Developing Performance Assessment Instruments to Measure 4C Skills in Online Discussion Activities of Science Learning

Yuyun Maryuningsih; Topik Hidayat; Riandi Riandi; Nuryani Rustaman

doi:10.24235/sc.educatia.v9i1.7500

Developing Performance Assessment Instruments to Measure 4C Skills in Online Discussion Activities of Science Learning

Yuyun Maryuningsih^(1*), Topik Hidayat⁽²⁾, Riandi Riandi⁽³⁾, Nuryani Rustaman⁽⁴⁾,

(1) Department of Biology Education, Faculty of Education and Teacher Training, IAIN Syekh Nurjati Cirebon
(2) Science Education Study Program, Graduate School, Universitas Pendidikan Indonesia
(3) Science Education Study Program, Graduate School, Universitas Pendidikan Indonesia
(4) Science Education Study Program, Graduate School, Universitas Pendidikan Indonesia
(*) Corresponding Author

Abstract

The 21st century learning utilizes information technology for various activities, including online discussion forums, to increase students’ learning activities and learning interaction. The 4C’s performance assessment instrument in the online discussion forum is not yet available, thus, a 4C’s assessment, including communication, collaboration, critical thinking, and innovative creative thinking skills, is necessary to assess students’ performance in the process of online discussion activities. This research aims to develop 4C’s performance assessment instruments in the online discussion process using the ADDIE model. Meanwhile, instrument development included analysis, design, development, implementation, and evaluation. The instruments were in the form of observation sheets and assessment rubrics. This study tested 4C’s observation instruments in 104 students in online discussion activities during four online discussion activities. Data analysis included construct validity and reliability of each instrument indicator. The data analysis reveals that the 4C’s performance instruments are useable to measure students’ 4C’s skills in online discussion forums.

Keywords

4C’s skills, Critical thinking, Performance assessment, Online discussion, 21st century skills

Full Text:

PDF

References

Akyol, Z., & Garrison, D. R. (2011). Understanding cognitive presence in an online and blended community of inquiry: Assessing outcomes and processes for deep approaches to learning. British Journal of Educational Technology, 42(2), 233-250.

Ancok, D. (2002). Teknik penyusunan skala pengukur. Pusat Studi Kependudukan dan Kebijakan UGM.

Armstrong, M. (1978). Assessing students’participation in class discussion. Assessment in Higher Education, 3(3), 186-202.

Armstrong, M., & Boud, D. (1983). Assessing participation in discussion: An exploration of the issues. Studies in Higher Education, 8(1), 33-44.

Awada, G. (2016). Effect of WhatsApp on critique writing proficiency and perceptions toward learning. Cogent Education, 3(1), 1264173.

Baird, J. A., Andrich, D., Hopfenbeck, T. N., & Stobart, G. (2017). Assessment and learning: Fields apart?. Assessment in Education: Principles, Policy & Practice, 24(3), 317-350.

Balaji, M. S., & Chakrabarti, D. (2010). Student interactions in online discussion forum: Empirical research from'media richness theory'perspective. Journal of interactive online learning, 9(1), 1-22.

Balla, J., & Boyle, P. (1994). Assessment of student performance: a framework for improving practice. Assessment & Evaluation in Higher Education, 19(1), 17-28.

Beuchot, A., & Bullen, M. (2005). Interaction and interpersonality in online discussion forums. Distance Education, 26(1), 67-87.

Biasutti, M. (2017). A coding scheme to analyse the online asynchronous discussion forums of university students. Technology, Pedagogy and Education, 26(5), 601-615.

Binkley, M., Erstad, O., Herman, J., Raizen, S., Ripley, M., Miller-Ricci, M., & Rumble, M. (2012). Defining twenty-first century skills. In Assessment and teaching of 21st century skills (pp. 17-66). Springer, Dordrecht.

Black, P., & Wiliam, D. (2018). Classroom assessment and pedagogy. Assessment in Education: Principles, Policy & Practice, 25(6), 551-575.

Brent, S., Draper, N., Hodgson, C., & Blackwell, G. (2009). Development of a performance assessment tool for rock climbers. European Journal of Sport Science, 9(3), 159-167.

Cann, A. J., Calvert, J. E., Masse, K. L., & Moffat, K. G. (2006). Assessed online discussion groups in biology education. Bioscience Education, 8(1), 1-11.

Charalambos, V., Michalinos, Z., & Chamberlain, R. (2004). The design of online learning communities: Critical issues. Educational Media International, 41(2), 135-143.

Christopher, M. M., Thomas, J. A., & Tallent‐Runnels, M. K. (2004). Raising the bar: Encouraging high level thinking in online discussion forums. Roeper Review, 26(3), 166-171.

Conole, G., & Fill, K. (2005). A learning design toolkit to create pedagogically effective learning activities. Journal of Interactive Media in Education, (1), 1-16.

Copping, A. (2018). Exploring connections between creative thinking and higher attaining writing. Education 3-13, 46(3), 307-316.

Cross, T., & Palese, K. (2015). Increasing learning: Classroom assessment techniques in the online classroom. American Journal of Distance Education, 29(2), 98-108.

Donovan, L., Green, T. D., & Mason, C. (2014). Examining the 21st century classroom: Developing an innovation configuration map. Journal of Educational Computing Research, 50(2), 161-178.

Dubuclet, K. S., Lou, Y., & MacGregor, K. (2015). Design and cognitive level of student dialogue in secondary school online courses. American Journal of Distance Education, 29(4), 283-296.

Ercikan, K., & Oliveri, M. E. (2016). In search of validity evidence in support of the interpretation and use of assessments of complex constructs: Discussion of research on assessing 21st century skills. Applied Measurement in Education, 29(4), 310-318.

Facione, P. (1990). Critical thinking: A statement of expert consensus for purposes of educational assessment and instruction (The Delphi Report). Retrieved from https://philarchive. org/archive/FACCTA

Fattah, S. F. E. S. A. (2015). The effectiveness of using whatsapp messenger as one of mobile learning techniques to develop students' writing skills. Journal of Education and practice, 6(32), 115-127.

Huxham, M., Campbell, F., & Westwood, J. (2012). Oral versus written assessments: A test of student performance and attitudes. Assessment & Evaluation in Higher Education, 37(1), 125-136.

Kivunja, C. (2015). Teaching students to learn and to work well with 21st century skills: Unpacking the career and life skills domain of the new learning paradigm. International Journal of Higher Education, 4(1), 1-11.

Kurt, S. (2019). An introduction to the addie model: Instructional design: The Addie approach. Independently Published.

Landis, M., Swain, K. D., Friehe, M. J., & Coufal, K. L. (2007). Evaluating critical thinking in class and online: Comparison of the newman method and the facione rubric. Communication Disorders Quarterly, 28(3), 135-143.

Lee, J. (2008). Rating scales for interpreting performance assessment. The interpreter and translator trainer, 2(2), 165-184.

Liu, X., Li, L., & Zhang, Z. (2018). Small group discussion as a key component in online assessment training for enhanced student learning in web-based peer assessment. Assessment & Evaluation in Higher Education, 43(2), 207-222.

Maryuningsih, Y., Hidayat, T., Riandi, R., & Rustaman, N. (2019). Developing Gen-21cs on smartphone to cultivate the 21st-century skills on biology teacher candidates. JPBI (Jurnal Pendidikan Biologi Indonesia), 5(3), 415-424.

Maryuningsih, Y., Hidayat, T., Riandi, R., & Rustaman, N. Y. (2019, February). Critical thinking skills of prospective biology teacher on the chromosomal basic of inheritance learning through online discussion forums. In Journal of Physics: Conference Series (Vol. 1157, No. 2, p. 022090). IOP Publishing.

Matheson, R., Wilkinson, S. C., & Gilhooly, E. (2012). Promoting critical thinking and collaborative working through assessment: Combining patchwork text and online discussion boards. Innovations in Education and Teaching International, 49(3), 257-267.

McLoughlin, D., & Mynard, J. (2009). An analysis of higher order thinking in online discussions. Innovations in Education and Teaching International, 46(2), 147-160.

National Education Association. (2012). Preparing 21st century students for a global society: An educator’s guide to the “Four Cs”. National Education Association.

O'Reilly, M., & Newton, D. (2002). Interaction online: Above and beyond requirements of assessment. Australasian Journal of Educational Technology, 18(1), 57-70.

Rovai, A. P. (2007). Facilitating online discussions effectively. The Internet and Higher Education, 10(1), 77-88.

Spatariu, A., Hartley, K., & Bendixen, L. D. (2004). Defining and measuring quality in online discussions. The Journal of Interactive Online Learning, 2(4), 1-15.

Thomas, J. E., & Graham, C. R. (2019). Online teaching competencies in observational rubrics: what are institutions evaluating?. Distance Education, 40(1), 114-132.

Todd, A., & Romine, W. L. (2017). Empirical validation of a modern genetics progression web for college biology students. International Journal of Science Education, 39(4), 488-505.

Wanas, N., El-Saban, M., Ashour, H., & Ammar, W. (2008, October). Automatic scoring of online discussion posts. In Proceedings of the 2nd ACM workshop on Information credibility on the web (pp. 19-26).

Wilson, M., Gochyyev, P., & Scalise, K. (2016). Assessment of Learning in Digital Interactive Social Networks: A Learning Analytics Approach. Online Learning, 20(2), 97-119.

Wolf, T. J., Dahl, A., Auen, C., & Doherty, M. (2017). The reliability and validity of the Complex Task Performance Assessment: A performance-based assessment of executive function. Neuropsychological rehabilitation, 27(5), 707-721.

DOI: 10.24235/sc.educatia.v9i1.7500