Validating the Component of E-Learning Antecedents, Digital Readiness and Usage Behavior towards E-Learning Performance: A Pilot Study
Abstract
With its plethora of benefits, E-learning has the potential to attract students to an educational environment. Unfortunately, E-learning can cause students to become passive learners. Most learning occurs asynchronously, and students typically feel estranged from their instructors and peers. This paper explains the pilot test approach to a proposed framework model based on E-learning antecedents, digital readiness, usage behavior and E-learning performance, before embarking on the extensive research necessary to develop best practices in E-learning. The content validity index and a pilot study were used to determine the usability and reliability of a survey questionnaire. Based on a simple random sampling plan, an online survey method was used to gather data from 102 respondents at the Universiti Teknikal Malaysia Melaka, Malaysia. The results indicate that the instrument's content validity index value is 0.97, which is significantly greater than the cut-off value of 0.8. The Cronbach alpha values for most of the constructs in the proposed framework model ranged between 0.905 and 0.970, indicating that the constructs are highly reliable. To contribute to the body of knowledge, the researchers provide an overview of the pilot test procedures as well as the methodology that was utilized. Based on the integration of the unified theory of acceptance and use of technology and task-technology fit models, a proposed framework model is presented to provide a more comprehensive framework model. It is concluded that the questionnaire items are adequate and acceptable for further investigation on a broader scale. Thus, the instrument can be examined further in other settings.
https://doi.org/10.26803/ijlter.21.10.9
Keywords
Full Text:
PDFReferences
Abdullah, J. M., Ismail, W. F. N. M. W., Mohamad, I., Ab Razak, A., Harun, A., Musa, K. I., & Lee, Y. Y. (2020). A critical appraisal of COVID-19 in Malaysia and beyond. The Malaysian Journal of Medical Sciences, 27(2), 1–9. http://doi.org/10.21315/mjms2020.27.2.1
Adams, D., Chuah, K. M., Mohamed, A., & Sumintono, B. (2021). Bricks to clicks: Students’ engagement in E-learning during the COVID-19 pandemic. Asia Pacific Journal of Educators and Education, 36(2), 99-117. https://doi.org/10.21315/apjee2021.36.2.6
Adams, D., & Dewitt, D. (2021). Innovative practices of technology-enhanced learning. Universiti Pendidikan Sultan Idris.
Ajzen, I. (2020). The theory of planned behaviour: Frequently asked questions. Human Behavior and Emerging Technologies, 2(4), 314-324. https://doi.org/10.1002/hbe2.195
Al-Kumaim, N. H., Alhazmi, A. K., Mohammed, F., Gazem, N. A., Shabbir, M. S., & Fazea, Y. (2021). Exploring the impact of the COVID-19 pandemic on university students’ learning life: An integrated conceptual motivational model for sustainable and healthy online learning. Sustainability, 13(5), 2546. https://doi.org/10.3390/su13052546
Almaiah, M. A. & Al-Khasawneh, A. (2020). Investigating the main determinants of mobile cloud computing adoption in university campus. Education and Information Technologies, 25(4), 3087–3107. https://doi.org/10.1007/s10639-020-10120-8
Ayaz, A. & Yanarta?, M. (2020). An analysis on the unified theory of acceptance and use of technology theory (UTAUT): Acceptance of electronic document management system (EDMS). Computers in Human Behavior Reports, 2, 100032. https://doi.org/10.1016/j.chbr.2020.100032
Azizan, S. N., Hoong, A. L. S., Crosling, G., & Atherton, G. (2021). Academic staff’s perspective on blended learning practices in higher education post COVID-19: A case study of a Singaporean university. Asia Pacific Journal of Educators and Education, 36(2), 206-231. https://doi.org/10.21315/apjee2021.36.2.11
Babin, B. J., & Zikmund, W. G. (2015). Exploring marketing research. Cengage Learning.
Cheng, L., Ritzhaupt, A. D., & Antonenko, P. (2019). Effects of the flipped classroom instructional strategy on students’ learning outcomes: A meta-analysis. Educational Technology Research and Development, 67, 793–824. https://doi.org/10.1016/j.edurev.2019.05.003
Cidral, W. A., Oliveira, T., Di Felice, M., & Aparicio, M. (2018). E-learning success determinants: Brazilian empirical study. Computers & Education, 122, 273–290. https://doi.org/10.1016/j.compedu.2017.12.001
Coman, C., ?îru, L.G., Mese?an-Schmitz, L., Stanciu, C. & Bularca, M.C. (2020). Online teaching and learning in higher education during the Coronavirus pandemic: Students’ perspective. Sustainability, 12(24), 10367. https://doi.org/10.3390/su122410367
Cooper, D. R., & Schindler, P. S. (2011). Business research methods (11th ed.). McGraw-Hill.
Cortina, J. M. (1993). What is coefficient alpha? An examination of theory and applications. Journal of Applied Psychology, 78(1), 98–104. https://doi.org/10.1037/0021-9010.78.1.98
Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16(3), 297–334. https://doi.org/10.1007/BF0231055
D'Ambra, J., Wilson, C. S., & Akter, S. (2013). Application of the task?technology fit model to structure and evaluate the adoption of e?books by academics. Journal of the American Society for Information Science and Technology, 64(1), 48–64. https://doi.org/10.1002/asi.22757
Davis, L. (1992). Instrument review: Getting the most from your panel of experts. Applied Nursing Research, 5(4), 194–197. https://doi.org/10.1016/S0897-1897(05)80008-4
Deng, L., & Tavares, N. J. (2013). From Moodle to Facebook: Exploring students’ motivation and experiences in online communities. Computers and Education, 68, 167–176. https://doi.org/10.1016/j.compedu.2013.04.028
Dwivedi, Y. K., Rana, N. P., Jeyaraj, A., Clement, M., & Williams, M. D. (2019). Re-examining the unified theory of acceptance and use of technology (UTAUT): Towards a revised theoretical model. Information Systems Frontiers, 21(3), 719–734. https://doi.org/10.1007/s10796-017-9774-y
Eze, S. C., Chinedu-Eze, V. C., Okike, C. K. & Bello, A. O. (2020). Factors Influencing the Use Of E-learning Facilities by Students in A Private Higher Education Institution (HEI) in A Developing Economy. Humanities and Social Sciences Communications, 7(1), Art No. 133. https://doi.org/10.1057/s41599-020-00624-6
Fantz, T. D., Siller, T. J., & Demiranda, M. A. (2011). Pre?collegiate factors influencing the self?efficacy of engineering students. Journal of Engineering Education, 100(3), 604–623. https://doi.org/10.1002/j.2168-9830.2011.tb00028.x
Feng, Q., Song, Q., Zhang, L., Zheng, S. & Pan, J. (2020). Integration of moderation and mediation in a latent variable framework: A comparison of estimation approaches for the second-stage moderated mediation model. Frontiers In Psychology, 11:2167. https://doi.org/10.3389/fpsyg.2020.02167
Fernández-Gómez, E., Martín-Salvador, A., Luque-Vara, T., Sánchez-Ojeda, M. A., Navarro-Prado, S., & Enrique-Mirón, C. (2020). Content validation through expert judgement of an instrument on the nutritional knowledge, beliefs, and habits of pregnant women. Nutrients, 12(4), 1136. https://doi.org/10.3390/nu12041136
Fraser, J., Fahlman, D. W., Arscott, J., & Guillot, I. (2018). Pilot testing for feasibility in a study of student retention and attrition in online undergraduate programs. The International Review of Research in Open and Distributed Learning, 19(1), 261–278. https://doi.org/10.19173/irrodl.v19i1.3326
Gaur, P. S., Zimba, O., Agarwal, V., & Gupta, L. (2020). Reporting surve based studies—A primer for authors. Journal of Korean Medical Science, 35(45), e398. https://doi.org/10.3346/jkms.2020.35. e398
Gherhe?, V., Stoian, C. E., F?rca?iu, M. A., & Stanici, M. (2021). E-learning Vs. Face-to-face learning: Analysing students’ preferences and behaviors. Sustainability, 13(8), 4381. https://doi.org/10.3390/su13084381
Goodhue, D. L., & Thompson, R. L. (1995). Task-technology fit and individual performance. MIS Quarterly, 19(2), 213–236. https://doi.org/10.2307/249689
Hailegebreal, S., Sedi, T. T., Belete, S., Mengistu, K., Getachew, A., Bedada, D., & Mengiste, S. A. (2022). Utilization of information and communication technology (ICT) among undergraduate health science students: a cross-sectional study. BMC Medical Education, 22(1), 1–7. https://doi.org/10.1186%2Fs12909-022-03296-9
Hair, J.F., Ringle, C., & M. Sarstedt, (2010). Partial least squares structural equation modeling: Rigorous applications, better results and higher acceptance. Long Range Planning, 46(1–2), 1–12. https://doi.org/10.1016/j.lrp.2013.08.016
Hair, J.F., Ringle, C.M., & M. Sarstedt, (2011). PLS-SEM: Indeed a silver bullet. Journal of Marketing Theory and Practice, 19(2), 139-152. https://doi.org/10.2753/MTP1069-6679190202
Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2018). Multivariate data analysis (8th ed.). Cengage Learning.
Hasim, M. A., Jabar, J., & Murad, A. M. (2019). A preliminary research on consumer acceptance in nanofood towards purchase intention: A pilot research. International Journal of Recent Technology and Engineering, 8(2S3), 352-356. https://doi.org/10.35940/ijrte.B1060.0782S319
Heilporn, G., Lakhal, S., & Bélisle, M. (2021). An examination of teachers’ strategies to foster student engagement in blended learning in higher education. International Journal of Educational Technology in Higher Education, 18(1), 1–25. https://doi.org/10.1186/s41239-021-00260-3
Hill, R. (1998). What sample size is “enough” in internet survey research? Interpersonal Computing and Technology: An Electronic Journal for the 21st Century, 6(3-4), 1-10.
In, J. (2017). Introduction of a pilot study. Korean Journal of Anesthesiology, 70(6), 601. https://doi.org/10.4097/kjae.2017.70.6.601
Isaac, S., & Michael, W. B. (1995). Handbook in research and evaluation. Educational and Industrial Testing Services. https://doi.org/10.1177/105960118200700111
Jie, S. S., & Fernandez, D. F. M. F. (2021). Factors influencing student’s behavioural intention towards the use of e-learning during Covid-19 in Malaysia. Research in Management of Technology and Business, 2(2), 952–964. https://doi.org/10.30880/rmtb.2021.02.02.068
Kim, H. J., Hong, A. J., & Song, H. D. (2019). The roles of academic engagement and digital readiness in students’ achievements in university E-learning environments. International Journal of Educational Technology in Higher Education, 16(1), 21. https://doi.org/10.1186/s41239-019-0152-3
Krejcie, R. V., & Morgan, D. W. (1970). Determining sample size for research activities. Educational and Psychological Measurement, 30(3), 607–610. https://doi.org/10.1177/001316447003000308
Lancaster, G. A., (2015). Pilot and feasibility studies come of age! Pilot and Feasibility Studies, 1(1), 1-4. https://doi.org/10.1186/2055-5784-1-1
Mamaril, N. A., Usher, E. L., Li, C. R., Economy, D. R., & Kennedy, M. S. (2016). Measuring undergraduate students' engineering self?efficacy: A validation study. Journal of Engineering Education, 105(2), 366–395. https://doi.org/10.1002/jee.20121
Memon, M. A., Ting, H., Cheah, J. H., Thurasamy, R., Chuah, F., & Cham, T. H. (2017). A review of the methodological misconceptions and guidelines related to the application of structural equation modelling: A Malaysian scenario. Journal of Applied Structural Equation Modeling, 1(1), 1–13. http://ir.unimas.my/id/eprint/24308
Memon, M. A., Ting, H., Cheah, J. H., Thurasamy, R., Chuah, F., & Cham, T. H. (2020). Sample size for survey research: Review and recommendations. Journal of Applied Structural Equation Modeling, 4(2), 1–20. https://doi.org/10.47263/JASEM.4(2)01
Miller, R. (2018). Transforming the future: Anticipation in the 21st century. Routledge. https://doi.org/10.4324/9781351048002
Mustafa, N. (2020). Impact of the 2019–20 Coronavirus pandemic on education. International Journal of Health Preferences Research, 1–12.
Nurakun, K. Z., Ismailova, R., & Dündar, H. (2018). Learning management system implementation: A case study in the Kyrgyz Republic. Interactive Learning Environments, 26(8), 1010–1022. https://doi.org/10.1080/10494820.2018.1427115
Osman, Z., Mohamad, W., Mohamad, R. K., Mohamad, L., & Sulaiman, T. F. T. (2018). Enhancing students’ academic performance in Malaysian online distance learning institutions. Asia Pacific Journal of Educators and Education, 33, 19–28. http://apjee.usm.my/APJEE_33_2018/APJEE%2033_Art2%20(19-28).pdf
Parkes, M., Stein, S., & Reading, C. (2015). Student preparedness for university E-learning environments. The Internet and Higher Education, 25, 1-10. https://doi.org/10.1016/j.iheduc.2014.10.002
Ponto, J. (2015). Understanding and evaluating survey research. Journal of the Advanced Practitioner in Oncology, 6(2), 168–171. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4601897/
Rapanta, C., Botturi, L., Goodyear, P., Guardia, L. and Koole, M. (2020), Online university teaching during and after the Covid-19 crisis: Refocusing teacher presence and learning activity. Postdigital Science and Education, 2(3), 923–945. https://doi.org/10.1007/s42438-020-00155-y
Rashid, T., & Asghar, H. M. (2016). Technology use, self-directed learning, student engagement and academic performance: Examining the interrelations. Computers in Human Behaviour, 63, 604–612. https://doi.org/10.1016/j.chb.2016.05.084
Saunders, M., Lewis, P., & Thornhill, A. (2019). Research methods for business students. Pearson Publications.
Sekaran, U., & Bougie, R. 2016. Research methods for business: A skill building approach (7th ed.). Wiley.
Sun, A. & Chen, X. (2016). Online education and its effective practice: A research review. Journal of Information Technology Education, 15, 157–190. http://www.informingscience.org/Publications/3502
Taber, K. S. (2018). The use of Cronbach’s alpha when developing and reporting research instruments in science education. Research in Science Education, 48(6), pp. 1273–1296. https://doi.org/10.1007/s11165-016-9602-2
Tang, Y. M., Chen, P. C., Law, K. M., Wu, C. H., Lau, Y. Y., Guan, J., He, D., & Ho, G. T. (2021). Comparative analysis of student’s live online learning readiness during the Coronavirus (COVID-19) pandemic in the higher education sector. Computers & Education, 168, 104211. https://doi.org/10.1016%2Fj.compedu.2021.104211
Van Teijlingen, E., & Hundley, V. (2002). The importance of pilot studies. Nursing Standard, 16(40), 33–36. https://doi.org/10.7748/ns2002.06.16.40.33.c3214
Vavasseur, A., Muscari, F., Meyrignac, O., Nodot, M., Dedouit, F., Revel-Mouroz, P., Dercle, L., Rozenblum, L., Wang, L., Maulat, C., Rousseau, H., Otal, P., Dercle, L., & Mokrane, F. Z. (2020). Blended learning of radiology improves medical students’ performance, satisfaction, and engagement. Insights into Imaging, 11, 1–12. https://doi.org/10.1186%2Fs13244-020-00865-8
Venkatesh, V., Morris, M. G., Davis, G. B., & Davis, F. D. (2003). User acceptance of information technology: Toward a unified view. MIS Quarterly, 27, 425–478. https://doi.org/10.2307/30036540
Vongjaturapat, S. (2018). Application of the task-technology fit model to structure and evaluation of the adoption of smartphones for online library systems. Science and Technology Asia, 23(1), 39–56. https://ph02.tci-thaijo.org/index.php/SciTechAsia/article/view/124831
Wedlock, B. C., & Trahan, M. P. (2019). Revisiting the unified theory of acceptance and the use of technology (UTAUT) model and scale: An empirical evolution of educational technology. Research Issues in Contemporary Education, 4(1), 6–20.
Whitehead, A. L., Julious, S. A., Cooper, C. L., & Campbell, M. J. (2016). Estimating the sample size for a pilot randomised trial to minimize the overall trial sample size for the external pilot and main trial for a continuous outcome variable. Statistical Methods in Medical Research, 25(3), 1057–1073. https://doi.org/10.1177/0962280215588241
Yang, N. (2020). eLearning for quality teaching in higher education: Teachers’ perception, practice, and interventions. Springer Nature.
Yusoff, M. S., & Tengku Ariffin, T. F. (2021). Development and validation of contextual leadership instrument for principals in Malaysian school context (MyCLIPS). Leadership and Policy in Schools, 1-16. https://doi.org/10.1080/15700763.2021.1971259
Zainab, A. M., Kiran, K., Karim, N. H. A., & Sukmawati, M. (2018). UTAUT’S performance consistency: Empirical evidence from a library management system. Malaysian Journal of Library and Information Science, 23(1), 17–32. https://doi.org/10.22452/mjlis.vol23no1.2
Zalat, M. M., Hamed, M. S., & Bolbol, S. A. (2021). The experiences, challenges, and acceptance of E-learning as a tool for teaching during the COVID-19 pandemic among university medical staff. PLoS One, 16(3), e0248758. https://doi.org/10.1371/journal.pone.0248758
Zun, A. B., Ibrahim, M. I., Mokhtar, A. M., Halim, A. S., & Wan Mansor, W. N. A. (2019). Translation, cross-cultural adaptation, and validation of the hospital consumer assessment of healthcare providers and systems (HCAHPS) into the Malay language. International Journal of Environmental Research and Public Health, 16(11), 2054. https://doi.org/10.3390/ijerph16112054
Refbacks
- There are currently no refbacks.
e-ISSN: 1694-2116
p-ISSN: 1694-2493