Examining the Critical Success Factors of E-Learning Using Structural Equation Model: A Case Study on the Mandatory Use

Main Article Content

Srinual Nalintippayawong*
Nattamol Kladyoo
Juthamart Phengkhlai

Abstract

Several researchers have studied e-learning success factors. However, there is rare research linking the success factors from the student perceptions to their data stored in the e-learning system, i.e., the student usage behavior and learning achievement.  In addition, there is little research in the literature on mandatory use contexts. Thus, this study aimed to systematically examine and investigate the critical success factors (CSFs) of e-learning used for e-learning evaluation, using an e-learning system in mandatory use as a case study. The study is based on the D&M IS success model, the user satisfaction model, and success factors of e-learning systems. A structural equation model was used to analyze the data collected from 221 undergraduate students who used the system. The results indicated that e-learning success factors were information quality, system quality, instructor characteristics, diversity of assessment, system use, user satisfaction, benefits, and learning performance. In addition, system use has a highly positive and significant effect on learning performance, whereas the perceived benefits are determined by system use, instructor characteristics, information quality, and user satisfaction. Besides, instructor characteristics, system quality, and diversity of assessment had positive impact on user satisfaction. The findings provide insights to practitioners, academics, and policymakers to help them focus on factors that can be used to improve and evaluate the e-learning system. Our study contributes to the body of knowledge on e-learning system success and evaluation in mandatory use contexts.


Keywords: critical success factors (CSF); e-learning success factors; information systems success; e-learning evaluation; structural equation modeling (SEM)


*Corresponding author: Tel.: (+66) 0899005668


                                              E-mail: srinual@it.kmitl.ac.th

Article Details

Section
Original Research Articles

References

Xaymoungkhoun, O., Bhuasiri, W., Rho, J.J., Zo, H. and Kim, M., 2012. The critical success factors of e-learning in developing countries. Kasetsart Journal of Social Sciences, 33(2), 321-332.

Kerzˇič, D., Tomazˇevič, N., Aristovnik, A. and Umek, L., 2019. Exploring critical factors of the perceived usefulness of blended learning for higher education students. PLOS One, 14(11), DOI: 10.1371/journal.pone.0223767.

Nalintippayawong, S., Atchariyachanvanich, K. and Julavanich, T., 2017. DBLearn: Adaptive e-learning for practical database course: An integrated architecture approach. 2017 18th IEEE/ACIS International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing (SNPD), Kanazawa, Japan, June 26-28, 2017, pp. 109-114.

Bani-Salameh, B. and Fakher, S.A., 2015. E-learning critical success factors model: Empirical investigation. Proceedings of the International Conference on Intelligent Information Processing, Security and Advanced Communication, Batna, Algeria, November 23-25, 2015, pp. 1-6.

DeLone, H.W. and McLean, R.E., 2003. The DeLone and McLean model of information systems success: A ten-year update. Journal of Management Information Systems, 19(4), 9-30, DOI: 10.1080/07421222.2003.11045748.

Lai, P.C., 2017. The literature review of technology adoption models and theories for the novelty technology. Journal of Information Systems and Technology Management, 14(1), 21-38, DOI: 10.4301/s1807-17752017000100002.

Al-Fraihat, D., Joy, M., Masa'deh, R. and Sinclair, J., 2020. Evaluating e-learning systems success story: An empirical study. Computers in Human Behavior, 102, 67-86, DOI: 10.1016/j.chb.2019.08.004.

Raspopovic, M., Jankulovic, A., Runic, J. and Lucic, V., 2014. Success factors for e-learning in a developing country: A case study of Serbia. International Review of Research in Open and Distributed Learning, 15(3), DOI: 10.19173/irrodl.v15i3.1586.

Alhabeeb, A. and Rowley, J., 2018. E-learning critical success factors: Comparing perspectives from academic staff and students. Computers and Education, 127(4), 1-12, DOI: 10.1016/j.compedu.2018.08.007.

Soleimani, M.S., Jaeger M., Faheiman A. and Alaqqad, R.A., 2022. Success factors of recently implemented eLearning methods at higher education institutions in Kuwait. Quality in Higher Education, DOI: 10.1080/13538322.2022.2132702.

Truong, T.T.H., Nguyen, T.H.V., Le, T.L. and Truong, T.A.N., 2021. Critical success factors for e-learning at university level: a case study from Danang University of Technology and Education (UTE-DN). Journal of Technical Education Science, (62), 65-73, DOI: 10.54644/jte.62.2021.77.

Do, T.X., Tran, H.T.L. and Le, T.T., 2022. Factors influencing the E-learning system usage during the COVID-19 pandemic in Vietnam. PLOS One, 17(12), DOI: 10.1371/journal.pone.0278109.

König, C.M., Karrenbauer, C. and Breitner, M.H., 2022. Critical success factors and challenges for individual digital study assistants in higher education: A mixed methods analysis. Education and Information Technologies, 28, DOI: 10.1007/s10639-022-11394-w.

Aparicio, M., Bacao, F. and Oliveira, T., 2016. Cultural impacts on e-learning systems' success. The Internet and Higher Education, 31, 58-70, DOI: 10.1016/j.iheduc.2016.06.003.

DeLone, H.W. and McLean, R.E., 2016. Information Systems Success Measurement. Boston: Now Publishers Inc.

Chang, C., Hajiyev, J. and Su, C., 2017. Examining the students’ behavioral intention to use e-learning in Azerbaijan. Computers and Education, 111, 128-143, DOI: 10.1016/j.compedu.2017.04.010.

Hew, F.K., Hu, X., Qiao, C. and Tang, Y., 2020. What predicts student satisfaction with MOOCs: A gradient boosting trees supervised machine learning and sentiment analysis approach. Computers and Education, 145, DOI: 10.1016/j.compedu.2019.103724.

Hassanzadeh, A., Kanaani, F. and Elahi, S., 2012. A model for measuring e-learning systems success in universities. Expert Systems with Applications, 39(12), 10959-10966, DOI: 10.1016/j.eswa.2012.03.028.

Freeze, D.R., Alshare, A.K., Lane, L.P. and Wen, J.H., 2010. IS Success model in e-learning context based on students’ perceptions. Journal of Information Systems Education, 21(2), 173-184.

Cidrala, A.W., Oliveira, T., Felice, Di M. and Aparicio, M., 2018. E-learning success determinants: Brazilian empirical study. Computers and Education, 122, 273-290, DOI: 10.1016/j.compedu.2017.12.001.

Aparicio, M., Bacao, F. and Oliveira, T., 2017. Grit in the path to e-learning success. Computers in Human Behavior, 66, 388-399, DOI: 10.1016/j.chb.2016.10.009.

Martins, J., Branco, F., Gonçalves, R., Au-Yong-Oliveira, M., Oliveira, T., Naranjo-Zolotov, M. and Cruz-Jesus, F., 2019. Assessing the success behind the use of education management information systems in higher education. Telematics and Informatics, 38, 182-193, DOI: 10.1016/j.tele.2018.10.001.

Martina, F., Ritzhauptb, A., Kumarb, S. and Budhrania, K., 2019. Award-winning faculty online teaching practices: Course design, assessment and evaluation, and facilitation. The Internet and Higher Education, 42, 34-43, DOI: 10.1016/j.iheduc.2019.04.001.

Atchariyachanvanich, K., Nalintippayawong, S. and Julavanich, T., 2019. Reverse SQL question generation algorithm in the DBLearn adaptive e-learning system. IEEE Access, 7, 54993-55004, DOI: 10.1109/ACCESS.2019.2912522.

Schumacker, E.R. and Richard, G.L., 2010. A Beginner’s Guide to Structural Equation Modeling. 3rd ed. New York: Taylor and Francis Group.

Civelek, E.M., 2018. Essentials of Structural Equation Modeling. Nebraska: Zea Books.

Hair, F.J.Jr., Black, C.W., Babin, J.B. and Andersonk, E.R., 2014. Multivariate Data Analysis. 7th ed. Harlow: Pearson Education Limited.

Alsabawy, Y.A., Steel, C.A. and Soar, J., 2016. Determinants of perceived usefulness of e-learning systems. Computers in Human Behavior, 64, 843-858, DOI: 10.1016/j.chb.2016.07.065.

Yakubu, N.M. and Dasuk, I.S., 2018. Assessing e-learning systems success in Nigeria: an application of the DeLone and McLean information systems success model. Journal of Information Technology Education: Research, 17, 183-203.

Al-Gahtani, S.S., 2016. Empirical investigation of e-learning acceptance and assimilation: A structural equation model. Applied Computing and Informatics, 12(1), 27-50, DOI: 10.1016/j.aci.2014.09.001.

Al-rahmi, M.W., Othman, S.M. and Yusuf, M.L., 2015. Exploring the factors that affect student satisfaction through using e-learning in Malaysian higher education institutions. Mediterranean Journal of Social Sciences, 6(4), DOI: 10.5901/mjss.2015.v6n4s1p299.

Asoodar, M., Vaezi, S. and Izanloo, B., 2016. Framework to improve e-learner satisfaction and further strengthen e-learning implementation. Computers in Human Behavior, 63, 704-716, DOI: 10.1016/j.chb.2016.05.060.

Malkanthie, A., 2015. Structural Equation Modeling with AMOS. [online] Available at: https://www.researchgate.net/publication/278889068_Structural_Equation_Modeling_with_AMOS.

Kline, B.R., 2011. Principles and Practice of Structural Equation Modeling. 3rd ed. New York: A Division of Guilford Publications.

Aziz, S.F.A., Manap, J., Kasim, A.C., Selamat, M.N., Tambi, N. and Idris, F., 2015. Does classroom characteristic truly stimulate learning motivation and performance? Reporting from Malaysian undergraduates’ perception. Asian Social Science, 11(15), DOI: 10.5539/ass.v11n15p84.

Holmes, S.P., 2011. Advanced Structural Equation Modelling Using Amos. Clayton: Monash University: Australian Consortium for Social and Political Research Incorporated.