Predicting Continuance Intention to Use Learning Management Systems among Undergraduates: The Moderating Effect of Intrinsic Motivation

Abstract

Learning Management Systems (LMS) are crucial in modern educational technology, enhancing education through personalized support, efficient resource management, and data-driven decision-making. LMS holds a pivotal position in contemporary higher education. This research explores undergraduate students’ continued learning intentions, grounded in the Expectation-Confirmation Model and Flow Theory, while assessing the moderating effect of intrinsic motivation within this context. From January to August 2023, an online survey gathered self-reported data on satisfaction, confirmation, perceived value, continued intention, flow experience, and intrinsic motivation from 232 undergraduate students across three universities in Henan Province using the Questionnaire Star platform. Analysis using Partial Least Squares Structural Equation Modeling (PLS-SEM) confirmed all research hypotheses except for the insignificant impact of flow on satisfaction and continued intention, demonstrating the model’s significant explanatory power for continued intention, explaining 90.8% of the variance. The adjusted R² was 90.6%, and the Q² value reached 78.5%. Intrinsic motivation was found to moderate the relationship between satisfaction and continued intention positively, but it did not affect the relationship between perceived value and continued intention. The findings underscore the importance of LMS in educational settings and provide insights into enhancing user experience, student engagement, and satisfaction. Recommendations include the need for developers to improve the LMS interface and functionalities, for educators to enrich learning resources, and for students to recognize the value of LMS and set clear goals to foster their intrinsic motivation.

Plain language summary

Exploring Why University Students Want to Keep Using Online Learning Platforms: How Big of an Influence Does Personal Interest Have?

Learning Management Systems (LMS) are crucial in modern educational technology, enhancing education through personalized support, efficient resource management, and data-driven decision-making. LMS holds a pivotal position in contemporary higher education. This research explores undergraduate students’ continued learning intentions, grounded in the Expectation-Confirmation Model and Flow Theory, while assessing the moderating effect of intrinsic motivation. The analysis was conducted using Smart PLS. Smart PLS offers a myriad of benefits for data analysis, including handling non-normal data, accommodating small sample sizes, maximizing explanatory power for the variance of endogenous latent variables, and the capacity to process complex models. The objective of this study is to discern the maximum explanatory power of CI variance influenced by FLOW, CON, PV, SAT, and SAT. With a sample size of just 232 and encompassing six constructs, the study adopts a complex model framework. Given these conditions, Smart PLS is an apt choice for data analysis in this context. The primary contribution of this research is developing a multi-dimensional and comprehensive model for assessing college students’ CI to use LMS. Moreover, our findings suggest that the flow experience does not significantly affect CI use and satisfaction, differing from previous studies where FLOW significantly impacted university students’ CI to use e-learning.

Keywords

expectation-confirmation model flow theory intrinsic motivation learning management system continuance intention

Introduction

With the rapid advancement of information technology and the impact of the COVID-19 pandemic, the number of users engaging in online learning has been increasing daily. Online learning has emerged as one of the most significant advancements in information and communication technology and higher education (Dang et al., 2016). LMS, one of the most comprehensive and essential technologies within online learning, has attracted extensive research and attention. LMS are information systems designed to facilitate e-learning by processing, storing, and disseminating educational materials (McGill & Klobas, 2009). They play a pivotal role in modern education by offering opportunities for efficient management of educational resources, support for personalized learning, data-driven decision-making, and the provision of a globalized educational approach. They help enhance the quality and accessibility of education, providing a more flexible, sustainable, and personalized learning experience for both students and educators. Early research on LMS primarily focused on adoption (Kim et al., 2021; Navarro et al., 2021; Raza et al., 2021; Ustun et al., 2021). However, studies by Ashrafi et al. (2020) have found that the continuance intention (CI) to use LMS reflects their success more than the initial willingness to adopt. Hence, university students’ uniqueness in learning needs and new technology acceptance makes them ideal subjects for evaluating LMS effects and optimizing educational resources (Martín-García et al., 2019). Despite early studies concentrating on LMS adoption issues, recent research indicates that users’ CI to use LMS systems better reflects their success (Ashrafi et al., 2020). Therefore, this study aims to delve into university students’ CI to use LMS and explore this specific group’s characteristics and personalized needs.

Researchers have explored the factors and mechanisms influencing the CI using multiple theoretical frameworks, including the ECM (Li, Wang, Wei, 2022), TAM (Ashrafi et al., 2020), TTF (Navarro et al., 2021), Flow (Goh & Yang, 2021a), D&M ISSM (Alyoussef, 2023; Gu et al., 2021) and SDT (Su & Chen, 2020). By integrating two or more models or incorporating different constructs, researchers have extended the model frameworks or enhanced the predictive capability of the models (Y. M. Cheng, 2021; Dai, Teo, Rappa, 2020). However, despite the TTF, TAM, and ISSM models examining the use of information systems from different angles, including task-technology fit, users’ attitudes (ATT) toward technology, and the impact of system quality, these models have limitations. For instance, the TAM model lacks consideration for user differences, and the TTF model focuses on the match between tasks and technology. The ECM model emphasizes users’ experience, including satisfaction (SAT) and confirmation (CON), while Flow Theory explores the depth of users’ experiences with products. This study primarily relies on ECM and Flow Theory to explore how individuals form CI to use LMS based on their experiences. For example, Ashrafi et al. (2020), based on TAM and ECM, surveyed 153 university students on factors affecting the CI to use LMS. The results showed that this integrated model could explain 75.9% of the variance in CI within LMS. Furthermore, existing research has identified multiple factors influencing LMS’s CI, such as SAT (Alzahrani & Seth, 2021; X. Wu & Wang, 2020), engagement (Goh & Yang, 2021), performance expectation, social influence (Sirayos & Siriluck, 2021), perceived usefulness (PU) (Alturki & Aldraiweesh, 2021), perceived ease of use (PEOU) (M. Cheng & Yuen, 2018; Gu et al., 2021), perceived value (PV) (Y. Li et al., 2021), and ATT toward LMS content quality (Ashrafi et al., 2020; Niu & Wu, 2022), laying the foundation for our research on the factors influencing university students’ CI to use LMS and the moderating effect of intrinsic motivation (IM).

Despite the recent surge in interest in the continued use of learning management systems (LMS), noticeable gaps still exist in the literature. Firstly, from a theoretical standpoint, prior research on the CI to use LMS has primarily been based on single models such as the ECM and the TAM. However, these models alone are not sufficient to fully explain the CI of university students to use LMS. Specifically, studies are scarce integrating ECM with TAM to explore the CI of using LMS. Integrating ECM and TAM could provide a more comprehensive and in-depth understanding of the factors affecting students’ CI of LMS. Secondly, the role of students’ IM as a moderating factor in the CI to use LMS has been overlooked. IM regulates students’ learning performance, strategies, and outcomes (Rodríguez-Ardura & Meseguer-Artola, 2019). Students with high IM are typically more driven to pursue knowledge and skills, show greater interest in learning tasks, and achieve higher learning outcomes (Çebi, 2022).

Moreover, IM can help maintain long-term learning motivation, making students more likely to exhibit a higher CI when learning is driven by interest and autonomy (Shahri et al., 2019). By understanding how IM affects learning intentions, educators and developers can better design learning environments and resources that stimulate students’ inner drive, promoting deeper engagement and effectiveness in learning. Understanding the impact of IM on CI allows educators and developers to create learning environments and resources that motivate students intrinsically, encouraging the sustained use of LMS.

Compared to existing research, this study contributes in three primary ways: Firstly, it reveals the moderating effect of IM on the CI of undergraduate students to use LMS, an aspect previously overlooked in the literature. Secondly, by integrating the ECM and Flow theory, this research provides empirical evidence for predicting factors of CI for undergraduates using the LMS. Lastly, the results of this study can guide system developers and educators in formulating effective improvement strategies to enhance students’ SAT and CI.

This study aims to delve deeply into the factors affecting the CI of undergraduate students to use LMS and the moderating role of IM. Our research surveyed the CI of 232 undergraduate students from Chinese universities to use LMS. Additionally, we analyzed the collected data using Smart Partial Least Square 4.0 (Smart-PLS). Based on this, the research questions of this study are:

(1) What factors influence the CI of undergraduate students to use LMS?

(2) To what extent do these factors explain the variance of CI of university students to use LMS?

(3) Does IM have a moderating effect on the impact of SAT and PV on CI?

The following offers a brief overview of the structure of the remaining sections of this study. Literature concerning ECM, Flow, and IM will be discussed in the subsequent section. Based on the literature review in the second section, we present our research hypotheses in the third section. The fourth section provides a detailed account of the methods employed in this study for data collection and model testing. The fifth section analyzes the empirical test results. In the sixth section, we discuss the statistical findings. Finally, we elaborate on the theoretical implications, practical implications, limitations of the study, and directions for future research.

Literature Review

ECM

Based on the Expectation Confirmation Theory (ECT) and the TAM, Bhattacherjee (2001) introduced the ECM in 2001. The ECM primarily focuses on the investigation of CI within the framework of information systems. It is widely used to assess user SAT and post-purchase behavior (Ashrafi et al., 2020; Chiu et al., 2020; Dai, Teo, & Rappa, Huang, 2020; H. S. Lee & Cho, 2021). The model comprises four constructs: PU, Confirmation (CON), SAT, and CI, as illustrated in Figure 1. According to Bhattacherjee (2001), PU pertains to users’ judgment of the system’s utility, serving as a primary reason for individuals to adopt certain technologies at a given time. CON refers to users’ perception of the consistency between their expectations and the actual performance of the information system. SAT represents the users’ subjective evaluation and feelings about their overall experience and the performance of a product or service after use. CI indicates the inclination to keep using the system.

Figure 1.

ECM model.

Previous research has widely applied the ECM to study users’ CI, not limited to e-learning systems (Y. M. Cheng, 2020; Xu et al., 2022), e-governance (Hidayat-ur-Rehman et al., 2020), and mobile applications (Tam et al., 2018). It also encompasses various aspects of online education, such as online learning systems (Li, Wang, Wei, 2022), LMS (Ashrafi et al., 2020), e-learning (Alam et al., 2022; Y. M. Cheng, 2021), and MOOCs (Dai, Teo, Rappa, 2020; Gu et al., 2021). These studies highlight CON, PU, and SAT as critical factors influencing students’ intentions to continue using these platforms. Furthermore, to enhance the predictive power of ECM, researchers have incorporated various constructs into the ECM model, such as computer anxiety, computer self-efficacy (Li, Wang, Wei, 2022), task skill, task enjoyment (Alam et al., 2022), curiosity, and ATT (Dai, Teo, Rappa, 2020). Additionally, ECM has been integrated with other theoretical models like SDT (Meng & Li, 2023), TPB (Li, Wang, Wei, 2022), TAM (Ashrafi et al., 2020), Flow and HOT-fit (Y. M. Cheng, 2021) and ISSM (Gu et al., 2021), forming comprehensive theoretical frameworks to explain students’ CI to use online learning technologies. Table 1 summarizes recent applications of ECM in the field of online education. Based on these research backgrounds, this study adopts ECM as the foundation, combined with the constructs above and theoretical models, to predict students’ CI to use LMS, thereby providing deep insights into online education’s practice and theoretical development.

Table 1.

Research on the Application of ECM in the Educational Domain.

Authors	Research contexts	Constructs	Theoretical frameworks	Result
Authors	Research contexts	Constructs	Theoretical frameworks	Supported	Not supported
Meng and Li (2023)	Informal online learning	PU, SAT, CI, CON, IM, extrinsic motivation (EM)	ECM + SDT	SAT → CI, PU → CI, PU → SAT, CON → CI, CON → PU, EM → PU, EM → CON, IM → CI	IM → CON, IM → SAT, IM → PU, EM → SAT, EM → CI
Li, Wag, Li(2022)	Online learning	SAT, CI, CON, PU, perceived enjoyment (PE), subjective norm (SN), perceptual behavior control (PBC)	ECM + TPB	CON → PU, CON → PE, PU → SAT, PE → SAT, SAT → CI, SN → CI, PBC → CI	CON → SAT
L. Li, Wang, Wei (2022)	Online learning systems	Computer anxiety (CA), PU, CON, SAT, CI, social interaction (SI), computer self-efficacy (CSE), gender	ECM	PU → CI, SAT → CI, CON → CI, PU → SAT, CSE → PU, CA → PU, CA → CON, SI → CI	CON → SAT
Ashrafi et al. (2020)	LMS	PU, PEOU, ATT, SN, PE, CON, SAT, CI, CNT, LMS Navigation (NAV), LMS presentation (PRE)	ECM + TAM	PU → CI, SN → CI, HED → CI, CON → SAT, PU → SAT, PEOU → SAT, CON → PU, CON → HED, PEOU → ATT, PU → ATT, CNT → PU, NAV → PEOU, PRE → PEOU	SAT → CI, ATT → CI, SN → SAT, PEOU → PU
Y. M. Cheng (2021)	e-learning	CON, PU, CI, SAT, flow, individual-technology fit (ITF), task-technology fit (TTF), organizational support (OS), human-human interaction (HHI), human-system interaction (HSI)	ECM + Flow theory + HOT-fit	CON → PU, CON → SAT, PU → SAT, PU → CI, SAT → CI, CON → Flow, Flow → PU, Flow → SAT, Flow → CI, ITF → PU, TTF → PU, TTF → CON, TTF → Flow, OS → PU, HHI → PU, HHI → CON, HHI → Flow, HSI → PU, HSI → CON, HSI → Flow
Alam et al. (2022)	e-learning platforms	Task skill (TS), Task enjoyment (EN), Task challenge (TC), SAT, CON, CI, post-adoption perceived usefulness (PAPU), Psychological safety (PS)	ECM	TS → EN, TC → EN, EN → SAT, CON → PAPU, PAPU → SAT, SAT → CI, PS → CI	CON → SAT
Dai Teo, Rappa, Huang (2020)	MOOCs	PU, CI, CON, SAT, ATT, curiosity (CUR)	ECM	CON → ATT, CON → SAT, ATT → CI, SAT → ATT, CUR → CI	CON → CI, CUR → ATT
Gu et al. (2021)	MOOCs	Information quality (INFQ), system quality (SYSQ), service quality (SERQ), CON, PU, SAT, CI	ECM + ISSM	INFQ → CON, SYSQ → CON, SERQ → CON, CON→PU, CON → SAT, PU → SAT, PU → CI, SAT → CI

Flow

Csikszentmihalyi (2000) introduced the Flow theory to describe the optimal mental state in human experiences. Flow theory denotes that when a person engages in an activity, if their skills align with the challenges, they become deeply absorbed and immersed in the activity, often referred to as “Flow.” Flow is a mental state that can provoke internal impulses, resulting in heightened concentration and involvement.

The Flow theory has been extensively adopted in various fields, such as education (Gao, 2023; X. B. Wang et al., 2022), marketing (Alan et al., 2022; Kang et al., 2018), psychology (Z. W. Zhang, 2021), and sports (Han & Park, 2020; H. S. Lee & Lee, 2021). It describes customers’ and users’ adoption intentions and has been validated across diverse activities. Gao (2023) amalgamated the concepts of sensory stimulation, the extended Unified Theory of Acceptance and Use of Technology (UTAUT), and Flow theory to discern the CI of users toward innovative education amidst delayed rewards. The findings indicated that the users’ Flow state significantly contributes to enhancing CI and materializing the deferred advantages of intelligent education. Based on the Expectancy-Value Theory (EVT) of achievement motivation and Flow theory, Rachmatullah et al. (2021) examined students’ genetics learning in a learning environment. The research findings revealed that the Flow experience significantly influenced students’ examination results. J. Wu et al. (2021) employed the Flow experience as a crucial predictor to gauge the subjective well-being of undergraduates during COVID-19. The results revealed a significant positive correlation between Flow and subjective well-being. Additionally, academic self-efficacy played a role in bolstering the positive relationship between Flow and subjective well-being. The more students experience Flow, the stronger their sense of academic self-efficacy, leading to greater subjective well-being.

Csikszentmihalyi (2000) proposed that educational institutions are ideal places for applying flow theory, where the flow experience can make individuals feel efficient, enthusiastic, and happy—excellent psychological states highly desired in academic environments. Research shows that flow significantly impacts education, especially enhancing learners’ SAT and maintaining their learning intentions (Jung & Shin, 2021; Yu-Ping Chiu, 2023). To further refine, we categorized the research results on the impact of flow into the following categories: Firstly, regarding the SAT with the learning process and the CI of learning, studies have shown that when the presentation of learning content or materials matches the needs of learners, they can achieve learning objectives with less effort. This match enhances learners’ sense of control, increases SAT with the learning process, and strengthens the CI of learning (Al-Okaily et al., 2021; Koc et al., 2022). Secondly, in terms of the adaptability of the learning environment, research points out that the challenging nature of the learning environment (e.g., gamified learning environments) should match learners’ capabilities. This adaptability supports learners’ continued learning in specific environments (Hamari & Koivisto, 2015). Thirdly, regarding classroom performance and learning outcomes, research based on the information system success model and flow theory found that flow experiences positively affect students’ classroom performance, learning outcomes, and willingness to attend classes Li, Wang, Lu, et al. (2022). Lastly, concerning student engagement in online learning platforms, research using a combined theoretical framework of flow theory and expectation-confirmation model shows a significant positive relationship between flow and students’ CI on online English teaching platforms (L. Zhao et al., 2021).

IM

Motivation is the “internal or external force that stimulates enthusiasm and perseverance to pursue a course of action” (Deci & Ryan, 1975). Motivation includes IM and EM, and human behavior is influenced by both IM and EM. IM refers to a type of motivation where individual actions are driven by PV and the benefits of the behavior (Meng & Li, 2023) rather than arising from external pressures or rewards. It plays a pivotal role in a person’s job SAT, curiosity, and sense of participation (C.-J. Wang, 2021). As IM is linked to high-quality academic outcomes, it has been widely studied in fields like online learning (Khan et al., 2018; Meng & Li, 2023; L. Wang, 2022), e-learning (Liu et al., 2022; Sahin et al., 2022), MOOCs (Dong et al., 2023; Romero-Frias et al., 2023), and hybrid learning (Al-Osaimi & Fawaz, 2022; Yang et al., 2023). Learners’ IM was found to be positively related to their academic achievements. IM influences students’ autonomy in learning and leads to more positive outcomes (Alghonaim, 2021).

The current study divides the role of IM into two main directions: Firstly, as a critical predictive variable, IM has a positive effect on students’ academic performance and their CI to learn. For instance, when C. Li, He, and Wong (2021) considered perceived enjoyment as an aspect of IM, it played a decisive role in university students’ CI to engage in English e-learning. Meng and Li’s (2023) research also confirmed the direct positive effect of IM on teachers’ informal online learning and students’ CI to engage in MOOC learning. Secondly, as a variable to be predicted, IM is influenced by various factors such as emotional intelligence, peer support, age, gender, etc. Mercader-Rubio et al. (2023) discovered that emotional intelligence could directly and positively predict university students’ IM, while Hsu et al. (2023) study revealed the impact of a peer assessment-based mobile learning method on IM. Furthermore, Fernández-Martín et al. (2020), through a meta-analysis, evaluated the effect of cooperative learning interventions on the IM of physical education students. These studies highlight the importance of IM in enhancing learning outcomes and identify complex factors that affect IM, providing valuable insights for improving the effectiveness of educational practices.

Hypothesis Development

SAT and CI

According to the ECM, SAT refers to the user’s subjective evaluation and feelings about a product or service’s overall experience and performance after its use (Bhattacherjee, 2001). Moreover, the SAT is the most potent predictor of a user’s CI. Existing research has explored the impact of SAT on CI from various domains (Hussein et al., 2022; Jo, 2022; T. Wang et al., 2021; J. Zhang et al., 2023). Specifically, T. Wang et al. (2021) took ECT and TTF frameworks and developed a research model to study the CI of university students toward online learning during COVID-19. The findings revealed that students’ SAT significantly influenced their CI toward online education. Jo (2022), using an extended ECM, investigated the critical driving factors for university students’ CI to use e-learning. The research found that SAT positively affected students’ CI in e-learning during COVID-19. Hussein et al. (2022), drawing from a combined model of TAM, ISSM, Cognitive Load Theory (CLT), and individual characteristics, researched students’ CI of using Google Classroom within the LMS. The study indicated that SAT significantly and positively impacted students’ CI of using Google Classroom. However, the Ashrafi et al. (2020) survey suggests that students’ SAT with LMS does not significantly affect their CI to use. This research hypothesizes that, when learners felt SAT with the LMS, they demonstrated a higher CI to use it. As a result, this research hypothesizes:

H1: SAT of LMS has a significant positive relationship with CI.

CON and SAT

CON refers to a user’s perception of the consistency between an information system’s expected performance and actual performance (Bhattacherjee, 2001). When users find that the outcomes they perceive from using online education platforms meet or exceed their expected levels, they subsequently experience expectation CON or negative disconfirmation, leading to higher levels of SAT (Bhattacherjee, 2001). In the field of online learning technology, a plethora of studies have elucidated the relationship between CON and SAT from various perspectives (C. Y. Li & Phongsatha, 2022; Rajeh et al., 2021; Yang et al., 2023; J. Zhang et al., 2023). Specifically, Yang et al. (2023) employed the ECM of Information System Continuance to explore the CI of blended learning. The study indicates that CON positively impacts SAT, influencing students’ CI toward blended learning. J. Zhang et al. (2023) ground their work in the ECT and the ISSM, investigating the critical predictors of the CI toward online learning systems. Their research revealed that students’ CON of the system significantly positively affects SAT. Rajeh et al. (2021) integrated the ECT and the TPB to predict students’ SAT and CI for e-learning. The results found that students’ CON significantly and positively influenced their SAT. Nevertheless, in the study on the continued intention of vocational college students to engage in online learning by Li, Wang and Wei (2022), it was found that confirmation has a significant negative impact on satisfaction, attributing this phenomenon to the insufficient online learning experience of vocational college students. This research hypothesizes that learners tend to be SAT with the LMS when they find that the LMS meets their expectations. As a result, this research hypothesizes:

H2: CON of LMS has a significant positive relationship with SAT.

PV, CON, SAT, and CI

PV was initially introduced as an economic concept, referring to an individual’s overall perception and evaluation of a product or service (Ma et al., 2019). It is also considered a crucial competitive strategy (Ma et al., 2019). PV plays a pivotal role in the SAT and CI toward online education. Y. Li, Nishimura, Yagami, et al. (2021) posited that a learner’s commitment to completing in-school assignments is closely related to their PV of online learning. The findings indicated that PV significantly and positively impacts the CI. Shanshan and Wenfei (2022) studied ECM, TTF, and flow theory, exploring factors influencing the CI toward using MOOCs. Their research found that PV notably and positively affects the user’s SAT and CI when using MOOCs. Azhar et al. (2021), integrating the UTAUT framework with PV, investigated factors affecting urban underprivileged populations’ acceptance of online learning. The results indicated that PV significantly impacts these populations’ acceptance and CI toward online education.

PV can be predicted through user CON. This CON can enhance their perceived benefits, thereby increasing the PV of online learning (Panigrahi et al., 2018). As demonstrated by Shanshan and Wenfei (2022), who employed a combined theoretical framework of TTF and ECT, a study on university students’ CI toward MOOCs revealed that CON positively influences their PV in using MOOCs. Jia et al. (2023) proposed a Value-Based Continuance Intention Model (V-ECM), with results indicating that PV directly and positively influences the CI. In this study, the higher the students’ PV, the greater their SAT with the LMS and CI. Furthermore, students’ CON of expectations toward the LMS can elevate their PV. As a result, this research hypothesizes:

H3: PV of LMS has a significant positive relationship with SAT.

H4: PV of LMS has a significant positive relationship with CI.

H5: CON of LMS has a significant positive relationship with PV.

CON and Flow

Flow is described as a state in which an individual, when engaged in an activity and their skills match the challenge, becomes wholly focused, deeply involved, and immersed in the task, losing a sense of self-awareness (Csikszentmihalyi, 2000). CON has a significant impact on users’ Flow experience. When learners have a positive CON of an online learning platform, they are more likely to be in a state of Flow because such platforms can fully engage them in learning activities (M.-C. Lee, 2010). To date, many studies in the educational field have affirmed the relationship between CON and Flow experience (Lu et al., 2019; Shanshan & Wenfei, 2022; Y.-T. Wang & Lin, 2021; H. Zhao & Khan, 2021). Lu et al. (2019) researched the SAT and CI of using MOOCs by leveraging the ECT and user experience. They found that user CON had a significant positive influence on their Flow experience. Y.-T. Wang and Lin (2021) utilized an integrated research model comprising ECT, Flow theory, and habit to explore the CI in using mobile learning applications. A core finding from their study suggested that CON exerted a pronounced positive effect on the Flow experience. Using the ISSM and Flow Theory, Tseng et al. (2022) examined business students’ acceptance and CI to use learning technology. Their results indicated that CON positively influenced students’ Flow experience. In this study, when learners feel a CON of their expected performance within the LMS, they experience a positive state of Flow. As a result, this research hypothesizes:

H6: CON of LMS has a significant positive relationship with Flow.

Flow and SAT

When learners associate their engagement in online platform-related activities with the Flow experience, it can further enhance their level of SAT, leading to a heightened sense of fulfillment (Ali, 2016). Current research has already established a relationship between Flow and SAT (Y. M. Cheng, 2021; Jung & Shin, 2021; M.-C. Lee, 2010; H. Zhao & Khan, 2021). For instance, H. Zhao and Khan (2021) used the Flow Theory and ECM as a theoretical framework to investigate the CI of using online English platforms. Their findings indicate a significant positive correlation between learners’ Flow experience and SAT with learning. In the e-learning system, Y. M. Cheng (2020) discovered that the Flow experience significantly positively impacts users’ SAT. During COVID-19, Jung and Shin (2021) examined the factors influencing Korean university students’ SAT with remote online learning. Their results revealed that Flow significantly enhances learners’ SAT with distant online education. In this study, students with a higher Flow experience exhibit more excellent SAT with the LMS. As a result, this research hypothesizes:

H7: Flow of LMS has a significant positive relationship with SAT.

Flow and CI

CI refers to the inclination to use a system (Bhattacherjee, 2001). Within educational research, the Flow experience can help learners reduce feelings of loneliness during the learning process, providing a sense of joy and fulfillment that might not be attainable in daily life (Deng et al., 2010). This, in turn, promotes the learners’ CI (Kawabata, 2018). Current research has elucidated the relationship between Flow theory and CI from various perspectives, such as online learning (Hewei & Youngsook, 2022; Li, Wang, Lu, et al., 2022), MOOCs (Arquero et al., 2021; Y. M. Cheng, 2023; Y. Zhao et al., 2020), and blended learning (Goh & Yag, 2021), among others. For instance, Y. Zhao et al. (2020) use a combined framework of Flow Theory and Stimuli-Organism-Response (S-O-R) to explore learners’ CI toward MOOCs. The study found that the higher the level of Flow, the greater the learners’ CI toward the platform. Goh and Yang (2021) investigated the nature of the Flow experience in driving learners’ CI of using an LMS in a blended learning environment. Their findings verified that Flow has a positive impact on CI. Gao (2023), under the backdrop of delayed benefits, studied the CI toward smart education. But Jin (2020) discovered that the flow experience could lead to student dissatisfaction with virtual classrooms, thereby reducing their CI to use virtual classrooms. This research hypothesizes that, students with a higher Flow experience demonstrate a greater CI toward the LMS. As a result, this research hypothesizes:

H8: Flow of LMS has a significant positive relationship with CI.

The Moderating Effect of IM

IM refers to the internal drive within an individual, aiming to fulfill inherent interests, curiosity, and personal values rather than being influenced by external rewards or punishments (Deci & Ryan, 1975). It is one of the crucial factors impacting students’ engagement and decisions related to continuous learning (Bailey et al., 2020). Specifically, under the influence of IM, students typically exhibit strong interest, enthusiasm, and confidence in daily learning activities (Henderlong & Lepper, 2002). Researchers tend to consider IM as a prerequisite for influencing the use of educational technology. For instance, Roca and Gagné (2008) examined the effects of learners’ CI on an English mobile learning system. The results suggested that IM positively predicts CI. Previous studies have found that both SAT and PV positively influence students’ CI toward online learning (Goh & Yang, 2021; Jia et al., 2023; Jo, 2022). Furthermore, the impact of IM on CI is also deemed essential (Li, He, and Wong, 2021; Meng & Li, 2023). Hence, SAT, PV, and IM are all expected to influence CI positively, and potential interactions might occur among these constructs. For example, C.-J. Wang (2021), based on empirical research, found that a positive relationship between students’ career decision-making self-efficacy, SAT, and vocational commitment relates to higher levels of IM. Moreover, higher levels of IM influence the positive relationship between SAT, commitment, and exploration. Vogt et al. (2021) studied the moderating role of IM on annotations and overall learning outcomes in Virtual Learning Environments (VRLE). The study discovered that IM significantly moderated the relationship between annotations and learning outcomes in VRLE. This research suggests that the magnitude of the impact of SAT and PV on CI differs at varying levels of IM. Therefore, exploring the interactions between IM, SAT, and PV in predicting CI for LMS is essential. As a result, this research hypothesizes:

H9a: IM of LMS has a significant positive moderate relationship between SAT and CI.

H9b: IM of LMS has a significant positive moderate relationship between PV and CI.

Based on the above hypothesis, the hypothesized model of this study is proposed (Figure 2).

Figure 2.

Research model.

Methods

Participants

This study distributed surveys and collected data via the online questionnaire platform (https://www.wjx.cn/). We initially provided teachers at participating universities with detailed information about the research objectives, data collection methods, and consent forms, who then forwarded the survey materials to the students. The samples were from three universities (Zhengzhou University, Henan Normal University, and Henan University of Science and Technology) in China. Participants had utilized an LMS for a minimum of one semester. A random sampling approach was employed to select participants. This method gathered data from 232 respondents via an online questionnaire. To evaluate the representativeness of our sample, we conducted Chi-square tests on gender distribution (male = 43.27%, female = 51.57%; p = .500). The results revealed no statistically significant difference between the sample and the population, underscoring the representativeness of our sample. Data collection spanned from January 2023 to August 2023.

According to Barclay et al. (1995), when conducting research using PLS-SEM, the minimum sample size should be ten times the number of arrows pointing at latent variables in the PLS path model. In this study, the maximum number of arrows pointing at a latent variable was 3. This means that this study’s minimum required sample size was 30, while the actual sample size was 232. Therefore, the sample size of this study meets the research requirements.

Measurements

The measurement comprised two sections. The first section gathered demographic data of the participants, encompassing gender, age, origin, and subject. Six constructs derived from the theoretical framework were assessed in the second section. Specifically, 19 indicators were evaluated in this section (Table 2). A 7-point Likert scale, ranging from 1 (strongly disagree) to 7 (strongly agree), was used, and all items were adapted directly from pertinent literature.

Table 2.

Constructs Measurement and Source.

Constructs	Items	Measurement	Source
FLOW	FLOW1	Time passed very quickly during use the LMS	Jung and Shin (2021) Ashrafi et al. (2020), Mouakket and Bettayeb (2015)
	FLOW2	While taking LMS, I am not affected by the surrounding conditions
	FLOW3	While taking LMS, I am much more focused
CON	CON1	My experience with using LMS was better than what I expected	Ashrafi et al. (2020)
	CON2	The service level provided by LMS was better than what I expected
	CON3	Overall, most of my expectations from using LMS were confirmed
PV	PV1	I use the LMS to keep up-to-date	Dağhan and Akkoyunlu (2016)
	PV2	The LMS satisfies my needs for knowledge, learning and development.
	PV3	The LMS plays a crucial role for me.
CI	CI1	I intend to continue using LMS in the future	Mouakket and Bettayeb, 2015, Sumi and Kabir (2021)
	CI2	I will keep using LMS as regularly as I do now
	CI3	I intend to increase my use of LMS in the future
	CI4	I will strongly recommend others to use LMS
SAT	SAT1	I am satisfied with the experience of using LMS
	SAT2	I will recommend LMS to others
	SAT3	My decision to use LMS is a wise one
IM	IM1	I use the LMS because this gives me fun, pleasure, and satisfaction	Munoz-Organero et al. (2010)
	IM2	I use the LMS to communicate with others. I can experience fun, pleasure, or satisfaction
	IM3	I use the LMS because it is important for my knowledge

Statistical Analysis

The analysis was conducted using Smart PLS. Smart PLS offers a myriad of benefits for data analysis, including handling non-normal data, accommodating small sample sizes, maximizing explanatory power for the variance of endogenous latent variables, and the capacity to process complex models (Hair, 2021). The objective of this study is to discern the maximum explanatory power of CI variance influenced by FLOW, CON, PV, SAT, and SAT. With a sample size of just 232 and encompassing six constructs, the study adopts a complex model framework. Given these conditions, Smart PLS is an apt choice for data analysis in this context.

The data analysis encompassed three distinct dimensions. The first focused on the outer model test, specifically assessing construct reliability and validity. Reliability measurements incorporated item reliability, composite reliability, and Cronbach’s alpha (α). Validity evaluations covered both convergent validity and discriminant validity. To ascertain the discriminant validity of the construct, both the Fornell-Larcker criterion and cross-loadings were scrutinized. The second dimension pertained to the inner model, encompassing the collinearity test, significance assessment of model relations, the model’s explanatory power (R²), predictive power (Q²), and the common method variance (CMV). The final aspect investigated the moderating influence of IM on the relationship among SAT, PV, and CI.

Results

Measurement Model

Guided by Hair (2021), the reliability and validity of the scales were ascertained using a measurement model. We commenced by evaluating the reliability of all constructs via indicator loadings and composite reliability (CR). Hair (2021) states that indicator loadings should exceed 0.708 for acceptable item reliability. Additionally, to gauge the internal consistency reliability of the scale, Cronbach’s alpha coefficient was utilized, with the expectation of a value surpassing .7. As delineated in Table 3, the indicator loadings, composite reliability, and Cronbach’s alpha all meet the stipulated .7 threshold, affirming the satisfactory reliability of all scales. The ensuing step involved examining the scales’ convergent and discriminant validity. The Average Variance Extracted (AVE) was employed to assess convergent validity, with a benchmark value of more than 0.5. Discriminant validity was scrutinized using the Fornell-Larcker criterion (Fornell & Larcker, 1981) and the cross-loading approach. According to the latter, an indicator’s outer loading on its designated construct should eclipse its cross-loadings (i.e., its correlation) with other constructs, as detailed in Table 4. Furthermore, inter-construct correlations ought to be lesser than the square root of the AVE, as reflected in Table 5. Collectively, these results indicate robust discriminant validity across all constructs.

Table 3.

Construct Reliability and Validity.

Constructs	Items	Loadings	Cronbach’α	CR	AVE
CI	CI1	0.946	.953	0.966	0.876
	CI2	0.935
	CI3	0.947
	CI4	0.917
CON	CON1	0.949	.944	0.964	0.899
	CON2	0.951
	CON3	0.944
FLOW	FLOW1	0.89	.901	0.938	0.835
	FLOW2	0.914
	FLOW3	0.938
IM	IM1	0.942	.933	0.957	0.882
	IM2	0.937
	IM3	0.938
PV	PV1	0.92	.917	0.948	0.858
	PV2	0.921
	PV3	0.939
SAT	SAT1	0.935	.928	0.954	0.874
	SAT2	0.938
	SAT3	0.932

Table 4.

Discriminant Validity (Cross-Loadings Criterion).

Items	CI	CON	FLOW	IM	PV	SAT
CI1	0.946	0.843	0.827	0.889	0.855	0.866
CI2	0.935	0.786	0.767	0.852	0.842	0.853
CI3	0.947	0.831	0.809	0.861	0.854	0.861
CI4	0.917	0.804	0.807	0.865	0.832	0.838
CON1	0.807	0.949	0.851	0.794	0.845	0.843
CON2	0.853	0.951	0.858	0.844	0.869	0.891
CON3	0.821	0.944	0.829	0.782	0.892	0.841
FLOW1	0.725	0.747	0.89	0.716	0.755	0.738
FLOW2	0.808	0.843	0.914	0.784	0.815	0.801
FLOW3	0.814	0.85	0.938	0.789	0.831	0.834
IM1	0.871	0.796	0.802	0.942	0.821	0.815
IM2	0.895	0.804	0.784	0.937	0.818	0.842
IM3	0.842	0.797	0.769	0.938	0.808	0.823
PV1	0.818	0.813	0.802	0.796	0.92	0.827
PV2	0.813	0.868	0.784	0.782	0.921	0.855
PV3	0.877	0.864	0.849	0.834	0.939	0.872
SAT1	0.863	0.861	0.795	0.819	0.876	0.935
SAT2	0.841	0.824	0.82	0.812	0.847	0.938
SAT3	0.857	0.853	0.817	0.837	0.856	0.932

Table 5.

Discriminant Validity (Fornell-Larcker Criterion).

Constructs	CI	CON	FLOW	IM	PV	SAT
CI	0.936
CON	0.872	0.948
FLOW	0.858	0.892	0.914
IM	0.926	0.851	0.836	0.939
PV	0.903	0.916	0.877	0.868	0.926
SAT	0.913	0.905	0.867	0.88	0.919	0.935

Note. The diagonal values in bold are the square roots of AVE.

Common Method Biases

Common Method Bias (CMB) was assessed through dual methodologies. Initially, Harman’s single-factor test suggested that no singular factor was responsible for the majority of the variance, with the most dominant factor explaining just 30.128% of the variance (Podsakoff et al., 2003), substantially below the 50% threshold as recommended by Podsakoff et al. (2003). Subsequently, the marker variable technique was employed, which introduces a theoretically unrelated marker variable to the research model for CMB assessment (Lindell & Whitney, 2001). The highest shared variance with other constructs was found to be 0.0127 (1.27%), considered significantly minimal according to Johnson et al. (2011). Consequently, the findings from these evaluations strongly suggest an insignificant prevalence of common method bias.

Structural Model

Collinearity

Collinearity was evaluated using the predictor constructs’ Variance Inflation Factor (VIF) values. Hair (2021) suggests that VIF values should ideally be below three and must not exceed 5 to confirm the absence of significant collinearity effects on the structural model estimates. As presented in Table 6, all VIF values range between 1.961 and 4.154, aligning with the recommended criteria.

Table 6.

VIF Values of Predictor Constructs.

Constructs	CI	FLOW	PV	SAT
CI
CON		1	1	2.887
FLOW	3.038			2.484
IM	4.154
PV	2.114			1.961
SAT	3.248

Significance of the Structural Model Relationship

The significance of the structural model relationships was determined through the bootstrapping algorithm in Smart-PLS. Hair (2021) recommends utilizing t statistics (t > 1.96), p-values (p < .05), and a confidence interval that excludes zero to evaluate the significance of these relationships. Table 7 presents the path coefficient, confidence interval, T statistics, and p-values.

Table 7.

Result of the Significance of the Structural Model Relationship.

Relationships	Original sample (O)	2.50%	97.50%	T statistics	p-Values	Results
SAT → CI	0.259	0.026	0.507	2.089	.037	Supported
CON → SAT	0.312	0.08	0.559	2.556	.011	Supported
PV → SAT	0.507	0.262	0.751	3.98	.000	Supported
PV → CI	0.202	0.049	0.387	2.323	.020	Supported
CON → PV	0.916	0.877	0.948	51.519	.000	Supported
CON → FLOW	0.892	0.847	0.927	43.272	.000	Supported
FLOW → SAT	0.144	−0.032	0.324	1.602	.109	Not supported
FLOW → CI	0.064	−0.065	0.198	0.952	.341	Not supported

Note. Significance level: p < .05, p < .01, p < .001. Non-significance: p > .05.

Specifically, the relationship between PV (β = .202, t = 2.323, p = .020), SAT (β = 0.259, t = 2.089, p = 0.037), and CI was positive. Likewise, CON (β = .312, t = 2.556, p = 0.011) and PV (β = .507, t = 3.98, p = .000) were positively related to SAT. The relationship between CON (β = .892, t = 43.272, p = .000) and FLOW was positive. Meanwhile, CON (β = .916, t = 51.519, p = .000) was positively related to PV. Finally, the non-significant relationships were FLOW with CI (β = .064, t = .952, p = .341) and FLOW with SAT (β = .144, t = 1.602, p = .109).

Explanatory Power and Predictive Relevance

The model’s explanatory power and predictive relevance can be discerned through the R ² values of endogenous constructs and Stone-Geisser’s Q ² values, respectively (Hair, 2021). As depicted in Table 8, the R ² values indicate the commendable explanatory strength of the model. Specifically, the R ² value for CI reveals that 90.8% of its variance can be attributed to the predictive variables. Concurrently, the predictors for SAT account for about 87.4% of its variance, as indicated by its R ² value. Furthermore, all the Q ² values exceeding zero, as shown in Table 8, underscore the significant predictive relevance of the empirical model (Hair, 2021).

Table 8.

Explanatory Power and Predictive Relevance.

Constructs	R ²	R² adjusted	Q ²
CI	.908	.906	0.785
FLOW	.796	.795	0.658
PV	.839	.838	0.716
SAT	.874	.872	0.755

Moderation Effect Analysis

Moderating effects arise when the association between two variables fluctuates based on the value of a third variable, termed the moderator. Such a moderator can modify the strength or orientation of the relationship between the primary variables (Hair, 2021). To assess the moderating effect of IM on the association between SAT, PV, and CI, this research utilized the two-stage approach of Smart PLS (Becker et al., 2018). Table 9 showcases that when considering university students utilizing LMS, IM notably augments the positive correlation between SAT and students’ CI to engage with the LMS (β = .336, t = 2.556, p = .011). This finding supports H9a. Conversely, IM does not exert a discernible moderating influence on the bond between PV and CI (β = −.084, t = .954, p = .34). As a result, H9b is refuted.

Table 9.

The Regulatory Effects of IM.

Hypothesis	Relationships	Original sample (O)	T statistics	p-Values
H9a	IM × SAT → CI	0.336	2.556	.011
H9b	IM × PV → CI	−0.084	0.954	.34

Note. Significance level: p < .05, p < .01, p < .001. Non-significance: p > .05.

Discussion

This study explored the factors influencing university students’ continued intention to use LMS, emphasizing the moderating role of intrinsic motivation. The description of the results starts with a comprehensive review of the existing literature, hypothesizing that Flow, CON, PV, and SAT play significant roles in predicting students’ CI to use. The validity assessment conducted with Smart PLS software indicated that the proposed research model could explain 90.8% of the total variance in students’ CI to use the learning management system, supporting the vast majority of the research hypotheses. Our findings revealed that PV is the most significant predictor, followed by SAT, while the flow experience did not significantly affect CI. Furthermore, this study delved deeper into the factors affecting satisfaction, finding that PV had the most significant effect on SAT, followed by CON, with flow experience having no significant effect on SAT. Lastly, confirmation significantly impacted both PV and flow experience, deepening the understanding of the interactions among these variables. IM played a significant role in the effect of SAT on CI to use, while its moderating effect between PV and CI to use was insignificant. The discussion then contrasts with existing research findings, exploring how these factors influence university students’ CI to use LMS.

This study indicates that when university students use the LMS, PV significantly influences their CI to use it. This finding is consistent with the research of Azhar et al. (2021), which indicates that the higher the students’ PV, the more direct and positive impact it has on their CI toward online learning. One possible explanation for this result is that PV reflects students’ approval of the LMS. Students who perceive that the LMS can meet their learning needs are more likely to use the system to achieve their educational objectives. Another rationale is that the LMS offers students a range of convenient learning tools and resources, catering to their functional requirements during the learning process. This perceived functional value amplifies students’ CI to use the LMS.

The research reveals that among university students, the SAT has a significant positive influence on the CI’s use of the LMS. This finding is consistent with J. Zhang et al. (2023), who indicated that the higher the students’ SAT with online learning, the greater their CI. There are two possible explanations for this finding. On the one hand, the LMS offers a variety of features and a user-friendly interface, allowing students to manage and organize learning resources conveniently. This enhances their SAT during the system’s use, promoting the CI. On the other hand, when students gain knowledge and experience from the system, fulfilling their periodic self-worth realization, it can significantly promote their SAT, enhancing their CI of using the LSM.

Interestingly, this study did not find a significant correlation between students’ Flow and CI. This result contrasts with the findings of Goh and Yang (2021) observed that Flow significantly influences students’ CI toward LMS. This inconsistency may be due to the following reasons. On the one hand, if students utilize the LMS primarily to achieve specific academic goals rather than to experience the system itself, and if the LMS fails to help them effectively achieve those goals, their CI to use the platform might be adversely impacted. On the other hand, over prolonged use, students might experience fatigue or find the LMS tedious. Alternatively, they might discover other superior learning tools or resources, leading to a diminished CI with the current LMS. Moreover, the study by Goh and Yang (2021), which conducted a reflective flow structure analysis on 92 students using the PLS method, contrasts with our study using the PLS-SEM analysis method based on a larger sample of 232 university students. This larger sample size might cover a broader student population and more diverse usage scenarios, suggesting that the direct impact of the flow experience on continued intention to use was not as significant in our findings.

The investigation carried out in this study has revealed that university students’ PV has a significant positive influence on their SAT while using the LMS. This result aligns with the findings of Shanshan and Wenfei (2022), which suggest that the higher the students’ PV, the greater their SAT levels when using MOOCs. A possible explanation might be that students tend to be more SAT when they perceive tangible learning benefits from the LMS. Another possible reason is that PV may relate to students’ assessments of the LMS’ quality and diversity of learning resources. When students feel the LMS offers high-quality and diverse learning materials, they are likelier to be SAT with it.

The study found that during the process of university students using the LMS, CON significantly influences SAT. These results reflect those of L. Li, Wang, Li (2022) also found that CON in online learning notably correlates with SAT. This effect can be attributed to students forming subjective perceptions about the LMS as they use it and then comparing the system’s outcomes to their prior expectations. If the post-use performance or results of the LMS exceed the students’ initial expectations, they tend to feel SAT with the content provided by the system.

Contrary to expectations, this study did not find a significant positive impact between university students’ Flow and SAT. This outcome is contrary to that of H. Zhao and Khan (2021), who found that Flow effectively enhances student SAT scores when students use online English platforms. This inconsistency may be due to the following two factors. Firstly, the learning content and tasks provided by the LMS might not align with the student’s educational needs. If it fails to improve students’ academic performance effectively, students may struggle to gain a sense of achievement, which consequently doesn’t foster an increase in SAT. Secondly, the LMS might lack personalized customization features, rendering it incapable of catering to diverse student groups’ individual needs and preferences. Such a shortfall might cause students to feel that their experience with the LMS platform is less than seamless. This can adversely affect their flow experience and reduce their overall SAT score with the LMS. Additionally, compared to H. Zhao and Khan (2022), who collected 500 sample data through a closed questionnaire survey conducted by a marketing research institution, our study was based on a broader sample size. In a larger sample, the impact of individual differences may be diluted, making the positive effect of flow experience on satisfaction less significant. This methodological difference might be another critical factor leading to the inconsistency in the results of the two studies.

This study demonstrates that during the process of university students using the LMS, CON significantly influences PV. This outcome aligns with the findings of (Panigrahi et al., 2018). Their research revealed that user SAT can enhance students’ perceived benefits in online learning, thereby increasing the PV of online learning. The observed correlation between CON and PV can be explained in two ways. First, when students engage with the LMS, if the content provided by the system meets their usage requirements and aligns with their expectations, they will have a heightened sense of CON toward the LMS. This, in turn, results in a higher PV for the students. Secondly, the LMS supports students’ learning by offering resources, course schedules, and assignment requirements. When students are SAT with this information and can rely on the accuracy and reliability of the information provided by the LMS, they are more likely to confirm the system’s value.

This research reveals that when university students use the LMS, CON significantly influences their Flow. This result is consistent with the findings of Wang and Lin (2021), who found that CON has a notable positive effect on the Flow experience in mobile learning applications. There are several possible explanations for this result. Firstly, when students clearly understand the LMS’s features and objectives, receive timely feedback, and find that most of their expectations regarding the LMS are confirmed, they are more likely to focus intently, leading to a state of flow. Secondly, the LMS can provide students with automated evaluations and feedback, promptly informing them about their academic performance and progress. Such timely feedback helps students better gauge their learning pace, enhances their sense of CON with the LMS, and consequently promotes the emergence of the Flow experience.

The results of this study show that during the process of using the LMS, university students’ IM significantly and positively moderates the relationship between SAT and CI. This finding aligns with the research of C.-J. Wang (2021), who surveyed 782 students and determined that IM notably positively moderates the relationship between SAT and CI. Two possible explanations account for this observation. Firstly, students with a high level of IM resonate more with the value and purpose of learning. This implies that they place greater importance on the support provided by the LMS. Consequently, they are more likely to derive SAT from the LMS, encouraging their CI to use the system. Secondly, when students feel SAT with the LMS, their IM may be further boosted. Conversely, high IM can also predispose students to derive SAT from the LMS more easily. This positive feedback loop ensures that IM is a robust positive moderator in the relationship between SAT and CI.

Contrary to previous research findings, this study discovered that university students’ IM does not significantly moderate the relationship between PV and CI when using the LMS. IM represents an individual’s inner driving force, influencing students’ motivation and persistence in learning. It could significantly impact how students assess learning tools’ value and CI use. This finding contrasts with the study of Hulleman and Harackiewicz (2009), who explored the factors influencing high school students’ continued participation in science classes. Their research discovered that IM played a significant moderating role between PV and CI. This discrepancy could be attributed to the following two aspects. On the one hand, PV refers to students’ subjective feelings about the utility and efficacy of using the LMS. Suppose students’ PV of the LMS platform primarily depends on external factors like ease of use or aesthetic interface rather than an IM for learning. In that case, the moderating effect of IM between PV and CI might be weak or non-existent. On the other hand, university students might use the LMS primarily to meet fundamental academic and course requirements. Such utilitarian needs could lead to students’ CI mainly being based on the actual functionalities provided by the LMS rather than being influenced by their IM.

Implications

This study integrates the ECM and Flow theory to explore the factors influencing college students’ CI toward LMS and the moderating role of IM. The proposed model accounts for 90.8% of the total variance in students’ CI with LMS. Consequently, this study’s research model and findings hold theoretical and practical implications.

Theoretical Implications

The primary contribution of this research is developing a multi-dimensional and comprehensive model for assessing college students’ CI to use LMS. This model was designed based on a systematic review and in-depth analysis of existing literature on ECM and Flow. This new model is comprehensive because it thoroughly incorporates various perspectives regarding the LMS, including learners’ CON, PV, SAT, CI, FLOW, and IM. These elements encapsulate the principal components of existing methodologies.

Moreover, our findings suggest that the flow experience does not significantly affect CI use and satisfaction, differing from previous studies where FLOW significantly impacted university students’ CI to use e-learning. This provides a new perspective for research in this field and expands the application scope of the ECM and FLOW, enhancing our understanding of university students’ continued intention to use LMS.

The current study also investigates the moderating role of IM on CI. Previous research has predominantly focused solely on the direct impact of IM on CI (Li, He, L., & Wong, 2021; L. Wang, 2022; Yang et al., 2023). To the best of our knowledge, this is the first study to comprehensively identify the influencing factors of CI when using LMS and empirically test the moderating role of IM within a single model. This represents the second theoretical contribution of our research.

The third contribution concerns the performance of the developed model. This model exhibited strong predictive capability for CI, significantly accounting for 90.8% of the variance in the CI to use LMS. Compared to previous models, it boasts higher predictive relevance and explanatory power.

Practical Implications

This study aims to explore the factors predicting undergraduates’ CI toward LMS. Based on the findings, we propose the following practical implications.

Firstly, regarding the impact on LMS developers. On the one hand, system developers should prioritize the user interface design of the LMS to ensure its usability, navigability, and visual appeal. Additionally, they could offer personalized customization options, allowing students to adjust the interface notification settings based on their preferences and needs, enhancing their SAT. On the other hand, developers can integrate engaging and interactive features into the LMS, such as online quizzes and virtual experiments, enabling students to assess their learning outcomes promptly. This piques students’ interest and motivation to continue learning and stimulates their IM.

Secondly, concerning the practical implications for educators, on one side, teachers can utilize the LMS to offer students a diversified range of learning resources, such as text, videos, and presentations, catering to different learning styles and needs (X. Wu & Wang, 2018). Moreover, educators can design collaborative projects within the LMS to enhance student engagement, increasing their PV and SAT with the system. On the other side, it’s imperative for teachers to foster students’ curiosity, desire to explore, and innovative thinking, creating a positive learning atmosphere. Encouraging self-directed learning can kindle their IM.

Lastly, regarding the practical implications for students, they should recognize the significance of the LMS in their learning journey. Students should learn to harness the LMS to enhance their study efficiency and apply acquired knowledge, elevating their PV and SAT. On the other hand, during LMS usage, students should set clear learning objectives for themselves, which can ignite their IM, making them more enthusiastic about using the LMS. Concurrently, it’s beneficial for them to cultivate the habit of using the LMS regularly, gradually fostering a sense of self-discipline in their studies, thereby amplifying their CI.

Limitations

While our research offers both practical and theoretical value in this study, there are also certain limitations. Firstly, the sample is confined to 232 undergraduate students from three general higher education institutions in the Henan province of China, leading to results that may not be universally representative. Hence, future research could broaden the sample to encompass students from vocational colleges, general higher education universities, and postgraduate students to determine whether the relationships between these variables vary among student demographics. Secondly, due to the cross-sectional nature of this research, it doesn’t shed light on the dynamic changes of the study subjects over time, nor does it ascertain causality of specific features or behaviors. Future studies could adopt a longitudinal perspective to understand the temporal dynamics of the constructs better. Thirdly, our study only discusses the moderating role of IM, leaving out the potential moderating role of extrinsic motivation. Hence, subsequent research can probe into the modulatory effects of extrinsic motivation or factors influencing IM when examining the CI to use LMS. Lastly, our conclusions are purely based on statistical data, which might not offer a deep understanding of the future continuous intention to use LMS. Including qualitative methods in future studies might help identify critical predictors of continuous intention, potentially addressing the gaps in quantitative research.

Conclusion

This study aimed to predict the factors influencing university students’ CI to use LMS. Employing a theoretical model based on the ECM, FLOW, and IM, the study put forth nine hypotheses and conducted empirical research on a sample of 232 university students. The findings revealed significant positive correlations among certain facets of the model. Notably, IM demonstrated a significant positive moderating effect. More specifically, CON had a pronounced positive impact on Flow experience, PV, and SAT. The PV was closely related to SAT, and both emerged as critical predictors of the CI. IM manifested a significant positive moderating role between SAT and the CI. The findings of this study underscore the importance of enhancing students’ CON, PV, and SAT through optimizing user experience in the design and implementation of LMS. Developers and educators should integrate personalized and interactive features to meet students’ learning needs and promote their continued engagement. This deepens our understanding of students’ motivations for using LMS and provides practical guidance for integrating educational technology more effectively into students’ needs and motivations, which can help improve the efficiency of LMS usage and teaching outcomes.

Footnotes

Authors’ contribution

Conceptualization, Renjie Song; Data curation, Yaru Zheng and Renjie Song; Writing original draft, Renjie Song; Writing - review & editing, Renjie Song and Yaru Zheng. All the authors have read and agreed to the published version of the manuscript.

Declaration of Conflicting Interests

The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Funding

The author(s) received no financial support for the research, authorship, and/or publication of this article.

Ethical Approval

The researchers confirms that all research was performed in accordance with relevant guidelines/regulations applicable when human participants are involved (e.g., Declaration of Helsinki or similar). This study was approved by the Ethics Committee of Henan Polytechnic University, with the approval number: HPU-2022-02-0108.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

ORCID iD

Yaru Zheng

Data Availability Statement

The data that support the findings of this study are available on request from the corresponding author.

References

Al-Okaily

Ai Ping

Al-Mawali

Zaidan

Tan

A. W. K.

(2021). An empirical investigation of enterprise system user satisfaction antecedents in Jordanian commercial banks. Cogent Business & Management, 8(1), 1918847. https://doi.org/10.1080/23311975.2021.1918847

Al-Osaimi

D. N.

Fawaz

(2022). Nursing students’ perceptions on motivation strategies to enhance academic achievement through blended learning: A qualitative study. Heliyon, 8(7), e09818. https://doi.org/10.1016/j.heliyon.2022.e09818

Alam

Mahmud

Hoque

S. M. S.

Akter

Rana

S. M. S.

(2022a). Predicting students’ intention to continue business courses on online platforms during the Covid-19: An extended expectation confirmation theory. International Journal of Management Education, 20(3), 100706. https://doi.org/10.1016/j.ijme.2022.100706

Alan

A. K.

Kabadayi

E. T.

Aksoy

N. C.

(2022). Replaying online games for flow experience and outcome expectations: An exploratory study for the moderating role of external locus of control based on Turkish gamers’ evaluations. Entertainment Computing, 40, 100460. https://doi.org/10.1016/j.entcom.2021.100460

Alghonaim

A. S.

(2021). Intrinsic motivation and speech production in Saudi EFL college students. Journal of Psycholinguistic Research, 50(5), 1137–1157. https://doi.org/10.1007/s10936-021-09803-1

Ali

(2016). Hotel website quality, perceived flow, customer satisfaction and purchase intention. Journal of Hospitality and Tourism Technology, 7(2), 213–228. https://doi.org/10.1108/jhtt-02-2016-0010

Alturki

Aldraiweesh

(2021). Application of learning management system (LMS) during the COVID-19 Pandemic: A sustainable acceptance model of the expansion technology approach. Sustainability, 13(19), 10991. https://doi.org/10.3390/su131910991

Alyoussef

I. Y.

(2023). Acceptance of e-learning in higher education: The role of task-technology fit with the information systems success model. Heliyon, 9(3), e13751. https://doi.org/10.1016/j.heliyon.2023.e13751

Alzahrani

Seth

K. P.

(2021). Factors influencing students’ satisfaction with continuous use of learning management systems during the COVID-19 pandemic: An empirical study. Education and Information Technologies, 26(6), 6787–6805. https://doi.org/10.1007/s10639-021-10492-5

10.

Arquero

J. L.

Romero-Frías

del Barrio-García

(2021). The impact of flow, satisfaction and reputation on loyalty to MOOCs: The moderating role of extrinsic motivation. Technology, Pedagogy and Education, 31, 399–415.

11.

Ashrafi

Zareravasan

Rabiee Savoji

Amani

(2020). Exploring factors influencing students’ continuance intention to use the learning management system (LMS): A multi-perspective framework. Interactive Learning Environments, 30(8), 1475–1497. https://doi.org/10.1080/10494820.2020.1734028

12.

Azhar

Wan Ahmad

W. F.

Ahmad

Abu Bakar

(2021). Factors affecting the acceptance of online learning among the urban poor: A case study of Malaysia. Sustainability, 13(18), 10359. https://doi.org/10.3390/su131810359

13.

Bailey

Almusharraf

Hatcher

(2020). Finding satisfaction: Intrinsic motivation for synchronous and asynchronous communication in the online language learning context. Education and Information Technologies, 26(3), 2563–2583. https://doi.org/10.1007/s10639-020-10369-z

14.

Barclay

Higgins

Thompson

(1995). The partial least squares (PLS) approach to casual modeling: Personal computer adoption and use as an Illustration. Technology Studies, 2, 285–309.

15.

Becker

J.-M.

Ringle

C. M.

Sarstedt

(2018). Estimating moderating effects in PLS-SEM and PLSc-SEM: Interaction term generation*data treatment. Journal of Applied Structural Equation Modeling, 2(2), 1–21. http://hdl.handle.net/11420/4059

16.

Bhattacherjee

(2001). Understanding information systems continuance: An expectation-confirmation model. MIS Quarterly, 25, 351–370.

17.

Çebi

(2022). How e-learning readiness and motivation affect student interactions in distance learning? Education and Information Technologies, 28(3), 2941–2960. https://doi.org/10.1007/s10639-022-11312-0

18.

Cheng

Yuen

A. H. K.

(2018). Student continuance of learning management system use: A longitudinal exploration. Computers & Education, 120, 241–253. https://doi.org/10.1016/j.compedu.2018.02.004

19.

Cheng

Y. M.

(2020). Investigating medical professionals’ continuance intention of the cloud-based e-learning system: An extension of expectation–confirmation model with flow theory. Journal of Enterprise Information Management, 34(4), 1169–1202. https://doi.org/10.1108/jeim-12-2019-0401

20.

Cheng

Y. M.

(2021). Investigating medical professionals’ continuance intention of the cloud-based e-learning system: An extension of expectation-confirmation model with flow theory [Article]. Journal of Enterprise Information Management, 34(4), 1169–1202. https://doi.org/10.1108/jeim-12-2019-0401

21.

Cheng

Y. M.

(2023). How different categories of gamified stimuli affect massive open online courses continuance intention and learning performance? mediating roles of internal experiences. Social Science Computer Review, 41(2), 495–527. https://doi.org/10.1177/08944393221111928

22.

Chiu

Cho

Chi

C. G.

(2020). Consumers’ continuance intention to use fitness and health apps: An integration of the expectation–confirmation model and investment model. Information Technology & People, 34(3), 978–998. https://doi.org/10.1108/itp-09-2019-0463

23.

Csikszentmihalyi

(2000). Happiness, flow, and economic equality. American Psychologist, 55(10), 1163–1164. https://doi.org/10.1037/0003-066X.55.10.1163

24.

Dağhan

Akkoyunlu

(2016). Modeling the continuance usage intention of online learning environments. Computers in Human Behavior, 60, 198–211. https://doi.org/10.1016/j.chb.2016.02.066

25.

Dai

H. M.

Teo

Rappa

N. A.

(2020). Understanding continuance intention among MOOC participants: The role of habit and MOOC performance. Computers in Human Behavior, 112, 106455. https://doi.org/10.1016/j.chb.2020.106455

26.

Dai

H. M.

Teo

Rappa

N. A.

Huang

(2020). Explaining Chinese university students’ continuance learning intention in the MOOC setting: A modified expectation confirmation model perspective. Computers & Education, 150, 103850. https://doi.org/10.1016/j.compedu.2020.103850

27.

Dang

M. Y.

Zhang

G. Y.

Ravindran

Osmonbekov

T. D.

(2016). Examining student satisfaction and gender differences in technology-supported, blended learning. Journal of Information Systems Education, 27, 119–130.

28.

Deci

E. L.

Ryan

R. M.

(1975). Intrinsic motivation and self-determination in human behavior. Perspectives in Social Psychology, 17(2), 253.

29.

Deng

Turner

D. E.

Gehling

Prince

(2010). User experience, satisfaction, and continual usage intention of IT. European Journal of Information Systems, 19, 60–75.

30.

Dong

L. F.

Zhang

(2023). Motivational understanding of MOOC learning: The impacts of technology fit and subjective norms. Behavioral Sciences, 13(2), 98. https://doi.org/10.3390/bs13020098

31.

Fernández-Martín

F.-D.

Romero-Rodríguez

J.-M.

Gómez-García

RamosNavas-Parejo

(2020). Impact of the flipped classroom method in the mathematical area: A systematic review. Mathematics, 8(12), 2162. https://doi.org/10.3390/math8122162

32.

Fornell

Larcker

D. F.

(1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18(1), 39–50. https://doi.org/10.1177/002224378101800104

33.

Gao

(2023). Understanding smart education continuance intention in a delayed benefit context: An integration of sensory stimuli, UTAUT, and flow theory. Acta Psychologica, 234, 103856. https://doi.org/10.1016/j.actpsy.2023.103856

34.

Goh

T. T.

Yang

(2021). The role of e-engagement and flow on the continuance with a learning management system in a blended learning environment. International Journal of Educational Technology in Higher Education, 18(1), 23. https://doi.org/10.1186/s41239-021-00285-8

35.

Sun

Z.-J.

(2021). Does MOOC quality affect users’ continuance intention? Based on an integrated model. Sustainability, 13(22), 12536. https://doi.org/10.3390/su132212536

36.

Hair

Jr. Hult

Tomas

Ringle Christian

Sarstedt

Marko

. (2021). A primer on partial least squares structural equation modeling (PLS-SEM) (3rd ed.). SAGE Publications, Inc.

37.

Hamari

Koivisto

(2015). “Working out for likes”: An empirical study on social influence in exercise gamification. Computers in Human Behavior, 50, 333–347. https://doi.org/10.1016/j.chb.2015.04.018

38.

Han

G. S.

Park

J. A.

(2020). Role of the flow in physical education class between school life stress and aggressiveness among adolescents. Sustainability, 12(10), 4241. https://doi.org/10.3390/su12104241

39.

Henderlong

Lepper

M. R.

(2002). The effects of praise on children’s intrinsic motivation: A review and synthesis. Psychological Bulletin, 128(5), 774–795. https://doi.org/10.1037/0033-2909.128.5.774

40.

Hewei

Youngsook

(2022). Influencing factors of online course learning intention of undergraduates majoring in art and design: Mediating effect of flow experience. SAGE Open, 12(4), 34004. https://doi.org/10.1177/21582440221134004

41.

Hidayat-ur-Rehman

Akram

M. S.

Malik

Mokhtar

S. A.

Bhatti

Z. A.

Khan

M. A.

(2020). Exploring the determinants of digital content adoption by academics: The moderating role of environmental concerns and price value. SAGE Open, 10(2), 31856. https://doi.org/10.1177/2158244020931856

42.

Hsu

T. C.

Chen

W. L.

Hwang

G. J.

(2023). Impacts of interactions between peer assessment and learning styles on students’ mobile learning achievements and motivations in vocational design certification courses. Interactive Learning Environments, 31(3), 1351–1363. https://doi.org/10.1080/10494820.2020.1833351

43.

Hulleman

C. S.

Harackiewicz

J. M.

(2009). Promoting interest and performance in high school science classes. Science, 326(5958), 1410–1412. https://doi.org/10.1126/science.1177067

44.

Hussein

M. H.

S. H.

Al-Azawei

Ibrahim

(2022). What drives students’ successful reuse of online learning in higher education? A case of Google Classroom. Australasian Journal of Educational Technology, 38(3), 1–21. https://doi.org/10.14742/ajet.7333

45.

Jia

Pang

Huang

Hou

(2023). Understanding consumers’ continuance intention to watch streams: A value-based continuance intention model. Frontiers in Psychology, 14, 1073301. https://doi.org/10.3389/fpsyg.2023.1073301

46.

Jin

(2020). MOOC student dropout prediction model based on learning behavior features and parameter optimization. Interactive Learning Environments, 31(2), 714–732. https://doi.org/10.1080/10494820.2020.1802300

47.

(2022). Determinants of continuance intention toward e-learning during COVID-19: An extended expectation-confirmation model. Asia Pacific Journal of Education, 42(1), 1–21. https://doi.org/10.1080/02188791.2022.2140645

48.

Johnson

R. E.

Rosen

C. C.

Djurdjevic

(2011). Assessing the impact of common method variance on higher order multi-dimensional constructs. Journal of Applied Psychology, 96(4), 744–761. https://doi.org/10.1037/a0021504

49.

Jung

J.-H.

Shin

J.-I.

(2021). Assessment of university students on online remote learning during COVID-19 pandemic in Korea: An empirical study. Sustainability, 13(19), 10821. https://doi.org/10.3390/su131910821

50.

Kang

J. W.

Lee

Namkung

(2018). The impact of restaurant patrons’ flow experience on SNS satisfaction and offline purchase intentions. International Journal of Contemporary Hospitality Management, 30(2), 797–816. https://doi.org/10.1108/ijchm-09-2016-0537

51.

Kawabata

(2018). Facilitating flow experience in physical education settings. Psychology of Sport and Exercise, 38, 28–38. https://doi.org/10.1016/j.psychsport.2018.05.006

52.

Khan

I. U.

Hameed

Y. G.

Islam

Sheikh

Khan

S. U.

(2018). Predicting the acceptance of MOOCs in a developing country: Application of task-technology fit model, social motivation, and self-determination theory. Telematics and Informatics, 35(4), 964–978. https://doi.org/10.1016/j.tele.2017.09.009

53.

Kim

J. J.

Yoon

Kim

E. J.

(2021). A comparison of faculty and student acceptance behavior toward learning management systems. International Journal of Environmental Research and Public Health, 18(16), 8570. https://doi.org/10.3390/ijerph18168570

54.

Koc

Altun

Yuksel

H. G.

(2022). Writing an expository text using augmented reality: Students’ performance and perceptions. Education and Information Technologies, 27(1), 845–866. https://doi.org/10.1007/s10639-021-10438-x

55.

Lee

H. S.

Lee

(2021). The effect of elementary school soccer instruction using virtual reality technologies on students’ attitudes toward physical education and flow in class. Sustainability, 13(6), 3240. https://doi.org/10.3390/su13063240

56.

Lee

J. S.

Cho

(2021). Determinants of continuance intention for over-the-top services. Social Behavior and Personality, 49(12), e10566. https://doi.org/10.2224/sbp.10566

57.

Lee

M.-C.

(2010). Explaining and predicting users’ continuance intention toward e-learning: An extension of the expectation–confirmation model. Computers & Education, 54(2), 506–516. https://doi.org/10.1016/j.compedu.2009.09.002

58.

Wong

I. A.

(2021). Determinants predicting undergraduates’ intention to adopt e-learning for studying English in Chinese higher education context: A structural equation modelling approach. Education and Information Technologies, 26(4), 4221–4239. https://doi.org/10.1007/s10639-021-10462-x

59.

Nishimura

Yagami

Park

H.-S.

(2021). An empirical study on online learners’ continuance intentions in China. Sustainability, 13(2), 889. https://doi.org/10.3390/su13020889

60.

C. Y.

Phongsatha

(2022). Satisfaction and continuance intention of blended learning from perspective of junior high school students in the directly-entering-socialism ethnic communities of China. PLoS One, 17(12), e0270939. https://doi.org/10.1371/journal.pone.0270939

61.

Wang

(2022). Examining continuance intention of online learning during COVID-19 pandemic: Incorporating the theory of planned behavior into the expectation-confirmation model. Frontiers in Psychology, 13, 1046407. https://doi.org/10.3389/fpsyg.2022.1046407

62.

Wang

(2022). Examining continuance intention of online learning during COVID-19 pandemic: Incorporating the theory of planned behavior into the expectation–confirmation model. Frontiers in Psychology, 13, 6407. https://doi.org/10.3389/fpsyg.2022.1046407

63.

Wang

(2022). Optimizing the systematic characteristics of online learning systems to enhance the continuance intention of Chinese college students. Sustainability, 14(18). https://doi.org/10.3390/su141811774

64.

Wang

Wei

(2022). Antecedents of continuance intention in online learning systems among vocational college students: The moderating effect of gender. Front Psychol, 13, 1088270. https://doi.org/10.3389/fpsyg.2022.1088270

65.

Lindell

M. K.

Whitney

D. J.

(2001). Accounting for common method variance in cross-sectional research designs. Journal of Applied Psychology, 86(1), 114–121. https://doi.org/10.1037/0021-9010.86.1.114

66.

Liu

Y. F.

Zhang

M. L.

Zhang

(2022). Understanding the role of learner engagement in determining MOOCs satisfaction: A self-determination theory perspective. Interactive Learning Environments, 31, 6084–6098. https://doi.org/10.1080/10494820.2022.2028853

67.

Y. F.

Wang

Y. B.

(2019). Understanding key drivers of Mooc satisfaction and continuance intention to use. Journal of Electronic Commerce Research, 20(2), 105–117.

68.

Ruangkanjanases

Chen

S.-C.

(2019). Investigating the impact of critical factors on continuance intention toward cross-border shopping websites. Sustainability, 11(21), 5914. https://doi.org/10.3390/su11215914

69.

Martín-García

A. V.

Martínez-Abad

Reyes-González

(2019). TAM and stages of adoption of blended learning in higher education by application of data mining techniques. British Journal of Educational Technology, 50(5), 2484–2500. https://doi.org/10.1111/bjet.12831

70.

McGill

T. J.

Klobas

J. E.

(2009). A task-technology fit view of learning management system impact. Computers & Education, 52(2), 496–508. https://doi.org/10.1016/j.compedu.2008.10.002

71.

Meng

(2023). Understanding Chinese teachers’ informal online learning continuance in a mobile learning community: An intrinsic-extrinsic motivation perspective. Journal of Computing in Higher Education, 36, 275–297. https://doi.org/10.1007/s12528-023-09352-7

72.

Mercader-Rubio

Angel

N. G.

Silva

Furtado

Brito-Costa

(2023). Intrinsic motivation: Knowledge, achievement, and experimentation in sports science students-relations with emotional intelligence. Behavioral Sciences, 13(7), 19. https://doi.org/10.3390/bs13070589

73.

Mouakket

Bettayeb

A. M.

(2015). Investigating the factors influencing continuance usage intention of Learning management systems by university instructors. International Journal of Web Information Systems, 11(4), 491–509. https://doi.org/10.1108/ijwis-03-2015-0008

74.

Munoz-Organero

Munoz-Merino

P. J.

Kloos

C. D.

(2010). Student behavior and interaction patterns with an LMS as motivation predictors in e-learning settings. IEEE Transactions on Education, 53(3), 463–470. https://doi.org/10.1109/te.2009.2027433

75.

Navarro

M. M.

Prasetyo

Y. T.

Young

M. N.

Nadlifatin

Redi

(2021). The perceived satisfaction in utilizing learning management system among engineering students during the COVID-19 pandemic: Integrating task technology fit and extended technology acceptance model. Sustainability, 13(19), 10669. https://doi.org/10.3390/su131910669

76.

Niu

(2022). Factors influencing vocational college students’ creativity in online learning during the COVID-19 pandemic: The group comparison between male and female. Frontiers in Psychology, 13, 967890.

77.

Panigrahi

Srivastava

P. R.

Sharma

(2018). Online learning: Adoption, continuance, and learning outcome—A review of literature. International Journal of Information Management, 43, 1–14. https://doi.org/10.1016/j.ijinfomgt.2018.05.005

78.

Podsakoff

P. M.

MacKenzie

S. B.

Lee

J.-Y.

Podsakoff

N. P.

(2003). Common method biases in behavioral research: A critical review of the literature and recommended remedies. Journal of Applied Psychology, 88(5), 879–903. https://doi.org/10.1037/0021-9010.88.5.879

79.

Rachmatullah

Reichsman

Lord

Dorsey

Mott

Lester

Wiebe

(2021). Modeling secondary students’ genetics learning in a game-based environment: integrating the expectancy-value theory of achievement motivation and flow theory. Journal of Science Education and Technology, 30(4), 511–528. https://doi.org/10.1007/s10956-020-09896-8

80.

Rajeh

M. T.

Abduljabbar

F. H.

Alqahtani

S. M.

Waly

F. J.

Alnaami

Aljurayyan

Alzaman

(2021). Students’ satisfaction and continued intention toward e-learning: A theory-based study. Medical Education Online, 26(1), 1961348. https://doi.org/10.1080/10872981.2021.1961348

81.

Raza

S. A.

Qazi

Khan

K. A.

Salam

(2021). Social isolation and acceptance of the learning management system (LMS) in the time of COVID-19 pandemic: An expansion of the UTAUT model. Journal of Educational Computing Research, 59(2), 183–208. https://doi.org/10.1177/0735633120960421

82.

Roca

J. C.

Gagné

(2008). Understanding e-learning continuance intention in the workplace: A self-determination theory perspective. Computers in Human Behavior, 24(4), 1585–1604. https://doi.org/10.1016/j.chb.2007.06.001

83.

Rodríguez-Ardura

Meseguer-Artola

(2019). Flow experiences in personalised e-learning environments and the role of gender and academic performance. Interactive Learning Environments, 29(1), 59–82. https://doi.org/10.1080/10494820.2019.1572628

84.

Romero-Frias

Arquero

J. L.

del Barrio-Garcia

(2023). Exploring how student motivation relates to acceptance and participation in MOOCs. Interactive Learning Environments, 31(1), 480–496. https://doi.org/10.1080/10494820.2020.1799020

85.

Sahin

Dogan

Yildiz

Okur

M. R.

(2022). University students with special needs: Investigating factors influencing e-learning adoption. Australasian Journal of Educational Technology, 38(5), 146–162. https://doi.org/10.14742/ajet.7454

86.

Shahri

Hosseini

Phalp

Taylor

Ali

(2019). How to engineer gamification. Journal of Organizational and End User Computing, 31(1), 39–60. https://doi.org/10.4018/joeuc.2019010103

87.

Shanshan

Wenfei

(2022). Understanding the impact of quality elements on MOOCs continuance intention. Education and Information Technologies, 27(8), 10949–10976. https://doi.org/10.1007/s10639-022-11063-y

88.

Sirayos

Siriluck

(2021). Factors influencing continuance intention to use online learning management system platform. Proceedings of The International Conference on Electronic Business, 21, 181–188.

89.

C. Y.

Chen

C.-H.

(2020). Investigating university students’ attitude and intention to use a learning management system from a self-determination perspective. Innovations in Education and Teaching International, 59, 306–315.

90.

Sumi

R. S.

Kabir

(2021). Satisfaction of e-learners with electronic learning service quality using the SERVQUAL model. Journal of Open Innovation: Technology, Market, and Complexity, 7(4), 227. https://doi.org/10.3390/joitmc7040227

91.

Tam

Santos

Oliveira

(2018). Exploring the influential factors of continuance intention to use mobile Apps: Extending the expectation confirmation model. Information Systems Frontiers, 22(1), 243–257. https://doi.org/10.1007/s10796-018-9864-5

92.

Tseng

H. W.

Cunningham

B. J.

(2022). Learning technology acceptance and continuance intention among business students: The mediating effects of confirmation, flow, and engagement. Australasian Journal of Educational Technology, 38(3), 70–86. https://doi.org/10.14742/ajet.7219

93.

Ustun

A. B.

Yilmaz

F. G. K.

Yilmaz

(2021). Investigating the role of accepting learning management system on students’ engagement and sense of community in blended learning. Education and Information Technologies, 26(4), 4751–4769. https://doi.org/10.1007/s10639-021-10500-8

94.

Vogt

Albus

Seufert

(2021). Learning in virtual reality: Bridging the motivation gap by adding annotations. Frontiers in Psychology, 12, 645032. https://doi.org/10.3389/fpsyg.2021.645032

95.

Wang

C.-J.

(2021). Should I stay or should I go? Linking career decision-making self-efficacy to intention to stay in the hospitality industry based on internship experience. Sustainability, 13(19), 571. https://doi.org/10.3390/su131910571

96.

Wang

(2022). Student intrinsic motivation for online creative idea generation: Mediating effects of student online learning engagement and moderating effects of teacher emotional support. Frontiers in Psychology, 13, 954216. https://doi.org/10.3389/fpsyg.2022.954216

97.

Wang

Lin

C.-L.

Y.-S.

(2021). Continuance intention of university students and online learning during the COVID-19 pandemic: A modified expectation confirmation model perspective. Sustainability, 13(8), 4586. https://doi.org/10.3390/su13084586

98.

Wang

X. B.

A. T.

Lin

Liu

S. Y.

Song

T. H.

Huang

Jiang

L. L.

(2022). Perceived usefulness predicts second language learners’ continuance intention toward language learning applications: A serial multiple mediation model of integrative motivation and flow. Education and Information Technologies, 27(4), 5033–5049. https://doi.org/10.1007/s10639-021-10822-7

99.

Wang

Y.-T.

Lin

K.-Y.

(2021). Understanding continuance usage of mobile learning applications: The moderating role of habit. Frontiers in Psychology, 12, 736051. https://doi.org/10.3389/fpsyg.2021.736051

100.

Xie

Lai

Mao

Harmat

(2021). Flow as a key predictor of subjective well-being among Chinese university students: A chain mediating model. Frontiers in Psychology, 12, 743906. https://doi.org/10.3389/fpsyg.2021.743906

101.

Wang

(2018). Selection of cooperative enterprises in vocational education based on ANP. Educational Sciences: Theory & Practice, 18(5), 1507–1515.

102.

Wang

(2020). Influence of professional identity and core self-evaluation on job satisfaction of vocational education teachers and the mediating effect of work stress. Revista Argentina De Clinica Psicologica, 29(2), 31.

103.

Bao

(2022). Elementary and secondary school students’ perceptions toward the use of e-learning under the COVID-19 pandemic: A mixed-methods study. Information Technology & People, 37, 130–151. https://doi.org/10.1108/itp-01-2021-0019

104.

Yang

Cai

Yang

H. H.

Wang

X. C.

(2023). Examining key factors of beginner’s continuance intention in blended learning in higher education. Journal of Computing in Higher Education, 35(1), 126–143. https://doi.org/10.1007/s12528-022-09322-5

105.

Yu-Ping Chiu

C.-C. C.

(2023). Learning flow and continuous intention toward online remote learning an integrated framework. International Journal of Research in Education and Science, 9(2), 351–564. https://doi.org/10.46328/ijres/3052

106.

Zhang

Liu

Zhang

(2023). What are the key drivers to promote continuance intention of undergraduates in online learning? A multi-perspective framework. Frontiers in Psychology, 14, 1121614. https://doi.org/10.3389/fpsyg.2023.1121614

107.

Zhang

Z. W.

(2021). Positive psychology: The basics. Frontiers in Psychology, 12, 719489. https://doi.org/10.3389/fpsyg.2021.719489

108.

Zhao

Khan

(2021). The students’ flow experience with the continuous intention of using online English platforms. Frontiers in Psychology, 12, 807084. https://doi.org/10.3389/fpsyg.2021.807084

109.

Zhao

Liu

Y.-S.

(2021). The differentiate effect of self-efficacy, motivation, and satisfaction on pre-service teacher students’ learning achievement in a flipped classroom: A case of a modern educational technology course. Sustainability, 13(5), 52888. https://doi.org/10.3390/su13052888

110.

Zhao

Khan

(2022). The Students’ Flow Experience With the Continuous Intention of Using Online English Platforms [Article]. Frontiers in Psychology, 12, 15, Article 807084. https://doi.org/10.3389/fpsyg.2021.807084

111.

Zhao

Wang

Sun

(2020). Technological environment, virtual experience, and MOOC continuance: A stimulus–organism–response perspective. Computers & Education, 144. https://doi.org/10.1016/j.compedu.2019.103721