Sage Journals: Discover world-class research

Abstract

Although learning with mobile educational applications (apps) has become popular in higher education, the factors accounting for students’ voluntary continuous usage have not yet been investigated fully. This study aims to understand art students’continuance intention by combining the expectation-confirmation model (ECM) and the effect of technostress. A research model was proposed and verified with a sample of 339 undergraduates who majored in art from two Chinese universities. The results of structural equation modeling indicated that: (a) both perceived usefulness and satisfaction directly predict continuance intention, while perceived usefulness indirectly predicts continuance intention through the mediating effect of satisfaction; (b) Technostress has a direct negative effect on both perceived usefulness and continuance intention, but has no direct effect on satisfaction; (c) Technostress indirectly influence students’continuance intention through the mediator of perceived usefulness and satisfaction. The theoretical and practical implications based on the findings are discussed.

Plain Language Summary

Purpose: This study aims to understand art students’ continuance intention by combining the expectation-confirmation model (ECM) and the effect of technostress. Methods: A research model was proposed and verified with a sample of 339 undergraduates who majored in art from two Chinese universities. Conclusions: The results of structural equation modelling indicated that: (a) both perceived usefulness and satisfaction directly predict continuance intention, while perceived usefulness indirectly predicts continuance intention through the mediating effect of satisfaction; (b) Technostress has a direct negative effect on both perceived usefulness and continuance intention, but has no direct effect on satisfaction; (c) Technostress indirectly influence students’ continuance intention through the mediator of perceived usefulness and satisfaction. Implications: This finding provides practical implications for practitioners related to mobile educational apps. The positive influences of perceived usefulness and satisfaction suggested that mobile apps must provide their potential learners with useful content and a pleasant environment. Specifically, app developers can improve learners’ perceived usefulness and satisfaction by improving load speed, reducing response time, and providing potential users with what they most need to learn. Based on the negative effect of technostress, it is suggested that the developers of mobile apps should take technostress into account in their decision-making process. For instance, they should be wary of the potential increased technostress when they add more features and functionality to their apps to attract learners’ continuous use. In addition, educational institutions also have to pay more attention to guiding students to deal with technostress actively to reduce its negative effect. For instance, teachers should encourage art students to combine other activities, such as face-to-face communication and sports activities, with mobile learning to alleviate technostress. Limitations: Despite the promising findings, this study also has some limitations. Firstly, in this study, the sample was limited to art students from Chinese universities. Considering the cultural differences, we should be cautious about the generality of the findings to learners of different cultures. Future research could verify these associations with participants from different cultural backgrounds. Secondly, this study only examined the mediating effects of perceived usefulness and satisfaction on the impact of technostress on continuance intention. Future research could investigate the mediating effect of other variables in this association, such as learning burnout. Thirdly, we only employed self-reported measurement to collect data. Future research can combine the self-report method with qualitative research methods to obtain more objective data.

Keywords

expectation-confirmation model technostress art students mobile educational applications continuance intention

Introduction

Mobile educational applications (apps) are those developed specifically to teach a specific knowledge and are popular among university students (Hoi, 2020). They have various advantages including portability, context sensitivity, flexibility, accessibility, and individuality (C. Chen, 2018; Sung et al., 2015). In recent years, a large number of mobile educational apps have been developed, which provide learners a broader choice and enable them to learn at any time and place convenient to them. To promote learning, some apps are specifically designed, such as embedding engagement mode, situational mode, gamification design, and recommendation service (C.P. Chen, 2018; Godwin-Jones, 2011; Reinders & Pegrum, 2017). These mobile educational apps provide a great convenience for art students to learn for various purposes, such as postgraduate entrance examination preparation, English learning, work preparation, and so on.

Coupled with the popularity of mobile educational apps, several studies have been performed to examine their effectiveness (J.S. Lee & Sylvén, 2021; Papadima-Sophocleous et al., 2012). Take mobile English learning apps for example, many researchers reported that mobile learning is helpful to learners’ pronunciation and reading (Cao & Deng, 2019); vocabulary learning (Klimova, 2021; J.S. Lee & Drajati, 2019; Saran et al., 2012); writing (Li & Hegelheimer, 2013), and communication skills (J.S. Lee & Sylvén, 2021; Papadima-Sophocleous et al., 2012). From the findings above mentioned, there is no doubt that mobile learning brings a lot of benefits to learners, a reason why many individuals hold positive attitudes toward it (Yang & Wang, 2019). However, the fact is that some learners still prefer learning with non-tech tools, such as physical books (Nie et al., 2020), arising the question that equipping mobile devices with mobile apps and previous learning experiences may not necessarily lead to learners’continuance intention of using mobile apps. This study strives to investigate the factors influencing art students’ continuance intention regarding mobile educational apps. The value of the research is twofold. On the one hand, it will promote developers to create educational apps that are more palatable to art students, and on the other hand, it will also provide valuable evidence for educational institutions to guide art students to use the educational apps effectively.

The expectation-confirmation model (ECM) is one of the most widely used theories to explain individuals’continuance intention of using a given technology (Mouakket, 2018; Stone & Baker-Eveleth, 2013). According to ECM, perceived usefulness and satisfaction are two essential constructs associated with users’ intention to use a given information system continuously. In the context of learning technology usage, substantial research has confirmed that perceived usefulness predicts individuals’satisfaction, which in turn, leads to a higher level of continuance intention (Joo, Lee, & Ham, 2014; Joo, Lim, & Kim, 2011). In addition, technostress, as a negative consequence of technology use, is reported to have a negative impact on users’ cognitive evaluation, satisfaction, and continuance intention. Although both ECM and technostress are considered to be linked to the continuance intention of a given technology closely, to our knowledge, there is no study has combined them to explain an individual’s continuance intention. Therefore, this study intends to propose and test a research model to explain art students’continuance intention by employing ECM combined with the influence of technostress. Specially, we will examine the relationships among technostress, perceived usefulness, satisfaction, and continuance intention of art students’ using mobile educational apps.

Literature Review and Hypotheses Development

Mobile Educational Apps

Mobile educational apps aim to provide convenience for learners to obtain certain knowledge (Hoi, 2020). In recent years, a growing number of learners are using mobile educational apps for various learning purposes (C.P. Chen, 2018; Nie et al., 2020). Among them, university students are the largest group to some extent (Liu et al., 2021). In China, it is reported that up to 93% of university students are using (or have used) various mobile educational apps (Bian & Liu, 2017). As art students, to improve their professional knowledge and general knowledge level, they usually study with mobile educational apps. However, a phenomenon that can not be ignored is that when they have used apps for some time or the request is cancelled, they stop using or even refuse to continue using them (Nie et al., 2020). Although substantial research has examined the effectiveness of using mobile educational apps (C.P. Chen, 2018; Li & Hegelheimer, 2013) and the factors impacting learners’ initial acceptance (Bian & Liu, 2017; Chung et al., 2015; Nie et al., 2020), few studies concerned the continuous use. As it is known to all, learners’ continuous use is crucial to their knowledge acquisition and the development of mobile apps. As per the suggestions of previous literature (Bhattacherjee, 2001; Khlaif et al., 2023), the ECM and technostress have good explanatory power for the users’ behavior intention of a given technology. This study strives to understand art students’ continuous use of mobile educational apps using the ECM and the role of technostress.

Expectation-Confirmation Model

The expectation-confirmation model (ECM) was adapted by Bhattacherjee (2001) from the expectation-confirmation theory widely used to understand consumers’ post-purchase behavior. The ECM was considered a solid theory more suitable to explain the continuance intention of technology adoption than other well-known models, such as the technology acceptance model (TAM) and the unified theory of acceptance and use of technology (UTAUT) (Ambalov, 2018). Figure 1 presents the four constructs and relationships in ECM.

Figure 1.

The expectation-confirmation model.

According to the ECM, perceived usefulness and satisfaction are two essential constructs associated with users’ intention to use a given information system continuously (Bhattacherjee, 2001). Specifically, perceived usefulness focuses on an individual’s evaluation of the benefits of information technology use, especially in improving performance outcomes (Scherer et al., 2019). It is a key predictor of technology adoption, because it not only directly predicts continuance intention, but also through the mediating effect of satisfaction (Bhattacherjee, 2001). Satisfaction reflects an individual’s affect response after using an information system, which is more realistic, stable, and unbiased than his/her initial attitude toward technology in the pre-adoption phase, a reason why it is dominant for continuance intention. Since the ECM has been employed to explain users’continuance intention in many different technology usage contexts, it is reasonable to employ it to predict art students’continuance intention of using mobile apps.

In addition, as technostress was considered to be linked with perceived usefulness, satisfaction, and continuance intention closely, this study proposed technostress as another factor influencing art students’continuance intention of using mobile apps.

Perceived Usefulness, Satisfaction, and Continuance Intention

According to the ECM, there are positive associations among perceived usefulness, satisfaction, and continuance intention. Many subsequent empirical studies have also confirmed the direct effect of perceived usefulness and its indirect effect on continuance intention through satisfaction (S.C. Chen et al., 2018; Thong et al., 2006). Several empirical studies also confirmed the positive influences of perceived usefulness and satisfaction on continuance intention in the context of MALL (García Botero et al., 2018; Kim & Lee, 2016). Therefore, this study formulated the following hypotheses:

H1: Art students’perceived usefulness is positively associated with their satisfaction with mobile educational apps.

H2: Art students’perceived usefulness is positively associated with their continuance intention of using mobile educational apps.

H3: Art students’satisfaction is positively associated with their continuance intention of using mobile educational apps.

Technostress

Originally, technostress was coined by Brod (1984), who defined it as “a modern disease of adaptation caused by an inability to cope with new computer technologies in a healthy manner.” Coupled with the proliferation of digital technologies and their wide penetration into life and work, technostress has attracted increasing concern of researchers from various fields including psychology, management, information technology, business, and education (Suh & Lee, 2017; X. Zhao et al., 2020; G. Zhao et al., 2022). In recent literature, technostress was broadly defined as an individual’s overall stress resulting from his/her ongoing use of technology (X. Wang et al., 2020). In this study, technostress concerns the stress that art students experience due to the usage of mobile educational apps.

The antecedents and consequences of technostress are a highly concerning issue in the relevant literature, which has been studied both in organizational and personal technology usage contexts (Maier, Laumer, Weinert, et al., 2015; Tarafdar et al., 2007). For the antecedents, Tarafdar et al. (2007) concluded five technostress creators including techno-complexity, techno-invasion, techno-overload, techno-insecurity, and techno-uncertainty, while Maier, Laumer, Weinert, et al. (2015) categorized six stressors. In terms of the consequences of technostress, many studies found that technostress will bring adverse consequences. For instance, Tarafdar et al. (2010) confirmed that technostress may lead to the reduction of users’satisfaction and performance in workplace, while some research in the field of education found that technostress may predict teachers’ discontinuance intention of technology adoption (Khlaif et al., 2023). Some other studies reported that students who experience higher levels of technostress are more likely to experience learning burnout and get decreased academic performance (Yao & Wang, 2023; G. Zhao et al., 2022). However, few studies have concerned technostress and its consequences for art students when using mobile educational apps.

Technostress and Perceived Usefulness

Perceived usefulness is considered a crucial predictor of intention in different contexts of technology use (Ambalov, 2018; Joo, Lee, & Ham, 2014; Joo, Lim, & Kim, 2011; Khlaif et al., 2023; Yang & Wang, 2019). In this study, perceived usefulness refers to art students’ perception of the extent to which the usage of mobile educational apps will improve their academic performance. It is an individual’s cognitive evaluation of a given technology, which may be negatively biased by negative psychological states such as technostress (Steelman & Soror, 2017). Similarly, Ayyagari et al. (2011) also proposed that technostress creators are linked to technology characteristics such as usefulness and complexity. In addition, Verkijika (2019) found that an individual’s technostress level has a significant negative influence on one’s attitude toward digital textbooks, while Khlaif et al. (2023) empirically verified that technostress negatively predicts teachers’perceived usefulness and attitudes toward mobile technology.

In terms of mobile technology usage, studies reported that although smartphones have become more useful, the increase in use may lead to higher technostress (Boonjing & Chanvarasuth, 2017; Y.K. Lee et al., 2014; Yao & Wang, 2023). Similarly, G. Zhao et al. (2022) and X. Wang et al. (2020) also found that students suffer from technostress in technology-enhanced learning activities. One of the possible consequences of technostress is that individuals may choose other non-tech alternative tools rather than smartphones to complete tasks. In this regard, the possible technostress resulting from mobile educational apps may also influence their cognitive evaluation of it. Therefore, this study formulated the following hypotheses:

H4: Art students’technostress negatively predicts their perceived usefulness of mobile educational apps.

Technostress and Satisfaction

Satisfaction originally refers to an individual’s pleasant or positive state when appraising his/her job, which was introduced into the field of information technology usage by Bhattacherjee (2001). In the context of information technology use, satisfaction is defined as “the extent to which individuals are satisfied with the apps that they use” (Tarafdar et al., 2010). Users with higher levels of satisfaction are more likely to continue to use it (Bhattacherjee & Lin, 2015). In this study, satisfaction concerns art students’ pleasurable state resulting from their usage of mobile educational apps.

The negative association between technostress and satisfaction was first concerned by Tarafdar et al (2010), who empirically verified that technostress may lead to end-users decrease in satisfaction in the workplace. Subsequent studies confirmed that technostress is negatively associated with job satisfaction in the context of both teleworkers (Suh & Lee, 2017) and novice teachers (Q. Wang & Yao, 2023) working with information technology. They argued that users’ negative cognitions of technology use such as insufficient social interaction, dependence on technology, and the demands for constant adapting to newly emerging technologies, are possible reasons for their decrease of satisfaction (Suh & Lee, 2017). In the context of mobile learning, learners’ possible negative cognitions including eye strain and extensive technology dependence may also lead to dissatisfaction with mobile apps. Therefore, this study formulated the following hypotheses:

H5: Art students’technostress negatively predicts their satisfaction with mobile educational apps.

Technostress and Continuance Intention

Continuance intention refers to the individuals’ willingness to continuously use a given information technology (Huang, 2019), which seems to be one of the most concerned issues in the field of technology adoption. As a negative outcome of technology use, technostress is negatively associated with users’ initial and continuance intention of a given information technology (Khlaif et al., 2023; Maier, Laumer, Eckhardt, et al., 2015; Steelman & Soror, 2017; Verkijika, 2019). For instance, Chou and Chou (2021), and Khlaif et al. (2023) found that technostress shows a negative effect on teachers’ intention to continue using online teaching and mobile technology, respectively. Similarly, Steelman and Soror (2017) also confirmed that technostress may predict an individual’s continuous usage intention of consumer technologies negatively. Based on these previous findings, it is plausible to expect that art students who experience high technostress resulting from mobile learning may be less willing to use it continuously. Therefore, this study formulated the following hypotheses:

H6: Art students’technostress negatively predicts their continuance intention to use mobile educational apps.

The research model of this study was shown in Figure 2.

Figure 2.

The research model.

Method

Instruments Development

In the first part of the survey, six items were designed to collect participants’ demographic information and their experiences of using mobile educational learning apps. In the second part, 13 items were designed to collect data for the four constructs in the research model. All the items were revised from existing instruments with satisfactory good reliability and validity, and were presented in the form of a 5-point Likert scale.

Specifically, to measure art students’technostress when learning with mobile apps, four items were used from the instrument developed by Chou and Chou (2021). A sample item includes “I feel drained from learning with mobile apps.”Perceived usefulness was measured employing three items developed by Venkatesh et al. (2012). A sample item is “Using mobile educational apps improves my academic performance.” To measure art students’satisfaction, three items were developed with reference to the instrument used by Limayem et al. (2007). A sample item includes “I’m very satisfied with using mobile educational apps.”Continuance intention to use mobile educational apps was measured employing three items revised from Venkatesh et al. (2012). An example item includes “I intend to continue using mobile educational apps in the future.”

Participants

In China, the accessibility of mobile devices and the popularity of mobile learning for students at different universities do not vary much. Therefore, this study used the method of convenience sampling to select two public universities in Zhejiang Province and Jiansu Province respectively for data collection. We contacted several student counselors at both universities to recruit participants. The counselors made a brief introduction of this study in face-to-face classes and invited the students who were using (or had used) educational learning apps including English Liulishuo, Xueyibao, Baicizhan, etc. to participate in the survey voluntarily and anonymously.

A total of 339 valid responses were received. All the respondents were students who had at least 1 week of experience learning through mobile apps. The demographic information of the participants and their mobile app usage experiences were shown in Table 1.

Table 1.

Information of Participants.

Gender	Number	Percentage	Grade	Number	Percentage
Male	95	28.02	Freshman	136	40.12
Female	244	71.98	Sophomore	87	25.66
Age			Junior	83	24.48
<20	171	50.44	Senior	33	9.73
21 to 23	110	32.45
>24	58	17.11

Data Analysis

Data analysis was performed with AMOS (version 24.0) and SPSS (version 24.0), which included two steps. First, a confirmatory factor analysis (CFA) was performed to examine the reliability and validity of the measurement model. Then, structural equation modeling (SEM) was performed to test the proposed hypotheses.

Results

The Measurement Model

This study employed five key indicators to evaluate the measurement model, including standardized factor loadings, Cronbach’s alpha coefficients, convergent validity, discriminate validity, and the goodness of model fit.

The calculation results of CFA (shown in Table 2) revealed that the standardized factor loadings of all items were higher than .50 (ranging from .698 to .965), meeting the criterion that items’ standardized factor loadings should not be less than .50 (Schumacker & Lomax, 2004). Additionally, Cronbach’s alpha coefficients of the four constructs are all above .70.

Table 2.

Results of Construct Validity and Reliability Analysis.

Construct	Item	Loading	α	CR	AVE	Mean	SD
Technostress	TS1	.698	.925	0.930	0.771	2.82	0.83
	TS2	.956
	TS3	.956
	TS4	.877
Perceived usefulness	PU1	.938	.928	0.931	0.818	3.71	0.83
	PU2	.934
	PU3	.838
Satisfaction	SA1	.879	.907	0.907	0.766	3.74	0.82
	SA2	.874
	SA3	.872
Continuance intention	CI1	.940	.961	0.962	0.894	3.81	0.78
	CI2	.964
	CI3	.932

The convergent validity was examined by the coefficients of composite reliability (CR) and average variance extracted (AVE). In this study, the coefficients of CR were higher than 0.90 and the coefficients of AVE were higher than 0.70. These results met the criteria that the CR coefficients should not be less than 0.7 and the AVE coefficients should not be less than 0.5 (Fornell & Larcker, 1981), suggesting an acceptable convergent validity.

In this study, the square root of the AVE of each latent variable is greater than its correlation coefficients with other variables (shown in Table 3), indicating an acceptable discriminant validity (Chin, 1998). Finally, the fitness of the measurement model was acceptable with χ²/df = 2.161, AGFI = 0.921, TLI = 0.976, CFI = 0.985, RMR = 0.021, RMSEA = 0.051 (Hu & Bentler, 1999).

Table 3.

Discriminate Validity.

Constructs	1	2	3	4
Technostress	.878
Perceived usefulness	−.167	.904
Satisfaction	−.208	.759	.875
Continuance intention	−.296	.625	.637	.946

Note. The bold values in the diagonal row are the square roots of the average variance extracted for the constructs in the research model.

The Structural Model

The results of SEM (Table 4) indicated that the fitness of the research model was also acceptable. The results of hypothesis testing (Table 5) revealed that students’perceived usefulness is positively associated with satisfaction (β = .805, p < .001) and their continuance intention (β = .383, p < .001) to adopt mobile educational apps, supporting H1 and H1. Additionally, students’satisfaction is positively associated with their continuance intention (β = .296, p < .001), which supports H3. As for the effects of technostress, the results indicated that technostress is negatively associated with perceived usefulness (β = −.183, p < .005) and continuance intention (β = −.165, p < .001), supporting H4 and H6. However, technostress has no significant effect on satisfaction (β = −.070, p > .05), rejecting H5. The research model with its standardized coefficients was shown in Figure 3.

Table 4.

The Goodness of Fit Indices for the Measurement Model and Research Model.

Model	χ²	χ²/df	AGFI	TLI	CFI	RMR	RMSEA
Measurement model	127.524 (.000)	2.161	0.921	0.976	0.985	0.021	0.051
Research model	127.524 (.000)	2.161	0.921	0.976	0.985	0.021	0.051
Recommended criteria	p > .05	<5.0	>0.90	>0.90	>0.90	<0.05	<0.08

Table 5.

The Results Hypotheses Test.

Hypotheses	Hypothesized path	B	β	S.E.	T	Result
H1	PU-SA	0.759	.805	0.044	17.151***	Supported
H2	PU-CI	0.354	.383	0.078	4.517***	Supported
H3	SA-CI	0.291	.296	0.085	3.422***	Supported
H4	TS-PU	−0.226	−.183	0.071	−3.189**	Supported
H5	TS-SA	−0.082	−.070	0.046	−1.789	Rejected
H6	TS-CI	−0.189	−.165	0.050	−3.769***	Supported

Note. TS = Technostress; PU = Perceived usefulness; SA = Satisfaction; CI = Continuance intention.

***

p < .001. **p < .01.

Figure 3.

The research model with its standardized coefficients.

Direct, Indirect, and Total Effects among the Variables

The direct, indirect, and total effects among the variables of perceived usefulness, satisfaction, technostress, and continuance intention were calculated (Table 6). Some noteworthy results were that technostress has indirect effects weighting of −0.135 on learners’continuance intention mediated together by perceived usefulness and satisfaction with mobile educational apps, and the total effects weight of technostress on continuance intention is −0.300, which is at a moderate level. Additionally, the total effects weight of technostress on satisfaction is −0.217 with the indirect effect mediated by perceived usefulness.

Table 6.

Direct, Indirect, and Total Effects among the Variables.

Dependent variable	Independent variable	Direct effect	Indirect effect	Total effect
PU	TS	−0.183**	—	−0.183
SA	TS	−0.070	−0.147	−0.217
	PU	0.805***	—	0.805
CI	TS	−0.165***	−0.135	−0.300
	PU	0.383***	0.239	0.622
	SA	0.389***	—	0.309

Note. TS = Technostress; PU = Perceived usefulness; SA = Satisfaction; CI = Continuance intention.

Discussion, Contributions, and Implications

Discussion

This study examined art students’continuance intention of using mobile apps by combining CEM and the role of technostress. A research model was proposed and verified by the survey data of 339 students who have experience of using mobile educational apps. Some noteworthy findings were discussed in the following part.

ECM Explains the Continuance Intention of Mobile Educational Apps Well

The results indicated that both perceived usefulness and satisfaction directly predict continuance intention. In addition, perceived usefulness has an indirect positive on continuance intention through the mediating effect of satisfaction. These findings support the assumptions of ECM and in line with previous studies which reported positive associations between these three constructs (Ambalov, 2018; Barnes & Böhringer, 2011). The findings revealed the crucial role of perceived usefulness and satisfaction in predicting art students’ continuous use of mobile apps. In other words, students with higher levels of perceived usefulness and satisfaction are more likely to adopt mobile educational apps continuously.

Technostress Negatively Predicts Perceived Usefulness and Continuance Intention

In terms of the influence of technostress, the results indicated that technostress has a direct negative effect on both perceived usefulness and continuance intention, which is in line with previous findings that reported the technostress’ negative effect on perceived usefulness and continuance intention (Chou & Chou, 2021; Khlaif et al., 2023; Steelman and Soror, 2017; Verkijika, 2019). However, this finding is contrary to that of Maier, Laumer, Weinert et al. (2015), which found that individuals tend to use SNS continuously even when they get stressed by it. The potential explanation for these conflicting findings is that, unlike mobile learning which aims to acquire knowledge, SNS use usually provides individuals with pleasurable experiences such as emotional communication and information sharing, which may lead to their dependence and addiction. Therefore, the negative effect of technostress on continuance intention may be reduced in the context of SNS use. The findings of this study imply that technostress resulting from mobile educational apps may lead to a decrease in art students’ usefulness evaluation and continuance intention of them.

Additionally, technostress also indirectly influences students’continuance intention through the mediator of perceived usefulness and satisfaction, and the total effect of technostress on continuance intention is stronger (β = −.300). The finding suggested that technostress may lead to a decrease in learners’ willingness to use mobile apps continuously through negatively bias their cognitive evaluation (i.e., perceived usefulness) and affect response (i.e., satisfaction). This finding provides a possible explanation for the phenomenon that some students still prefer non-tech learning even if they have noticed the benefits of mobile learning (Nie et al., 2020).

Technostress has no Significant Effect on Satisfaction

However, the results also indicated that technostress has no direct effect on satisfaction, which is contrary to the findings of existing studies, which found that technostress negatively predicts users’satisfaction (Suh & Lee, 2017; Tarafdar et al., 2010; Q. Wang & Yao, 2023). The different characteristics of the samples, such as social role and technology usage contexts, may account for the conflicting findings to a certain extent. The participants of the previous three studies are employees or teachers who are required to use technologies for work purposes, while in this study the participants are art students who use technology for learning voluntarily. Since art students can freely choose educational apps based on their preferences, the impact of technostress on satisfaction may be reduced. To better understand the influence of technostress on satisfaction, further studies, whose sample is especially students, are necessary.

Contributions and Implications

The present study at least has three contributions. Firstly, to our knowledge, this is the first research to investigate art students’ voluntary use of mobile educational apps by combining ECM and the role of technostress, which provides a new theoretical framework for further study of relevant technology continuous adoption. It reminds researchers to pay attention to the impact of individuals’ psychological reactions to technology adoption. Second, by examining the relationships between technostress, learner’s cognitive evaluation (i.e., perceived usefulness), satisfaction, and continuance intention, this study clarified these interrelationships and helps to bridge the existing research gap in technostress literature. Last but not least, by investigating the effect of technostress, this study provided evidence that there is a necessity to further explore the generality of some conclusions about technology use, such as “People are likely to continue to use a given technology as long as it meets their expectations (Khlaif et al., 2023).”

This findings also provide practical implications for practitioners related to mobile educational apps. The positive influences of perceived usefulness and satisfaction suggested that mobile apps must provide their potential learners with useful content and a pleasant environment. Specifically, app developers can improve learners’perceived usefulness and satisfaction by improving load speed, reducing response time, and providing potential users with what they most need to learn. Based on the negative effect of technostress, it is suggested that the developers of mobile apps should take technostress into account in their decision-making process. For instance, they should be wary of the potential increased technostress when they add more features and functionality to their apps to attract learners’ continuous use. In addition, educational institutions also have to pay more attention to guiding students to deal with technostress actively to reduce its negative effect. For instance, teachers should encourage art students to combine other activities, such as face-to-face communication and sports activities, with mobile learning to alleviate technostress.

Limitations and Future Work

Despite the promising findings, this study also has some limitations. Firstly, in this study, the sample was limited to art students from Chinese universities. Considering the cultural differences, we should be cautious about the generality of the findings to learners of different cultures. Future research could verify these associations with participants from different cultural backgrounds. Secondly, this study only examined the mediating effects of perceived usefulness and satisfaction on the impact of technostress on continuance intention. Future research could investigate the mediating effect of other variables in this association, such as learning burnout. Thirdly, we only employed self-reported measurement to collect data. Future research can combine the self-report method with qualitative research methods to obtain more objective data.

Conclusion

This study explored art students’continuance intention of using mobile educational apps by employing the ECM and the role of technostress. Although technostress has no significant effect on satisfaction, it has a direct negative effect on both perceived usefulness and continuance intention, and even indirectly influences continuance intention through the mediator of perceived usefulness and satisfaction in the context of art students’ mobile app usage. Therefore, developers of mobile educational apps should take users’perceived usefulness, satisfaction, and technostress into account in their decision-making process. Educational institutions should also take effective measures to help students manage technostress and increase the continuous usage of mobile education apps.

Footnotes

Acknowledgements

The authors would like to thank all the students who participated in the study.

Declaration of Conflicting Interests

The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Funding

The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This study was partially funded by Presidential Fund of Minnan Normal University, Project Number (Project Number: sk20017).

ORCID iD

Xiaofan Yu

Data Availability Statement

Data sharing not applicable to this article as no datasets were generated or analyzed during the current study.

References

Ambalov

I. A.

(2018). A meta-analysis of IT continuance: An evaluation of the expectation-confirmation model. Telematics and Informatics, 35(6), 1561–1571. https://doi.org/10.1016/j.tele.2018.03.016

Ayyagari

Grover

Purvis

(2011). Technostress: Technological antecedents and implications. MIS Quarterly, 35(4), 831–858. https://doi.org/10.1093/jcr/ucaa031

Barnes

S. J.

Böhringer

(2011). Modeling use continuance behavior in microblogging services: The case of Twitter. Journal of Computer Information Systems, 51(4), 1–10. https://doi.org/10.1080/08874417.2011.11645496

Bhattacherjee

(2001). Understanding information systems continuance: An expectation-confirmation model. MIS Quarterly, 25(3), 351. https://doi.org/10.2307/3250921

Bhattacherjee

Lin

C.-P.

(2015). A unified model of IT continuance: Three complementary perspectives and crossover effects. European Journal of Information Systems, 24(4), 364–373. https://doi.org/10.1057/ejis.2013.36

Bian

Liu

(2017). Current situation of Chinese college students using English learning app. New Media Studies, 3(16), 21–22.

Boonjing

Chanvarasuth

(2017). Risk of overusing mobile phones: Technostress effect. Procedia Computer Science, 111, 196–202. https://doi.org/10.1016/j.procs.2017.06.053

Brod

(1984). Technostress: The human cost of the computer revolution. Addison Wesley Publishing Company.

Cao

Deng

(2019). Research on the influence of “Baicizhan” on college students’ English vocabulary learning in the perspective of mobile learning. Technology Enhanced Foreign Language Education, 6, 43–48.

10.

Chen

C.-P.

(2018). Understanding mobile English-learning gaming adopters in the self-learning market: The uses and gratification expectancy model. Computers & Education, 126, 217–230. https://doi.org/10.1016/j.compedu.2018.07.015

11.

Chen

S.-C.

Yen

D. C.

Peng

S.-C.

(2018). Assessing the impact of determinants in e-magazines acceptance: An empirical study. Computer Standards & Interfaces, 57, 49–58. https://doi.org/10.1016/j.csi.2017.11.004

12.

Chin

W. W.

(1998). Issues and opinion on structural equation modeling. Mis Quarterly, 22(1), 7–41.

13.

Chou

H.-L.

Chou

(2021). A multigroup analysis of factors underlying teachers’ technostress and their continuance intention toward online teaching. Computers & Education, 175, 104335. https://doi.org/10.1016/j.compedu.2021.104335

14.

Chung

H.-H.

Chen

S.-C.

Kuo

M.-H.

(2015). A study of EFL college students’ acceptance of mobile learning. Procedia - Social and Behavioral Sciences, 176, 333–339. https://doi.org/10.1016/j.sbspro.2015.01.479

15.

Fornell

Larcker

D. F.

(1981). Structural equation models with unobservable variables and measurement error: Algebra and statistics. Sage.

16.

García Botero

Questier

Cincinnato

Zhu

. (2018). Acceptance and usage of mobile assisted language learning by higher education students. Journal of Computing in Higher Education, 30(3), 426–451. https://doi.org/10.1007/s12528-018-9177-1

17.

Godwin-Jones

(2011). Emerging technologies: Mobile apps for language learning. Language Learning and Technology, 15, 2–11.

18.

Hoi

V. N.

(2020). Understanding higher education learners’ acceptance and use of mobile devices for language learning: A Rasch-based path modeling approach. Computers & Education, 146, 103761. https://doi.org/10.1016/j.compedu.2019.103761

19.

Bentler

P. M.

(1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55.

20.

Huang

Y.-M.

(2019). Examining students’ continued use of desktop services: Perspectives from expectation-confirmation and social influence. Computers in Human Behavior, 96, 23–31. https://doi.org/10.1016/j.chb.2019.02.010

21.

Joo

Y. J.

Lee

H. W.

Ham

(2014). Integrating user interface and personal innovativeness into the TAM for mobile learning in Cyber University. Journal of Computing in Higher Education, 26(2), 143–158. https://doi.org/10.1007/s12528-014-9081-2

22.

Joo

Y. J.

Lim

K. Y.

Kim

E. K.

(2011). Online university students’satisfaction and persistence: Examining perceived level of presence, usefulness and ease of use as predictors in a structural model. Computers & Education, 57(2), 1654–1664. https://doi.org/10.1016/j.compedu.2011.02.008

23.

Khlaif

Z. N.

Sanmugam

Ayyoub

(2023). Impact of technostress on continuance intentions to use mobile technology. The Asia-Pacific Education Researcher, 32, 151–162. https://doi.org/10.1007/s40299-021-00638-x

24.

Kim

G.-m.

Lee

S.-j.

(2016). Korean students’ intentions to use mobile-assisted language learning: Applying the technology acceptance model. International Journal of Contents, 12(3), 47–53. https://doi.org/10.5392/IJoC.2016.12.3.047

25.

Klimova

(2021). Evaluating impact of mobile applications on EFL university learners’ vocabulary learning – A review study. Procedia Computer Science, 184, 859–864. https://doi.org/10.1016/j.procs.2021.03.108

26.

Lee

Y.-K.

Chang

C.-T.

Lin

Cheng

Z.-H.

(2014). The dark side of smartphone usage: Psychological traits, compulsive behavior and technostress. Computers in Human Behavior, 31, 373–383. https://doi.org/10.1016/j.chb.2013.10.047

27.

Lee

J. S.

Drajati

N. A.

(2019). Affective variables and informal digital learning of English: Keys to willingness to communicate in a second language. Australasian Journal of Educational Technology, 35(5), 168–182. https://doi.org/10.14742/ajet.5177

28.

Lee

J. S.

Sylvén

L. K.

(2021). The role of informal digital learning of English in Korean and Swedish EFL learners’ communication behaviour. British Journal of Educational Technology, 52(3), 1279–1296. https://doi.org/10.1111/bjet.13082

29.

Hegelheimer

(2013). Mobile-assisted grammar exercises: Effects on self-editing in L2 writing. Language, Learning and Technology, 17(3), 135–156.

30.

Limayem

Hirt

Cheung

(2007). How habit limits the predictive power of intention: The case of information systems continuance. MIS Quarterly, 31, 705–737. https://doi.org/10.2307/25148817

31.

Liu

Ding

Fan

Hwang

G.-J.

Zhang

(2021). Self-oriented learning perfectionism and English learning burnout among EFL learners using mobile applications: The mediating roles of English learning anxiety and grit. Learning and Individual Differences, 88, 102011. https://doi.org/10.1016/j.lindif.2021.102011

32.

Maier

Laumer

Eckhardt

Weitzel

(2015). Giving too much social support: Social overload on social networking sites. European Journal of Information Systems, 24(5), 447–464. https://doi.org/10.1057/ejis.2014.3

33.

Maier

Laumer

Weinert

Weitzel

(2015). The effects of technostress and switching stress on discontinued use of social networking services: A study of Facebook use: Effects of technostress and switching stress. Information Systems Journal, 25(3), 275–308. https://doi.org/10.1111/isj.12068

34.

Mouakket

(2018). The role of personality traits in motivating users’ continuance intention towards Facebook: Gender differences. The Journal of High Technology Management Research, 29(1), 124–140. https://doi.org/10.1016/j.hitech.2016.10.003

35.

Nie

Zheng

Zeng

Zhou

Lei

Wang

(2020). Using the theory of planned behavior and the role of social image to understand mobile English learning check-in behavior. Computers & Education, 156, 103942. https://doi.org/10.1016/j.compedu.2020.103942

36.

Papadima-Sophocleous

Olga

Mallouris

(2012, January 1). IPod impact on oral reading fluency of university ESAP students [Conference session]. GLoCALL 2012. Beijing, China.

37.

Reinders

Pegrum

(2017). Supporting language learning on the move. In Tomlinson

(Ed.), SLA research and materials development for language learning (pp. 219–232). Routledge.

38.

Saran

Seferoğlu

Çağiltay

(2012). Mobile language learning: Contribution of multimedia messages via mobile phones in consolidating vocabulary. Asia-Pacific Education Researcher, 21, 181–190.

39.

Scherer

Siddiq

Tondeur

(2019). The technology acceptance model (TAM): A meta-analytic structural equation modeling approach to explaining teachers’ adoption of digital technology in education. Computers & Education, 128, 13–35. https://doi.org/10.1016/j.compedu.2018.09.009

40.

Schumacker

R. E.

Lomax

R. G.

(2004). A beginner’s guide to structural equation modeling. Psychology Press.

41.

Steelman

Z. R.

Soror

A. A.

(2017). Why do you keep doing that? The biasing effects of mental states on IT continued usage intentions. Computers in Human Behavior, 73, 209–223. https://doi.org/10.1016/j.chb.2017.03.027

42.

Stone

R. W.

Baker-Eveleth

(2013). Students’ expectation, confirmation, and continuance intention to use electronic textbooks. Computers in Human Behavior, 29(3), 984–990. https://doi.org/10.1016/j.chb.2012.12.007

43.

Suh

Lee

(2017). Understanding teleworkers’ technostress and its influence on job satisfaction. Internet Research, 27(1), 140–159. https://doi.org/10.1108/IntR-06-2015-0181

44.

Sung

Y.-T.

Chang

K.-E.

Yang

J.-M.

(2015). How effective are mobile devices for language learning? A meta-analysis. Educational Research Review, 16, 68–84. https://doi.org/10.1016/j.edurev.2015.09.001

45.

Tarafdar

Ragu-Nathan

B. S.

Ragu-Nathan

T. S.

(2007). The impact of technostress on role stress and productivity. Journal of Management Information Systems, 24(1), 301–328. https://doi.org/10.2753/MIS0742-1222240109

46.

Tarafdar

Ragu-Nathan

T. S.

(2010). Impact of technostress on end-user satisfaction and performance. Journal of Management Information Systems, 27(3), 303–334. https://doi.org/10.2753/MIS0742-1222270311

47.

Thong

J. Y. L.

Hong

S.-J.

Tam

K. Y.

(2006). The effects of post-adoption beliefs on the expectation-confirmation model for information technology continuance. International Journal of Human-Computer Studies, 64(9), 799–810. https://doi.org/10.1016/j.ijhcs.2006.05.001

48.

Venkatesh

Thong

J. Y. L.

(2012). Consumer acceptance and use of information technology: Extending the unified theory of acceptance and use of technology (SSRN Scholarly Paper No. 2002388). Social Science Research Network. https://papers.ssrn.com/abstract=2002388

49.

Verkijika

S. F.

(2019). Digital textbooks are useful but not everyone wants them: The role of technostress. Computers & Education, 140, 103591. https://doi.org/10.1016/j.compedu.2019.05.017

50.

Wang

Yao

(2023). The impact of technostress creators on novice teachers’ job satisfaction. Journal of Education for Teaching, 49(1), 104–119. https://doi.org/10.1080/02607476.2021.2013712

51.

Wang

Tan

S. C.

(2020). Technostress in university students’ technology-enhanced learning: An investigation from multidimensional person-environment misfit. Computers in Human Behavior, 105, 106208. https://doi.org/10.1016/j.chb.2019.106208

52.

Yang

Wang

(2019). Modeling the intention to use machine translation for student translators: An extension of Technology Acceptance Model. Computers & Education, 133, 116–126. https://doi.org/10.1016/j.compedu.2019.01.015

53.

Yao

Wang

(2023). Technostress from smartphone use and its impact on University students’ sleep quality and academic performance. The Asia-Pacific Education Researcher, 32(3), 317–326. https://doi.org/10.1007/s40299-022-00654-5

54.

Zhao

Wang

Dong

(2022). Exploring the structural relationship between university support, students’ Technostress, and Burnout in Technology-Enhanced Learning. The Asia-Pacific Education Researcher, 31, 463–473. https://doi.org/10.1007/s40299-021-00588-4

55.

Zhao

Xia

Huang

(2020). Impact of technostress on productivity from the theoretical perspective of appraisal and coping processes. Information & Management, 57(8), 103265. https://doi.org/10.1016/j.im.2020.103265

Art Students’ Technostress,Perceived Usefulness,Satisfaction,and Continuance Intention to Use Mobile Educational Applications

Abstract

Plain Language Summary

Keywords

Introduction

Literature Review and Hypotheses Development

Mobile Educational Apps

Expectation-Confirmation Model

Perceived Usefulness, Satisfaction, and Continuance Intention

Technostress

Technostress and Perceived Usefulness

Technostress and Satisfaction

Technostress and Continuance Intention

Method

Instruments Development

Participants

Data Analysis

Results

The Measurement Model

The Structural Model

Direct, Indirect, and Total Effects among the Variables

Discussion, Contributions, and Implications

Discussion

ECM Explains the Continuance Intention of Mobile Educational Apps Well

Technostress Negatively Predicts Perceived Usefulness and Continuance Intention

Technostress has no Significant Effect on Satisfaction

Contributions and Implications

Limitations and Future Work

Conclusion

Footnotes

Acknowledgements

Declaration of Conflicting Interests

Funding

ORCID iD

Data Availability Statement

References