Factor Associated With Teacher Satisfaction and Online Teaching Effectiveness Under Adversity Situations: A Case of Vietnamese Teachers During COVID-19

Abstract

How teachers perform and react to the world-wide pandemic and how the epidemic affects an education system may also be used as new conditions to consider the way to enhance SDG4 in developing countries. Regarding that concern, this study investigated 294 teachers’ perspective on their teaching effectiveness and satisfaction during COVID-19. The findings underlined the significant roles of support from various stakeholders, school readiness toward digital transformation, and teachers’ anxiety over teacher satisfaction. Notably, teachers’ newly absorbed technological and pedagogical skills do elevate their teaching effectiveness but do not lead to higher satisfaction during the pandemic.

Keywords

teacher performance teacher satisfaction Vietnam COVID-19 SDG4

There is no boundary that can stop the impact of COVID-19 across countries and industries. As a country which started dealing with the COVID-19 very soon, Vietnam has applied a school closure policy for schools all over the nation since February 4, 2020. The Vietnamese education system has to face a trilemma of ensuring the safety, learning progress, and proper living standard for teachers. On the one hand, the threats of SAR-COV-2 virus over students and teachers were limited. On the other hand, there are massive changes in teaching and learning habits as online learning was not a popular solution in the country (T. Tran, et al., 2020). In addition, more than one million Vietnamese teachers have to upgrade themselves to master new technologies while the concerns about the future always exist in their mind.

Expanded from Wuhan, China, since early January 2020, the COVID-19 has been labeled with different levels of risk by various governments (Callaway, 2020). Some governments decided to adopt a social distancing policy in early February (Brahma et al., 2020), while other cabinets did not tighten their preventive regulations until early April (University of Oxford, 2020). Empirical evidence from prior coronavirus epidemics reported low levels of transmission in schools. However, by March 18, 2020, the school closure policy has been applied in 107 countries (Viner et al., 2020). Till early May, more than 1,268 million students, which are about 72% of total learners across 177 countries and territories, were affected by the COVID-19 (UNESCO, 2020). To minimize the negative impact of school closure, universities and educational institutions over the globe established different platforms, resources, and guidelines to fulfill the gap of teacher competency (Cambridge University, 2020; VPAL, 2020) and elevate learning and teaching practices (MHA, 2020). Notwithstanding, the sudden digital transformation still did not adapt to the teaching and learning demand, as well as caused new educational inequality (Hodges et al., 2020). Such unforeseen changes lead to adverse effects over students, parents, and teachers (Hoang, 2020; Hoang et al., 2020; T. Tran, et al., 2020), not to mention the other damages to economics and society (Bin Nafisah et al., 2018; Rashid et al., 2015).

As a very close neighboring country with 1.435 km of shared land borders with China, Vietnam alerted the high risk of COVID-19 since very early (La et al., 2020). Besides the debate on the effectiveness of national school closure policy (T. Tran, A.-D. Hoang, Y. C. Nguyen, L.-C. Nguyen et al., 2020), there are also arguments on tuition that parents have to pay during school closure (Nguyen et al., 2020). While teachers in public schools were not affected by the tuition contest, teachers in private schools struggled, especially kindergarten teachers, whose grade levels are not appropriate for online classes. Specifically, among nearly 42,000 teachers had postponed working contracts and no salary, 29,700 of those were kindergarten teachers (Thanh, 2020). On March 3, 2020, a group of more than 150 private education institutions proposed a letter to the Vietnamese government, asking for support on policy, regulations, and taxation. Accordingly, about 70% of private education institutions will go bankrupt in the next 3 months as their cash flows were disrupted (Nguyen, 2020). Tackling the cost and damage of COVID-19 is a crucial mission of scientist, especially researchers in developing countries like Vietnam (Vuong, 2018). Regardless of the sources and the level of issues, these difficulties seriously challenge teachers’ motivation and commitment to the teaching profession (Canrinus et al., 2012). Thus, sustaining teachers’ mental health during the pandemic is also very important.

Teaching effectiveness and teacher satisfaction are the main concerns of educational leaders in most countries and territories (Mulford, 2003; OECD, 2005). However, there is a lack of studies on teacher satisfaction and teaching effectiveness under the circumstance of school closure and social distancing policies due to pandemic. Thus, besides responding to the call of researching to prevent and minimize the impact of COVID-19 (Elseviers, 2020), this study also extended literature on teacher satisfaction and effectiveness, with a focus on the chaotic situation of a global crisis. This empirical evidence can contribute to elevating the way teachers overcome future adversity situations. Concerning the influence of stress, perceived support, school readiness, and teachers’ newly absorbed skills over their satisfaction and teaching effectiveness, this study focused on those following research questions:

How do teachers’ perceptions on the impact of COVID-19 affect their satisfaction and online teaching effectiveness?

How do teachers’ perceived support affect their satisfaction and online teaching effectiveness?

How does school readiness toward online learning affect teacher satisfactions and online teaching effectiveness?

How do teachers’ newly absorbed knowledge and skills affect their satisfaction and online teaching effectiveness?

Literature Review

Teacher Satisfaction

Teacher satisfaction is crucial to the operational excellence of any educational institution. Satisfaction in the teaching profession is quite different from other occupations due to its nature mechanism (Jorde-Bloom, 1986), antecedents, and outcomes (Skaalvik & Skaalvik, 2011). As life-long learners, teachers always seek new opportunities to develop themselves and raise their standards continuously (Little, 1995). Thus, maintaining intrinsic and extrinsic motivations is an essential concern, regarding the need for sustainable education quality (Hoang et al., 2020b; Pearson & Moomaw, 2005). Scholars have noticed that there are two broad measures or aspects of peoples' career satisfaction instead of a classical concept of a simple continuum or single measure (Holdaway, 1978; Nias, 1981). On the one hand, teachers are most satisfied by matters intrinsic to the role of teaching. On the other hand, teachers are dissatisfied with extrinsic issues to the task of teaching and working, such as the broader domain of society, governments, and the employing body (Dinham & Scott, 1996).

Recently, newly proposed clustering approaches for teacher job satisfaction follow the initial research of Hofstede (1980) on six dimensions of cultural values, which include an aspect of collective versus individual behavior (Klassen et al., 2010). In particular, different cultures also lead to various contributions to the notion of teacher job satisfaction. Teachers from collective cultures like East Asian countries often have higher job commitment due to higher eagerness to prolong to directorial settlement (Kirkman & Shapiro, 2001). Even for Chinese teachers who are working in Western countries, the teachers who tribute the long-established value of following leaders also experience pressure adversely compared to their countryman who pared down that traditional belief (Xie et al., 2008). Disregarding the identical and cultural aspects, Leithwood and Sun (2012) stated that leadership could influence both the collective behavior and individual behavior of teachers. Caprara et al. (2003) confirmed that teachers' performance does enrich teacher job satisfaction in both collectivistic and individualistic cultures. However, Muhammad Arifin (2015) made an important point that despite the significant influence of motivation over teacher job satisfaction, its impact on teacher efficiency still needs more investigation.

Factors associated with teachers’ satisfaction can be categorized by the origin of the problem (internal-caused or external-caused) (Thibodeaux, 2014) or the level of challenge (Klassen et al., 2010). In particular, teachers themselves encounter adversity situations that generate conflicts and stress (Cooper & Travers, 2012; Gold & Roth, 2013). Besides teacher’s perceived unfairness and sadness, different stakeholders such as students, colleagues, school managers, school administrators (Sergiovanni, 1967), and media (Hargreaves & Fullan, 1998) can also influence teacher job satisfaction. Regarding the hierarchy of factors associated with teacher satisfaction, Dinham and Scott (1998) proposed an eight-factor model to capture the notion of teacher satisfaction over three domains which are as follows: core teaching activities, school-related factors, and society-related factors. Day et al. (2007) and Dörnyei and Ushioda (2013) both confirmed that indicators related to the core teaching profession as the most critical factor which maintain a high level of teacher satisfaction. In contrast, they also stated that it is not easy to make teachers happy with school leadership, working culture, organizational structure, decision-making process, or school reputation. Admit that challenges, any action aiming to enhance teacher satisfaction by tackling school-level issues, are often acknowledged by teachers (Leithwood & Sun, 2012; Nguni et al., 2006).

Regardless of the sources and the level of issues, these difficulties seriously challenge teachers’ motivation and commitment to the teaching profession (Canrinus et al., 2012). Accordingly, we suggested four hypotheses to examine the influence of teacher perceptions, the support they received, the readiness of their school toward online learning during the pandemic, and their newly absorbed competencies, over teacher satisfaction during COVID-19.

Hypothesis

1a: Stress feeling of COVID 19 has a negative impact on teacher satisfaction.

Hypothesis

2a: Teacher perceived supports have a positive impact on teacher satisfaction.

Hypothesis

3a: School readiness toward online learning has a positive impact on teacher satisfaction.

Hypothesis

4a: Newly absorbed knowledge and skills during the pandemic period have a positive impact on teacher satisfaction.

Online Teaching Effectiveness

Teaching Effectiveness

Teaching is one of the most stressful occupations (Johnson et al., 2005), in which teachers have to maintain high levels of performance regardless of their condition (Chaplain, 1995). Both the early-stage teachers to experienced teachers, from under-graduated students to professors, have to face the stressful nature of teaching (Chaplain, 2008; Kyriacou, 1987). There are three factors of performance, including task performance, citizenship behavior, and counterproductive behavior (Colquitt et al., 2011). Teacher performance, therefore, is the demonstration of their impact on students learning and can be measured through student achievement, pedagogical practice observation, school, or student survey results (Lieberman & Miller, 1984). Teacher effectiveness is the aggregated impact of teacher behaviors on student learning (Chi et al., 2013; Seidel & Shavelson, 2007). Marsh and Bailey (1991) proposed the multi-dimensional approach to measure teacher effectiveness, including learning value, teaching enthusiasm, clear expression, group interaction, the harmonious relationship between teachers and students, tr context, evaluation methods, extracurricular assignments, and learning difficulty. Notwithstanding, teacher effectiveness influences student achievement the most, in comparison with other determinants like class size, in-class composition, or previous student achievement (Darling-Hammond & Youngs, 2002; Staiger & Rockoff, 2010).

Teachers’ psychological characteristics have long been hypothesized to contribute to teaching effectiveness (Barr, 1952). Therefore, the state of well-being is necessary for effective teaching performance. Calabrese (1987) featured that teachers with higher teaching effectiveness and engagement are the ones who have a lower level of stress. Overall, factors related to the organizational culture, such as working pressure, learning cultural, and interpersonal issues with students or colleagues, can lead to a higher level of teacher stress (Antoniou et al., 2006). For instance, the most common sources of stress for almost teachers are student behavior and workload (Boyle et al., 1995). Regarding the internal factors that affect teacher performance, Maddux (1995) stated that teacher self-efficacy is the most crucial toward teacher performance. In particular, teachers’ personality, perception, emotion, and cognitive determine the way they develop their learning capabilities, as well as social interaction toward better performance. In some specific circumstances, physical and mental support is needed to enhance the educational process. Supportiveness is not just to provide help but also includes interactive behaviors such as offering comfort and exchanging material resources, knowledge, and information (Sarros & Sarros, 1992). A considerable number of studies in social support and well-being have verified that social support can relieve an entity of pressure, maintain mental health, and increase prosperity at work (Holt-Lunstad et al., 2010; Toker, 2011). Social support is significantly related to well-being and a significant factor for predicting well-being and teaching effectiveness. Hsu and Tsai (2013) mentioned that suitable and proper social support from supervisors, peers, and families could enhance teaching effectiveness.

ICT Competency

Regarding the critical role of Information and Communication Technologies (ICT) in the global digitalization context (Vitanova et al., 2015), both teaching and learning effectiveness could be improved significantly. In almost all countries of the Asia Pacific region, teacher ICT enhancement programs are accessible for teachers across educational types and levels (Sahito & Vaisanen, 2017). Toward sustainable education, several European countries recommended the utilization of ICT embedment within future teacher development plans (Usun, 2009). The digital transformation process is beyond the single purpose of using ICT applications as tools but extended to the renovation of teacher roles and pedagogies toward a constructive learning environment (Valcke et al., 2007). As a result, there are also changes in the requirements, structures, and approaches of teacher continuous professional development programs (Riviou & Sotiriou, 2017).

Several factors determine teachers' ICT competencies, such as teachers' attitudes toward ICT, ICT experience and skills, self-efficacy, and perceived usefulness of ICT (Hernández-Ramos et al., 2014). The individual accountability, evaluation, career development, and formal qualifications of the teachers also play a vital role in enhancing the ICT skills that can create and maintain the link between ICT, the curriculum, teachers' needs, and professional development within a planned policies framework (Valcke et al., 2007). In short, literature has pointed out that teachers' attitudes toward the new technologies, their perceived framework guidelines, self-efficacy, and experience are crucial determinants of the ICT integration in the teaching–learning process (Valcke et al., 2007). Therefore, the overall effectiveness and efficiency of the educational activities are improved.

Considering the novel impact of the COVID-19 on education, there is a necessity of understanding factors that affect teaching effectiveness, especially under the pressure of a sudden digital transformation due to school suspension. Correspondingly, this research measures the impacts of teachers’ perspectives during COVID-19 and teachers’ ICT competencies on teaching effectiveness through the following hypotheses:

Hypothesis

1b: Stress feeling of COVID-19 has a negative impact on online teaching effectiveness.

Hypothesis

2b: Teacher perceived supports have a positive impact on online teaching effectiveness.

Hypothesis

3b: School readiness toward online learning has a positive impact on online teaching effectiveness.

Hypothesis

4b: Newly absorbed knowledge and skills during the pandemic period have a positive impact on online teaching effectiveness.

Research Framework and Research Method

Conceptual Framework

Consider teachers as the main subject of this study, this research investigated how teachers’ satisfaction and online teaching effectiveness during COVID-19 varied due to diversity in their perceptions about the pandemic’s impact. In particular, we examined teacher satisfaction (SAT) and online teaching effectiveness (ONL_EFF) during COVID-19 as the primary outcomes. Indistinct, SAT included teachers’ satisfaction on the supportiveness they received toward (i) their daily living (Satis_life) and (ii) online teaching and learning activity (Satis_teach_learn). Online teaching effectiveness was constructed by (i) teachers’ perceived teaching effectiveness (Onl_effective) and (ii) student activeness and engagement (Onl_active). Referred from the literature review, we constructed the antecedents as follows. First, teachers’ perceived perspective regarding COVID-19 (FEEL) included teachers’ feeling that there are significant changes in their living habits and financial status. The second construct is the support (SUP), which teachers receive from the Government, teacher union, and the parent association. Third, teacher readiness for online teaching (READY) is an accumulation of preparation in ICT infrastructure (Ready_ICT), school policies (Ready_policy), and teacher competency (Ready_teacher). The final construct is a function of the newly acquired technological and pedagogical knowledge (NEW). All of those above items are teachers’ self-report and were measured by a Likert scale of five (1= totally disagree, 2 = disagree, 3 = neither disagree nor agree, 4 = agree, and 5 = totally agree). Figure 1 demonstrates the overall structural equation model (SEM) to examine the relationship of four factors on teacher satisfaction and online teaching effectiveness under the adverse situation.

Figure 1.

Conceptual framework of the influences of perceived supportiveness, stress feeling, school readiness, and new knowledge absorption on teachers’ satisfaction and online teaching effectiveness.

Data Collection

The research protocol has been approved by EdLab Asia Educational Research and Development Centre’s IRB (No.200402). Researchers collected these data from April 6, 2020 to April 11, 2020, 2 months since the first date of school closure due to COVID-19 in Vietnam. Initially, a preliminary test was conducted with the involvement of thirty K-12 teachers and four principals in Hanoi to validate the measurements. After revising the questionnaire, we spread the survey URL across the Facebook groups of Microsoft Innovative Educator and Vietnam Innovative Education Forum–the most popular online community of Vietnamese teachers, with 38,600 members and 14,000 members, respectively. Within 1 week, there were 1005 clicks on our survey, which led to 373 potential observations. However, the final dataset includes 294 observations only, due to the exclusion of 79 respondents which violated our cross-checking questions. The final dataset has been stored in Harvard Dataverse (Hoang et al., 2020c), and the full descriptive statistic can also be found in Data in Brief (Vu et al., 2020).

Results and Discussion

Descriptive Statistic

Table 1 presents the demographic of 294 respondents. The majority of respondents are female (83.3%), come from public schools (65.0%), and teachers mostly have bachelor’s degrees (61.6%). Regarding teaching experience, nearly half of the teachers (41.8%) have more than ten years of teaching experience. Regarding teaching subjects, the distribution is quite equal, namely, 29.6% in sciences-related, 23.8% in social sciences-related, 19.4% in foreign languages, and 27.2% in other subjects. Many teachers are teaching in primary school (34.0%), while lower, upper, and post-secondary school teachers account for 21.4%, 22.4%, and 19.0%, respectively.

Table 1.

Demographic and Basic Information of Respondents.

Characteristic	Respondents
Characteristic	Frequency (n = 294)	%
Gender
Male	46	15.6
Female	245	83.3
Prefer not to disclosure	3	1.0
Teaching experience
From 1 to 3 years	64	21.8
From 3 to 5 years	48	16.3
From 5 to 10 years	59	20.1
More than 10 years	123	41.8
Teaching qualification
Diploma	13	4.4
BA	181	61.6
MA	89	30.3
Doctor	11	3.7
School type
Public school	191	65.0
Private (normal)	49	16.7
Private (bilingual/international)	37	12.6
Continuing education center	13	4.4
Other	4	1.4
Subject
Sciences-related	87	29.6
Social sciences-related	70	23.8
Foreign language	57	19.4
Others	80	27.2
Grade level
Pre-K	9	3.1
Primary	100	34.0
Lower secondary	63	21.4
Upper secondary	66	22.4
Post-secondary	56	19.0

Measurement Model

Measurement Validation

We used SPSS 20 to conduct confirmatory factor analysis (CFA) and AMOS to run structural equation modeling (SEM). Initially, we assessed to find out whether our model has acceptable goodness of fit, as suggested by a two-step approach (Anderson & Gerbing, 1988). The results for the goodness of fit are presented in Table 2. As can be seen from the table, the Chi-square of the model is 73.596, the degree of freedom is 55, and the adjusted Chi-square over the degree of freedom is 1.338 (smaller than 3) (Mantel, 1963). Moreover, the goodness of fit (GFI) is 0.966 (>0.95), and the adjusted goodness of fit (AGFI) is 0.935 (>0.90) which indicates a well-fitting model (Hooper et al., 2008). Finally, the model reports normed-fit index (NFI) of 0.957 (>0.95), root-mean-square error (RMSEA) of 0.034 (<0.08), and comparative fit index (CFI) of 0.988 (>0.95) (Hooper et al., 2008). All in all, all indices suggest a good fitting model.

Table 2.

Results of Multiple Fit Indices.

Index	Result	Acceptable level
Chi-square	73.596	-
Degree of freedom	55	-
Chi-square/Degree of freedom	1.338	<5
GFI	.966	>0.9
AGFI	.935	>0.8
NFI	.957	>0.9
RMSEA	.034	<0.08
CFI	.988	>0.9

Table 3 demonstrates the outputs of factor loading for CFA at p < 0.001. With 294 observations in our study, a factor loading value of 0.50 is required for each item (Hair et al., 1998). From Table 3, all elements in their related constructs have high enough factor loading values. As a result, four factors (perceived support, stress feeling, school readiness, and new knowledge absorption), as well as teacher satisfaction and online teaching effectiveness, are measured by their reliable indicators.

Table 3.

Results of Factor Loading for Confirmatory Factor Analysis.

Items	Factor loading
FEELING (FEEL)
Feel_fin	0.588
Feel_habit	0.856
SUPPORT (SUP)
Sup_parents	0.735
Sup_union	0.831
Sup_gov	0.89
NEW KNOWLEDGE (NEW)
New_ICT	0.856
New_pedagogy	0.767
SCHOOL READINESS (READY)
Ready_ICT	0.771
Ready_policy	0.878
Ready_teacher	0.863
ONLINE TEACHING EFFECTIVENESS (ONL_EFF)
Onl_active	0.954
Onl_effective	0.701
TEACHER SATISFACTION (SAT)
Satis_teach_learn	0.697
Satis_life	0.886

Finally, Table 4 shows the results of the convergent and discriminant validity test. All of the measurement constructs have composite reliability (CR) bigger or equal to 0.7, average variance extracted (AVE) bigger than 0.5 (Byrne, 2013), and maximum shared variance (MSV) smaller than AVE (Fornell & Larcker, 1981). The maximum reliability (MaxR(H)) was also examined. Subsequently, the model’s discriminant validity is constructed (Hancock & Mueller, 2001). Besides, outputs of factor correlations confirm the negative influence of teacher satisfaction, online teaching effectiveness, and teachers’ feeling.

Table 4.

Convergent and Discriminant Validity.

Construct	CR	AVE	MSV	MaxR(H)	Factor correlation
Construct	CR	AVE	MSV	MaxR(H)	SAT	SUP	FEEL	READY	NEW	ONL
SAT	0.775	0.635	0.194	0.821	0.797
SUP	0.861	0.674	0.194	0.878	0.441	0.821
FEEL	0.7	0.539	0.116	0.766	−0.340	−0.087	0.734
READY	0.876	0.703	0.170	0.886	0.401	0.241	0.034	0.839
NEW	0.795	0.661	0.170	0.807	0.122	0.118	0.127	0.412	0.813
ONL_EFF	0.821	0.701	0.088	0.917	0.163	0.085	−0.297	0.128	0.232	0.837

Structural Model

Table 5 illustrates the outputs for SEM. As can be seen from the coefficients, the perceived support and school readiness have positive relationships with teacher satisfaction. In particular, the more support teachers received from both inside and outside schools, the more appreciation they have. Among various supports, the support from the government is the most crucial to teachers, with the estimated correlation of 0.79; support from parents association weights 0.54 only (the detailed interactions between constructs and their related factors can be seen in Supplementary Appendix 1). Moreover, if the schools are more ready for the transformation (online learning), the teachers would feel more satisfied. The readiness related to policies and teachers’ capabilities contributed most to general school readiness according to teachers’ views (0.77 and 0.74, respectively), while ICT infrastructure accounted for a smaller part (0.59). However, these factors (perceived support and school readiness) have no impact on teachers’ perception of online teaching effectiveness.

Table 5.

Results of Structural Equation Model.

	Coefficient	p	Hypothesis
Dependent variable: SAT
SUP	0.334	***	H2a supported
FEEL	−0.32	***	H1a supported
READY	0.341	***	H3a supported
NEW	−0.022	0.752	H4a not supported
R²	39%
Dependent variable: ONL
SUP	0.016	0.809	H2b not supported
FEEL	−0.33	***	H1b supported
READY	0.029	0.691	H3b not supported
NEW	0.26	***	H4b supported
R2	16.3%

Chi-square = 73.223; degree of freedom = 54; Cmin/df = 1.356; goodness of fit (GFI) = 0.966; adjusted goodness of fit (AGFI) = 0.934; normed fit index (NFI) = 0.957; root mean square error of approximation (RMSEA) = 0.035; The Tucker–Lewis coefficient (TLI) = 0.988 and comparative fit index (CFI) = 0.988

In addition, stress feeling in teachers has a negative relationship with both teachers’ satisfaction and teachers’ perception of online learning, and the two influences are quite similar in weight (−0.32 and −0.33). In other words, when teachers feel they have to change daily habits or their financial plan is threatened due to COVID-19, they tend to have lower satisfaction, and they consider online teaching is less effective. Between the change in daily habit and financial plan, teachers are affected more by daily habit changes, with the estimated correlation of 0.73 compared to 0.34 of the financial threat.

The final remarkable relationship is between newly absorbed knowledge and skills and teachers' perception of online learning. This positive relationship shows that the more teachers acquire new pedagogy and ICT knowledge and skills, the more students' engagement and online effectiveness they perceive. For the respondents, new ICT knowledge and expertise is slightly more critical than pedagogy- related knowledge and skills (a difference of 0.14). Additionally, teachers' perception of online learning focuses a lot on students' active engagement (0.91) compared to the effectiveness of teaching and learning (0.49).

Conclusion

Teacher satisfaction is a crucial element toward teaching commitment and teaching effectiveness, which contribute to sustainable education development. The main goal of this study is to explore teachers’ satisfaction and teaching effectiveness during the sudden digital transformation of teaching and learning due to COVID-19. On the one hand, this study contributes to broadening the literature on educational operation during crises. On the other hand, it highlights essential aspects, which educational leaders can consider enhancing the stable efficiency of teaching and learning activities during such a chaotic situation of COVID-19. In short, the research team figured out the significant influences of teacher’s perceived support, stress, and readiness over teacher satisfaction. To promote online teaching effectiveness, school leaders should pay attention to teachers’ stress and anxiety, as well as enhancing online teaching competencies.

First, the final dataset of 294 observations has built up a shred of convincing evidence to confirm the influence of stress over teachers’ satisfaction and online teaching effectiveness. In particular, sudden changes in daily routine and teaching habits due to school closure, as well as the anxiety regarding the current and potential decrease in regular income, had significant negative impacts on both the teachers’ satisfaction and the online teaching effectiveness. This result is associated with what was explored long ago that variation in psychology may lead to the alteration of teaching effectiveness (Barr, 1952) and that teachers are dissatisfied with such extrinsic factors as contextual or societal effects as declared in previous scholars (Day, 2013; Dörnyei & Ushioda, 2013).

Second, the perceived support from students’ parents, from the unions or relevant authorities and the readiness of the schools, which influenced the most on the teachers’ satisfaction, made no impact on the online teaching effectiveness. By this finding, the physical and mental extrinsic support seems to induce adverse effects on teachers during the COVID-19 pandemic compared to their regular teaching lifetime. Whereas under the usual educational conditions, the significant dissatisfiers with teachers are noted to be parents, policymakers, business leaders, or politicians (Hargreaves & Fullan, 1998); they play vital roles in raising the teachers’ satisfaction in adversity.

Third, among tested factors, the newly absorbed knowledge or skills was the only mediator which can help to enhance the online teaching effectiveness. However, incorporating new pedagogical and technological skills did not improve teachers’ satisfaction during the pandemic. This finding is a notable contribution to current works of literature on teacher continuous professional development, in which learning new knowledge and skills is a critical component of teacher self-autonomy toward life-long learning and long-term career satisfaction (Little, 1995; Pearson & Moomaw, 2005).

Inclosing this article, we would like to mention considerable limitations of the work, which can be fulfilled by future studies. First, with the focus on online teaching effectiveness, this research did not include the sample of teachers in mountainous and island areas, whose ICT infrastructure and Internet access are limited. Second, the findings of this research mostly relied on teachers’ self-report within a small group of teachers. Thus, future open database should be constructed to increase the diversity of this research topic (Vuong, 2020). As a result, a part of the data might be exaggerated as a consequence of teachers’ stress due to COVID-19, while the other part might be flattened. Last but not least, the situation of COVID-19 was well handled by the Vietnamese government, so the stress of Vietnamese teachers might not be as acute as their colleagues in other countries, especially the territories with high levels of COVID-19 spreading. Thus, a comparative study will be beneficial to portrait the picture of teacher satisfaction during a pandemic.

Supplemental Material

sj-pdf-1-jex-10.1177_00220574211039483 – Supplemental Material for Factor Associated With Teacher Satisfaction and Online Teaching Effectiveness Under Adversity Situations: A Case of Vietnamese Teachers During COVID-19

Supplemental Material, sj-pdf-1-jex-10.1177_00220574211039483 for Factor Associated With Teacher Satisfaction and Online Teaching Effectiveness Under Adversity Situations: A Case of Vietnamese Teachers During COVID-19 by Phuong-Tam Pham, Thanh-Thao Thi Phan, Yen-Chi Nguyen and Anh-Duc Hoang in Journal of Education

Footnotes

Author Contributions

Phuong-Tam Phan: Conceptualization, Methodology, Investigation, Writing - Review and Editing Yen-Chi Nguyen: Investigation, Data Curation, Writing - Original Draft Thanh-Thao Thi Phan: Investigation, Writing - Original Draft Anh-Duc Hoang: Conceptualization, Writing - Review and Editing.

Declaration of Conflicting Interests

The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Funding

The author(s) received no financial support for the research, authorship, and/or publication of this article.

ORCID iDs

Thanh-Thao Thi Phan

Yen-Chi Nguyen

Anh-Duc Hoang

Supplemental Material

Supplemental material for this article is available online.

References

Anderson

J. C.,

Gerbing

D. W.

(1988). Structural equation modeling in practice: A review and recommended two-step approach. Psychological Bulletin, 103(3), 411–423. https://doi.org/10.1037/0033-2909.103.3.411

Antoniou

A. S.

Polychroni

Vlachakis

A. N.

(2006). Gender and age differences in occupational stress and professional burnout between primary and high‐school teachers in Greece. Journal of Managerial Psychology, 21(7), 682–690. https://doi.org/10.1108/02683940610690213

Barr

A. S.

(1952). The measurement of teacher characteristics and prediction of teaching efficiency. Review of Educational Research, 22(3), 169–174. https://doi.org/10.3102/00346543022003169

Bin Nafisah

Alamery

A. H.

Al Nafesa

Aleid

Brazanji

N. A.

(2018). School closure during novel influenza: A systematic review. Journal of Infection and Public Health, 11(5), 657–661. https://doi.org/10.1016/j.jiph.2018.01.003

Boyle

G. J.

Borg

M. G.

Falzon

J. M.

Baglioni

A. J.

(1995). A structural model of the dimensions of teacher stress. British Journal of Educational Psychology, 65(1), 49–67. https://doi.org/10.1111/j.2044-8279.1995.tb01130.x

Brahma

Chakraborty

Menokee

(2020). The early days of a global pandemic: A timeline of COVID-19 spread and government interventions. Brookings. https://www.brookings.edu/2020/04/02/the-early-days-of-a-global-pandemic-a-timeline-of-covid-19-spread-and-government-interventions/

Byrne

B. M.

(2013). Structural equation modeling with EQS: Basic concepts, applications, and programming (2nd ed.). New York, NY: Taylor & Francis Group. https://doi.org/10.4324/9780203726532

Calabrese

R. L.

(1987). The principal: An agent for reducing teacher stress. NASSP Bulletin, 71(503), 66–70. https://doi.org/10.1177/019263658707150315

Callaway

(2020). Time to use the p-word? Coronavirus enters dangerous new phase. Nature, 579(277), 12. https://doi.org/10.1038/d41586-020-00551-1

10.

Cambridge University . (2020). COVID-19 resources and information. Cambridge.Org. https://www.cambridge.org/gb/academic/covid-19-resources-and-information

11.

Canrinus

E. T.

Helms-Lorenz

Beijaard

Buitink

Hofman

(2012). Self-efficacy, job satisfaction, motivation and commitment: Exploring the relationships between indicators of teachers’ professional identity. European Journal of Psychology of Education, 27(1), 115–132. https://doi.org/10.1007/s10212-011-0069-2

12.

Caprara

G. V.

Barbaranelli

Borgogni

Steca

(2003). Efficacy beliefs as determinants of teachers’ job satisfaction. Journal of Educational Psychology, 95(4), 821–832. https://doi.org/10.1037/0022-0663.95.4.821

13.

Chaplain

R. P.

(1995). Stress and job satisfaction: A study of english primary school teachers. Educational Psychology, 15(4), 473–489. https://doi.org/10.1080/0144341950150409

14.

Chaplain

R. P.

(2008). Stress and psychological distress among trainee secondary teachers in England. Educational Psychology, 28(2), 195–209. https://doi.org/10.1080/01443410701491858

15.

Chi

Yeh

Choum

S.-M.

High

Y. J.

(2013). The organizational commitment, personality traits and teaching efficacy of junior high school teachers: The meditating effect of job involvement. The Journal of Human Resource and Adult Learning, 9(2), 131–142.

16.

Colquitt

LePine

Wesson

(2011). Organizational behavior: Improving performance and commitment in the workplace. New York, NY: McGraw-HilI/Irwin. https://www.mheducation.com/highered/product/organizational-behavior-improving-performance-commitment-workplace-colquitt-lepine/M9781259545092.html

17.

Cooper

C.,

Travers

(2012). Teachers under pressure. London: Routledge. https://doi.org/10.4324/9780203059975

18.

Darling-Hammond

Youngs

(2002). Defining “highly qualified teachers”: What does “scientifically-based research” actually tell us? Educational Researcher, 31(9), 13–25. https://doi.org/10.3102/0013189X031009013

19.

Day

(2013). The new lives of teachers. Back to the future: Legacies, continuities and changes in educational policy, practice and research (pp. 57–74). Rotterdam, SH: Sense Publishers. https://doi.org/10.1007/978-94-6209-240-2_4

20.

Day

Sammons

Stobart

(2007). Teachers matter: Connecting work, lives and effectiveness. New York, NY: McGraw-Hill Education. https://books.google.com.vn/books/about/Teachers_Matter_Connecting_Work_Lives_An.html?id=Juyp8W3MDbkC&redir_esc=y

21.

Dinham

S.,

Scott

(1996, August). Teacher satisfaction, motivation and health: Phase one of the teacher 2000 project. the annual meeting of the American educational research association. https://eric.ed.gov/?id=ED405295

22.

Dinham

Scott

(1998). A three domain model of teacher and school executive career satisfaction. Journal of Educational Administration, 36(4), 362–378. https://doi.org/10.1108/09578239810211545

23.

Dörnyei

Z.,

Ushioda

(2013). Teaching and researching motivation (2nd ed.). London: Routledge. https://doi.org/10.4324/9781315833750

24.

Elseviers . (2020). Novel coronavirus information center. Elsevier.

25.

Fornell

C.,

Larcker

D. F.

(1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18(1), 39–50. https://doi.org/10.1177/002224378101800104

26.

Gold

Y.,

Roth

R. A.

(2013). Teachers managing stress & preventing burnout. London: Routledge. https://www.amazon.com/Teachers-Managing-Stress-Preventing-Burnout-ebook/dp/B000UYCOPA

27.

Hair

J. F.

Black

W. C.

Babin

B. J.

Anderson

R. E.

(1998). Multivariate data analysis (Vol. 5). Pearson. https://www.amazon.com/Multivariate-Data-Analysis-Joseph-Hair/dp/0138132631

28.

Hancock

G.,

Mueller

(2001). Rethinking construct reliability within latent variable systems. Structural equation modeling: Present and future (pp. 195–216). Lincolnwood, IL: Scientific Software International Inc. https://books.google.com.vn/books?id=AMLN-oKmC_IC&printsec=copyright&redir_esc=y#v=onepage&q&f=false

29.

Hargreaves

A.,

Fullan

(1998). What’s worth fighting for out there? Ontario Public School Teachers’ Federation. https://eric.ed.gov/?id=ED448537.

30.

Hernández-Ramos

J. P.

Martínez-Abad

García Peñalvo

F. J.

Esperanza Herrera García

Rodríguez-Conde

M. J.

(2014). Teachers’ attitude regarding the use of ICT. A factor reliability and validity study. Computers in Human Behavior, 31(1), 509–516. https://doi.org/10.1016/j.chb.2013.04.039

31.

Hoang

A.-D.

(2020). Pandemic and teacher retention: empirical evidence from expat teachers in Southeast Asia during COVID-19. International journal of sociology and social policy. https://doi.org/10.1108/IJSSP-07-2020-0269

32.

Hoang

A.-D.

Pham

H.-H.

Q.-A.

Dinh

V.-H.

T.-T.

Nguyen

Y.-C.

(2020c). Survey on Vietnamese teachers’ perspectives during COVID-19. Harvard Dataverse. https://doi.org/10.7910/DVN/FOCPKH

33.

Hoang

A.-D.

Pham

H.-H.

Nguyen

Y.-C.

Nguyen

L.-K.-N.

Vuong

Q.-H.

Dam

M. Q.

Tran

Nguyen

T.-T.

(2020b). Introducing a tool to gauge curriculum quality under Sustainable Development Goal 4: The case of primary schools in Vietnam. International Review of Education, 66, 457–485. https://doi.org/10.1007/s11159-020-09850-1

34.

Hoang

A.-D.

N.-T.

Nguyen

Y.-C.

Hoang

C.-K.

Nguyen

T.-T.

Pham

H.-H.

Nguyen

L.-C.

Doan

P.-T.

Dao

Q.-A.

Dinh

V.-H.

(2020a). Dataset of ex-pat teachers in Southeast Asia’s intention to leave due to the COVID-19 pandemic. Data in Brief, 31, 105913. https://doi.org/10.1016/j.dib.2020.105913

35.

Hodges

Moore

Lockee

Trust

Bond

(2020). The difference between emergency remote Teaching and online learning | EDUCAUSE. EDUCAUSE review. https://er.educause.edu/articles/2020/3/the-difference-between-emergency-remote-teaching-and-online-learning

36.

Hofstede

(1980). Motivation, leadership, and organization: Do American theories apply abroad? Organizational Dynamics, 9(1), 42–63. https://doi.org/10.1016/0090-2616(80)90013-3

37.

Holdaway

E. A.

(1978). Facet and overall satisfaction of teachers. Educational Administration Quarterly, 14(1), 30–47. https://doi.org/10.1177/0013161X7801400106

38.

Holt-Lunstad

Smith

T. B.

Layton

J. B.

(2010). Social relationships and mortality risk: A meta-analytic review. PLoS Medicine, 7(7), e1000316. https://doi.org/10.1371/journal.pmed.1000316.

39.

Hooper

Coughlan

Mullen

M. R.

(2008). Evaluating model fit: A synthesis of the structural equation modelling literature. 7th European Conference on Research Methodology for Business and Management Studies, 195–200. https://doi.org/10.21427/D79B73

40.

Hsu

H.,

Tsai

(2013). A study of social support, self-efficacy and school effectiveness of teachers in New Taipei City. Chung Yuan Physical Education Journal, 3, 68–75. https://doi.org/10.6646/CYPEJ.2013.3.68

41.

Johnson

Cooper

Cartwright

Donald

Taylor

Millet

(2005). The experience of work‐related stress across occupations. Journal of Managerial Psychology, 20(2), 178–187. https://doi.org/10.1108/02683940510579803

42.

Jorde-Bloom

(1986). Teacher job satisfaction: A framework for analysis. Early Childhood Research Quarterly, 1(2), 167–183. https://doi.org/10.1016/0885-2006(86)90027-X

43.

Kirkman

B. L.,

Shapiro

D. L.

(2001). The impact of cultural values on job satisfaction and organizational commitment in self-managing work teams: The mediating role of employee resistance. Academy of Management Journal, 44(3), 557–569. https://doi.org/10.2307/3069370

44.

Klassen

R. M.

Usher

E. L.

Bong

(2010). Teachers’ collective efficacy, job satisfaction, and job stress in cross-cultural context. The Journal of Experimental Education, 78(4), 464–486. https://doi.org/10.1080/00220970903292975

45.

Kyriacou

(1987). Teacher stress and burnout: An international review. Educational Research, 29(2), 146–152. https://doi.org/10.1080/0013188870290207

46.

V.-P.

Pham

T.-H.

M.-T.

Nguyen

M.-H.

Nguyen

K.-L.

Nguyen

H.-K. T.

Tran

Khuc

M.-T.

Vuong

Q.-H.

Vuong

Q.-H.

(2020). Policy response, social media and science journalism for the sustainability of the public health system amid the COVID-19 outbreak: The Vietnam lessons. Sustainability, 12(7), 2931. https://doi.org/10.3390/su12072931

47.

Leithwood

K.,

Sun

(2012). The nature and effects of transformational school leadership. Educational Administration Quarterly, 48(3), 387–423. https://doi.org/10.1177/0013161X11436268

48.

Lieberman

A.,

Miller

(1984). Teachers, their world, and their work. Implications for school improvement. New York, NY: Teachers College Press. https://eric.ed.gov/?id=ED368711.

49.

Little

(1995). Learning as dialogue: The dependence of learner autonomy on teacher autonomy. System, 23(2), 175–181. https://doi.org/10.1016/0346-251X(95)00006-6

50.

Maddux

J. E.

(1995). Self-efficacy theory. In Self-efficacy, adaptation, and adjustment (pp. 3–33). Springer. https://doi.org/10.1007/978-1-4419-6868-5_1

51.

Mantel

(1963). Chi-square tests with one degree of freedom; extensions of the mantel-haenszel procedure. Journal of the American Statistical Association, 58(303), 690–700. https://doi.org/10.1080/01621459.1963.10500879

52.

Marsh

H. W.,

Bailey

(1991). Confirmatory factor analyses of multitrait-multimethod data: A comparison of alternative models. Applied Psychological Measurement, 15(1), 47–70. https://doi.org/10.1177/014662169101500106

53.

MHA . (2020). Mental health and COVID-19 information and resources. Mental Health America. https://mhanational.org/covid19

54.

Muhammad Arifin

(2015). The influence of competence, motivation, and organisational culture to high school teacher job satisfaction and performance. International Education Studies, 8(1), 38–45. https://doi.org/10.5539/ies.v8n1p38

55.

Mulford

(2003). School leaders: Challenging roles and impact on teacher and school effectiveness (OECD commissioned paper). https://www.oecd.org/education/school/37133393.pdf

56.

Nguni

Sleegers

Denessen

(2006). Transformational and transactional leadership effects on teachers’ job satisfaction, organizational commitment, and organizational citizenship behavior in primary schools: The Tanzanian case. School Effectiveness and School Improvement, 17(2), 145–177. https://doi.org/10.1080/09243450600565746

57.

Nguyen

. (2020). 150 cơ sở giáo dục tư thục “cầu cứu” vì đóng cửa do dịch Covid -19. [150 private educational institutions ask for help because of the closure due to Covid -19].Youth Newspaper. https://thanhnien.vn/giao-duc/150-co-so-giao-duc-tu-thuc-cau-cuu-vi-dong-cua-do-dich-covid-19-1191469.html

58.

Nguyen

Bich

(2020). Nghỉ học để phòng dịch Covid-19: Học trực tuyến có đóng phí?[School closure due to COVID-19: Do parents have to pay tuition for online learning?]. Youth Newspaper. https://thanhnien.vn/giao-duc/nghi-hoc-de-phong-dich-covid-19-hoc-truc-tuyen-co-dong-phi-1197352.html

59.

Nias

(1981). Teacher satisfaction and dissatisfaction: Herzberg’s ‘two‐factor’ hypothesis revisited. British Journal of Sociology of Education, 2(3), 235–246. https://doi.org/10.1080/0142569810020302

60.

OECD . (2005). Education and training policy: Teachers matter: Attracting, developing and retaining effective teachers. OECD. https://www.oecd.org/education/school/34990905.pdf.

61.

Pearson

C. L.,

Moomaw

(2005). The relationship between teacher autonomy and stress, work satisfaction, empowerment, and professionalism. Educational Research Quarterly, 29(1), 38–54. https://www.questia.com/library/journal/1P3-905483171/the-relationship-between-teacher-autonomy-and-stress

62.

Rashid

Ridda

King

Begun

Tekin

Wood

J. G.

Booy

(2015). Evidence compendium and advice on social distancing and other related measures for response to an influenza pandemic. Paediatric Respiratory Reviews, 16(2), 119-126. https://doi.org/10.1016/j.prrv.2014.01.003

63.

Riviou

K.,

Sotiriou

(2017). Teachers’ professional development in the theme of competence-based learning-impact and lessons learnt. In Anastasiades

Zaranis

(Eds.), Research on e-Learning and ICT in Education (pp. 283–297). Cham, ZG: Springer International Publishing. https://doi.org/10.1007/978-3-319-34127-9_21

64.

Sahito

Z.,

Vaisanen

(2017). Effect of ICT skills on the job satisfaction of teacher educators: Evidence from the Universities of the Sindh Province of Pakistan. International Journal of Higher Education, 6(4), 122. https://doi.org/10.5430/ijhe.v6n4p122

65.

Sarros

J. C.,

Sarros

A. M.

(1992). Social support and teacher burnout. Journal of Educational Administration, 30(1). https://doi.org/10.1108/09578239210008826

66.

Seidel

T.,

Shavelson

R. J.

(2007). Teaching effectiveness research in the past decade: The role of theory and research design in disentangling meta-analysis results. Review of Educational Research, 77(4), 454–499. https://doi.org/10.3102/0034654307310317

67.

Sergiovanni

(1967). Factors which affect satisfaction and dissatisfaction of teachers. Journal of Educational Administration, 5(1), 66–82. https://doi.org/10.1108/eb009610

68.

Skaalvik

E. M.,

Skaalvik

(2011). Teacher job satisfaction and motivation to leave the teaching profession: Relations with school context, feeling of belonging, and emotional exhaustion. Teaching and Teacher Education, 27(6), 1029–1038. https://doi.org/10.1016/j.tate.2011.04.001

69.

Staiger

D. O.,

Rockoff

J. E.

(2010). Searching for effective teachers with imperfect information. Journal of Economic Perspectives, 24(3), 97–118. https://doi.org/10.1257/jep.24.3.97

70.

Thanh

(2020). Gần 42.000 giáo viên bị ảnh hưởng thu nhập vì Covid-19 [Nearly 42,000 teachers are affected financially due to Covid-19]. Youth Newspaper. https://thanhnien.vn/giao-duc/gan-42000-giao-vien-bi-anh-huong-thu-nhap-vi-covid-19-1215966.html

71.

Thibodeaux

A. K.

(2014). The effects of leadership and high-stakes testing on teacher retention [University of Southern Mississippi]. https://eric.ed.gov/?id=ED557520

72.

Toker

(2011). Job satisfaction of academic staff: An empirical study on Turkey. Quality Assurance in Education, 19(2), 156–169. https://doi.org/10.1108/09684881111125050

73.

Tran

Hoang

A. D.

Nguyen

T. T.

Dinh

V. H.

Nguyen

Y. C.

Pham

H. H.

(2020). Dataset of Vietnamese student’s learning habits during COVID-19. Data in Brief, 30(10), 105682. https://doi.org/10.1016/j.dib.2020.105682.

74.

Tran

Hoang

A.-D.

Nguyen

Y.-C.

Nguyen

L.-C.

N.-T.

Pham

Q.-H.

Pham

C.-X.

Q.-A.

Dinh

V.-H.

Nguyen

T.-T.

(2020). Toward sustainable learning during school suspension: Socioeconomic, occupational aspirations, and learning behavior of vietnamese students during COVID-19. Sustainability, 12(10), 4195. https://doi.org/10.3390/su12104195

75.

UNESCO . (2020). COVID-19 educational disruption and response. UNESCO. https://en.unesco.org/covid19/educationresponse

76.

University of Oxford . (2020). The Oxford COVID-19 government response tracker. University of Oxford. https://www.bsg.ox.ac.uk/research/research-projects/coronavirus-government-response-tracker

77.

Usun

(2009). Information and communications technologies (ICT) in teacher education (ITE) programs in the world and Turkey. Procedia - Social and Behavioral Sciences, 1(1), 331–334. https://doi.org/10.1016/j.sbspro.2009.01.062

78.

Valcke

Rots

Verbeke

van Braak

(2007). ICT teacher training: Evaluation of the curriculum and training approach in Flanders. Teaching and Teacher Education, 23(6), 795–808. https://doi.org/10.1016/j.tate.2007.02.004

79.

Viner

R. M.

Russell

S. J.

Croker

Packer

Ward

Stansfield

Mytton

Bonell

Booy

(2020). School closure and management practices during coronavirus outbreaks including COVID-19: A rapid systematic review. The Lancet Child & Adolescent Health, 4(5), 397–404. https://doi.org/10.1016/S2352-4642(20)30095-X

80.

Vitanova

Atanasova-Pachemska

Iliev

Pachemska

(2015). Factors affecting the development of ICT competencies of teachers in primary schools. Procedia - Social and Behavioral Sciences, 191, 1087–1094. https://doi.org/10.1016/j.sbspro.2015.04.344

81.

VPAL . (2020). Teaching remotely. Harvard’s office of the vice provost for advances in learning. https://teachremotely.harvard.edu/best-practices

82.

C.-T.

Hoang

A.-D.

Than

V.-Q.

Nguyen

M.-T.

Dinh

V.-H.

Q.-A. T.

T.-T. T.

Pham

H.-H.

Nguyen

Y.-C.

(2020). Dataset of Vietnamese teachers’ perspectives and perceived support during the COVID-19 pandemic. Data in Brief, 31, 105788. https://doi.org/10.1016/j.dib.2020.105788

83.

Vuong

Q.-H.

. (2018). The (ir)rational consideration of the cost of science in transition economies. Nature Human Behaviour, 2(1), 5. https://doi.org/10.1038/s41562-017-0281-4

84.

Vuong

Q.-H.

. (2020). Reform retractions to make them more transparent. Nature, 582(7811), 149. https://doi.org/10.1038/d41586-020-01694-x

85.

Xie

J. L.

Schaubroeck

Lam

S. S. K.

(2008). Theories of job stress and the role of traditional values: A longitudinal study in China. Journal of Applied Psychology, 93(4), 831–848. https://doi.org/10.1037/0021-9010.93.4.831

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.29 MB