Abstract
Self-regulated learning (SRL) is essential for academic success. Research shows that culture influences the engagement in SRL processes. However, there are limited cross-cultural studies investigating SRL; therefore, we aimed to validate an SRL measurement for Chinese international and Canadian domestic undergraduate students and to examine if the relationships between SRL engagement and academic performance differ across the two groups. First, we investigated the measurement invariance of the Regulation of Learning Questionnaire for both groups. Our findings confirmed the metric invariance across these cultural groups and identified items contributing to the scalar non-invariance. Additionally, we found that goal management was significantly associated with Canadian students’ course grades only, at the middle and end of a 4-month academic semester. In contrast, monitoring was significantly associated with semester GPA for both groups at the middle of the semester. Our findings emphasize the significance of evaluating measurement invariance across cultures and contribute to the extant literature on the relationship between culture and SRL.
Introduction
Decades of research on self-regulated learning (SRL) have demonstrated its significance for students’ academic success (Hadwin & Winne, 2012; Theobald, 2021; Winne, 2015; Zimmerman, 2000, 2002). Self-regulated learners strategically and metacognitively plan, monitor, and adapt their learning processes to achieve their goals (Winne, 2015; Winne & Hadwin, 1998, 2008; Zimmerman, 2002), thereby promoting academic success. Consistent with their social cognitive roots, SRL models acknowledge the reciprocal role played by social context in SRL (Schunk & Zimmerman, 1997; Winne & Hadwin, 1998; Zimmerman, 1989). Furthermore, self-regulatory competence initially develops from social sources of academic skills and gradually transforms into individual sources through modeling (Schunk & Zimmerman, 1997). For example, the development of self-regulatory competency is shaped by social influences, including social models (e.g., teachers), verbal descriptions, and social guidance and feedback through observations and imitations (Schunk & Zimmerman, 1997). In other words, SRL is socio-historically situated in the experiences and interactions of learners as they grapple with academic work in a rich social milieu. Culture provides a platform for individuals to engage in cultural learning and acquire knowledge through social interactions (Greenfield et al., 2003). That is, the way individuals behave, think, and feel can be different across cultural contexts. Therefore, culture could play an essential role in shaping how individuals develop and gain self-regulatory competency. For example, research shows that Asian learners tend to emphasize more social-oriented SRL strategies, whereas Western learners tend to emphasize more individual-oriented SRL strategies (Shi et al., 2013).
Despite the potential influence of culture on learners’ development of self-regulatory competency (e.g., Greenfield et al., 2003), cross-cultural studies on SRL are rare in the extant literature. Indeed, predominant models of SRL used in cross-cultural studies have been based on Western theoretical frameworks (McInerney, 2011; McInerney & King, 2017). Therefore, considering the Western SRL models as universal across cultures in research may pose challenges in understanding cross-cultural similarities and differences in SRL. In fact, such challenges have been evidenced in the paradox of Chinese learners who have been historically portrayed as placing more emphasis on passive and rote learning (e.g., memorization and repetition; Pratt et al., 1999) but tended to perform well academically, particularly in the Western countries (Kember, 2000; Li, 2012; Marton et al., 1999). Therefore, it is critical to understand whether an SRL theoretical model that has been developed in the West can be applied to other cultures by examining the measurement equivalence of an SRL assessment used to examine various phases of SRL for distinct cultural groups. Specifically, the present study examined cultural differences in SRL, focusing on Chinese international and Canadian domestic students in a Canadian university by examining whether an SRL assessment can be equivalently used to examine the psychological construct of SRL for these two groups.
Literature Review
Self-regulation is essential for learners to develop lifelong learning skills to succeed in a wide range of settings, including education and employment (Sitzmann & Ely, 2011; Zimmerman, 2002). Specially, it is crucial for students to plan, monitor, evaluate, and adapt their learning processes to achieve their academic goals (Schunk & Zimmerman, 1997; Zimmerman & Schunk, 2001). Prior work has provided compelling evidence that these regulatory processes in learning help students build strong metacognitive knowledge (Pintrich, 2000), thereby allowing students to strategically decide how to manage their learning processes (Winne, 2015). Indeed, a recent meta-analysis reported that SRL training programs with a strong emphasis on metacognition improved university students’ academic performance, cognitive and metacognitive strategy use, and motivation (Theobald, 2021).
Several SRL models have been proposed with a consolidated theoretical background and empirical support (see Panadero, 2017 for a review). All models consider SRL as a cyclical process comprising various phases and subprocesses (e.g., planning, monitoring, and adapting; Panadero, 2017) and recognize learners as actively and constructively engaging in their learning process and being able to monitor, evaluate, and regulate many aspects of their own cognition, behavior, motivation, and emotion (Pintrich, 2000). Particularly, Winne and Hadwin’s (1998) model describes four loosely sequenced and recursively linked phases. In the first phase, learners generate a task understanding about features of academic tasks by evaluating personal and task characteristics (e.g., self-efficacy and domain knowledge). In the second phase, goal setting and planning, learners set goals for the task and construct plans to accomplish the established goals. Particularly, goals serve as standards for learners to monitor their regulation of learning (Winne, 2015). In the third phase, strategy enactment is where learners engage in tactics and strategies to achieve goals created in previous phases. In the fourth phase, adaptation, learners make purposeful changes to approach their future learning (Winne & Hadwin, 1998, 2008). As SRL is a recursive cycle, learners may revisit phases in any order (Winne, 2015).
Moreover, many SRL models acknowledge the reciprocal role that social context plays (Schunk & Zimmerman, 1997; Winne & Hadwin, 1998). For example, this social influence within SRL is apparent in Zimmerman’s (1989) cyclical phases model, in which learners evaluate their performance by comparing it with that of others. As Martin (2007) noted, it is critical to understand how people express themselves, engage in strategic planning, and pursue various goals through their relationships with others. Therefore, through social modeling, guidance, and interactions, the development of SRL can be fostered. As an essential component of learning and socialization, culture is defined as “an advanced form of social life based on shared understandings and the use of meaning for processing information collectively” (Baumeister, 2011, p. 6; Greenfield et al., 2003). Repeated and continuous engagement in specific cultural contexts or practices often leads to automatized patterns of psychological responses (Markus & Kitayama, 2010). Thus, culture significantly and unobtrusively influences every aspect of people’s lives. Like other scholars (Helmke & Tuyet, 1999; Li et al., 2018; McInerney & King, 2017; Purdie & Hattie, 1996; Shi et al., 2013), we acknowledge that the socially situated nature of SRL implies that culture can influence its development and foster different perspectives about SRL across distinct cultures. This notion then leads to the question of how learners with culturally different learning experiences engage in distinct aspects of SRL.
Extant studies often use mono-cultural research samples, despite the rapid growth of SRL research in educational psychology (McInerney & King, 2017). One meta-analysis study found that primary and secondary Chinese students in China tend to emphasize the importance of self-efficacy, strategy enactment, and self-evaluation during learning (Li et al., 2018). Unfortunately, only a limited number of cross-cultural SRL studies have been conducted (e.g., Lopez et al., 2013; Shi et al., 2013; Tong et al., 2019; Zhu et al., 2008). These few available studies found that students from Asian and Western contexts exhibit significant differences in their SRL. A cross-cultural study examined the learning conceptions and approaches to learning used by first-year Flemish and Chinese university students in Flanders and China (Zhu et al., 2008). Their results revealed that Chinese students’ conceptions of learning emphasized understanding, personal change, and the development of social competence more so than those of their Flemish counterparts.
In addition to studies on the effects of students’ previous sociocultural learning experiences on SRL, Shi et al. (2013) examined how Chinese international and Canadian domestic students engaged in SRL actions within a multicultural collaborative learning context at a Canadian university. They found that, compared with Chinese international students, Canadian domestic students demonstrated more individually oriented SRL actions (e.g., emphasizing individualistic actions and maintaining one’s own goals) relative to more socially oriented actions (e.g., emphasizing others’ interest and benefits and meeting the needs of others or the group). Lastly, a cross-cultural study investigating the relationships between perseverance, SRL, motivation, and achievement for 15-year-old students from Hong Kong, the Republic of Korea, Australia, New Zealand, Scotland, and the US found that SRL strategy use served as a mediator for perseverance predicting students’ achievement for all countries (Xu et al., 2021). Specifically, Xu et al. (2021) found that control strategy as an SRL strategy had stronger impacts on achievement for students from Anglo-Saxon countries than those from East Asian countries. Also, memorization had a negative effect on achievement, but this effect was weaker in East Asian countries than in Western countries (Xu et al., 2021). Overall, the studies presented thus far provide evidence that culture influences how students engage in SRL.
Although prior research has revealed cross-cultural differences in SRL, scholars have failed to recognize that culturally specific learning approaches are often not stressed in SRL models. According to McInerney and King (2017), most cross-cultural studies utilize SRL theoretical models and measurements that were developed and validated in the West. Further, utilizing the WEIRD (i.e., Western, Educated, Industrial, Rich, and Democratic) population, which represents only 12% of the world’s population, is still common in psychological research (Henrich et al., 2010). Thus, a Western SRL theoretical framework may not fully capture the unique ways in which non-WEIRD learners engage in SRL, and its corresponding measures may fail to reflect observable SRL behaviors in non-Western cultural contexts. Subsequently, the observed cross-cultural differences in the extant SRL literature could be explained by a lack of theoretical precision and operational explicitness of the related constructs. Findings from studies that adopt a Western theoretical framework and use an underrepresented population cannot be generalized to other non-WEIRD populations. Without testing the invariance of the measurement used across groups, studies that use the same measurement to examine group differences lack measurement comparability, making their conclusions or findings ambiguous and problematic (Boer et al., 2018). Indeed, Tong and Colleagues (2019) investigated the psychometric properties of the Motivated Strategies for Learning Questionnaire (MSLQ; Pintrich et al., 1993) in a Chinese cultural context. MSLQ is one of the most widely used SRL questionnaires for assessing the process of self-regulation, developed by Pintrich et al. (1993). Of the original 81-item MSLQ, only 52 items were retained for Chinese undergraduate students, with modifications to some SRL constructs, including reasons for engagement in academic tasks and beliefs about accomplishing them (Tong et al., 2019). This study provided evidence that cross-cultural adaptation of a well-established SRL instrument was necessary to apply SRL models developed in Western cultural contexts to Eastern cultural contexts. Therefore, it is critical to evaluate whether an SRL measurement developed and validated in the West could be equivalently applied to measure SRL among non-Western populations.
The present study adopted the Regulation of Learning Questionnaire (RLQ; Hadwin, 2009; McCardle & Hadwin, 2015), which was based on Winne and Hadwin’s (1998) SRL model and designed to capture dynamic SRL processes as they unfold over time in various contexts. Specifically, the RLQ prompts learners to respond to items about each phase of SRL in relation to a recent and specific study event. Learners report contextual details about the course, its tasks, and the challenges that they encountered. To advance current understandings of cross-cultural differences using an existing SRL measurement, it is important to first establish the compatibility of the adopted measure by examining the measurement invariance of the RLQ. Evaluating the cultural invariance of an SRL measure is crucial for developing data-driven understandings of Chinese international students’ SRL engagement, shaped by their previous learning experiences in China. This approach, in turn, can inform culturally responsive approaches to support their academic success while studying in Canada.
Given that SRL is a dynamic process unfolding over time across contexts, learners may exhibit different patterns of engagement as they navigate various learning tasks. The present study examines the cultural invariance of the RLQ at three separate time points, which are the beginning, middle, and end of a 4-month academic semester. Considering that different phases of the semester demand various levels of cognitive, behavioral, and emotional engagement with learning, university students may demonstrate distinct patterns of SRL engagement, such as developing adequate task understanding of academic assignments, choosing effective learning strategies, and evaluating their adaptive or maladaptive learning patterns. Adopting longitudinal data to examine the measurement invariance at different time points of the semester can provide evidence about the validity of the RLQ at different time points as Chinese international and Canadian domestic students engage in SRL processes. As a result, this study aimed to (a) evaluate the measurement invariance of SRL constructs from the RLQ (McCardle & Hadwin, 2015) between Chinese and Canadian students across three time points over one university semester and (b) examine the relationship between participating students’ self-reported engagement in SRL processes and their academic performance.
Methods
Participants
The study participants included undergraduate students enrolled in a face-to-face undergraduate educational psychology course on learning strategies and SRL at a Canadian public university (N = 586) during both the 2013–2014 and 2014–2015 academic years (Fall 2013 n = 166, Spring 2014 n = 108, Fall 2014 n = 162, and Spring 2015 n = 150). Their ages ranged from 17 to 44 years (M = 19.12, SD = 2.13). Of the 562 participants reporting their year of education, 68.5% were in their first year of and 22.8% were in their second year of university, and 56.9% were female. A subset of Chinese international students (n = 151; 95 female, 52 male, and 3 unidentified) included participants who held Chinese citizenship and study permits and self-reported that English was not their first language. Of the 143 Chinese international students reporting their year of education, 71.3% were in their first year and 20.3% were in their second year of the university. Canadian domestic students (n = 435; 239 female, 193 males, and 4 unidentified) included those who held Canadian citizenship, self-reported that English was their first language, and had attended a Canadian high school. Of the 419 Canadian domestic students reporting their year of education, 67.5% were in their first year and 23.6% were in their second year of university.
Procedure
The university’s Human Research Ethics Board approved this study’s procedures. Participants who were enrolled in this course were automatically included in this research and provided with a consent information letter at the beginning of the semester. They were given multiple opportunities to withdraw from participating over the semester. Prior to the final analysis, data were removed for students who declined to participate prior to the final analysis. Participants completed the RLQ online as a class activity in week 2 (time 1), week 6 (time 2), and week 11 (time 3) of the semester. Of the participants, 91% completed the RLQ at three time points, 7% completed it twice, and about 2% completed it once. Completion of the RLQ was required for a participation mark; however, responses were not graded. Feedback was provided to students in the form of a profile of a-priori subscale scores each time they completed the survey.
Measures
Self-Regulated Learning
The RLQ (Hadwin et al., 2022; McCardle & Hadwin, 2015) assessed participants’ self-reported actions and strategies specific to key SRL processes. The RLQ comprised three sections. In the first section, students were instructed to think about a recent challenge that they had faced during their academic learning. They were asked to (a) provide the name of the course for which they had been studying, (b) describe the task, and (c) explain the challenge they encountered in an open-ended text field. In the second section, students rated their intentions to engage in specific SRL processes during their study session and respond to five items (i.e., thoroughly understand the task, set good quality goals, monitor my progress, evaluate my progress, and adapt my learning) on a 4-point Likert scale (1 = not at all, 2 = not really, 3 = sort of, and 4 = yes).
In the third section, students were instructed to “Think about the study session when you encountered a challenge you had faced, specifically in your academic learning. Rate the extent to which you actually did each of the following from 1 (not at all) to 4 (yes). Before I got started, I….”. Four subscales of the RLQ reflecting the essential phases of SRL processes were adopted, including Task Analysis (3 items), Goal Setting & Management (7 items), Monitoring (3 items), and Adaptation (6 items). Students responded to the items on a 4-point Likert scale (1 = not at all, 2 = not really, 3 = sort of, and 4 = yes). Higher scores indicate a higher self-reported engagement in the respective phase of SRL processes.
Academic Performance
Students’ final course grades and semester registry GPA were obtained as measures of their academic performance. Specifically, GPA is reported on a 9-point scale, where 0 = F (0–48%), 1 = D (50–59%), 2 = C (60–64%), 3 = C+(65–69%), 4 = B-(70–72%), 5 = B (73–76%), 6 = B+(77–79%), 7 = A-(80–84%), 8 = A (85–89%), and 9 = A+(90–100%). Because this undergraduate educational psychology course teaches students about SRL, final course grades were considered to reflect a student’s own self-regulatory knowledge and skills, whereas the GPA reflected their university performance.
Statistical Analyses
This study conducted a Multiple-Group Confirmatory Factor Analysis (MG-CFA) using AMOS version 30. Prior to the main analysis, we examined measurement invariance across three time points separately for the Canadian and Chinese samples. Then, we examined a four-factor measurement model for the RLQ represented by task analysis, goal setting and management, monitoring, and adaptation. MG-CFAs were conducted to assess the measurement invariance between the two groups across time. Three hierarchical steps (i.e., configural, metric, and scalar invariance) were adopted in testing measurement invariance (Byrne, 2016; Vandenberg & Lance, 2000). Due to the commonly recognized restrictiveness of the chi-square statistic, as well as its sensitivity to sample size, four additional model fit indices were consulted (Bentler, 1990; Hu & Bentler, 1999; Ponterotto et al., 2003; Steiger, 1990), including: (a) comparative fit index (CFI) values ≥.90, (b) the standardized root mean square residual (SRMR) ≤ .08, (c) 90% confidence interval (CI) accompanying the root mean square error of approximation (RMSEA) ≤ .06, and (d) the Tucker–Lewis index (TLI) ≥ .90. The full information maximum likelihood estimation procedure was used to manage missing data.
The first step involved establishing configural invariance. Determination of invariance (equivalence of model form) at this step was based on the indices of goodness-of-fit to the data. Next, the metric invariance model, with factor loadings constrained to be equal across the two groups, was evaluated against the configural model. Following this, scalar invariance was examined by imposing equality constraints on item intercepts across groups. If the full scalar invariance could not be established, the partial scalar invariance would be examined by freely estimating the intercept of the variant items (Byrne et al., 1989). There is a limited discussion of the specific criterion regarding the minimal number of invariant items required to establish partial scalar invariance, and standards of establishing partial measurement invariance vary in the current literature (Byrne et al., 1989; Cheung & Lau, 2012; Putnick & Bornstein, 2016; Vandenberg & Lance, 2000). According to other researchers (see Byrne et al., 1989), a minimum of two items, including the reference indicator, must be invariant before researchers can make meaningful comparisons across groups. Considering that limited studies explored the extent to which the SRL constructs, and their measurement were theoretically and operationally equivalent across cultural groups, this study was rather exploratory in nature. Therefore, investigating RLQ items that failed the measurement invariance was more important than adopting a strict guideline to establish the partial scalar invariance. Such an explorative approach allowed us to investigate cultural differences of the RLQ explicitly at the item level and locate sources of non-invariant items (Byrne et al., 1989; Putnick & Bornstein, 2016). Using changes in CFI and RMSEA values is more appropriate to obtain evidence of non-invariance than chi-square (χ2) difference in value (Leong et al., 2018). Therefore, we examined the difference in CFI (ΔCFI ≤.010) and RMSEA values (ΔRMSEA ≤.015) to determine whether the decrease in fit between the latter and previous models was substantial (Cheung & Rensvold, 2002).
Results
Measurement Invariance
Descriptives Statistics of the Subscales of the RLQ, Course Grade, and Semester GPA
Note. GPA = grade point average
Then, we conducted MG-CFAs to examine measurement invariance for Chinese international and Canadian domestic student groups. The configural invariance models demonstrated acceptable fit to the data at all three time points (χ2 = 486.101, df = 292, p < .001, CFI = .91, TLI = .90, RMSEA = .034 [.029, .039], SRMR = .05 at time 1; χ2 = 466.023, df = 292, p < .001, CFI = .93, TLI = .91, RMSEA = .033 [.027, .038], SRMR = .04 at time 2; χ2 = 498.701, df = 292, p < .001, CFI = .92, TLI = .90, RMSEA = .035 [.030, .041], SRMR = .05 at time 3). This finding indicates that the factor structure of the RLQ (i.e., task analysis, goal setting and management, monitoring, and adaptation) was supported in both groups.
Next, the metric invariance model with factor loadings constrained to be equal across the two groups was evaluated. Changes in CFI and RMSEA were minimal (ΔCFI = .006, .003, and .004; ΔRMSEA = .000, 000, and .000 at time 1, time 2, and time 3, respectively). These results suggest that the factor loadings of the four-factor RLQ model were invariant between Chinese international students and Canadian students, supporting metric invariance.
Tests for Invariance of the Four-Factor Measurement Model of the RLQ: Goodness-of-Fit Statistics
Note. CFI = comparative fit index, TLI = Tucker-Lewis index, SRMR = standardized root mean square residual, RMSEA = root mean square error of analysis, 90% CI = 90% confidence interval.
***p < .001.
Non-Invariant Item Intercepts Identified for the Four-Factor Measurement Model of the RLQ at Time 2 and Time 3
Note. X refers to non-invariant items across Chinese international and Canadian domestic students.
Relationships Between SRL and Academic Performance
Correlations between SRL Processes and Academic Performance for Canadian Domestic and Chinese International Students
Note. *p < .05, **p < .01. The significance was indicated in bold.
Discussion
This study evaluated the measurement invariance of the RLQ, assessing the four phases of SRL, between Chinese international students and Canadian domestic students across three time points. Our findings support the configural invariance across Chinese and Canadian students at each time point, indicating that the same factor structure was present in the two groups. Further, the established metric invariance across the Chinese and Canadian students at the three time points may indicate that the psychological meanings of task analysis, goal management, monitoring, and adaptation are all attributed equivalently. However, the present study did not establish the scalar invariance between the Chinese and Canadian samples at the middle and end of the semester (time 2 and time 3). This finding supports Tong et al. (2019), who emphasized the need to translate, adapt, and validate an SRL questionnaire developed in Western contexts to ensure they accurately assess SRL for learners with different cultural learning backgrounds. The present study is exploratory in nature, as few studies have examined the extent to which the SRL construct is operationally equivalent across cultural groups.
Although our findings indicate that scalar invariance was not supported at time 2 and time 3, almost half of the RLQ items were identified as invariant across the three time points. This suggests that the intercepts of SRL constructs, such as goal setting and management, monitoring, and adaptation remain consistent across these two groups at each time point. Although scalar invariance was not fully supported, the identification of invariant RLQ items suggests that Chinese international students and Canadian domestic students may engage in certain aspects of SRL processes in similar ways, such as setting and managing academic goals, monitoring learning progress, and adapting to learning situations. That is, both Chinese international and Canadian university students emphasize SRL as an effortful, goal-oriented, adaptive, and metacognitive process. Because Chinese international and Canadian domestic students studied in the same learning environment, a Western university, and received instruction on SRL in the same undergraduate educational psychological course, their engagement in SRL could be similar. This interpretation warrants further research to investigate whether distinct sociocultural learning environments shape students’ engagement in SRL.
A closer examination of the scalar non-invariant item related to goal setting and management reveals that it tends to focus on goal evaluation (i.e., “evaluated my progress toward my goal”). There are two possible explanations for this lack of invariance across two groups. First, Chinese learners may not set their learning goals explicitly or define them in a measurable format because they emphasize virtues (e.g., sincerity, diligence, and endurance of hardship) in learning as a goal (Li, 2012). For instance, in prior research examining the predictive power of self-efficacy, task values, and growth mindset on Chinese primary school students’ SRL in English writings, task values (interest and utility) were shown to be a weaker predictor of SRL use (Bai et al., 2021). Therefore, displaying virtues, rather than focusing on the utility of learning tasks, may be a highly motivating goal in learning for Chinese students, which influenced how Chinese students evaluated their goals. Second, for Chinese students, learning does not merely represent an academic pursuit but can also serve as moral and social goals that then enable them to achieve self-perfection (Li, 2003, 2012). For instance, in Bempechat et al.’s (2018) study, families’ educational messaging played a critical role in fostering Chinese adolescents’ virtue-oriented learning beliefs and their self-regulated behaviors. Because moral and social objectives are emphasized for Chinese learners, they may reply on social resources, such as peers, teachers, and parents, to evaluate their learning.
Another non-invariant item worth mentioning is one from adaptation (i.e., “altered the level of effort I was putting in”). This SRL item reflects an essential learning component related to effort and perseverance, which are emphasized in Chinese learning philosophy, particularly Confucianism. To illustrate Confucianism in detail, Confucius’s notion of learning addresses effortful regulations to develop learning virtues to perfect oneself morally, intellectually, and mentally. Regardless of how much a person achieves, one should continuously make efforts because learning never ends (Li, 2003). Additionally, Confucius acknowledged that learning requires a sense of integrity and a sense of shame by recognizing one’s wrongdoings or challenges and simultaneously amending oneself (Li, 2003). Because scalar invariance was not established at time 2 and time 3, we postulate that these SRL constructs may have been influenced by students’ sociocultural learning backgrounds, which, in turn, affected how they interpreted RLQ items. That is, students with different sociocultural experiences tend to express differences in their SRL processes at the operational level, which could explain the lack of fit of the RLQ for Chinese international students. To our knowledge, no existing empirical study has yet explored the potential reasons why an SRL instrument might exhibit scalar non-invariance across cultural groups. While our findings suggest that sociocultural learning backgrounds may influence how students interpret RLQ items, further research is needed to empirically test the specific mechanisms underlying these differences.
Lastly, correlation analyses showed that the Canadian students’ engagement in goal setting and management at time 2 (i.e., the middle of the semester) was positively related to their GPA and course grade, while that of the Chinese international students did not. In contrast, monitoring was positively associated with GPA at time 2 for both Canadian domestic and Chinese international students. These findings align with previous studies that found SRL is essential for students’ academic performance in Western learning contexts (Hadwin & Winne, 2012; Theobald, 2021). Notably, items of the monitoring factor, including understanding and remembering, could effectively capture the way of how Chinese students monitored their learning processes. As Kember (2000) stated, Chinese students tended to emphasize memorization and understanding through multiple continuous stages during their learning. However, our findings suggest that the impact of SRL engagement on academic achievement for Chinese learners is small or may be absent (Li et al., 2018). One possible explanation for this is that semester GPA and course grades may not accurately reflect Chinese international students’ learning outcomes, particularly since most of the Chinese participants were in their first year of university transitioning from high school to university and from the Chinese culture to the Canadian culture. Thus, other outcome measurements, such as academic engagement and retention, should be considered within future studies.
Overall, moderate to strong correlations between engagement in SRL processes and academic performance for Chinese and Canadians were absent in this study. While small correlations were found, they were insufficient to conclude that these correlations were meaningful. The process of gaining SRL skills takes time and effort, as it requires learners to proactively cultivate learning skills across various phases, strategically make tactical choices based on task understanding and study goals, and metacognitively monitor, evaluate, and regulate their learning processes (Hadwin & Winne, 2012)—all while controlling and inhibiting undesirable learning behaviors. Students enrolling in an educational psychology course that taught the science of learning and motivation may not effectively and immediately apply what they learned about SRL to other disciplinary courses. It may take more time for students to metacognitively apply the SRL knowledge and skills acquired from this course to their own learning. Research has shown that, although students possess accurate metacognitive knowledge about effective learning strategies, their intention to change is often not strong enough to break old habits and develop new ones (David et al., 2024). Therefore, using longitudinal data extending beyond a single 4-month semester is necessary to determine whether students’ active use of SRL practices could enhance their academic performance. Because of the adaptive nature of SRL as a dynamic process unfolding over time in contexts, using correlational analysis to examine the relation between SRL and academic performance limits understanding of how students’ SRL evolved over time to predict students’ academic performance. More importantly, our study found that four SRL constructs were not measured in the same way over time for Chinese international students, whereas these constructs retained similar psychological meaning for the Canadian sample. Therefore, future research should adopt longitudinal research designs to examine whether SRL constructs evolve or remain stable over time for students from distinct sociocultural learning backgrounds.
Limitations and Future Directions
In this study, the sample size of Chinese international students was small (n = 150). Our small sample could explain why the longitudinal measurement invariance was not supported for the Chinese sample and scalar measurement invariance of the four-factor RLQ model was not achieved between the Canadian and Chinese samples. Therefore, future research with a larger sample size for more rigorous analyses, such as structural equation modeling, is warranted. Moreover, using CFI in testing measurement invariance is less powerful when the sample size of each comparison group is unequal. It has been noted that the larger size group tends to exert a greater influence on the parameter estimation process of the constrained model (Cheung & Lau, 2012). Therefore, obtaining an equal or similar sample size across groups needs to be considered in future studies.
Given that questionnaires are usually structured within the framework of a Likert-type scaling point, it is possible that the item scores rated by some cultural groups could be biased (Byrne & Watkins, 2003). For example, Chinese international students could use their completion of the RLQ to show their active engagement in learning by selecting higher scale points as we found that Chinese international students’ mean scores of four SRL constructs across three time points were slightly higher than Canadian domestic students. Selecting higher points of a Likert scale may affect the factor analysis of an instrument, which could sway the resulting conclusions regarding its cross-cultural invariance (Hui & Triandis, 1989). Thus, it is important for future research to consider the impact of using a Likert-type scale in self-reported SRL measurements while investigating cross-cultural invariance. For example, it warrants further consideration in a cross-cultural study of whether the meaning of the Likert scale points (e.g., 2 = not really and 3 = sort of) is interpreted in the same way across various cultural groups and whether adopting a Likert scale with a neural midpoint (e.g., neither difficult nor easy) is necessary. Further, it might be difficult for Chinese international students to capture the exact meanings of certain items in English although they had met their university’s requirements for English language proficiency. Therefore, a cross-cultural modification of the RLQ’s items to eliminate ambiguous meanings for non-English spoken learners might be necessary in future research.
In addition, this study’s results cannot be generalized to students who have not enrolled in this university course. For example, Chinese international students enrolled in this educational psychology course demonstrated a strong motivation to gain self-regulatory competency and engage in various SRL practices to tackle their academic challenges. These limitations warrant a need to replicate this study with students who have not received any training on SRL to see whether a measurement invariance of the RLQ is then obtained. Additionally, all participants came from a Canadian university, which further limits the generalizability of our findings. Given that learning contexts are significantly different between Canada and China, Chinese students studying in a Canadian university may not be representative of those studying in China. Thus, we suggest that large-scale cultural studies including more diverse samples are needed to address this limitation.
Despite these limitations, the present study contributes to the current literature as no existing empirical study has investigated why an SRL instrument would fail in terms of its measurement invariance across cultural groups. When using SRL models developed and validated in the West, researchers must be cautious about whether indicators (survey items) of the questionnaire reflect the same underlying latent constructs of SRL cross-culturally. Lastly, the importance of this finding outlines the need for educators to be aware of the complex and dynamic interplay between culture and SRL. In other words, meaningful engagement in SRL may appear differently for students with different learning backgrounds. Intervention programs that incorporate culturally relevant curriculum content and foster SRL competency would effectively support diverse learners in educational settings.
Footnotes
Authors’ Note
This paper is based on a master’s thesis and was also presented at the American Educational Research Association.
Funding
The authors disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This work was supported by the Social Sciences and Humanities Research Council of Canada (435-2018-0440 awarded to Allyson F. Hadwin and Joseph-Armand Bombardier Canada Graduate Scholarship awarded to Meng Qi Wu).
Declaration of Conflicting Interests
The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Data Availability Statement
Due to the sensitive nature of the questions asked in this study, survey respondents were assured raw data would remain confidential and would not be shared.
