Restricted accessResearch articleFirst published online 2015-8
Assessing the Validity of the Cross-Cultural Survey of Online Reading Attitudes and Behaviors With American and South Korean Fifth- and Sixth-Grade Students
The Internet is having a profound impact on the literacy practices of students worldwide; yet, there are few instruments available to facilitate cross-cultural comparisons and conclusions specific to cognitive and affective variables related to Internet proficiency. This research was conducted to examine the measurement invariance of the Cross-Cultural Survey of Online Reading Attitudes and Behaviors (SORAB-XC) across a sample of participants from South Korea and the United States. Strong structural validity information was noted for SORAB-XC in each sample, and the results revealed measurement invariance of the item loadings of SORAB-XC between the samples, which justifies the comparison across the samples with respect to the relations between latent factor variables. Implications for future research address the use of the instrument in each individual context; however, additional refinements are required to enable cross-cultural mean comparisons.
BanduraA. (1997). Self-efficacy: The exercise of control. New York, NY: Freeman.
2.
BennettS.MatonK.KervinL. (2008). The digital natives debate: A critical review of the evidence. British Journal of Educational Technology, 39, 775-786. doi:10.1111/j.1467-8535.2007.00793.x
3.
Brand-GruwelS.WopereisI.WalravenA. (2009). A descriptive model of information problem solving while using Internet. Computers & Education, 53, 1207-1217. doi:10.1016/j.compedu.2009.06.004
4.
CarawayK.TuckerC. M.ReinkeW. M.HallC. (2003). Self-efficacy, goal orientation, and fear of failure as predictors of school engagement in high school students. Psychology in the Schools, 40, 417-427.
5.
ChenF. F. (2008). What happens if we compare chopsticks with forks? The impact of making inappropriate comparisons in cross-cultural research. Journal of Personality and Social Psychology, 95, 1005-1018.
6.
CheungG. W.RensvoldR. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9, 233-255. doi:10.1207/S15328007SEM0902_5
7.
ChongW. H. (2007). The role of personal agency beliefs in academic self-regulation: An Asian perspective. School Psychology International, 28, 63-76. doi:10.1177/0143034307075681
8.
CoiroJ. (2009). Promising practices for supporting adolescents’ online literacy development. In WoodK. D.BlantonW. E. (Eds.), Promoting literacy with adolescent learners: Research-based practices (pp. 442-471). New York, NY: Guilford Press.
9.
CoiroJ.DoblerE. (2007). Exploring the online reading comprehension strategies used by sixth-grade skilled readers to search for and locate information on the Internet. Reading Research Quarterly, 42, 214-257. doi:10.1598/RRQ.42.2.2
10.
DimitrovD. M. (2010). Testing for factorial invariance in the context of construct validation. Measurement and Evaluation in Counseling and Development, 43, 121-149.
11.
EagletonM. B.DoblerE. (2007). Reading the web: Strategies for Internet inquiry. New York, NY: Guilford Press.
12.
EagletonM. B.GuineeK.LanglaisK. (2003). Teaching Internet literacy strategies: The hero inquiry project. Voices From the Middle, 10, 28-35.
13.
FanX.SivoS. A. (2005). Sensitivity of fit indices to misspecified structural or measurement model components: Rationale of two-index strategy revisited. Structural Equation Modeling, 12, 343-367. doi:10.1207/s15328007sem1203_1
14.
GoldmanS. R.BraaschJ. L. G.WileyJ.GraesserA. C.BrodowinskaK. M. (2012). Comprehending and learning from Internet sources: Processing patterns of better and poorer learners. Reading Research Quarterly, 47, 356-381. doi:10.1002/RRQ.027
15.
HartmanD. K.MorsinkP. M.ZhengJ. (2010). From print to pixels: The evolution of cognitive conceptions of reading comprehension. In BakerE. A. (Ed.), Multiple perspectives on new literacies research and instruction (pp. 131-164). New York, NY: Guilford Press.
16.
HeineS. J.BuchtelE. E. (2009). Personality: The universal and the culturally specific. Annual Review of Psychology, 60, 369-394. doi:10.1146/annurev.psych.60.110707.163655
17.
HofmanJ. L.WuH.KrajcikJ. S.SolowayE. (2003). The nature of middle school learners’ science content understandings with the use of on-line resources. Journal of Research in Science Teaching, 40, 323-346.
18.
HornJ. L. (1965). A rationale and test for the number of factors in factor analysis. Psychometrika, 30, 179-185.
19.
HuL.BentlerP. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1-55. doi:10.1080/10705519909540118
20.
KiS. (2013). A validation study for the Korea Survey of Online Reading Attitudes and Behaviors and Skills (KSORAB). Journal of Reading Research, 30, 227-259.
21.
KiiliC.LaurinenL.MarttunenM. (2008). Students evaluating Internet sources: From versatile evaluators to uncritical readers. Journal of Educational Computing Research, 39, 75-95.
22.
KlassenR. M. (2004). A cross-cultural investigation of the efficacy beliefs of south Asian immigrant and Anglo Canadian nonimmigrant early adolescents. Journal of Educational Psychology, 96, 731-742.
23.
KuiperE.VolmanM.TerwelJ. (2009). Developing web literacy in collaborative inquiry activities. Computers & Education, 52, 668-680. doi:10.1016/j.compedu.2008.11.010
24.
LeuD. J.KinzerC. K.CoiroJ.CastekJ.HenryL. A. (2013). New literacies: A dual-level theory of the changing nature of literacy, instruction, and assessment. In AlvermannD. E.UnrauN. J.RuddellR. B. (Eds.), Theoretical models and process of reading (6th ed., pp. 1150-1181). Newark, DE: International Reading Association.
25.
LiD. D.LimC. P. (2008). Scaffolding online historical inquiry tasks: A case study of two secondary school classrooms. Computers & Education, 50, 1394-1410.
26.
MacCallumR. C.RoznowskiM.NecowitzL. B. (1992). Model modifications in covariance structure analysis: The problem of capitalization on chance. Psychological Bulletin, 111, 490-504. doi:10.1037/0033-2909.111.3.490
27.
MarkusH. R.KitayamaS. (1991). Culture and the self: Implications for cognition, emotion, and motivation. Psychological Review, 98, 224-253.
28.
MarshH. W.HauK. T.WenZ. (2004). In search of golden rules: Comment on hypothesis-testing approaches to setting cutoff values for fit indexes and dangers in overgeneralizing Hu and Bentler’s (1999) findings. Structural Equation Modeling, 11, 320-341. doi:10.1207/s15328007sem1103_2
29.
MessickS. (1995). Validity of psychological assessment: Validation of inferences from person’s responses and performances as scientific inquiry into score meaning. American Psychologist, 50, 741-749.
30.
MoosD. C. (2009). Note-taking while learning with hypermedia: Cognitive and motivational considerations. Computers in Human Behavior, 25, 1120-1128.
31.
MoosD. C.AzevedoR. (2008). Monitoring, planning, and self-efficacy during learning with hypermedia: The impact of conceptual scaffolds. Computers in Human Behavior, 24, 1686-1706.
32.
O’ByrneW. I.McVerryJ. G. (2009). Measuring the dispositions of online reading comprehension: A preliminary validation study. In WorthyJ.MalochB.HoffmanJ. V.SchallertD. L.FairbanksC. M. (Eds.), 57th yearbook of the National Reading Conference (pp. 362-375). Oak Creek, WI: National Reading Conference.
33.
ParkY. S.KimU. (1999). The educational challenge of Korea in the global era: The role of family, school, and government. Chinese University Education Journal, 26, 91-120.
34.
PeñaE. D. (2007). Lost in translation: Methodological considerations in cross-cultural research. Child Development, 78, 1255-1264. doi:10.1111/j.1467-8624.2007.01064.x
35.
PutmanS. M. (2011, April). Exploring skills and attitudes toward online reading: Analyzing the Survey of Online Reading Attitudes and Behaviors. Paper presented at the 2011 Annual Meeting of the American Educational Research Association, New Orleans, LA.
36.
PutmanS. M. (2014). Exploring dispositions towards online reading: Analyzing the Survey of Online Reading Attitudes and Behaviors. Reading Psychology, 35, 1-31. doi:10.1080/02702711.2012.664250
37.
SaliliF.ChiuC. Y.LaiS. (2001). The influence of culture and context on students’ motivational orientation and performance. In SaliliF.ChiuC. Y.HongY. Y. (Eds.), Student motivation, the culture and context of learning (pp. 221-247). New York, NY: Kluwer Academic.
38.
SatorraA. (2000). Scaled and adjusted restricted tests in multi-sample analysis of moment structures. In HeijmansR. D. H.PollockD. S. G.SatorraA. (Eds.), Innovations in multivariate statistical analysis: A Festschrift for Heinz Neudecker (pp. 233-247). London, England: Kluwer Academic.
39.
SatorraA.BentlerP. M. (1988). A scaled differences chi-square test statistic for moment structure analysis. Psychometrika, 66, 507-514. doi:10.1007/BF02296192
40.
ScholzU.Gutierrez-DonaB.SudS.SchwarzerR. (2002). Is general self-efficacy a universal construct? Psychometric findings from 25 countries. European Journal of Psychological Assessment, 18, 242-251. doi:10.1027//1015-5759.18.3.242
41.
ThompsonM. S.GreenS. B. (2013). Evaluating between-group differences in latent variable means. In HancockG. R.MuellerR. D. (Eds.), Structural equation modeling: A second course (2nd ed., pp. 163-218). Charlotte, NC: Information Age.
42.
TsaiC. C.LinC. C. (2004). Taiwanese adolescents’ perceptions and attitudes regarding the Internet: Exploring gender differences. Adolescence, 39, 725-734.
43.
TsaiM. J.TsaiC. C. (2010). Junior high school students’ Internet usage and self-efficacy: A re-examination of the gender gap. Computers & Education, 54, 1182-1192. doi:10.1016/j.compedu.2009.11.004
44.
WhitmanD. S.Van RooyD. L.ViswesvaranC.KrausE. (2009). Testing the second-order factor structure and measurement equivalence of the Wong and Law Emotional Intelligence Scale across gender and ethnicity. Educational and Psychological Measurement, 69, 1057-1074.
