Assessing the Validity of the Cross-Cultural Survey of Online Reading Attitudes and Behaviors With American and South Korean Fifth- and Sixth-Grade Students

Abstract

The Internet is having a profound impact on the literacy practices of students worldwide; yet, there are few instruments available to facilitate cross-cultural comparisons and conclusions specific to cognitive and affective variables related to Internet proficiency. This research was conducted to examine the measurement invariance of the Cross-Cultural Survey of Online Reading Attitudes and Behaviors (SORAB-XC) across a sample of participants from South Korea and the United States. Strong structural validity information was noted for SORAB-XC in each sample, and the results revealed measurement invariance of the item loadings of SORAB-XC between the samples, which justifies the comparison across the samples with respect to the relations between latent factor variables. Implications for future research address the use of the instrument in each individual context; however, additional refinements are required to enable cross-cultural mean comparisons.

Keywords

new literacies online inquiry self-regulation self-efficacy validity

Get full access to this article

View all access options for this article.

References

Bandura

(1997). Self-efficacy: The exercise of control. New York, NY: Freeman.

Bennett

Maton

Kervin

(2008). The digital natives debate: A critical review of the evidence. British Journal of Educational Technology, 39, 775-786. doi:10.1111/j.1467-8535.2007.00793.x

Brand-Gruwel

Wopereis

Walraven

(2009). A descriptive model of information problem solving while using Internet. Computers & Education, 53, 1207-1217. doi:10.1016/j.compedu.2009.06.004

Caraway

Tucker

C. M.

Reinke

W. M.

Hall

(2003). Self-efficacy, goal orientation, and fear of failure as predictors of school engagement in high school students. Psychology in the Schools, 40, 417-427.

Chen

F. F.

(2008). What happens if we compare chopsticks with forks? The impact of making inappropriate comparisons in cross-cultural research. Journal of Personality and Social Psychology, 95, 1005-1018.

Cheung

G. W.

Rensvold

R. B.

(2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9, 233-255. doi:10.1207/S15328007SEM0902_5

Chong

W. H.

(2007). The role of personal agency beliefs in academic self-regulation: An Asian perspective. School Psychology International, 28, 63-76. doi:10.1177/0143034307075681

Coiro

(2009). Promising practices for supporting adolescents’ online literacy development. In Wood

K. D.

Blanton

W. E.

(Eds.), Promoting literacy with adolescent learners: Research-based practices (pp. 442-471). New York, NY: Guilford Press.

Coiro

Dobler

(2007). Exploring the online reading comprehension strategies used by sixth-grade skilled readers to search for and locate information on the Internet. Reading Research Quarterly, 42, 214-257. doi:10.1598/RRQ.42.2.2

10.

Dimitrov

D. M.

(2010). Testing for factorial invariance in the context of construct validation. Measurement and Evaluation in Counseling and Development, 43, 121-149.

11.

Eagleton

M. B.

Dobler

(2007). Reading the web: Strategies for Internet inquiry. New York, NY: Guilford Press.

12.

Eagleton

M. B.

Guinee

Langlais

(2003). Teaching Internet literacy strategies: The hero inquiry project. Voices From the Middle, 10, 28-35.

13.

Fan

Sivo

S. A.

(2005). Sensitivity of fit indices to misspecified structural or measurement model components: Rationale of two-index strategy revisited. Structural Equation Modeling, 12, 343-367. doi:10.1207/s15328007sem1203_1

14.

Goldman

S. R.

Braasch

J. L. G.

Wiley

Graesser

A. C.

Brodowinska

K. M.

(2012). Comprehending and learning from Internet sources: Processing patterns of better and poorer learners. Reading Research Quarterly, 47, 356-381. doi:10.1002/RRQ.027

15.

Hartman

D. K.

Morsink

P. M.

Zheng

(2010). From print to pixels: The evolution of cognitive conceptions of reading comprehension. In Baker

E. A.

(Ed.), Multiple perspectives on new literacies research and instruction (pp. 131-164). New York, NY: Guilford Press.

16.

Heine

S. J.

Buchtel

E. E.

(2009). Personality: The universal and the culturally specific. Annual Review of Psychology, 60, 369-394. doi:10.1146/annurev.psych.60.110707.163655

17.

Hofman

J. L.

Krajcik

J. S.

Soloway

(2003). The nature of middle school learners’ science content understandings with the use of on-line resources. Journal of Research in Science Teaching, 40, 323-346.

18.

Horn

J. L.

(1965). A rationale and test for the number of factors in factor analysis. Psychometrika, 30, 179-185.

19.

Bentler

P. M.

(1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1-55. doi:10.1080/10705519909540118

20.

(2013). A validation study for the Korea Survey of Online Reading Attitudes and Behaviors and Skills (KSORAB). Journal of Reading Research, 30, 227-259.

21.

Kiili

Laurinen

Marttunen

(2008). Students evaluating Internet sources: From versatile evaluators to uncritical readers. Journal of Educational Computing Research, 39, 75-95.

22.

Klassen

R. M.

(2004). A cross-cultural investigation of the efficacy beliefs of south Asian immigrant and Anglo Canadian nonimmigrant early adolescents. Journal of Educational Psychology, 96, 731-742.

23.

Kuiper

Volman

Terwel

(2009). Developing web literacy in collaborative inquiry activities. Computers & Education, 52, 668-680. doi:10.1016/j.compedu.2008.11.010

24.

Leu

D. J.

Kinzer

C. K.

Coiro

Castek

Henry

L. A.

(2013). New literacies: A dual-level theory of the changing nature of literacy, instruction, and assessment. In Alvermann

D. E.

Unrau

N. J.

Ruddell

R. B.

(Eds.), Theoretical models and process of reading (6th ed., pp. 1150-1181). Newark, DE: International Reading Association.

25.

D. D.

Lim

C. P.

(2008). Scaffolding online historical inquiry tasks: A case study of two secondary school classrooms. Computers & Education, 50, 1394-1410.

26.

MacCallum

R. C.

Roznowski

Necowitz

L. B.

(1992). Model modifications in covariance structure analysis: The problem of capitalization on chance. Psychological Bulletin, 111, 490-504. doi:10.1037/0033-2909.111.3.490

27.

Markus

H. R.

Kitayama

(1991). Culture and the self: Implications for cognition, emotion, and motivation. Psychological Review, 98, 224-253.

28.

Marsh

H. W.

Hau

K. T.

Wen

(2004). In search of golden rules: Comment on hypothesis-testing approaches to setting cutoff values for fit indexes and dangers in overgeneralizing Hu and Bentler’s (1999) findings. Structural Equation Modeling, 11, 320-341. doi:10.1207/s15328007sem1103_2

29.

Messick

(1995). Validity of psychological assessment: Validation of inferences from person’s responses and performances as scientific inquiry into score meaning. American Psychologist, 50, 741-749.

30.

Moos

D. C.

(2009). Note-taking while learning with hypermedia: Cognitive and motivational considerations. Computers in Human Behavior, 25, 1120-1128.

31.

Moos

D. C.

Azevedo

(2008). Monitoring, planning, and self-efficacy during learning with hypermedia: The impact of conceptual scaffolds. Computers in Human Behavior, 24, 1686-1706.

32.

O’Byrne

W. I.

McVerry

J. G.

(2009). Measuring the dispositions of online reading comprehension: A preliminary validation study. In Worthy

Maloch

Hoffman

J. V.

Schallert

D. L.

Fairbanks

C. M.

(Eds.), 57th yearbook of the National Reading Conference (pp. 362-375). Oak Creek, WI: National Reading Conference.

33.

Park

Y. S.

Kim

(1999). The educational challenge of Korea in the global era: The role of family, school, and government. Chinese University Education Journal, 26, 91-120.

34.

Peña

E. D.

(2007). Lost in translation: Methodological considerations in cross-cultural research. Child Development, 78, 1255-1264. doi:10.1111/j.1467-8624.2007.01064.x

35.

Putman

S. M.

(2011, April). Exploring skills and attitudes toward online reading: Analyzing the Survey of Online Reading Attitudes and Behaviors. Paper presented at the 2011 Annual Meeting of the American Educational Research Association, New Orleans, LA.

36.

Putman

S. M.

(2014). Exploring dispositions towards online reading: Analyzing the Survey of Online Reading Attitudes and Behaviors. Reading Psychology, 35, 1-31. doi:10.1080/02702711.2012.664250

37.

Salili

Chiu

C. Y.

Lai

(2001). The influence of culture and context on students’ motivational orientation and performance. In Salili

Chiu

C. Y.

Hong

Y. Y.

(Eds.), Student motivation, the culture and context of learning (pp. 221-247). New York, NY: Kluwer Academic.

38.

Satorra

(2000). Scaled and adjusted restricted tests in multi-sample analysis of moment structures. In Heijmans

R. D. H.

Pollock

D. S. G.

Satorra

(Eds.), Innovations in multivariate statistical analysis: A Festschrift for Heinz Neudecker (pp. 233-247). London, England: Kluwer Academic.

39.

Satorra

Bentler

P. M.

(1988). A scaled differences chi-square test statistic for moment structure analysis. Psychometrika, 66, 507-514. doi:10.1007/BF02296192

40.

Scholz

Gutierrez-Dona

Sud

Schwarzer

(2002). Is general self-efficacy a universal construct? Psychometric findings from 25 countries. European Journal of Psychological Assessment, 18, 242-251. doi:10.1027//1015-5759.18.3.242

41.

Thompson

M. S.

Green

S. B.

(2013). Evaluating between-group differences in latent variable means. In Hancock

G. R.

Mueller

R. D.

(Eds.), Structural equation modeling: A second course (2nd ed., pp. 163-218). Charlotte, NC: Information Age.

42.

Tsai

C. C.

Lin

C. C.

(2004). Taiwanese adolescents’ perceptions and attitudes regarding the Internet: Exploring gender differences. Adolescence, 39, 725-734.

43.

Tsai

M. J.

Tsai

C. C.

(2010). Junior high school students’ Internet usage and self-efficacy: A re-examination of the gender gap. Computers & Education, 54, 1182-1192. doi:10.1016/j.compedu.2009.11.004

44.

Whitman

D. S.

Van Rooy

D. L.

Viswesvaran

Kraus

(2009). Testing the second-order factor structure and measurement equivalence of the Wong and Law Emotional Intelligence Scale across gender and ethnicity. Educational and Psychological Measurement, 69, 1057-1074.