Should Test Anxiety be Measured Differently for Males and Females? Examination of Measurement Bias Across Gender on Measures of Test Anxiety for Middle and High School,and College Students

Abstract

The present study examined measurement invariance across gender and gender differences on two measures of test anxiety developed for U.S. middle and high school, and college students. It was hypothesized that measurement invariance and gender differences would be found on the two measures of test anxiety, suggesting no separate scoring system is needed for males and females and that gender differences reported reflect true differences on the underlying trait. The results of four confirmatory factor analyses (CFAs) and two multi-group CFAs indicated that the measures of test anxiety were invariant across gender. In addition, internal consistency reliability estimates were found to be similar for males and females on each measure. Furthermore, gender differences were reported on the test anxiety measures. Implications of the findings for researchers and practitioners are discussed.

Keywords

test anxiety gender differences measurement invariance bias confirmatory factor analyses multi-group confirmatory factor analyses

Get full access to this article

View all access options for this article.

References

Brown

T. A.

(2006). Confirmatory factor analysis for applied research. New York, NY: Guilford Press.

Byrne

B. M.

(2012). Structural equation modeling with Mplus: Basic concepts, applications, and programming. New York, NY: Routledge.

Byrne

B. M.

Shavelson

R. J.

Múthen

(1989). Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariance. Psychological Bulletin, 105, 456-466. doi:10.1037/0033-2909.105.3.456

Carle

A. C.

Millsap

R. E.

Cole

D. A.

(2008). Measurement bias across gender on the Children’s Depression Inventory: Evidence for invariance from two latent variable models. Educational and Psychological Measurement, 68, 281-303. doi:10.1177/0013164407308471

Cassady

J. C.

(2004). The influence of cognitive test anxiety across the learning-test cycle. Learning and Instruction, 14, 569-592. doi:10.1016/j.learninstruc.2004.09.002

Chapell

M. S.

Blanding

Z. B.

Silerstein

M. E.

Takahashi

M. N. B.

Newman

Gubi

McCain

(2005). Test anxiety and academic performance in undergraduate and graduate students. Journal of Educational Psychology, 97, 268-274. doi:10.1037/0022-0663.97.2.268

Cheung

G. W.

Rensvold

R. B.

(2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9, 233-255. doi:10.1207/S15328007SEM0902_5

Cizek

G. J.

Burg

S. S.

(2006). Addressing test anxiety in a high-stakes environment. Thousand Oaks, CA: Corwin Press.

Cole

S. R.

(1999). Assessment of differential item functioning in the Perceived Stress Scale-10. Journal of Epidemiology & Community Health, 53, 319-320. doi:10.1136/jech.53.5.319

10.

Everson

H. T.

Millsap

R. E.

Rodriguez

C. M.

(1991). Isolating gender differences in test anxiety: A confirmatory factor analysis of the Test Anxiety Inventory. Educational and Psychological Measurement, 51, 243-251. doi:10.1177/0013164491511024

11.

Flora

D. B.

Curran

P. J.

(2004). An empirical evaluation of alternative methods of estimation for confirmatory factor analysis with ordinal data. Psychological Methods, 9, 466-491. doi:10.1037/1082-989X.9.4.466

12.

Gregor

(2005). Examination anxiety: Live with it, control it or make it work for you? School Psychology International, 26, 617-635. doi:10.1177/0143034305060802

13.

Hembree

(1988). Correlates, causes, effects, and treatment of test anxiety. Review of Educational Research, 58, 47-77. doi:10.3102/00346543058001047

14.

Bentler

P. M.

(1999). Cutoff criteria for fit indices in covariance structural analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1-55. doi:10.1080/10705519909540118

15.

Kieffer

K. M.

Cronin

Gawet

D. L.

(2006). Test and study worry and emotionality in the prediction of college students’ reasons for drinking: An exploratory investigation. Journal of Alcohol and Drug Education, 50, 57.

16.

King

R. B.

Ganotice

A. F.

Watkins

D. A.

(2012). Validation of the Chinese version of the Sense of Self (SOS) Scale. Asia Pacific Education Review, 13, 323-331. doi:10.1007/s12564-011-9195-4

17.

LeBeau

R. T.

Glenn

Liao

Wittchen

Beesdo-Baum

Ollendick

Craske

M. G.

(2010). Specific phobia: A review of DSM-IV specific phobia and preliminary recommendations for DSM-V. Depression and Anxiety, 27, 148-167. doi:10.1002/da.20655

18.

Little

T. D.

(1997). Mean and covariance structures (MACS) analyses of cross-cultural data: Practical and theoretical issues. Multivariate Behavioral Research, 32, 53-76. doi:10.1207/s15327906mbr3201_3

19.

Little

T. D.

(2013). Longitudinal structural equation modeling. New York, NY: Guilford Press.

20.

Lowe

P. A.

(2013). Validation of the Adult Manifest Anxiety Scale–College version scores among U.S. college students. Canadian Journal of School Psychology, 28, 277-294. doi:10.1177/0829573513497907

21.

Lowe

P. A.

(2014). The Test Anxiety Measure for Adolescents (TAMA): Examination of the reliability and validity of the scores of a new multidimensional measure of test anxiety for middle high school students. Journal of Psychoeducational Assessment, 32, 404-416. doi:10.1177/0734282914528611

22.

Lowe

P. A.

Lee

S. W.

(2008). Factor structure of the Test Anxiety Inventory for Children and Adolescents (TAICA) scores across gender among students in elementary and secondary school settings. Journal of Psychoeducational Assessment, 26, 231-246. doi:10.1177/0734282907303773

23.

Lowe

P. A.

Reynolds

C. R.

(2005). Factor structure of AMAS-C scores across gender among students in collegiate settings. Educational and Psychological Measurement, 65, 687-707. doi:10.1177/0013164405275659

24.

Methia

R. A.

(2004). Help your child overcome test anxiety & achieve higher test scores. College Station, TX: Virtual Bookwork.com.

25.

Muthén

L. K.

Muthén

B. O.

(1998-2013). Mplus (Version 7.1). Los Angeles, CA: Author.

26.

Nunnally

J. C.

Bernstein

I. H.

(1994). Psychometric theory (3rd ed.). New York, NY: McGraw-Hill.

27.

Prelow

Tien

J. Y.

Roosa

M. W.

Wood

(2000). Do coping styles differ across sociocultural groups? The role of measurement equivalence in making this judgment. American Journal of Community Psychology, 28, 225-244. doi:10.1023/A:1005139318357

28.

Reynolds

C. R.

(1998). Need we measure anxiety differently for males and females? Journal of Personality Assessment, 70, 212-221. doi:10.1207/s15327752jpa7002_2

29.

Reynolds

C. R.

Richmond

B. O.

Lowe

P. A.

(2003a). The Adult Manifest Anxiety Scale–College version. Los Angeles, CA: Western Psychological Services.

30.

Reynolds

C. R.

Richmond

B. O.

Lowe

P. A.

(2003b). The Adult Manifest Anxiety Scale: Manual. Los Angeles, CA: Western Psychological Services.

31.

Reynolds

M. R.

Keith

T. Z.

(2013). Measurement and statistical issues in child assessment research. In Saklofske

D. H.

Reynolds

C. R.

Schwean

V. L.

(Eds.), The Oxford handbook of child psychological assessment (pp. 48-83). New York, NY: Oxford University Press.

32.

Seipp

Schwarzer

(1996). Cross-cultural anxiety research: A review. In Schwarzer

Zeidner

(Eds.), Stress, anxiety, and coping in academic settings (pp. 13-68). Tubingen, Germany: Francke-Verlag.

33.

Spielberger

C. D.

(1980). Test Anxiety Inventory. Palo Alto, CA: Consulting Psychologists Press.

34.

Spielberger

C. D.

Anton

W. D.

Bedell

(1976). The nature and treatment of test anxiety. In Zuckerman

Spielberger

C. D.

(Eds.), Emotions and anxiety: New concepts, methods, and applications (pp. 317-344). Hillsdale, NJ: Lawrence Erlbaum.

35.

Szafranski

D. D.

Barrera

T. L.

Norton

P. J.

(2012). Test Anxiety Inventory: 30 years later. Anxiety, Stress, & Coping, 25, 667-677. doi:10.1080/10615806.2012.663490

36.

Wadee

A. A.

Kuschke

R. H.

Kometz

Berk

(2001). Personality factors, stress, and immunity. Stress & Health, 17, 25-40. doi:10.1002/1532-2998(200101)17:1<25::AID-SMI873>3.0.CO;2-N

37.

Waller

N. G.

Thompson

J. S.

Wenk

(2000). Using IRT to separate measurement bias from true group differences on homogeneous and heterogeneous scales. An illustrative with the MMPI. Psychological Methods, 5, 125-146. doi:10.1037/1082-989X.5.1.125

38.

Widaman

K. F.

Reise

S. P.

(1997). Exploring the measurement invariance of psychological instruction: Applications in substance use domain. In Bryant

K. J.

Windle

West

S. G.

(Eds.), The science of prevention: Methodological advances from alcohol and substance abuse research (pp. 281-324). Washington, DC: American Psychological Association.

39.

Wren

D. G.

Benson

(2004). Measuring test anxiety in children: Scale development and internal construct validation. Anxiety, Stress, & Coping, 17, 227-240. doi:10.1080/10615800412331292606

40.

Zeidner

(1998). Test anxiety: The state of the art. New York, NY: Plenum Press.

41.

Zeidner

Nevo

(1992). Test anxiety in examinees in a college admission testing situation: Incidence, dimensionality, and cognitive correlates. In Hagtvet

K. A.

Johnsen

B. T.

(Eds.), Advances in test anxiety research (Vol. 7, pp. 288-303). Lisse, The Netherlands: Swets & Zeitlinger.