Restricted accessResearch articleFirst published online 2015-6
Should Test Anxiety be Measured Differently for Males and Females? Examination of Measurement Bias Across Gender on Measures of Test Anxiety for Middle and High School,and College Students
The present study examined measurement invariance across gender and gender differences on two measures of test anxiety developed for U.S. middle and high school, and college students. It was hypothesized that measurement invariance and gender differences would be found on the two measures of test anxiety, suggesting no separate scoring system is needed for males and females and that gender differences reported reflect true differences on the underlying trait. The results of four confirmatory factor analyses (CFAs) and two multi-group CFAs indicated that the measures of test anxiety were invariant across gender. In addition, internal consistency reliability estimates were found to be similar for males and females on each measure. Furthermore, gender differences were reported on the test anxiety measures. Implications of the findings for researchers and practitioners are discussed.
BrownT. A. (2006). Confirmatory factor analysis for applied research. New York, NY: Guilford Press.
2.
ByrneB. M. (2012). Structural equation modeling with Mplus: Basic concepts, applications, and programming. New York, NY: Routledge.
3.
ByrneB. M.ShavelsonR. J.MúthenB. (1989). Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariance. Psychological Bulletin, 105, 456-466. doi:10.1037/0033-2909.105.3.456
4.
CarleA. C.MillsapR. E.ColeD. A. (2008). Measurement bias across gender on the Children’s Depression Inventory: Evidence for invariance from two latent variable models. Educational and Psychological Measurement, 68, 281-303. doi:10.1177/0013164407308471
5.
CassadyJ. C. (2004). The influence of cognitive test anxiety across the learning-test cycle. Learning and Instruction, 14, 569-592. doi:10.1016/j.learninstruc.2004.09.002
6.
ChapellM. S.BlandingZ. B.SilersteinM. E.TakahashiM. N. B.NewmanB.GubiA.McCainN. (2005). Test anxiety and academic performance in undergraduate and graduate students. Journal of Educational Psychology, 97, 268-274. doi:10.1037/0022-0663.97.2.268
7.
CheungG. W.RensvoldR. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9, 233-255. doi:10.1207/S15328007SEM0902_5
8.
CizekG. J.BurgS. S. (2006). Addressing test anxiety in a high-stakes environment. Thousand Oaks, CA: Corwin Press.
9.
ColeS. R. (1999). Assessment of differential item functioning in the Perceived Stress Scale-10. Journal of Epidemiology & Community Health, 53, 319-320. doi:10.1136/jech.53.5.319
10.
EversonH. T.MillsapR. E.RodriguezC. M. (1991). Isolating gender differences in test anxiety: A confirmatory factor analysis of the Test Anxiety Inventory. Educational and Psychological Measurement, 51, 243-251. doi:10.1177/0013164491511024
11.
FloraD. B.CurranP. J. (2004). An empirical evaluation of alternative methods of estimation for confirmatory factor analysis with ordinal data. Psychological Methods, 9, 466-491. doi:10.1037/1082-989X.9.4.466
12.
GregorA. (2005). Examination anxiety: Live with it, control it or make it work for you?School Psychology International, 26, 617-635. doi:10.1177/0143034305060802
13.
HembreeR. (1988). Correlates, causes, effects, and treatment of test anxiety. Review of Educational Research, 58, 47-77. doi:10.3102/00346543058001047
14.
HuL.BentlerP. M. (1999). Cutoff criteria for fit indices in covariance structural analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1-55. doi:10.1080/10705519909540118
15.
KiefferK. M.CroninC.GawetD. L. (2006). Test and study worry and emotionality in the prediction of college students’ reasons for drinking: An exploratory investigation. Journal of Alcohol and Drug Education, 50, 57.
16.
KingR. B.GanoticeA. F.WatkinsD. A. (2012). Validation of the Chinese version of the Sense of Self (SOS) Scale. Asia Pacific Education Review, 13, 323-331. doi:10.1007/s12564-011-9195-4
17.
LeBeauR. T.GlennD.LiaoB.WittchenH.Beesdo-BaumK.OllendickT.CraskeM. G. (2010). Specific phobia: A review of DSM-IV specific phobia and preliminary recommendations for DSM-V. Depression and Anxiety, 27, 148-167. doi:10.1002/da.20655
18.
LittleT. D. (1997). Mean and covariance structures (MACS) analyses of cross-cultural data: Practical and theoretical issues. Multivariate Behavioral Research, 32, 53-76. doi:10.1207/s15327906mbr3201_3
19.
LittleT. D. (2013). Longitudinal structural equation modeling. New York, NY: Guilford Press.
20.
LoweP. A. (2013). Validation of the Adult Manifest Anxiety Scale–College version scores among U.S. college students. Canadian Journal of School Psychology, 28, 277-294. doi:10.1177/0829573513497907
21.
LoweP. A. (2014). The Test Anxiety Measure for Adolescents (TAMA): Examination of the reliability and validity of the scores of a new multidimensional measure of test anxiety for middle high school students. Journal of Psychoeducational Assessment, 32, 404-416. doi:10.1177/0734282914528611
22.
LoweP. A.LeeS. W. (2008). Factor structure of the Test Anxiety Inventory for Children and Adolescents (TAICA) scores across gender among students in elementary and secondary school settings. Journal of Psychoeducational Assessment, 26, 231-246. doi:10.1177/0734282907303773
23.
LoweP. A.ReynoldsC. R. (2005). Factor structure of AMAS-C scores across gender among students in collegiate settings. Educational and Psychological Measurement, 65, 687-707. doi:10.1177/0013164405275659
24.
MethiaR. A. (2004). Help your child overcome test anxiety & achieve higher test scores. College Station, TX: Virtual Bookwork.com.
25.
MuthénL. K.MuthénB. O. (1998-2013). Mplus (Version 7.1). Los Angeles, CA: Author.
26.
NunnallyJ. C.BernsteinI. H. (1994). Psychometric theory (3rd ed.). New York, NY: McGraw-Hill.
27.
PrelowH.TienJ. Y.RoosaM. W.WoodJ. (2000). Do coping styles differ across sociocultural groups? The role of measurement equivalence in making this judgment. American Journal of Community Psychology, 28, 225-244. doi:10.1023/A:1005139318357
28.
ReynoldsC. R. (1998). Need we measure anxiety differently for males and females?Journal of Personality Assessment, 70, 212-221. doi:10.1207/s15327752jpa7002_2
29.
ReynoldsC. R.RichmondB. O.LoweP. A. (2003a). The Adult Manifest Anxiety Scale–College version. Los Angeles, CA: Western Psychological Services.
30.
ReynoldsC. R.RichmondB. O.LoweP. A. (2003b). The Adult Manifest Anxiety Scale: Manual. Los Angeles, CA: Western Psychological Services.
31.
ReynoldsM. R.KeithT. Z. (2013). Measurement and statistical issues in child assessment research. In SaklofskeD. H.ReynoldsC. R.SchweanV. L. (Eds.), The Oxford handbook of child psychological assessment (pp. 48-83). New York, NY: Oxford University Press.
32.
SeippB.SchwarzerC. (1996). Cross-cultural anxiety research: A review. In SchwarzerC.ZeidnerM. (Eds.), Stress, anxiety, and coping in academic settings (pp. 13-68). Tubingen, Germany: Francke-Verlag.
33.
SpielbergerC. D. (1980). Test Anxiety Inventory. Palo Alto, CA: Consulting Psychologists Press.
34.
SpielbergerC. D.AntonW. D.BedellJ. (1976). The nature and treatment of test anxiety. In ZuckermanM.SpielbergerC. D. (Eds.), Emotions and anxiety: New concepts, methods, and applications (pp. 317-344). Hillsdale, NJ: Lawrence Erlbaum.
35.
SzafranskiD. D.BarreraT. L.NortonP. J. (2012). Test Anxiety Inventory: 30 years later. Anxiety, Stress, & Coping, 25, 667-677. doi:10.1080/10615806.2012.663490
WallerN. G.ThompsonJ. S.WenkE. (2000). Using IRT to separate measurement bias from true group differences on homogeneous and heterogeneous scales. An illustrative with the MMPI. Psychological Methods, 5, 125-146. doi:10.1037/1082-989X.5.1.125
38.
WidamanK. F.ReiseS. P. (1997). Exploring the measurement invariance of psychological instruction: Applications in substance use domain. In BryantK. J.WindleM.WestS. G. (Eds.), The science of prevention: Methodological advances from alcohol and substance abuse research (pp. 281-324). Washington, DC: American Psychological Association.
39.
WrenD. G.BensonJ. (2004). Measuring test anxiety in children: Scale development and internal construct validation. Anxiety, Stress, & Coping, 17, 227-240. doi:10.1080/10615800412331292606
40.
ZeidnerM. (1998). Test anxiety: The state of the art. New York, NY: Plenum Press.
41.
ZeidnerM.NevoB. (1992). Test anxiety in examinees in a college admission testing situation: Incidence, dimensionality, and cognitive correlates. In HagtvetK. A.JohnsenB. T. (Eds.), Advances in test anxiety research (Vol. 7, pp. 288-303). Lisse, The Netherlands: Swets & Zeitlinger.
