Test of Measurement Invariance,and Evidence for Reliability and Validity of AMAS Scores in Dutch Secondary School and University Students

Abstract

The Abbreviated Math Anxiety Scale (AMAS) is commonly used to compare groups on math anxiety. Group comparisons should however be preceded by a demonstration of metric and scalar measurement invariance, which is currently only available for undergraduate students in the USA. This study tested for metric and scalar measurement invariance of AMAS scores across sexes and age groups and investigated reliability and validity evidence. Dutch secondary school students (N = 1504) and university students (N = 629) completed the AMAS and reported their math grades. Subsamples also completed questionnaires on related (e.g., trait anxiety) and unrelated constructs (e.g., anxiety for learning a foreign language). Results of multi-group Confirmatory Factor Analyses showed the 2-factor structure that was detected in earlier studies and supported partial metric and scalar invariance, although cross-loadings for one item were included for the female university students group to improve model fit. Reliability ranged from acceptable to good and validity was supported.

Keywords

measurement invariance math anxiety sex differences age groups

Get full access to this article

View all access options for this article.

References

American Educational Research Association (AERA) (2014). American psychological association, & national council on measurement in EducationStandards for educational and psychological testing. American Educational Research Association.

Bakker

F. C.

van Wieringen

P. C. W.

van der Ploeg

H. M.

Spielberger

C. D (

(1989). Zelf-beoordelings-vragenlijst voor kinderen. ZBV-K. Swets & Zeitlinger.

Brown

T. A.

(2015). Confirmatory factor analysis for applied research (2nd ed.). The Guilford Press.

Brown

J. L.

Sifuentes

L. M.

(2016). Validation study of the abbreviated math anxiety scale: Spanish adaptation. Journal of Curriculum and Teaching, 5(2), 76–82. http://dx.doi.org/10.5430/jct.v5n2p76

Byrne

B. M.

Shavelson

R. J.

Muthén

(1989). Testing for the equivalence of factor covariance and mean structures: The issue of partial measurement invariance. Psychological Bulletin, 105(3), 456–466. http://doi.org/10.1037/0033-2909.105.3.456

Carey

Hill

Devine

Szücs

(2016). The chicken or the egg? The direction of the relationship between mathematics anxiety and mathematics performance. Frontiers in Psychology, 6(1987), 1–7 http://doi.org/10.3389/fpsyg.2015.01987

Caviola

Primi

Chiesi

Mammarella

I. C.

(2017). Psychometric properties of the Abbreviated Math Anxiety Scale (AMAS) in Italian primary school children. Learning and Individual Differences, 55, 174–182. http://doi.org/10.1016/j.lindif.2017.03.006

Chen

F. F.

(2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal, 14(3), 464–504. http://doi.org/10.1080/10705510701301834

Cheung

G. W.

Rensvold

R. B.

(2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9(2), 233–255. http://doi.org/10.1207/S15328007SEM0902_5

10.

Cho

K. W.

(2022). Measuring math anxiety among predominantly underrepresented minority undergraduates using the Abbreviated Math Anxiety Scale. Journal of Psychoeducational Assessment. Advance online publication. http://doi.org/10.1177/07342829211063286

11.

Cipora

Szczygieł

Willmes

Nuerk

H. C.

(2015). Math anxiety assessment with the abbreviated math anxiety scale: Applicability and usefulness: Insights from the Polish adaptation. Frontiers in Psychology, 6(1833), 1–16. http://doi.org/10.3389/fpsyg.2015.01833

12.

Cito (2012). OECD programme for international student assessment 2012Hoofdonderzoek PISA 2012. PISA-2012-llvragenlijst-B-v1.0).

13.

Dancey

C. P.

Reidy

(2007). Statistics without maths for psychology. Pearson Education.

14.

Dempster

McCorry

N. K.

(2009). The role of previous experience and attitudes toward statistics in statistics assessment outcomes among undergraduate psychology students. Journal of Statistics Education, 17(2), 2. https://doi.org/10.1080/10691898.2009.11889515

15.

Dowker

Sarkar

Looi

C. Y.

(2016). Mathematics anxiety: What have we learned in 60 years? Frontiers in Psychology, 7(508), 1–16. http://doi.org/10.3389/fpsyg.2016.00508

16.

Evers

A. V. A. M.

Lucassen

Meijer

R. R.

Sijtsma

(2009). COTAN Beoordelingssysteem voor de kwaliteit van tests [COTAN Assessment system for the quality of tests]. Netherlands Institute of Psychologists.

17.

Hill

Mammarella

I. C.

Devine

Caviola

Passolunghi

M. C.

Szűcs

(2016). Maths anxiety in primary and secondary school students: Gender differences, developmental changes and anxiety specificity. Learning and Individual Differences, 48, 45–53. http://doi.org/10.1016/j.lindif.2016.02.006

18.

Hopko

D. R.

Mahadevan

Bare

R. L.

Hunt

M. K.

(2003). The abbreviated math anxiety scale (AMAS) construction, validity, and reliability. Assessment, 10(2), 178–182. http://doi.org/10.1177/1073191103010002008

19.

Horwitz

E. K.

Horwitz

M. B.

Cope

(1986). Foreign language classroom anxiety. The Modern Language Journal, 70(2), 125–132. http://doi.org/10.1111/j.1540-4781.1986.tb05256.x

20.

Kuncel

N. R.

Credé

Thomas

L. L.

(2005). The validity of self-reported grade point averages, class ranks, and test scores: A meta-analysis and review of the literature. Review of Educational Research, 75(1), 63–82. https://doi.org/10.3102/00346543075001063

21.

Lee

(2009). Universals and specifics of math self-concept, math self-efficacy, and math anxiety across 41 PISA 2003 participating countries. Learning and Individual Differences, 19(3), 355–365. http://doi.org/10.1016/j.lindif.2008.10.009

22.

(1999). A meta-analysis of the relationship between anxiety toward mathematics and achievement in mathematics. Journal of Research in Mathematrics Education, 30(5), 520–540. http://doi: 10.2307/749772

23.

Muthén

L. K.

Muthén

B. O.

(2015). Mplus user's guide. Muthén & Muthén.

24.

OECD (2013). PISA 2012 assessment and analytical framework: Mathematics, reading, science, problem solving and financial literacy. OECD Publishing. https://doi.org/10.1787/9789264190511-en

25.

Primi

Busdraghi

Tomasetto

Morsanyi

Chiesi

(2014). Measuring math anxiety in Italian college and high school students: Validity, reliability and gender invariance of the Abbreviated Math Anxiety Scale (AMAS). Learning and Individual Differences, 34, 51–56. http://doi.org/10.1016/j.lindif.2014.05.012

26.

Putnick

D. L.

Bornstein

M. H.

(2016). Measurement invariance conventions and reporting: The state of the art and future directions for psychological research. Developmental Review, 41(1), 71–90. http://doi.org/10.1016/j.dr.2016.06.004

27.

Richardson

F. C.

Suinn

R. M.

(1972). The mathematics anxiety rating scale: Psychometric data. Journal of Counseling Psychology, 19(6), 551–554. http://doi.org/10.1037/h0033-456

28.

Sachisthal

M. S.

Raijmakers

M. E.

Jansen

B. R.

(2021). Trait and state math EAP (emotion, appraisals and performance) profiles of Dutch teenagers. Learning and Individual Differences, 89(1), 102029. https://doi.org/10.1016/j.lindif.2021.102029

29.

Satorra

Bentler

P. M.

(2010). Ensuring positiveness of the scaled difference chi-square test statistic. Psychometrika, 75(2), 243–248. http://doi.org/10.1007/s11336-009-9135-Y

30.

Schillinger

F. L.

Vogel

S. E.

Diedrich

Grabner

R. H.

(2018). Math anxiety, intelligence, and performance in mathematics: Insights from the German adaptation of the Abbreviated Math Anxiety Scale (AMAS-G). Learning and Individual Differences, 61(1), 109–119. http://doi.org/10.1016/j.lindif.2017.11.014

31.

Schmitz

E. A.

(2020). Missing factors in math anxiety: The role of emotional components, math behaviour, and cognitive biases in adolescents’ math anxiety. [Doctoral dissertation, University of Amsterdam].

32.

Schmitz

E. A.

Jansen

B. R. J.

Wiers

R. W.

Salemink

(2019). Do implicitly measured math-anxiety associations play a role in math behavior? Journal of Experimental Child Psychology, 186(1), 171–188. http://doi.org/10.1016/j.jecp.2019.05.013

33.

Spielberger

C. D.

Edwards

C. D.

Lushene

R. E.

Montuori

Platzek

(1973). State-trait anxiety inventory for children. In Preliminary manual. Consulting Psychologist Press.

34.

Steele

J. R.

Ambady

(2006). Math is Hard!” The effect of gender priming on women’s attitudes. Journal of Experimental Social Psychology, 42(4), 428–436. https://doi.org/10.1016/j.jesp.2005.06.003

35.

Sticca

Goetz

Bieg

Hall

N. C.

Eberle

Haag

(2017). Examining the accuracy of students’ self-reported academic grades from a correlational and a discrepancy perspective: Evidence from a longitudinal study. Plos One, 12(11), Article e0187367. https://doi.org/10.1371/journal.pone.0187367

36.

Suárez-Pellicioni

Núñez-Peña

M. I.

Colomé

À.

(2016). Math anxiety: A review of its cognitive consequences, psychophysiological correlates, and brain bases. Cognitive, Affective & Behavioral Neuroscience, 16(1), 3–22. http://doi.org/10.3758/s13415-015-0370-7

37.

Vahedi

Farrokhi

(2011). A confirmatory factor analysis of the structure of Abbreviated Math Anxiety Scale. Iranian Journal of Psychiatry, 6(2), 47–53.

38.

van de Schoot

Lugtig

Hox

(2012). A checklist for testing measurement invariance. European Journal of Developmental Psychology, 9(4), 486–492. http://doi.org/10.1080/17405629.2012.686740.

39.

Wang

Shakeshaft

Schofield

Malanchini

(2018). Anxiety is not enough to drive me away: A latent profile analysis on math anxiety and math motivation. Plos One, 13(2), Article e0192072. https://doi.org/10.1371/journal.pone.0192072

40.

Wicherts

J. M.

Dolan

C. V.

(2010). Measurement invariance in confirmatory factor analysis: An illustration using IQ test performance of minorities. Educational Measurement: Issues and Practice, 29(3), 39–47. http://doi.org/10.1111/j.1745-3992.2010.00182.x