The purpose of this study was to estimate pooled reliability values for the total and sub-scales of the Children’s Test Anxiety Scale (CTAS) and to investigate the sources for the heterogeneity between the reliability estimates of the studies using the scale. In line with this purpose, a reliability generalization meta-analysis was applied, with 34 studies reporting 38 alpha coefficients. We also examined the induction rates of the CTAS. The pooled reliability values were estimated as .915, .867, .795, and .740 for the total scale, thoughts, autonomic reactions, and off-task behaviors sub-scales, respectively. Results of the meta-analysis showed that heterogeneity was detected in the total and subscales, and moderator analyses were conducted to determine the source of heterogeneity. The analyses revealed the statistical significance of some categorical (school level, continent, country, scale type, language, publication type) and continuous (mean age and mean scale score) variables. Reliability induction rate was determined to be 11.21%. This study represents the first reliability generalization analysis of the CTAS. The generalized reliability of both the CTAS and its subscales was established. Our findings endorse the CTAS as reliable instruments for assessing test anxiety in children. The limitations of the scale were mentioned, and suggestions were made to the researchers. Recommendations are offered for future research.
AlisinanoğluF.Ulutaşİ. (2003). Çocukların kaygı düzeyleri ile annelerinin kaygı düzeyleri arasındaki ilişkinin incelenmesi. Eğitim ve Bilim, 28(128), 65–71.
2.
*AnbarN.CheieL.Visu-PetraL. (2022). Math anxiety, math achievement and gender differences among primary school children and their parents from Palestine. International Journal of Learning, Teaching and Educational Research, 21(8), 326–334. https://doi.org/10.26803/ijlter.21.8.19
3.
AndersonS. B.SauserW. I.Jr. (1995). Measurement of test anxiety: An overview. In SpielbergerC. D.VaggP. R. (Eds.), Test anxiety: Theory, assessment and treatment (pp. 15–33). Taylor & Francis.
4.
*Aras KemerF. (2019). Farklı yetenek düzeyindeki ortaokul öğrencilerinde sınav kaygısı ile yaşam doyumu arasındaki ilişkide umudun aracı rolü. (Thesis ID. 549798). Gazi University. Master’s Thesis, YOK Thesis Center.
5.
*ArslanÇ. (2020). Examining the relationship between 5-8th grade students' test anxiety and mathematics anxiety. Acta Didactica Napocensia, 13(1), 127–137. https://doi.org/10.24193/adn.13.1.12
6.
AslanÖ. Ş.GöcenS.SenS. (2022). Reliability generalization meta-analysis of mathematics anxiety scale for primary school students. Journal of Measurement and Evaluation in Education and Psychology, 13(2), 117–133. https://doi.org/10.21031/epod.1119308
7.
*AydinU. (2017). Test anxiety: Do gender and school-level matter?European Journal of Educational Research, 6(2), 187–197. https://doi.org/10.12973/eu-jer.6.2.187
8.
*AydinU. (2019). Grade level differences in the cognitive, behavioral, and physiological components of test anxiety. International Journal of Educational Psychology: International Journal of E-Politics, 8(1), 27–50. https://doi.org/10.17583/ijep.2019.2729
9.
*AydınU.BulganG. (2017). Çocuklarda Sınav Kaygısı Ölçeği’nin Türkçe uyarlaması: Geçerlik ve güvenirlik çalışması. Elementary Education Online, 16(2), 887–899. https://doi.org/10.17051/ilkonline.2017.304742
10.
BarnesL. L.HarpD.JungW. S. (2002). Reliability generalization of scores on the Spielberger state-trait anxiety inventory. Educational and Psychological Measurement, 62(4), 603–618. https://doi.org/10.1177/001316402128775049
11.
BedellJ. R.MarloweH. A. (1995). An evaluation of test anxiety scales: Convergent, divergent and predictive validity. In SpielbergerC. D.VaggP. R. (Eds.), Test anxiety: Theory, assessment and treatment (pp. 35–45). Taylor & Francis.
12.
BeggC. B.MazumdarM. (1994). Operating characteristics of a rank correlation test for publication bias. Biometrics, 50(4), 1088–1101.
13.
BeidelD. C. (1991). Social phobia and overanxious disorder in school-age children. Journal of the American Academy of Child and Adolescent Psychiatry, 30(4), 545–552. https://doi.org/10.1097/00004583-199107000-00003
14.
BensonJ.El-ZahharN. (1994). Further refinement and validation of the revised test anxiety scale. Structural Equation Modeling: A Multidisciplinary Journal, 1(3), 203–221. https://doi.org/10.1080/10705519409539975
15.
*BochisL.SandraF. (2018). Intervention program to reduce the level of test anxiety in a primary school class. A pilot study. Revista Romaneasca Pentru Educatie Multidimensionala-Journal for Multidimensional Education, 10(4), 23–31. https://doi.org/10.18662/rrem/69
16.
BonettD. G. (2002). Sample size requirements for testing and estimating coefficient alpha. Journal of Educational and Behavioral Statistics, 27(4), 335–340. https://doi.org/10.3102/10769986027004335
17.
BorensteinM.HedgesL. V.HigginsJ. P.RothsteinH. R. (2009). Introduction to meta-analysis. John Wiley & Sons.
18.
*CahalanJ. V. (2008). Test anxiety in context: Primary students’ experience of test anxiety in an ecological framework. New York University. (UMI No. 3332499). [Doctoral dissertation]. Proquest Dissertations and Thesis.
19.
*CareyE.DevineA.HillF.SzűcsD. (2017). Differentiating anxiety forms and their role in academic performance from primary to secondary school. PLoS One, 12(3), Article e0174418. https://doi.org/10.1371/journal.pone.0174418
20.
CassadyJ. C.JohnsonR. E. (2002). Cognitive test anxiety and academic performance. Contemporary Educational Psychology, 27(2), 270–295. https://doi.org/10.1006/ceps.2001.1094
21.
ChapellM. S.BlandingZ. B.SilversteinM. E.TakahashiM.NewmanB.GubiA.McCannN. (2005). Test anxiety and academic performance in undergraduate and graduate students. Journal of Educational Psychology, 97(2), 268–274. https://doi.org/10.1037/0022-0663.97.2.268
22.
*ChingB. H. H. (2017). Mathematics anxiety and working memory: Longitudinal associations with mathematical performance in Chinese children. Contemporary Educational Psychology, 51(2), 99–113. https://doi.org/10.1016/j.cedpsych.2017.06.006
*CoşkunF. (2018). Çocuklarda Sınav Kaygısı Ölçeğinin Türkçeye Uyarlanması: Geçerlik ve güvenirlik çalışması (Thesis ID. 505464). Bolu İzzet Baysal University, Master’s Thesis. YOK Thesis Center.
25.
CrockerL.SchmittA.TangL. (1988). Test anxiety and standardized achievement test performance in the middle school years. Measurement and Evaluation in Counseling and Development, 20(4), 149–157. https://doi.org/10.1080/07481756.1988.12022865
26.
*CurtisC. A. (2009). The relationship between anxiety, working memory and academic performance among secondary school pupils with social, emotional and behavioural difficulties: A test of processing efficiency theory (yayın No. 142539). University of Southampton. [Doctoral dissertation] Eprints.
27.
DowkerA.SarkarA.LooiC. Y. (2016). Mathematics anxiety: What have we learned in 60 years?Frontiers in Psychology, 7, 508. https://doi.org/10.3389/fpsyg.2016.00508
28.
DriscollR. (2007). Westside test anxiety scale validation. (ED495968). Online submission.
29.
DusekJ. B. (1980). The development of test anxiety in children. In SarasonI.G. (Ed.), Test anxiety: Theory, research, and applications (pp. 87–110). Lawrence Erlbaum Associates.
30.
EggerM.Davey SmithG.SchneiderM.MinderC. (1997). Bias in meta-analysis detected by a simple, graphical test. British Medical Journal, 315(7109), 629–634. https://doi.org/10.1136/bmj.315.7109.629
*FergusT. A.LimbersC. A. (2019). Reducing test anxiety in school settings: A controlled pilot study examining a group format delivery of the attention training technique among adolescent students. Behavior Therapy, 50(4), 803–816. https://doi.org/10.1016/j.beth.2018.12.001
33.
*FergusT. A.LimbersC. A.BockselC. E. (2020). Associations between metacognitive beliefs and test anxiety among middle school students. Translational Issues in Psychological Science, 6(1), 70–80. https://doi.org/10.1037/tps0000216
34.
*GençA.SanliE. (2023). The effect of students’ exam anxiety on high school entrance exam success: The moderator role of parental exam anxiety. Journal of Pedagogical Research, 7(1), 260–272. https://doi.org/10.33902/jpr.202316861
35.
HancockG. R.MuellerR. O. (2001). Rethinking construct reliability within latent variable systems. In CudeckR.du ToitS.SoerbomD. (Eds.), Structural equation modeling: Present and future—a festschrift in honor of Karl Jöreskog (pp. 195–216). Scientific Software International.
36.
HattieJ. (1985). Methodology review: Assessing unidimensionality of tests and ltenls. Applied Psychological Measurement, 9(2), 139–164. https://doi.org/10.1177/014662168500900204
37.
HembreeR. (1988). Correlates, causes, effects, and treatment of test anxiety. Review of Educational Research, 58(1), 47–77. https://doi.org/10.3102/00346543058001047
38.
HensonR. K.ThompsonB. (2002). Characterizing measurement error in scores across studies: Some recommendations for conducting ‘reliability generalization’ studies. Measurement and Evaluation in Counseling and Development, 35(2), 113–127. https://doi.org/10.1080/07481756.2002.12069054
39.
HigginsJ. P.ThompsonS. G. (2002). Quantifying heterogeneity in a meta-analysis. Statistics in Medicine, 21(11), 1539–1558. https://doi.org/10.1002/sim.1186
40.
*IndriesM.BochisL. (2019). Sport anxiety, test anxiety and academic performance of primary school pupils: A correlational study. Health, Sports and Rehabilitation Medicine, 20(4), 165–169. https://doi.org/10.26659/pm3.2019.20.4.165
41.
*JournaultA. A.PlanteI.CharbonneauS.SauvageauC.LongpréC.GiguèreC. É.LupienS. (2021). What triggers students’ state anxiety in schools: Using latent profile analyses to uncover the combined role of anxiety sensitivity and test anxiety.
42.
*KaderF. A. H. A.EissaM. A. (2014). Measuring test anxiety in students aged 10-17 years in Egypt: Factor analysis and psychometric properties. Psycho-Educational Research Reviews, 3(3), 102–109.
43.
*KorhonenJ.NyroosM.JonssonB.EklöfH. (2018). Additive and multiplicative effects of working memory and test anxiety on mathematics performance in grade 3 students. Educational Psychology, 38(5), 572–595. https://doi.org/10.1080/01443410.2017.1356449
44.
LeadbeaterB.ThompsonK.GruppusoV. (2012). Co-occurring trajectories of symptoms of anxiety, depression, and oppositional defiance from adolescence to young adulthood. Journal of Clinical Child and Adolescent Psychology, 41(6), 719–730. https://doi.org/10.1080/15374416.2012.694608
45.
LearyM. R.KowalskiR. M. (1997). Social anxiety. Guilford Press.
46.
*Lieberman-AcobasE. (2010). The relation between test anxiety, distractibility, and academic performance (Umi ID. 3436499). St. John's University. [Doctoral dissertation].
47.
LiebertR. M.MorrisL. W. (1967). Cognitive and emotional components of test anxiety: A distinction and some initial data. Psychological Reports, 20(3), 975–978. https://doi.org/10.2466/pr0.1967.20.3.975
48.
LightR. J.PillemerD. B. (1984). Summing up: The science of reviewing research. Harvard University Press.
49.
LoweP. A.GrumbeinM. J.RaadJ. M. (2011). Examination of the psychometric properties of the test anxiety scale for elementary students (TAS-E) scores. Journal of Psychoeducational Assessment, 29(6), 503–514. https://doi.org/10.1177/0734282910395894
50.
LoweP. A.LeeS. W.DeRuyckK. A. (2004). An exploratory factor analysis of a new comprehensive measure of test anxiety: The Test Anxiety Inventory for Children andAdolescents (TAICA). (Unpublished manuscript).
51.
LoweP. A.LeeS. W.WitteborgK. M.PrichardK. W.LuhrM. E.CullinanC. M.MildrenB. A.RaadJ. M.CorneliusR. A.JanikM.JanikM. (2008). The Test Anxiety Inventory for Children and Adolescents (TAICA) examination of the psychometric properties of a new multidimensional measure of test anxiety among elementary and secondary school students. Journal of Psychoeducational Assessment, 26(3), 215–230. https://doi.org/10.1177/0734282907303760
52.
ManavF. (2011). Kaygı kavramı. Toplum Bilimleri, 5(9), 201–211.
53.
MandlerG.CowenJ. E. (1958). Test anxiety questionnaires. Journal of Consulting Psychology, 22(3), 228–229. https://doi.org/10.1037/h0043617
54.
*MarieR.JournaultA. A.CernikR.WelchP.LupienS.McDermottB.MoxonJ. V.SarnyaiZ.SarnyaiZ. (2022). A cross-sectional study investigating Canadian and Australian Adolescents’ perceived experiences of COVID-19: Gender differences and mental health implications. International Journal of Environmental Research and Public Health, 19(7), 4407. https://doi.org/10.3390/ijerph19074407
55.
McDonaldR. P. (1970). The theoretical foundations of principal factor analysis, canonical factor analysis, and alpha factor analysis. British Journal of Mathematical and Statistical Psychology, 23(1), 1–21. https://doi.org/10.1111/j.2044-8317.1970.tb00432.x
56.
McNeishD. (2018). Thanks coefficient alpha, we’ll take it from here. Psychological Methods, 23(3), 412–433. https://doi.org/10.1037/met0000144
57.
MoherD.LiberatiA.TetzlaffJ.AltmanD. G.PRISMA Group. (2010). Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. International Journal of Surgery, 8(5), 336–341. https://doi.org/10.1016/j.ijsu.2010.02.007
58.
NunnallyJ. C.BernsteinI. H. (1994). Psychometric theory (3.). McGraw-Hill.
59.
*OhI. (2017). Test anxiety in school-age children in high-achieving schools (Yayın no. 10745523). The Chicago School of Professional Psychology. [Doctoral dissertation] Proquest Dissertations and Thesis.
60.
OllendickT. H.MeyerJ. (1984). School phobia. In TurnerS. M. (Ed.), Behavioral theories and treatment of anxiety (367–411). Plenum Press.
61.
OnwuegbuzieA. J.BaileyP.DaleyC. E. (1999). Factors associated with foreign language anxiety. Applied PsychoLinguistics, 20(2), 217–239. https://doi.org/10.1017/s0142716499002039
62.
*OwensM. (2009). Exploring the role of working memory and understanding educational underachievement in anxiety and depression (ID. 66624). University of Southampton. [Doctoral dissertation] EPrints.
63.
*OwensM.StevensonJ.HadwinJ. A.NorgateR. (2012). Anxiety and depression in academic performance: An exploration of the mediating factors of worry and working memory. School Psychology International, 33(4), 433–449. https://doi.org/10.1177/0143034311427433
64.
PetittiD. B. (2000). Meta-analysis, decision analysis and cost-effectiveness analysis: Methods for quantitative synthesis in medicine. Oxford University Press.
65.
PiquerasJ. A.Martín-VivarM.SandinB.San LuisC.PinedaD. (2017). The revised child anxiety and depression scale: A systematic review and reliability generalization meta-analysis. Journal of Affective Disorders, 218, 153–169. https://doi.org/10.1016/j.jad.2017.04.022
66.
PutwainD. (2008). Do examinations stakes moderate the test anxiety–examination performance relationship?Educational Psychology, 28(2), 109–118. https://doi.org/10.1080/01443410701452264
67.
*PutwainD. W.BestN. (2012). Do highly test anxious students respond differentially to fear appeals made prior to a test?Research in Education, 88(1), 1–10. https://doi.org/10.7227/rie.88.1.1
68.
*RavidA. (2015). 'Not just right experiences’ in Youth. State university of New York at binghamton, Department of Psychology.
69.
R Core Team. (2021). R: A language and environment for statistical computing R Foundation for Statistical Computing. R Core Team. https://www.R-project.org/
70.
*RealiF.Jiménez-LealW.Maldonado-CarrenoC.DevineA.SzücsD. (2016). Examining the link between math anxiety and math performance in Colombian students. Revista Colombiana de Psicología, 25(2), 369–379. https://doi.org/10.15446/rcp.v25n2.54532
RosenthalR. (1979). The file drawer problem and tolerance for null results. Psychological Bulletin, 86(3), 638–641.
73.
Sánchez-MecaJ.Marín-MartínezF.López-LópezJ. A.Núñez-NúñezR. M.Rubio-AparicioM.López-GarcíaJ. J.López-PinaJ. A.Blázquez-RincónD. M.López-IbáñezC.López-NicolásR. (2021). Improving the reporting quality of reliability generalization meta-analyses: The REGEMA checklist. Research Synthesis Methods, 12(4), 516–536. https://doi.org/10.1002/jrsm.1487
74.
Sánchez-MecaJ.Rubio-AparicioM.López-PinaJ.Núñez-NúñezR.M.Marín-MartínezF. (2015). The phenomenon of reliability induction in the social and health sciences. XIV Congress of Methodology of the Social and Health Sciences.
75.
SarasonI. G. (1977). The test anxiety scale: Concept and research.
76.
SarasonI. G. (1984). Stress, anxiety, and cognitive interference: Reactions to tests. Journal of Personality and Social Psychology, 46(4), 929–938. https://doi.org/10.1037//0022-3514.46.4.929
SarasonS. B.GordonE. M. (1953). The test anxiety questionnaire: Scoring norms. Journal of Abnormal and Social Psychology, 48(3), 447–448. https://doi.org/10.1037/h0055887
79.
*Segall CernikR. (2021). The relationship between co-rumination and different forms of normative anxiety in Quebec youth. The University of Montreal. [Unpublished Doctoral dissertation].
80.
*SegoolN.CarlsonJ.GoforthA.von der EmbseN.BarterianJ. (2013). Heightened test anxiety among young children: Elementary school students’ anxious responses to highstakes testing. Psychology in the Schools, 50(5), 489–499. https://doi.org/10.1002/pits.21689
81.
SenS. (2022). A reliability generalization meta-analysis of runco ideational behavior scale. Creativity Research Journal, 34(2), 178–194. https://doi.org/10.1080/10400419.2021.1960719
82.
ŞenS.Yıldırımİ. (2023). CMA ile meta-analiz uygulamaları (Genişletilmiş ikinci baskı). Anı Yayıncılık.
83.
SenS.YörükS. (2023). A reliability generalization meta‐analysis of the Kaufman Domains of Creativity Scale. Journal of Creative Behavior, 57(4), 812–837. https://doi.org/10.1002/jocb.620
84.
ShieldsA. L.CarusoJ. C. (2004). A reliability induction and reliability generalization study of the CAGE questionnaire. Educational and Psychological Measurement, 64(2), 254–270. https://doi.org/10.1177/0013164403261814
85.
*ShoahosseiniR.BaghaeiP. (2019). Validation of the Persian translation of the children’s test anxiety scale: A multidimensional rasch model analysis. European Journal of Investigation in Health, Psychology and Education, 10(1), 59–69. https://doi.org/10.3390/ejihpe10010006
86.
SmelserN. J.BaltesP. B. (2011). International encyclopedia of the social and behavioural sciences. Proceedings of US National Academy of Sciences, 95(3), 922–930.
87.
SpielbergerC. D. (1980). Test anxiety inventory: Preliminary professional manual. Consulting Psychologists Press, Inc.
88.
SpielbergerC. D. (1983). State-trait anxiety inventory for adults (STAI-AD) [database records]. APA PsycTests.
89.
SpielbergerC. D.VaggP. R. (1995). Test anxiety: A transactional process model.
90.
StoneW.L.LemanekK.L. (1990). Developmental issues in children’s self-reports. In La GrecaA.M. (Ed.), Through the eyes of a child: Obtaining self-reports from children and adolescents (pp. 3–17). Allyn & Bacon.
91.
SwansonS.HowellC. (1996). Test anxiety in adolescents with learning disabilities and behavior disorders. Exceptional Children, 62(5), 389–397. https://doi.org/10.1177/001440299606200501
92.
*SzczygiełM. (2020). More evidence that math anxiety is specific to math in young children: The correlates of the Math Anxiety Questionnaire for Children (MAQC). International Electronic Journal of Elementary Education, 12(5), 429–438. https://doi.org/10.26822/iejee.2020562133
93.
TavakolM.DennickR. (2011). Making sense of Cronbach’s alpha. International Journal of Medical Education, 2, 53–55. https://doi.org/10.5116/ijme.4dfb.8dfd
94.
ThorntonA.LeeL. (2000). Publication bias in meta-analysis: Its causes and consequences. Journal of Clinical Epidemiology, 53(2), 207–216. https://doi.org/10.1016/s0895-4356(99)00161-4
95.
*TaylerB. R. (2014). The effectiveness of a manualised hypnosis intervention in reducing test-anxiety in school aged children: A pilot randomised controlled trial [unpublished doctoral dissertation]. University of Southampton.
96.
TurnerB. G.BeidelD. C.HughesS.TurnerM. W. (1993). Text anxiety in African American school children. School Psychology Quarterly, 8(2), 140–152. https://doi.org/10.1037/h0088835
97.
Vacha-HaaseT. (1998). Reliability generalization: Exploring variance in measurement error affecting score reliability across studies. Educational and Psychological Measurement, 58(1), 6–20. https://doi.org/10.1177/0013164498058001002
98.
Vacha-HaaseT.KoganL. R.ThompsonB. (2000). Sample compositions and variabilities in published studies versus those in test manuals: Validity of score reliability inductions. Educational and Psychological Measurement, 60(4), 509–522. https://doi.org/10.1177/00131640021970682
99.
Vacha-HaaseT.ThompsonB. (2011). Score reliability: A retrospective look back at 12 years of reliability generalization studies. Measurement and Evaluation in Counseling and Development, 44(3), 159–168. https://doi.org/10.1177/0748175611409845
100.
*Van MierH. I.SchleepenT. M.Van den BergF. C. (2019). Gender differences regarding the impact of math anxiety on arithmetic performance in second and fourth graders. Frontiers in Psychology, 9, 2690. https://doi.org/10.3389/fpsyg.2018.02690
*VogelaarB.BakkerM.ElliottJ. G.ResingW. C. (2017). Dynamic testing and test anxiety amongst gifted and average-ability children. British Journal of Educational Psychology, 87(1), 75–89. https://doi.org/10.1111/bjep.12136
103.
Von der EmbseN. P.WitmerS. E. (2014). High-stakes accountability: Student anxiety and large-scale testing. Journal of Applied School Psychology, 30(2), 132–156. https://doi.org/10.1080/15377903.2014.888529
104.
WineJ. D. (1982). Evaluation anxiety: A cognitive-attentional construct. Series in clinical and community psychology: Achievement, stress, and anxiety, 207–219.
105.
*WoodS. G.HartS. A.LittleC. W.PhillipsB. M. (2016). Test anxiety and a high-stakes standardized reading comprehension test: A behavioral genetics perspective. Merrill-Palmer Quarterly, 62(3), 233–251. https://doi.org/10.13110/merrpalmquar1982.62.3.0233
106.
*WrenD. G.BensonJ. (2004). Measuring test anxiety in children: Scale development and internal construct validation. Anxiety, Stress and Coping, 17(3), 227–240. https://doi.org/10.1080/10615800412331292606
ZeidnerM. (1998). Test anxiety: The state of the art. Plenum Press.
109.
ZeidnerM. (2004). Test anxiety. In SpielbergerC. (Ed.) Encyclopedia of applied psychology. Elsevier.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
