There is growing evidence that student experiences of school climate are closely linked to both individual and school-level outcomes. To support data-driven school improvement efforts, it is essential to use reliable and valid measures of school climate, especially brief tools that reduce response burden, ensure accessibility, and enhance feasibility. Using bifactor analysis, this study examined the psychometric properties of the Community and Youth Collaborative Institute School Climate Experience Survey – Middle/High School Student Short Form (CAYCI-SES-SF). Data were collected from 1,509 middle and high school students. Findings indicated the short 29-item version of the survey supports a general factor structure, suggesting it can function as a comprehensive, brief, psychometrically sound tool. The shortened instrument demonstrated strong overall reliability and adequate reliability for some subscales. However, variability in factor loadings and omega coefficients points to the need for further scale refinement. Overall, the study provides initial evidence for the use of the abbreviated CAYCI-SES-SF to assess school climate in educational settings.
Anderson-ButcherD.AmoroseA.BatesS. M.IachiniA. L.BallA.HendersonT. (2020). Driving school improvement planning with community and youth collaborative institute school experience surveys (CAYCI-SES). Children & Schools, 42(1), 7–17. https://doi.org/10.1093/cs/cdz028
2.
Anderson-ButcherD.AmoroseA.IachiniA.BallA. (2012). The development of the perceived school experiences scale (PSES). Research on Social Work Practice, 22(2), 186–194. https://doi.org/10.1177/1049731511419866
3.
Anderson-ButcherD.BatesS.LawsonH. A.ChildsT.IachiniA. (2022b). Community collaboration for school improvement: A scoping review. Education Sciences, 12(12), 918–938. https://doi.org/10.3390/educsci12120918
4.
Anderson-ButcherD.BatesS.SterlingK.VogelerM.DowW.AmoroseA. (2022a). Canyons community schools: Universities and colleges as key partners. Children & Schools, 45(1), 17–26. https://doi.org/10.1093/cs/cdac025
5.
Anderson-ButcherD.IachiniA.BallA.BarkerS.MartinL. (2016). A university-school partnership to examine the adoption and implementation of the Ohio community collaboration model in one urban school district: A mixed method case study. Journal of Education for Students Placed at Risk, 21(3), 190–204. https://doi.org/10.1080/10824669.2016.1183429
6.
Anderson-ButcherD.PalutaL.SterlingK.AndersonC. (2017). Ensuring healthy youth development through community schools: A case study. Children & Schools, 39(1), 7–16. https://doi.org/10.1093/cs/cdx026
7.
BatesS.MellinE.PalutaL.Anderson-ButcherD.VogelerM.SterlingK. (2019). Examining the influence of interprofessional team collaboration on student-level outcomes through school-community partnerships. Children & Schools, 41(2), 119–122. https://doi.org/10.1093/cs/cdz001
8.
BaumsteigerR.HoffmannJ. D.SeibylJ.RoseB.BrackettM. A. (2023). A systematic review of secondary school climate assessments. Educational Psychology Review, 35(2), 1–22. https://doi.org/10.1007/s10648-023-09748-y
BonifayW.LaneS. P.ReiseS. P. (2017). Three concerns with applying a bifactor model as a structure of psychopathology. Clinical Psychological Science, 5(1), 184–186. https://doi.org/10.1177/2167702616657069
11.
BornovalovaM. A.ChoateA. M.FatimahH.PetersenK. J.WiernikB. M. (2020). Appropriate use of bifactor analysis in psychopathology research: Appreciating benefits and limitations. Biological Psychiatry, 88(1), 1–18. https://doi.org/10.1016/j.biopsych.2020.01.013
12.
BrittN.BatesS.Anderson-ButcherD.EdwardsR.NotemanN.BradyC.DuMondL.ChildsT. M. (2022). University-assisted community schools as partners in neighborhood revitalization efforts. Children & Schools, 45(1), 35–45. https://doi.org/10.1093/cs/cdac024
13.
BurnhamK. P.AndersonD. R. (2004). Multimodel inference: Understanding AIC and BIC in model selection. Sociological Methods & Research, 33(2), 261–304. https://doi.org/10.1177/0049124104268644
14.
CaiL.HansenM. (2013). Limited-information goodness-of-fit testing of hierarchical item factor models. British Journal of Mathematical and Statistical Psychology, 66(2), 245–276. https://doi.org/10.1111/j.2044-8317.2012.02050.x
15.
ChalmersR. P. (2012). Mirt: A multidimensional item response theory package for the R environment. Journal of Statistical Software, 48(6), 1–29. https://doi.org/10.18637/jss.v048.i06
16.
ChenF. F.HayesA.CarverC. S.LaurenceauJ. P.ZhangZ. (2012). Modeling general and specific variance in multifaceted constructs: A comparison of the bifactor model to other approaches. Journal of Personality, 80(1), 219–251. https://doi.org/10.1111/j.1467-6494.2011.00739.x
17.
CohenJ.McCabeL.MichelliN. M.PickeralT. (2009). School climate: Research, policy, teacher education and practice. Teachers College Record, 111(1), 180–213. https://doi.org/10.1177/016146810911100108
EidM. (2020). Multi-faceted constructs in abnormal psychology: Implications of the bifactor S-1 model for individual clinical assessment. Journal of Abnormal Child Psychology, 48(7), 895–900. https://doi.org/10.1007/s10802-020-00624-9
20.
EidM.GeiserC.KochT.HeeneM. (2017). Anomalous results in G-factor models: Explanations and alternatives. Psychological Methods, 22(3), 541–562. https://doi.org/10.1037/met0000083
21.
FrazierS. L.MehtaT. G.AtkinsM. S.GlissonC. G.GreenP. D.GibbonsR. D.Linking Neighborhood, Kids, and Schools CenterChapmanJ. E.SchoenwaldS. K.CuaG.OgleR. R. (2015). The social context of urban classrooms: Measuring student psychological climate. Journal of Early Adolescence, 35(5–6), 759–789. https://doi.org/10.1177/0272431615570056
22.
Gálvez-NietoJ. L.Trizano-HermosillaÍ.Polanco-LevicánK. (2024). Psychometric Evaluation of the School Climate and School Identification Measure—Student on Chilean Students: A Bifactor Model Approach. Children, 11(1), 87. https://doi.org/10.3390/children11010087
23.
GignacG. E. (2014). On the inappropriateness of using items to calculate total scale score reliability via coefficient alpha for multidimensional scales. European Journal of Psychological Assessment, 30(2), 130–139. https://doi.org/10.1027/1015-5759/a000181
24.
HendersonT.BatesS.Anderson-ButcherD.AmoroseA.MagierE.NewmanT. (2020). Tailoring supports to youth in schools: One approach to identifying needs and targeting intervention. International Journal of School Social Work, 5(1), 2. https://doi.org/10.4148/2161-4148.1049
25.
HoffmanJ. A.Anderson-ButcherD.FullerM.BatesS. (2017). The school experiences of rural youths: A study in appalachian Ohio. Children & Schools, 39(3), 147–155. https://doi.org/10.1093/cs/cdx010
26.
LenzA. S.RochaL.ArasY. (2021). Measuring school climate: A systematic review of initial development and validation studies. International Journal of the Advancement of Counselling, 43(1), 48–62. https://doi.org/10.1007/s10447-020-09415-9
27.
LiS.SavaleiV. (2025). Evaluating statistical fit of confirmatory bifactor models: Updated recommendations and a review of current practices. Psychological Methods. Advance online publication. https://doi.org/10.1037/met0000703
28.
LombardiE.TraficanteD.BettoniR.OffrediI.GiorgettiM.VerniceM. (2019). The impact of school climate on well-being experience and school engagement: A study with high-school students. Frontiers in Psychology, 10(■■■), Article 2482. https://doi.org/10.3389/fpsyg.2019.02482
29.
MacCallumR. C.BrowneM. W.SugawaraH. M. (1996). Power analysis and determination of sample size for covariance structure modeling. Psychological Methods, 1(2), 130–149. https://doi.org/10.1037/1082-989X.1.2.130
30.
Maydeu-OlivaresA. (2015). Evaluating fit in IRT models. In ReiseS. P.RevickiD. A. (Eds.), Handbook of item response modeling: Applications to typical performance assessment (pp. 111–127). Routledge/Taylor & Francis Group.
31.
McNeishD. (2018). Thanks coefficient alpha, we’ll take it from here. Psychological Methods, 23(3), 412–433. https://doi.org/10.1037/met0000144
32.
McNeishD. (2024). Practical implications of sum scores being psychometrics’ greatest accomplishment. Psychometrika, 89(4), 1148–1169. https://doi.org/10.1007/s11336-024-09988-z
33.
MurrayA. L.JohnsonW. (2013). The limitations of model fit in comparing the bi-factor versus higher-order models of human cognitive ability structure. Intelligence, 41(5), 407–422. https://doi.org/10.1016/j.intell.2013.06.004
O’MalleyM.VoightA.RenshawT. L.EklundK. (2015). School climate, family structure, and academic achievement: A study of moderation effects. School Psychology Quarterly, 30(1), 142–157. https://doi.org/10.1037/spq0000076
36.
Posit Team. (2023). RStudio: Integrated development environment for R. Posit Software, PBC. https://www.posit.co/
37.
R Core Team. (2024). R: A language and environment for statistical computing. R Foundation for Statistical Computing. [Computer software]. https://www.r-project.org/Version 4.4.2.
ReiseS. P.BonifayW.HavilandM. G. (2018). Bifactor modelling and the evaluation of scale scores. In IrwingP.BoothT.HughesD. J. (Eds.), The wiley handbook of psychometric testing: A multidisciplinary reference on survey, scale and test development (pp. 678–707). Wiley.
40.
ReiseS. P.KimD. S.MansolfM.WidamanK. F. (2016). Is the bifactor model a better model or is it just better at modeling implausible responses? Application of iteratively reweighted least squares to the rosenberg self-esteem scale. Multivariate Behavioral Research, 51(6), 818–838. https://doi.org/10.1080/00273171.2016.1243461
41.
ReiseS. P.MooreT. M.HavilandM. G. (2010). Bifactor models and rotations: Exploring the extent to which multidimensional data yield univocal scale scores. Journal of Personality Assessment, 92(6), 544–559. https://doi.org/10.1080/00223891.2010.496477
42.
ReiseS. P.ScheinesR.WidamanK. F.HavilandM. G. (2013). Multidimensionality and structure coefficient bias in structural equation modelling: A bifactor perspective. Educational and Psychological Measurement, 73(1), 1–26. https://doi.org/10.1177/0013164412449831
43.
RodriguezA.ReiseS. P.HavilandM. G. (2016a). Applying bifactor statistical indices in the evaluation of psychological measures. Journal of Personality Assessment, 98(3), 223–237. https://doi.org/10.1080/00223891.2015.1089249
44.
RodriguezA.ReiseS. P.HavilandM. G. (2016b). Evaluating bifactor models: Calculating and interpreting statistical indices. Psychological Methods, 21(2), 137–150. https://doi.org/10.1037/met0000045
45.
SavahlS.CasasF.AdamsS. (2023). Considering a bifactor model of children’s subjective well-being using a multinational sample. Child Indicators Research, 16(6), 2253–2278. https://doi.org/10.1007/s12187-023-10058-6
46.
SijtsmaK.EllisJ. L.BorsboomD. (2024). Recognize the value of the sum score, psychometric’s greatest accomplishment. Psychometrika, 89(1), 84–117. https://doi.org/10.1007/s11336-024-09964-7
47.
SmitsI. A.TimmermanM. E.BareldsD. P.MeijerR. R. (2015). The Dutch symptom Checklist-90-Revised: Is the use of subscales justified?European Journal of Psychological Assessment, 31(4), 263–271. https://doi.org/10.1027/1015-5759/a000233
48.
StefanssonK. K.GestsdottirS.GeldorfG. J.SkulasonS.LernerR. M. (2016). A bifactor model of school engagement: Assessing general and specific aspects of behavioral, emotional, and cognitive engagement among adolescents. International Journal of Behavioral Development, 40(5), 471–480. https://doi.org/10.1177/0165025415604056
49.
StrandP. S.GotchC. M.FrenchB. F.BeaverJ. L. (2019). Factor structure and invariance of an adolescent risks and needs assessment. Assessment, 26(6), 1105–1116. https://doi.org/10.1177/1073191117706201
50.
ThapaA.CohenJ.GuffeyS.Higgins-D’AlessandroA. (2013). A review of school climate research. Review of Educational Research, 83(3), 357–385. https://doi.org/10.3102/0034654313483907
51.
VoightA.NationM. (2016). Practices for improving secondary school climate: A systematic review of the research literature. American Journal of Community Psychology, 58(1-2), 174–191. https://doi.org/10.1002/ajcp.12074
52.
WangM.DegolJ. L. (2016). School climate: A review of the construct, measurement, and impact on student outcomes. Educational Psychology Review, 28(2), 315–352. https://doi.org/10.1007/s10648-015-9319-1
53.
WangM.HofkensT. (2021). Beyond classroom academics: A school-wide and multi-contextual perspective on student engagement in school. Adolescent Research Review, 5(4), 419–433. https://doi.org/10.1007/s40894-01900115-z
54.
WidamanK. F.RevelleW. (2023). Thinking thrice about sum scores, and then some more about measurement and analysis. Behavior Research Methods, 55(2), 788–806. https://doi.org/10.3758/s13428-022-01849-w
55.
ZulligK. J.KoopmanT. M.PattonJ. M.UbbesV. A. (n.d.). School climate: Historical review, instrument development, and school assessment. Journal of Psychoeducational Assessment, 28(■■■), 139–152. https://doi.org/10.1177/07342829093444205
