Sage Journals: Discover world-class research

Abstract

School climate plays a critical role in student well-being, academic success, and behavioral outcomes, yet the length of existing school climate surveys limits their feasibility for frequent administration within intervention frameworks such as Multi-Tiered Systems of Support (MTSS) and Positive Behavioral Interventions and Supports (PBIS). The purpose of this study was to evaluate the psychometric properties of a shortened school climate survey adapted from the validated U.S. Department of Education School Climate Surveys (EDSCLS)-Student Survey. A sample of 596 secondary students responded to 19 strategically selected items from the original survey. Using exploratory and confirmatory factor analysis, two items were removed due to low factor loadings, resulting in a refined 17-item measure with strong psychometric properties across three factors: embracing school diversity, school belonging, and student-teacher relationships. Findings suggest that this shortened survey maintains measurement integrity while enhancing practical usability within a data-driven intervention framework. Implications for integrating school climate assessment into MTSS and PBIS models to inform timely and effective school-wide interventions are discussed.

Keywords

school climate factor analysis assessment utility multi-tiered systems of support data-driven decision-making

Get full access to this article

View all access options for this article.

References

Bear

G. G.

Gaskins

Blank

Chen

F. F.

(2011). Delaware School Climate Survey—Student: Its factor structure, concurrent validity, and reliability. Journal of School Psychology, 49(2), 157–174. https://doi.org/10.1016/j.jsp.2011.01.001

Berkowitz

Moore

Astor

R. A.

Benbenishty

(2017). A research synthesis of the associations between socioeconomic background, inequality, school climate, and academic achievement. Review of Educational Research, 87(2), 425–469. https://doi.org/10.3102/0034654316685921

Brand

Felner

R. D.

Shim

Seitsinger

A. M.

Dumas

(2003). Middle school improvement and reform: Development and validation of a school-level assessment of climate, cultural pluralism, and school safety. Journal of Educational Psychology, 95(3), 570–588. https://doi.org/10.1037/0022-0663.95.3.570

Castillo

J. M.

Batsche

G. M.

Curtis

M. J.

Stockslager

March

Minch

(2010). Problem solving/response to intervention evaluation tool technical assistance manual. https://scholarcommons.usf.edu/

Center on PBIS. (2024). PBIS: An evidence-based framework for making schools safe, positive, predictable, and equitable. Center on PBIS, University of Oregon. www.pbis.org/resource/pbis-an-evidence-based-framework.

Chafouleas

S. M.

(2011). Direct behavior rating: A review of the issues and research in its development. Education & Treatment of Children, 34, 575–591. https://doi.org/10.1353/etc.2011.0034

Cicchetti

D. V.

Sparrow

S. S.

(1981). Developing criteria for establishing interrater reliability of specific items: Applications to assessment of adaptive behavior. American Journal of Mental Deficiency, 86, 127–137.

Cohen

McCabe

E. M.

Michelli

N. M.

Pickeral

(2009). School climate: Research, policy, practice, and teacher education. Teachers College Record, 111, 180–213. https://doi.org/10.1177/016146810911100108

Cornell

Huang

(2019). Collecting and analyzing local school safety and climate data. In Mayer

Jimerson

(Eds.), School safety and violence prevention: Science, practice, and policy driving change (pp. 151–175). American Psychological Association.

10.

Cornell

Shukla

Konold

(2016). Authoritative School Climate Survey: Development and validation of a middle school version. School Psychology Quarterly, 31(1), 70–82. https://doi.org/10.1037/spq0000131

11.

Duckworth

A. L.

Yeager

D. S.

(2015). Measurement matters: Assessing personal qualities other than cognitive ability for educational purposes. Educational Researcher, 44(4), 237–251. https://doi.org/10.3102/0013189X15584327

12.

Elrod

B. G.

Rice

K. G.

Meyers

(2022). PBIS fidelity, school climate, and student discipline: A longitudinal study of secondary schools. Psychology in the Schools, 59, 376–397. https://doi.org/10.1002/pits.22614

13.

Espelage

D. L.

Polanin

J. R.

Low

S. K.

(2014). Teacher and staff perceptions of school environment as predictors of student aggression, victimization, and willingness to intervene in bullying situations. School Psychology Quarterly, 29(3), 287–305. https://doi.org/10.1037/spq0000072

14.

Every Student Succeeds Act, 20 U.S.C. § 6301 (2015). https://www.congress.gov/bill/114th-congress/senate-bill/1177

15.

Fire

N. T.

Alkalay

Gvion

Zalsman

(2023). The association between school staff’s coping strategies following a student’s suicide, school climate, and previous experience with suicide. Psychology in the Schools, 60, 2639–2656. https://doi.org/10.1002/pits.22898

16.

Florida Positive Behavioral Interventions & Support Project. (2020). Foundations of implementation: Multi-tiered Support Systems (MTSS) logic of a multi-tiered approach. http://flpbis.cbcs.usf.edu/foundations/mtss.html

17.

Gage

N. A.

Larson

Sugai

Chafouleas

S. M.

(2016). Student perceptions of school climate as predictors of office discipline referrals. American Educational Research Journal, 53(3), 492–515. https://doi.org/10.3102/0002831216637349

18.

Gonzálvez

León-Moreno

Sanmartín

García-Fernández

J. M.

(2022). Systematic and evaluative review of school climate instruments for students. Psychology in the Schools, 59(2), 1–16. https://doi.org/10.1002/pits.22838

19.

Horn

J. L.

(1965). A rationale and test for the number of factors in factor analysis. Psychometrika, 30(2), 179–185. https://doi.org/10.1007/BF02289447

20.

Bentler

P. M.

(1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. https://doi.org/10.1080/10705519909540118

21.

Jones

T. M.

Fleming

(2021). A multilevel model of the association between school climate and racial differences in academic outcomes. Psychology in the Schools, 58, 893–912. https://doi.org/10.1002/pits.22477

22.

Kaiser

H. F.

(1960). The application of electronic computers to factor analysis. Educational and Psychological Measurement, 20(1), 141–151. https://doi.org/10.1177/001316446002000116

23.

Kohl

Recchia

Stefggen

(2013). Measuring school climate: An overview of measurement scales. Educational Research, 55, 411–426. http://dx.doi.org/10.1080/00131881.2013.844944

24.

Konold

Cornell

Shukla

Huang

(2017). Racial/ethnic differences in perceptions of school climate and its association with student engagement and peer aggression. Journal of Youth and Adolescence, 46, 1289–1303. https://doi.org/10.1007/s10964-016-0576-1

25.

Kupchik

Highberger

Bear

(2022). Identifying the helpfulness of school climate: Skipping school, cheating on tests, and elements of school climate. Psychology in the Schools, 59, 1538–1555. https://doi.org/10.1002/pits.22692

26.

Lane

K. L.

Oakes

W. P.

Menzies

H. M.

(2014). Comprehensive, integrated, three-tiered models of prevention: Why Does my school—and district—need an integrated approach to meet students’ academic, behavioral, and social needs? Preventing School Failure: Alternative Education for Children and Youth, 58(3), 121–128. https://doi.org/10.1080/1045988X.2014.893977

27.

Marraccini

M. E.

Fang

Levine

S. P.

Chin

A. J.

Pittleman

(2020). Measuring student perceptions of school climate: A systematic review and ecological content analysis. School Mental Health, 12, 195–221. https://https://doi.org/10.1007/s12310-019-09348-8

28.

National School Climate Center. (2021). How is school climate measured?

29.

Raîche

Walls

T. A.

Magis

Riopel

Blais

J. G.

(2013). Non-graphical solutions for Cattell’s Scree test. Methodology, 9(1), 23–29. https://doi.org/10.1027/1614-2241/a000051

30.

R Core Team. (2023). R: A language and environment for statistical computing. R Foundation for Statistical Computing. http://www.R-project.org/

31.

Revelle

(2020). How to: Use the psych package for factor analysis and data reduction. Northwestern University, Department of Psychology.

32.

Roeser

R. W.

Eccles

J. S.

Sameroff

A. J.

(2000). School as a context of early adolescents’ academic and social-emotional development: A summary of research findings. The Elementary School Journal, 100(5), 443–471. https://doi.org/10.1086/499650

33.

Rosseel

(2012). lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48(1), 1–36. https://doi.org/10.18637/jss.v048.i02

34.

Schaffer

(2022). Multi-tiered systems of support: A practical guide to preventative practice. Sage Publications.

35.

Tabachnick

B. G.

Fidell

L. S.

(2007). Using multivariate statistics. Pearson Education, Inc.

36.

Thapa

Cohen

Guffey

Higgins-D’Alessandro

(2013). A review of school climate research. Review of Educational Research, 83, 357–385. https://doi.org/10.3102/0034654313483907

37.

U.S. Department of Education. (2018). ED School Climate Surveys-Student Survey. https://safesupportivelearning.ed.gov/edscls

38.

Wang

Degol

J. L.

(2016). School climate: A review of the construct, measurement, and impact on student outcomes. Educational Psychology Review, 28, 315–352. https://doi.org/10.1007/s10648-015-9319-1

39.

Way

Reddy

Rhodes

(2007). Students’ perceptions of school climate during the middle school years: Associations with trajectories of psychological and behavioral adjustment. American Journal of Community Psychology, 40(3-4), 194–213. https://doi.org/10.1007/s10464-007-9143-y

40.

Worthington

R. L.

Whittaker

T. A.

(2006). Scale development research: A content analysis and recommendations for best practices. The Counseling Psychologist, 34(6), 806–838. https://doi.org/10.1177/0011000006288127

41.

Zullig

K. J.

Koopman

T. M.

Patton

J. M.

Ubbes

V. A.

(2010). School climate: Historical review, instrument development, and school assessment. Journal of Psychoeducational Assessment, 28, 139–152. https://doi.org/10.1177/0734282909344205

42.

Zwick

W. R.

Velicer

W. F.

(1986). Comparison of five rules for determining the number of components to retain. Psychological Bulletin, 99(3), 432–442. https://doi.org/10.1037/0033-2909.99.3.432

Advancing School Climate Assessment: A Psychometrically Sound,Time-Efficient Survey for Intervention Frameworks

Abstract

Keywords

Get full access to this article

References