Examining an Integrated Factor Structure of Schoolwide MTSS Implementation Measures

Abstract

Multitiered systems of support (MTSS) are composed of tiered prevention and intervention in multiple domains. MTSS is often referred to as an umbrella framework that includes both a multi-tiered approach to proactive school-wide behavior (e.g., Schoolwide Positive Behavior Interventions and Supports) and academic supports in reading, writing, and/or mathematics (e.g., Response to Intervention). Integrating behavior and academic support systems can become complex, requiring significant coordination and implementation efforts within schools. However, efforts to measure implementation and study how such implementation across behavioral and academic domains relates are limited. In the current study, we used MTSS implementation data from 225 schools in a U.S. Midwestern state to examine a factor structure of schoolwide MTSS implementation measures in behavioral and academic domains (reading and mathematics). Results suggest (a) a hierarchical factor model for behavioral and academic MTSS measures fits well, indicating that integrated behavioral and academic supports are driven by an overall implementation factor, and (b) the overall factor had no relation to school-level achievement. Implications for practice and future directions for research are discussed.

Keywords

positive behavior supports assessment school-wide interventions systems

Get full access to this article

View all access options for this article.

References

Algozzine

Barrett

Eber

George

Horner

Lewis

Putnam

Swain-Bradway

McIntosh

Sugai

(2014). School-wide PBIS Tiered Fidelity Inventory. OSEP Technical Assistance Center on Positive Behavioral Interventions and Supports. https://www.pbis.org

American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (2014). Standards for educational and psychological testing. American Educational Research Association. https://www.testingstandards.net/uploads/7/6/6/4/76643089/standards_2014edition.pdf

Bruhn

A. L.

Hirsch

S. E.

Lloyd

J. W.

(2015). Treatment integrity in school-wide programs: A review of the literature (1993–2012). The Journal of Primary Prevention, 36(5), 335–349. https://doi.org/10.1007/s10935-015-0400-9

Charlton

C. T.

Sabey

C. V.

Dawson

M. R.

Pyle

Lund

E. M.

Ross

S. W.

(2018). Critical incidents in the scale-up of state multitiered systems of supports. Journal of Positive Behavior Interventions, 20(4), 191–202. https://doi.org/10.1177%2F1098300718770804

Clarke

Baker

S. K.

Smolkowski

Doabler

Cary

M. S.

Fien

(2015). Investigating the efficacy of a core kindergarten mathematics curriculum to improve student mathematics learning outcomes. Journal of Research on Educational Effectiveness, 8, 303–324. https://doi.org/10.1080/19345747.2014.980021

Garbacz

S. A.

Santiago

R. T.

Gulbrandson

(2022). Examining implementation of positive behavioral interventions and supports in rural schools. Rural Special Education Quarterly, 41(2), 95–107. https://doi.org/10.1177/87568705221097117

Gettinger

Kratochwill

T. R.

Eubanks

Foy

Levin

J. R.

(2021). Academic and behavior combined support: Evaluation of an integrated supplemental intervention for early elementary students. Journal of School Psychology, 89, 1–19. https://doi.org/10.1016/j.jsp.2021.09.004

Herman

K. C.

Reinke

W. M.

Dong

Bradshaw

C. P.

(2022). Can effective classroom behavior management increase student achievement in middle school? Findings from a group randomized trial. Journal of Educational Psychology, 114(1), 144–160. http://doi.org/10.1037/edu0000641

Bentler

P. M.

(1998). Fit indices in covariance structure modeling: Sensitivity to underparameterized model misspecification. Psychological Methods, 3(4), 424–453. https://doi.org/10.1037/1082-989X.3.4.42

10.

Kame’enui

E. J.

Simmons

D. C.

(2002). Planning and evaluation tool for effective schoolwide reading programs–Revised (PET-R). Institute for the Development of Educational Achievement.

11.

Kincaid

Childs

George

(2010). School-wide Benchmarks of Quality [Revised]. https://www.pbis.org/resource/boq

12.

Markon

K. E.

(2019). Bifactor and hierarchical models: Specification, inference, and interpretation. Annual Review of Clinical Psychology, 15, 51–69. https://doi.org/10.1146/annurev-clinpsy-050718-095522

13.

Maul

(2013). Method effects and the meaning of measurement. Frontiers in Psychology, 4, Article 169. https://doi.org/10.3389/fpsyg.2013.00169

14.

McIntosh

Goodman

(2016). Integrated multi-tiered systems of support: Blending RTI and PBIS. Guilford Press.

15.

McIntosh

Massar

M. M.

Algozzine

R. F.

George

H. P.

Horner

R. H.

Lewis

T. J.

Swain-Bradway

(2017). Technical adequacy of the SWPBIS Tiered Fidelity Inventory. Journal of Positive Behavior Interventions, 19(1), 3–13. https://doi.org/10.1177/1098300716637193

16.

McNeish

Wolf

M. G.

(2021). Dynamic fit index cutoffs for confirmatory factor analysis models. Psychological Methods, 28(1), 61–88. https://doi.org/10.1037/met0000425

17.

Mellard

McKnight

Jordan

(2010). RTI tier structures and instructional intensity. Learning Disabilities Research & Practice, 25(4), 217–225. https://doi.org/10.1111/j.1540-5826.2010.00319.x

18.

R Core Team. (2022). R: A language and environment for statistical computing. R Foundation for Statistical Computing. https://www.R-project.org/

19.

Rosseel

(2012). lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48(2), 1–36. https://doi.org/10.18637/jss.v048.i02

20.

St. Martin

K. A.

Huth

Harms

. (2015). Reading Tiered Fidelity Inventory Comprehensive Edition. Michigan’s Integrated Behavior and Learning Support Initiative, Michigan Department of Education.

21.

Scott

T. M.

Gage

N. A.

Hirn

R. G.

Lingo

A. S.

Burt

(2019). An examination of the association between MTSS implementation fidelity measures and student outcomes. Preventing School Failure: Alternative Education for Children and Youth, 63(4), 308–316. https://doi.org/10.1080/1045988X.2019.1605971

22.

Scott

T. M.

Lingo

A. S.

Hirn

R. G.

(2013). The Academic and Behavior Response to Intervention School Assessment (ASA). Center for Instructional and Behavioral Interventions in Schools, University of Louisville.

23.

Sugai

Horner

R. H.

(2009). Responsiveness-to-intervention and school-wide positive behavior supports: Integration of multi-tiered system approaches. Exceptionality, 17(4), 223–237. https://doi.org/10.1080/09362830903235375

24.

Sugai

Lewis-Palmer

Todd

Horner

R. H.

(2005). School-wide evaluation tool. Educational and Community Supports. https://www.pbis.org/resource/school-wide-evaluation-tool-set

25.

U.S. Department of Education, Institute of Education Sciences, & National Center for Education Statistics (n.d.). Common core of data: Identification of rural locales. http://nces.ed.gov/surveys/ruraled/definitions.asp

26.

van Dijk

Schatschneider

Al Otaiba

Hart

S. A

. (2023). Student behavior ratings and response to tier 1 reading intervention: Which students do not benefit? Journal of Research on Educational Effectiveness, 17, 491–512. https://doi.org/10.1080/19345747.2023.2194894

27.

Wagenmakers

E.-J.

Farrell

(2004). AIC model selection using Akaike weights. Psychonomic Bulletin & Review, 11, 192–196. https://doi.org/10.3758/bf03206482

28.

Wisconsin RtI Center. (2011). Schoolwide implementation review.

29.

Wisconsin RtI Center. (2019). FAQ: School-wide Implementation Review.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.46 MB