Sustained implementation of effective behavior support systems and practices is critical for improving academic and behavior outcomes for students with and without disabilities. Although implementation studies have identified variables facilitating sustained implementation of Tier 1 behavior support systems in schools, little research exists examining Tier 2 and 3 behavior support systems. The purpose of this 5-year prospective study was to identify practice, school, and district variables facilitating sustained implementation of Tiers 2 and 3 behavior support systems in schools. The sample included 646 schools implementing positive behavioral interventions and supports (PBIS) across 23 U.S. states. Using structural equation modeling, we found several key variables to be predictive of sustained implementation (sustained implementation and implementation quality) of Tier 2 (Tiers 1 and 2 fidelity in Year 1 and a general Tiers 2 and 3 sustainability factor) and Tier 3 behavior support systems (Tier 1 and Tier 3 fidelity in Year 1 and a general Tiers 2 and 3 sustainability factor). Implications for how district and school leadership teams can improve sustained implementation of Tiers 2 and 3 behavior support systems are discussed.
AlgozzineR. F.BarrettS.EberL.GeorgeH.HornerR. H.LewisT. J.PutnamR. F.Swain-BradwayJ.McIntoshK.SugaiG. (2014). SWPBIS Tiered Fidelity Inventory. OSEP Technical Assistance Center on Positive Behavioral Interventions and Supports. Available at http://www.pbis.org
BoydR. J.AndersonC. M. (2013). Breaks are better: A tier II social behavior intervention. Journal of Behavioral Education, 22(4), 348–365. https://doi.org/10.1007/s10864-013-9184-2
4.
BradshawC. P.KothC. W.ThorntonL. A.LeafP. J. (2009). Altering school climate through school-wide positive behavioral interventions and supports: Findings from a group-randomized effectiveness trial. Prevention Science, 10, 100–115. https://doi.org/10.1007/s11121-008-0114-9
5.
BradshawC. P.PasE. T.DebnamK. J.JohnsonS. L. (2020). A randomized controlled trial of MTSS-B in high schools: Improving classroom management to prevent EBDs. Remedial and Special Education, 42(1), 44–59. https://doi.org/10.1177/0741932520966727
6.
BradshawC. P.WaasdorpT. E.LeafP. J. (2015). Examining variation in the impact of school-wide positive behavioral interventions and supports: Findings from a randomized controlled effectiveness trial. Journal of Educational Psychology, 107(2), 546–557. https://doi.org/org/10.1037/a0037630.
7.
ChaparroE. A.KittelmanA.McDanielS. C.Peshak GeorgeH.VanLoneJ.SoS. (2022). Examining rural school implementation of positive behavioral supports across tiers. Rural Special Education Quarterly, 41(3), 116–128. https://doi.org/10.1177/87568705221097114
8.
CharltonC. T.MoultonS.SabeyC. V.WestR. (2020). A systematic review of the effects of schoolwide intervention programs on student and teacher perceptions of school climate. Journal of Positive Behavior Interventions, 23(3), 185–200. https://doi.org/10.1177/1098300720940168
9.
CoffeyJ. H.HornerR. H. (2012). The sustainability of schoolwide positive behavior interventions and supports. Exceptional Children, 78(4), 407–422. https://doi.org/10.1177/001440291207800402
10.
CohenR.KincaidD.ChildsK. E. (2007). Measuring school-wide positive behavior support implementation: Development and validation of the Benchmarks of Quality. Journal of Positive Behavior Interventions, 9(4), 203–213. https://doi.org/10.1177/10983007070090040301.
11.
CommonE. A.LaneK. L.PustejovskyJ. E.JohnsonA. H.JohlL. E. (2017). Functional assessment–based interventions for students with or at-risk for high-incidence disabilities: Field testing single-case synthesis methods. Remedial and Special Education, 38(6), 331–352. https://doi.org/10.1177/0741932517693320
12.
DebnamK. J.PasE. T.BradshawC. P. (2012). Secondary and tertiary support systems in schools implementing school-wide positive behavioral interventions and supports: A preliminary descriptive analysis. Journal of Positive Behavior Interventions, 14(3), 142–152. https://doi.org/10.1177/1098300712436844.
13.
EndersC. K. (2010). Applied missing data analysis. Guilford Press.
14.
FienH.NelsonN. J.SmolkowskiK.KostyD.PilgerM.BakerS. K.SmithJ. L. M. (2020). A conceptual replication study of the enhanced core reading instruction MTSS-reading model. Exceptional Children, 87(3), 265–288. https://doi.org/10.1177/0014402920953763
15.
FlanneryK. B.KatoM. M.KittelmanA.McIntoshK.TriplettD. (2020). A Tier 1 intervention to increase ninth grade engagement and success: Results from a randomized controlled trial. School Psychology, 1(35), 88–98. https://doi.org/10.1037/spq0000347
16.
HarnB. A.ParisiD.StoolmillerM. (2013). Balancing fidelity with flexibility and fit: What do we really know about fidelity of implementation in schools?Exceptional Children, 79(3), 181–193. https://doi.org/10.1177/0014402913079002051
17.
HawkenL. S.CroneD. A.BundockK.HornerR. H. (2021). Responding to problem behavior in schools: The Check-In, Check-Out intervention (3rd ed.). The Guilford Press.
18.
HornerR. H.KittelmanA. (2021). Advancing the large-scale implementation of applied behavior analysis. Behavior and Social Issues, 30(1), 94–105. https://doi.org/10.1007/s42822-021-00049-z
19.
HuL.BentlerP. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1–55. https://doi.org/10.1080/10705519909540118
20.
KimJ.McIntoshK.HoseltonR. (2014). Do schools with adequate Tier I SWPBIS implementation have stronger implementation at Tiers II and III? OSEP Technical Assistance Center on Positive Behavioral Interventions and Supports. Available at: https://www.pbis.org
KittelmanA.EliasonB.DickeyC. R.McIntoshK. (2018). How are schools using the SWPBIS Tiered Fidelity Inventory (TFI)? OSEP Technical Assistance Center on Positive Behavioral Interventions and Supports. Available at: https://www.pbis.org
23.
KittelmanA.MercerS. H.McIntoshK.HoseltonR. (2022). Optimal timing for launching installation of Tier 2 and 3 systems of school-wide positive behavioral interventions and supports. Journal of Positive Behavior Interventions, 24(3), 171–182. https://doi.org/10.1177/1098300721996084
24.
KittelmanA.MercerS. H.McIntoshK.MorrisK. R.HattonH. L. (2023). Validation of a measure of district systems implementation of positive behavioral interventions and supports. Remedial and Special Education, 44(4), 259–271. https://doi.org/10.1177/07419325221114472.
25.
KittelmanA.MercerS. H.McIntoshK.NeseR. N. T. (2021). Development and validation of a measure assessing sustainability of Tier 2 and 3 behavior support systems. Journal of School Psychology, 85, 140–154. https://doi.org/10.1016/j.jsp.2021.02.001
26.
LaneK. L.KalbergJ. R.ShepcaroJ. C. (2009). An examination of the evidence base for function-based interventions for students with emotional and/or behavioral disorders attending middle and high schools. Exceptional Children, 75(3), 321–340. https://doi.org/10.1177/001440290907500304.
27.
LomanS. L.RodriguezB. J.HornerR. H. (2010). Sustainability of a targeted intervention package: First Step to Success in Oregon. Journal of Emotional and Behavioral Disorders, 18(3), 178–191. https://doi.org/10.1177/1063426610362899
28.
MassarM.McIntoshK.MercerS. H.HoseltonR. (2017). Factor analysis of a fidelity of implementation measure for social behavior systems. Remedial and Special Education, 40(1), 16–24. https://doi.org/10.1177/0741932517736515
29.
MathewsS. (2011). The role of school personnel perceptions in predicting sustained implementation of school-wide positive behavior support [Unpublished master’s thesis]. University of British Columbia.
30.
MathewsS.McIntoshK.FrankJ. L.MayS. L. (2014). Critical features predicting sustained implementation of school-wide positive behavior support. Journal of Positive Behavior Interventions, 16(3), 168–178. https://doi.org/10.1177/1098300713484065
31.
McDanielS. C.CohenD.BruhnA. L. (2022). Evaluating school-level student outcomes of a systematic Tier 2 framework. Behavioral Disorders, 47(3), 176–186. https://doi.org/10.1177/01987429211009156
32.
McIntoshK.GirvanE. J.Fairbanks FalconS.McDanielS. C.SmolkowskiK.BastableE.Santiago-RosarioM. R.IzzardS.AustinS. C.NeseR. N. T.BaldyT. S. (2021). Equity-focused PBIS approach reduces racial inequities in school discipline: A randomized controlled trial. School Psychology, 36(6), 433–444. https://doi.org/10.1037/spq0000466
33.
McIntoshK.GoodmanS. (2016). Integrated multi-tiered systems of support: Blending RTI and PBIS. Guilford Press.
34.
McIntoshK.HornerR. H.SugaiG. (2009). Sustainability of systems-level evidence-based practices in schools: Current knowledge and future directions. In SailorW.DunlapG.SugaiG.HornerR. H. (Eds.), Handbook of positive behavior support (pp. 327–352). Springer.
35.
McIntoshK.MassarM. M.AlgozzineR. F.GeorgeH. P.HornerR. H.LewisT. J.Swain-BradwayJ. (2017). Technical adequacy of the SWPBIS tiered fidelity inventory. Journal of Positive Behavior Interventions, 19(1), 3–13. https://doi.org/10.1177/1098300716637193
36.
McIntoshK.MercerS. H.HumeA. E.FrankJ. L.TurriM. G.MathewsS. (2013). Factors related to sustained implementation of schoolwide positive behavior support. Exceptional Children, 79(3), 293–311.
37.
McIntoshK.MercerS. H.NeseR. N. T.Strickland-CohenM. K.KittelmanA.HoseltonR.HornerR. H. (2018). Factors predicting sustained implementation of a universal behavior support framework. Educational Researcher, 47(5), 307–316. https://doi.org/10.3102/0013189X18776975
38.
MercerS. H.McIntoshK.HoseltonR. (2017). Comparability of fidelity measures for assessing Tier 1 school-wide positive behavioral interventions and supports. Journal of Positive Behavior Interventions, 19(4), 195–204. https://doi.org/10.1177/1098300717693384.
NeseR. N. T.KittelmanA.Strickland-CohenM. K.McIntoshK. (2023). Examining teaming and Tier 2 and 3 practices within a PBIS framework. Journal of Positive Behavior Interventions, 25(1), 16–27. https://doi.org/10.1177/10983007211051090
41.
PlonskyL.GhanbarH. (2018). Multiple regression in L2 research: A methodological synthesis and guide to interpreting R2 values. Modern Language Journal, 102(4), 713–731. https://doi.org/10.1111/modl.12509
42.
RobertsonR. E.KokinaA. A.MooreD. W. (2020). Barriers to implementing behavior intervention plans: Results of a statewide survey. Journal of Positive Behavior Interventions, 22(3), 145–155. https://doi.org/10.1177/1098300720908013
43.
SchaperA.McIntoshK.HoseltonR. (2016). Within-year fidelity growth of SWPBIS during installation and initial implementation. School Psychology Quarterly, 31(3), 358–368. https://doi.org/10.1037/spq0000125
44.
WalkerV. L.ChungY.-C.BonnetL. K. (2018). Function-based intervention in inclusive school settings: A meta-analysis. Journal of Positive Behavior Interventions, 20(4), 203–216. https://doi.org/10.1177/1098300717718350
45.
WeistM. D.EberL.HornerR. H.SplettJ.PutnamB.BarrettS.PeralesK.FairchildA. J.HooverS. (2018). Improving multitiered systems of support for students with “internalizing” emotional/behavioral problems. Journal of Positive Behavior Interventions, 20(3), 172–184. https://doi.org/10.1177/1098300717753832
46.
WolfeK.PyleD.CharltonC. T.SabeyC. V.LundE. M.RossS. W. (2016). A systematic review of the empirical support for Check-In Check-Out. Journal of Positive Behavior Interventions, 18(2), 74–88. https://doi.org/10.1177/1098300715595957
47.
WoodbridgeM. W.SumiW. C.YuJ.RouspilK.JavitzH. S.SeeleyJ. R.WalkerH. M. (2014). Implementation and sustainability of an evidence-based program: Lessons learned from the PRISM applied to First Step to Success. Journal of Emotional and Behavioral Disorders, 22(2), 95–106. https://doi.org/10.1177/1063426613520456
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
