Fidelity of implementation of school practices is crucial to student outcomes. Several types of tools, including self-assessments, are available for measuring fidelity, but little is known regarding the relation of self-assessments of fidelity to fidelity instruments completed with the support of external experts, specifically, during the first few years of implementation. The present study used cross-sectional data from 1,438 schools to examine relations between fidelity self-assessment and team-based fidelity measures in the first 4 years of implementation of School-Wide Positive Behavioral Interventions and Supports (SWPBIS). Results showed strong positive correlations between fidelity self-assessments and a team-based measure of fidelity at each year of implementation.
BradshawC. P.DebnamK.KothC. W.LeafP. J. (2009). Preliminary validation of the Implementation Phases Inventory for assessing fidelity of schoolwide positive behavior supports. Journal of Positive Behavior Interventions, 11, 145–160.
2.
BradshawC. P.ReinkeW. M.BevansK. B.BrownL. D.LeafP. J. (2009). Implementation of Positive Behavioral Interventions and Supports (PBIS) in elementary schools: Observations from a randomized trial. Education and Treatment of Children, 31, 1–26.
3.
CohenJ. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum.
4.
CohenR.KincaidD.ChildsK. E. (2007). Measuring school-wide positive behavior support implementation: Development and validation of the Benchmarks of Quality. Journal of Positive Behavior Interventions, 9, 203–213.
5.
DomitrovichC. E.BradshawC. P.PoduskaJ. M.HoagwoodK.BuckleyJ. A.OlinS.. . . IalongoN. S. (2008). Maximizing the implementation quality of evidence-based preventive interventions in schools: A conceptual framework. Advances in School Mental Health Promotion, 1, 6–28.
6.
FiskeK. (2008). Treatment integrity of school-based behavior analytic interventions: A review of the research. Behavior Analysis in Practice, 1, 19–25.
7.
FixsenD. L.NaoomS. F.BlaseK. A.FriedmanR. M.WallaceF. (2005). Implementation research: Synthesis of the literature (FMHI Publication #231). Tampa: University of South Florida, Louis de la Parte Florida Mental Health Institute, The National Implementation Research Network.
8.
FlanneryK. B.FenningP.KatoM. M.McIntoshK. (2014). Effects of school-wide positive behavioral interventions and supports and fidelity of implementation on problem behavior in high schools. School Psychology Quarterly, 29, 111–124. doi:10.1037/spq0000039
9.
GreshamF. M. (1989). Assessment of treatment integrity in school consultation and prereferral intervention. School Psychology Review, 18, 37–50.
10.
Hagan-BurkeS.BurkeM. D.MartinE.BoonR. T.ForeC.III.KirkendollD. (2005). The internal consistency of the school-wide subscales of the effective behavioral support survey. Education & Treatment of Children, 28, 400–413.
11.
HornerR. H.SugaiG.Lewis-PalmerT. L. (2005). School-wide Positive Behavior Support evaluation template. Eugene, OR: Educational and Community Supports.
12.
HornerR. H.ToddA. W.Lewis-PalmerT.IrvinL. K.SugaiG.BolandJ. B. (2004). The School-Wide Evaluation Tool (SET): A research instrument for assessing school-wide positive behavior support. Journal of Positive Behavior Interventions, 6, 3–12.
13.
KincaidD.ChildsK.GeorgeH. P. (2005). Schoolwide benchmarks of quality. Unpublished instrument, University of South Florida, Tampa.
14.
KozialS.BurnsP. (1986). Teachers’ accuracy in self-reporting about instructional practices using a focused self-report inventory. The Journal of Educational Research, 79, 205–209.
15.
LewisT. J.McIntoshK.SimonsenB.MitchellB. S.HattonH. L. (2017). School-wide systems of positive behavior support: Implications for students at-risk and with emotional/behavioral disorders. AERA Open, 3(2), 1–11.
16.
LillejojC. J.GriffinK. W.SpothR. (2004). Program provider and observer ratings of school-based preventive intervention implementation: Agreement and relation to youth outcomes. Health Education & Behavior, 31, 242–257.
17.
MathewsS.McIntoshK.FrankJ. L.MayS. L. (2013). Critical features predicting sustained implementation of school-wide positive behavior support. Journal of Positive Behavior Interventions, 16, 168–178.
18.
McIntoshK.MartinezR. S.TyS. V.McClainM. B. (2013). Scientific research in school psychology: Leading researchers weigh in on its past, present, and future. Journal of School Psychology, 51, 267–318. doi:10.1016/j.jsp.2013.04.003
19.
McIntoshK.MercerS. H.HumeA. E.FrankJ. L.TurriM. G.MathewsS. (2013). Factors related to sustained implementation of schoolwide positive behavior support. Exceptional Children, 79, 293–311.
20.
McIntoshK.MercerS. H.NeseR. N. T.GhemraouiA. (2016). Patterns of implementation of a scaled-up school-based prevention model over a five-year period. Prevention Science, 17, 992–1001.
21.
McIntoshK.MercerS.NeseR.Strickland-CohenK.KittelmanA.HoseltonR.HornerR., (2018). Factors predicting sustained implementation of a universal behavior support framework. Educational Researcher, 47, 307–316.
22.
NeseR. N. T.McIntoshK.NeseJ. F. T.BloomJ.JohnsonN. W.PhillipsD.. . . HoseltonR. (2016). Predicting abandonment of school-wide behavior interventions. Behavioral Disorders, 42, 261–270.
23.
NoellG. H. (2007). Research examining the relationships among consultation process, treatment integrity, and outcomes. In ErchulW. P.SheridanS. M. (Eds.), Handbook of research in school consultation: Empirical foundations for the field (pp. 315-334). Mahwah, NJ: Lawrence Erlbaum.
24.
NoellG. H.GreshamF. M.GansleK. A. (2002). Does treatment integrity matter? A preliminary investigation of instructional implementation and mathematics performance. Journal of Behavioral Education, 11, 51–67.
25.
NoellG. H.VolzJ. R.HendersonM. Y.WilliamsK. L. (2017). Evaluating an integrated support model for increasing treatment plan implementation following consultation in schools. School Psychology Quarterly, 32, 525–538.
26.
NoellG. H.WittJ. C.SliderN. J.ConnellJ. E.GattiS. L.WilliamsK. L.. . . DuhonG. J. (2005). Treatment implementation following behavioral consultation in schools: A comparison of three follow-up strategies. School Psychology Review, 34, 87–106.
27.
SafranS. P. (2006). Using the Effective Behavior Supports Survey to guide development of schoolwide positive behavior support. Journal of Positive Behavior Interventions, 8, 3–9.
28.
SanettiL. M.KratochwillT. R. (2008). Treatment integrity in behavioral consultation: Measurement, promotion, and outcomes. International Journal of Behavioral Consultation and Therapy, 4, 95–114.
29.
SchoenwaldS.GarlandA.ChapmanJ.FrazierS.SHeidowA.Southam-GerowM. (2011). Toward the effective and efficient measurement of implementation fidelity. Administration and Policy in Mental Health, 38, 32–43.
30.
SheridanS. M.Swanger-GagneM.WelchG. W.KwonK.GarbaczS. A. (2009). Fidelity measurement in consultation: Psychometric issues and preliminary examination. School Psychology Review, 38, 476–495.
31.
SpragueJ. R.BiglanA.RusbyJ. C.GauJ. M.VincentC. G. (2017). Implementing school wide PBIS in middle schools: Results of a randomized trial. Journal of Health Science & Education, 1(2), 1–10.
32.
StormontM.ReinkeW. M. (2012). Using coaching to support behavioral interventions and support systems. Beyond Behavior, 21(2), 11–19.
33.
SugaiG.HornerR. H. (2009). Defining and describing schoolwide positive behavior support. In SailorW.DunlapG.SugaiG.HornerR. H. (Eds.), Handbook of positive behavior support (pp. 307–326). New York, NY: Springer.
34.
SugaiG.HornerR. H.Lewis-PalmerT. L. (2001). Team Implementation Checklist (TIC). Eugene, OR: Educational and Community Supports. Available from http://www.pbis.org
35.
SugaiG.HornerR. H.ToddA. W. (2000). PBIS Self-Assessment Survey 2.0. Eugene, OR: Educational and Community Supports. Available from http://www.pbisapps.org
36.
University of Oregon. (2014). Dataset 0055 [Database and codebook]. Eugene: Author.
37.
VincentC. G.SpauldingS. A.TobinT. J. (2010). A reexamination of the psychometric properties of the School-Wide Evaluation Tool (SET). Journal of Positive Behavior Interventions, 12, 161–179.
