Classroom pivotal response teaching (CPRT) is an evidence-based practice (EBP) adapted for classroom use. A recent effectiveness trial of CPRT involved training 98 special education classrooms in Southern California. The Exploration, Planning, Implementation, and Sustainment (EPIS) conceptual framework illustrates the impact of inner- and outer-context factors on implementation outcomes. This article evaluates how teacher factors (including attitudes toward EBP) and organizational factors (implementation climate and district support) influence training outcomes (fidelity of intervention, report of use, sustainment, and satisfaction). Teachers’ ratings of training quality were related to higher fidelity during their follow-up year, β = .34, t(78) = 2.97, p < .004, and rating of intervention ease of use was related to higher daily CPRT use. Teacher ratings on the appeal scale of the attitudes measure were associated with individual sustainment, β = .35, t(55) = 2.76, p < .01. Leader involvement at recruitment meetings, β = .35, t(48) = 2.58, p = .01, and provision of CPRT training space, β = .44, t(48) = 2.73, p < .01, were significantly related to school sustainment. Teachers’ overall attitudes toward the intervention were significantly related to satisfaction with CPRT training, β = .41, t(80) = 3.96, p < .01. This study makes important preliminary contributions to understanding the impact of inner-context implementation determinants of a classroom-based EBP for students with autism spectrum disorder.
Get full access to this article
View all access options for this article.
References
1.
AaronsG. A. (2004). Mental health provider attitudes toward adoption of evidence-based practice: The Evidence-Based Practice Attitude Scale (EBPAS). Mental Health Services Research, 6, 61–74. doi:10.1023/B:MHSR.0000024351.12294.65
2.
AaronsG. A. (2006). Transformational and transactional leadership: Association with attitudes toward evidence-based practice. Psychiatric Services, 57, 1162–1169. doi:10.1176/appi.ps.57.8.1162
3.
AaronsG. A.EhrhartM. G.FarahnakL. R. (2014). The Implementation Leadership Scale (ILS): Development of a brief measure of unit level implementation leadership. Implementation Science, 9, 45. doi:10.1186/1748-5908-9-45
4.
AaronsG. A.EhrhartM. G.FarahnakL. R.HurlburtM. S., (2015). Leadership and organizational change for implementation (LOCI): a randomized mixed method pilot study of a leadership and organization development intervention for evidence-based practice implementation. Implementation Science, 10(1), 11. https://doi.org/10.1186/s13012-014-0192-y
5.
AaronsG. A.GlissonC.HoagwoodK.KelleherK.LandsverkJ.CafriG. (2010). Psychometric properties and US national norms of the Evidence-Based Practice Attitude Scale (EBPAS). Psychological Assessment, 22, 356. doi:10.1037/a0019188
6.
AaronsG. A.HurlburtM.HorwitzS. M. (2011). Advancing a conceptual model of evidence-based practice implementation in public service sectors. Administration and Policy in Mental Health and Mental Health Services Research, 38, 4–23. doi:10.1007/s10488-010-0327-7
7.
AaronsG. A.SommerfeldD. H. (2012). Leadership, innovation climate, and attitudes toward evidence-based practice during a statewide implementation. Journal of the American Academy of Child & Adolescent Psychiatry, 51, 423–431. doi:10.1016/j.jaac.2012.01.018
8.
AllenK. A.BowlesT. V. (2014). Examining the effects of brief training on the attitudes and future use of behavioral methods by teachers. Behavioral Interventions, 29, 62–76. doi:10.1002/bin.1376
9.
BassB. M.AvolioB. J. (1990). The implications of transactional and transformational leadership for individual, team, and organizational development. Research in Organizational Change and Development, 4, 231–272.
10.
BauerM. S.DamschroderL.HagedornH.SmithJ.KilbourneA. M. (2015). An introduction to implementation science for the non-specialist. BMC Psychology, 3, 32. doi:10.1186/s40359-015-0089-9
11.
BeidasR. S.EdmundsJ.DittyM.WatkinsJ.WalshL.MarcusS.KendallP. (2014). Are inner context factors related to implementation outcomes in cognitive-behavioral therapy for youth anxiety?Administration and Policy in Mental Health and Mental Health Services Research, 41, 788–799. doi:10.1007/s10488-013-0529-x
12.
BonS. C.BigbeeA. J. (2011). Special education leadership: Integrating professional and personal codes of ethics to serve the best interests of the child. Journal of School Leadership, 21, 324–359. doi:10.1177/105268461102100302
13.
Brookman-FrazeeL.HaineR. A.GabayanE. N.GarlandA. F. (2008). Predicting frequency of treatment visits in community-based youth psychotherapy. Psychological Services, 5, 126. doi:10.1037/1541-1559.5.2.126
14.
Brookman-FrazeeL.StahmerA. C. (2018). Effectiveness of a multi-level implementation strategy for ASD interventions: Study protocol for two linked cluster randomized trials. Implementation Science, 13, 66. doi:10.1186/s13012-018-0757-2
15.
BuescherA. V.CidavZ.KnappM.MandellD. S. (2014). Costs of autism spectrum disorders in the United Kingdom and the United States. JAMA Pediatrics, 168, 721–728. doi:10.1001/jamapediatrics.2014.210
16.
BurnsM. K.YsseldykeJ. E. (2009). Reported prevalence of evidence-based instructional practices in special education. The Journal of Special Education, 43, 3–11. doi:10.1177/0022466908315563
17.
CasperE. S. (2007). The theory of planned behavior applied to continuing education for mental health professionals. Psychiatric Services, 58, 1324–1329. doi:10.1176/ps.2007.58.10.1324
18.
CicchettiD. V. (1994). Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychological Assessment, 6, 284–290. doi:10.1037/1040-3590.6.4.284
19.
CreswellJ. W.GarrettA. L. (2008). The “movement” of mixed methods research and the role of educators. South African Journal of Education, 28, 321–333. Retrieved from https://www.ajol.info/index.php/saje/article/view/25155
20.
Darling-HammondL.HylerM. E.GardnerM. (2017). Effective teacher professional development. Palo Alto, CA: Learning Policy Institute.
21.
Digest of Education Statistics. (2017). Children 3 to 21 years old served under Individuals with Disabilities Education Act (IDEA), Part B, by type of disability: Selected years, 1976–77 through 2015–16. Retrieved from https://nces.ed.gov/programs/digest/d17/tables/dt17_204.30.asp
22.
DingfelderH. E.MandellD. S. (2011). Bridging the research-to-practice gap in autism intervention: An application of diffusion of innovation theory. Journal of Autism and Developmental Disorders, 41, 597–609. doi:10.1007/s10803-010-1081-0
23.
EcclesM. P.MittmanB. S. (2006). Welcome to Implementation Science. Implementation Science, 1, 1. doi:10.1186/1748-5908-1-1
24.
EhrhartM. G.AaronsG. A.FarhnakL. R. (2014). Assessing the organizational context for EBP implementation: The development and validity testing of the Implementation Climate Scale (ICS). Implementation Science, 9, 157. doi:10.1186/s13012-014-0157-1
25.
GarlandA. F.HaineR. A.Lewczyk-BoxmeyerC. (2007). Determinates of youth and parent satisfaction in usual care psychotherapy. Evaluation and Program Planning, 30, 45–54. doi:10.1016/j.evalprogplan.2006.10.003
26.
GlissonC.HemmelgarnA.GreenP.WilliamsN. (2013). Randomized Trial of the Availability, Responsiveness and Continuity (ARC) Organizational Intervention for Improving Youth Outcomes in Community Mental Health Programs. Journal of the American Academy of Child and Adolescent Psychiatry, 52, 493–500. doi:10.1016/j.jaac.2013.02.005.
27.
GongT.ZimmerliL.HofferH. E. (2013). The effects of transformational leadership and the sense of calling on job burnout among special education teachers. Journal of School Leadership, 23, 969–993. doi:10.1177/105268461302300603
28.
GreenA. E.AlbaneseB. J.ShapiroN. M.AaronsG. A. (2014). The roles of individual and organizational factors in burnout among community-based mental health service providers. Psychological Services, 11, 41–49. doi:10.1037/a0035299
29.
HarnedM. S.DimeffL. A.WoodcockE. A.ContrerasI. (2013). Predicting adoption of exposure therapy in a randomized controlled dissemination trial. Journal of Anxiety Disorders, 27, 754–762. doi:10.1016/j.janxdis.2013.02.006
30.
HedgesL.RhoadsC., (2010). Statistical Power Analysis in Education Research (NCSER 2010-3006). Washington, DC: National Center for Special Education Research, Institute of Education Sciences, U.S. Department of Education.
31.
HenggelerS. W.ChapmanJ. E.RowlandM. D.Halliday-BoykinsC. A.RandallJ.ShackelfordJ.SchoenwaldS. K. (2008). Statewide adoption and initial implementation of contingency management for substance-abusing adolescents. Journal of Consulting and Clinical Psychology, 76, 556–567. doi:10.1037/0022006x.76.4.556
32.
HessK. L.MorrierM. J.HeflinL. J.IveyM. L. (2008). Autism treatment survey: Services received by children with autism spectrum disorders in public school classrooms. Journal of Autism and Developmental Disorders, 38, 961–971. doi:10.1007/s10803-007-0470-
33.
HolmS. (1979). A simple sequentially rejective multiple test procedure. Scandinavian Journal of Statistics, 6, 65–70.
34.
HowardJ. S.SparkmanC. R.CohenH. G.GreenG.StanislawH. (2005). A comparison of intensive behavior analytic and eclectic treatments for young children with autism. Research in Developmental Disabilities, 26, 359–383. doi:10.1016/j.ridd.2004.09.005
KleinK. J.ConnA. B.SmithD. B.SorraJ. S. (2001). Is everyone in agreement? An exploration of within-group agreement in employee perceptions of the work environment. Journal of Applied Psychology, 86, 3–16. doi:10.1037//00021-9010.86.1.3
37.
KoegelR. L.CamarataS.KoegelL. K.Ben-TallA.SmithA., (1998). Increasing speech intelligibility in children with autism. Journal of Autism and Developmental Disorders, 28, 241–251.
38.
KoegelL. K.KoegelR. L.HarrowerJ. K.CarterC. M., (1999). Pivotal response intervention I: Overview of approach. Journal of the Association for Persons With Severe Handicaps, 24, 174–185.
39.
KoegelR. L.KoegelL. K.SurrattA., (1992). Language intervention and disruptive behavior in preschool children with autism. Journal of Autism and Developmental Disorders, 22, 141–153.
40.
KratzH. E.StahmerA.XieM.MarcusS. C.PellecchiaM.LockeJ. . . . MandellD. S. (2019). The effect of implementation climate on program fidelity and student outcomes in autism support classrooms. Journal of Consulting and Clinical Psychology, 87, 270–281. doi:10.1037/ccp0000368
41.
LavelleT. A.WeinsteinM. C.NewhouseJ. P.MunirK.KuhlthauK. A.ProsserL. A. (2014). Economic burden of childhood autism spectrum disorders. Pediatrics, 133, 520–529. doi:10.1542/peds.2013-0763
42.
LockeJ.KratzH.ReisingerE.MandellD. (2014). Implementation of evidence-based practices for children with autism spectrum disorders in public schools. InChild and adolescent therapy: Dissemination and implementation of empirically supported treatments (pp. 261–276). Oxford University Press.
43.
LydonH.HealyO.LeaderG., (2011). A comparison of Video Modeling and Pivotal Response Training to teach pretend play skills to children with Autism Spectrum Disorder. Research in Autism Spectrum Disorders, 5, 872–884. doi:10.1016/j.rasd.2010.10.002.
44.
McCormickJ. A. (2011). Inclusive elementary classroom teacher knowledge of and attitudes toward applied behavior analysis and autism spectrum disorder and their use of applied behavior analysis (Doctoral dissertation). Retrieved from http://search.proquest.com/docview/867839321
45.
MoullinJ. C.DicksonK. S.StadnickN. A.RabinB.AaronsG. A. (2019). Systematic review of the Exploration, Preparation, Implementation, Sustainment (EPIS) framework. Implementation Science, 14, 1. doi:10.1186/s13012-018-0842-6
NovinsD. K.GreenA. E.LeghaR. K.AaronsG. A. (2013). Dissemination and implementation of evidence-based practices for child and adolescent mental health: A systematic review. Journal of the American Academy of Child and Adolescent Psychiatry, 52, 1009–1025. doi:10.1016/j.jaac.2013.07.012
49.
OdomS. L. (2009). The tie that binds: Evidence-based practice, implementation science, and outcomes for children. Topics in Early Childhood Special Education, 29, 53–61. doi:10.1177/0271121408329171
50.
OdomS. L.Collet-KlingenbergL.RogersS. J.HattonD. D. (2010). Evidence-based practices in interventions for children and youth with autism spectrum disorders. Preventing School Failure: Alternative Education for Children and Youth, 54, 275–282. doi:10.1080/10459881003785506
51.
PellecchiaM.ConnellJ. E.BeidasR. S.XieM.MarcusS. C.MandellD. S. (2015). Dismantling the active ingredients of an intervention for children with autism. Journal of Autism and Developmental Disorders, 45, 2917–2927. doi:10.1007/s10803-015-2455-0
52.
PierceK.SchreibmanL., (1995). Increasing complex social behaviors in children with autism: Effects of peer-implemented pivotal response trainingJournal of Applied Behavior Analysis, 28, 285–295.
53.
PowellB. J.McMillenJ. C.ProctorE. K.CarpenterC. R.GriffeyR. T.BungerA. C. . . . YorkJ. L. (2012). A compilation of strategies for implementing clinical innovations in health and mental health. Medical Care Research and Review, 69, 123–157. doi:10.1177/1077558711430690
ProctorE.SilmereH.RaghavanR.HovmandP.AaronsG.BungerA. . . . HensleyM. (2011). Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Administration and Policy in Mental Health and Mental Health Services Research, 38, 65–76. doi:10.1007/s10488-010-0319-7
56.
RedingM. E.ChorpitaB. F.LauA. S.Innes-GombergD. (2014). Providers’ attitudes toward evidence-based practices: Is it just about providers, or do practices matter, too?Administration and Policy in Mental Health and Mental Health Services Research, 41, 767–776. doi:10.1007/s10488-013-0525-1
57.
ReedS. R.StahmerA. C.SuhrheinrichJ.SchreibmanL. (2013). Stimulus overselectivity in typical development: Implications for teaching children with autism. Journal of Autism and Developmental Disorders, 43, 1249–1257. doi:10.1007/s10803-012-1658-x
58.
RiethS. R.StahmerA. C.SuhrheinrichJ.SchreibmanL. (2015). Examination of the prevalence of stimulus overselectivity in children with ASD. Journal of Applied Behavior Analysis, 48, 71–84. doi:10.1002/jaba.165
59.
RiethS. R.StahmerA. C.SuhrheinrichJ.SchreibmanL.KennedyJ.RossB. (2014). Identifying critical elements of treatment: Examining the use of turn taking in autism intervention. Focus on Autism and Other Developmental Disabilities, 29, 168–179. doi:10.1177/1088357613513792
60.
RodlJ. E.BonifayW.CruzR. A.ManchandaS. (2018) A survey of school administrators’ training and support related to evaluating special education teachers. Journal of School Administration Research and Development, 3, 19–31.
61.
ScheuermannB.WebberJ.BoutotE. A.GoodwinM. (2003). Problems with personnel preparation in autism spectrum disorders. Focus on Autism and Other Developmental Disabilities, 18, 197–206. doi:10.1177/10883576030180030801
62.
StahmerA. C., (1995). Teaching symbolic play skills to children with autism using pivotal response training. Journal of Autism and Developmental Disorders, 25, 123–141.
63.
StahmerA.SuhrheinrichJ.ReedS.SchreibmanL.BolducC. (2011). Classroom pivotal response teaching: A guide to effective implementation. New York, NY: Guilford Press.
64.
StahmerA. C.SuhrheinrichJ.RiethS. (2016). A pilot examination of the adapted protocol for classroom pivotal response teaching. Journal of the American Academy of Special Education Professionals, Winter, 119–139.
65.
StahmerA. C.SuhrheinrichJ.SchetterP.McGee HassrickE. (2018). Exploring multi-level system factors facilitating educator training and implementation of evidence-based practices (EBP): A study protocol. Implementation Science, 13, 3. doi:10.1186/s13012-017-0698-1
66.
SuhrheinrichJ. (2011). Training teachers to use pivotal response training with children with autism: Coaching as a critical component. Teacher Education and Special Education, 34, 339–349. doi:10.1177/0888406411406553
67.
SuhrheinrichJ.StahmerA. C.ReedS.SchreibmanL.ReisingerE.MandellD. (2013). Implementation challenges in translating pivotal response training into community settings. Journal of Autism and Developmental Disorders, 43, 2970–2976. doi:10.1007/s10803-013-1826–1827.
68.
SuhrheinrichJ.StahmerA. C.SchreibmanL. (2007). A preliminary assessment of teachers’ implementation of pivotal response training. Journal of Speech and Language Pathology–Applied Behavior Analysis, 2, 1–13. doi:10.1037/h0100202
WeinerB. J.BeldenC. M.BergmireD. M.JohnstonM. (2011). The meaning and measurement of implementation climate. Implementation Science, 6, 78. doi:10.1186/1748-5908-6-78
71.
WilliamsN. J.GlissonC. (2014). Testing a theory of organizational culture, climate and youth outcomes in child welfare systems: A United States national study. Child Abuse and Neglect, 38, 757–767. doi:10.1016/j.chiabu.2013.09.003
72.
WongC.OdomS. L.HumeK. A.CoxA. W.FettigA.KucharczykS.SchultzT. R. (2015). Evidence-based practices for children, youth, and young adults with autism spectrum disorder: A comprehensive review. Journal of Autism and Developmental Disorders, 45, 1951–1966. doi:10.1007/s10803-014-2351-z
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
