Implementation of evidence-based practice (EBP) for autism spectrum disorder (ASD) in the education system is a public health priority. Leadership is a critical driver of EBP implementation but little is known about the types of leadership behaviors exhibited by school leaders and how this influences the context of EBP implementation, particularly for students with ASD. The objectives of this study were to determine (1) the leadership profiles of principals involved in EBP implementation for students with ASD and (2) how these leadership profiles related to school characteristics and implementation climate. The Exploration, Preparation, Implementation, Sustainment (EPIS) framework was used to guide the design and analysis of this study. Participants (n = 296) included principals, teachers, and classroom support staff. They provided demographic information and completed the Multifactor Leadership Questionnaire and Implementation Climate Scale. Using latent profile analysis, a three-pattern solution was identified: Disengaged (6% of sample), Undifferentiated (23% of sample), and Optimal (71% of sample). Principals in schools with higher proportions of students with an individualized education program were more likely to be classified as Undifferentiated than Optimal. The Optimal group was associated with more positive implementation climate than the Undifferentiated or Disengaged groups. Findings suggest that leadership behaviors rated by principals and their staff involved in implementation of common autism EBPs can be meaningfully clustered into three discernible profiles that are shaped by organizational context and linked to strategic implementation climate. Our study findings have implications for leadership training and service delivery in schools by underscoring the critical nature of school leadership during implementation of EBPs for children with autism and the interplay between specific leadership behaviors and strategic implementation climate.
AaronsG. A.CafriG.LugoL.SawitzkyA. (2012). Expanding the domains of attitudes towards evidence-based practice: The Evidence-Based Practice Attitude Scale-50. Administration and Policy in Mental Health and Mental Health Services Research, 39, 331–340. doi:10.1007/s10488-010-0302-3
2.
AaronsG. A.EhrhartM. G.FarahnakL. R.HurlburtM. S. (2015). Leadership and organizational change for implementation (LOCI): A randomized mixed method pilot study of a leadership and organization development intervention for evidence-based practice implementation. Implementation Science, 10(1), 11. doi:10.1186/s13012-014-0192-y
3.
AaronsG. A.EhrhartM. G.FarahnakL. R.SklarM. (2014). Aligning leadership across systems and organizations to develop a strategic climate for evidence-based practice implementation. Annual Review of Public Health, 35, 255–274. doi:10.1146/annurev-publhealth-032013-182447
4.
AaronsG. A.EhrhartM. G.FarahnakL. R.SklarM.HorowitzJ. (2017). Discrepancies in leader and follower ratings of transformational leadership: Relationship with organizational culture in mental health. Administration and Policy in Mental Health and Mental Health Services Research, 44, 480–491. doi:10.1007/s10488-015-0672-7
5.
AaronsG. A.EhrhartM. G.MoullinJ. C.TorresE. M.GreenA. E. (2017). Testing the leadership and organizational change for implementation (LOCI) intervention in substance abuse treatment: A cluster randomized trial study protocol. Implementation Science, 12(1), 29.
6.
AaronsG. A.EhrhartM. G.TorresE. M.FinnN. K.BeidasR. S. (2017). The humble leader: Association of discrepancies in leader and follower ratings of implementation leadership with organizational climate in mental health. Psychiatric Services, 68, 115–122. doi:10.1176/appi.ps.201600062
7.
AaronsG. A.FarahnakL. R.EhrhartM. G. (2014). Leadership and strategic organizational climate to support evidence-based practice implementation. In BeidasR. S.KendallP. C. (Eds.), Dissemination and implementation of evidence-based practices in child and adolescent mental health (pp. 82–97). New York, NY: Guilford Press.
8.
AaronsG. A.GreenA. E.TrottE.WillgingC. E.TorresE. M.EhrhartM. G.RoeschS. C. (2016). The roles of system and organizational leadership in system-wide evidence-based intervention sustainment: A mixed-method study. Administration and Policy in Mental Health and Mental Health Services Research, 43, 991–1008.
9.
AaronsG. A.HurlburtM.HorwitzS. M. (2011). Advancing a conceptual model of evidence-based practice implementation in public service sectors. Administration and Policy in Mental Health and Mental Health Services Research, 38, 4–23. doi:10.1007/s10488-010-0327-7
10.
AaronsG. A.SommerfeldD. H. (2012). Leadership, innovation climate, and attitudes toward evidence-based practice during a statewide implementation. Journal of the American Academy of Child and Adolescent Psychiatry, 51, 423–431. doi:10.1016/j.jaac.2012.01.018
11.
ArickJ. R.LoosL.FalcoR. A.KrugD. A. (2004). The STAR program: Strategies for teaching based on autism research, levels I, II, & III. Austin, TX: Pro-Ed.
12.
ArickJ. R.YoungH. E.FalcoR. A.LoosL. M.KrugD. A.GenseM. H.JohnsonS. B. (2003). Designing an outcome study to monitor the progress of students with autism spectrum disorders. Focus on Autism and Other Developmental Disabilities, 18, 75–87. doi:10.1177/108835760301800201
13.
ArnoldK. A.ConnellyC. E.GellatlyI. R.WalshM. M.WitheyM. J. (2017). Using a pattern-oriented approach to study leaders: Implications for burnout and perceived role demand. Journal of Organizational Behavior, 38, 1038–1056. doi:10.1002/job.2182
14.
AvolioB. J. (1999). Full leadership development: Building the vital forces in organizations. Thousand Oaks, CA: SAGE.
15.
AvolioB. J. (2011). Full Range Leadership Development, Second Edition. Thousand Oaks, CA: SAGE.
16.
BarlingJ.ChristieA.HoptionC. (2011). Leadership. In ZedeckS. (Ed.), APA handbook of industrial and organizational psychology, Vol 1: Building and developing the organization (pp. 183–240). Washington, DC: American Psychological Association.
17.
BassB. M.AvolioB. J. (1995). MLQ: Multifactor Leadership Questionnaire (Technical report). Binghamton, NY: Center for Leadership Studies, Binghamton University.
18.
BassB. M.RiggioR. E. (2006). Transformational leadership. Mahwah, NJ: Psychology Press.
19.
BeidasR. S.EdmundsJ.DittyM.WatkinsJ.WalshL.MarcusS.KendallP. (2014). Are inner context factors related to implementation outcomes in cognitive-behavioral therapy for youth anxiety?Administration and Policy in Mental Health and Mental Health Services Research, 41, 788–799. doi:10.1007/s10488-013-0529-x
20.
BeidasR. S.WilliamsN. J.GreenP. D.AaronsG. A.Becker-HaimesE. M.EvansA. C.. . . MarcusS. C. (2016). Concordance between administrator and clinician ratings of organizational culture and climate. Administration and Policy in Mental Health and Mental Health Services Research, 45, 142–151. doi:10.1007/s10488-016-0776-8
21.
BergmanL. R.LundhL. G. (2015). Introduction: The Person-oriented approach: Roots and roads to the future. Journal for Person-Oriented Research, 1, 1–6.
22.
BittermanA.DaleyT. C.MisraS.CarlsonE.MarkowitzJ. (2008). A national sample of preschoolers with autism spectrum disorders: Special education services and parent satisfaction. Journal of Autism and Developmental Disorders, 38, 1509–1517. doi:10.1007/s10803-007-0531-9
23.
BonhamC. A.SommerfeldD.WillgingC.AaronsG. A. (2014). Organizational factors influencing implementation of evidence-based practices for integrated treatment in behavioral health agencies. Psychiatry Journal, 2014, 802983. doi:10.1155/2014/802983
24.
BowersA. J.BlitzM.ModesteM.SalisburyJ.HalversonR. (2017). How leaders agree with teachers in schools on measures of leadership practice: A two-level latent class analysis of the comprehensive assessment of leadership for learning. Teachers College Record, 119(4), 1–66.
25.
Brookman-FrazeeL.Baker-EriczénM.StahmerA.MandellD.HaineR. A.HoughR. L. (2009). Involvement of youths with autism spectrum disorders or intellectual disabilities in multiple public service systems. Journal of Mental Health Research in Intellectual Disabilities, 2, 201–219. doi:10.1080/19315860902741542
26.
Brookman-FrazeeL.StahmerA. C. (2018). Effectiveness of a multi-level implementation strategy for ASD interventions: Study protocol for two linked cluster randomized trials. Implementation Science, 13(1), 66.
27.
California Autism Professional Training and Information Network. (2017). Welcome. Available from http://www.captain.ca.gov/
28.
CamburnE.RowanB.TaylorJ. E. (2003). Distributed leadership in schools: The case of elementary schools adopting comprehensive school reform models. Educational Evaluation and Policy Analysis, 25, 347–373. doi:10.3102/01623737025004347
29.
ChassonG. S.HarrisG. E.NeelyW. J. (2007). Cost comparison of early intensive behavioral intervention and special education for children with autism. Journal of Child and Family Studies, 16, 401–413. doi:10.1007/s10826-006-9094-1
30.
ChristensenD. L.BaioJ.Van Naarden BraunK.BilderD.CharlesJ.ConstantinoJ. N.. . . Yeargin-AllsoppM. (2014). Prevalence of autism spectrum disorder among children aged 8 years—Autism and developmental disabilities monitoring network, 11 Sites, United States, 2010. Morbidity and Mortality Weekly Report: Surveillance Summaries, 63(2), 1–21. doi:10.15585/mmwr.ss6503a1
31.
CobbC. (2015). Principals play many parts: A review of the research on school principals as special education leaders 2001-2011. International Journal of Inclusive Education, 19, 213–234. doi:10.1080/13603116.2014.916354
32.
DamschroderL. J.AronD. C.KeithR. E.KirshS. R.AlexanderJ. A.LoweryJ. C. (2009). Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implementation Science, 4(50), 1–15. doi:10.1186/1748-5908-4-50
33.
DingfelderH. E.MandellD. S. (2011). Bridging the research-to-practice gap in autism intervention: An application of diffusion of innovation theory. Journal of Autism and Developmental Disorders, 41, 597–609. doi:10.1007/s10803-010-1081-0
34.
DiPaolaM. F.Walther-ThomasC. (2003). Principals and special education: The critical role of school leaders (COPPSE Document No. IB-7). Gainesville: Center on Personnel Studies in Special Education, University of Florida.
35.
DomitrovichC. E.BradshawC. P.PoduskaJ. M.HoagwoodK.BuckleyJ. A.OlinS.. . . IalongoN. S. (2008). Maximizing the implementation quality of evidence-based preventive interventions in schools: A conceptual framework. Advances in School Mental Health Promotion, 1(3), 6–28. doi:10.1080/1754730x.2008.9715730
36.
DoucetO.FredetteM.SimardG.TremblayM. (2015). Leader profiles and their effectiveness on employees’ outcomes. Human Performance, 28, 244–264. doi:10.1080/08959285.2015.1021039
37.
EhrhartM. G.AaronsG. A.FarahnakL. R. (2014). Assessing the organizational context for EBP implementation: The development and validity testing of the Implementation Climate Scale (ICS). Implementation Science, 9(1), 157–168. doi:10.1186/s13012-014-0157-1
FormanS. G.BarakatN. M. (2011). Cognitive-behavioral therapy in the schools: Bringing research to practice through effective implementation. Psychology in the Schools, 48, 283–296. doi:10.1002/pits.20547
40.
FotiR. J.BrayB. C.ThompsonN. J.AllgoodS. F. (2012). Know thy self, know thy leader: Contributions of a pattern-oriented approach to examining leader perceptions. The Leadership Quarterly, 23, 702–717. doi:10.1016/j.leaqua.2012.03.007
41.
FotiR. J.ThompsonN. J.AllgoodS. F. (2011). The pattern-oriented approach: A framework for the experience of work. Industrial and Organizational Psychology, 4, 122–125. doi:10.1111/j.1754-9434.2010.01309.x
42.
GlasgowR. E.VogtT. M.BolesS. M. (1999). Evaluating the public health impact of health promotion interventions: The RE-AIM framework. American Journal of Public Health, 89, 1322–1327. doi:10.2105/ajph.89.9.1322
43.
GurneyJ. G.McPheetersM. L.DavisM. M. (2006). Parental report of health conditions and health care use among children with and without autism: National survey of children’s health. Archives of Pediatrics & Adolescent Medicine, 160, 825–830. doi:10.1001/archpedi.160.8.825
44.
HallingerP. (1992). The evolving role of American principals: From managerial to instructional to transformational leaders. Journal of Educational Administration, 30(3), 35–48. doi:10.1108/09578239210014306
45.
HoagwoodK. E.OlinS. S.HorwitzS.McKayM.CleekA.GleacherA.. . . HoganM. (2014). Scaling up evidence-based practices for children and families in New York State: Toward evidence-based policies on implementation for state mental health systems. Journal of Clinical Child and Adolescent Psychology, 43, 145–157. doi:10.1080/15374416.2013.869749
46.
HowardH. A.LadewP.PollackE. G. (2009). The national autism center’s national standards project: Findings and conclusions. Randolph, MA: National Autism Center.
47.
IovannoneR.DunlapG.HuberH.KincaidD. (2003). Effective educational practices for students with autism spectrum disorders. Focus on Autism and Other Developmental Disabilities, 18, 150–165. doi:10.1177/10883576030180030301
48.
Kang-YiC. D.LockeJ.MarcusS. C.HadleyT. R.MandellD. S. (2016). School-based behavioral health service use and expenditures for children with autism and children with other disorders. Psychiatric Services, 67, 101–106. doi:10.1176/appi.ps.201400505
49.
KleinK. J.ConnA. B.SmithD. B.SorraJ. S. (2001). Is everyone in agreement? An exploration of within-group agreement in employee perceptions of the work environment. Journal of Applied Psychology, 86, 3–16. doi:10.1037//0021-9010.86.1.3
50.
KleinK. J.ConnA. B.SorraJ. S. (2001). Implementing computerized technology: An organizational analysis. Journal of Applied Psychology, 86, 811–824. doi:10.1037/0021 9010.86.5.811
51.
KratzH. E.StahmerA.XieM.MarcusS. C.PellecchiaM.LockeJ.. . . MandellD. S. (2019). The effect of implementation climate on program fidelity and student outcomes in autism support classrooms. Journal of Consulting and Clinical Psychology, 87, 270–281. doi:10.1037/ccp0000368
52.
LeighJ. P.DuJ. (2015). Brief report: Forecasting the economic burden of autism in 2015 and 2025 in the United States. Journal of Autism and Developmental Disorders, 45, 4135–4139.
53.
LeithwoodK.JantziD. (2006). Transformational school leadership for large-scale reform: Effects on students, teachers, and their classroom practices. School Effectiveness and School Improvement, 17, 201–227.
54.
LoY.MendellN.RubinD. (2001). Testing the number of components in a normal mixture. Biometrika, 88, 767–778. doi:10.1093/biomet/88.3.767
55.
LockeJ.BeidasR. S.MarcusS.StahmerA.AaronsG. A.LyonA. R.. . . MandellD. S. (2016). A mixed methods study of individual and organizational factors that affect implementation of interventions for children with autism in public schools. Implementation Science, 11(1), 135. doi:10.1186/s13012-016-0501-8
56.
LockeJ.OlsenA.WidemanR.DowneyM. M.KretzmannM.KasariC.MandellD. S. (2015). A tangled web: The challenges of implementing an evidence-based social engagement intervention for children with autism in urban public school settings. Behavior Therapy, 46, 54–67. doi:10.1016/j.beth.2014.05.001
57.
LockeJ.WolkC. B.HarkerC.OlsenA.ShingledeckerT.BargF.. . . BeidasR. (2017). Pebbles, rocks, and boulders: The implementation of a school-based social engagement intervention for children with autism. Autism, 21, 985–994. doi:10.1177/1362361316664474
58.
LubkeG. H.MuthénB. (2005). Investigating population heterogeneity with factor mixture models. Psychological Methods, 10, 21–39. doi:10.1037/1082-989x.10.1.21
59.
LyonA. R.CookC. R.BrownE. C.LockeJ.DavisC.EhrhartM.AaronsG. A. (2018). Assessing organizational implementation context in the education sector: Confirmatory factor analysis of measures of implementation leadership, climate, and citizenship. Implementation Science, 13(1), 5.
60.
MandellD. S.CaoJ.IttenbachR.Pinto-MartinJ. (2006). Medicaid expenditures for children with autistic spectrum disorders: 1994 to 1999. Journal of Autism and Developmental Disorders, 36, 475–485. doi:10.1007/s10803-006-0088-z
61.
McHughR. K.BarlowD. H. (2010). The dissemination and implementation of evidence-based psychological treatments. A review of current efforts. American Psychologist, 65, 73–84.
62.
MehtaT. G.AtkinsM. S.FrazierS. L. (2013). The organizational health of urban elementary schools: School health and teacher functioning. School Mental Health, 5, 144–154. doi:10.1007/s12310-012-9099-4
63.
MontesG.HaltermanJ. S.MagyarC. I. (2009). Access to and satisfaction with school and community health services for US children with ASD. Pediatrics, 124(Suppl. 4), S407–S413. doi:10.1542/peds.2009-1255L
64.
MorinA. J.MorizotJ.BoudriasJ. S.MadoreI. (2011). A multifoci person-centered perspective on workplace affective commitment: A latent profile/factor mixture analysis. Organizational Research Methods, 14, 58–90. doi:10.1177/1094428109356476
65.
MoullinJ.DicksonK.StadnickN. A.RabinB.AaronsA. A. (2019). Systematic review of the exploration, preparation, implementation sustainment framework. Implementation Science, 14, 1.
66.
MuthénL. K.MuthénB. O. (1998–2017). Mplus user’s guide (8th ed.). Los Angeles, CA: Author.
67.
NakamuraB. J.MuellerC. W.Higa-McMillanC.OkamuraK. H.ChangJ. P.SlavinL.ShimabukuroS. (2014). Engineering youth service system infrastructure: Hawaii’s continued efforts at large-scale implementation through knowledge management strategies. Journal of Clinical Child and Adolescent Psychology, 43, 179–189. doi:10.1080/15374416.2013.812039
NovinsD. K.GreenA. E.LeghaR. K.AaronsG. A. (2013). Dissemination and implementation of evidence-based practices for child and adolescent mental health: A systematic review. Journal of the American Academy of Child and Adolescent Psychiatry, 52, 1009–1025.
70.
NylundK. L.AsparouhovT.MuthénB. (2007). Deciding on the number of classes in latent class analysis and growth mixture modeling. A Monte Carlo simulation study. Structural Equation Modeling: A Multidisciplinary Journal, 14, 535–569. doi:10.1080/10705510701575396
71.
OwensJ.LyonA. R.BrandtN. E.Maisa WarnerM.NadeemE.SpielC.WagnerM. (2014). Implementation science in school mental health: Key constructs and a proposed research agenda. School Mental Health, 6, 99–111.
72.
ProctorE. K.LandsverkJ.AaronsG. A.ChambersD. A.GlissonC.MittmanB. S. (2009). Implementation research in mental health services: An emerging science with conceptual, methodological, and training challenges. Administration and Policy in Mental Health and Mental Health Services Research, 36, 24–34. doi:10.1007/s10488-008-0197-4
73.
StahmerA. C.ReedS.LeeE.ReisingerE. M.ConnellJ. E.MandellD. S. (2015). Training teachers to use evidence-based practices for autism: Examining procedural implementation fidelity. Journal of School Psychology, 52, 181–195. doi:10.1002/pits.21815
74.
StarinA. C.AtkinsM. S.WehrmannK. C.MehtaT.Hesson-McInnisM. S.Marinez-LoraA.MehlingerR. (2014). Moving science into state child and adolescent mental health systems: Illinois’ evidence-informed practice initiative. Journal of Clinical Child and Adolescent Psychology, 43, 169–178. doi:10.1080/15374416.2013.848772
75.
SunJ.LeithwoodK. (2012). Transformational school leadership effects on student achievement. Leadership and Policy in Schools, 11, 418–451.
76.
TrupinE.KernsS. (2015). Introduction to the special issue: Legislation related to children’s evidence-based practice. Administration and Policy in Mental Health and Mental Health Services Research, 44, 1–5. doi:10.1007/s10488-015-0666-5
77.
WeinerB. J.BeldenC. M.BergmireD. M.JohnstonM. (2011). The meaning and measurement of implementation climate. Implementation Science, 6(1), 78–89. doi:10.1186/1748-5908-6-78
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
