The effectiveness of training community mental health therapists in an evidence-based intervention for ASD: Findings from a hybrid effectiveness-implementation trial in outpatient and school-based mental health services

Abstract

An Individualized Mental Health Intervention for ASD (AIM HI) was developed in collaboration with community stakeholders for delivery in mental health services in response to therapist- and caregiver-identified need to improve services for children with autism spectrum disorder (ASD). Primary findings from a cluster randomized Hybrid Type 1 effectiveness-implementation trial conducted in publicly funded mental health programs demonstrated the effectiveness of AIM HI therapist training on child and caregiver outcomes. This study examined therapist outcomes and therapist experience as a moderator of training effects. Mental health programs were randomized to immediate AIM HI training or usual care. Therapists and child/caregiver clients were recruited from participating programs. Therapists in the AIM HI training condition received consultation for 6 months while delivering AIM HI. Differences between training conditions were examined using multilevel modeling. Therapists receiving AIM HI training were observed to use more extensive active teaching strategies with caregivers, engagement strategies with children, strategies promoting continuity of care, and had more structured sessions with more extensively pursued skill building. Therapist licensure moderated some training outcomes. The current study provides support for evidence-based practice implementation in usual care mental health services.

Lay abstract

Publicly funded mental health services play an important role in caring for school-age children with autism spectrum disorder (ASD); however, therapists report a lack of specialized ASD training, which families identity as a barrier in obtaining mental health services for their children. An Individualized Mental Health Intervention for ASD (AIM HI) was developed in collaboration with community stakeholders to respond to identified needs of children and community therapists. The current study examined the effects of therapist training in AIM HI on the changes in therapist practice, including therapists’ use of evidence-based intervention strategies in session. Data were collected from a study conducted in community outpatient and school based mental health programs randomly assigned to receive AIM HI therapist training or observation of routine care. Therapist and child clients were enrolled from participating programs. Therapists in AIM HI training received training and consultation for 6 months while delivering the AIM HI intervention to a participating client; therapists in usual care delivered routine care. Both groups of therapists video recorded psychotherapy sessions which were scored by trained raters. Differences between training groups were examined using multilevel modeling. Therapists trained in AIM HI were observed to use more extensive active teaching strategies with caregivers, engagement strategies with children, strategies promoting continuity of care, and had more structured sessions with more effective pursuit of caregiver and children skill teaching. Therapist licensure moderated some training outcomes.

Keywords

autism spectrum disorder children’s mental health services community effectiveness trial EBI strategy delivery therapist training

Get full access to this article

View all access options for this article.

References

Alexander

J. L.

Ayres

K. M.

Smith

K. A.

(2015). Training teachers in evidence-based practice for individuals with autism spectrum disorder: A review of the literature. Teacher Education and Special Education, 38(1), 13–27. https://doi.org/10.1177/0888406414544551

Bearss

Johnson

Smith

Lecavalier

Swiezy

Aman

. . .Scahill

(2015). Effect of parent training vs parent education on behavioral problems in children with autism spectrum disorder: A randomized clinical trial. Journal of the American Medical Association, 313(15), 1524–1533. https://doi.org/10.1001/jama.2015.3150

Beidas

R. S.

Kendall

P. C.

(2010). Training therapists in evidence-based practice: A critical review of studies from a systems-contextual perspective. Clinical Psychology: Science and Practice, 17(1), 1–30. https://doi.org/10.1111/j.1468-2850.2009.01187.x

Brookman-Frazee

L. I.

Baker-Ericzén

Stadnick

Taylor

(2012). Parent perspectives on community mental health services for children with autism spectrum disorders. Journal of Child and Family Studies, 21(4), 533–544. https://doi.org/10.1007/s10826-011-9506-8

Brookman-Frazee

L. I.

Chlebowski

(2013). An Individualized Mental Health Intervention for ASD (AIM HI) observational coding system manual. University of California, San Diego.

Brookman-Frazee

L. I.

Chlebowski

Villodas

Roesch

Martinez

(2021). Training community therapists to deliver an individualized mental health intervention for autism spectrum disorder: Changes in caregiver outcomes and mediating role on child outcomes. Journal of the American Academy of Child & Adolescent Psychiatry, 60(3), 355–366. https://doi.org/10.1016/j.jaac.2020.07.896

Brookman-Frazee

L. I.

Drahota

(2010). An Individualized Mental Health Intervention for children with autism spectrum disorders (AIM HI): A model to address challenging behaviors in children with ASD—A therapist manual. University of California, San Diego.

Brookman-Frazee

L. I.

Drahota

Stadnick

Palinkas

L. A.

(2012). Therapist perspectives on community mental health services for children with autism spectrum disorders. Administration and Policy in Mental Health and Mental Health Services Research, 39(5), 365–373. https://doi.org/10.1007/s10488-011-0355-y

Brookman-Frazee

L. I.

Roesch

Chlebowski

Baker-Ericzen

Ganger

(2019). Effectiveness of training therapists to deliver an individualized mental health intervention for children with ASD in publicly funded mental health services: A cluster randomized clinical trial. JAMA Psychiatry, 76(6), 574–583. https://doi.org/10.1001/jamapsychiatry.2019.0011

10.

Brookman-Frazee

L. I.

Stadnick

Chlebowski

Baker-Ericzén

Ganger

(2018). Characterizing psychiatric comorbidity in children with autism spectrum disorder receiving publicly funded mental health services. Autism, 22(8), 938–952. https://doi.org/10.1177/1362361317712650

11.

Brookman-Frazee

L. I.

Taylor

Garland

A. F.

(2010). Characterizing community-based mental health services for children with autism spectrum disorders and disruptive behavior problems. Journal of Autism and Developmental Disorders, 40(10), 1188–1201. https://doi.org/10.1007/s10803-010-0976-0

12.

Chiri

Warfield

M. E.

(2012). Unmet need and problems accessing core health care services for children with autism spectrum disorder. Maternal Child Health Journal, 16, 1081–1091. https://doi.org/10.1007/s10995-011-0833-6

13.

Constantino

J. N.

Gruber

C. P.

(2012). Social Responsiveness Scale, Second Edition (SRS-2). Western Psychological Services.

14.

Curran

G. M.

Bauer

Mittman

Pyne

J. M.

Stetler

(2012). Effectiveness implementation hybrid designs: Combining elements of clinical effectiveness and implementation research to enhance public health impact. Medical Care, 50, 217–226. https://doi.org/10.1097/mlr.0b013e3182408812

15.

de Bruin

E. I.

Ferdinand

R. F.

Meester

de Nijs

P. F.

Verheij

(2007). High rates of psychiatric co-morbidity in PDD-NOS. Journal of Autism and Developmental Disorders, 37(5), 877–886. https://doi.org/10.1007/s10803-006-0215-x

16.

Enders

C. K.

(2010). Applied missing data analysis. Guilford Press.

17.

Eyberg

S. M.

Pincus

(1999). ECBI & SESBI-R: Eyberg child behavior inventory and Sutter-Eyberg student behavior inventory-revised: Professional manual. Psychological Assessment Resources.

18.

Frank

H. E.

Becker-Haimes

E. M.

Kendall

P. C.

(2020). Therapist training in evidence-based interventions for mental health: A systematic review of training approaches and outcomes. Clinical Psychology: Science and Practice, 27(3), Article e12330. https://doi.org/10.1111/cpsp.12330

19.

Garland

A. F.

Brookman-Frazee

Hurlburt

M. S.

Accurso

E. C.

Zoffness

R. J.

Haine-Schlagel

Ganger

(2010). Mental health care for children with disruptive behavior problems: A view inside therapists’ offices. Psychiatric Services, 61(8), 788–795. https://doi.org/10.1176/ps.2010.61.8.788

20.

Gjevik

Eldevik

Fjæran-Granum

Sponheim

(2011). Kiddie-SADS reveals high rates of DSM-IV disorders in children and adolescents with autism spectrum disorders. Journal of Autism and Developmental Disorders, 41(6), 761–769. https://doi.org/10.1007/s10803-010-1095-7

21.

Herschell

A. D.

Kolko

D. J.

Baumann

B. L.

Davis

A. C.

(2010). The role of therapist training in the implementation of psychosocial treatments: A review and critique with recommendations. Clinical Psychology Review, 30(4), 448–466. https://doi.org/10.1016/j.cpr.2010.02.005

22.

Higham

Tharmanathan

Birks

(2015). Use and reporting of restricted randomization: A review. Journal of Evaluation in Clinical Practice, 21(6), 1205–1211. https://doi.org/10.1111/jep.12408

23.

Horner

R. H.

Carr

E. G.

Strain

P. S.

Todd

A. W.

Reed

H. K.

(2002). Problem behavior interventions for young children with autism: A research synthesis. Journal of Autism and Developmental Disorders, 32(5), 423–446. https://doi.org/10.1023/A:1020593922901

24.

Kalb

L. G.

Stuart

E. A.

Mandell

D. S.

Olfson

Vasa

R. A.

(2017). Management of mental health crises among youths with and without ASD: A national survey of child psychiatrists. Psychiatric Services, 68, 1039–1045. https://doi.org/10.1176/appi.ps.201600332

25.

Kilbourne

A. M.

Beck

Spaeth-Rublee

Ramanuj

O’Brien

R. W.

Tomoyasu

Pincus

H. A.

(2018). Measuring and improving the quality of mental health care: A global perspective. World Psychiatry, 17(1), 30–38. https://doi.org/10.1002/wps.20482

26.

Lake

J. K.

Perry

Lunsky

(2014). Mental health services for individuals with high functioning autism spectrum disorder. Autism Research and Treatment, 2014, 502420. https://doi.org/10.1155/2014/502420

27.

Landes

S. J.

McBain

S. A.

Curran

G. M.

(2019). An introduction to effectiveness-implementation hybrid designs. Psychiatry Research, 280, 112513. https://doi.org/10.1016/j.psychres.2019.112513

28.

Leyfer

O. T.

Folstein

S. E.

Bacalman

Davis

N. O.

Dinh

Morgan

. . .Lainhart

J. E.

(2006). Comorbid psychiatric disorders in children with autism: Interview development and rates of disorders. Journal of Autism and Developmental Disorders, 36(7), 849–861. https://doi.org/10.1007/s10803-006-0123-0

29.

Lord

Rutter

DiLavore

P. C.

(2012). Autism Diagnostic Observation Schedule (ADOS-2) (modules 1–4) (2nd ed.). Western Psychological Services.

30.

Mandell

D. S.

Walrath

C. M.

Manteuffel

Sgro

Pinto-Martin

(2005). Characteristics of children with autistic spectrum disorders served in comprehensive community-based mental health settings. Journal of Autism and Developmental Disorders, 35(3), 313–321. https://doi.org/10.1007/s10803-005-3296-z

31.

Muthén

L. K.

Muthén

B. O.

(2017). Mplus (Version 8).

32.

Narendorf

S. C.

Shattuck

P. T.

Sterzing

P. R.

(2011). Mental health service use among adolescents with an autism spectrum disorder. Psychiatric Services, 62, 975–978. https://doi.org/10.1176/appi.ps.62.8.975

33.

Postorino

Sharp

W. G.

McCracken

C. E.

Bearss

Burrell

T. L.

Evans

A. N.

Scahill

(2017). A systematic review and meta-analysis of parent training for disruptive behavior in children with autism spectrum disorder. Clinical Child and Family Psychology Review, 20(4), 391–402. https://doi.org/10.1007/s10567-017-0237-2

34.

Preacher

K. J.

Hayes

A. F.

(2008). Asymptotic and resampling strategies for assessing and comparing indirect effects in multiple mediator models. Behavior Research Methods, 40(3), 879–891. https://doi.org/10.3758/brm.40.3.879

35.

Rakovshik

S. G.

McManus

(2010). Establishing evidence-based training in cognitive behavioral therapy: A review of current empirical findings and theoretical guidance. Clinical Psychology Review, 30(5), 496–516. https://doi.org/10.1016/j.cpr.2010.03.004

36.

Raudenbush

S. W.

Bryk

A. S.

(2002). Hierarchical linear models: Applications and data analysis methods. Sage Publications.

37.

Ryeznik

Sverdlov

(2018). A comparative study of restricted randomization procedures for multiarm trials with equal or unequal treatment allocation ratios. Statistics in Medicine, 37(21), 3056–3077. https://doi.org/10.1002/sim.7817

38.

Simonoff

Pickles

Charman

Chandler

Loucas

Baird

(2008). Psychiatric disorders in children with autism spectrum disorders: Prevalence, comorbidity, and associated factors in a population-derived sample. Journal of the American Academy of Child & Adolescent Psychiatry, 47(8), 921–929.

39.

Soke

G. N.

Maenner

M. J.

Christensen

Kurzius-Spencer

Schieve

L. A.

(2018). Prevalence of co-occurring medical and behavioral conditions/symptoms among 4- and 8-year-old children with autism spectrum disorder in selected areas of the United States in 2010. Journal of Autism and Developmental Disorders, 48(8), 2663–2676.

40.

Steinbrenner

J. R.

Hume

Odom

S. L.

Morin

K. L.

Nowell

S. W.

Tomaszewski

. . .Savage

M. N.

(2020). Evidence-based practices for children, youth, and young adults with autism. The University of North Carolina at Chapel Hill, Frank Porter Graham Child Development Institute, National Clearinghouse on Autism Evidence and Practice Review Team.

41.

Suhrheinrich

Rieth

S. R.

Dickson

K. S.

Roesch

Stahmer

A. C.

(2020). Classroom pivotal response teaching: Teacher training outcomes of a community efficacy trial. Teacher Education and Special Education, 43(3), 215–234. https://doi.org/10.1177/0888406419850876

42.

Wong

Odom

S. L.

Hume

K. A.

Cox

A. W.

Fettig

Kucharczyk

. . .Schultz

T. R.

(2015). Evidence-based practices for children, youth, and young adults with autism spectrum disorder: A comprehensive review. Journal of Autism and Developmental Disorders, 45, 1951–1966. https://doi.org/10.1007/s10803-014-2351-z