Implementing Evidence-Based Mental-Health Treatments: Attending to Training,Fidelity,Adaptation,and Context

Abstract

This article provides a very high-level overview of some key considerations in the field of implementation science as it relates to clinical psychology. The article reviews recent findings regarding treatment fidelity, adaptation of treatments, and clinical outcomes. It then details some recent findings on training therapists to provide evidence-based therapies as they were designed to be delivered, with sufficient skill and adaptations if needed to ensure better fit for clients who receive treatments in different treatment settings. Finally, the article considers implications for implementing and sustaining new treatments and supporting their fidelity and adaptation, as well as key directions for future research.

Keywords

implementation and dissemination evidence-based treatments fidelity adaptation sustainability

Get full access to this article

View all access options for this article.

References

Aarons

G. A.

Ehrhart

M. G.

Farahnak

L. R.

Hurlburt

M. S.

(2015). Leadership and organizational change for implementation (LOCI): A randomized mixed method pilot study of a leadership and organization development intervention for evidence-based practice implementation. Implementation Science, 10, Article 11. https://doi.org/10.1186/s13012-014-0192-y

Baumann

A. A.

Domenech Rodríguez

M. M.

Amador

N. G.

Forgatch

M. S.

Parra-Cardona

J. R.

(2014). Parent Management Training-Oregon model (PMTO™) in Mexico City: Integrating cultural adaptation activities in an implementation model. Clinical Psychology: Science and Practice, 21(1), 32–47. https://doi.org/10.1037/h0101724

Becker-Haimes

E. M.

Klein

M. R.

McLeod

B. D.

Schoenwald

S. K.

Dorsey

Hogue

Fugo

P. B.

Phan

M. L.

Hoffacker

Beidas

R. S.

(2021). The TPOCS-self-reported Therapist Intervention Fidelity for Youth (TPOCS-SeRTIFY): A case study of pragmatic measure development. Implementation Research and Practice, 2. https://doi.org/10.1177/2633489521992553

Beidas

R. S.

Dorsey

Lewis

C. C.

Lyon

A. R.

Powell

B. J.

Purtle

Saldana

Shelton

R. C.

Stirman

S. W.

Lane-Fall

M. B.

(2022). Promises and pitfalls in implementation science from the perspective of US-based researchers: Learning from a pre-mortem. Implementation Science, 17, Article 55. https://doi.org/10.1186/s13012-022-01226-3

Beidas

R. S.

Stirman

S. W.

(2021). Realizing the promise of learning organizations to transform mental health care: Telepsychiatry care as an exemplar. Psychiatric Services, 72(1), 86–88. https://doi.org/10.1176/appi.ps.202000257

Creed

T. A.

Crane

M. E.

Calloway

Olino

T. M.

Kendall

P. C.

Stirman

S. W.

(2021). Changes in community clinicians’ attitudes and competence following a transdiagnostic Cognitive Behavioral Therapy training. Implementation Research and Practice, 2. https://doi.org/10.1177/26334895211030220

Creed

T. A.

Frankel

S. A.

German

R. E.

Green

K. L.

Jager-Hyman

Taylor

K. P.

Adler

A. D.

Wolk

C. B.

Stirman

S. W.

Waltman

S. H.

Williston

M. A.

Sherrill

Evans

A. C.

Beck

A. T.

(2016). Implementation of transdiagnostic cognitive therapy in community behavioral health: The Beck Community Initiative. Journal of Consulting and Clinical Psychology, 84(12), 1116–1126. https://doi.org/10.1037/ccp0000105

Crowe

Collie

Johnson

Stirman

S. W.

(2020). An intervention mapping process to increase evidence-based psychotherapy within a complex healthcare system. American Psychologist, 75(8), 1116–1129. https://doi.org/10.1037/amp0000631

Flemotomos

Martinez

V. R.

Chen

Creed

T. A.

Atkins

D. C.

Narayanan

(2021). Automated quality assessment of cognitive behavioral therapy sessions through highly contextualized language representations. PLOS ONE, 16(10), Article e0258639. https://doi.org/10.1371/journal.pone.0258639

10.

German

Frankel

Adler

Stirman

S. W.

Creed

(2018). Building capacity to deliver evidenced-based practice within community mental health: Examining an approach using web-based training and trained peer support. Psychiatric Services, 69(3), 286–292. https://doi.org/10.1176/appi.ps.201700029

11.

Glisson

Schoenwald

S. K.

Hemmelgarn

Green

Dukes

Armstrong

K. S.

Chapman

J. E.

(2010). Randomized trial of MST and ARC in a two-level evidence-based treatment implementation strategy. Journal of Consulting and Clinical Psychology, 78(4), 537–550. https://doi.org/10.1037/a0019160

12.

Herschell

A. D.

Kolko

D. J.

Baumann

B. L.

Davis

A. C.

(2010). The role of therapist training in the implementation of psychosocial treatments: A review and critique with recommendations. Clinical Psychology Review, 30(4), 448–466. https://doi.org/10.1016/j.cpr.2010.02.005

13.

Horvath

A. O.

Luborsky

(1993). The role of the therapeutic alliance in psychotherapy. Journal of Consulting and Clinical Psychology, 61(4), 561–573. https://doi.org/10.1037/0022-006X.61.4.561

14.

Imel

Z. E.

Pace

B. T.

Soma

C. S.

Tanana

Hirsch

Gibson

Georgiou

Narayanan

Atkins

D. C.

(2019). Design feasibility of an automated, machine-learning based feedback system for motivational interviewing. Psychotherapy, 56(2), 318–328. https://doi.org/10.1037/pst0000221

15.

Johnson

La Bash

Song

Dunlap

Lagdamen

Suvak

Landy

M. S. H.

Shields

Monson

C. M.

Stirman

S. W.

(2021). The role of the consultant in consultation for an evidence-based treatment for PTSD. Psychological Services. Advance online publication. https://doi.org/10.1037/ser0000592

16.

Johnson

J. E.

Stout

R. L.

Miller

T. R.

Zlotnick

Cerbo

L. A.

Andrade

J. T.

Nargiso

Bonner

Stirman

S. W.

(2019). Randomized effectiveness trial of interpersonal psychotherapy (IPT) for prisoners with major depression. Journal of Consulting and Clinical Psychology, 87(4), 392–406. https://doi.org/10.1037/ccp0000379

17.

Keefe

J. R.

Hernandez

Johanek

Landy

M. S. H.

Sijercic

Shnaider

Wagner

A. C.

Lane

J. E. M.

Monson

C. M.

Stirman

S. W.

(2021). Competence in delivering Cognitive Processing Therapy and the therapeutic alliance both predict PTSD symptom outcomes. Behavior Therapy. Advance online publication. https://doi.org/10.1016/j.beth.2021.12.003

18.

Kirchner

J. E.

Smith

J. L.

Powell

B. J.

Waltz

T. J.

Proctor

E. K.

(2020). Getting a clinical innovation into practice: An introduction to implementation strategies. Psychiatry Research, 283, Article 112467. https://doi.org/10.1016/j.psychres.2019.06.042

19.

Kirk

M. A.

Moore

J. E.

Stirman

S. W.

Birkin

S. A.

(2020). Towards a comprehensive model for understanding adaptations’ impact: The Model for Adaptation Design and Impact (MADI). Implementation Science, 15, Article 56. https://doi.org/10.1186/s13012-020-01021-y

20.

LoSavio

S. T.

Dillon

K. H.

Murphy

R. A.

Goetz

Houston

Resick

P. A.

(2019). Using a learning collaborative model to disseminate cognitive processing therapy to community-based agencies. Behavior Therapy, 50(1), 36–49. https://doi.org/10.1016/j.beth.2018.03.007

21.

Marques

Valentine

S. E.

Kaysen

Mackintosh

M.-A.

Dixon De Silva

L. E.

Ahles

E. M.

Youn

S. J.

Shtasel

D. L.

Simon

N. M.

Wiltsey-Stirman

(2019). Provider fidelity and modifications to Cognitive Processing Therapy in a diverse community health clinic: Associations with clinical change. Journal of Consulting and Clinical Psychology, 87(4), 357–369. https://doi.org/10.1037/ccp0000384

22.

McLeod

B. D.

Cox

J. R.

Jensen-Doss

Herschell

Ehrenreich-May

Wood

J. J.

(2018). Proposing a mechanistic model of clinician training and consultation. Clinical Psychology: Science and Practice, 25(3), Article e12260. https://doi.org/10.1111/cpsp.12260

23.

Miller

C. J.

Wiltsey-Stirman

Baumann

A. A.

(2020). Iterative Decision-making for Evaluation of Adaptations (IDEA): A decision tree for balancing adaptation, fidelity, and intervention impact. Journal of Community Psychology, 48(4), 1163–1177. http://doi.org/10.1002/jcop.22279

24.

Monson

C. M.

Shields

Suvak

M. K.

Lane

J. E. M.

Shnaider

Landy

M. S. H.

Wagner

A. C.

Sijercic

Masina

Wanklyn

S. G.

Stirman

S. W.

(2018). A randomized controlled effectiveness trial of training strategies in cognitive processing therapy for posttraumatic stress disorder: Impact on patient outcomes. Behaviour Research and Therapy, 110, 31–40. https://doi.org/10.1016/j.brat.2018.08.007

25.

Nilsen

(2015). Making sense of implementation theories, models and frameworks. Implementation Science, 10, Article 53. https://doi.org/10.1186/s13012-015-0242-0

26.

Pace

B. T.

Song

Suvak

M. K.

Shields

Monson

C. M.

Stirman

S. W.

(2021). Therapist self-efficacy in delivering cognitive processing therapy in a randomized controlled implementation trial. Cognitive and Behavioral Practice, 28(3), 327–335. https://doi.org/10.1016/j.cbpra.2020.08.002

27.

Power

Noble

L. A.

Simmonds-Buckley

Kellett

Stocton

Firth

Delgadillo

(2022). Associations between treatment adherence–competence–integrity (ACI) and adult psychotherapy outcomes: A systematic review and meta-analysis. Journal of Consulting and Clinical Psychology, 90(5), 427–455. https://doi.org/10.1037/ccp0000736

28.

Rosen

C. S.

Matthieu

M. M.

Stirman

S. W.

Cook

J. M.

Landes

Bernardy

N. C.

Chard

K. M.

Crowley

Eftekhari

Finley

E. P.

Hamblen

J. L.

Harik

J. M.

Kehle-Forbes

S. M.

Meis

L. A.

Osei-Bonsu

P. E.

Rodriguez

A. L.

Ruggiero

K. J.

Ruzek

J. I.

Smith

B. N.

. . . Watts

B. V.

(2016). A review of studies on the system-wide implementation of evidence-based psychotherapies for posttraumatic stress disorder in the Veterans Health Administration. Administration and Policy in Mental Health and Mental Health Services Research, 43(6), 957–977. https://doi.org/10.1007/s10488-016-0755-0

29.

Sayer

N. A.

Bernardy

N. C.

Yoder

Hamblen

J. L.

Rosen

C. S.

Ackland

P. E.

Kehle-Forbes

S. M.

Clothier

B. A.

Schnurr

P. P.

Orazem

R. J.

Noorbaloochi

(2021). Evaluation of an implementation intervention to increase reach of evidence-based psychotherapies for PTSD in US Veterans Health Administration PTSD clinics. Administration and Policy in Mental Health and Mental Health Services Research, 48(3), 450–463. https://doi.org/10.1007/s10488-020-01086-3

30.

Sijercic

Lane

J. E. M.

Gutner

C. A.

Monson

C. M.

Stirman

S. W.

(2020). The association between clinician and perceived organizational factors with early fidelity to cognitive processing therapy for posttraumatic stress disorder in a randomized controlled implementation trial. Administration and Policy in Mental Health and Mental Health Services Research, 47(1), 8–18. https://doi.org/10.1007/s10488-019-00966-7

31.

Stirman

S. W.

Baumann

A. A.

Miller

C. J.

(2019). The FRAME: An expanded framework for reporting adaptations and modifications to evidence-based interventions. Implementation Science, 14, Article 58. https://doi.org/10.1186/s13012-019-0898-y

32.

Stirman

S. W.

Gamarra

J. M.

Bartlett

B. A.

Calloway

Gutner

C. A.

(2017). Empirical examinations of modifications and adaptations to evidence-based psychotherapies: Methodologies, impact, and future directions. Clinical Psychology: Science and Practice, 24(4), 396–420. https://doi.org/10.1111/cpsp.12218

33.

Stirman

S. W.

Gutner

C. A.

Gamarra

Suvak

M. K.

Vogt

Johnson

Wachen

J. S.

Dondanville

K. A.

Yarvis

J. S.

Mintz

Peterson

A. L.

Young-McCaughan

Resick

P. A.

, for the STRONG STAR Consortium. (2021). A novel approach to the assessment of fidelity to a cognitive behavioral therapy for PTSD using clinical worksheets: A proof of concept with cognitive processing therapy. Behavior Therapy, 52(3), 656–672. https://doi.org/10.1016/j.beth.2020.08.005

34.

Stirman

S. W.

Gutner

C. A.

Langdon

Graham

J. R.

(2016). Bridging the gap between research and practice in mental health service settings: An overview of developments in implementation theory and research. Behavior Therapy, 47(6), 920–936. https://doi.org/10.1016/j.beth.2015.12.001

35.

Stirman

S. W.

Pontoski

Creed

Xhezo

Evans

A. C.

Beck

A. T.

Crits-Christoph

(2017). A non-randomized comparison of strategies for consultation in a community-academic training program to implement an evidence-based psychotherapy. Administration and Policy in Mental Health and Mental Health Services Research, 44(1), 55–66. https://doi.org/10.1007/s10488-015-0700-7

36.

Stirman

S. W.

Shields

Deloriea

Landy

M. S. H.

Belus

J. M.

Maslej

M. M.

Monson

C. M.

(2013). A randomized controlled dismantling trial of post-workshop consultation strategies to increase effectiveness and fidelity to an evidence-based psychotherapy for Posttraumatic Stress Disorder. Implementation Science, 8, Article 82. https://doi.org/10.1186/1748-5908-8-82

37.

Sundell

Beelmann

Hasson

von Thiele Schwarz

(2016). Novel programs, international adoptions, or contextual adaptations? Meta-analytical results from German and Swedish intervention research. Journal of Clinical Child & Adolescent Psychology, 45(6), 784–796. https://doi.org/10.1080/15374416.2015.1020540

38.

Swanson

K. M.

Song

Beristianos

Aajmain

Lane

J. E. M.

Landy

M. S. H.

Suvak

M. K.

Shields

Monson

C. M.

Stirman

S. W.

(2021). A glimpse into the “black box”: Which elements of consultation in an EBP are associated with client symptom change and therapist fidelity? Implementation Research and Practice, 2. https://doi.org/10.1177/26334895211051791

39.

Valentine

S. E.

Borba

C. P. C.

Dixon

Vaewsorn

A. S.

Gallegos Guajardo

Resick

P. A.

Stirman

S. W.

Marques

(2017). Cognitive processing therapy for Spanish-speaking Latinos: A formative study of a model-driven cultural adaptation of the manual to enhance implementation in a usual care setting. Journal of Clinical Psychology, 73(3), 239–256. https://doi.org/10.1002/jclp.22337

40.

Weisz

J. R.

Thomassin

Hersh

Santucci

L. C.

MacPherson

H. A.

Rodriguez

G. M.

Bearman

S. K.

Lang

J. M.

Vanderploeg

J. J.

Marshall

T. M.

J. J.

Jensen-Doss

Evans

S. C.

(2020). Clinician training, then what? Randomized clinical trial of child STEPs psychotherapy using lower-cost implementation supports with versus without expert consultation. Journal of Consulting and Clinical Psychology, 88(12), 1065–1078. https://doi.org/10.1037/ccp0000536

41.

Williams

N. J.

Ehrhart

M. G.

Aarons

G. A.

Marcus

S. C.

Beidas

R. S.

(2018). Linking molar organizational climate and strategic implementation climate to clinicians’ use of evidence-based psychotherapy techniques: Cross-sectional and lagged analyses from a 2-year observational study. Implementation Science, 13, Article 85. https://doi.org/10.1186/s13012-018-0781-2

42.

Worley

C. B.

LoSavio

S. T.

Aajmain

Rosen

Stirman

S. W.

Sloan

D. M.

(2020). Training during a pandemic: Successes, challenges, and practical guidance from a virtual facilitated learning collaborative training program for written exposure therapy. Journal of Traumatic Stress, 33(5), 634–642. https://doi.org/10.1002/jts.22589