Examining the nature and determinants of evidence-based treatment (EBT) modification is an important step toward understanding the impact of modifications and informing modification guidelines. We examined the prevalence, types, reasons for, and predictors of clinician-reported modification to cognitive behavioral therapy (CBT) for children and adolescents. Ninety-eight clinicians trained in CBT completed surveys on their intent to modify CBT, perceptions of CBT characteristics, confidence in their ability to appropriately deliver CBT in complex clinical situations, and organizational EBT implementation climate post-training. Post-consultation, clinicians self-reported the types and reasons for modifications they performed. Ninety-three percent of clinicians reported they modified CBT, primarily with fewer than half of their clients. Client needs and clinician preference or style accounted for the highest proportion of modification reasons. The number of reported modifications performed was predicted by clinician confidence in their ability to deliver CBT appropriately (b = .90, p = .01) and their intent to modify (b = .55, p = .01).
AaronsG. A.GreenA. E.PalinkasL. A.Self-BrownS.WhitakerD. J.LutzkerJ. R.. . . ChaffinM. J. (2012). Dynamic adaptation process to implement an evidence-based child maltreatment intervention. Implementation Science, 7, Article 32. doi:10.1186/1748-5908-7-32
2.
AaronsG. A.MillerE. A.GreenA. E.PerrottJ. A.BradwayR. (2012). Adaptation happens: A qualitative case study of implementation of The Incredible Years evidence-based parent training programme in a residential substance abuse treatment programme. Journal of Children’s Services, 7, 233–245. doi:10.1108/17466661211286463
3.
AjzenI. (1991). The theory of planned behavior. Organizational Behavior and Human Decision Processes, 50, 179–211. doi:10.1016/0749-5978(91)90020-T
4.
AjzenI.MaddenT. J. (1986). Prediction of goal-directed behavior: Attitudes, intentions, and perceived behavioral control. Journal of Experimental Social Psychology, 22, 453–474. doi:10.1016/0022-1031(86)90045-4
5.
AllenB.CrosbyJ. W. (2014). Treatment beliefs and techniques of clinicians serving child maltreatment survivors. Child Maltreatment, 19, 49–60. doi:10.1177/1077559513518097
6.
ArmitageC. J.ConnerM. (2001). Efficacy of the theory of planned behaviour: A meta-analytic review. British Journal of Social Psychology, 40, 471–499. doi:10.1348/014466601164939
7.
BeidasR. S.MarcusS.AaronsG. A.HoagwoodK. E.SchoenwaldS.EvansA. C.. . . MandellD. S. (2015). Predictors of community therapists’ use of therapy techniques in a large public mental health system. JAMA Pediatrics, 169, 374–382. doi:10.1001/jamapediatrics.2014.3736
8.
BlakelyC. H.MayerJ. P.GottschalkR. G.SchmittN.DavidsonW. S.RoitmanD. B.EmshoffJ. G. (1987). The fidelity-adaptation debate: Implications for the implementation of public sector social programs. American Journal of Community Psychology, 15, 253–268. doi:10.1007/978-1-4419-8646-7_10
9.
BlieseP. D. (2000). Within-group agreement, non-independence, and reliability: Implications for data aggregation and analysis. In KleinK. J.KozlowskiS. W. J. (Eds.), Multilevel theory, research, and methods in organizations: Foundations, extensions, and new directions (pp. 349–381). San Francisco, CA: Jossey-Bass.
10.
BurleyM. (2009). Outpatient treatment differences for children served in Washington’s public mental health system. Olympia, WA. Retrieved from http://www.wsipp.wa.gov/rptfiles/09-10-3401.pdf
11.
ChambersD. A.GlasgowR. E.StangeK. C. (2013). The dynamic sustainability framework: Addressing the paradox of sustainment amid ongoing change. Implementation Science, 8(1), Article 117. doi:10.1186/1748-5908-8-117
12.
ChorpitaB. F.DaleidenE. L. (2009). Mapping evidence-based treatments for children and adolescents: Application of the distillation and matching model to 615 treatments from 322 randomized trials. Journal of Consulting and Clinical Psychology, 77, 566–579. doi:10.1037/a0014565
13.
ChorpitaB. F.DaleidenE. L.WeiszJ. R. (2005). Modularity in the design and application of therapeutic interventions. Applied and Preventive Psychology, 11, 141–156. doi:10.1016/j.appsy.2005.05.002
14.
CookJ. M.DinnenS.ThompsonR.SimiolaV.SchnurrP. P. (2014). Changes in implementation of two evidence-based psychotherapies for PTSD in VA residential treatment programs: A national investigation. Journal of Traumatic Stress, 27, 137–143. doi:10.1002/jts.21902
15.
CookJ. M.ThompsonR.SchnurrP. P. (2015). Perceived characteristics of intervention scale: Development and psychometric properties. Assessment, 22, 704–714. doi:10.1177/1073191114561254
16.
DorseyS.BerlinerL.LyonA. R.PullmannM. D.MurrayL. K. (2016). A statewide common elements initiative for children’s mental health. The Journal of Behavioral Health Services & Research, 43, 246–261. doi:10.1007/s11414-014-9430-y
17.
EhrhartM. G.AaronsG. A.FarahnakL. R. (2014). Assessing the organizational context for EBP implementation: The development and validity testing of the Implementation Climate Scale (ICS). Implementation Science, 9(1), Article 157. doi:10.1186/s13012-014-0157-1
18.
ElliottD. S.MihalicS. (2004). Issues in disseminating and replicating effective prevention programs. Prevention Science, 5, 47–53.
19.
FisherJ. D.FisherW. A.CornmanD. H.AmicoR. K.BryanA.FriedlandG. H. (2006). Clinician-delivered intervention during routine clinical care reduces unprotected sexual behavior among HIV-infected patients. Journal of Acquired Immune Deficiency Syndromes, 41, 44–52. doi:10.1097/01.qai.0000192000.15777.5c
20.
GodinG.Bélanger-GravelA.EcclesM.GrimshawJ. (2008). Healthcare professionals’ intentions and behaviours: A systematic review of studies based on social cognitive theories. Implementation Science, 3, Article 36. doi:10.1186/1748-5908-3-36
21.
GodinG.KokG. (1996). The theory of planned behavior: A review of its applications to health-related behaviors. American Journal of Health Promotion, 11, 87–98.
22.
GreenhalghT.RobertG.BateP.MacfarlaneF.KyriakidouO. (2005). Diffusion of innovations in health service organisations: A systematic literature review. Oxford, UK: Blackwell.
23.
HillL. G.MaucioneK.HoodB. K. (2007). A focused approach to assessing program fidelity. Prevention Science, 8, 25–34. doi:10.1007/s11121-006-0051-4
24.
JamesL. R.DemareeR. G.WolfG. (1993). rwg: An assessment of within-group interrater agreement. Journal of Applied Psychology, 78, 306–309. doi:10.1037/0021-9010.78.2.306
25.
JemmottJ. B.IIIJemmottL. S.BravermanP. K.FongG. T. (2005). HIV/STD risk reduction interventions for African American and Latino adolescent girls at an adolescent medicine clinic. Archives of Pediatrics & Adolescent Medicine, 159, 440–449. doi:10.1001/archpedi.159.5.440
26.
KaysenD.LindgrenK.ZanganaG. A. S.MurrayL.BassJ.BoltonP. (2013). Adaptation of cognitive processing therapy for treatment of torture victims: Experience in Kurdistan, Iraq. Psychological Trauma: Theory, Research, Practice, and Policy, 5, 184–192. doi:10.1037/a0026053
27.
KendallP. C.BeidasR. S. (2007). Smoothing the trail for dissemination of evidence-based practices for youth: Flexibility within fidelity. Professional Psychology: Research and Practice, 38, 13–20. doi:10.1037/0735-7028.38.1.13
28.
KumpferK. L.AlvaradoR.SmithP.BellamyN. (2002). Cultural sensitivity and adaptation in family-based prevention interventions. Prevention Science, 3, 241–246.
29.
LauA.BarnettM.StadnickN.SaifanD.ReganJ.Wiltsey StirmanS.. . . Brookman-FrazeeL. (2017). Therapist report of adaptations to delivery of evidence-based practices within a system-driven reform of publicly funded children’s mental health services. Journal of Consulting and Clinical Psychology, 85, 664–675. doi:10.1037/ccp0000215
30.
LundgrenL.AmodeoM.CohenA.ChasslerD.HorowitzA. (2011). Modifications of evidence-based practices in community-based addiction treatment organizations: A qualitative research study. Addictive Behaviors, 36, 630–635. doi:10.1016/j.addbeh.2011.01.003
31.
MurrayL. K.DorseyS.SkavenskiS.KasomaM.ImasikuM.BoltonP.. . . CohenJ. A. (2013). Identification, modification, and implementation of an evidence-based psychotherapy for children in a low-income country: The use of TF-CBT in Zambia. International Journal of Mental Health Systems, 7, Article 24. doi:10.1186/1752-4458-7-24
32.
PalinkasL. A.WeiszJ. R.ChorpitaB. F.LevineB.GarlandA. F.HoagwoodK. E.LandsverkJ. (2013). Continued use of evidence-based treatments after a randomized controlled effectiveness trial: A qualitative study. Psychiatric Services, 64, 1110–1118. doi:10.1176/appi.ps.004682012
33.
ParkA. L.ChorpitaB. F.ReganJ.WeiszJ. R. & Research Network on Youth Mental Health. (2015). Integrity of evidence-based practice: Are providers modifying practice content or practice sequencing?Administration and Policy in Mental Health and Mental Health Services Research, 42, 186–196. doi:10.1007/s10488-014-0559-z
34.
PerepletchikovaF.KazdinA. E. (2006). Treatment integrity and therapeutic change: Issues and research recommendations. Clinical Psychology: Science and Practice, 12, 365–383. doi:10.1093/clipsy.bpi045
35.
PerepletchikovaF.TreatT. A.KazdinA. E. (2007). Treatment integrity in psychotherapy research: Analysis of the studies and examination of the associated factors. Journal of Consulting and Clinical Psychology, 75, 829–841. doi:10.1037/0022-006X.75.6.829
36.
PinheiroJ.BatesD.DebRoyS.SarkarD. R., & R Core Team. (2017). nlme: Linear and nonlinear mixed effects models. Retrieved from https://CRAN.R-project.org/package=nlme
37.
R Core Team. (2016). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing.
38.
RogersE. (1962). Diffusion of innovations. New York, NY: Free Press.
39.
RogersE. (2003). Diffusion of innovations (5th ed.). New York, NY: Free Press.
40.
Southam-GerowM. A.McLeodB. D. (2013). Advances in applying treatment integrity research for dissemination and implementation science: Introduction to special issue. Clinical Psychology, 20, 1–13. doi:10.1111/cpsp.12019
41.
StirmanS. W.MillerC. J.ToderK.CallowayA. (2013). Development of a framework and coding system for modifications and adaptations of evidence-based interventions. Implementation Science, 8(1), Article 65. doi:10.1186/1748-5908-8-65
42.
WeinerB. J.BeldenC. M.BergmireD. M.JohnstonM. (2011). The meaning and measurement of implementation climate. Implementation Science, 6(1), Article 78. doi:10.1186/1748-5908-6-78
43.
WeiszJ. R.ChorpitaB. F.PalinkasL. A.SchoenwaldS. K.MirandaJ.BearmanS. K.. . . GibbonsR. D. (2012). Testing standard and modular designs for psychotherapy treating depression, anxiety, and conduct problems in youth: A randomized effectiveness trial. Archives of General Psychiatry, 69, 274–282. doi:10.1001/archgenpsychiatry.2011.147
44.
Wiltsey StirmanS. A.CallowayA.ToderK.MillerC. J.DevitoA. K.MeiselS. N.. . . Crits-ChristophP. (2014). Modifications to cognitive therapy by community mental health providers: Implications for effectiveness and sustainability. Psychiatric Services, 64, 1056–1059. doi:10.1176/appi.ps.201200456
45.
Wiltsey StirmanS. A.GutnerC.Crits-ChristophP.EdmundsJ.EvansA. C.BeidasR. S. (2015). Relationships between clinician-level attributes and fidelity-consistent and fidelity-inconsistent modifications to an evidence-based psychotherapy. Implementation Science, 10(1), Article 115. doi:10.1186/s13012-015-0308-z
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
