Many treatment engagement challenges are documented for adolescents with ADHD. Across contexts, helping professionals (i.e., therapists, prescribers, educators, coaches) might benefit from an engagement strategy toolbox to facilitate work with adolescents with ADHD and their families.
Method:
The current study describes the development and psychometric testing of the ADHD Engagement Process Code (AEPC), a measure that operationalizes engagement strategies in the context of a blended behavioral/motivational interviewing treatment for adolescent ADHD (Supporting Teens’ Autonomy Daily; STAND). The AEPC also operationalizes in-session parent and adolescent engagement-related behaviors. Behavior counts and global codes were coded for 840 audio-recorded STAND sessions delivered by 21 therapists to 121 adolescents. Subsets of tapes were double coded using the AEPC’s parent, adolescent, and therapist coding systems to assess kappa for line-by-line verbalizations and intraclass correlations for session-level behavior counts and global scores. Construct validity was assessed. We explored low frequency and low variability codes and examined correlations between codes.
Results:
AEPC codes possessed good to excellent inter-rater reliability and strong discriminant validity. Three low frequency codes and one low variability global were identified indicating opportunities for AEPC refinement.
Conclusions:
The AEPC is publicly available (https://osf.io/kshfy/) and offers a library of adolescent-specific codes for those interested in measuring provider, parent, or adolescent engagement behaviors in relevant populations or contexts.
BarkleyR. A.EdwardsG.LaneriM.FletcherK.MeteviaL. (2001). The efficacy of problem-solving communication training alone, behavior management training alone, and their combination for parent–adolescent conflict in teenagers with ADHD and ODD. Journal of Consulting and Clinical Psychology, 69(6), 926. https://doi.org/10.1037/0022-006X.69.6.926
2.
BarkleyR. A.MurphyK. R.FischerM. (2010). ADHD in adults: What the science says. Guilford press.
3.
BarkleyR. A.RobinA. L. (2014). Defiant teens: A clinician’s manual for assessment and family intervention. Guilford Publications.
4.
BawejaR.SoutulloC. A.WaxmonskyJ. G. (2021). Review of barriers and interventions to promote treatment engagement for pediatric attention deficit hyperactivity disorder care. World Journal of Psychiatry, 11(12), 1206–1227. https://doi.org/10.5498/wjp.v11.i12.1206
5.
BirdH. R.GouldM. S.StaghezzaB. (1992). Aggregating data from multiple informants in child psychiatry epidemiological research. Journal of the American Academy of Child & Adolescent Psychiatry, 31, 78–85. https://doi.org/10.1097/00004583-199201000-00012
6.
BoyerB. E.GeurtsH. M.PrinsP. J.Van der OordS. (2015). Two novel CBTs for adolescents with ADHD: The value of planning skills. European Child & Adolescent Psychiatry, 24, 1075–1090. https://doi.org/10.1007/s00787-014-0661-5
7.
BrinkmanW. B.SimonJ. O.EpsteinJ. N. (2018). Reasons why children and adolescents with attention-deficit/hyperactivity disorder stop and restart taking medicine. Academic Pediatrics, 18(3), 273–280. https://doi.org/10.1016/j.acap.2017.09.005
8.
BussingR.Koro-LjungbergM.NoguchiK.MasonD.MayersonG.GarvanC. W. (2012). Willingness to use ADHD treatments: A mixed methods study of perceptions by adolescents, parents, health professionals and teachers. Social Science & Medicine, 74(1), 92–100. https://doi.org/10.1016/j.socscimed.2011.10.009
9.
BussingR.ZimaB. T.MasonD. M.PorterP. C.GarvanC. W. (2011). Receiving treatment for attention-deficit hyperactivity disorder: Do the perspectives of adolescents matter?Journal of Adolescent Health, 49, 7–14. https://doi.org/10.1016/j.jadohealth.2010.08.014
10.
ChackoA.WymbsB. T.RajwanE.WymbsF.FeirsenN. (2017). Characteristics of parents of children with ADHD who never attend, drop out, and complete behavioral parent training. Journal of Child and Family Studies, 26, 950–960. https://doi.org/10.1007/s10826-016-0618-z
11.
ChanE.FoglerJ. M.HammernessP. G. (2016). Treatment of attention-deficit/hyperactivity disorder in adolescents: A systematic review. JAMA, 315(18), 1997–2008. https://doi.org/10.1001/jama.2016.5453
12.
CicchettiD. V. (1994). Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychological assessment, 6(4), 284–290. https://doi.org/10.1037/1040-3590.6.4.284
13.
CrossA.SheffieldD. (2019). Mental contrasting for health behaviour change: A systematic review and meta-analysis of effects and moderator variables. Health Psychology Review, 13(2), 209–225. https://doi.org/10.1080/17437199.2019.1594332
14.
DanielsonM. L.BitskoR. H.GhandourR. M.HolbrookJ. R.KoganM. D.BlumbergS. J. (2018). Prevalence of parent-reported ADHD diagnosis and associated treatment among US children and adolescents, 2016. Journal of Clinical Child & Adolescent Psychology, 47(2), 199–212. https://doi.org/10.1080/15374416.2017.1417860
15.
EvansS. W.SchultzB. K.DeMarsC. E.DavisH. (2011). Effectiveness of the challenging horizons after-school program for young adolescents with ADHD. Behavior Therapy, 42(3), 462–474. https://doi.org/10.1016/j.beth.2010.11.008
16.
FabianoG. A.PelhamW. E.Jr.WaschbuschD. A.GnagyE. M.LaheyB. B.ChronisA. M.OnyangoA. N.KippH.Lopez-WilliamsA.Burrows-MacLeanL. (2006). A practical measure of impairment: Psychometric properties of the impairment rating scale in samples of children with attention deficit hyperactivity disorder and two school-based samples. Journal of Clinical Child and Adolescent Psychology, 35(3), 369–385. https://doi.org/10.1207/s15374424jccp3503_3
17.
FabianoG. A.SchatzN. K.PelhamW. E. (2014). Summer treatment programs for youth with ADHD. Child and Adolescent Psychiatric Clinics, 23(4), 757–773. https://doi.org/10.1016/j.chc.2014.05.012
18.
FischerM.BarkleyR. A.FletcherK. E.SmallishL. (1993). The stability of dimensions of behavior in ADHD and normal children over an 8-year followup. Journal of Abnormal Child Psychology, 21, 315–337. https://doi.org/10.1007/BF00917537
19.
GlynnL. H.HallgrenK. A.HouckJ. M.MoyersT. B. (2012). CACTI: Free, open-source software for the sequential coding of behavioral interactions. PLoS One, 7(7), e39740. https://doi.org/10.1371/journal.pone.0039740
20.
GollwitzerP. M.OettingenG. (2020). Implementation intentions. In GellmanM. D. (Ed.), Encyclopedia of behavioral medicine (pp. 1159–1164). Springer International Publishing. https://doi.org/10.1007/978-3-030-39903-0_1710
21.
HamrinV.IennacoJ. D. (2017). Evaluation of motivational interviewing to improve psychotropic medication adherence in adolescents. Journal of Child and Adolescent Psychopharmacology, 27(2), 148–159. https://doi.org/10.1089/cap.2015.0187
22.
HarrisonJ. R.EvansS. W.BaranA.KhondkerF.PressK.NoelD.WassermanS.BelmonteC.MohlmannM. (2020). Comparison of accommodations and interventions for youth with ADHD: A randomized controlled trial. Journal of School Psychology, 80, 15–36. https://doi.org/10.1016/j.jsp.2020.05.001
23.
HodsonG. (2021). Construct jangle or construct mangle? Thinking straight about (nonredundant) psychological constructs. Journal of Theoretical Social Psychology, 5(4), 576–590. https://doi.org/10.1002/jts5.120
24.
HouckJ. M.MoyersT. B.MillerW. R.GlynnL. H.HallgrenK. A. (2010). The motivational interivewing skills code (Version 2.5). http://casaa.unm.edu/download/misc25.pdf
25.
JohnsonE.MellorD.BrannP. (2008). Differences in dropout between diagnoses in child and adolescent mental health services. Clinical Child Psychology and Psychiatry, 13(4), 515–530. https://doi.org/10.1177/1359104508096767
26.
JohanssonM.GreenwoodL.Torres AntunezG.LinkK.SibleyM. H. (2023). Predictors of engagement barriers for adolescent ADHD treatment. Journal of Attention Disorders, 27(5), 499–509. https://doi.org/10.1177/10870547231153876
27.
KhanM. U.AslaniP. (2021). Exploring factors influencing initiation, implementation and discontinuation of medications in adults with ADHD. Health Expectations, 24, 82–94. https://doi.org/10.1111/hex.13031
28.
KlonekF. E.WunderlichE.SpurkD.KauffeldS. (2016). Career counseling meets motivational interviewing: A sequential analysis of dynamic counselor–client interactions. Journal of Vocational Behavior, 94, 28–38. https://doi.org/10.1016/j.jvb.2016.01.008
29.
KriegerV.Amador-CamposJ. A.Gallardo-PujolD. (2019). Temperament, executive function, and attention-deficit/hyperactivity disorder (ADHD) in adolescents: The mediating role of effortful control. Journal of Clinical and Experimental Neuropsychology, 41(6), 615–633. https://doi.org/10.1080/13803395.2019.1599824
30.
LandisJ. R.KochG. G. (1977). An application of hierarchical kappa-type statistics in the assessment of majority agreement among multiple observers. Biometrics, 33, 363–374. https://doi.org/10.2307/2529786
31.
LangbergJ. M.DvorskyM. R.MolitorS. J.BourchteinE.EddyL. D.SmithZ. R.OddoL. E.EadehH. M. (2018). Overcoming the research-to-practice gap: A randomized trial with two brief homework and organization interventions for students with ADHD as implemented by school mental health providers. Journal of Consulting and Clinical Psychology, 86(1), 39–55. https://doi.org/10.1037/ccp0000265
32.
LawsM. B.MagillM.MastroleoN. R.GamarelK. E.HoweC. J.WalthersJ.MontiP. M.SouzaT.WilsonI. BRoseG. S.KahlerC. W. (2018). A sequential analysis of motivational interviewing technical skills and client responses. Journal of Substance Abuse Treatment, 92, 27–34. https://doi.org/10.1016/j.jsat.2018.06.006
33.
MillerW. R.RollnickS. (2023). Motivational interviewing: Helping people change and grow. Guilford Publications.
34.
MolinaB. S.HinshawS. P.SwansonJ. M.ArnoldL. E.VitielloB.JensenP. S.EpsteinJ. N.HozaB.HechtmanL.AbikoffH. B.ElliottG. R.GreenhillL. L.NewcornJ. H.WellsK. C.WigalT.GibbonsR. D.Hur, K., Houck, P. R., & MTACooperative Group. (2009). The MTA at 8 years: Prospective follow-up of children treated for combined-type ADHD in a multisite study. Journal of the American Academy of Child & Adolescent Psychiatry, 48(5), 484–500. https://doi.org/10.1097/CHI.0b013e31819c23d0
35.
MoyersT. B.MartinT. (2006). Therapist influence on client language during motivational interviewing sessions. Journal of Substance Abuse Treatment, 30(3), 245–251. https://doi.org/10.1016/j.jsat.2005.12.003
36.
MoyersT. B.RowellL. N.ManuelJ. K.ErnstD.HouckJ. M. (2016). The motivational interviewing treatment integrity code (MITI 4): Rationale, preliminary reliability and validity. Journal of Substance Abuse Treatment, 65, 36–42. https://doi.org/10.1016/j.jsat.2016.01.001
37.
PasE. T.BordenL.HermanK.BradshawC. P. (2021). Leveraging Motivational Interviewing to coach teachers in the implementation of preventive evidence-based practices: A sequential analysis of the Motivational Interviewing process. Prevention Science, 22, 786–798. https://doi.org/10.1007/s11121-021-01238-3
38.
PelhamW. E.Jr.MeichenbaumD. L.SmithB. H.SibleyM. H.GnagyE. M.BuksteinO. (2017). Acute effects of MPH on the parent–teen interactions of adolescents with ADHD. Journal of Attention Disorders, 21(2), 158–167. https://doi.org/10.1177/1087054713480833
39.
Rios-DavisA.SibleyM. H.DelgadoA.Zulauf-McCurdyC. (2023). Identifying common and unique elements of evidence-based treatments for adolescent ADHD. Journal of Child and Family Studies, 32(2), 466–480. https://doi.org/10.1007/s10826-022-02475-y
40.
ShafferD.FisherP.LucasC. P.DulcanM. K.Schwab-StoneM. E. (2000). NIMH diagnostic interview schedule for children version IV (NIMH DISC-IV): Description, differences from previous versions, and reliability of some common diagnoses. Journal of the American Academy of Child & Adolescent Psychiatry, 39(1), 28–38. https://doi.org/10.1097/00004583-200001000-00014
41.
SibleyM. H. (2016). Parent-teen therapy for executive function deficits and ADHD: Building skills and motivation. Guilford.
42.
SibleyM. H.ArnoldL. E.SwansonJ. M.HechtmanL. T.KennedyT. M.OwensE.MolinaB. S. G.JensenP. S.HinshawS. P.RoyA.Chronis-TuscanoA.NewcornJ. H.RohdeL. A., & MTA Cooperative Group. (2022). Variable patterns of remission from ADHD in the multimodal treatment study of ADHD. American Journal of Psychiatry, 179(2), 142–151. https://doi.org/10.1176/appi.ajp.2021.21010032
43.
SibleyM. H.CampezM.PerezA.MorrowA. S.MerrillB. M.AltszulerA. R.CoxeS.YeguezC. E. (2016). Parent management of organization, time management, and planning deficits among adolescents with ADHD. Journal of Psychopathology and Behavioral Assessment, 38, 216–228. https://doi.org/10.1007/s10862-015-9515-9
44.
SibleyM. H.CoxeS. J.SteinM. A.MeinzerM. C.ValenteM. J. (2022). Predictors of treatment engagement and outcome among adolescents with attention-deficit/hyperactivity disorder: An integrative data analysis. Journal of the American Academy of Child & Adolescent Psychiatry, 61(1), 66–79. https://doi.org/10.1016/j.jaac.2021.03.017
45.
SibleyM. H.FloresS.MurphyM.BasuH.SteinM. A.EvansS. W.ManzanoM.Van DreelS. (under review). Pharmacological and non-pharmacological treatments for adolescents with ADHD: An updated systematic review of the literature (2013-2022). Paper submitted for Publication.
46.
SibleyM. H.GrazianoP. A.KuriyanA. B.CoxeS.PelhamW. E.RodriguezL.SanchezF.DerefinkoK.HelsethS.WardA. (2016). Parent-teen behavior therapy+ motivational interviewing for adolescents with ADHD. Journal of Consulting and Clinical Psychology, 84(8), 699–712. https://doi.org/10.1037/ccp0000106
47.
SibleyM. H.JohanssonM.MonroyJ. M.HillD. M.LaCountP. A.BarneyS.MolinaN.DelgadoA. (2022). Building a theoretical model for supporting teens’ autonomy daily (STAND): A network analysis of family-perceived changes. Behavior Therapy, 53(1), 49–63.
48.
SibleyM. H.KuriyanA. B. (2016). DSM-5 changes enhance parent identification of symptoms in adolescents with ADHD. Psychiatry Research, 242, 180–185. https://doi.org/10.1016/j.psychres.2016.05.036
49.
SibleyM. H.LinkK.Torres AntunezG.GreenwoodL. (2023). Engagement barriers to behavior therapy for adolescent ADHD. Journal of Clinical Child & Adolescent Psychology, 52, 834–849. https://doi.org/10.1080/15374416.2022.2025597
50.
SibleyM. H.PelhamW. E.Jr.MolinaB. S.GnagyE. M.WaschbuschD. A.GarefinoA. C.KuriyanA. B.BabinskiD. E.KarchK. M. (2012). Diagnosing ADHD in adolescence. Journal of Consulting and Clinical Psychology, 80(1), 139–150. https://doi.org/10.1037/a0026577
51.
SibleyM. H.RodriguezL.CoxeS.PageT.EspinalK. (2020). Parent–teen group versus dyadic treatment for adolescent ADHD: What works for whom?Journal of Clinical Child & Adolescent Psychology, 49(4), 476–492. https://doi.org/10.1080/15374416.2019.1585257
52.
SmithE.KoertingJ.LatterS.KnowlesM. M.McCannD. C.ThompsonM.Sonuga-BarkeE. J. (2015). Overcoming barriers to effective early parenting interventions for attention-deficit hyperactivity disorder (ADHD): Parent and practitioner views. Child: Care, Health and Development, 41(1), 93–102. https://doi.org/10.1111/cch.12146
53.
SprichS. E.SafrenS. A.FinkelsteinD.RemmertJ. E.HammernessP. (2016). A randomized controlled trial of cognitive behavioral therapy for ADHD in medication-treated adolescents. Journal of Child Psychology and Psychiatry, 57(11), 1218–1226. https://doi.org/10.1111/jcpp.12549
54.
SteingardR.SteinM.MarkowitzJ. S. (2022). Medications used for ADHD. In FulcanM. (Ed.), Dulcan’s textbook of child and adolescent psychiatry (3rd ed., pp. 695–728). American Psychiatric Press.
55.
WagnerC. C.SanchezF. P. (2002). The role of values in motivational interviewing. Motivational Interviewing: Preparing People for Change, 2, 284–298.
56.
WolraichM. L.HaganJ. F.AllanC.ChanE.DavisonD.EarlsM.EvansS. W.FlinnS. K.FroehlichT.FrostJ.HolbrookJ. R.LehmannC. U.LessinH. R.OkechukwuK.PierceK. L.WinnerJ. D.ZurhellenW. (2019). Clinical practice guideline for the diagnosis, evaluation, and treatment of attention-deficit/hyperactivity disorder in children and adolescents. Pediatrics, 144(4), e20192528. https://doi.org/10.1542/peds.2019-2528
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
