Bidirectional associations between changes in symptoms and alliance are established for in-person psychotherapy. Alliance may play an important role in promoting engagement and effectiveness within unguided mobile-health (mHealth) interventions. Using models disaggregating alliance and psychological distress into within- and between-persons components (random intercept cross-lagged panel model), we report bidirectional associations between alliance and distress over the course of a 4-week smartphone-based meditation intervention (n = 302, 80.0% elevated depression/anxiety). Associations were stable across time, and effect sizes were similar to those observed for psychotherapy (distress to alliance: βs = −0.13 to −0.14; alliance to distress: βs = −0.09 to −0.10). Alliance may be worth measuring to improve the acceptability and effectiveness of mHealth tools. Further empirical and theoretical work characterizing the role and meaning of alliance in unguided mHealth is warranted.
BaierA. L.KlineA. C.FeenyN. C. (2020). Therapeutic alliance as a mediator of change: A systematic review and evaluation of research. Clinical Psychology Review, 82, Article 101921. https://doi.org/10.1016/j.cpr.2020.101921
2.
BaumelA.FaberK.MathurN.KaneJ. M.MuenchF. (2017). Enlight: A comprehensive quality and therapeutic potential evaluation tool for mobile and web-based eHealth interventions. Journal of Medical Internet Research, 19(3), Article e82. https://doi.org/10.2196/jmir.7270
3.
BaumelA.KaneJ. M. (2018). Examining predictors of real-world user engagement with self-guided eHealth interventions: Analysis of mobile apps and websites using a novel dataset. Journal of Medical Internet Research, 20(12), Article e11491. https://doi.org/10.2196/11491
4.
BaumelA.MuenchF.EdanS.KaneJ. M. (2019). Objective user engagement with mental health apps: Systematic search and panel-based usage analysis. Journal of Medical Internet Research, 21(9), Article e14567. https://doi.org/10.2196/14567
5.
BrownT. A. (2015). Confirmatory factor analysis for applied research (2nd ed.). The Guilford Press.
6.
ChoiS. W.SchaletB.CookK. F.CellaD. (2014). Establishing a common metric for depressive symptoms: Linking the BDI-II, CES-D, and PHQ-9 to PROMIS depression. Psychological Assessment, 26(2), 513–527.
7.
CohenS.WilliamsonG. (1988). Perceived stress in a probability sample of the United States. In SpacapanS.OskampS. (Eds.), The social psychology of health: Claremont Symposium on Applied Social Psychology (pp. 31–67). Sage.
8.
CollinsF. S.VarmusH. (2015). A new initiative on precision medicine. New England Journal of Medicine, 372(9), 793–795.
9.
CurranP. J.HowardA. L.BainterS. A.LaneS. T.McGinleyJ. S. (2014). The separation of between-person and within-person components of individual change over time: A latent curve model with structured residuals. Journal of Consulting and Clinical Psychology, 82(5), 879–894.
10.
DeRubeisR.BrotmanM.GibbonsC. (2005). A conceptual and methodological analysis of the nonspecifics argument. Clinical Psychology: Science and Practice, 12, 174–183.
11.
FalkenströmF.GranströmF.HolmqvistR. (2013). Therapeutic alliance predicts symptomatic improvement session by session. Journal of Counseling Psychology, 60(3), 317–328.
12.
FlückigerC.Del ReA. C.WampoldB. E.HorvathA. O. (2018). The alliance in adult psychotherapy: A meta-analytic synthesis. Psychotherapy, 55(4), 316–340.
13.
FlückigerC.Grosse HoltforthM.ZnojH. J.CasparF.WampoldB. E. (2013). Is the relation between early post-session reports and treatment outcome an epiphenomenon of intake distress and early response? A multi-predictor analysis in outpatient psychotherapy. Psychotherapy Research, 23(1), 1–13.
14.
FlückigerC.RubelJ.Del ReA. C.HorvathA. O.WampoldB. E.Crits-ChristophP.Atzil-SlonimD.CompareA.FalkenströmF.EkebladA.ErrázurizP.FisherH.HoffartA.HuppertJ. D.KivityY.KumarM.LutzW.MuranJ. C.StrunkD. R.. . . BarberJ. P. (2020). The reciprocal relationship between alliance and early treatment symptoms: A two-stage individual participant data meta-analysis. Journal of Consulting and Clinical Psychology, 88(9), 829–843. https://doi.org/10.1037/ccp0000594
15.
GálÉ.S,tefanS.CristeaI. A. (2021). The efficacy of mindfulness meditation apps in enhancing users’ well-being and mental health related outcomes: A meta-analysis of randomized controlled trials. Journal of Affective Disorders, 279, 131–142.
16.
GoldbergS. B. (2022). A common factors perspective on mindfulness-based interventions. Nature Reviews Psychology, 1(10), 605–619. https://doi.org/10.1038/s44159-022-00090-8
17.
GoldbergS. B.BaldwinS. A.RiordanK. M.TorousJ.DahlC. J.DavidsonR. J.HirshbergM. J. (2022). Alliance with an unguided smartphone app: Validation of the Digital Working Alliance Inventory. Assessment, 29(6), 1331–1345. https://doi.org/10.1177/10731911211015310
GoldbergS. B.LamS.SimonssonO.TorousJ.SunS. (2022). Mobile phone-based interventions for mental health: A systematic meta-review of 14 meta-analyses of randomized controlled trials. PLOS Digital Health, 1(1), Article e0000002. https://doi.org/10.1371/journal.pdig.0000002
20.
GrahamJ. W. (2009). Missing data analysis: Making it work in the real world. Annual Review of Psychology, 60, 549–576.
21.
HamakerE. L.KuiperR. M.GrasmanR. P. (2015). A critique of the cross-lagged panel model. Psychological Methods, 20(1), 102–116.
HensonP.WisniewskiH.HollisC.KeshavanM.TorousJ. (2019). Digital mental health apps and the therapeutic alliance: Initial review. BJPsych Open, 5(1), Article e15. https://doi.org/10.1192/bjo.2018.86
24.
HirshbergM. J.FryeC.DahlC. J.RiordanK. M.VackN. J.SachsJ.GoldmanR.DavidsonR. J.GoldbergS. B. (2022). A randomized controlled trial of a smartphone-based well-being training in public school system employees during the COVID-19 pandemic. Journal of Educational Psychology, 114(8), 1895–1911. https://doi.org/10.1037/edu0000739
25.
HorvathA.GreenbergL. (1989). Development and validation of the Working Alliance Inventory. Journal of Counseling Psychology, 36(2), 223–233.
26.
KilukB. D.SerafiniK.FrankforterT.NichC.CarrollK. M. (2014). Only connect: The working alliance in computer-based cognitive behavioral therapy. Behaviour Research and Therapy, 63, 139–146.
27.
KooK. H.TietQ. Q.RosenC. S. (2016). Relationships between racial/ethnic minority status, therapeutic alliance, and treatment expectancies among veterans with PTSD. Psychological Services, 13(3), 317–321.
28.
LinardonJ.CuijpersP.CarlbringP.MesserM.Fuller-TyszkiewiczM. (2019). The efficacy of app-supported smartphone interventions for mental health problems: A meta-analysis of randomized controlled trials. World Psychiatry, 18(3), 325–336.
29.
LinardonJ.Fuller-TyszkiewiczM. (2020). Attrition and adherence in smartphone-delivered interventions for mental health problems: A systematic and meta-analytic review. Journal of Consulting and Clinical Psychology, 88(1), 1–13.
30.
MiloffA.CarlbringP.HamiltonW.AnderssonG.ReuterskiöldL.LindnerP. (2020). Measuring alliance toward embodied virtual therapists in the era of automated treatments with the Virtual Therapist Alliance Scale (VTAS): Development and psychometric evaluation. Journal of Medical Internet Research, 22(3), Article e16660. https://doi.org/10.2196/16660
31.
MuthénL. K.MuthénB. O. (2017). Mplus user’s guide (8th ed.).
32.
Nahum-ShaniI.ShawS. D.CarpenterS. M.MurphyS. A.YoonC. (2022). Engagement in digital interventions. American Psychologist, 77(7), 836–852.
33.
PilkonisP. A.ChoiS. W.ReiseS. P.StoverA. M.RileyW. T.CellaD., & PROMIS Cooperative Group. (2011). Item banks for measuring emotional distress from the Patient-Reported Outcomes Measurement Information System (PROMIS): Depression, anxiety, and anger. Assessment, 18(3), 263–283.
34.
RobertiJ. W.HarringtonL. N.StorchE. A. (2006). Further psychometric support for the 10-item version of the Perceived Stress Scale. Journal of College Counseling, 9(2), 135–147.
35.
SatorraA.BentlerP. M. (2010). Ensuring positiveness of the scaled difference chi-square test statistic. Psychometrika, 75(2), 243–248.
36.
SchaletB. D.CookK. F.ChoiS. W.CellaD. (2014). Establishing a common metric for self-reported anxiety: Linking the MASQ, PANAS, and GAD-7 to PROMIS anxiety. Journal of Anxiety Disorders, 28(1), 88–96.
37.
SchnallR.RojasM.BakkenS.BrownW.Carballo-DieguezA.CarryM.GelaudeD.MosleyJ. P.TraversJ. (2016). A user-centered model for designing consumer mobile health (mHealth) applications (apps). Journal of Biomedical Informatics, 60, 243–251. https://doi.org/10.1016/j.jbi.2016.02.002
38.
SteinhublS. R.MuseE. D.TopolE. J. (2013). Can mobile health technologies transform health care?Journal of the American Medical Association, 310(22), 2395–2396.
39.
TongF.LedermanR.D’AlfonsoS.BerryK.BucciS. (2022). Digital therapeutic alliance with fully automated mental health smartphone apps: A narrative review. Frontiers in Psychiatry, 13, Article 819623. https://doi.org/10.3389/fpsyt.2022.819623
40.
WasilA. R.GillespieS.PatelR.PetreA.Venturo-ConerlyK. E.ShingletonR. M.WeiszJ. R.DeRubeisR. J. (2020). Reassessing evidence-based content in popular smartphone apps for depression and anxiety: Developing and applying user-adjusted analyses. Journal of Consulting and Clinical Psychology, 88(11), 983–993. https://doi.org/10.1037/ccp0000604
41.
WehmannE.KöhnenM.HärterM.LiebherzS. (2020). Therapeutic alliance in technology-based interventions for the treatment of depression: Systematic review. Journal of Medical Internet Research, 22(6), Article e17195. https://doi.org/10.2196/17195
42.
WeiselK. K.FuhrmannL. M.BerkingM.BaumeisterH.CuijpersP.EbertD. D. (2019). Standalone smartphone apps for mental health: A systematic review and meta-analysis. npj Digital Medicine, 2, Article 118. https://doi.org/10.1038/s41746-019-0188-8
43.
WhelenM. L.MurphyS. T.StrunkD. R. (2021). Reevaluating the alliance–outcome relationship in the early sessions of cognitive behavioral therapy of depression. Clinical Psychological Science, 9(3), 515–523.
44.
Zilcha-ManoS.FisherH. (2022). Distinct roles of state-like and trait-like patient–therapist alliance in psychotherapy. Nature Reviews Psychology, 1(4), 194–210.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
