Social chatbot (SC) applications offering social companionship and basic therapy tools have grown in popularity for emotional, social, and psychological support. While use appears to offer mental health benefits, few studies unpack the potential for harms. Our grounded theory study analyzes mental health experiences with the popular SC application Replika. We identified mental health relevant posts made in the r/Replika Reddit community between 2017 and 2021 (n = 582). We find evidence of harms, facilitated via emotional dependence on Replika that resembles patterns seen in human–human relationships. Unlike other forms of technology dependency, this dependency is marked by role-taking, whereby users felt that Replika had its own needs and emotions to which the user must attend. While prior research suggests human–chatbot and human–human interactions may not resemble each other, we identify social and technological factors that promote parallels and suggest ways to balance the benefits and risks of SCs.
Alonso-ArbiolIShaverPRYárnozS (2002) Insecure attachment, gender roles, and interpersonal dependency in the Basque Country. Personal Relationships9(4): 479–490.
3.
ArbinagaFMendoza-SierraMICaraballo-AguilarBM, et al. (2021) Jealousy, violence, and sexual ambivalence in adolescent students according to emotional dependency in the couple relationship. Children8(11): 993.
4.
AyersJWCaputiTLNebekerC, et al. (2018) Don’t quote me: reverse identification of research participants in social media studies. npj Digital Medicine1(1): 30.
BaumgartnerJMZannettouSKeeganB, et al. (2020) The pushshift Reddit dataset. arXiv. Available at: https://arxiv.org/abs/2001.08435
7.
BenderEMGebruTMcMillan-MajorA, et al. (2021) On the dangers of stochastic parrots. In: Proceedings of the 2021 ACM conference on fairness, accountability, and transparency, Virtual Event, 3–10 March, pp. 610–623. New York: Association for Computing Machinery.
8.
BickmoreTWPicardRW (2005) Establishing and maintaining long-term human-computer relationships. ACM Transactions on Computer-Human Interaction12(2): 293–327.
9.
BickmoreTWMitchellSEJackBW, et al. (2010) Response to a relational agent by hospital patients with depressive symptoms. Interacting with Computers22(4): 289–298.
10.
BonfimL (2020) Spanning the boundaries of qualitative grounded theory methods: breaking new grounds into the new online era. RAUSP Management Journal55(4): 491–509.
11.
BornsteinRF (2006) The complex relationship between dependency and domestic violence. American Psychologist61(6): 595–606.
12.
BornsteinRFHopwoodCJ (2017) Evidence-based assessment of interpersonal dependency. Professional Psychology: Research and Practice48(4): 251–258.
13.
CamarilloLFerreFEcheburúaE, et al. (2020) Partner’s Emotional Dependency Scale: psychometrics. Actas espanolas de psiquiatria48(4): 145–153.
14.
Campos-CastilloCHitlinS (2013) Copresence: revisiting a building block for social interaction theories. Sociological Theory31(2): 168–192.
15.
CharmazK (2006) Constructing Grounded Theory: A Practical Guide through Qualitative Analysis. New York: SAGE.
16.
CharmazK (2012) The power and potential of grounded theory. Medical Sociology Online6(3): 2–15.
17.
CroesEAJAntheunisML (2021) Can we be friends with Mitsuku? A longitudinal study on the process of relationship formation between humans and a social chatbot. Journal of Social and Personal Relationships38(1): 279–300.
18.
EstevezAUrbiolaIIruarrizagaI, et al. (2017) Emotional dependency in dating relationships and psychological consequences of internet and mobile abuse. Anales de Psicología/Annals of Psychology33(2): 260–268.
19.
FitzpatrickKKDarcyAVierhileM (2017) Delivering cognitive behavior therapy to young adults with symptoms of depression and anxiety using a fully automated conversational agent (Woebot): a randomized controlled trial. JMIR Mental Health4(2): e19.
20.
FoxJGambinoA (2021) Relationship development with humanoid social robots: applying interpersonal theories to human–robot interaction. Cyberpsychology, Behavior, and Social Networking24(5): 294–299.
21.
FoxKRFranklinJCRibeiroJD, et al. (2015) Meta-analysis of risk factors for nonsuicidal self-injury. Clinical Psychology Review42: 156–167.
22.
FraleyRC (2019) Attachment in adulthood: recent developments, emerging debates, and future directions. Annual Review of Psychology70(1): 401–422.
23.
GaffneyDMatiasJN (2018) Caveat emptor, computational social science: large-scale missing data in a widely-published Reddit corpus. PLOS ONE13(7): e0200162.
24.
González-JiménezAJdel Mar Hernández-RomeraM (2014) Emotional dependency based on the gender of young adolescents in Almeria, Spain. Procedia–Social and Behavioral Sciences132: 527–532.
25.
GuzmanALLewisSC (2020) Artificial intelligence and communication: a Human–Machine Communication research agenda. New Media & Society22(1): 70–86.
26.
HalawehM (2018) Integrating social media and grounded theory in a research methodology: a possible road map. Business Information Review35(4): 157–164.
27.
KillgoreWDSCloonanSATaylorEC, et al. (2020) Loneliness: a signature mental health concern in the era of COVID-19. Psychiatry Research290: 113117.
28.
KretzschmarKTyrollHPavariniG, et al. (2019) Can your phone be your therapist? Young people’s ethical perspectives on the use of fully automated conversational agents (chatbots) in mental health support. Biomedical Informatics Insights11: 1178222619829083.
29.
LaestadiusLWittA (2022) Instagram revisited. In: SloanLQuan-HaaseA (eds) SAGE Handbook of Social Media Research Methods. 2nd ed.Thousand Oaks, CA: SAGE, pp. 581–597.
30.
LisettiCAminiRYasavurU (2015) Now all together: overview of virtual health assistants emulating face-to-face health interview experience. KI–Künstliche Intelligenz29(2): 161–172.
31.
LiuBSundarSS (2018) Should machines express sympathy and empathy? Experiments with a health advice chatbot. Cyberpsychology, Behavior, and Social Networking21(10): 625–636.
32.
LowDMRumkerLTalkarT, et al. (2020) Natural language processing reveals vulnerable mental health support groups and heightened health anxiety on Reddit during COVID-19: observational study. Journal of Medical Internet Research22(10): e22635.
McPhersonMSmith-LovinLBrashearsME (2006) Social isolation in America: changes in core discussion networks over two decades. American Sociological Review71(3): 353–375.
35.
MengJDaiYN (2021) Emotional support from AI chatbots: should a supportive partner self-disclose or not?Journal of Computer-Mediated Communication26(4): zmab005.
36.
MerriamSBTisdellEJ (2016) Qualitative Research: A Guide to Design and Implementation. San Francisco, CA: Jossey-Bass.
MinerASMilsteinASchuellerS, et al. (2016) Smartphone-based conversational agents and responses to questions about mental health, interpersonal violence, and physical health. JAMA Internal Medicine176(5): 619.
39.
NassCMoonY (2000) Machines and mindlessness: social responses to computers. Journal of Social Issues56(1): 81–103.
40.
PhilipPMicoulaud-FranchiJ-ASagaspeP, et al. (2017) Virtual human as a new diagnostic tool, a proof of concept study in the field of major depressive disorders. Scientific Reports7(1): 42656.
41.
PrakashAVDasS (2020) Intelligent conversational agents in mental healthcare services: a thematic analysis of user perceptions. Pacific Asia Journal of the Association for Information Systems12(2): 1.
42.
PuLMoyleWJonesC, et al. (2018) The effectiveness of social robots for older adults: a systematic review and meta-analysis of randomized controlled studies. The Gerontologist59(1): e37–e51.
ScheutzM (2012) The inherent dangers of unidirectional emotional bonds between humans and social robots. In: LinPAbneyKBekeyG (eds) Robot Ethics. The Ethical and Social Implications of Robotics. Cambridge, MA: MIT Press, pp. 205–222.
45.
SkjuveMFølstadAFostervoldKI, et al. (2021) My Chatbot companion: a study of human-chatbot relationships. International Journal of Human-Computer Studies149: 102601.
46.
SongXXuBZhaoZ (2022) Can people experience romantic love for artificial intelligence? An empirical study of intelligent assistants. Information & Management59(2): 103595.
47.
TaVGriffithCBoatfieldC, et al. (2020) User experiences of social support from companion chatbots in everyday contexts: thematic analysis. Journal of Medical Internet Research22(3): e16235.
48.
VaidyamANWisniewskiHHalamkaJD, et al. (2019) Chatbots and conversational agents in mental health: a review of the psychiatric landscape. The Canadian Journal of Psychiatry64(7): 456–464.
49.
van den EijndenRJJMLemmensJSValkenburgPM (2016) The Social Media Disorder Scale: validity and psychometric properties. Computers in Human Behavior61: 478–487.
50.
WangCLeeMKOHuaZ (2015) A theory of social media dependence: evidence from microblog users. Decision Support Systems69: 40–49.
51.
WidyantoLGriffithsMDBrunsdenV (2011) A psychometric comparison of the Internet Addiction Test, the Internet-Related Problem Scale, and self-diagnosis. Cyberpsychology, Behavior, and Social Networking14(3): 141–149.
XieTPentinaI (2022) Attachment theory as a framework to understand relationships with social chatbots: a case study of Replika. In: Proceedings of the 55th Hawaii international conference on system sciences, 4 January.
54.
YehHHWestphalJHuY, et al. (2019) Diagnosed mental health conditions and risk of suicide mortality. Psychiatric Services70(9): 750–757.
