Sage Journals: Discover world-class research

Abstract

Background

Mental health problems among children and adolescents increased in recent years, while mental health services are overburdened with long waiting lists. eHealth interventions, that is, interventions delivered digitally via apps or websites, offer a promising approach to prevent and efficiently treat emerging mental health problems in youth. Over the past years, rapid technological progress has led to diverse eHealth interventions for youth mental health. However, a structured overview of effective eHealth elements and mechanisms through which interventions aim to improve mental health is lacking. The aim of this pre-registered systematic review is to identify elements of eHealth interventions that improve mental health and well-being in children and adolescents aged 10–25 from both clinical and general populations.

Methods

This systematic review conducted in April 2023 in accordance with the Preferred Reporting Items for Systematic Review and Meta-Analysis guidelines identified 108 studies and 103 distinct interventions between 2011–2023. The overall sample size was 33,435 participants (30.7% male, mean age = 18.4 years, SD = 2.5). Most studies (64.8%) were randomized controlled trials (RCTs) to test the interventions. The remaining studies utilized a pre-post or group-comparison design (non-RCTs).

Results

The interventions were heterogeneous in design, method of delivery, target group and outcome measures. Overall, 77.7% of the studies showed a positive significant association between eHealth intervention and mental health or well-being. Elements that were often related to improved mental health and well-being were cognitive behavioural therapy (CBT) or self-monitoring as therapeutic principles, blended approaches combining eHealth with traditional therapy, peer/parental involvement and technological gamification elements, such as rewards.

Conclusions

Elements of youth eHealth interventions that appear to positively impact mental health or well-being are (a) CBT-based, (b) self-monitoring (c) blended interventions, (d) peer or parental involvement or (e) gamification. Future directions for the development and implementation of eHealth interventions for youth are discussed.

Keywords

EHealth intervention effective elements children adolescents systematic review mental health well-being

Introduction

Adolescence includes the life transition from childhood to adulthood and is marked by an increased vulnerability to mental health problems.¹ Currently, an estimated 13–25% of European adolescents suffer from depression or anxiety.² Current societal challenges, demands and major crises such as the COVID-19 pandemic, may further increase the risk of mental health problems.^3–6 One of the major challenges ahead is the overburdened healthcare system; timely identification and treatment of mental health problems are difficult, with a shortage of healthcare professionals, long waiting lists for treatment and lack of effective prevention strategies.⁷ Moreover, stigma associated with mental health problems and help-seeking, and complex ‘pathways to care’ further delay treatment.^8,9 Overall, for adolescents with mental health problems, it may take several years to be diagnosed and receive adequate treatment.^10,11 Therefore, alternative, easily accessible and sustainable approaches to promote resilience and prevent the onset of mental health problems in children and adolescents are urgently warranted.^12,13

A promising approach to prevent and treat mental health problems and to build resilience in adolescents is eHealth. eHealth can be defined as ‘health services and information delivered or enhanced through the Internet and related technologies’.¹⁴ Advantages of eHealth compared to face-to-face therapy for mental health problems include lower invasiveness, potential higher cost-effectiveness, lower threshold for help-seeking and efficient delivery of therapy.^15,16 The field of eHealth for mental health has evolved rapidly, with an enormous increase in the number of eHealth interventions in recent years.^17,18 This has resulted in a diverse range of existing eHealth interventions, varying in design, mode of delivery, content and mechanisms through which interventions aim to improve mental health. However, most eHealth interventions lack scientific substantiation.¹⁹ To develop evidence-based future-proof and sustainable eHealth interventions it is essential to understand which elements are effective. In this study, we review the literature on different elements (mode of delivery, therapeutic principles, blended intervention and/or involvement of others and interactive elements) of eHealth interventions aimed at enhancing mental health or well-being in children and adolescents.

Elements of eHealth interventions

The first element we investigate in this review is the mode of delivering interventions, that is, via smartphone applications, web-based or text messages. Earlier eHealth interventions targeting mental health were mainly computerized versions of cognitive behavioural therapy (CBT) or included additional telecommunications (i.e. text messages or emailing) to face-to-face therapy. Some contemporary eHealth interventions still include these elements. However, the rapid technological development and the rise of mobile technology in the last decade led to the development of eHealth interventions via websites or smartphone applications. Currently, there are around 20,000 mental health apps in the app store and the popularity continues to grow.²⁰ Importantly, providing eHealth interventions appears particularly useful and feasible for youth, since the vast majority (∼95%) of adolescents in the United States and Europe have access to smartphones or laptops.²¹

The second element in this review includes the therapeutic principles of eHealth interventions. According to recent systematic reviews of randomized controlled trials (RCTs), most eHealth interventions for youth are based on CBT and are related to improved mental health in children and adolescents.^22,23 CBT is a treatment approach that aims to identify and modify maladaptive patterns of thinking, emotional responses and behaviours.²⁴ An essential element of CBT is the learning and application of adaptive coping strategies, such as seeking social support, self-acceptance, positive distractions and problem solving. In adolescents, CBT is commonly used to treat depressive symptoms and disorders and has been found to be effective in reducing mental health problems and increasing well-being in youth.^25,26

The efficacy of eHealth interventions based on other therapeutic principles than CBT, such as positive psychology, mindfulness or self-monitoring, are less frequently investigated, resulting in inconclusive evidence.²⁷ However, there is empirical evidence on these therapeutic principles in regular care (non-eHealth contexts), which might be interesting to study further. Specifically, positive psychology is the scientific study of what makes life most worth living, focusing on both individual and societal well-being.²⁸ Interventions based on positive psychology specifically aim to enhance well-being instead of reducing psychopathological symptoms and can be used to complement clinical psychological interventions for mental health symptoms. Well-known examples of positive psychology interventions include practicing gratitude or forgiveness, being kind to others, writing about positive, meaningful or successful experiences and finding flow. Systematic reviews and meta-analyses found positive psychology interventions to be effective in increasing well-being, as well as decreasing depression and anxiety symptoms.^29,30 Moreover, originating from Buddhist practice and philosophy, mindfulness can be described as the state of being attentive to and aware of what is taking place in the present.³¹ Interventions to increase mindfulness often include meditation or relaxation practices and have been related to various mental health and well-being outcomes, both in adults³² and youth.³³ Furthermore, self-monitoring can be used as an element to improve mental health by enhancing emotional self-awareness.^34,35 Self-monitoring is nowadays mostly done via the experience sampling method (ESM) using the smartphone of the participant. ESM includes the repeated assessment of mood, behaviour and context per day. The collection of data on momentary positive and negative affect multiple times per day is thought to enhance self-insight and self-management, allowing for early identification of mood problems. Mood patterns can reveal important information for both the participant and the therapist if applied in a clinical setting.³⁵

The third element in this review is the addition of face-to-face therapy or inclusion of parents/peers in eHealth interventions. eHealth interventions can be administered as stand-alone (e.g. patients themselves play a mindfulness app), supported by peers or parents or blended in combination with face-to-face therapy. Recent reviews suggest that interventions are more likely to be effective when they include a face-to-face component compared to self-administered interventions.^22,23 However, conclusive evidence based on more studies is needed.

Lastly, the fourth element in eHealth interventions include advanced gamification or interactive elements. Technological advancements have resulted in the development of chatbots and serious gamification.^36,37 Chatbots are automated artificial intelligence (AI)-driven software. Through interactive interfaces, people can engage in conversations with chatbots via text or speech. Chatbots recently emerged in psychotherapy, providing guided psychotherapy via automated script-based dialogue.³⁶ In adults, chatbot-delivered psychotherapy seems to reduce depressive symptoms.³⁸ Gamification refers to the use of gaming elements in healthcare and digital health. It involves serious gaming, that is, teaching skills or knowledge through games and integrating game-like elements, such as earning points, rewards, challenges, group competition, to engage and motivate users in their healthcare activities.^39–41 A meta-analysis of 42 studies showed a positive effect of gamification on mental health in children, adolescents and adults.³⁶ The effect was consistent across platforms (smartphone vs website) and goals of the game (mental health enhancement, physical health enhancement or learning). Similarly, gamification was effective in samples with different characteristics, that is, age and clinical status, indicating the potential of gamification in eHealth interventions in diverse populations.

Taken together, despite a strong increase in eHealth tools, it is not yet clear which elements improve mental health and well-being in children and adolescents. Previous systematic reviews suggest that eHealth interventions are effective in improving mental health and well-being, but these interventions are mostly limited to CBT targeting depression and anxiety.^22,23,42 Other therapeutic principles, such as positive psychology, mindfulness or self-monitoring and other measures of mental health problems and well-being are not taken into account. This focus on CBT-based interventions leaves a significant gap in our understanding of how these alternative therapeutic approaches, which may offer unique benefits, contribute to mental health outcomes. Moreover, the rapid technological advancements and heightened interest in eHealth due to the COVID-19 pandemic have likely increased the variety and number of eHealth interventions beyond those previously reviewed. Therefore, there is a pressing need to evaluate these emerging interventions to identify which elements are most effective across different therapeutic approaches and outcomes.

Aims

In this systematic review, we describe elements of eHealth interventions aiming to reduce mental health problems and enhance well-being in children and adolescents aged 10–25 years both from clinical and general populations. We explicitly chose this broad age range from adolescence to young adulthood to provide a complete review that reflects the diversity of eHealth interventions available across different developmental stages (instead of focusing on only one developmental stage). This is in line with recent work that expanded the definition and timeframe of adolescence to include young adulthood, because adolescence mostly extends into the early 20 s, as more youth in modern societies are postponing traditional adult responsibilities such as starting a family, securing full-time employment or purchasing a house. By systematically exploring a broad range of therapeutic principles, we aim to provide a comprehensive understanding of the effective components of eHealth interventions. In particular, we include studies on eHealth interventions (both RCTs and non-RCTs) based on different therapeutic principles, assessing a wide range of mental health and well-being outcomes in clinical samples and samples from the general population. Understanding these elements is important for advancing the field, as it can inform the development of more targeted and effective eHealth solutions. First, we describe the elements of existing eHealth interventions, including the (a) mode of delivery, that is, smartphone application, web-based or text messages, (b) therapeutic principle of the intervention, such as CBT, mindfulness and positive psychology, (c) blended interventions and/or involvement of others, such as parents or peers and (d) interactive elements, such as chatbots or gamification. Second, we describe the mental health and well-being outcomes. Finally, we evaluate the effect of the different elements in improving mental health or well-being in children and adolescents.

Method

Search strategy and selection criteria

This systematic review is conducted and reported in accordance with the Preferred Reporting Items for Systematic Review and Meta-Analysis guidelines (Moher et al., 2009). Hypotheses and methods were pre-registered in PROSPERO (https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42023404110). The search was conducted in 02/2022 and updated in 04/2023 by the medical library of the Erasmus MC Rotterdam, The Netherlands. The electronic databases Embase, Medline ALL, PsycINFO, Web of Science, Cochrane and Google Scholar were used (see online supplemental materials A1 and A2 for search string queries).

Inclusion criteria included studies that investigated eHealth interventions aimed at reducing mental health problems (e.g. depression, anxiety and stress) or improving well-being in children and adolescents aged 10–25 years. Additionally, studies were included if they assessed the intervention effects using quantitative measures of mental health or well-being rather than qualitative approaches. Exclusion criteria were: (a) focus on a very specific target group (e.g. pregnant teenagers or paediatric patients), (b) no digital intervention, (c) intervention primarily targeting the support system of children/adolescents (e.g. parents), (d) evaluation via qualitative data, (e) no English article or full-text availability or (f) study protocols, systematic reviews, letters, case reports or conference abstracts.

Figure 1 provides an overview of the selection process and the reasons for exclusion. After the initial search, duplicates were manually removed. All remaining articles were assessed for relevance based on titles and abstracts. To ensure a robust selection process, five independent reviewers (SvE, ED, FB, MvdE, AV) participated, with a mean interrater reliability of 81.3%, indicating a strong level of agreement. Any discrepancies were resolved through consensus between two reviewers (SvE, ED). Full-text papers of the included 108 articles were independently assessed by two reviewers (SvE, ED) with a strong mean interrater reliability of 94.4%. Data extraction from all included papers was carried out by LdV, with validation and cross-checking performed by SvE and ED.

Figure 1.

PRISMA flow diagram of the search and selection process.

Data extraction and quality assessment

Data on descriptives, design, elements and efficacy were extracted from the included studies. Quality assessment and risk of bias in the included studies were performed using the national institute of health Quality Assessment tool (https://www.nhlbi.nih.gov/health-topics/study-quality-assessment-tools). This tool consists of a checklist with 14 (RCT) or 12 (non-RCT: pre-post/group comparison studies) questions, which can be answered with ‘yes’, ‘no’, otabr ‘cannot determine/not reported/not applicable’. To determine the quality rating of the studies, scores were assigned based on the percentage of items answered ‘yes’: >80% was considered good, 60–80% was considered fair, and <60% was considered poor quality (see online supplemental materials for details). The quality assessment was conducted by three reviewers (SvE, ED, LdV). Each study was evaluated by two reviewers. Initially, the reviewers individually rated the studies and, in case of inconsistencies between ratings, the differences were resolved through discussions until agreement was reached.

Results

Characteristics of studies and participants

In total, 108 studies were included. Table 1 shows the characteristics of the included studies. The studies were published between 2011 and 2023. The overall sample size was 33,435 participants. The average age of the participants ranged from 9.5 to 24.3 years, resulting in a mean age of 18.4 (SD = 2.5). The proportion of males was on average 30.7%. Studies were mostly conducted in Europe (k_{number of studies}= 34/108) followed by North America (k = 33/108), Oceania (k = 23/108), Asia (k = 17/108) and Africa (k = 1/108). Quality assessment indicated that a small proportion (17%) of the RCTs were considered to have poor quality, 64% had fair quality, and 19% had good quality (see Table A3 in the online supplemental materials). Of the non-RCTs, 50% of the studies had poor quality, and respectively, 37% and 13% of the studies had fair or good quality (see Table A4 in the online supplemental materials). Regarding power, among the RCTs, 53% (37/70) had an adequate sample size for detecting differences with at least 80% power. In non-RCTs, 32% (12/38) reported sufficient power. Over all studies, this means that 55% of the studies did not have an adequate sample size to detect effects. Furthermore, only 54% (58/108) of the studies pre-registered their methods and analyses.

Table 1.

Descriptive characteristics of included studies in the systematic review.

	Reference		Intervention	Co-creation	Registration	RCT			Intervention group					Control group
											Age					Age				Quality
							Country	Group	N	% male	Mean	SD	Range	N	%male	Mean	SD	Range	Type
Aboody et al.	⁴³	2020	GGBI	N.R.	√	√	ISR	G.P.	48	0.0	23.3	1.5	19–28	42	0.0	23.8	1.5	19–28	AO	71%
Akin-Sari et al.	⁴⁴	2022	GGcov	N.R.	×	√	TUR	G.P.	25	22.2	22.2	7.1	18–63	22	18.5	24.7	8.5	18–63	WL	64%
Alvarez-Jimenez et al.	⁴⁵	2020	MOST+	√	√	×	AUS	A.R.	157	23.0	19.1	2.3	16–25	–	–	–	–	–	–	64%
Anastasiadou et al.	⁴⁶	2020	TCApp	N.R.	×	√	ESP	C.P.	53	9.4	17.3	3.5	N.R.	53	7.7	18.9	7.8	N.R.	TAU	50%
Andrews et al.	⁴⁷	2022	Climate Schools	√	√	√	AUS	G.P.	1272	N.R.	13.6	N.R	N.R.	1267	N.R	13.5	N.R	N.R.	AO	79%
Arps et al.	⁴⁸	2018	N.R	√	×	×	NZL	G.P.	57	15.0	18.1	1.7	16–21	62	15.0	18.1	1.7	16–21	AM	86%
Babiano-Espinosa et al.	⁴⁹	2021	N.R	×	×	×	NOR	C.P.	25	44.0	13.1	2.9	8–17	–	–	–	–	–	–	79%
Badesha et al.	⁵⁰	2023	Sanvello	×	√	×	GBR	A.R.	5	0.0	16.2	0.8	15–17						–	64%
Bannink et al. a	⁵¹	2014	E-health4Uth	×	√	√	NLD	G.P.	392	56.9	15.8	0.7	15–16	434	51.4	15.8	0.7	15–16	AO	64%
Bannink et al. b	⁵¹	2014	E-health4Uth + consultation	×	–	√	NLD	G.P.	430	56.0	16.0	0.7	15–16	434	51.4	15.8	0.7	15–16	AO
Bohleber et al.	⁵²	2016	Companion app	√	×	×	CHE	G.P.	619	49.0	17.1	1.8	15–17	515				15–17	AO	79%
Bruehlman et al.	⁵³	2020	Nod	×	√	√	USA	G.P.	100	43.0	18.7	0.3	18–25	121	38.0	18.7	0.4	18–25	WL	71%
Bucci et al.	⁵⁴	2018	Actissist	√	√	√	GBR	C.P.	24	62.5	20.2	7.4	16+	12	25.0	18.3	7.0	16+	AM	71%
Burckhardt et al. a	⁵⁵	2015	Bite Back	N.R.	√	√	AUS	G.P.	94	0.0	13.8	1.6	12–18	90	0.0	13.8	1.6	12–18	AM	79%
Burckhardt et al. b	⁵⁵	2015	Bite Back	N.R.	–	√	AUS	G.P.	72	100.0	14.6	0.4	12–18	54	100.0	14.6	0.4	12–18	AM
Cliffe et al.	⁵⁶	2020	Sleepio	N.R.	×	×	GBR	C.P.	39	28.0	15.6	1.2	14–17	–	–	–	–	–	–	71%
Deady et al.	⁵⁷	2016	DEAL project	N.R.	√	√	AUS	A.R.	60	40.0	21.9	2.3	18–25	44	41.0	21.6	2.1	18–25	AM	57%
Dietvorst et al. a	⁵⁸	2022	Grow It! I	√	√	×	NLD	G.P.	462	32.0	16.7	3.1	12–25	–	–	–	–	–	–	71%
Dietvorst et al. b	⁵⁸	2022	Grow It! II	√	–	×	NLD	G.P.	733	19.0	18.7	3.7	12–25	–	–	–	–	–	–
Donovan et al. a	⁵⁹	2017	BRAVE-ONLINE	N.R.	×	√	AUS	C.P.	34	44.4	9.5	1.4	7–12	29	44.4	9.5	1.4	7–12	WL	57%
Donovan et al. b	⁵⁹	2017	BRAVE-ONLINE	N.R.	–	√	AUS	C.P.	44	39.4	13.9	1.7	12–18	27	39.4	13.9	1.7	12–18	WL
Fish et al.	⁶⁰	2019	Headspace	×	×	√	USA	G.P.	33	4.0	21.0	N.R	18–48	39	4.0	21.0	N.R	18–48	AO	71%
Fitzpatrick et al.	⁶¹	2017	Woebot	N.R.	×	√	USA	A.R.	34	21.0	22.6	2.4	18–28	36	7.0	21.8	2.2	18–28	AM	64%
Flett et al.	⁶²	2020	Headspace	×	√	√	NZL	G.P.	124	29.0	17.9	0.5	17–20	126	33.0	17.9	0.5	17–20	WL	71%
Flett et al. a	⁶³	2019	Headspace	×	√	√	NZL	G.P.	72	33.3	20.2	3.1	18–41	75	27.4	19.8	1.1	18–25	AM	86%
Flett et al. b	⁶³	2019	Smiling Mind	×	–	√	NZL	G.P.	63	28.6	20.2	4.0	18–49	75	27.4	19.8	1.1	18–25	AM
Frohlich et al.	⁶⁴	2021	Take Care of Me	N.R.	×	√	CAN	A.R.	114	30.7	24.8	4.4	18–35	108	33.3	24.3	4.3	18–35	AM	86%
Gonsalves et al.	⁶⁵	2021	POD Adventures	N.R.	×	×	IND	A.R.	248	50.0	15.6	N.R	13–19	–	–	–	–	–	–	57%
Haeger et al.	⁶⁶	2022	ACT daily	N.R.	×	×	USA	C.P.	11	18.2	23.6	5.1	20–38	–	–	–	–	–	–	71%
Haug et al.	⁶⁷	2017	ready4life	N.R.	×	×	CHE	G.P.	877	41.7	17.4	2.7	16+	–	–	–	–	–	–	79%
Haug et al.	⁶⁸	2021	SmartCoach	N.R.	√	√	CHE	G.P.	750	43.6	15.4	1.0	14–17	723	46.1	15.5	1.0	14–17	AO	86%
Heshmati et al. a	⁶⁹	2023	N.R	N.R.	×	√	USA	G.P.	51	31.9	N.R.	N.	18–22	55	31.9	N.R.	N.	18–22	AM	64%
Heshmati et al. b	⁶⁹	2023	N.R	N.R.	–	√	USA	G.P.	54	31.9	N.R.	N.R	18–22	55	31.9	N.R.	N.	18–22	AM
Hides et al.	⁷⁰	2019	Music eScape	√	√	√	AUS	G.P.	85	21.2	20.0	2.6	16–25	84	20.2	19.9	2.4	16–25	WL	79%
Hilt et al.	⁷¹	2021	CARE	N.R.	×	×	USA	A.R.	80	53.8	14.0	1.0	12–25	–	–	–	–	–	–	79%
Hoek et al.	⁷²	2012	Internet-based guided self-help intervention	N.R.	√	√	NLD	C.P.	22	31.8	15.8	N.	12–21	23	17.4	16.4	N.R	12–21	WL	57%
Hong et al.	⁷³	2018	RAW HAND	N.R.	×	×	KOR	C.P.	15	46.7	24.4	5.4	10–40	15	46.7	22.5	2.1	10–40	–	43%
Huberty et al.	⁷⁴	2019	Calm	×	√	√	USA	G.P.	41	12.2	20.4	2.3	18+	47	8.5	21.9	6.3	18+	WL	50%
Jeong et al.	⁷⁵	2020	Brake of my mind	√	×	×	KOR	C.P.	3	0.0	N.R.	N.R	15–19	–	–	–	–	–	–	43%
Jolstedt et al.	⁷⁶	2018	BiP Anxiety	N.R.	×	×	SWE	C.P.	19	37.0	10.5	1.6	8–12	–	–	–	–	–	–	71%
Jones et al.	⁷⁷	2020	MoodHwb	√	×	×	GBR	A.R.	43	21.0	16.3	2.4	13–23	–	–	–	–	–	–	79%
Karyotaki et al.	⁷⁸	2022	ICare Prevent	√	×	√	NLD	C.P.	48	20.8	21.8	2.7	18+	52	17.3	22.1	2.5	18+	TAU	64%
Kauer et al.	³⁴	2012	Mobile Tracking of Young People's Experiences	×	√	√	AUS	C.P.	69	22.1	18.5	3.2	14–24	49	37.0	17.4	3.2	14–24	AM	93%
Kenny et al.	⁷⁹	2020	CopeSmart	N.R.	√	√	GBR	G.P.	385	43.0	16.0	0.7	15–18	175	27.0	16.2	1.0	15–18	AO	71%
Kramer et al.	⁸⁰	2014	PratenOnline	N.R.	√	√	NLD	C.P.	131	20.6	19.4	1.6	12–22	132	22.0	19.6	1.8	12–22	WL	57%
Lattie et al.	⁸¹	2020	IntelliCare	N.R.	√	×	USA	G.P.	20	15.0	24.2	6.0	18+	–	–	–	–	–	–	79%
Lenhard et al.	⁸²	2014	BiP OCD	×	√	×	SWE	C.P.	21	38.1	14.4	2.6	12–17	–	–	–	–	–	–	71%
Levin et al. a	⁸³	2020	N.R	×	×	√	USA	A.R.	45	22.1	21.8	5.9	18+	45	20.0	21.7	3.3	18+	WL	64%
Levin et al. b	⁸³	2020	N.R	×	–	√	USA	A.R.	46	26.1	22.3	4.6	18+	45	20.0	21.7	3.3	18+	WL
Levin et al. c	⁸³	2020	N.R	×	–	√	USA	A.R.	45	33.3	23.3	6.1	18+	45	20.0	21.7	3.3	18+	WL
Lindqvist et al.	⁸⁴	2020	N.R.	×	√	√	SWE	C.P.	38	18	16.6	1.1	15–18	38	21	16.5	1.1	15–18	AM	79%
Littleton et al.	⁸⁵	2019	N.R.	N.R.	×	√	USA	C.P.	22	0	22.5	6.0	18–42	24	0	22.5	6.0	18–42	AM	86%
Liu et al.	⁸⁶	2022	XiaoNan	×	×	√	CHN	A.R.	41	41.5	23.4	1.8	19–28	42	47.6	22.8	1.7	19–28	AM	86%
Lyzwinski et al.	⁸⁷	2019	My Student Mindfulness App	×	√	√	AUS	G.P.	45	26.0	20.2	N.R	18–24	45	39.0	20.2	N.R	18–24	AM	93%
MacIsaac et al.	⁸⁸	2021	JoyPop	√	×	×	CAN	G.P.	156	21.2	19.0	2.9	16–38	–	–	–	–	–	–	50%
Manicavasagar et al.	⁸⁹	2014	Bite Back	N.R.	√	√	AUS	G.P.	62	35.5	15.5	1.6	12–18	92	30.4	15.3	1.7	12–18	AM	57%
March et al.	⁹⁰	2018	BRAVE Self-Help	√	×	×	AUS	A.R.	4425	31.8	13.0	3.0	7–17	–	–	–	–	–	–	79%
Mason et al.	⁹¹	2021	Peer Network Counseling-txt	N.R.	×	√	USA	A.R.	34	33.0	15.2	1.4	13–18	35	33.0	15.2	1.4	13–18	WL	64%
Mason et al.	⁹²	2023	CBT-txt	N.R.	×	√	USA	A.R.	53	17.0	22.0	2.0	18–25	49	17.0	22.0	2.0	18–25	WL	71%
McCall et al.	⁹³	2018	Overcome Social Anxiety	N.R.	×	√	CAN	A.R.	30	37.0	21.5	4.1	17–46	35	20.0	22.1	6.5	17–46	WL	64%
Melvin et al.	⁹⁴	2019	BeyondNow	√	×	×	AUS	C.P.	36	33.3	19.9	6.0	16–42	–	–	–	–	–	–	64%
Mens et al. a	⁹⁵	2022	Grow It!	√	√	×	NLD	G.P.	476	23.9	16.2	3.0	12–25	–	–	–	–	–	–	71%
Mens et al. b	⁹⁵	2022	Grow It!	√	–	×	NLD	G.P.	814	17.2	18.5	3.4	12–25	–	–	–	–	–	–
Na et al.	⁹⁶	2022	MEndorphins	√	√	×	KOR	G.P.	35	34.3	21.7	1.7	18–25	–	–	–	–	–	–	79%
Nagamitsu et al.	⁹⁷	2022	Mugimaru	N.R.	√	√	JPN	G.P.	71	37.9	N.R.	N.R	13–18	72	37.9	N.R.	N.R	13–18	AO	71%
Newman et al.	⁹⁸	2021	Lantern	N.R.	√	√	IND	C.P.	117	69.2	20.1	1.7	18–30	105	68.6	19.7	1.4	18–30	WL	71%
Nicol et al.	⁹⁹	2022	W-GenZ	N.R.	√	√	USA	C.P.	10	10.0	14.7	1.7	13–17	7	0.0	14.8	1.7	13–17	WL	86%
Nicolaidou et al.	¹⁰⁰	2021	Friends	×	×	×	CYP	G.P.	20	55.0	N.R.	N.R	9–10	21	47.7	N.R.	N.	9–10	AO	86%
Nordh et al.	¹⁰¹	2021	ICBT	N.R.	√	√	SWE	C.P.	51	20.0	13.6	2.0	10–17	52	27.0	14.5	2.1	10–17	TAU	79%
O'Dea et al.	¹⁰²	2020	WeClick	×	√	√	AUS	G.P.	98	13.3	14.8	1.0	12–16	95	13.7	14.9	0.9	12–16	WL	93%
Ofoegbu et al.	¹⁰³	2020	N.R.	N.R.	×	√	NGA	A.R.	56	44.2	24.2	5.2	17+	56	55.8	23.8	4.4	17+	AO	57%
Ong et al.	¹⁰⁴	2022	Intellect	N.R.	√	√	SGP	G.P.	149	34.2	21.7	2.1	18–30	161	29.0	21.5	2.0	18–30	AM	71%
PazCastro et al.	¹⁰⁵	2022	N.R.	N.R.	√	√	CHE	G.P.	750	43.6	15.4	1.0	14+	723	46.1	15.5	1.0	14+	AO	79%
Pinto et al.	¹⁰⁶	2016	eSMART-MH	N.R.	√	√	USA	A.R.	12	33.0	22.0	2.5	18–25	16	33.0	22.0	2.5	18–25	AM	71%
Ranney et al.	¹⁰⁷	2018	iDOVE	N.R.	×	√	USA	A.R.	58	41.4	14.8	1.2	13–17	58	41.4	15.1	1.1	13–17	AM	93%
Rauschenberg et al.	¹⁰⁸	2021	EMIcompass	×	×	×	NLD	C.P.	10	30.0	20.3	3.8	14–25	–	–	–	–	–	–	79%
Reid et al.	¹⁰⁹	2011	mobiletype	N.R.	√	√	AUS	C.P.	68	22.1	17.4	3.2	14–24	46	37	18.5	3.2	14–24	AM	79%
Reininghaus et al.	¹¹⁰	2023	EMIcompass	×	×	√	DEU	C.P.	46	23.9	21.3	2.8	14–25	46	30.4	22.0	2.1	14–25	TAU	79%
Rice et al.	¹¹¹	2018	Rebound	√	×	×	AUS	C.P.	42	50	18.5	2.1	15–24	–	–	–	–	–	–	86%
Rickhi et al. a	¹¹²	2015	LEAP project	N.R.	√	√	AUS	A.R.	18	22.2	15.3	N.R	12–18	13	7.69	15.2	N.R	13–17	WL	50%
Rickhi et al. b	¹¹²	2015	LEAP project	N.R.	–	√	CAN	A.R.	15	46.7	21.0	N.R	19–24	16	37.5	20.9	N.R	19–24	WL
Riggs et al.	¹¹³	2018	Marijuana eCHECKUPTOGO	N.R.	×	√	USA	A.R.	144	54.9	20.0	2.0	18+	154	47.4	20.0	2.0	18+	AM	58%
Rodriguez-De-Dios et al.	¹¹⁴	2021	CompDig	N.R.	×	×	ESP	G.P.	126	53.5	13.2	1.0	12–16	118	53.5	13.2	1.0	12–16	AO	58%
Roncero et al.	¹¹⁵	2019	GGRO	×	√	√	ESP	G.P.	51	25.5	22.9	9.2	18–65	46	10.9	20.1	2.7	18–65	WL	33%
Rushing et al.	¹¹⁶	2021	BRAVE	√	√	√	USA	G.P.	509	33.7	N.R.	N.R	15–24	521	33.7	N.R.	N.R	15–24	AM	67%
Ryan et al.	¹¹⁷	2022	N.R.	N.R.	×	×	USA	C.P.	27	15.0	N.R.	N.R	12–17	–	–	–	–	–	–	50%
Sakata et al.	¹¹⁸	2022	Resilience	N.R.	√	×	JPN	A.R.	1093	42.0	21.6	3.0	18–39	–	–	–	–	–	–	67%
Schlosser et al.	¹¹⁹	2018	PRIME	N.R.	×	√	USA	C.P.	22	60.0	24.3	2.6	16–36	21	65.0	23.8	4.5	16–36	TAU	58%
Schulte et al.	¹²⁰	2022	Boozebuster	√	√	√	NLD	G.P.	252	12.3	22.9	3.3	18–30	251	12.4	23.1	3.5	18–30	AM	67%
Schwinn et al.	¹²¹	2021	Vamos	N.R.	×	√	USA PRI	G.P.	321	39.4	14.2	1.1	12–15	323	39.5	14.0	1.1	12–15	AO	58%
Serlachius et al.	¹²²	2021	Whitu	√	×	×	NZL	G.P.	20	25.0	21.3	3.3	16–25	–	–	–	–	–	–	58%
Sethi et al. a	¹²³	2013	MoodGYM	N.R.	×	√	AUS	C.P.	21	38.0	20.3	1.4	18–25	23	43.0	19.5	1.3	18–25	AO	58%
Sethi et al. b	¹²³	2013	MoodGYM	N.R.	–	√	AUS	C.P.	23	17.0	20.8	1.2	18–25	23	43.0	19.5	1.3	18–25	AO
Sethi et al. c	¹²³	2013	MoodGYM	N.R.	–	√	AUS	C.P.	22	31.0	19.6	1.4	18–25	23	43.0	19.5	1.3	18–25	AO
Shrier et al.	¹²⁴	2014	MOMENT	N.R.	×	×	USA	A.R.	27	30.0	19.2	N.R	15–24	–	–	–	–	–	–	50%
Shroff et al.	¹²⁵	2023	YES	√	√	×	USA	G.P.	894	39.9	N.R.	N.R	11–17	–	–	–	–	–	–	67%
Silk et al.	¹²⁶	2020	SmartCAT2.0	√	×	×	USA	C.P.	34	50.0	11.4	1.6	9–14	–	–	–	–	–	–	58%
Srivastava et al.	¹²⁷	2020	Smartteen	N.R.	×	√	IND	C.P.	11	81.8	16.0	1.5	13–19	10	70.0	16.1	1.3	13–19	TAU	67%
Stallard et al.	¹²⁸	2018	Bluelce	√	×	×	GBR	C.P.	44	9.0	16.0	1.4	12–17	–	–	–	–	–	–	83%
Stevens et al.	¹²⁹	2022	Kooth	×	×	×	GBR	A.R.	302	12.6	16.7	N.R	13–21	–	–	–	–	–	–	75%
Suffoletto et al.	¹³⁰	2021	MoST-MH	N.R.	√	√	USA	C.P.	34	21.0	18.7	0.4	18+	18	0.0	18.7	0.5	18+	TAU	67%
Sun et al.	¹³¹	2022	Mindfulness	√	√	√	CHN	A.R.	57	26.3	22.2	2.7	18+	57	26.3	22.2	2.7	18+	AM	58%
Sun et al.	¹³²	2022	SME	√	√	√	CHN	G.P.	152	55.9	12.8	1.1	N.R.	238	52.5	13.3	1.2	N.R.	WL	67%
Takahashi et al.	¹³³	2019	SPSRS	N.R.	√	×	JPN	A.R.	22	72.7	20.0	0.6	18–24	–	–	–	–	–	–	58%
Thabrew et al.	¹³⁴	2022	Whitu	√	√	√	NZL	G.P.	45	6.7	22.7	3.7	16–30	45	13.3	24.6	3.7	16–30	WL	67%
Toh et al.	¹³⁵	2022	Intellect	N.R.	√	√	SGP	G.P.	135	27.7	22.9	6.3	18–59	129	21.7	22.0	4.3	18–59	AM	58%
Topooco et al.	¹³⁶	2019	Iterapi	N.R.	√	√	SWE	C.P.	35	9.0	17.5	1.1	15–19	35	0.0	17.5	1.2	15–19	AM	67%
Torok et al.	¹³⁷	2022	LifeBuoy	N.R.	√	√	AUS	C.P.	228	16.7	21.4	2.2	18–25	227	14.5	21.7	2.2	18–25	AM	83%
vanRosmalen-Nooijens et al.	¹³⁸	2017	Feel the ViBe	N.R.	√	√	NLD	A.R.	20	5.0	18.4	3.6	12–25	20	0.0	18.2	3.0	12–25	TAU	33%
vanVoorhees et al.	¹³⁹	2020	CATCH-IT	N.R.	√	√	USA	A.R.	193	N.R.	15.4	1.5	13–18	176	N.R.	15.4	1.5	13–18	AM	83%
Waite et al.	¹⁴⁰	2019	BRAVE ONLINE	N.R.	√	√	GBR	C.P.	30	46.7	14.2	1.4	13–18	30	23.3	15.2	1.3	13–18	WL	58%
Webb et al.	¹⁴¹	2022	CARE	N.R.	√	√	USA	A.R.	72	38.9	13.7	0.9	12–15	80	43.8	13.8	0.9	12–15	AM	50%
Webb et al.	¹⁴²	2021	CARE	N.R.	×	×	USA	G.P.	80	53.8	14.0	1.0	12–15	–	–	–	–	–	–	67%
Weintraub et al.	¹⁴³	2022	N.R.	N.R.	×	×	USA	C.P.	31	38.7	15.1	1.5	13–17	–	–	–	–	–	–	58%
Whiteside et al.	¹⁴⁴	2019	Anxiety Coach	N.R.	×	×	USA	C.P.	8	25.0	12.6	2.8	8–17	–	–	–	–	–	–	67%
Whittaker et al.	¹⁴⁵	2017	MEMO	N.R.	√	√	NZL	G.P.	426	31.7	14.3	0.9	13–17	429	31.7	14.3	0.9	13–17	AM	83%
Wiljer et al.	¹⁴⁶	2020	ThoughSpot	√	√	√	CAN	G.P.	241	18.9	22.9	3.4	17–29	240	19.6	23.2	3.1	17–29	TAU	67%
Wisman et al.	¹⁴⁷	2023	N.R.	N.R.	√	√	NLD	C.P.	21	23.8	16.5	1.3	13–18	18	22.2	16.3	1.2	13–18	TAU	83%
Zanden et al.	¹⁴⁸	2012	MYM	N.R.	√	√	NLD	C.P.	121	16.5	20.8	2.2	16–25	123	14.6	21.0	2.3	16–25	WL	67%
Zheng et al.	¹⁴⁹	2021	REAP	N.R.	√	√	CHN	G.P.	485	52.3	13.5	0.5	N.R.	469	52.3	13.5	0.5	N.R.	AO	58%

Note: N.R: not reported; Group: G.O./A.R./C.P.; G.O.: general population, A.R: at risk, C.P.: clinical population; Type: WL/TAU/AO; WL: waitlist, TAU: treatment as usual, AO: assessment only, AM: attention matched. The country abbreviations can be found at https://en.wikipedia.org/wiki/ISO_3166–1_alpha-3. Quality = >80% yes answers were considered good (green), 60%–80% were considered fair (yellow) and <60% were considered poor quality (red). Registration: pre-registration by means of a clinical trial registration for RCT or analyses pre-registration.

The 108 studies, including 103 distinct interventions, include a description of 112 evaluations of interventions (i.e. four studies compared two different interventions). The interventions Grow It! and Headspace were evaluated three times in different studies and samples, and the interventions Bite Back, CARE, EMIcompass, Intellect, and Whitu were each evaluated twice. Few eHealth interventions (24/103, 23.3%) were developed in co-creation or co-design with youth. The duration of the interventions differed substantially and ranged from a single session to 300 days, with an average of 54.4 days (SD = 46.2, median = 42 days).

Of the included studies, 70 (64.8%) were RCTs, 35 (32.4%) used a pre-post design (non-RCT), and the remaining three were group comparisons (non-RCT). Of the RCTs, 34 had a passive control group (assessment-only, k = 12, or a waitlist group, k = 22) and 37 studies had an active control group (attention-matched intervention, k = 27) or treatment as usual, k = 10). We report RCT results separately from non-RCT results because RCTs offer more rigorous control over confounding variables, reducing bias and providing clearer insights into the efficacy of interventions. The target population differed. Several studies (43/108; 39.8%) recruited children and adolescents from the general population, whereas 35.2% of the studies (38/108) included children or adolescents in clinical outpatient settings, and 25.0% (27/108) targeted participants at risk for mental health problems, such as adolescents exposed to family violence or those with parents diagnosed with mood disorders.

Elements

Tables 2 and 3 display the results regarding the elements of eHealth interventions in respectively RCT and non-RCT studies.

Mode of delivery. Approximately half of the interventions (54/103, 52.4%) were delivered through smartphone applications and this increased substantially over time (see Table 2) and Figure 2). Furthermore, 36/103 interventions (35.0%) delivered the intervention via websites, whereas seven studies, mostly older studies, utilized text messages. The remaining studies used a combination of either applications and websites (k = 4) or websites and text messages (k = 2).

Therapeutic principles. The different therapeutic principles of the interventions can be found in Figure 3. The interventions mostly included CBT (57/103, 53%), self-monitoring of daily mood (17/103, 13%), mindfulness (14/103, 13%) or positive psychology (10/103, 9%). The remaining interventions included content based on a range of theories and therapies, including motivational interviewing, dialectical behavioural therapy, acceptance and commitment therapy and family focused therapy. One-third of the interventions (35/103, 33%) combined content from different therapeutic principles, for example, both CBT and positive psychology. For more information on the intervention elements used in the studies, see Table A5 in the online supplemental materials.

Blended interventions and/or involvement of others. In 32 studies (28.6%), eHealth interventions were studied in a blended form, either by offering additional sessions with a therapist (26/32), classroom teaching (5/32), or in combination with a coach (1/32) or general practitioner (1/32). In 12 studies, parents were involved in the eHealth intervention and in five studies peers were involved.

Interactive elements. In three interventions (3/103) a chatbot was included. The chatbots were Woebot (Fitzpatrick et al., 2017; Nicol et al., 2022) and XiaoNan (Liu et al., 2022). Both chatbots are CBT-based and help adolescents to understand and regulate their emotions, thoughts and behaviours via tailored conversations.

Figure 2.

Mode of delivery used to deliver interventions by year. Note that the search was until April 2023, but in this figure, we included studies until 2022 to only include complete years.

Figure 3.

The number of interventions that included the different therapeutic principles.

Table 2.

Results of randomized controlled trials on elements of eHealth interventions.

Reference		Intervention	Duration	Elements					Efficacy
				Method	Principles	Gamification	Blended	Others involved	Mental health	Well-being
Aboody et al.	2020	GGBI	14	App	CBT	–	–	–	√	√
Akin-Sari et al.	2022	GGcov	12	App	CBT	–	–	–	√	–
Anastasiadou et al.	2020	TCApp	84	App	CBT, self-monitoring with feedback	Badges, points	Therapy	–	×	×
Andrews et al.	2022	Climate Schools	6 sessions	Website	CBT	–	Classroom	–	×	–
Bannink et al.	2014	E-health4Uth	1 session	Website	Tailored feedback	–	Classroom	–	√	√
Bannink et al.	2014	E-health4Uth + consultation with nurse	1 session	Website	Tailored feedback	–	Classroom, therapy	–	√	×
Bruehlman-Senecal et al.	2020	Nod	28	App	Positive psychology, mindfulness, CBT	–	–	–	×	–
Bucci et al.	2018	Actissist	84	App	CBT, self-monitoring with feedback	–	–	–	√	×
Burckhardt et al.	2015	Bite Back	42	Website	Positive psychology	–	Classroom	–	×	×
Deady et al.	2016	DEAL project	28	Website	CBT, motivational interviewing	–	–	–	√	–
Donovan et al.	2017	BRAVE-ONLINE	70	Website	CBT	Games	Therapy	Parents		–
Fish et al.	2019	Headspace	14	App	Mindfullness	Badges, points, buddies	–	–	√	–
Fitzpatrick et al.	2017	Woebot	14	App	CBT, chatbot	Rewards	–	–	√	×
Flett et al.	2019	Headspace	10	App	Mindfullness	Badges, points, buddies	–	–	√	√
Flett et al.	2019	Smiling Mind	10	App	Mindfullness	×	–	–	√	√
Flett et al.	2020	Headspace	92	App	Mindfullness	Badges, points, buddies	–	–	√	√
Haug et al.	2021	Smartcoach	154	Website, text messages	Social cognitive therapy	Rewards, points, competition	–	–	√	×
Haug et al.	2017	ready4life	183	Website, text messages	Social cognitive therapy	Rewards, points, competition	–	–	√	√
Heshmati et al.	2023	N.R.	15	App	Positive psychology	–	–	–	–	×
Heshmati et al.	2023	N.R.	15	App	Positive psychology + meditation	–	–	–	–	×
Hides et al.	2019	Music eScape	30	App	Music, self-monitoring with feedback	–	–	–	×	×
Hoek et al.	2012	N.R.	35	Website	Problem-solving	–	–	–	×	–
Huberty et al.	2019	Calm	56	App	Mindfulness, CBT	–	–	–	√	√
Karyotaki et al.	2022	ICare Prevent	49	Website	CBT	–	–	–	×	×
Kauer et al.	2012	Mobile Tracking of Young People's Experiences		App	Self-monitoring with feedback	–	–	–	√	√
Kenny et al.	2020	CopeSmart	28	App	ESM	–	–	–	×	×
Kramer et al.	2014	PratenOnline	5 sessions	Website	Solution-focused brief therapy	–	–	–	√	–
Levin et al.	2020		42	Website	ACT	–	–	–	√	√
Lindqvist et al.	2020		56	Website	Psychodynamic therapy	–	Therapy	–	√	√
Littleton et al.	2019		9 sessions	Website	CBT	–	Therapy	–	√	–
Liu et al.	2022	XiaoNan	112	App	Chatbot based on CBT	–	–	–	√	×
Lyzwinski et al.	2019	My Student Mindfulness App	77	App	Mindfulness	–	–	–	√	√
Manicavasagar et al.	2014	Bite Back	42	Website	Positive psychology	–	–	–	√	√
Mason et al.	2021	Peer Network Counseling-txt	28	Text messages	Peer network Counselling-txt: focuses on peer relations	–	–	Parents	√	√
Mason et al.	2023	CBT-txt	28	Text messages	CBT	–	–	–	√	–
McCall et al.	2018	Overcome Social Anxiety	28	Website	CBT	–	–	–	√	×
Nagamitsu et al.	2022	Mugimaru	14	App	CBT	–	–	–	√	×
Newman et al.	2021	Lantern	92	Website	CBT	–	Therapy	–	√	–
Nicol et al.	2022	W-GenZ (Woebot for adolescents)	84	App	Chatbot based on CBT, interpersonal psychotherapy, and dialectical behaviour therapy	–	–	–	×	×
Nordh et al.	2021	ICBT	10 sessions	Website	CBT	–	Therapy	Parents	√	√
O'Dea et al.	2020	WeClick	28	App	CBT	Avatars, serious game	–	–	×	√
Ofoegbu et al.	2020		70	Website	CBT	–	Therapy	–	√	–
Ong et al.	2022	Intellect	9	App	Cognitive dissonance, self-compassion approaches	–	–	–	√	√
PazCastro et al.	2022		154	Website	Social cognitive therapy	–	–	–	√	×
Pinto et al.	2016	eSMART-MH	84	Web-based (avatar digital therapeutic)	CBT	Avatar, serious game to learn skill	–	–	×	–
Ranney et al.	2018	iDOVE	56	Text messages	motivational interviewing, CBT	–	–	–	√	–
Reid et al.	2011	mobiletype	14–28	App	Self-monitoring with feedback	–	GP	–	×	√
Reininghaus et al.	2023	EMIcompass	42	App	Compassion focused, CBT	–	Therapy	–	√	√
Rickhi et al.	2015	LEAP project	56	Website	Spiritually informed principles	–	–	–	√	×
Riggs et al.	2018	Marijuana eCHECKUPTOGO	42	Website	Personalized feedback + PBS	–	–	–	√
Roncero et al.	2019	GGRO	15	App	CBT	–	–	–	√	√
Rushing et al.	2021	BRAVE	56	Text messages	CBT	–	–	–	×	×
Schlosser et al.	2018	PRIME	84	App	CBT, behavioural activation, mindfulness	–	Coach	Peers	√	√
Schulte et al.	2022	Boozebuster	42	App	PNF, MI, and PBS	–	–	–	×	–
Schwinn et al.	2021	Vamos	∼135	App	Social learning theory, MI, and bicultural competence	–	–	–	√	√
Sethi et al.	2013	MoodGYM	35	Website	CBT	–	Therapy	–	√	–
Srivastava et al.	2020	Smartteen	84	App	CBT and self-monitoring with feedback	Serious game to learn skills	Therapy	–	√	√
Suffoletto et al.	2021	MoST-MH	92	Text messages	positive psychology, CBT, DBT	–	–	–	√	×
Sun et al.	2022	Mindfulness for Growth and Resilience	30	App	Mindfullness	–	Therapy	Peers	√	√
Sun et al.	2022	Sharing Mind and Enjoyment (SME)	30	App	Family based	Badges, points, personalization	–	Parents	√	×
Thabrew et al.	2022	Whitu	28	App	Positive psychology, CBT	Badges, avatars	–	–	√	√
Toh et al.	2022	Intellect	8	App	CBT	–	–	–	√	–
Topooco et al.	2019	Iterapi	56	Website	CBT	–	Therapy	–	√	–
Torok et al.	2022	LifeBuoy	42	App	DBT	–	–	–	√	×
vanRosmalen-Nooijens et al.	2017	Feel the ViBe	84	Website	Psychoeducation, peer-support	–	–	–	×	–
vanVoorhees et al.	2020	CATCH-IT		Website	CBT and interpersonal psychotherapy	–	–	Parents	×	–
Waite et al.	2019	BRAVE for teenagers ONLINE	70	Website	CBT	–	Therapy	Parents	×	–
Webb et al.	2022		21	App	Mindfulness	–	–	–	√	–
Whittaker et al.	2017	MEMO	63	Mobile phone	CBT	–	–	–	×	–
Wiljer et al.	2020	ThoughSpot	183	Mobile and web app	Information about nearby mental health and wellness services, self-monitoring	–	–	–	√	×
Wisman et al.	2023		6 sessions	Website	Emotion regulation and CBT	–	Therapy	–	√	√
Zanden et al.	2012	Master your mood (MYM)	42	Website	CBT	–	–	Peers	√	√
Zheng et al.	2021	REAP	14	App	Physical activity	–	–	–	√	×

Note: ×: no(t) significant, –: no outcome found/not available, √: yes, significant. *Duration is in days, unless otherwise specified.

ACT: acceptance and commitment therapy; DBT: dialectical behaviour therapy; MI: motivational interviewing; PBS: protective behavioural strategies; PNF: personalized normative feedback.

Table 3.

Results of non-RCT studies on the elements of eHealth interventions.

Reference		Intervention	Duration	Elements					Efficacy
				Method	Principles	Gamification	Blended	Others involved	Mental health	Well-being
Alvarez-Jimenez et al.	2020	MOST+	7–63	Website	Strengths based approach	Serious game to learn skills, chat with peers	–	Peers	√	√
Arps et al.	2018	N.R.	28	Text messages	Positive psychology	–	–	–	×	√
Babiano-Espinosa et al.	2021	N.R.	98	App	CBT	–	Therapy	Parent	√	–
Badesha et al.	2023	Sanvello	35	App	CBT	–	Therapy	–	×	×
Bohleber et al.	2016	Companion app	300	App	CBT	–	–	–	×	×
Cliffe et al.	2020	Sleepio	∼60	App, website	CBT	–	–	–	√	–
Dietvorst et al.	2022	Grow It! Cohort I	42	App	CBT, ESM	Serious game (challenges) to learn skill, points, gifts, chat with peers, personalization	–	–	√	√
Dietvorst et al.	2022	Grow It! Cohort II	21	App	CBT, ESM	Serious game (challenges) to learn skill, points, gifts, chat with peers, personalization	–	–	√	√
Frohlich et al.	2021	Take Care of Me vs psychoeducation control program	56	Website	ESM, CBT, motivational interviewing	–	–	–	√	√
Gonsalves et al.	2021	POD Adventures	21	App	Problem × solving	Gamified stories	–	–	√	√
Haeger et al.	2022	ACT daily	14	App	Acceptance and commitment therapy, ESM	–	–	–	√	√
Hilt et al.	2021	CARE	21	App	ESM, mindfullness	–	–	–	√	–
Hong et al.	2018	RAW HAND	21	App	Exposure and response prevention	Serious game to learn skills	–	–	√	–
Jeong et al.	2020	Brake of my mind	N.R.	App	Theory of planned behaviour	–	–	–	√	–
Jolstedt et al.	2018	BiP Anxiety	84	Website	CBT	–	Therapy	Parents	√	√
Jones et al.	2020	MoodHwb	60	App, website	CBT, positive psychology, behavioural change theory	–	–	Parents	×	×
Lattie et al.	2020	IntelliCare	56	App	CBT	–	–	–	√	√
Lenhard et al.	2014	BiP OCD	84	Website	CBT	–	Therapy	Parents	√	–
MacIsaac et al.	2021	JoyPop	28	App	Self × regulation, ESM, journal, breathing exercises, game, art	Serious game to induce flow	–	–	√	√
March et al.	2018	BRAVE Self-Help	140	Website	CBT	–	–	–	√	–
Melvin et al.	2019	BeyondNow	61	App	Safety plan	–	Therapy	–	√	√
Mens et al.	2022	Grow It!	21–42	App	ESM, CBT	Serious game (challenges) to learn skill, points, gifts, chat with peers, personalization	–	–	√	√
Na et al.	2022	MEndorphins	7	App	Behavioural activation	–	–	–	√	–
Nicolaidou et al.	2021	Friends	42	Website	CBT	–	–	–	√	√
Rauschenberg et al.	2021	EMIcompass	21	App	Compassion focused intervention, CBT	–	Therapy	–	√	×
Rice et al.	2018	Rebound	84	Website	Positive psychology, mindfulness, strength × based intervention	Serious game to learn skills	Therapy	Peers	√	√
Rodriguez-De-Dios et al.	2021	CompDig	1 session	App	Narrative persuasion theory	Badges, points, personalization	Classroom	–	√	√
Ryan et al.	2022		30	Text messages	Brief caring text messages	–	–	–	√	–
Sakata et al.	2022	Resilience training	56	App	CBT	Serious game to learn skills	–	–	√	√
Serlachius et al.	2021	Whitu	14	App	CBT, positive psychology	Badges, avatars	–	–	√	×
Shrier et al.	2014		14	App	Motivational enhancement therapy	–	Therapy	–	√	–
Shroff et al.	2023	YES	1 session	Website	‘Project Personality’ (which teaches that personal traits are malleable), ‘The ABC Project’ (which teaches values × based activity engagement to elicit pleasure and accomplishment), and ‘Project CARE’ (which teaches the benefits of self × kindness in social and academic success)	–	–	–	√	–
Silk et al.	2020	SmartCAT2.0	56	App	CBT	Rewards, points	Therapy	–	√	√
Stallard et al.	2018	Bluelce	84	App	DBT, CBT, mood diary	–	Therapy	–	√	–
Stevens et al.	2022	Kooth	30	Website	Digital professional and peer support	–	–	–	√	√
Takahashi et al.	2019	SPSRS	35	App	Behavioural activation	–	–	–	√	×
Webb et al.	2021	CARE	21	App	Mindfulness, ESM	–	–	–	×	–
Weintraub et al.	2022		63	App	Family focused therapy, CBT	Serious game (challenges), rewards, points	–	Parents	√	√
Whiteside et al.	2019	Anxiety Coach	84	App, website	Parent × Coached Exposure Therapy (PC × Exp)	–	Therapy	Parents	×	–

Note: ×: no(t) significant, –: no outcome found/not available, √: yes, significant. *Duration is in days, unless otherwise specified.

Of the 103 interventions, 21 (20.4%) included one or more gamification elements (see online supplemental material A6). In 12 interventions, serious games were included to learn a specific skill, such as coping, exposure or communication. In 11 interventions, rewards, like badges or virtual gifts were included to enhance adherence. Similarly, in nine interventions the participants could earn points. In six interventions, participants could choose an avatar or personalize the intervention in another way. Finally, there was the opportunity to interact with peers, via a chat or buddy system in three interventions.

Mental health and well-being outcomes

Different outcome measures were used for mental health and well-being (see Figure 4 and Table A5 in the online supplemental materials). The most frequent mental health outcome measures included depressive symptoms or disorder (in 56% of the evaluations of interventions one or more measures of depression were included), anxiety (43%), alcohol use (13%) and stress (22%). The most frequent outcome measures of well-being included general well-being, such as quality of life or positive affect (32%), self-efficacy/self-esteem (16%), resilience (6%) and mindfulness (7%).

Figure 4.

Pie charts of different mental health (top) and well-being outcomes (bottom) used in the included studies to assess the efficacy of the different interventions.

All studies included a follow-up assessment shortly or directly after the intervention to assess the intervention effects. In addition, 48 studies of interventions (45%) included one or more extra follow-up assessments. This follow-up time was on average 4.0 months (SD = 3.2, range = 1–18 months).

Effects of eHealth intervention on well-being and mental health

Overall, 77.7% (84/108 studies) of the studies reported a significant positive association between the eHealth intervention and one or more mental health or well-being outcome measures. The percentage of studies showing a positive effect of the eHealth intervention on mental health or well-being varied based on the elements (mode of delivery, therapeutic principles, blended intervention and/or involvement of others, interactive elements) as described below.

1. Effects of mode of delivery

Of the 62 studies on interventions delivered via smartphone apps, 50 showed improved mental health or well-being (80.6%). Among the 37 web-based interventions, 28 studies showed improved mental health or well-being (75.7%). Interventions utilizing text messages improved mental health or well-being in 85.7% (six out of seven) of the studies. Finally, four out of six intervention studies (66.7%) combining different modes of delivery, for example, smartphone application and web-based) showed an improvement in mental health or well-being.

2. Effects of therapeutic principles

Figure 5 shows the therapeutic principles of the interventions in four categories (CBT, self-monitoring, mindfulness and positive psychology) and the proportion of studies reporting improved mental health or well-being. A darker color indicates a higher proportion of studies that reported a significant positive effect of the eHealth intervention on the outcome measure. In 58% of the studies, a positive significant association between CBT and any mental health or well-being measure was reported. Similarly, across all outcomes, 59% of the studies reported improved mental health or well-being due to interventions including self-monitoring. Interventions based on mindfulness showed positive significant associations with mental health and well-being in 50% of the studies and interventions based on positive psychology only in 32% of the studies.

Figure 5.

Effect of the therapeutic elements on mental health and well-being outcomes. The colours in the cells show the proportion of studies that reported improvements in mental health or well-being. A darker color indicates higher proportion of studies that reported a significant positive effect of the eHealth intervention on the outcome measure.

Besides the four described therapeutic principles, a large part of the studies included interventions based on other therapeutic principles, including motivational interviewing, dialectical behavioural therapy, acceptance and commitment therapy, or family focused therapy. The percentage of interventions based on these therapeutic principles that showed a positive significant association with mental health or well-being was not computed as this is uninformative due to the limited number of studies.

Taking into account the sustainability of intervention effects, we looked at the 48 intervention trials that included one or more additional follow-up assessments. Thirty of these trials included a CBT intervention, and 70% still showed effects on well-being and mental health 4 weeks to 6 months later. There were not enough follow-up assessments for other intervention elements to be able to say anything about sustainability.

3. Effects of blended interventions and/or involvement of others

Eighty studies provided the intervention as a stand-alone, and 60 (75%) of these showed a significant improved mental health or well-being. In 22/25 studies (88%) that combined the eHealth intervention with face-to-face therapy, there was an improvement in mental health or well-being. Additional classroom teaching, or sessions with a general practitioner (Reid et al., 2011) or coach (Schlosser et al., 2018), improved mental health or well-being in four of the six (67%) studies. The majority of the studies that involved parents (8/11, 72.7%) or peers (5/5100%) in the intervention showed an improvement in mental health or well-being.

4. Effects of interactive elements

Of the three interventions that included a chatbot, two studies showed reduced depression^61,86 versus.⁹⁹ Of the interventions with one or multiple gamification elements, 88.5% (23/26) reported improved mental health or well-being, compared to 74.4% (64/86) of interventions without gamification.

Discussion

There is an enormous increase in available eHealth applications, mounting over 20,000 mental health apps in the app store.²⁰ However, few of them have a solid scientific body of evidence. In this systematic review, we evaluated scientific studies on eHealth interventions for mental health and well-being in children and adolescents and reviewed which elements (mode of delivery, therapeutic principles, blended intervention and/or involvement of others, interactive elements) are effective in improving mental health and well-being. In total, 103 distinct interventions over a total of 33,435 participants were studied. Overall, in 77.7% of the studies eHealth interventions were related to improved mental health or well-being. Elements that were often reported to result in improved mental health and well-being were CBT and self-monitoring as therapeutic principle, a blended approach of combining eHealth with traditional therapy, parent/peer involvement and gamification elements, such as rewards. This suggests that these elements can be effective in enhancing mental health and well-being in youth via eHealth interventions. However, the quality of the studies varied, and the majority of the studies did not have sufficient power to detect an effect. These results emphasize that eHealth is often studied and can be effective in improving mental health and well-being in youth, but the quality of the research design and methodology should be taken into account.

Effective elements of eHealth interventions

In contrast to what can be found in the app store, all of the here described apps were based on scientific insights. Compared to the earlier reviews mainly focusing on CBT,^22,23,42 we evaluated a diverse range of therapeutic principles including CBT (57%), self-monitoring (13%), mindfulness (13%) and positive psychology (11%). One third of the interventions combined multiple therapeutic principles. We found that over half of the studies examining CBT-based eHealth interventions (58%) reported a significant improvement of mental health or well-being. This is comparable to findings described in earlier reviews.^22,23,42 However, CBT-based interventions differed widely in their exact content. Due to large heterogeneity in the exact content and outcome measures, we did not dive into these differences. However, we expect that disorder-specific content may enhance the efficacy of an eHealth CBT-based intervention. Furthermore, whereas for anxiety and depressive disorders specific content related to mental health and a long-term treatment might be needed,^25,26 improvements in well-being may require other content and possibly shorter interventions. Future research with standardized measures per outcome is needed to effectively compare such CBT-based eHealth interventions.

Significant improvements in mental health and well-being were reported in 59% of studies of eHealth interventions that included self-monitoring. The working mechanism of self-monitoring is improving mental health by enhancing emotional self-awareness, self-insight and self-management.^34,35 However, accurate self-monitoring depends on sufficient compliance; that is, participants should complete mood surveys when requested. Yet, adherence and compliance are challenging in both offline and online interventions.¹⁵⁰ Options to maximize compliance include active monitoring of compliance and personalizing questionnaires. In clinical settings, self-monitoring can be stimulated as part of a collaborative process between the patient and clinician, in which discussion of mood surveys is part of the treatment.¹⁵¹ Importantly, there were more non-RCT studies that reported a positive effect of self-monitoring (79% of 42 studies) than RCTs (30% of 27 studies; see online supplemental material A5). Although we did not conduct a meta-analysis and these results are not directly comparable, the difference in effectiveness between non-RCTs and RCTs is noteworthy. In RCTs, bias is reduced and cause-effect relationships between interventions and outcomes can be interpreted with more certainty than in non-RCTs. However, insights from studies in a less controlled environment (‘real world studies’ such as pre-post designs) on the intrinsic motivation for sustained engagement with a preventive app is essential if eHealth interventions are to be made publicly available for wider implementation. Therefore, evaluations in RCTs and non-RCTs could lead to different pieces of the puzzle in understanding the working mechanisms and effects of eHealth interventions.

Interventions based on mindfulness and positive psychology showed a positive significant effect on mental health or well-being in respectively 50% and 32% of the studies. The findings on mindfulness are partly in line with a meta-analysis of 20 studies on the effect of face-to-face mindfulness on anxiety, depression and stress among children.³³ The authors found that mindfulness had positive effects in 5/20 studies and reported a moderate meta-analytic effect of mindfulness (d = 0.37). The diversity in duration and exact content of mindfulness interventions differed. Therefore, the optimal conditions to benefit from mindfulness are not clear yet and need further investigation. Similarly, the effectiveness of positive psychology interventions in increasing mental health and well-being need future research.^29,30 Interventions based on positive psychology specifically aim to enhance well-being and can be used to complement clinical psychological interventions for mental health problems.²⁸ An explanation for the relatively low percentage of effective interventions could be the diverse positive psychology interventions, from practicing gratitude or forgiveness, being kind to others, writing about positive or meaningful experiences, to finding flow. This indicates that more research is needed to the effective elements within positive psychology.

Reviewing studies on blended eHealth interventions seem to suggest effectiveness. Combining eHealth interventions with face-to-face therapy, 88% of the studies showed improved mental health or well-being. Furthermore, 73% of the studies with involvement of parents showed an improvement in mental health or well-being, whereas all five interventions with involvement of peers showed positive effects. These findings are in line with earlier reviews^22,23 and indicate the potential importance of human interaction, and especially peers, in eHealth interventions for youth mental health.

Finally, interactive or gamification elements, such as rewards or avatars, were only included in 20% of the interventions described in this review. These elements might improve mental health or well-being: a slightly larger percentage of interventions with gamification elements showed improved mental health and well-being (89% versus 74% of interventions without gamification), replicating the consistent positive effects of gamification in the review of Cheng and colleagues.³⁶ One explanation of the mechanism behind the effects of gamification is that gamification increases adherence to the eHealth intervention due to positive reinforcement via rewards or points. This mechanism may be similar to face-to-face CBT where progress is recognized and rewarded in various ways, for example, using a sticker chart or praising the progress of behavioural change.¹⁵² Positive reinforcement as part of the therapist toolkit is associated with higher self-esteem and self-efficacy.¹⁵³ In contrast to face-to-face CBT that is mostly individual, gamification in eHealth interventions allows for team elements, such as contact with peers, to further increase adherence and user experience.^36,41 This indicates that gamification appears to have potential in eHealth interventions for mental health in youth. For a more detailed discussion about the role of gamification in eHealth see the focused review of Cheng and colleagues.³⁶

Strengths, limitations and future directions

In this systematic review we extend previous reviews^22,23,42 by including the most recent eHealth studies and more diverse interventions and outcome measures. For example, whereas Garrido et al.²² and Hollis et al.⁴² only included RCTs to assess the efficacy of eHealth interventions, we included both RCTs and non-RCT studies to review newer interventions with more advanced technology; for new interventions, (pilot) non-RCT studies are often the first step to test efficacy and RCTs are not always available.

This study also has limitations. First, a quantitative meta-analysis to test the effect size of different elements of the eHealth interventions was not possible, because the studies were too heterogeneous in study methods, outcomes, therapeutic principles, analyses and reported effect sizes. To increase opportunities for meta-analyses, we advocate for strict adherence to standardized reporting of eHealth interventions and evaluations, such as CONSORT-EHEALTH.¹⁵⁴ These guidelines require complete reporting of the theoretical framework of the intervention, as well as content, duration, mode of delivery, involvement of others, outcome measures, implementation and analyses methods.

Without a meta-analysis we could not directly compare results between studies. Instead, we report the proportion of studies that found significant effects of interventions on mental health and well-being. However, publication bias could have influenced the results and limited the generalizability of our findings. Studies with significant outcomes are more likely to be published, while those with null or negative results may remain unpublished. The high percentage of studies that reported a significant positive association between the eHealth intervention and one or more mental health or well-being outcome measures (77.7%) could indicate a publication bias. This selective reporting can lead to an overestimation of effects and limit the interpretation of effective elements. Second, we focused on the effects of single elements of eHealth interventions. However, most eHealth interventions included multiple elements; for example CBT, self-monitoring and gamification. By describing the individual effects, it is possible that we miss the interactive effects of the different elements. Therefore, future research should study the potential accumulative effect of specific combinations of different eHealth elements on mental health and well-being. Conducting factorial designs or intervention mapping approaches could provide insights into the specific mechanisms underlying these interactions.^155,156

Furthermore, although we grouped the therapeutic principles into commonly used definitions, such as CBT or mindfulness, the operationalization differed in various ways. For example, the content of CBT interventions widely differed between studies (e.g. conversations with chatbot, group-sessions or psychoeducation). Also, the duration of the intervention (8–300 days) differed widely. It is possible and likely that these differences in operationalization lead to differences in outcomes. The adherence to standardized reporting of eHealth interventions and evaluations as described above could help to further investigate associations between intervention designs and outcomes.

In addition, pre-registration should play an important role in new eHealth studies. Pre-registration can be seen as an indicator of the dedication to be transparent, rigorous and reproducible. The process of publicly registering study plans, hypotheses and methods, before conducting the study mitigates biases and enhances credibility of findings.¹⁵⁷ Of the studies included in this review only 54% of the studies was pre-registered. Furthermore, a substantial number of the studies had poor quality ratings. This could have affected the findings, as poor-quality studies may introduce various biases and errors that skew results. The high proportion of studies with poor quality, particularly among the non-RCT studies (50%), indicate the need for more high-quality research in this field. Similarly, power was not sufficient or not reported in 55% of the studies, limiting the reliability of the findings. Therefore, the overall conclusions drawn from this review should be considered with caution, and future research should focus on improving study quality to provide more evidence on the effectiveness of eHealth interventions.

In this review we included studies in adolescents between 12–25 years of age, and to be able to generalize the results to different populations, we included studies with adolescents from the general population, at-risk youth and clinical samples. The distribution of samples across these categories was mostly equal (39.8% general population, 35.2% clinical samples and 25.0% at risk for mental health problems). However, in other aspects the results could be less generalizable to the whole population. For example, the studies mostly included older adolescents (mean age of 18.4 years) mostly females (mean = 69.3%), and mostly adolescents from Europe and the United States. This indicates that future studies to eHealth interventions should include more diverse samples with respect to these sample characteristics.

Another important aspect to take into account is the perspective of youth on eHealth interventions themselves. Incorporating this perspective is important to ensure interventions are appealing for the target audience and working as intended.^158,159 However, in most of the studies included (77%) the involvement of youth or co-creation was not reported or not included in the development of eHealth interventions. Earlier experience with co-creation of the Grow It! intervention app¹⁶⁰ in our research group proved this approach valuable in understanding the world through the lens of future generations. Co-creation can be applied in different ways, depending on the desired involvement of the youth in the different stages of developing an eHealth intervention. For example, incorporating youth perspectives in eHealth development can be done through discussion groups and iterative feedback sessions to optimize an intervention that is already developed. Alternatively, in what is also called Participatory Action Research, youth are included at the start of the study and act as experience experts during all stages of the developmental process.¹⁶¹ Involving youth in some way in the process helps to ensure the intervention is user-friendly and relevant and this can enhance the effectiveness of the eHealth intervention. Therefore, we recommend co-creation with youth in the development of future eHealth interventions.

Furthermore, in recent years, the field of youth mental health has seen significant advancements through the integration of technology. This technological progress allows the inclusion of advanced elements in eHealth interventions, such as the use of generative AI and integration of large language models (LLMs) into mental healthcare.¹⁶² An application of LLMs in mental health care are chatbots. As described, the chatbot Woebot seems to positively affect adolescent mental health.^61,99 Woebot is based on CBT and uses generative AI to chat with users and to deliver personalized, in-the-moment support. The quick developments in the field of AI and LLM hold promise for creating more interactive, engaging and effective mental health interventions. These technologies can potentially provide scalable, accessible mental health support, bridging gaps in traditional care and reaching underserved populations. As AI continues to evolve, future research should focus on optimizing these tools, ensuring ethical standards and evaluating long-term impacts on youth mental health outcomes. For the opportunities and risk for AI-driven interventions in mental health see recent publications.¹⁶²

Technological advances can be used to further personalize interventions. Personalization can increase the involvement and therefore the efficacy of an intervention. For example, adolescents’ feeling of control can be enhanced by having them decide who will be involved (e.g. parent, peer, therapist) in different modules. Just-in-time adaptive interventions (JITAI) take personalization a step further. Unlike traditional interventions that follow a fixed schedule or set of rules, JITAIs dynamically adjust the intervention based on real-time data regarding an individual's current state or needs. The intervention can thus continuously evolve and delivers the right type of intervention precisely when it is needed. This adaptive approach aims to optimize its impact on the individual's mental health and well-being.¹⁶³

The next challenge of eHealth tools is to implement such tools in (clinical) practice.¹⁶⁴ While eHealth interventions hold significant promise for youth mental health, several challenges can hinder their successful implementation. For example, ensuring the privacy and security of users is crucial. To mitigate privacy risks, during the development of eHealth tools, attention should be paid to the anonymity of user data and adherence to strict data protection regulations, that is, the general data protection regulation.¹⁶⁵ Another challenge is the availability and continuity of technological support. If needed, support should be available for healthcare providers and users, but also continuous updates are needed to maintain the eHealth intervention.¹⁶⁶ Another important aspect of implementation is the target group. eHealth tools developed to be integrated in the clinical context have their own challenges such as the preference of patients and health-care professionals, and legal and ethical considerations.¹⁶⁷ Preventive eHealth tools aimed to be publicly available require a different dissemination strategy and face challenges in adoption and scale-up.¹⁶⁴ This review points to promising directions for effective eHealth interventions. However, the implementation of such tools in different groups remains challenging and requires future research. An eHealth implementation guideline has been developed that can help assess the determinants of successful eHealth intervention prior to the implementation.¹⁶⁶

Conclusion

Most of the 108 reviewed studies, covering 103 eHealth interventions, showed positive effects of eHealth interventions on mental health or well-being in children and adolescents. Specific elements of eHealth interventions that often enhance mental health or well-being include CBT, self-monitoring, a blended approach, involvement of parents or peers and gamification. More research to these potential effective elements and the accumulative effect of specific combinations of different elements, with standardized outcome measures are needed to understand under which circumstances and in which target groups eHealth interventions can be implemented in clinical practice and as preventive tool. With the continuing developments in technology, the development of eHealth interventions is expected to accelerate in the near future.

Key points and relevance

Youth mental health problems are increasing and mental health services are overburdened. eHealth tools can be promising to address mental health problems.

Rapid technological progress has led to diverse eHealth interventions.

A structured overview of effective eHealth elements through which interventions aim to improve mental health and well-being is lacking.

We show elements of eHealth interventions aimed at improving mental health and well-being in children and adolescents aged 10–25 years from clinical and general populations.

This review suggests that CBT and self-monitoring as therapeutic principles, blended interventions in combination with face-to-face therapy or the involvement of parents or peers, and gamification elements, such as rewards, can be effective elements of eHealth interventions for children and adolescents.

Supplemental Material

sj-docx-1-dhj-10.1177_20552076241294105 - Supplemental material for Effective elements of eHealth interventions for mental health and well-being in children and adolescents: A systematic review

Supplemental material, sj-docx-1-dhj-10.1177_20552076241294105 for Effective elements of eHealth interventions for mental health and well-being in children and adolescents: A systematic review by Evelien Dietvorst, Lianne P. de Vries, Stephanie van Eijl, Esther Mesman, Jeroen S. Legerstee, Loes Keijsers, Manon H. J. Hillegers and Annabel Vreeker in DIGITAL HEALTH

Supplemental Material

sj-xlsx-2-dhj-10.1177_20552076241294105 - Supplemental material for Effective elements of eHealth interventions for mental health and well-being in children and adolescents: A systematic review

Supplemental material, sj-xlsx-2-dhj-10.1177_20552076241294105 for Effective elements of eHealth interventions for mental health and well-being in children and adolescents: A systematic review by Evelien Dietvorst, Lianne P. de Vries, Stephanie van Eijl, Esther Mesman, Jeroen S. Legerstee, Loes Keijsers, Manon H. J. Hillegers and Annabel Vreeker in DIGITAL HEALTH

Footnotes

Acknowledgements

The authors wish to thank Dr Sabrina (S.T.G.) Meertens-Gunput from the Erasmus MC Medical Library for developing and updating the search strategies. We would like to thank Famke Bos and Maaike van der Eijk for their invaluable contributions in coding the title and abstract, as well as to Kim van den Dool for her assistance in the coding.

Declaration of conflicting interests

The authors declared no potential conflicts of interest with respect to the research, authorship and/or publication of this article.

Funding

This work is supported by the Sophia Foundation (grant number B18-05). This publication is part of the ‘eHealth junior’ project (with project number [NWA.1292.19.226]) of the NWA research program ‘Research on Routes by Consortia (Onderzoek op Routes door Consortia)’, which is funded by the Netherlands Organization for Scientific Research (NWO). Furthermore, this research is part of the PROTECt ME project funded by Convergence, the alliance between Erasmus Medical Center Rotterdam, Erasmus University Rotterdam and Delft University of Technology.

Consent statement

Ethical approval and informed consent were not applicable for this systematic review as it involved the collection and analysis of data from previously published studies. All data sources were publicly available, and no primary data collection or direct involvement of human participants occurred.

ORCID iD

Evelien Dietvorst

Supplemental material

Supplemental material for this article is available online.

References

Solmi

Radua

Olivola

, et al. Age at onset of mental disorders worldwide: large-scale meta-analysis of 192 epidemiological studies. Mol Psychiatry 2022; 27: 281–295.

World Health Organization. Adolescent mental health, https://www.who.int/news-room/fact-sheets/detail/adolescent-mental-health, accessed feb-20223 (2022).

Daly

. Prevalence of depression among adolescents in the US from 2009 to 2019: analysis of trends by sex, race/ethnicity, and income. J Adolesc Health 2022; 70: 496–499.

Poletti

Preti

Raballo

. From economic crisis and climate change through COVID-19 pandemic to Ukraine war: a cumulative hit-wave on adolescent future thinking and mental well-being. Eur Child Adolesc Psychiatry 2023; 32: 1815–1816.

Racine

McArthur

Cooke

, et al. Global prevalence of depressive and anxiety symptoms in children and adolescents during COVID-19: a meta-analysis. JAMA Pediatr 2021; 175: 1142–1150.

Wiederhold

. The escalating crisis in adolescent mental health. New York: Mary Ann Liebert, Inc., Publishers, 2022, pp.81–82.

Fegert

Kehoe

Çuhadaroglu Çetin

, et al. Next generation Europe: a recovery plan for children, adolescents and their families: for the time after the pandemic, we need a vision and investments for the future. Berlin, Germany: Springer, 2021, pp.991–995.

MacDonald

Fainman-Adelman

Anderson

, et al. Pathways to mental health services for young people: a systematic review. Soc Psychiatry Psychiatr Epidemiol 2018; 53: 1005–1038.

MacDonald

Ferrari

Fainman-Adelman

, et al. Experiences of pathways to mental health services for young people and their carers: a qualitative meta-synthesis review. Soc Psychiatry Psychiatr Epidemiol 2021; 56: 339–361.

10.

Hansen

Kjaersdam Telléus

Færk

, et al. Help-seeking pathways prior to referral to outpatient child and adolescent mental health services. Clin Child Psychol Psychiatry 2021; 26: 569–585.

11.

Raven

Jörg

Visser

, et al. Time-to-treatment of mental disorders in a community sample of Dutch adolescents. A TRAILS study. Epidemiol Psychiatr Sci 2017; 26: 177–188.

12.

Mesman

Vreeker

Hillegers

. Resilience and mental health in children and adolescents: an update of the recent literature and future directions. Curr Opin Psychiatry 2021; 34: 586–592.

13.

Masten

Motti-Stefanidi

. Multisystem resilience for children and youth in disaster: reflections in the context of COVID-19. Advers Resil Sci 2020; 1: 95–106.

14.

Eysenbach

. What is e-health? J Med Internet Res 2001; 3: e833.

15.

Odgers

Jensen

. Annual research review: adolescent mental health in the digital age: facts, fears, and future directions. J Child Psychol Psychiatry 2020; 61: 336–348.

16.

Odgers

Schueller

Ito

. Screen time, social media use, and adolescent development. Annu Rev Dev Psychol 2020; 2: 485–502.

17.

Camacho

Cohen

Torous

. Assessment of mental health services available through smartphone apps. AMA Netw Open 2022; 5: e2248784-e.

18.

Lau

O'Daffer

Colt

, et al. Android and iPhone mobile apps for psychosocial wellness and stress management: systematic search in app stores and literature review. JMIR Mhealth Uhealth 2020; 8: e17798.

19.

Marshall

Dunstan

Bartik

. Apps with maps—anxiety and depression mobile apps with evidence-based frameworks: systematic search of major app stores. JMIR Ment Health 2020; 7: e16525.

20.

Deloitte. Mental health goes mobile: The mental health app market will keep on growing. New York, USA: Deloitte, 2021.

21.

Statista. Smartphone ownership teenagers. New York, USA: Statista, 2022, pp. 1–19.

22.

Garrido

Millington

Cheers

, et al. What works and what doesn’t work? A systematic review of digital mental health interventions for depression and anxiety in young people. Front Psychiatry 2019; 10: 759.

23.

Lehtimaki

Martic

Wahl

, et al. Evidence on digital mental health interventions for adolescents and young people: systematic overview. JMIR Ment Health 2021; 8(4): e25847.

24.

Beck

. Cognitive behavior therapy: Basics and beyond. New York, United States: Guilford Publications, 2020.

25.

Oud

De Winter

Vermeulen-Smit

, et al. Effectiveness of CBT for children and adolescents with depression: a systematic review and meta-regression analysis. Eur Psychiatry 2019; 57: 33–45.

26.

Sigurvinsdóttir

Jensínudóttir

Baldvinsdóttir

, et al. Effectiveness of cognitive behavioral therapy (CBT) for child and adolescent anxiety disorders across different CBT modalities and comparisons: a systematic review and meta-analysis. Nord J Psychiatry 2020; 74: 168–180.

27.

Buyl

Beogo

Fobelets

, et al.

e-Health interventions for healthy aging: a systematic review

. Syst Rev 2020; 9: 1–15.

28.

Seligman

MEP

Csikszentmihalyi

. Positive psychology: An introduction. Washington, D.C., United States: American Psychological Association, 2000.

29.

Carr

Cullen

Keeney

, et al. Effectiveness of positive psychology interventions: a systematic review and meta-analysis. J Posit Psychol 2021; 16: 749–769.

30.

van Agteren

Iasiello

, et al. A systematic review and meta-analysis of psychological interventions to improve mental wellbeing. Nat Hum Behav 2021; 5: 631–652.

31.

Brown

. Play: How it shapes the brain, opens the imagination, and invigorates the soul. New York, United States: Penguin, 2009.

32.

Spijkerman

MPJ

Pots

WTM

Bohlmeijer

. Effectiveness of online mindfulness-based interventions in improving mental health: a review and meta-analysis of randomised controlled trials. Clin Psychol Rev 2016; 45: 102–114.

33.

Zoogman

Goldberg

Hoyt

, et al. Mindfulness interventions with youth: a meta-analysis. Mindfulness (N Y) 2015; 6: 290–302.

34.

Kauer

Reid

Crooke

AHD

, et al. Self-monitoring using mobile phones in the early stages of adolescent depression: randomized controlled trial. J Med Internet Res 2012; 14: e1858.

35.

van Os

Verhagen

Marsman

, et al. The experience sampling method as an mHealth tool to support self-monitoring, self-insight, and personalized health care in clinical practice. Depress Anxiety 2017; 34: 481–493.

36.

Cheng

Ebrahimi

. A meta-analytic review of gamified interventions in mental health enhancement. Comput Human Behav 2023; 141: 107621.

37.

Fleming

Cheek

Merry

, et al. Serious games for the treatment or prevention of depression: a systematic review. Rev Psicopatol Psicol Clin 2014; 19: 227–242.

38.

Lim

Shiau

CWC

Cheng

, et al. Chatbot-delivered psychotherapy for adults with depressive and anxiety symptoms: a systematic review and meta-regression. Behav Ther 2022; 53: 334–347.

39.

Yang

. Exploring the inverted-U relationship between gamification achievement and health management performance. Comput Human Behav 2021; 121: 106805.

40.

Deterding

Dixon

Khaled

Nacke

(eds.). From game design elements to gamefulness: Defining “gamification”. In: Proceedings of the 15th International Academic MindTrek Conference: Envisioning Future Media Environments Tampere, Finland, September 28-30, 2011. New York, NY: Association for Computing Machinery (ACM), p. 40, 2011.

41.

Sardi

Idri

Fernández-Alemán

. A systematic review of gamification in e-Health. J Biomed Inform 2017; 71: 31–48.

42.

Hollis

Falconer

Martin

, et al. Annual research review: digital health interventions for children and young people with mental health problems–a systematic and meta-review. J Child Psychol Psychiatry 2017; 58: 474–503.

43.

Aboody

Siev

Doron

. Building resilience to body image triggers using brief cognitive training on a mobile application: a randomized controlled trial. Behav Res Ther 2020; 134: 103723.

44.

DOI: 1016/j.brat.2020.103723.

45.

Akin-Sari

Inozu

Haciomeroglu

, et al.

Cognitive training using a mobile app as a coping tool against COVID-19 distress: a crossover randomized controlled trial

. J Affect Disord 2022; 311: 604–613.

46.

Alvarez-Jimenez

Rice

D'Alfonso

, et al. A novel multimodal digital service (moderated online social therapy+) for help-seeking young people experiencing mental ill-health: pilot evaluation within a national youth e-mental health service. J Med Internet Res 2020; 22: e17155.

47.

Anastasiadou

Folkvord

Brugnera

, et al. An mHealth intervention for the treatment of patients with an eating disorder: a multicenter randomized controlled trial. Int J Eating Disord 2020; 53: 1120–1131.

48.

Andrews

Birrell

Chapman

, et al. Evaluating the effectiveness of a universal eHealth school-based prevention programme for depression and anxiety, and the moderating role of friendship network characteristics. Psychol Med 2023; 53: 5042–5051.

49.

Arps

Friesen

Overall

. Promoting youth mental health via text-messages: a New Zealand feasibility study. Appl Psychol Health Well-Being. 2018; 10: 457–480.

50.

Babiano-Espinosa

Wolters

Weidle

, et al. Acceptability and feasibility of enhanced cognitive behavioral therapy (eCBT) for children and adolescents with obsessive–compulsive disorder. Child Adolesc Psychiatry Ment Health 2021; 15: 1–11.

51.

Badesha

Wilde

Dawson

. Mental health mobile application self-help for adolescents exhibiting psychological distress: a single case experimental design. Psychology and psychotherapy: theory. Res Pract 2023; 96: 223–248.

52.

Bannink

Broeren

Joosten-van Zwanenburg

, et al.

Effectiveness of a web-based tailored intervention (E-health4Uth) and consultation to promote adolescents’ health: randomized controlled trial

. J Med Internet Res 2014; 16: e3163.

53.

Bohleber

Crameri

Eich-Stierli

, et al. Can we foster a culture of peer support and promote mental health in adolescence using a web-based app? A control group study. JMIR Ment Health 2016; 3: e5597.

54.

Bruehlman-Senecal

Hook

Pfeifer

, et al. Smartphone app to address loneliness among college students: pilot randomized controlled trial. JMIR Ment Health 2020; 7: e21496.

55.

Bucci

Barrowclough

Ainsworth

, et al. Actissist: proof-of-concept trial of a theory-driven digital intervention for psychosis. Schizophr Bull 2018; 44: 1070–1080.

56.

Burckhardt

Manicavasagar

Batterham

, et al. A web-based adolescent positive psychology program in schools: randomized controlled trial. J Med Internet Res 2015; 17: e4329.

57.

Cliffe

Croker

Denne

, et al. Digital cognitive behavioral therapy for insomnia for adolescents with mental health problems: feasibility open trial. JMIR Ment Health 2020; 7: e14842.

58.

Deady

Mills

Teesson

, et al. An online intervention for co-occurring depression and problematic alcohol use in young people: primary outcomes from a randomized controlled trial. J Med Internet Res 2016; 18: e5178.

59.

Dietvorst E

Vreeker A

Koval

, et al. The grow it! app—longitudinal changes in adolescent well-being during the COVID-19 pandemic: a proof-of-concept study. Eur Child Adolesc Psychiatry 2023; 32: 1097–1107.

60.

Donovan

Spence

March

. Does an online CBT program for anxiety impact upon sleep problems in anxious youth? Sleep and developmental psychopathology. Milton Park, Abingdon-on-Thames, Oxfordshire, England, UK: Routledge, 2018, pp.42–52.

61.

Fitzpatrick

Darcy

Vierhile

. Delivering cognitive behavior therapy to young adults with symptoms of depression and anxiety using a fully automated conversational agent (Woebot): a randomized controlled trial. JMIR Ment Health 2017; 4: e7785.

62.

Fish

Saul

. The gamification of meditation: a randomized-controlled study of a prescribed mobile mindfulness meditation application in reducing college students’ depression. Simul Gaming 2019; 50: 419–435.

63.

Flett

JAM

Conner

Riordan

, et al. App-based mindfulness meditation for psychological distress and adjustment to college in incoming university students: a pragmatic, randomised, waitlist-controlled trial. Psychol Health 2020; 35: 1049–1074.

64.

Flett

JAM

Hayne

Riordan

, et al. Mobile mindfulness meditation: a randomised controlled trial of the effect of two popular apps on mental health. Mindfulness (N Y) 2019; 10: 863–876.

65.

Frohlich

Rapinda

Schaub

, et al. Efficacy of a minimally guided internet treatment for alcohol misuse and emotional problems in young adults: results of a randomized controlled trial. Addict Behav Rep 2021; 14: 100390.

66.

Gonsalves

Hodgson

Bhat

, et al. App-based guided problem-solving intervention for adolescent mental health: a pilot cohort study in Indian schools. BMJ Ment Health 2021; 24: 11–18.

67.

Haeger

Davis

Levin

. Utilizing ACT daily as a self-guided app for clients waiting for services at a college counseling center: a pilot study. J Am Coll Health 2022; 70: 742–749.

68.

Haug

Paz Castro

Meyer

, et al. A mobile phone-based life skills training program for substance use prevention among adolescents: pre-post study on the acceptance and potential effectiveness of the program, Ready4life. JMIR Mhealth Uhealth 2017; 5: e143.

69.

Haug

Castro

Wenger

, et al. A mobile phone–based life-skills training program for substance use prevention among adolescents: cluster-randomized controlled trial. JMIR Mhealth Uhealth 2021; 9: e26951.

70.

Heshmati

Muth

, et al. Capturing the heterogenous effects of a mobile-health psychological well-being intervention for early adults: Results from a process-oriented approach. PsyarXiv 2023 (preprint).

71.

Hides

Dingle

Quinn

, et al. Efficacy and outcomes of a music-based emotion regulation mobile app in distressed young people: randomized controlled trial. JMIR Mhealth Uhealth 2019; 7: e11482.

72.

Hilt

Swords

. Acceptability and preliminary effects of a mindfulness mobile application for ruminative adolescents. Behav Ther 2021; 52: 1339–1350.

73.

Hoek

Schuurmans

Koot

, et al. Effects of Internet-based guided self-help problem-solving therapy for adolescents with depression and anxiety: a randomized controlled trial. PLoS ONE 2012, pp. 1–6.

74.

Hong

Kim

Aboujaoude

, et al. Investigation of a mobile “serious game” in the treatment of obsessive–compulsive disorder: a pilot study. Games Health J 2018; 7: 317–326.

75.

Huberty

Green

Glissmann

, et al. Efficacy of the mindfulness meditation mobile app “calm” to reduce stress among college students: randomized controlled trial. JMIR Mhealth Uhealth 2019; 7: e14273.

76.

Jeong

Chang

Kim

. Development and feasibility of a safety plan mobile application for adolescent suicide attempt survivors. CIN: computers, informatics. Nursing 2020; 38: 382–392.

77.

Jolstedt

Ljótsson

Fredlander

, et al. Implementation of internet-delivered CBT for children with anxiety disorders in a rural area: a feasibility trial. Internet Interv 2018; 12: 121–129.

78.

Jones

Thapar

Rice

, et al. A digital intervention for adolescent depression (MoodHwb): mixed methods feasibility evaluation. JMIR Ment Health 2020; 7: e14536.

79.

Karyotaki

Klein

Ciharova

, et al. Guided internet-based transdiagnostic individually tailored cognitive behavioral therapy for symptoms of depression and/or anxiety in college students: a randomized controlled trial. Behav Res Ther 2022; 150: 104028.

80.

Kenny

Fitzgerald

Segurado

, et al. Is there an app for that? A cluster randomised controlled trial of a mobile app–based mental health intervention. Health Informatics J 2020; 26: 1538–1559.

81.

Kramer

Conijn

Oijevaar

, et al. Effectiveness of a web-based solution-focused brief chat treatment for depressed adolescents and young adults: randomized controlled trial. J Med Internet Res 2014; 16: e3261.

82.

Lattie

Cohen

Winquist

, et al. Examining an app-based mental health self-care program, intellicare for college students: single-arm pilot study. JMIR Ment Health 2020; 7: e21075.

83.

Lenhard

Vigerland

Andersson

, et al. Internet-delivered cognitive behavior therapy for adolescents with obsessive-compulsive disorder: an open trial. PloS One 2014; 9: e100773.

84.

Levin

Krafft

Hicks

, et al. A randomized dismantling trial of the open and engaged components of acceptance and commitment therapy in an online intervention for distressed college students. Behav Res Ther 2020; 126: 103557.

85.

Lindqvist

Mechler

Carlbring

, et al. Affect-focused psychodynamic internet-based therapy for adolescent depression: randomized controlled trial. J Med Internet Res 2020; 22: e18047.

86.

Liu

Peng

Song

, et al. Using AI chatbots to provide self-help depression interventions for university students: a randomized trial of effectiveness. Internet Interv 2022; 27: 100495.

87.

Littleton

Grills

. Changes in coping and negative cognitions as mechanisms of change in online treatment for rape-related posttraumatic stress disorder. J Trauma Stress 2019; 32: 927–935.

88.

Lyzwinski

Caffery

Bambling

, et al. The mindfulness app trial for weight, weight-related behaviors, and stress in university students: randomized controlled trial. JMIR Mhealth Uhealth 2019; 7: e12210.

89.

MacIsaac

Mushquash

Mohammed

, et al. Adverse childhood experiences and building resilience with the JoyPop app: evaluation study. JMIR Mhealth Uhealth 2021; 9: e25087.

90.

Manicavasagar

Horswood

Burckhardt

, et al. Feasibility and effectiveness of a web-based positive psychology program for youth mental health: randomized controlled trial. J Med Internet Res 2014; 16: e140.

91.

March

Spence

Donovan

, et al. Large-scale dissemination of internet-based cognitive behavioral therapy for youth anxiety: feasibility and acceptability study. J Med Internet Res 2018; 20: e234.

92.

Mason

Coatsworth

Russell

, et al. Reducing risk for adolescent substance misuse with text-delivered counseling to adolescents and parents. Subst Use Misuse 2021; 56: 1247–1257.

93.

Mason

Coatsworth

Zaharakis

, et al. Treating young adult depression with text-delivered cognitive behavioral therapy: a pilot randomized clinical trial. Behav Ther 2023; 54: 315–329.

94.

McCall

Richardson

Helgadottir

, et al. Evaluating a web-based social anxiety intervention among university students: randomized controlled trial. J Med Internet Res 2018; 20: 91.

95.

Melvin

Gresham

Beaton

, et al. Evaluating the feasibility and effectiveness of an Australian safety planning smartphone application: a pilot study within a tertiary mental health service. Suicide Life Threat Behav 2019; 49: 846–858.

96.

Mens

MMJ

Keijsers

Dietvorst

, et al. Promoting daily well-being in adolescents using mHealth. J Youth Adolesc 2022; 51: 2173–2189.

97.

Lee

Kim

(eds). Development and Evaluation: A behavioral activation mobile application for self-management of stress for college students. Healthcare 2022, pp. 1–11.

98.

Nagamitsu

Kanie

Sakashita

, et al. Adolescent health promotion interventions using well-care visits and a smartphone cognitive behavioral therapy app: randomized controlled trial. JMIR Mhealth Uhealth 2022; 10: e34154.

99.

Nicol

Wang

Graham

, et al. Chatbot-delivered cognitive behavioral therapy in adolescents with depression and anxiety during the COVID-19 pandemic: feasibility and acceptability study. JMIR Form Res 2022; 6: e40242.

100.

Newman

Kanuri

Rackoff

, et al. A randomized controlled feasibility trial of internet-delivered guided self-help for generalized anxiety disorder (GAD) among university students in India. Psychotherapy. 2021; 58: 591.

101.

Nicolaidou

Stavrou

Leonidou

. Building primary-school children’s resilience through a web-based interactive learning environment: quasi-experimental pre-post study. JMIR Pediatr Parent 2021; 4: e27958.

102.

Nordh

Wahlund

Jolstedt

, et al. Therapist-guided internet-delivered cognitive behavioral therapy vs internet-delivered supportive therapy for children and adolescents with social anxiety disorder: a randomized clinical trial. JAMA Psychiatry 2021; 78: 705–713.

103.

O’Dea

Han

Batterham

, et al. A randomised controlled trial of a relationship-focussed mobile phone application for improving adolescents’ mental health. J Child Psychol Psychiatry 2020; 61: 899–913.

104.

Ofoegbu

Asogwa

Otu

, et al. Efficacy of guided internet-assisted intervention on depression reduction among educational technology students of Nigerian universities. Medicine (Baltimore) 2020; 99: e18774.

105.

Ong

Sündermann

. Efficacy of the mental health app “intellect” to improve body image and self-compassion in young adults: a randomized controlled trial with a 4-week follow-up. JMIR Mhealth Uhealth 2022; 10: e41800.

106.

Castro

Haug

Wenger

, et al. Longer-term efficacy of a digital life-skills training for substance use prevention. Am J Prev Med 2022; 63: 944–953.

107.

Pinto

Greenblatt

Hickman

, et al. Assessing the critical parameters of eSMART-MH: a promising avatar-based digital therapeutic intervention to reduce depressive symptoms. Perspect Psychiatr Care 2016; 52: 157–168.

108.

Ranney

Pittman

Dunsiger

, et al. Emergency department text messaging for adolescent violence and depression prevention: A pilot randomized controlled trial. Psychol Serv 2018; 15(4): 419.

109.

Rauschenberg

Boecking

Paetzold

, et al. A compassion-focused ecological momentary intervention for enhancing resilience in help-seeking youth: uncontrolled pilot study. JMIR Ment Health 2021; 8: e25650.

110.

Reid

Kauer

Hearps

SJC

, et al. A mobile phone application for the assessment and management of youth mental health problems in primary care: a randomised controlled trial. BMC Fam Pract 2011; 12: 1–14.

111.

Reininghaus

Paetzold

Rauschenberg

, et al. Effects of a novel, transdiagnostic ecological momentary intervention for prevention, and early intervention of severe mental disorder in youth (EMIcompass): findings from an exploratory randomized controlled trial. Schizophr Bull 2023; 49: 592–604.

112.

Rice

Gleeson

Davey

, et al. Moderated online social therapy for depression relapse prevention in young people: pilot study of a ‘next generation’online intervention. Early Interv Psychiatry 2018; 12: 613–625.

113.

Rickhi

Kania-Richmond

Moritz

, et al. Evaluation of a spirituality informed e-mental health tool as an intervention for major depressive disorder in adolescents and young adults–a randomized controlled pilot trial. BMC Complement Altern Med 2015; 15: 1–14.

114.

Riggs

Conner

Parnes

, et al. Marijuana eCHECKUPTO GO: effects of a personalized feedback plus protective behavioral strategies intervention for heavy marijuana-using college students. Drug Alcohol Depend 2018; 190: 13–19.

115.

Rodríguez de Dios

Igartua

D'Haenens

. Narrative persuasion in a mobile environment: effectiveness of a mobile application for promoting digital skills and coping strategies in adolescents. Int J Commun 2021; 15: 1637–1658.

116.

Roncero

Belloch

Doron

. Can brief, daily training using a mobile app help change maladaptive beliefs? Crossover randomized controlled trial. JMIR Mhealth Uhealth 2019; 7: e11443.

117.

Rushing

Kelley

Bull

, et al. Efficacy of an mHealth intervention (BRAVE) to promote mental wellness for American Indian and Alaska native teenagers and young adults: randomized controlled trial. JMIR Ment Health 2021; 8: e26158.

118.

Ryan

Chambers

Gravey

, et al. A brief text-messaging intervention for suicidal youths after emergency department discharge. Psychiatr Serv 2022; 73: 954–957.

119.

Sakata

Toyomoto

Yoshida

, et al. Components of smartphone cognitive-behavioural therapy for subthreshold depression among 1093 university students: a factorial trial. BMJ Ment Health 2022; 25: e18–e25.

120.

Schlosser

Campellone

Truong

, et al. Efficacy of PRIME, a mobile app intervention designed to improve motivation in young people with schizophrenia. Schizophr Bull 2018; 44: 1010–1020.

121.

Schulte

MHJ

Boumparis

Kleiboer

, et al. The effectiveness of a mobile intervention to reduce young adults’ alcohol consumption to not exceed low-risk drinking guidelines. Front Digit Health 2022; 4: 1016714.

122.

Schwinn

Fang

Hopkins

, et al. Longitudinal outcomes of a smartphone application to prevent drug use among Hispanic youth. J Stud Alcohol Drugs 2021; 82: 668–677.

123.

Serlachius

Boggiss

Lim

, et al. Pilot study of a well-being app to support New Zealand young people during the COVID-19 pandemic. Internet Interv 2021; 26:100464.

124.

Sethi

. Treating youth depression and anxiety: a randomised controlled trial examining the efficacy of computerised versus face-to-face cognitive behaviour therapy. Aust Psychol 2013; 48: 249–257.

125.

Shrier

Rhoads

Burke

, et al. Real-time, contextual intervention using mobile technology to reduce marijuana use among youth: a pilot study. Addict Behav 2014; 39: 173–180.

126.

Shroff

Roulston

Fassler

, et al. A digital single-session intervention platform for youth mental health: cultural adaptation, evaluation, and dissemination. JMIR Ment Health 2023; 10: e43062.

127.

Silk

Pramana

Sequeira

, et al. Using a smartphone app and clinician portal to enhance brief cognitive behavioral therapy for childhood anxiety disorders. Behav Ther 2020; 51: 69–84.

128.

Srivastava

Mehta

Sagar

, et al. Smartteen-a computer assisted cognitive behavior therapy for Indian adolescents with depression-a pilot study. Asian J Psychiatr 2020; 50: 101970.

129.

Stallard

Porter

Grist

. A smartphone app (BlueIce) for young people who self-harm: open phase 1 pre-post trial. JMIR Mhealth Uhealth 2018; 6: e8917.

130.

Stevens

Cartagena Farías

Mindel

, et al. Pilot evaluation to assess the effectiveness of youth peer community support via the kooth online mental wellbeing website. BMC Public Health 2022; 22: 1903.

131.

Suffoletto

Goldstein

Gotkiewicz

, et al. Acceptability, engagement, and effects of a mobile digital intervention to support mental health for young adults transitioning to college: pilot randomized controlled trial. JMIR Form Res 2021; 5: e32271.

132.

Sun

Lin

Goldberg

, et al. A mindfulness-based mobile health (mHealth) intervention among psychologically distressed university students in quarantine during the COVID-19 pandemic: a randomized controlled trial. J Couns Psychol 2022; 69: 57.

133.

Sun

Wang

, et al. A smartphone app for promoting mental well-being and awareness of anxious symptoms in adolescents: a pilot cluster randomized controlled trial. Games Health J 2022; 11: 393–402.

134.

Takahashi

Takada

Hirao

. Feasibility and preliminary efficacy of a smartphone application intervention for subthreshold depression. Early Interv Psychiatry 2019; 13: 133–136.

135.

Thabrew

Boggiss

Lim

, et al. Well-being app to support young people during the COVID-19 pandemic: randomised controlled trial. BMJ Open 2022; 12: e058144.

136.

Toh

SHY

Tan

JHY

Kosasih

, et al. Efficacy of the mental health app intellect to reduce stress: randomized controlled trial with a 1-month follow-up. JMIR Form Res 2022; 6: e40723.

137.

Topooco

Byléhn

Dahlström Nysäter

, et al. Evaluating the efficacy of internet-delivered cognitive behavioral therapy blended with synchronous chat sessions to treat adolescent depression: randomized controlled trial. J Med Internet Res 2019; 21: e13393.

138.

Torok

Han

McGillivray

, et al.

The effect of a therapeutic smartphone application on suicidal ideation in young adults: findings from a randomized controlled trial in Australia

. PLoS Med 2022; 19: e1003978.

139.

van Rosmalen-Nooijens

Lo Fo Wong

Prins

, et al. Young people, adult worries: randomized controlled trial and feasibility study of the internet-based self-support method “feel the ViBe” for adolescents and young adults exposed to family violence. J Med Internet Res 2017; 19: e204.

140.

Van Voorhees

Gladstone

TRG

Sobowale

, et al. 24-month Outcomes of primary care web-based depression prevention intervention in adolescents: randomized clinical trial. J Med Internet Res 2020; 22: e16802.

141.

Waite

Marshall

Creswell

. A randomized controlled trial of internet-delivered cognitive behaviour therapy for adolescent anxiety disorders in a routine clinical care setting with and without parent sessions. Child Adolesc Ment Health 2019; 24: 242–250.

142.

Webb

Swords

Lawrence

, et al. Which adolescents are well-suited to app-based mindfulness training? A randomized clinical trial and data-driven approach for personalized recommendations. J Consult Clin Psychol 2022; 90: 55.

143.

Webb

Swords

Murray

, et al. App-based mindfulness training for adolescent rumination: predictors of immediate and cumulative benefit. Mindfulness (N Y) 2021; 12: 2498–2509.

144.

Weintraub

Ichinose

Zinberg

, et al. App-enhanced transdiagnostic CBT for adolescents with mood or psychotic spectrum disorders. J Affect Disord 2022; 311: 319–326.

145.

Whiteside

SPH

Biggs

Tiede

, et al. An online-and mobile-based application to facilitate exposure for childhood anxiety disorders. Cogn Behav Pract 2019; 26: 478–491.

146.

Whittaker

Stasiak

McDowell

, et al. MEMO: an mHealth intervention to prevent the onset of depression in adolescents: a double-blind, randomised, placebo-controlled trial. J Child Psychol Psychiatry 2017; 58: 1014–1022.

147.

Wiljer

Shi

, et al. Effects of a mobile and web app (thought spot) on mental health help-seeking among college and university students: randomized controlled trial. J Med Internet Res 2020; 22: e20790.

148.

Wisman

Emmelkamp

Dekker

JJM

, et al. Internet-based emotion-regulation training added to CBT in adolescents with depressive and anxiety disorders: a pilot randomized controlled trial to examine feasibility, acceptability, and preliminary effectiveness. Internet Interv 2023; 31: 100596.

149.

van der Zanden

Kramer

Gerrits

, et al. Effectiveness of an online group course for depression in adolescents and young adults: a randomized trial. J Med Internet Res 2012; 14: e2033.

150.

Singh

Kumar

Gupta

. Mental health prevention and promotion—a narrative review. Front Psychiatry 2022; 13: 898009.

151.

Bos

de Jonge

Cox

RFA

. Affective variability in depression: revisiting the inertia–instability paradox. Br J Psychol 2019; 110: 814–827.

152.

Dobson

Dozois

DJA

. Handbook of cognitive-behavioral therapies. New York, United States: Guilford Publications, 2021.

153.

Taylor

Montgomery

. Can cognitive-behavioral therapy increase self-esteem among depressed adolescents? A systematic review. Child Youth Serv Rev 2007; 29: 823–839.

154.

Eysenbach

Consort

. CONSORT-EHEALTH: improving and standardizing evaluation reports of web-based and mobile health interventions. J Med Internet Res 2011; 13: e1923.

155.

Nahum-Shani

Dziak

. Multilevel factorial designs in intervention development. In: Collins LM (ed.) Optimization of behavioral, biobehavioral, and biomedical interventions: advanced topics, Berlin, Germany: Springer, 2018, pp.47–87.

156.

Kok

Gottlieb

Peters

G-JY

, et al. A taxonomy of behaviour change methods: an intervention mapping approach. Health Psychol Rev 2016; 10: 297–312.

157.

Nosek

Hardwicke

Moshontz

, et al. Replicability, robustness, and reproducibility in psychological science. Annu Rev Psychol 2022; 73: 719–748.

158.

Lehnert

Niess

Lallemand

, et al. Child–computer interaction: from a systematic review towards an integrated understanding of interaction design methods for children. Int J Child Comput Interact 2022; 32: 100398.

159.

Poole

Peyton

(eds) Interaction design research with adolescents: Methodological challenges and best practices. In Proceedings of the 12th International Conference on Interaction Design and Children. New York, NY, USA, June 24–27, 2013. New York, NY: Association for Computing Machinery (ACM).

160.

Dietvorst

Aukes

Legerstee

, et al. A smartphone serious game for adolescents (grow it! app): development, feasibility, and acceptance study. JMIR Form Res 2022; 6: e29832.

161.

Cornish

Breton

Moreno-Tabarez

, et al. Participatory action research. Nat Rev Meth Primers 2023; 3: 34.

162.

Obradovich

Khalsa

Khan

, et al. Opportunities and risks of large language models in psychiatry. NPP – Digit Psychiatry Neurosci 2024; 2: 8.

163.

Nahum-Shani

Smith

Spring

, et al. Just-in-time adaptive interventions (JITAIs) in mobile health: key components and design principles for ongoing health behavior support. Ann Behav Med 2018; 52: 446–462.

164.

Greenhalgh

Abimbola

. The NASSS framework-a synthesis of multiple theories of technology implementation. Stud Health Technol Inform 2019; 263: 193–204.

165.

Lee

EWJ

McCloud

Viswanath

. Designing effective eHealth interventions for underserved groups: five lessons from a decade of eHealth intervention design and deployment. J Med Internet Res 2022; 24: e25419.

166.

Cremers

H-P

Theunissen

Hiddink

, et al. Successful implementation of ehealth interventions in healthcare: development of an ehealth implementation guideline. Health Serv Manage Res 2021; 34: 269–278.

167.

van Gemert-Pijnen

JEWC

Nijland

van Limburg

, et al. A holistic framework to improve the uptake and impact of eHealth technologies. J Med Internet Res 2011; 13: e1672.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.02 MB

0.16 MB