Abstract
Objective
This synthesis of reviews and meta-analyses delves into the landscape of behavior change techniques (BCTs) employed in digital interventions designed to help individuals abstain from or reduce consumption of substances (including alcohol, tobacco, and illicit drugs). This review considers the “black box” problem in mHealth programs by using Michie et al.’s BCT taxonomy to describe BCTs that have been used in intervention literature and to explore potential active ingredients that may contribute to intervention effectiveness.
Methods
We synthesize findings from 49 systematic reviews and meta-analyses. While individual studies often express inconclusiveness for the effectiveness of specific BCTs, this review uncovers promising avenues for future research. Our analysis focuses on mobile health (mHealth) just-in-time adaptive interventions (JITAIs), with a specific emphasis on substance use reduction.
Results
Eleven BCTs were studied extensively in these reviews, including self-monitoring of behavior, feedback on behavior, goal setting, social support, prompts/cues, and behavior substitution. Our synthesis of evidence points to prompts/cues as particularly promising and highlights a handful of BCTs that demand further investigation, including self-monitoring, goal setting, and feedback on behavior.
Conclusions
This review identifies specific limitations in each step of review formulation and provides nuanced suggestions to enhance the efficacy of future research endeavors.
Keywords
Introduction
Although addiction is treatable, individuals in recovery typically experience multiple lapse and relapse episodes. According to the National Institute on Drug Abuse, 40 to 60% of patients with substance use disorders (SUDs) relapse after treatment. 1 Relapse can be dangerous or even deadly for some drugs such as opioids and alcohol, as persons in recovery can more easily overdose due to lack of tolerance following a period of abstinence. 1
The most effective behavioral interventions for relapse prevention include cognitive behavioral therapy for addiction and co-occurring mental health disorders, contingency management, and mindfulness coaching. 2 The standard treatment for SUDs involve medication management (when available) and monthly individual counseling, usually with a 3- or 6-month follow up.3,4 Although the standard treatment methods are effective, individuals with SUD face many barriers to in-person treatment, and access to counseling may not be readily available in the moment when an individual is facing strong urges to use; recent estimates suggest that only 10% of individuals with an SUD are receiving treatment.2,5 Barriers include perceived stigma, fear of punishment, lack of social support, lack of trust in providers, transportation difficulties, and lack of available services. 6 Substance use interventions can also be applicable for the large proportion of individuals who struggle from SUD but do not have a formal diagnosis, or whose symptoms are subclinical.5,7 Thus, for the remainder of this review, we will refer to “substance use involvement” or “substance use recovery,” instead of “substance use disorder” to be inclusive of the more general population affected by substance use problems.
Just-in-time adaptive interventions (JITAIs) are a promising mobile health (mHealth) methodology for complementing or replacing in-person behavioral therapy that is either out-of-reach or undesired, as JITAIs focus on providing an individual with tailored support, at the right time and right level. 8 Generally, just-in-time components of mHealth interventions are delivered through program-initiated push notifications or text messages in the moment when an individual is likely to need immediate support. In some cases a program could apply “just-in-time” pull components (i.e., participant-initiated) if some type of support is immediately available to an individual that is seeking help in a time of need (e.g., pressing a “support” button in an app or texting an alert line). 8 JITAIs have been used to target behaviors such as reducing sedentary behavior, increasing physical activity, and preventing dietary lapses, in addition to smoking and substance abuse.8–11 These interventions may be particularly helpful for relapse prevention because JITAIs are uniquely positioned to target predictors of inhibitory self-control to support abstinence when cravings are strong. 8
JITAIs, which are relatively new, are becoming increasingly popular and well-studied. The number of studies indexed in Google Scholar using search terms “‘JITAI’ AND ‘mHealth’” have steadily increased from 74 published in 2019 to 275 published in 2025. However, most of them use many treatment components simultaneously (e.g., web- or app-based lessons together with standardized push messages and a social interaction component). The use of simultaneous intervention components is natural and mirrors most health promotion programs, whether delivered in person or via remote methods. Nevertheless, the use of multiple components and behavioral strategies simultaneously, particularly when delivered using a novel modality, produces a “black box” problem wherein it is difficult to evaluate which strategies are driving the behavior change. 12 As the popularity of JITAIs continues to grow, it is critical to understand the differential efficacy and effectiveness of individual mobile intervention components.
Michie et al.’s Behavior Change Technique (BCT) taxonomy is a set of 93 BCTs that enables researchers to identify specific components and applications in interventions as “active ingredients” of an intervention. 13 The application of BCTs in non-mHealth interventions targeting substance use have been found effective in several studies. 14 Incorporating specific BCTs, such as problem-solving, goal setting of behavior, self-monitoring of behavior, and biofeedback, have led to reductions in substance use in traditional interventions, supporting the utility of this taxonomy in identifying active ingredients of interventions.15,16 The identification of individual BCTs within interventions can allow for future disentanglement of treatment component effectiveness and lead to the development of more efficient and effective interventions.
To fill this gap in the literature, this synthesis summarizes existing systematic reviews and meta-analyses that have sought to examine the role of BCTs in digital behavior change interventions for substance use recovery.
Methods
As part of a larger systematic review and meta-analysis, we searched PubMed, Web of Science, Scopus, and Embase using MeSH and Boolean search terms to identify eHealth and mHealth studies with at least one just-in-time (JIT) component targeting a reduction in substance use behaviors or dietary behaviors such as calorie restriction. The full search terms applied are located in Appendix A. This review of reviews represents a sub-analysis of the review articles identified with this search; these articles were omitted from the larger systematic review and meta-analysis project. Here, we examine systematic reviews and meta-analyses published between 2009 and 2024 returned using our search terms, focusing on the reviews of substance use (i.e., reviews about dietary behaviors were excluded for the purposes of this review paper).
As part of the larger study, two reviewers screened the titles and abstracts of each paper identified using search terms; all systematic reviews and meta-analyses were moved to a separate collection to be used for this synthesis of reviews. These review papers were then fully reviewed by two reviewers, and those that fit inclusion criteria were included in this paper. Inclusion criteria for this review included: must be identified as a systematic review, meta-analysis, or review of more than one quantitative study that contained at least one JITAI component; must target outcomes related to substance use (i.e., alcohol, tobacco or nicotine, or other illicit drugs); describes at least one clearly identifiable BCT from Michie et al.’s BCT taxonomy in its content either directly referenced within the text, or implied in the text and identified by our team. For inclusion in this synthesis, reviews were required to focus on interventions in which all primary studies incorporated a JITAI component, although specific implementation and features of the JITAI varied across studies.
In some cases, BCTs were directly named in the review papers, and these were recorded; however, for other reviews, BCTs were described in the text, and our team identified which BCT was being referenced based on operational definitions outlined in Michie et al. (2013). For example, in several studies, “self-monitoring of behavior” was not directly named, but “self-reporting” was described and BCT [2.3] was identified. For example, interventions that required participants to record or track their substance use behaviors were coded as self-monitoring of behavior [2.3]; interventions that provided participants with personalized information about their behavior were coded with feedback on behavior [2.2]; interventions that required participants to establish goals or targets for their behavior changes, either long-term or short-term were coded as goal setting (behavior) [1.1]. For some BCT categories, particularly social support [3.1-3.3], reviews often evaluated the concept at a broader level, rather than distinguishing between specific subtypes. In this case, we also synthesized findings, grouping its use under the broader “social support” category. Once reviews were identified for inclusion, each review was evaluated for which BCTs were included, whether the unique effects of each BCT were able to be isolated given the study design, which BCTs were found effective, and any other notable conclusions.
For each included review, we extracted which BCTs were present, whether their independent effects could be isolated, and any reported conclusions regarding effectiveness. Effectiveness classifications were based on the conclusions reported by the authors of each review. In this synthesis, a BCT was considered “effective” if the review authors reported that it was associated with positive behavioral outcomes. This synthesis reflects the determinations made by the review authors, rather than applying a new effectiveness criterion. Some reviews did not explicitly evaluate or declare the effectiveness of the individual BCTs, often focusing on the effectiveness of the intervention instead. For these reviews, effectiveness was coded as “N/A,” but they were still included, as they provide information on which BCTs were implemented in digital interventions, even if their independent effectiveness was not determined.
Extracted data was coded manually using a structured Excel spreadsheet using a predefined framework If a review reported that the unique effect of a BCT was evaluated but not found effective, it was coded with 0; if a BCT was evaluated and found effective, it was coded with 1; if a BCT was evaluated but results were mixed between studies, it was coded with 2. As noted previously, if the unique effect of the BCT could not be evaluated, results were coded as “N/A”. “Mixed results” are defined as reviews that included at least one study that found the BCT effective for decreasing the likelihood of substance use involvement, while other studies in the same review found that BCT to have null effect on substance use involvement.
“Positive behavior change” or “positive clinical outcomes” refers to the reduction of substance use involvement, including but not limited to smoking and alcohol use reduction. These outcomes were used to inform effectiveness classifications in this synthesis.
Results
Summary of search results
Of the N = 12,045 articles retrieved in the initial search, we identified 152 systematic reviews and meta-analyses which could facilitate analysis of differential effectiveness of BCTs across included digital interventions. After removing duplicates as well as those that did not contain an mHealth or JIT component, 118 systematic reviews and meta-analyses remained. Of these reviews, n = 49 included substance use outcomes as detailed in the PRISMA flow chart in Figure 1. Intervention modalities covered in reviews included smartphone apps, reviewed in 21 reviews; text messaging, in 31 reviews; websites or web-based interventions, in 21 reviews; wearable technologies, in 3 reviews; and video games, in 3 reviews. PRISMA flow diagram of study selection process.
Behavior change techniques identified
Summary of review articles extracted and BCTs assessed.
Review findings
Six reviews17,18,20,24,40,44 were able to isolate the effects of self-monitoring of behavior [2.3], and all six concluded that this BCT was found effective for positive clinical outcomes, including smoking reduction and reduction of alcohol consumption. Three additional reviews showed mixed results after being unable to fully isolate the effects of [2.3] among their included studies, and thus could not render strong conclusions.19,35,56 Additionally, three reviews22,33,37 found [2.3] ineffective. Only four reviews34,40,44,47 were able to isolate the positive effects of feedback on behavior [2.2], finding the BCT effective for reducing consumption of alcohol and tobacco use, and three additional reviews23,41,57 showed mixed results. Two reviews33,37 found that [2.2] was ineffective. After self-monitoring and feedback, the next most studied BCT in these reviews was goal setting for behavior [1.1],17,18,23,26,28–32,35,40,43,45–47,49–53,55,58,61 though only one review 55 was able to isolate the effects of the BCT, concluding that this BCT was found effective in reducing alcohol use and smoking. One additional review 18 found mixed results. Social support [3.1-3] was also commonly studied and evaluated in 13 reviews,17,23,26,29,31,32,35,52–55,58,62 though none reported clear evidence that these BCTs were effective to promote substance use reduction.
Total number of reviews in which each BCT was evaluated, found effective, or results were mixed.
Summary of results
While feedback on behavior [2.2], self-monitoring of behavior [2.3], and goal setting (behavior) [1.1] were evaluated in the most reviews, prompts/cues [7.1], and behavior substitution [8.2] were effective in the largest proportions of the reviews that included them. Problem solving [1.2] and action planning [1.4] had the next largest proportions, while self-monitoring of behavior [2.3], feedback on behavior [2.2], goal setting (behavior) [1.1], and valued self-identity [13.4] had the lowest non-zero proportions for effectiveness.
Discussion
Overall, most of the systematic reviews and meta-analyses included in this synthesis yielded mixed or inconclusive results and declared that further research is needed to better characterize BCT effectiveness for preventing substance use in JITAIs. Most of the reviews in this paper yielded mixed results for the effects of individual BCTs on positive behavior change, due to variations between results in individual studies, where only some studies within each review were able to isolate the effects of the BCTs. This limited the ability to determine conclusive results for the effects of BCTs; however, it helps clarify where evidence is beginning to emerge and highlights what steps need to be taken in the future to reach more conclusive results.
Despite these mixed findings, this synthesis provides a clearer picture of how BCTs are currently being implemented and evaluated in digital substance use interventions. While several techniques, such as feedback on behavior [2.2], self-monitoring of behavior [2.3], and goal setting (behavior) [1.1] were evaluated in the most reviews, prompts/cues [7.1] and behavior substitution [8.2] appeared most promising. These finding suggest that some BCTs may deserve more attention in future intervention design and evaluation. Ybarra et al. suggests that the next steps for smoking cessation, in particular, is to determine if the just-in-time components, like the text-messages themselves, are sufficient on their own or if other BCT components, such as setting a quit day and preparing, need to be paired with them. 22 In addition, they suggest that future studies should compare text messaging interventions to other controls that do not require an in-person component, such as telephone quit lines, which would provide context for the relative impact of mHealth interventions. 22 Spohr et al. provides a different approach, suggesting that prioritizing the development of adaptively tailored programming for text message interventions in smoking cessation, especially with the incorporation of ecological momentary assessment (EMA) would be beneficial to mHealth research. 24 EMA, especially when used in conjunction with behavioral interventions, allows real-time assessment of cue-induced craving, facilitating proactive measures to prevent relapse. The reviews also acknowledge potential biases in their studies, but generally, most reviews declare a low risk of bias. Additionally, many studies within the reviews utilized randomized controlled trials, which allow for a more systematic approach to analysis that can be more easily replicated.
A major limitation of our synthesis was the inability to conduct substance-specific analysis. Of the 49 studies included in this synthesis, 36 focused on alcohol use as the primary health behavior, while several others grouped multiple substances, such as alcohol use and smoking use, together. Because of this, isolated analysis on specific substances was infeasible. The individual reviews included in our synthesis also had some limitations, such as including a small number of studies or a small number of participants in each individual study. Many reviews focused on the effects of the delivery method (e.g., the app itself) rather than the effect of the BCTs used, which is not applicable to our review. Incomplete reporting of BCTs was a considerable confounding factor across many such reviews and is not easily addressable without systematic reconsideration in reporting of systematic reviews and meta-analyses and highlights the need for interventionists to attempt to isolate the effects of key BCTs whenever possible. Other reviews evaluated which BCTs were used most often without considering the effectiveness of those BCTs. Another common limitation among the systematic reviews was that the studies analyzed were too heterogenous with respect to target outcomes for a meta-analysis to be conducted. Many studies focused on the effectiveness of the intervention, rather than the effectiveness of the BCT, while still acknowledging the use of BCTs. For example, Scott-Sheldon et al. 31 and Palmer et al. 26 found that text messaging interventions were correlated with increased smoking cessation rates, indicating that such JITAIs show promise for improving substance use outcomes. While these findings demonstrate the potential effectiveness of digital interventions, they do not isolate the effects of individual BCTs contributing to these outcomes. Additionally, since these conclusions were drawn across reviews with various study designs, samples, and outcome measures, some variability in effectiveness findings is expected and reflects the nature of such a synthesis. A few reviews acknowledge the fact that there was a wide variability in definitions and in inclusion criteria, so it was difficult to accurately compare across studies. Moving forward, it will be helpful for future interventions to adopt similar reporting measures and outcomes to promote comparability and enable more definitive conclusions to be conferred.
One major limitation of our study was that it was difficult to compare the usage of BCTs across multiple systematic reviews and meta-analyses because there was a lack of uniformity. Some reviews did not state explicitly which BCTs were used, and instead, they were described in the methods. In these cases, trained coders certified from the BCT taxonomy retroactively coded which BCT was being described, provided sufficient description to meet criteria. While multiple steps were taken to ensure as much accuracy as possible in these codings, there is likely error present. In the future, it would be beneficial for studies to specifically identify which BCTs are used in their interventions, perhaps as a supplementary table or file, to better facilitate systematic comparison and move the field forward. We recommend that researchers consider factorial designs or other innovative trial designs to pinpoint the active ingredients of interventions.
Conclusion
While few definitive conclusions could be made from the review of 49 systematic reviews and meta-analyses focusing on substance use, there are promising results that clearly set up the path for future research of the use of BCTs in JITAIs for substance abuse cessation and relapse prevention. Although there is evidence suggesting that social support, feedback on behavior, and self-monitoring of outcomes of behavior are effective for relapse prevention, these results are mixed within reviews, so further research should evaluate the context in which these BCTs are most effective. Notably, this synthesis sheds light on less commonly studied BCTs such as prompts/cues [7.1] and behavior substitution [8.2], which are promising avenues for further exploration. Beyond echoing the call for more investigation, this synthesis serves as a roadmap, pinpointing specific limitations in each step in the formulation of a systematic review/meta-analysis and providing suggestions on how to improve upon them for future research. We recognize the complexities in drawing conclusions from the existing literature and advocate for a more refined approach in future research. Rather than offering a single definitive answer, this synthesis clarifies which BCTs are most frequently used across digital substance use interventions and which appear most consistently associated with positive outcomes among prior reviews. By doing so, we provide a reference point for future intervention development and highlight areas where more rigorous research is needed to better understand the active ingredients of digital substance use interventions.
Footnotes
Consent to participate
There are no human participants in this article and informed consent is not required.
Author Contributions
Conceptualization: NPG (lead), NGO (equal), LH (supporting), BTN (supporting), Data curation: NPG (lead), NGO (supporting), LH (supporting), BTN (supporting), Formal analysis: NPG, Investigation: NPG, Methodology: NGO (lead), BTN (equal), LH (equal), NPG (supporting), Project administration: NPG (lead), NGO (supporting), LH (supporting), BTN (supporting), Supervision: NGO (lead), LH (supporting), BTN (supporting), Visualization: NPG (lead), LH (supporting), NGO (supporting), BTN (supporting), Writing – original draft: NPG (lead), Writing – review & editing: NPG (lead), NGO (supporting), LH (supporting), BTN (supporting).
Funding
The authors received no financial support for the research, authorship, and/or publication of this article.
Declaration of conflicting interests
The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
