Abstract
Objectives
Our aim was to conduct a systematic review to determine which technology-driven diabetes prevention interventions were effective in producing clinically significant weight loss, and to identify the behaviour change techniques and digital features frequently used in effective interventions.
Methods
We searched five databases (CINAHL, EMBASE, MEDLINE, PsychINFO, and Pubmed) from inception to September 2018 and reviewed 19 experimental and non-experimental studies of 21 technology-driven diet plus physical activity interventions for adults (≥18 years) at risk of developing type 2 diabetes. Behaviour change techniques were coded using the BCT taxonomy v1, and digital features were identified via thematic analysis of intervention descriptions.
Results
Sixty-three per cent of interventions were effective in the short term (achieving ≥3% weight loss at ≤6 months), using an average of 5.6 more behaviour change techniques than non-effective interventions, and 33% were effective in the long term (achieving ≥5% weight loss at ≥12 months), using 3.7 more behaviour change techniques than non-effective interventions. The techniques of social support (unspecified), goal setting (outcome/behaviour), feedback on behaviour, and self-monitoring of outcome(s) of behaviour were identified in over 90% of effective interventions. Interventions containing digital features that facilitated health and lifestyle education, behaviour/outcome tracking, and/or online health coaching were most effective.
Conclusion
The integration of specific behaviour change techniques and digital features may optimise digital diabetes prevention interventions to achieve clinically significant weight loss. Additional research is needed to identify the mechanisms in which behaviour change techniques and digital features directly influence physical activity, dietary behaviours, and intervention engagement.
Keywords
Introduction
The global prevalence of diabetes represents a major public health concern. In 2015, the number of adults with diabetes was estimated at 415 million worldwide, with this figure projected to rise to 642 million by the year 2040. 1 Type 2 diabetes (T2D) accounts for approximately 90% of all diabetes cases, and those with the condition face an additional two-to-fourfold risk of coronary heart disease.2,3 Being overweight and obese are the main drivers of T2D with 60% of diabetes cases directly attributed to weight gain. 4 Based on international evidence from several landmark prevention studies,5–7 the International Diabetes Federation concluded that modifications to diet and physical activity are key to diabetes prevention. 3 In the largest of these studies, the Diabetes Prevention Program included one-on-one health coaching and provided 16 30–60 minute educational sessions on diet, exercise, and behaviour modification. Participants lost an average of 5–7% of baseline body weight after 1 year, leading to a 58% study-wide reduction in T2D incidence over 3 years. 7 Current diabetes prevention guidelines issued by the Centers for Disease Control and Prevention (CDC) in the USA, and the National Institute for Health and Care Excellence (NICE) in the UK, therefore recommend a weight loss target of at least 5%.8,9
Despite their effectiveness, the implementation of such large-scale, intensive programs may not be feasible in routine clinical practice where health care resources are limited.10,11 In view of this, smaller-scale diabetes prevention interventions (DPIs) have been adapted from the original Diabetes Prevention Program for implementation in ‘real world’ community settings.12,13 Systematic reviews of these community-based DPIs concluded that the interventions can promote clinically significant weight loss, as evidenced by an average 4–5% reduction in baseline body weight.12,14 However, despite offering greater accessibility and sustainability, 15 community-based DPIs still require face-to-face delivery, which present participation barriers such as transportation, family/work commitments, and cost.16,17
Technology-driven DPIs have been developed to overcome the participation barriers of face-to-face DPIs by offering lifestyle education and support remotely or automatically via text messages, smartphone applications, or websites. 18 Recent meta-analyses of DPIs delivered via digital technologies reported results comparable to the reviews of community-based DPIs. Bian et al. 19 reported a mean 2-year weight loss of 4.81 kg across 15 studies, and Joiner, Nam, and Whittemore 20 found an overall weight loss of 3.98% at 15 months across 22 studies. However, a number of the reviewed interventions were not necessarily technology-driven, with both meta-analyses including interventions that were delivered exclusively in real time by a human coach via phone or teleconference. Although these modes of delivery can be more accessible for participants, phone-based interventions require mutually convenient meeting times between participant and coach. Furthermore, these interventions may still incur substantial time and resource costs as health coaches must drive the intervention by frequently interacting with participants in real time. This may be particularly resource-intensive if sessions are delivered one-on-one. Importantly, both meta-analyses also reported significant inter-study heterogeneity in the modes of delivery, materials used, and the amount of weight lost, and the most effective behavioural and digital components or ‘active ingredients’ of the interventions remain unclear.
Behaviour change techniques (BCTs) are the observable, replicable, and irreducible intervention components, designed to modify the processes that regulate behaviour. 21 A taxonomy of BCTs was developed to provide a standardised list of BCT labels and definitions, and evidence suggests that specific BCTs may be effective in improving dietary and physical activity behaviours.21,22 European diabetes prevention guidelines state that self-regulatory BCTs (e.g., goal setting, self-monitoring), action planning, problem solving, and social support should be present in all face-to-face DPIs.10,23 However, no review to date has assessed the use of BCTs in technology-driven DPIs.
Reviews of mobile health diabetes management studies have examined the links between technological features and intervention effectiveness. Donevant, Estrada, Culley, Habing, and Adams 24 found that interventions with statistically significant outcomes used a combination of interactive features (where participants respond to or modify content in real time) and passive features (where a response is not required), while interventions without significant outcomes were more likely to have used passive features only. Holcombe 25 found that interactive two-way text messages were more effective than passive one-way text messages at improving glycated haemoglobin (A1c) and medication adherence in adults with T2D. However, as the reviewed interventions focused on the management of T2D, it is not yet known which digital features are most effective in diabetes prevention. Furthermore, these reviews excluded interventions that were delivered using non-mobile digital platforms such as desktop computers or websites.
As DPIs that incorporate technology vary in content and outcomes, identifying the most effective behavioural and digital components in technology-driven DPIs is important to delineate potential causal pathways between components and outcomes and inform the cost and resource optimisation of future interventions. To achieve this, it must first be determined which technology-driven DPIs are effective in producing clinically significant weight loss and, following this, the most effective components can be identified. However, no review to date has either applied the BCT taxonomy to identify the techniques used in technology-driven DPIs, or performed a digital feature assessment. In light of this, the present review has two primary aims:
To determine which technology-driven DPIs were effective in producing clinically significant weight loss and improvements in additional outcomes linked to the onset of T2D. To identify the BCTs and digital features most frequently used in effective interventions.
Methods
This review followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines Moher et al. 26 (see Supplementary File 1). The protocol was registered with the International Prospective Register of Systematic Reviews (PROSPERO) [CRD42018097195].
Study eligibility criteria
We included experimental and non-experimental studies, published in English, that assessed the effectiveness of technology-driven (e.g., automated phone calls or messages, smartphone application, text, email, instant message, video, website) diet and/or physical activity interventions for adults, age 18 and over, who are at risk of developing T2D (e.g., individuals with prediabetes, metabolic syndrome, overweight/obesity). This included observational studies, single-arm intervention studies, and randomised and non-randomised trials which assessed the intervention against a control group or alternative DPI. Studies must have had an explicit aim of preventing T2D or reducing the risk of developing T2D and reported at least one of the following outcomes: body weight, glycaemic status (either A1c or fasting glucose), or T2D incidence. Studies were excluded if: participants had previously received a diagnosis of type 1, type 2, or gestational diabetes; the interventions were delivered exclusively in real-time via a human coach (e.g., face-to-face, phone call, teleconferencing); or, if technology was only used to supplement an unmodified face-to-face intervention.
Study search and selection
A systematic literature search of five databases (CINAHL, EMBASE, MEDLINE, PsycINFO, and PubMed) was conducted by the lead author (LV) to identify relevant studies published between database inception and 3 September 2018. Search terms (see Supplementary File 2) included key words, phrases, and Medical Subject Headings relevant to T2D risk, prevention interventions, diabetes-relevant outcomes, and digital modes of delivery.
All records retrieved from the database search were imported into EndNote X5 27 and duplicates removed. All unique records were then imported into the Covidence software. 28 Titles and abstracts were screened by one reviewer (LV) to determine potentially eligible full-text articles. The same reviewer screened all resulting full-text articles for inclusion. A second reviewer (JMu) independently screened a random 20% of the titles and abstracts, followed by a random 20% of the full-text articles. All initial disagreements were resolved via discussion between the two reviewers. Forward and backward reference searches of the included articles were then conducted by LV to identify additional articles.
Outcomes and effectiveness assessment
The primary outcomes of interest were body weight, glycaemic status (A1c or fasting glucose), and T2D incidence. Body weight was chosen to inform this review’s primary definition of effectiveness as body weight has a strong association with T2D incidence, and is reported more often in DPI studies than the other primary outcomes.4,11,19 Intervention effectiveness was defined in relation to a mean weight loss of at least 5% of baseline body weight for two reasons. First, this figure is considered clinically significant 29 and matches the US and UK weight loss benchmark for 12-month DPIs.8,9 Second, in the USA, for an organisation to receive accreditation as a certified Diabetes Prevention Program provider endorsed by the CDC, at least five participants must have completed the year-long programme, and the average weight loss after 12 months must have been at least 5%. 8 Achieving this 5% has important implications as it can result in insurance coverage for participants and reimbursement for the organisations that deliver the programme. 30
Interventions of ≤6 months were deemed effective if an average of ≥3% weight loss was achieved at ≤6 month follow-up, while interventions of ≥12 month duration were deemed effective if an average ≥5% weight loss was achieved at ≥12-month follow-up. Based on these criteria, interventions were labelled in four potential ways: (a) effective short term; (b) not effective short term; (c) effective long term; and, (d) not effective long term. Interventions of ≥12 month duration received two labels as they included short and long term follow-ups. Relationships were explored between the number and type of BCTs and digital features identified in effective versus non-effective interventions.
For the purpose of this review, BCTs and digital features were considered effective if they were identified in at least 75% of effective interventions, both short and long term. A BCT or digital feature was considered most effective at each respective time period (short or long term) if it was identified at considerably greater frequency in effective interventions compared to non-effective interventions.
Data extraction
A data extraction tool was developed for this review and piloted on five randomly selected papers then refined and finalised. The extracted information included participant, study, and intervention characteristics, outcomes of absolute weight loss, percentage of baseline weight lost, A1c, fasting glucose, and T2D incidence – all of which were converted to standardised units where necessary. In cases where the average percentage of weight lost was not reported, this was hand calculated using the average baseline body weights and the average body weights at post intervention and subsequent follow-up(s). Data were extracted by one reviewer (LV), with a random 20% checked for accuracy by a second independent reviewer (EM). As the process of obtaining more detailed information from authors can take many months in which only a percentage of authors respond to such requests, 31 only the publicly available materials (e.g., main study articles, follow-up study articles, intervention development articles, protocols, supplementary materials) pertaining to the included studies were used for data extraction, BCT coding, and digital feature identification.
Behaviour change technique coding
The BCT taxonomy v1 21 was used by one reviewer (LV) to code BCTs from all intervention descriptions, and a second independent reviewer (EM) double coded a random 20% of all descriptions to check for reliability. All initial disagreements were resolved via discussion between the two reviewers. Based on previous reviews,19,20 it was anticipated that a number of different studies would describe the same standardised intervention such as those interventions based on the Diabetes Prevention Program. It was also anticipated that the interventions may be described differently in each study’s published literature where, for example, some BCTs clearly present in Study A’s intervention description(s) would be absent from Study B’s intervention description(s) and vice versa. To accommodate this, an imputation process was used to include the missing BCTs. First, intervention descriptions from each study were coded to identify the BCTs clearly present. Second, the BCTs coded as present in study A, but missing from study B, were also coded to Study B; the BCTs present in study B, but missing from study A, were coded to study A.
Digital feature identification
A modified three-phase thematic analysis 32 was performed on all intervention descriptions to identify digital features. First, one reviewer (LV) analysed the descriptions, coding each digital component (e.g., nutrition video) and its mode of delivery (e.g., website), plus each non-digital component (e.g., food diary) and its format (e.g., hard copy). The aforementioned imputation process was also used to identify additional components in cases where multiple studies assessed the same standardised intervention. Second, digital components were categorised according to the level of interactivity between the participant and the digital tool and classified as either passive (one-way interaction) or interactive (two-way interaction). A second reviewer (EM) independently completed these first two phases on a random 20% of all intervention descriptions to check for reliability. Third, all passive and interactive digital components were pooled together in their respective groups and analysed by LV and EM via discussion. Through this discussion, common themes among the passive and interactive components were generated. These component clusters or themes were subsequently classified as either passive or interactive digital features and assigned labels that best represent each theme.
Quality assessment
Study quality was assessed using the NICE quality appraisal checklist for quantitative intervention studies. 33 This 27-item checklist enables appraisal of a study’s internal and external validity where each item is rated ++, +, or – based on the degree to which the criteria was satisfied, with ++ indicating highest quality or lowest risk of bias. One reviewer (LV) conducted the assessments and a random 20% were checked by a second reviewer (EM).
Data synthesis
This review aimed to explore associations between two types of intervention components (BCTs and digital features) and the percentage of baseline weight lost and assess the effectiveness of interventions using international diabetes prevention benchmarks and certification requirements. Therefore, a narrative synthesis was chosen to organise and present the data within the text, with statistical data presented in the summary tables. As the majority of studies featured in the primary effectiveness analysis did not report the percentage of weight lost, sufficient data was not available for meta-analysis.
Results
A total of 3510 unique articles were identified via electronic database searches (see Figure 1), with 323 remaining for full-text review. Following full-text review, 28 full-text articles were retained, and a forward and backward reference search identified nine additional articles. Thirty-seven articles (see Supplementary File 3) representing 19 studies of 21 interventions (two studies each assessed two unique technology-driven DPIs) were ultimately included. For studies reported in multiple articles, only the main article reporting the primary outcome measure(s) at first follow-up is referenced in the text and tables.

PRISMA flow diagram.
Study characteristics
A summary of the characteristics of all 19 studies can be found in Table 1. Most studies (
Study characteristics.
NA: Not Applicable.
Intervention characteristics
A summary of the characteristics from all 21 technology-driven DPIs can be found in Table 2. The intervention delivery period ranged between 3 and 24 months in duration, and all interventions targeted both diet and physical activity behaviours. Eleven interventions were independent (newly developed),34,36–38,46,48–52 and 10 were largely adapted from a previous face-to-face program. Of these 10, six35,39,40,43,45,47 were adapted from the Diabetes Prevention Program,
53
and four41,42,44 were adapted from the Group Lifestyle Balance Program.
54
Sixteen interventions were informed by at least one theory or framework, with Social Cognitive Theory (
Intervention characteristics.
Quality assessment
A summary of the quality assessments for all 19 studies can be found in Supplementary Table 1. Fifteen studies (all 10 RCTs and five of the nine non-RCTs) achieved a high quality rating for internal validity through minimisation of bias across multiple criteria. Ten studies (seven of the 10 RCTs and three of the nine non-RCTs) achieved a high quality rating for external validity, with findings generalisable to the source population.
Intervention effectiveness
Two studies were excluded from the primary effectiveness assessment. The study by Arens, Hauth, and Weissmann
52
was excluded as they implemented rolling follow-ups where a common intervention end point could not be determined. However, on average, participants remained in the intervention for 8.3 months, losing 2.4 kg (
Based on this review’s primary effectiveness criteria, 12 interventions were effective short term,34,35,40–47,51 these included both the GLB-DVD and GLB-Internet interventions by Piatt et al. 44 and the Behavioural e-Counseling intervention by Tate et al. 46 Seven interventions were not effective short term,36–39,46,48,50 including the Basic Internet intervention by Tate et al. 46 Four interventions were effective long term,35,42–44 including the GLB-Internet intervention by Piatt et al. 44 Eight interventions were not effective long term;39,44–48,50 including the GLB-DVD intervention by Piatt et al. 44 and both the Behavioural e-Counseling and Basic Internet interventions by Tate et al. 46
Of the four interventions that included an active weight maintenance phase (8–12 months in duration) with sufficient outcome data, one achieved further weight loss 43 and three achieved weight maintenance (as indicated by <0.5% change in body weight) during this period.35,42,45 Four interventions included follow-ups that were conducted 12 or more months after the intervention was complete. Of these, both the GLB-DVD and GLB-Internet interventions by Piatt et al. 44 achieved further weight loss at 12 months post-intervention, one achieved weight maintenance at 12 months, 43 and one achieved weight maintenance at 12 months but reported a 39% regain of lost weight at 24 months. 45
Secondary measures
Change in glycaemia
Complete results for changes in A1c and fasting glucose were reported for 9 and 13 interventions respectively (see Supplementary Table 3). Seven interventions achieved significant improvement in A1c34–36,38,41,45,51 and five interventions achieved significant improvement in fasting glucose.34,41,42,47,48
Incidence of T2D
Incidence rates for T2D were reported for two interventions. Wong et al.
50
found a 24-month T2D incidence rate of 11.11% and 18% in the intervention and usual care groups respectively. However, this difference was not significant. Ramachandran et al.
49
reported significantly lower T2D incidence, HR = 0.700,
Behaviour change techniques
Thirty unique BCTs were coded from all 21 interventions (see Supplementary Table 4), with an average of nine BCTs per intervention (range: 1–14). A summary of the BCTs identified in effective and non-effective interventions can be found in Table 3. Seven BCTs were identified in at least 75% of effective interventions, both short and long term. These were: goal setting (behaviour) (identified in 92% and 100% of effective interventions in the short and long term respectively), problem solving (75% and 100%), goal setting (outcome) (92% and 100%), feedback on behaviour (92% and 100%), self-monitoring of behaviour (92% and 75%), self-monitoring of outcome(s) of behaviour (92% and 100%), and social support (unspecified) (100% and 100%).
Summary of behaviour change technique use in effective and non-effective interventions.
Short term effectiveness
Interventions that achieved short term effectiveness used an average of 11.3 BCTs (range: 4–14), compared to 5.4 (range: 1–10) among non-effective interventions. Two BCTs were identified at a considerably greater frequency in effective interventions versus non-effective interventions. These were social support (unspecified) (identified in 100% of effective interventions versus 29% of non-effective interventions) and adding objects to the environment – coded when participants were issued pedometers to count their steps (67% versus 0%).
Long term effectiveness
Interventions that achieved long term effectiveness used an average of 11.5 BCTs (range: 10–13), compared to 7.8 (range: 1–13) among non-effective interventions. One BCT, problem solving, was identified at a considerably greater frequency in effective interventions versus non-effective interventions (100% versus 50%).
Digital features
The digital and non-digital components coded from all 21 interventions can be found in Supplementary File 5. Ten digital features – five passive and five interactive (see Supplementary Table 5) – were identified via thematic analysis of intervention descriptions. Detailed descriptions of all ten digital features can be found in Supplementary File 6. The five passive features were: health and lifestyle information and advice; activity tracking; reminders and prompts; diet tracking; and, weight and biomeasure tracking. The five interactive features were: interactive health and lifestyle lessons; social media and support; online health coaching; automated feedback; and gamification. Interventions used an average of 4.3 digital features (range: 1–9), including 2.9 passive features (range: 1–5) and 1.4 interactive features (range: 0–4).
A summary of the digital features identified in effective and non-effective interventions can be found in Table 4. Three digital features (all passive) were identified in at least 75% of effective interventions, both short and long term. These were: activity tracking (identified in 100% and 100% of effective interventions in the short and long term respectively), health and lifestyle information and advice (75% and 75%); and diet tracking (75% and 75%). It is noteworthy that the interactive social media and support feature was identified in only 50% of the effective interventions, yet the social support (unspecified) BCT was identified in 100% of effective interventions. Additionally, of the three interventions that only used paper based rather than digital tools to track diet and physical activity, two were not effective in the short term, and all three were not effective in the long term (data not shown).
Summary of digital feature use in effective and non-effective interventions.
Short term effectiveness
Interventions that achieved short term effectiveness used an average of 5.6 total features (range: 3–9), including 3.8 passive features (range: 2–5) and 1.8 interactive features (range: 0–4). Non-effective interventions used an average of 2.7 total features (range: 1–5), including 1.9 passive features (range 1–4) and 0.9 interactive features (range: 0–2). Three digital features were identified at a considerably greater frequency in effective interventions versus non-effective interventions. These were the passive features of activity tracking (identified in 100% of effective interventions versus 29% of non-effective interventions) and diet tracking (75% versus 14%), and the interactive feature of online health coaching (58% versus 0%).
Long term effectiveness
Interventions that achieved long term effectiveness used an average of 6 total features (range: 4–7), including 4.3 passive features (range: 3–5) and, 1.8 interactive features (range: 1–3). Non-effective interventions used an average of 3.9 total features (range: 1–7), including 2.4 passive features (range: 1–4) and 1.5 interactive features (range: 1–4). Four digital features were identified at a considerably greater frequency in effective interventions versus non-effective interventions. These were the passive features of activity tracking (100% versus 50%), reminders and prompts (100% versus 50%), weight and biomeasure tracking (75% versus 25%), and the interactive feature of online health coaching (100% versus 38%).
Additional analyses
As the imputation process used in this review is a novel means of coding BCTs and digital components, additional analyses were conducted using only those BCTs and digital components clearly present in each study’s intervention description(s). Results of these analyses, which exclude any BCT or digital feature coded via imputation, can be found in Supplementary Tables 8–10.
Discussion
This systematic review assessed 19 studies of 21 technology-driven DPIs, with the aims of determining which interventions were effective in producing clinically significant weight loss and improvements in additional outcomes linked to the onset of T2D and identifying the most effective BCTs and digital features. This review found that, in the short term (≤6 months), most technology-driven DPIs successfully achieved clinically significant weight loss in adults at risk of developing T2D, as determined by an average weight loss of at least 3% of baseline body weight. However, most interventions fell short of achieving the 5% weight loss benchmark for clinical significance at ≥12 months. Follow-up data indicated that weight loss was maintained for at least one year post-intervention. Additionally, seven and five interventions achieved significant improvements in A1c and fasting glucose respectively, and one study found a significantly lower 5-year incidence of T2D among participants who completed the intervention compared to those who received usual care – evidence to support the effectiveness of technology-driven DPIs in diabetes prevention. Across all the reviewed studies, there was wide heterogeneity in study populations, attrition rates, intervention duration, and mode of delivery. Comparable findings on the effectiveness of technology-driven DPIs and inter-study heterogeneity were reported in previous meta-analyses.19,20
Behaviour change techniques
Interventions which used a larger number of BCTs were more effective. This is consistent with reviews of face-to-face interventions for individuals with T2D55–57 or those at risk of developing T2D. 58 Seven unique BCTs were frequently identified in effective interventions. These were: social support (unspecified), goal setting (behaviour), goal setting (outcome), feedback on behaviour, self-monitoring of outcome(s) of behaviour, self-monitoring of behaviour, and problem solving. All of these BCTs correspond to the recommended behaviour change components for face-to-face DPIs as outlined in the IMAGE toolkit for the prevention of T2D in Europe. 23 Therefore, the present findings suggest these recommendations should extend to technology-driven DPIs. Of the recommended behaviour change components described in the toolkit, action planning was the only corresponding BCT that was not identified in at least 75% of effective interventions. Nevertheless, as action planning was identified more frequently in effective than non-effective interventions in both the short and long term, this technique may still be a valuable inclusion in technology-driven DPIs.
In the short term, effective interventions used, on average, 5.6 more BCTs than non-effective interventions, with social support (unspecified) and adding objects to the environment the most effective BCTs. A number of digital social support-based weight loss interventions have reported significant weight loss.59–61 However, the broad nature of the social support (unspecified) BCT may have increased the frequency in which it was coded in the present review relative to other BCTs. As this BCT accommodates a wide range of social support strategies, a rationale for the effectiveness of social support in the present review is difficult to discern, and weight loss may have occurred via interactions between social support and other intervention components. Furthermore, studies of online weight loss communities found weight loss or weight gain to depend on: the type(s) of social support available; how participants provided and received support; and the level in which participants engaged with the support opportunities.62–65 Therefore, for a nuanced understanding of the relationship between social support and weight loss in technology-driven DPIs, further assessment is needed to identify the perceptions and experiences of participants who engaged or disengaged with the social support tools and opportunities. Adding to the success of social support, all eight interventions that issued pedometers were effective – perhaps unsurprising given that pedometer-based walking interventions, even those lacking dietary intervention, have achieved modest weight loss. 66 However, weight loss may not be the product of pedometer use per se, as goal setting (e.g., daily step targets) could have motivated participants to increase their physical activity to the level required for weight reduction. Supporting this, a review of pedometer use among adult outpatients reported a 27% increase in physical activity and significant decrease in Body Mass Index (BMI), with goal setting the key outcome predictor. 67 It is also possible that participants perceived the self-contained pedometer to be a practical gift of value, providing an incentive to engage with the intervention in its early stages.
In the long term, effective interventions used, on average, 3.7 more BCTs than non-effective interventions. The most effective BCT was problem solving, a technique which encourages participants to generate potential strategies for health behaviour change (such as overcoming barriers, relapse prevention, and coping planning), and then selecting, applying, and evaluating the most appropriate strategy.21,23,68 Such strategies may have empowered participants to build the necessary skills to maintain healthier behaviours long term and prevent or overcome weight loss plateaus.
Collectively, the evidence suggests that technology-driven DPIs containing a larger number of BCTs were more likely to achieve clinically significant weight loss. Moreover, a specific set of seven BCTs were frequently identified in interventions that were effective in both the short and long term. Social support and adding objects to the environment (via pedometer use) were the most effective BCTs in the short term, and problem solving was the most effective BCT in the long term.
Digital features
Much like the evidence for BCTs, interventions which used a larger number of passive and interactive digital features were more effective. Comparable results were reported by Donevant et al. 24 and Holcombe et al., 25 who found that mobile health interventions were more effective in improving diabetes-related outcomes when interactive features were included. However, in the present review, the influence of interactive features decreased over time. Three digital features, all passive (health and lifestyle information and advice, diet tracking, and activity tracking) were frequently identified in effective interventions – suggesting that these components may constitute an effective core set of features which future technology-driven DPIs should integrate as a base standard.
In the short term, effective interventions used, on average, 1.9 more passive features and one more interactive feature than non-effective interventions. The most effective were the passive features of activity tracking and diet tracking and the interactive feature of online health coaching. In the long term, effective interventions used, on average, 1.9 more passive features and 0.25 more interactive features than non-effective interventions. The most effective were the passive features of: activity tracking, reminders and prompts, weight and biomeasure tracking, and the interactive feature of online health coaching.
The comparatively high use of digital tracking and online health coaching across effective interventions at both time periods offers two conclusions. First, self-monitoring may be most effective when digital technologies are used to track behaviours and outcomes. This is further supported by the low rate of effectiveness among interventions that used paper-based tracking only. Paper-based diaries can be burdensome and subject to delayed reporting and low adherence69,70 – limitations previously observed in diet plus physical activity interventions.71,72 However, paper-based reporting may have simply been less engaging for participants who chose to enrol in a technology-driven DPI through an interest in using digital tools. Second, feedback was most effective when delivered digitally, provided that it was given by a human coach. Online coaching predominantly involved two-way instant messaging and may have multiple advantages over automated feedback and real-time health coaching delivered in person or by phone. Online coaching grants participants the human interaction and detailed, tailored feedback that is lacking in automated feedback protocols; yet, unlike live coaching, instant messages are concise and accessible 24 hours a day. Furthermore, online coaching eliminates the need to set mutually convenient meeting times, arrange transport, or seek privacy to accept or make a phone call. Although self-monitoring and health coaching were most effective when delivered digitally, the same was not found for social support. The social support (unspecified) BCT, used in 100% of effective interventions, captured online, face-to-face, and phone support; yet the digitally-exclusive social media and support feature was found in only 50% of effective interventions, together suggesting that online support (e.g., via other participants) and face-to-face or phone support (e.g., via family, friends, and support staff) were equally effective.
Technology-driven DPIs have been developed to overcome the accessibility barriers of face-to-face interventions, and, as the present findings collectively suggest, interventions which use more BCTs and digital features are more effective; websites and smartphones may be the most suitable modes of delivery due to their increasingly high adoption rates and breadth of functionality. In 2018, internet use and smartphone ownership rates among adults in advanced economies were 90% and 76% respectively, with sharp, steady growth reported among the 50-and-older age group. 73 Moreover these multimedia platforms have the capacity to incorporate a large variety of passive and interactive features and deliver a comprehensive, evidence-based curriculum such as that used in the Diabetes Prevention Program.
Strengths and limitations
This was the first review of technology-driven DPIs to identify the BCTs and digital features frequently associated with clinically significant weight loss. We used two separate approaches to identify intervention components, enabling a detailed assessment of the interventions’ active ingredients. BCT coding represented a top-down approach in which intervention descriptions were reduced to their smallest behaviour change components as informed by existing labels and definitions. Conversely, digital feature identification was a bottom-up approach through which the features were informed by the intervention descriptions themselves – working from the narrowly defined digital components, up to the broadly defined digital features. Future reviews of interventions containing both digital and non-digital components may benefit from this dual-approach as, in addition to identifying the interventions’ most effective behavioural components, this approach can also identify a component’s most effective mode of delivery.
This review has some limitations. First, identification of BCTs and digital components was dependent on the detail in which the interventions were described – a common limitation of reviews that examine BCTs and digital features.20,24,57 While the imputation process mitigated this to some degree, imputation was only used to extrapolate BCTs from other studies within this review that applied the same standardised intervention. For all independent interventions, a BCT was only marked as present if its inclusion was explicitly clear in the intervention description(s). Second, although this review found BCTs and digital features to be identified more frequently in effective interventions, the long term assessment contained fewer interventions than the short term assessment. Therefore, greater confidence may be placed in the short term findings. Third, as a meta-analysis was not feasible (nor an aim of this review), an overall intervention effect was not established, and, as there was wide heterogeneity in sample size between studies, an intervention’s effectiveness may have been influenced by each study’s statistical power. However, to establish the effectiveness of individual interventions, we used international benchmarks and certification criteria that are applied, in practice, to assess interventions on a case-by-case basis. For example, the CDC can certify an individual cite regardless of sample size (at a minimum of 5 participants), provided the 5% weight loss benchmark was achieved. 8 Finally, we reviewed studies with varying designs, including RCTs and non-experimental (observational) studies, which may have introduced various biases. However, technology-driven DPIs are designed for real world implementation, and RCT conditions are unlikely to match those in which the intervention is routinely completed. Furthermore, observational data can offer insight into the outcomes of participants often unrepresented in RCTs, such as older adults or individuals with comorbid conditions. 74 These population groups are particularly important, with recent US reports citing that nearly half of adults aged 65 and over have prediabetes and, of all adults with prediabetes, rates of comorbid hypertension and dyslipidaemia were 51% and 24% respectively.75,76
Future directions
Although this review described the associations between specific BCTs, digital features, and effectiveness, causality cannot be inferred, and further research is needed to determine the most effective intervention components for population sub-groups such as those defined by age, gender, ethnicity, geographic location, and socio-economic status. As some technology-driven DPIs have standardisation requirements, precluding the post-hoc testing of individual components,35,77 developers of future interventions could trial individual components during the development phase. For example, the Multiphase Optimisation Strategy (MOST), 78 which facilitates the identification and testing of candidate components before a complete prototype is developed and ultimately tested via RCT. However, this process is subject to relatively high resource and time commitments, and care is needed to ensure that methodological rigour does not impede the assessment of real world effectiveness. Further research is also needed to identify the implementation and sustainability costs for the digital features by mode of delivery so that cost-effectiveness can be established. The ‘non-effective’ interventions in this review do not necessarily lack utility in T2D prevention as for every kilogram of weight lost in the original Diabetes Prevention Program, T2D risk was still reduced by 16%. 79 Interventions that achieve modest weight loss but are inexpensive to sustain may still be viable T2D prevention tools. Finally, each of the reviewed interventions targeted physical activity and dietary behaviours, yet only 11 and 9 studies reported changes in these respective behaviours, each measured in a variety of ways. Standardised physical activity and dietary measures should be used in future interventions to enable researchers to identify the behaviours that most strongly influence weight loss. Additionally, as attrition varied widely between studies, further research is also required to assess participant adherence and engagement, and its subsequent impact on behaviour change and the outcomes associated with T2D.
Conclusion
A number of technology-driven DPIs achieved clinically significant weight loss in adults at risk of developing T2D, particularly in the short term, which, along with reports of improved glycaemia and lower T2D incidence, supports the utility of these interventions for preventing diabetes. However, many interventions still fell short of reaching the 12 month 5% weight loss target as set by the CDC and recommended by NICE. Effective interventions contained a larger number of BCTs and digital features than non-effective interventions. Interventions that encouraged participants to set goals; self-monitor their diet, physical activity, and body weight; seek social support; and develop problem solving strategies were most successful. Technology-driven DPIs can be optimised by integrating digital-only tools that provide health and lifestyle information and advice; track behaviours and outcomes; and facilitate online behavioural support from a health coach. Websites and smartphone applications are appropriate modes of delivery as these multimedia platforms are widely accessible and have the capacity to incorporate a large variety of features. Additional research is needed to determine the cost-effectiveness of technology-driven DPIs and identify the mechanisms in which BCTs and digital features directly influence physical activity, dietary behaviours, and engagement among different population groups.
Supplemental Material
DHJ914427 Supplementary Material1 - Supplemental material for A systematic review of the behaviour change techniques and digital features in technology-driven type 2 diabetes prevention interventions
Supplemental material, DHJ914427 Supplementary Material1 for A systematic review of the behaviour change techniques and digital features in technology-driven type 2 diabetes prevention interventions by Luke Van Rhoon, Molly Byrne, Eimear Morrissey, Jane Murphy and Jenny McSharry in Digital Health
Supplemental Material
DHJ914427 Supplementary Material2 - Supplemental material for A systematic review of the behaviour change techniques and digital features in technology-driven type 2 diabetes prevention interventions
Supplemental material, DHJ914427 Supplementary Material2 for A systematic review of the behaviour change techniques and digital features in technology-driven type 2 diabetes prevention interventions by Luke Van Rhoon, Molly Byrne, Eimear Morrissey, Jane Murphy and Jenny McSharry in Digital Health
Supplemental Material
DHJ914427 Supplementary Material3 - Supplemental material for A systematic review of the behaviour change techniques and digital features in technology-driven type 2 diabetes prevention interventions
Supplemental material, DHJ914427 Supplementary Material3 for A systematic review of the behaviour change techniques and digital features in technology-driven type 2 diabetes prevention interventions by Luke Van Rhoon, Molly Byrne, Eimear Morrissey, Jane Murphy and Jenny McSharry in Digital Health
Supplemental Material
DHJ914427 Supplementary Material4 - Supplemental material for A systematic review of the behaviour change techniques and digital features in technology-driven type 2 diabetes prevention interventions
Supplemental material, DHJ914427 Supplementary Material4 for A systematic review of the behaviour change techniques and digital features in technology-driven type 2 diabetes prevention interventions by Luke Van Rhoon, Molly Byrne, Eimear Morrissey, Jane Murphy and Jenny McSharry in Digital Health
Supplemental Material
DHJ914427 Supplementary Material5 - Supplemental material for A systematic review of the behaviour change techniques and digital features in technology-driven type 2 diabetes prevention interventions
Supplemental material, DHJ914427 Supplementary Material5 for A systematic review of the behaviour change techniques and digital features in technology-driven type 2 diabetes prevention interventions by Luke Van Rhoon, Molly Byrne, Eimear Morrissey, Jane Murphy and Jenny McSharry in Digital Health
Supplemental Material
DHJ914427 Supplementary Material6 - Supplemental material for A systematic review of the behaviour change techniques and digital features in technology-driven type 2 diabetes prevention interventions
Supplemental material, DHJ914427 Supplementary Material6 for A systematic review of the behaviour change techniques and digital features in technology-driven type 2 diabetes prevention interventions by Luke Van Rhoon, Molly Byrne, Eimear Morrissey, Jane Murphy and Jenny McSharry in Digital Health
Supplemental Material
DHJ914427 Supplementary Material7 - Supplemental material for A systematic review of the behaviour change techniques and digital features in technology-driven type 2 diabetes prevention interventions
Supplemental material, DHJ914427 Supplementary Material7 for A systematic review of the behaviour change techniques and digital features in technology-driven type 2 diabetes prevention interventions by Luke Van Rhoon, Molly Byrne, Eimear Morrissey, Jane Murphy and Jenny McSharry in Digital Health
Footnotes
Funding
The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This work was supported by the National University of Ireland, Galway under the Hardiman Scholarship; and the Irish Research Council under the Government of Ireland Postgraduate Scholarship [Project ID number: GOIPG/2019/1355]. The funders had no role in study design, data coding and analysis, the decision to publish, or preparation of the manuscript.
Conflicting of interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Ethical approval
Not applicable
Guarantor
MB
Contributorship
LV was the review lead and was responsible for drafting the review protocol, conducting searches, screening articles, extracting data, conducting quality assessments, coding BCTs and digital components, identifying digital features, analysing and synthesising the data, and writing the manuscript. EM independently double-coded the BCTs and digital components, identified digital features, and performed consistency checks on the data and quality assessments. MB and JMc provided independent advice for the duration of the review process. JMu independently double-screened the full-text articles. All authors contributed to the review protocol and critically reviewed each manuscript draft and approved the final manuscript.
Acknowledgements
None
Peer Review
Tim Robbins, University of Warwick reviewed this paper.
Supplemental material
Supplemental material for this article is available online.
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
