Abstract
Background:
Nonadherence to diabetes medication is prevalent and costly. MEssaging for Diabetes (MED), a mobile health (mHealth) intervention, identified and addressed user-specific barriers to medication adherence. We assessed whether MED reduced users’ targeted barriers and if barrier reductions were associated with within-participant improvements in adherence or glycemic control (HbA1c).
Methods:
Adults (N = 80) with type 2 diabetes completed self-report measures identifying barriers to adherence at baseline and monthly for 3 months. At each assessment, 17 barriers were assessed and ranked for each user. Each subsequent month, users received daily text messages addressing their 3 highest ranked barriers. Targeted barriers were different for each participant and could change monthly. Paired
Results:
Participants were 69% non-white and 82% had incomes <$25K. Average HbA1c was 8.2 ± 2.0%. Assessment completion rates were 100% at baseline, 59% at 1 month, 30% at 2 months, and 65% at 3 months. The most commonly reported barriers were the cost of medications (76%), believing medications are harmful (58%), and lacking information about medications (53%). Participants’ barrier scores improved each month and barrier improvement predicted adherence assessed via nightly adherence assessment text messages (
Conclusions:
Iterative, individual tailoring may overcome users’ barriers to adherence. Attrition is a challenge for mHealth interventions among low-income patients.
Nonadherence to diabetes medications is a problem, 1 especially among low-socioeconomic, racially diverse populations.2,3 Medication nonadherence has costly consequences, including the human and economic burden of more diabetes-related complications and a higher risk of premature mortality. 4 Mobile health (mHealth) interventions have the potential to reach the hardest-to-reach and most vulnerable populations to support adherence and improve health outcomes5,6 at low cost. 7 Currently, 9 in 10 US adults use a mobile phone 8 and more than 80% of mobile phone users text message. 9 There are no disparities in using mobile phones for text messaging and phone calls by race/ethnicity or socioeconomic status (SES).9,10 Furthermore, mHealth interventions using text messaging and phone calls have been acceptable among low-income and racially diverse samples in the United States, and some have recently improved glycemic control among adults with diabetes.7,11 However, few mHealth interventions have targeted diabetes medication adherence, specifically.11 -13
Mobile technology provides opportunities to tailor an intervention’s functionality (ie, timing and dose/frequency of messages and calls) and content to meet users’ needs and preferences. 14 Tailored text messages have been repeatedly shown to be more engaging and more effective at changing health behavior than nontailored messages.13,15,16 Tailoring content to users’ barriers to adherence should be effective, 17 but doing so only once may not be adequate for long-term improvements because (1) patient-reported barriers may change over time (eg, financial factors, 18 social and environmental stressors, 19 and regimen-specific challenges), and (2) interventions may be successful in reducing existing barriers to adherence and new barriers may arise. Tailoring throughout interventions (ie, dynamic tailoring) is increasingly being used to sustain patient engagement and improve intervention effectiveness,7,15,20 but its value is rarely empirically examined.
Despite increased interest in and success of mHealth interventions to support diabetes self-management, little is known about how mobile communications contribute to behavior change and improvements in clinical outcomes. 21 Identifying whether interventions effectively improve the mechanisms they target can inform future interventions 22 and ensure the most effective elements are retained. 23 Few mHealth interventions have evaluated effects on the psychological mechanisms targeted by the content. 24 Therefore, we conducted a 3-month evaluation of the MEssaging for Diabetes (MED) intervention, which identifies participants’ individual barriers to medication adherence and dynamically tailors text messages each month to improve patients’ adherence and glycemic control. 25 Our objectives were to evaluate whether the MED intervention reduced user-specific barriers to adherence each month, and whether barrier reductions were associated with improvements in adherence and glycemic control.
Methods
We recruited patients receiving care from a federally qualified health center (FQHC) in Nashville, Tennessee from February to September 2013. Trained research assistants (RAs) worked with clinic staff and advertised the study on flyers in the clinic waiting area to recruit eligible and interested participants. Eligible patients were English-speaking adults (≥18 years old) diagnosed with and prescribed medications for type 2 diabetes mellitus (T2DM) who owned a cell phone with text messaging capability. Exclusion criteria included a diagnosis of dementia and visual or auditory limitations because participants needed to see text messages and hear automated calls. RAs took interested and eligible participants to a private clinic room to complete informed consent and to verbally administer self-report measures. 26 RAs also completed medical chart reviews to collect the number and type of prescribed medications. The Vanderbilt University Institutional Review Board approved all study procedures prior to enrollment.
Intervention
The MED intervention includes daily text messages and weekly automated calls using interactive voice response (IVR) technology. The MED intervention sends: (1) a unique, daily, tailored text message addressing the user’s barriers to adherence, (2) a daily text message at the user’s bedtime asking if he or she has taken all diabetes medicines that day (requesting a yes/no response), and (3) a weekly IVR call. The IVR call provides feedback on the user’s adherence the previous week based on his or her responses to the daily 2-way text message, with encouragement and interactive problem-solving prompts. 25 We used the SuperEgo© mobile communications platform 27 to integrate self-reported barriers and preferences for timing of messages and IVR calls and to aggregate responses to 2-way text messages and communicate with Twilio©, which delivers corresponding text message and IVR communications.
Participants were exposed to MED for 3 months. Participants complete assessments with self-report measures at baseline, and at 1, 2, and 3 months postbaseline. Seventeen barriers to adherence are assessed and scores are standardized and ranked. Each barrier is “tagged” to sets of text messages with tips and information to reduce the barrier, and users get 1 text message per day addressing 1 of their 3 highest-ranked barriers over the course of 1 month. 25 Text messages are sent randomly without replacement so users do not receive the same text message twice within the same month. 25 At each assessment, all 17 barriers are reassessed and reranked, so a user might have 3 new barriers targeted by MED during the next month or 1 or more of the same barriers targeted previously, depending on whether the same barriers continued to rank highest for that user over time. If a user does not complete a monthly assessment, text messages continue to target barriers identified the previous month. For users who report less than 3 barriers, barriers are randomly selected, so MED addresses 3 barriers to adherence at any given time for all users.
Detailed descriptions of MED’s functionality, barriers, and associated text messages have been published. 25 Example barriers and associated text messages included:
Measures
Statistical Analyses
All analyses were conducted with Stata v13. We used descriptive statistics to characterize the sample, and identify the sample’s most common barriers to adherence. We used Mann-Whitney
Paired (within-participant)
Next, a series of regression models assessed whether within-participant changes in barriers scores predicted within-participant change in adherence and HbA1c. Models were unadjusted because each participant was his or her own control. All models used clustered standard errors to account for shared within-participant variance (ie, barriers grouped within participants). The coefficients are interpreted the same as ordinary least squares regression nonstandardized coefficients, but the standard errors take into account that the observations are not independent. Standardized coefficients are nonsensical because standard errors vary across participants.
For medication adherence, we regressed SDSCA-reported adherence and, separately, responses to 2-way text messages assessing adherence onto changes in barrier scores. For the SDSCA analyses, we adjusted for baseline SDSCA scores and ran separate models in which barrier changes each month predicted change in the SDSCA score for that month. For the text message reporting, we examined whether change in barrier scores each month predicted adherence reported via text messages during MED exposure (ie, number of “yes” responses/number of 2-way texts sent).
For HbA1c, regression models assessed whether within-person change in barriers scores led to within-person change in HbA1c. These models were first unadjusted and then adjusted for baseline HbA1c. The first included all available data, regressing change in HbA1c from baseline to follow-up onto change in barrier scores (ie, number of barriers varied depending on the number of follow-up assessments each participant completed). This model was unable to isolate the effects of barrier reductions by month of MED exposure due to missed follow-up assessments. The second could isolate these effects, but only included data from 18 participants who completed all assessments. In this analysis, pre to post change in HbA1c was regressed onto change in each barrier score for all 3 months of MED exposure (ie, 9 values per participant—3 per month for 3 months). This model was able to isolate the effects of barrier reductions by month of MED exposure.
Results
Participant characteristics are shown in Table 1. Participants were 80 adults (50.1 ± 10.5 years old), 68% were female and 69% were non-white. Most (82%) had an annual income <$25,000 (USD) and 35% were uninsured. Forty-three percent of participants were prescribed 2 diabetes medications (range 1-3) and 64% were prescribed insulin. Figure 1 depicts the number of participants who received intervention content addressing each barrier for at least 1 month during the 3-month MED trial. The most frequently reported (and therefore most commonly addressed) barriers were cost of medications (76% of participants), believing medications are harmful (58%), and lack of information about medication (53%). According to the SDSCA, out of the past 7 days, the sample was adherent for an average of 6.13 ± 1.22 days at baseline, 6.48 ± 1.36 days at 1 month, 6.82 ± 0.43 days at 2 months, and 6.18 ± 1.35 days at 3 months. Adherence according to the daily 2-way text message responses was 85.8% ± 20.5% (IQR 84.7-97.3%) over the 3-month MED trial. The average baseline HbA1c was 8.3 ± 2.0%; and the average change in HbA1c was −0.05 ± 1.04% (range −3.1 to 2.6%).
Participant Characteristics.
Assessed with the Summary of Diabetes Self-Care Activities medications subscale administered separately for each prescribed diabetes medication and then averaged across medications.
Number of “yes” responses / total number of 2-way text messages sent during MED exposure. Two-way text messages were sent each night at each participant’s bedtime and asked if he or she took all his or her diabetes medications for that day.
One outlier was excluded from summary statistics and analyses for HbA1c. This participant had a baseline HbA1c value of 6.3% and a follow-up value of 11.4%, representing a change in HbA1c of 5.1%.

Barriers to diabetes medication adherence assessed and the number of participants (out of 80) who received text messages targeting the barrier at any point during MEssaging for Diabetes.
Participants were invited to complete each assessment, regardless of whether they missed a prior one. Assessment completion rates were 100% at baseline, 59% at 1 month, 30% at 2 months, and 65% at 3 months. For each follow-up assessment, we compared completers with noncompleters on all variables in Table 1. We found no systematic differences: relative to noncompleters, more female, white, and adherent (all
Figure 2 shows the average within-participant change (Δ, delta) in the standardized barrier scores MED addressed for each participant, depicted separately each month of the intervention. The within-participant reduction was significant for at least 2 of the 3 barriers addressed each month, with largest reductions in the first month (Figure 2). Within-participant barrier reductions were not associated with within-participant SDSCA changes overtime. However, within-participant barrier reductions by month predicted higher adherence assessed via text message responses (ie, regression coefficients at month 1 = −0.06; month 2 = −0.05; month 3 = −0.08, all

Changes in standardized scores for the top 3 barriers to diabetes medication adherence addressed by the intervention each month. Paired (within-participant)
Do Changes (Δ) in Barrier Scores During Each Month of the Intervention Predict Change in HbA1c From Baseline to 3-Month Follow-Up Assessment Among Participants Who Completed Each Assessment (n = 18)?
Robust standard errors allow for intragroup correlation (ie, 3 barriers for each participant, each month) using Stata option cluster. Among the 18 participants who completed all assessments, the average change in HbA1c was −0.22 ± 1.28%.
Boldface indicates statistical significance. †
Discussion
MEssaging for Diabetes (MED) delivers daily text messages addressing user’s individually identified barriers to diabetes medication adherence. In this diverse, low-income sample the most common barriers were the cost of medications, believing medications are harmful, and lack of information about medication. MED retailored text message content to each participant’s barriers each month they completed an assessment—continuing to address barriers that remained a problem and/or identifying new barriers. Participants experienced reductions in barriers addressed each month of the intervention. Furthermore, barrier reductions each month of MED exposure predicted greater adherence assessed via participants’ responses to daily text messages. Barrier reductions were not associated with glycemic control improvement in the full sample, but were associated with glycemic control improvement among participants who completed all assessments.
We found barrier reductions tapered throughout the intervention, with the largest effects in the first month and the weakest effects in the third month. There are several potential explanations for this. First, the novelty of MED may have worn off and participants quit reading and/or thinking about the text messages due to alert fatigue or repetitiveness of the messages (message content was repeated if targeted barriers did not change). Second, MED may have addressed the most salient barriers for participants at the beginning of the study. Figure 2 shows empirical support for this hypothesis; barriers with higher initial scores (ie, more potential for reduction) were addressed in the first 2 months. Third, we had less power to detect change in participants’ barrier scores in later months due to fewer participants completing follow-up assessments.
Our measures of adherence have limitations. Barrier reductions did not predict improvement in participant-reported adherence on the SDSCA, but did predict rate of yes responses to daily 2-way text messages. The SDSCA assesses adherence during the past 7 days only, and the average baseline adherence in our sample was more than 6 days per week, leaving little room for improvement. Others have noted the SDSCA’s lack of sensitivity, limited variability, and ceiling effects. 32 Adherence via daily 2-way texts messages also has limitations. There is no baseline level using this measure, and this text message was an intervention component in itself—many participants said they used the message as a reminder to take their evening doses—so responses may have little to do with those text messages addressing barriers.
Engagement is an important concern in behavioral interventions, especially for patients with low SES. 26 Participants who completed monthly assessments did not differ systematically from those who did not on demographic characteristics, adherence or HbA1c. Thus, MED was successful in retaining the most at-risk participants (ie, those with the lowest incomes, no insurance, less adherence, and high HbA1c). However, getting participants to complete follow-up assessments was still a problem. Nonparticipation in follow-up assessments led to a more static user experience, which may have, in turn, led to further nonparticipation. When MED content was redundant due to nonparticipation, it may have addressed already-overcome barriers, potentially making users less interested in MED and/or less interested in completing additional assessments. This may have reduced MED’s efficacy as well. Barrier reductions were associated with improvements in HbA1c only among participants who completed all follow-up assessments and thus had the content dynamically tailored each month.
Conclusions
Understanding the pathways by which mHealth interventions affect behavior change and clinical outcomes is critical to improving their reach and impact.
21
To advance the field of mHealth and inform behavior change efforts, studies should assess the degree to which interventions effectively change the targeted mechanisms, and whether changes in those targeted mechanism drive changes in behavioral and clinical outcomes.
22
Our as-treated analyses allowed for examining the intervention as intended, and provides a more mechanistic understanding of
Footnotes
Acknowledgements
The authors thank Cecilia C. Quintero for her role in data collection, and the Vine Hill Community Clinic personnel and the participants for their contributions to this research. This work was presented as a poster at the 75th Annual Meeting of the American Diabetes Association in June, 2015 with the title “Texting Intervention Overcomes Barriers to Medication Adherence Among Low-Income, Diverse Adults With Type 2 Diabetes.”
Abbreviations
DMKQ, Diabetes Medication Knowledge Questionnaire; FQHC, federally qualified health center; HbA1c, hemoglobin A1C; IVR, interactive voice response; MASES, Medication Adherence Self-Efficacy Scale; MDQ, Medicines for Diabetes Questionnaire; MED, MEssaging for Diabetes; mHealth, mobile health; RA, research assistant; SDSCA, Summary of Diabetes Self-Care Activities; SES, socioeconomic status; T2DM, type 2 diabetes mellitus.
Declaration of Conflicting Interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This research was supported by a McKesson Foundation mHealth Award to CYO and SAM. LSM was supported by career development award K01DK106306 from the National Institute of Diabetes and Digestive and Kidney Diseases, and by the Vanderbilt Center for Diabetes Translational Research P30DK092986. CYO was also supported by a career development award K01DK087894 and R01DK100694-01A1 from the National Institute of Diabetes and Digestive and Kidney Diseases. The contents of this manuscript are solely the responsibility of the authors and do not necessarily represent official views of the National Institutes of Health or the McKesson Foundation. The funders played no role in study design; collection, analysis, and interpretation of data; writing the report; or the decision to submit the report for publication.
