Abstract
Background:
Text message interventions are feasible, preferable, and sometimes effective for youth with diabetes. However, few, if any studies, have examined the personalized use of text messages with youth repeatedly hospitalized for diabetic ketoacidosis (DKA) and their caregivers. This study characterizes the use of personalized text messages in Novel Interventions in Children’s Healthcare (NICH).
Methods:
Approximately 2 months of text messages sent to youth with repeat DKA and their caregivers were logged regarding the following text characteristics: (1) content, (2) intervention type, (3) timing, and (4) recipient characteristics.
Results:
NICH interventionists sent 2.3 and 1.5 texts per day to patients and caregivers, respectively. Approximately 59% of outgoing texts occurred outside of typical business hours, and roughly 68% of texts contained some form of support and/or encouragement. The relation between type of intended intervention and day/time of text was significant, χ2(2, N = 5,808) = 266.93, P < .001. Interventionists were more likely to send behavioral intervention text messages outside of business hours, whereas they were more likely to send care coordination and case management text messages during business hours.
Conclusions:
To our knowledge, this is the first study to specifically categorize and describe the personalized use of text messages with youth repeatedly hospitalized for DKA and their caregivers. Findings indicate that a promising treatment program for these youth frequently used text interventions to deliver praise and encouragement to patients and caregivers alike, often outside of typical business hours, and tailored text content based on patient and caregiver characteristics.
Suboptimal adherence is relatively common amongst patients with type 1 diabetes, with only 21% of pediatric patients in the United States estimated to achieve the International Society of Pediatric and Adolescent Diabetes target glycated hemoglobin.1,2 In particular, adolescents and emerging adults are especially vulnerable to the burden associated with diabetes management and are disproportionately at risk of suboptimal diabetes management.3,4 Unfortunately, such adherence difficulties are associated with increased risk of both acute and chronic medical problems, negative psychological outcomes, and increased health care costs.5-8
In addition to patient age, several demographic, psychosocial and environmental factors put a subset of youth with diabetes at greater risk for suboptimal adherence and associated negative outcomes. 9 Specifically, adolescents and emerging adults of ethnic minority status,10,11 lower socioeconomic status,12,13 and with mental health problems (eg, depression and anxiety)14,15 are at increased risk for low adherence to treatment regimens and poorer glycemic control. Family factors (eg, high marital conflict, low family cohesion, low parental involvement in diabetes management) have also been identified as having negative implications for diabetes management and glycemic control.16-21 Patients with a combination of these risk factors may be particularly vulnerable.22-24
Behavioral interventions (eg, Wysocki et al, 25 Harris et al 26 ) are commonly used to improve adherence and glycemic control among youth with diabetes, 27 and most are moderately successful. 28 Traditionally, however, behavioral interventions for youth are office-based, constrained to a small temporal window, and are infrequent (ie, once per week or less), thereby limiting youth access to care delivered in their natural environment and at the time, frequency, and level of intensity that best matches their unique situation. Given that 75-90% of youth in the United States send and receive text messages regularly, 29 mobile health strategies (eg, text interventions) may provide an opportunity to augment the effectiveness of and increase patient access to multicomponent behavioral interventions while allowing providers to deliver immediate feedback on clinically relevant behaviors as they occur within the relevant ecological environment. In addition, racial and socioeconomic differences in text messaging rates are decreasing, potentially making mobile technology a means to reach previously underserved populations. 29
As noted in a recent review, 30 numerous studies have evaluated the use of text messaging as an intervention component to improve pediatric diabetes management by targeting blood glucose monitoring,31-34 use of insulin,31,35 diabetes education, 35 physical activity, 36 and adherence barriers. 37 With few exceptions, the vast majority of studies of text use, or short message service (SMS), do not predominantly focus on youth with poorly controlled diabetes and comorbid psychosocial vulnerability. In addition, studies which utilize “personalized” messages (not automated) do not typically include text content, intervention purpose, and message timing.32,35 Related to this, those studies often rely on a predetermined list of text selections, thereby limiting provider flexibility to adapt texts to best fit the individual and context. Moreover, our literature review identified only 1 previous study that involved caregivers in the text-messaging program. 31 Overall, SMS findings suggest that text messaging interventions are both feasible and preferable for youth; 30 however, there are few treatments that utilize personalized communications to enhance interventions and a limited understanding of the content and utility of such intervention components.
Novel Interventions in Children’s Healthcare (NICH) 38 was developed for youth repeatedly hospitalized for diabetic ketoacidosis (DKA). NICH services involve intensive home- and community-based treatment for patients and their families to reduce barriers to disease management. Text messaging is used whenever possible to increase patient and family contact, provide immediate reinforcement for diabetes management, assist with on-the-fly problem solving, build rapport, and provide skills coaching. Although NICH has been associated with improvements in diabetes management (eg, decreased HbA1c, reduced frequency of DKA),38,39 the use of SMS interventions in this treatment model has yet to be characterized. To better understand how treatment programs might utilize personalized communications to intervene with vulnerable populations, this study examined the manner in which text messages were used in NICH.
Method
Procedure and Eligibility
The current study evaluates text messages sent by NICH interventionists to youth with diabetes and their caregivers. Youth were referred to NICH by providers at a children’s hospital at a major academic medical center in the United States. Eligible youth were identified by medical staff as having experienced poor metabolic control (ie, HbA1c > 10), at least 1 diabetes-related hospitalization (eg, DKA, hypoglycemic event) in the past 6 months, presence of psychosocial vulnerability (eg, family financial insecurity, involvement of child protective services), and limited response to medical interventions. Youth and families included in this study had already received NICH services, and retrospective chart reviews were conducted to collect text data.
Only patients and caregivers who had received at least 2 months of NICH services with associated text records were included. Overall, data for 26 youth (11 males and 15 females) and 24 primary caregivers (17 mothers, 4 fathers, 1 sister, 1 grandmother, and 1 girlfriend) were collected. Twenty-four of the participating patients were diagnosed with type 1 diabetes, and 2 patients with type 2 diabetes and insulin dependence. In families with more than 1 identified caregiver, only texts sent to the interventionist’s primary contact person were included. If the patient or caregiver did not have access to a phone, the NICH program provided one. Patient mean age at onset of treatment was 15.6 years (SD = 1.7 years), and mean duration of diabetes was 6.4 years (SD = 4.3 years). During the year prior to NICH enrollment, mean patient HbA1c was 12.3 (SD = 1.5), and patients averaged 5.1 days admitted (SD = 6.5 days) due to diabetes-related complications (eg, DKA). The mean length of NICH treatment for patients in this study was 17.7 months (SD = 7.8 months; range = 8.9-37.9 months). All research procedures were approved by the university Institutional Review Board.
NICH Program Description
The interventions that comprise NICH and a case example have been described in detail previously (see Harris et al 38 for a more thorough description). Briefly, NICH services include a combination of case management, care coordination, and behaviorally based interventions. NICH interventionists are on call 24 hours per day, 7 days per week. NICH services are delivered in all contexts in which the patient and family are embedded (eg, hospitals, clinics, schools, homes) to facilitate collaboration between medical providers and families, improve families’ abilities to problem-solve, improve adherence, and reduce unnecessary hospitalizations. NICH interventionists average 3 hours per week in face-to-face service provision with patients and families. Regarding technology use, anecdotal reports of NICH interventionists and supervisors suggested that outgoing text messages are sent frequently, often occur outside of business hours, are positive and encouraging, and are modified to best fit the individual traits of the recipient (eg, more emoji and meme use with adolescents than caregivers).
At the time of this study, NICH services were being provided by 8 interventionists with caseloads of approximately 8 to 10 patients. NICH interventionists are typically masters-level providers with backgrounds in medicine, psychology, public health, and/or social work. Weekly supervision was provided by doctoral-level professionals in psychology and included, on average, 2 hours of group supervision, 1 hour of individual supervision, and phone support as needed.
Data Collection
Two months of interventionists’ text records were collected, and incoming and outgoing text frequencies were calculated. Because the aim of the current study is to better understand how treatment programs might utilize personalized communications to enhance interventions, only content from outgoing text messages was coded. Trained research assistants coded outgoing texts for micro (eg, positive reinforcement, problem-solving, scheduling) and macro level intervention content (ie, behavioral intervention, care coordination, case management). Patient age and sex, and caregiver sex and status, were recorded. Each text received a primary content code (PCC) and a care type code (CTC). If applicable, some texts also received a secondary content code (SCC). Table 1 displays brief code definitions and examples.
Care and Content Code Definitions and Examples.
Text Coding
In phase 1 of text coding, a list of potential PCC/SCC categories was created by a focus group of 5 interventionists and 1 supervisor. Categories that appeared overly similar were combined, and those judged likely to be poorly represented were removed. Coders were trained to categorize the primary theme of each text as the PCC and any secondary theme as the SCC. In phase 2, the outgoing texts from interventionists to 20 youth and caregivers were coded, interrater reliability was analyzed, and new categories were subsequently created to address identified problems in coding. A second round of coding was then conducted and resulted in improved interrater reliability and fewer texts coded as “unknown.” The outcomes from round 2 are represented in the Results section. Kappas for PCC, SCC, and CTC were .74, .59, and .77, respectively, ranging from moderate to substantial agreement. 40
Content Codes
Coders recorded the PCC/SCC of each text into 1 of 11 content categories (see Table 1). If text content did not fit in a category, it was coded as “unknown.” To estimate how many total texts contained some form of positive valence, an encouragement/support category was created that combined the positive interaction, rapport building, tech fun, and empathizing/normalizing categories.
Care Type Code
Consistent with the 3 types of services delivered in NICH, coders also recorded whether the overall message sent was most consistent with a behavioral- and/or family-based intervention, care coordination, or case management.
Results
Descriptive Information
Interventionists sent a total of 5,909 text messages to patients and caregivers, ranging from 6 to 468 texts per participant (mean = 118.2, SD = 94.3) and received a total of 7,217 text messages from patients and caregivers, ranging from 10 to 506 texts per participant (mean = 144.3, SD = 130.4). Bivariate correlations examined relations among frequencies of text messages sent to and from patients (r = .74, P < .001) and text messages sent to and from caregivers (r = .89, P < .001). Because the above analyses revealed significant associations between the number of incoming and outgoing text messages, we did not control for frequency of incoming text messages in further analyses.
NICH interventionists texted patients 2.3 times per day (SD = 1.6) and caregivers 1.5 times per day (SD = 1.0). Descriptive data for time and content of outgoing text messages appear in Tables 2 and 3, respectively. Text message frequencies by day/time of text (Table 2) reveal that, of the 5,909 text messages sent, 40.9% were sent during business hours and 58.7% were sent outside of business hours. Text messages sent outside of business hours were most often sent on weekdays prior to or after business hours (39.6%; Figure 1). Table 3 indicates that texts were sent with the purpose of behavioral intervention (76.4%), care coordination (19.6%), and case management (2.2%). The primary purpose of 52.0% of sent text messages was to provide encouragement/reinforcement, and positive interactions were the most commonly represented text content (42.2%).
Frequencies and Percentages of Outgoing Texts by Day/Time.
Morning = 12:00AM-8:59AM; Day = 9:00AM-5:00PM; Evening = 5:01PM-11:59PM. During business hours = 9:00AM-5:00PM.
Frequencies and Percentages of Outgoing Texts by Content Category.
PCC, primary content code; SCC, secondary content code. an (%) = n of care code category (percentage of care code category relative to total outgoing texts). bn (%) = n of PCC texts (percentage of PCC texts relative to total outgoing texts). cn (%) = n of SCC texts (percentage of SCC texts relative to total outgoing texts). dAll text messages were given a PCC, therefore unclear content was coded as “unknown.” SCCs were not required and thus, many text messages were not given a secondary code (ie, coded as “none”).

Frequencies of outgoing texts by day/time. Percentages reflect the percentages of all text messages that were sent during each time period; the figure does not include missing data (n = 23; 0.4% of texts).
Tests of Independence Among Study Variables
Chi-square tests of independence were performed to examine the relation between text content and text recipient (Table 4). The relation between care codes and text recipient was significant, suggesting that patients were more likely to receive care coordination texts than were caregivers, χ2(1, N = 5714) = 5.83, P < .01, and caregivers were more likely than patients to receive behavioral intervention texts (χ2 = 3.72, P < .05). In addition, chi-square results suggest that patients were more likely than caregivers to receive care interaction, χ2(1, N = 5794) = 92.03, P < .001, rapport building (χ2 = 15.12, P < .001), tech fun (χ2 = 120.74, P < .001), and encouragement/support (χ2 = 6.23, P < .05) texts, whereas caregivers were more likely than patients to receive positive interaction (χ2 = 12.73, P < .001), coaching (χ2 = 25.85, P < .001), informative (χ2 = 126.52, P < .001), strategic questioning (χ2 = 11.65, P < .001), and empathizing/normalizing (χ2 = 81.48, P < .001) texts.
Text Content Categories by Text Recipient (Patient vs Caregiver) and Day/Time of Text (During vs Outside of Business Hours).
Each text has only 1 care code, but may have 1 or multiple intervention codes. an (%) = n of content category texts to patient/caregiver (percentage content category texts to parent/caregiver relative to total texts to patient/caregiver). bn (%) = n of content category texts sent during/outside of business hours (percentage content category texts sent during/outside of business hours relative to total texts sent during/outside of business hours).
P ≤ .05. **P ≤ .01. ***P ≤ .001.
Chi-square tests of independence were performed to examine the relation between text content and day/time of messages (Table 4). The relation between care codes and day/time of text was significant. Interventionists were more likely to send behavioral intervention text messages outside of business hours than during business hours, χ2(1, N = 5808) = 266.91, P < .001, whereas they were more likely to send care coordination (χ2 = 234.61, P < .001) and case management (χ2 = 20.31, P < .001) text messages during business hours than outside of business hours (Figure 2). In addition, chi-square results suggest that interventionists were more likely to send positive interaction, χ2(1, N = 5867) = 69.81, P < .001, care interaction (χ2 = 33.11, P < .001), rapport building (χ2 = 17.22, P < .001), and encouragement/support (χ2 = 100.53, P < .001) texts outside of business hours than during business hours and were more likely to send scheduling text messages (χ2 = 204.92, P < .001) and text messages providing information (χ2 = 6.36, P < .05) during business hours than outside of business hours.

Care codes of outgoing texts by day/time of text. ***P < .001.
The relation between text content and sex of text recipient was also examined. Among patients, interventionists were more likely to send positive interaction, χ2(1, N = 2103) = 4.41, P < .05, care interaction (χ2 = 14.36, P < .001), problem solving (χ2 = 5.65, P < .05), rapport building (χ2 = 5.54, P < .05), and tech fun (χ2 = 44.17, P < .001) texts to females than to males and were more likely to provide information through text (χ2 = 4.10, P < .05) to males than females. Among patients, both the relation between care codes and sex, and the relation between sex of text recipient and the use of encouragement/support texts were null. Among caregivers, the relation between care codes and sex was significant, suggesting that interventionists were more likely to send behavioral intervention text messages to female caregivers than male caregivers, χ2(1, N = 2056) = 17.82, P < .001, and were more likely to send care coordination text messages to male caregivers than female caregivers (χ2 = 17.35, P < .001). Interventionists were also more likely to send care interaction (χ2 = 9.73, P < .01), scheduling (χ2 = 7.15, P < .05), and tech fun (χ2 = 10.45, P < .01) text messages to male caregivers than to female caregivers and were more likely to send empathizing/normalizing text messages (χ2 = 2.47, P < .05) to female caregivers than male caregivers. Among caregivers, the relation between sex of text recipient and use of encouragement/support texts was also null.
Discussion
The results of this study are relevant to the growing body of literature describing text interventions for youth with medical complexity. Findings indicate that NICH interventionists frequently text both NICH patients and their primary caregivers, and that text content is consistent with program efforts to use texting to provide more opportunities for immediate positive reinforcement and behavioral intervention.
NICH interventionists frequently provided positive/encouraging texts to patients and primary caregivers. Given the high rate of “diabetes burnout” reported by adolescents and youth adults with diabetes, NICH providers are coached to intervene consistent with the research of Gottman, 41 by providing a 5:1 ratio of positive/encouraging messages compared to diabetes-specific reminders with a potentially negative valence. However, the frequent need for problem-solving, scheduling, and care-related texts may result in a less-than-optimal ratio of encouraging to reminding texts. Fortunately, more than 68% of outgoing messages were coded as containing some form of encouragement and/or support, including use of compliments, empathy, humor, and positive reinforcement of desired behaviors.
In addition, caregivers were more likely than patients to receive behavioral intervention texts. This is not entirely surprising, given that NICH aims to improve caregivers’ abilities to problem-solve and effectively support patient adherence. For example, interventionists are trained to identify signs of “miscarried helping” and to modify caregiver-patient interactions to reduce diabetes-related conflict. Caregivers are also coached, as needed, to successfully address other patient behaviors (eg, illicit drug use, association with delinquent peers, school truancy) directly or indirectly related to diabetes management that often result in increased caregiver-child conflict. The strong correlation between incoming and outgoing texts suggests that interventionists were able to maintain communication with both patients and caregivers. While we cannot be sure whether it is the supportive/encouraging nature of outgoing texts, the high need for and acceptability of in-the-moment parent training, or the personalized nature of this intervention, we hypothesize that these intervention components may be driving patient engagement.
Interestingly, the majority of texts were sent outside of business hours. This finding is consistent with interventionists’ anecdotal reports that much of their communication with families does not occur from 9 to 5, Monday through Friday. Related to this, SMS use outside of business hours was significantly more likely to involve behavioral interventions, suggesting the need for assistance (ie, problem-solving) at times when providers are traditionally unavailable or difficult to access. These results should be considered when creating future text interventions, as even automated/scheduled texting programs may benefit from enhancing care outside of business hours.
Interventionist SMS use varied depending on the sex of the recipient. However, although recipient sex appeared to be related to frequency of specific outgoing content, the frequency of texts that were perceived to be encouraging and/or supportive did not differ based on sex for caregivers or patient. It is unclear whether content differences were driven by interventionist perceptions of content efficacy, interventionist biases when interacting with individuals of different sex, and/or the incoming messages received; however, results reflect the tailored nature of the intervention and interventionists’ efforts to personalize interactions, while maintaining efforts to incorporate encouragement and positive reinforcement.
Regarding limitations, the data presented here are retrospective, program-specific, and may not generalize well to other clinical programs or patient populations. These findings were not compared to treatment outcomes, and the sample size was relatively small. There was also a large range in the number of texts sent. This range is indicative of the flexible nature of NICH to modify forms of communication as needed to best fit patient and family needs (eg, 1 individual received only 6 texts due to their lack of comfort with SMS). Future studies would benefit from utilizing a larger sample size, examining associations between use of text and treatment change, coding characteristics of incoming texts, and including a control group.
Conclusion
To our knowledge, this is the first study to specifically describe the personalized use of text messages with youth repeatedly hospitalized for DKA and their caregivers. Personalized text messages were used, on average, more than once per day with youth and primary caregivers, and often included encouragement outside of typical business hours. A strong correlation was demonstrated between the frequency of incoming and outgoing texts, which, although not definitive, suggests that the communications had value for the patients and caregivers served. Although speculative, findings indicate that frequent use of personalized and positive text messages may be an acceptable supplement to programs designed to engage and treat youth experiencing multiple DKA events. These findings may be particularly relevant to providers caring for similar youth, as well as treatment developers, researchers, and health care systems interested in using mobile technology to augment treatment efficacy.
Footnotes
Acknowledgements
We want to acknowledge the patients and families who have participated in NICH.
Abbreviations
CTC, care type code; DKA, diabetic ketoacidosis; NICH, Novel Interventions in Children’s Healthcare; PCC, primary content code; SCC, secondary content code; SMS, short message service.
Declaration of Conflicting Interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) received no financial support for the research, authorship, and/or publication of this article.
