Abstract
Type 2 diabetes (T2D) is a risk factor for cognitive decline. In neurodegenerative disease research, remote digital cognitive assessments and unobtrusive sensors are gaining traction for their potential to improve early detection and monitoring of cognitive impairment. Given the high prevalence of cognitive impairments in T2D, these digital tools are highly relevant. Further research incorporating remote digital biomarkers of cognition, behavior, and motor functioning may enable comprehensive characterizations of patients with T2D and may ultimately improve clinical care and equitable access to research participation. The aim of this commentary article is to review the feasibility, validity, and limitations of using remote digital cognitive tests and unobtrusive detection methods to identify and monitor cognitive decline in neurodegenerative conditions and apply these insights to patients with T2D.
Keywords
Introduction
One in 10 Americans has diabetes, and approximately 90% to 95% of these cases are type 2 diabetes (T2D).1 -3 T2D is associated with a 1.5- to 2.5-fold increased risk of cognitive decline and dementia.4 -10 T2D and downstream effects of hyperinsulinemia adversely influence cognition, particularly memory, executive functioning, and information processing speed. 11 T2D is associated with lower brain volume and perfusion, greater white matter hyperintensities, and higher prevalence of cerebrovascular disease compared with nondiabetic controls.7,12 -20 Epidemiological studies suggest an increased prevalence of Alzheimer’s disease and related dementias (ADRD) in T2D patients, and murine models suggest a mechanism through which altered insulin pathways promote the development and accumulation of ADRD pathology.21 -24
Early detection of dementia and cognitive decline is an important care management strategy in older adults. Although there are ethical considerations when raising awareness of early cognitive deficits given the paucity of effective treatments to stop cognitive decline, early detection of cognitive deficits can improve patient and family quality of life, reduce caregiver burden, lower care costs, and enable earlier interventions for symptom management and modifying disease progression.25 -29 Moreover, neurodegenerative diseases have long preclinical periods of pathological aggregation prior to clinical symptom onset,30 -32 and clinical trials in several neurological illnesses suggest treatments will be most effective if initiated early in the disease course.33,34 Thus, the preclinical phase of neurodegenerative and cerebrovascular disease presents a time-sensitive opportunity for intervention and enrollment in clinical trials, making early detection of cognitive changes in T2D an urgent unmet need. Digital technologies offer the possibility of self-administered, low-cost, scalable, and efficient methods for detecting and monitoring neurocognitive change in patients with T2D. 35
Rapid technological advances hastened the development of reliable digital tools for remote evaluations of cognition. The growing list of digital assessments can broadly be classified based on whether patients must engage with the digital technology (active), or the technology monitors patients without active engagement (passive). This article discusses recent advances in active and passive approaches to remote monitoring in ADRD that may be relevant for detecting and monitoring cognitive changes in patients with T2D. We examine the scientific evidence supporting the reliability, validity, and feasibility of digital technology measures, in both active and passive forms, and raise practical considerations for implementation.
Active Digital Monitoring Assessment Tools
Active digital assessments can be delivered to T2D patients using different formats (e.g., examiner-administered versus self-administered), settings (e.g., clinic vs home), and devices (e.g., computers, tablets, and smartphones). Computerized active cognitive assessments can reduce time, cost, and staffing needs associated with traditional paper-and-pencil cognitive assessments.36 -38 Clinician time and scoring errors may be reduced through automated scoring and data exporting.35 -37,39 Online assessments are scalable and facilitate frequent repeated assessments, which can improve assessment reliability and sensitivity.36,40 -42 Testing within a patient’s own environment improves ecological validity43,44 and correlates highly with in-person testing.45 -52 We discuss promising active digital assessment tools which can be implemented for cognitive health monitoring in T2D patients, focusing on unsupervised assessments and smartphone-based tools.
Computer-, Tablet-, and Browser-Based Assessments
Supervised examiner administration
Most active digital cognitive measures have been developed for the computer, tablet, or browser. Of these, most studies rely on study teams to administer participant tests in highly controlled research settings. Supervised digital cognitive assessment batteries are highly reliable,43,53 sensitive to preclinical neurodegenerative disease,46,53 and useful for tracking changes longitudinally. 53 See Staffaroni et al 36 for a review of batteries with the greatest empirical evidence.
Unsupervised administration
Although in-person, examiner-administered assessments are the gold-standard for reducing confounds through standardized testing protocols, the time and cost benefits associated with unsupervised administration protocols offer a scalable alternative.40,54,55 Two recent large-scale efforts provide initial support for unsupervised browser-based cognitive assessment validity in ADRD research. The UCSF Brain Health Registry, an online registry of over 75 000 participants, administered unsupervised browser-based Cogstate cognitive tests and found excellent criterion-related validity, including improved diagnostic classification of mild cognitive impairment (MCI) and AD compared with demographics alone. 38 Another study using unsupervised browser-based assessments from the Platform for Research Online to investigate Genetics and Cognition in Ageing (PROTECT) developed a composite score that successfully distinguished between normal cognition and early AD at baseline, and was sensitive to cognitive and functional decline over 2 years. 56 Other unsupervised or self-administered computer or tablet batteries include the Cogstate C3, forthcoming self-administered UCSF TabCAT Brain Health Assessment (personal communication, Kate Possin), among several others.57 -60 Unsupervised assessments are a promising novel paradigm for delivering assessments in a scalable fashion that might be relevant for studies of T2D.
Smartphone-Based Assessments
Smartphone-based assessments of cognition, motor functioning, speech, and language are under evaluation for ADRD. Smartphones are attractive for conducting widely accessible remote cognitive evaluations given their high prevalence globally. 53 Assessments deployed through smartphones have been found to be reliable40,41,53 and valid, as supported by evidence of strong correspondence between smartphone cognitive tests and gold-standard cognitive tests,40,61 -65 everyday functioning,62,66 -68 brain imaging, and fluid biomarkers of AD pathology.40,69 -72
Motor deficits are a common manifestation of a range of neurodegenerative, neurological, and other medical conditions including T2D.73 -77 Applications have been developed to utilize the smartphone’s touch screen, accelerometer, magnetometer, and gyroscope to quantify gait, balance, dexterity, and coordination. Smartphone-based assessments of finger tapping, gait, and balance can detect treatment response, predict disease severity, and are correlated with standard clinical motor assessments.78,79
Language impairment is a central feature of many neurodegenerative disorders, and subtle speech changes may occur early in the disease process either due to changes in speech/language networks or secondary to other cognitive deficits. Several applications leverage smartphones’ audio recording capabilities to capture speech during conversation and completion of various tasks.36,80 Automated processing pipelines extract linguistic (e.g., syntactic complexity, semantic content, and lexical diversity) and acoustic (e.g., pause length, pitch) features from audio recordings.80 -85 Digital speech analyses are sensitive tools to detect early signs of cognitive impairment and predict transition from normal cognition to MCI.80,81,86 -88 One study comparing healthy older adults with and without T2D suggested temporal speech parameters (e.g., utterance length and total pause duration), but not standard neuropsychological measures, were sensitive to early cognitive changes in those with T2D. 89 Replication and extension are needed to understand the utility of speech recordings for early detection of cognitive decline in T2D.
A few platforms collect several data streams including self-administered cognitive tests, motor, and speech collection using a single smartphone app such as the NIH-funded ALLFTD Mobile App, built on the Linkt app in partnership with Datacubed Health.36,90
To overcome the noise inherent to testing people in an unsupervised environment, innovative testing paradigms with repeated measurements are employed in smartphone testing studies. Some studies utilize randomized independent parallel test versions for each memory task to reduce confounding practice effects,41,53 whereas others administer the same test multiple times and capitalize on diminished practice effects as an early indicator of pathological brain changes. 53 The “burst” approach is a paradigm for deploying repeated assessments delivered at varying times per day using a pseudorandomized ecological momentary assessment method and is promising for extracting highly reliable data from unsupervised evaluation.43,70,71,91 -93
Limitations of Active Tools
Despite many benefits, active remote monitoring is not without limitations and unique considerations. A common criticism of unsupervised self-administration is the difficulty discerning a participant’s level of effort and engagement, the presence of distractions, and whether assistance completing measures was received. 45 Distractions are reported to occur in a small (~7.4%) yet nonnegligible proportion of participants completing unsupervised remote cognitive testing. 49 For patients with cognitive impairments or low digital familiarity, it may be difficult or impossible to engage them in testing without a proctor. Additional ethical concerns must be considered if attempting to integrate caregivers as proctors for participants with more substantial cognitive deficits—current recommendations are to only engage caregivers in setting up digital assessments but not proctoring any tasks. 94
The lack of widespread access to technology and internet connectivity is a significant barrier, particularly in older adults, low-income households, and ethnic diverse ethnic groups. However, studies show a steadily increasing rise in technology adoption, smartphone ownership, and accessibility among these populations, especially in recent years.95 -103 Investigators and clinicians must also decide whether to use a “managed” or “bring-your-own” device (BYOD). A managed device (i.e., a dedicated device for the cognitive assessment rather than the examinee’s own device) may reduce variance associated with hardware and software, but requires additional resources for device purchase and maintenance. 36 Differing levels of familiarity with the chosen managed device may also affect performance. 36 Alternatively, BYOD may reach a wider and more diverse audience at a lower cost, although concerns regarding the effects of hardware and software differences remain. 104 Finally, privacy concerns must be considered while using digital data capture as cybersecurity is paramount.35,105,106 Despite its limitations, active testing paradigms are reliable and valid methods for conducting ADRD research and are relevant for observational and interventional diabetes studies.
Passive Monitoring Assessment Tools
Digital health technologies are not only used to deliver active testing protocols but also for unobtrusive monitoring of real-world cognitive and physical functioning. Passive remote monitoring approaches typically place sensors throughout a participant’s environment and software on electronic devices to monitor activity patterns. We discuss some of the most promising sensors, wearables, and platforms for sensor integration to consider for implementation in diabetes research.
In-Home Sensor Monitoring
A common approach to passive data collection involves using sensors to monitor movement inside and outside of the home. In-home passive infrared (PIR) motion sensors record indoor mobility frequency and variability (room-to-room transitions/day) and walking speed.107 -116 Fewer outings and decreased indoor movement were found in people with incident cognitive impairment. 117 Graded reduction in gait velocity, collected unobtrusively from in-home PIR sensors, is both associated with and predictive of cognitive and physical decline.107,110,118 -122 PIR sensors can also detect the nonamnestic subtype of MCI in older adults with high precision. 123
Other in-home technologies include bioelectrical impedance analysis of a digital scale to track weight fluctuations, a sleep mat placed under a patient’s mattress to measure heart and respiratory rate variability, sleep duration and sleep stage measurements, and a 7-day electronic pillbox recording medication adherence.115,116 A study comparing healthy older adults with slight differences on cognitive testing, observed large differences in medication adherence—thereby suggesting real-world monitoring may be more sensitive than traditional gold-standard paper-and-pencil tasks.116,124,125 Audio recordings can also be collected passively (e.g., during phone calls or interviews, in-home microphone use).126 -128 We anticipate the array of behaviors captured by in-home sensors will continue to expand as sensor technology develops.
Monitoring Driving and GPS
Driving is a complex functional activity requiring the integration of multiple cognitive domains. Impaired driving possesses high-stake safety implications, making it a clinically relevant target for passive monitoring. GPS data can be combined with software to monitor driving behaviors (i.e., rapid acceleration and braking). Everyday driving behavior, such as driving shorter distances and fewer visits to unique destinations, is associated with and predictive of preclinical AD.129,130 Even in nondriving patients, GPS may be a method to study changes in travel, social activities, and other aspects of movement that might reflect underlying health issues.
Wearable Devices
Wearable devices (e.g., wristbands and smartwatches) enable continuous monitoring of physical activity, movement via GPS, and a vast range of physiological functions including sleep, gait, heart rate, electrocardiogram, blood oxygen, and continuous glucose monitoring (CGM). Combinations of mobility metrics (e.g., steps, turning, and transition from sit-to-stand) obtained from wearable devices are related to specific health outcomes such as MCI, Parkinson’s disease, and AD-dementia.131,132 Heart rate variability is related to mental stress and cardiac functioning over time,133 -135 which may be a feasible tool to assess and monitor cognitive and brain health-related physiological changes.136,137 A study found adherence to wearing a Fitbit device (89% of study days) was a predictor of memory functioning among older adults, 138 while wearable-quantified physical activity was more predictive of brain health and cardiometabolic indices than self-report. 139 High adherence in daily wear, incremental validity over self-report measures, and relatively low costs make wearable devices a viable tool for both research and clinical monitoring of T2D patients.
Computer Usage Monitoring
Interacting with personal electronic devices requires a complex orchestration of cognitive skills. Software installed to monitor computer and smartphone usage generates densely sampled data to identify metrics sensitive to early cognitive changes. For example, participants with MCI demonstrate lower overall computer usage and greater day-to-day usage time variability relative to cognitively normal controls. 140 Compared with cognitively intact older adults, older adults with MCI generate fewer, more variable, and less efficient mouse movements, which are significantly associated with gold-standard cognitive test scores. 141 In another study, participants with MCI spent less time on the computer and on various computer programs (e.g., email, word processing applications, search functions) compared with healthy controls. 142 In Huntington’s disease, mutation carriers are more inconsistent than controls in keyboard strokes and typing cadence—both of which are correlated with disease severity. 143
Smartphone Usage Monitoring
Given that over 83% of the world owns smartphones globally, 144 and these devices are often carried throughout the day, smartphones offer a unique inroad to daily activity and functioning. Integrated sensors and usage meta-data (e.g., steps, user commute routine) are collected automatically in smartphones and are often accessible for research purposes.145,146 Examples of extractable data types include typing patterns, call frequency, social media app interactions, and environmental decibel levels. Open-source software packages and digital phenotyping platforms (e.g., Beiwe app) 147 are available for investigators to extract data from participants’ interaction with their smartphones (e.g., finger tapping, keystroke metadata).148 -150 The Linkt/ALLFTD App also captures several aspects of passive data including step count, screen time, social media app usage, GPS, and battery life.36,151 -153 Extracting smartphone metadata is a promising and scalable passive monitoring approach, although more research is required to understand how best to utilize this rich data source and identify best metrics for reliable early detection and monitoring of cognitive and functional changes.
Passive Data Input Integration
Rather than relying on a single sensor type or software package for passive data collection, time-stamped integration across multiple passive data streams may enable the most comprehensive and sensitive view of daily functioning and cognitive status. 154 The Collaborative Aging Research using Technology (CART) Initiative 124 platform integrates data captured from various sensors and software discussed above and weekly questionnaires completed by participants to contextualize data (e.g., presence of visitors, medication changes). Integrative platforms easily incorporate with CGMs and smart insulin pen smartphone app data to better understand cognitive fluctuations in relation to blood glucose level fluctuations as a mechanism to determine predictors of cognitive decline.
Limitations of Passive Tools
Despite its benefits, passive remote monitoring methods have several limitations. For example, wearables may be linked to perceived social stigma associated with diabetes as visible devices could reveal health status to others155 -157; new data, however, suggests increasing willingness to wear devices and positive experiences with wearable use among adults and older adults.136,158 -161 Digital sensors can also be expensive and in-home installation must be consistently executed to obtain accurate naturalistic data. Like active technologies, cybersecurity and ethical implications of private home monitoring must be considered. The black box nature of commercial software and firmware algorithms can change, sometimes unbeknownst to the user, during a study. As new versions of devices are released, consistency with prior versions cannot be assumed and time-consuming harmonization studies are often required. Finally, challenges may arise when contextualizing collected data as sensors and digital devices must accurately discern sensors activated by the patient and not by other people, animals, or external forces.
Conclusions
Innovative technological solutions for active and passive monitoring allow clinicians to extend evaluations of patients with T2D beyond the clinic into patients’ daily lives to monitor and assess cognitive and functional status. Quantifying complex daily behaviors may enhance sensitivity to early cognitive and functional decline while offering opportunity for continuous longitudinal monitoring. 162 Given the increased risk of dementia and cognitive decline among individuals with T2D, it is imperative to identify indicators of cognitive impairment during the preclinical period.4,5 It will be important for T2D digital monitoring studies to account for acute cognitive changes secondary to hypoglycemia to avoid false conclusions of a concomitant cognitive disorder due to, for example, a neurodegenerative or cerebrovascular etiology. At this time, unsupervised remote digital assessments should not be used for clinical decision making, but rather could prompt in-person assessments with trained clinicians. Diabetes medicine was an early adopter of health technology and is well-positioned for incorporating digital biomarkers to enable comprehensive characterizations of patients with T2D, thereby improving clinical care.
Footnotes
Acknowledgements
The authors express their gratitude to Dr David C. Klonoff for his valuable feedback and support throughout the process of writing this commentary.
Abbreviations
ADRD, Alzheimer’s disease and related dementias; BYOD, bring-your-own device; CART, the Collaborative Aging Research using Technology; CGM, continuous glucose monitoring; MCI, mild cognitive impairment; ORCATECH, Oregon Center for Aging and Technology; PIR, passive infrared; PROTECT, platform for research online to investigate genetics and cognition in aging; T2D, type 2 diabetes.
Declaration of Conflicting Interests
The author(s) declared the following potential conflicts of interest with respect to the research, authorship, and/or publication of this article: Dr AMS is an inventor of a subset of ALLFTD Mobile App cognitive tasks and receives licensing fees. AYD conducts human research at Google, Alphabet Inc., outside the scope of this work. The authors report no other conflicts of interest.
Funding
The authors disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: Dr. Staffaroni is supported by the NIH/NIA (K23AG061253). The authors otherwise received no financial support for the research, authorship, and/or publication of this article.
