Abstract
Objectives:
This study examined whether community-dwelling older adults can independently capture wearable sensor data that can be used to classify frailty status.
Methods:
Fifty-one older adults (age 77.5 ± 8.4 years, height 163.6 77.5 ± 8.4, weight 72.0 ± 13.5 kg, female 76%) took part in this investigation. Participants independently captured physical activity and physical function data at home using a smartwatch and a research-grade inertial sensor system for 48-hours. Machine learning classifiers were used to determine whether the data obtained can discriminate between frailty levels.
Results:
Models incorporating variables from both the smartwatch and inertial sensor system were successful in the prediction of frailty status.
Discussion:
This study has demonstrated the ability of older adults to collect data which can be used to indicate their frailty risk. This may enable earlier intervention and lessen the impact of frailty on the individual and society as a whole.
Introduction
The world’s population is ageing at an unprecedented rate. According to estimates from the World Health Organization, the proportion of the world’s population over 60 will almost double from 12% to 22% by the year 2050. 1 Frailty is one of the greatest challenges facing an ageing population. Despite a significant number of studies in this area, there is no universally accepted definition of frailty. There is a consensus that frailty is a medical syndrome with multiple causes and contributors, characterized by reduced gait speed, weakness, low levels of activity, and exhaustion. 2 Probably the most frequently used definition of frailty is the physical frailty phenotype proposed by Fried and colleagues, 3 who characterized frailty in relation to 5 components; unintentional weight loss, low grip strength, self-reported exhaustion, slow walking speed and low physical activity. The presence of 3 to 5 of these characteristics identifies someone as frail.
The consequence of frailty is an increased risk of falls, delirium, disability, and death.3 -6 Frailty is also a significant predictor of hospitalization and nursing home placement among community-dwelling older adults.7,8 While frailty can have devastating consequences, it is however dynamic, and can be reversible, with transitions occurring in either direction between non-frail, pre-frail and frail.
Frailty can be measured using a combination of physical, cognitive, psychological, social, and nutritional assessments. Fried’s Frailty Phenotype is a physical performance-based model that uses a combination of self-report and objective measurement and is validated for clinic and population screening with the ability to predict adverse outcomes. 9 The Deficit Accumulation Index (DAI), 5 or Frailty Index as it is commonly referred to, is based on the concept that frailty arises from the accumulation of health deficits. It incorporates a broad range of factors, across various domains such as physical function, cognition, self-rated health and biomarkers. 10 Other frailty screening tools include the Edmonton Frail Scale 11 which is a short and easy-to-administer tool assessing nine domains, including cognition, functional independence and polypharmacy.
Impaired physical function reflects reduced strength, mobility and balance which are core characteristics of frailty. 3 Measures of functional performance such as the Berg Balance Scale, 12 the Elderly Mobility Scale 13 and the Timed Up and Go test 14 are often used alongside other domains to gain a comprehensive understanding of an individual’s frailty status. However, the opportunities to undertake these assessments are limited to clinical visits, and there is the risk that the onset of frailty might go undetected or be identified too late. This delayed identification can result in missed opportunities for early intervention, thereby compromising the chances of maintaining functional independence.
Declining physical activity is also widely recognized as a key indicator of frailty, reflecting a gradual reduction in functional capacity and resilience in older adults. 15 As people age, the loss of muscle strength and endurance – often referred to as sarcopenia – leads to diminished mobility and a reduced ability to perform daily tasks, which are hallmark signs of frailty. 3 Studies show that decreased physical activity is associated with increased vulnerability to adverse health outcomes, including falls, hospitalization, and loss of independence. 16 In fact, lower levels of physical activity not only predict the onset of frailty but also accelerate its progression. 9 This reduction in movement often leads to a cycle of worsening physical and cognitive health, reinforcing the importance of early detection and intervention to preserve mobility and quality of life. Identifying and addressing this decline early can play a crucial role in preventing the more severe consequences of frailty and improving long-term health outcomes for older adults. 17
Wearable sensors have become a pervasive means of measuring physical function and physical activity. A recent systematic review has shown that wearable sensors can be used to collect objective, quantifiable parameters of physical activity and physical function that can be used to distinguish between levels of frailty. 18 This review found that parameters of physical activity and physical function obtained from a wearable sensor such as; time spent in non-sedentary activity, gait speed and balance correlate well with the identification of frailty. Most of the studies included in this review were conducted in laboratory or in experimental settings. However, considering that the signs and symptoms of frailty can be more subtle, regular or continuous evaluations in a person’s naturalistic, home environment may be more useful in identifying frailty. Giving older adults the tools they need to independently monitor for frailty may enable earlier intervention and therefore lower the likelihood of developing frailty. Early detection enables timely interventions, such as tailored exercise programmes, nutritional support, or medical treatment, which can slow down or reverse the progression of frailty. 16 In addition, facilitating older adults to undertake these assessments independently in their own homes may also reduce the burden of testing, offering greater convenience for patients and minimizing the impact of health care on the daily routines. Furthermore, promoting self-monitoring fosters greater awareness and engagement in one’s own health, encouraging proactive management of age-related changes. Using wearable sensors to undertake these assessments may provide richer datasets, than the snapshot assessment obtained during visits to a health care facility. Such tools can bridge the gap between clinical visits, making frailty monitoring more continuous and accessible, especially for those with limited access to regular healthcare.
A major development is the use of machine learning algorithms to analyse data from wearables, enabling automated frailty detection. These models can process sensor data to identify physical activity and function indicators that distinguish frail or prefrail from robust with sufficient sensitivity and specificity. 19 Despite these advances, challenges remain, particularly concerning data accuracy and questions remain as to whether consumer-grade wearables are precise enough to capture subtle declines in physical activity and physical function. Additionally, there is a need to explore whether assessments of physical activity and physical function can be performed in a home setting, providing a more realistic insight into how an older adult moves and whether they can use these devices in their daily lives.
We have previously reported on the ability of older adults to independently perform a TUG test in their own home, and capture objective test data using a research grade wearable sensor system. 20 This study showed that the majority of individuals could successfully complete the TUG assessments unsupervised and obtain a frailty risk score using the wearable sensor system. This current study examined whether the sensor data captured independently by older adults can discriminate between frailty levels. Research-grade devices can provide granular data of physical activity and physical function. In this study we analysed data captured from both a researcher-grade wearable sensor system and a commercially available smartwatch to investigate if a consumer-grade device could provide data with sufficient detail to discriminate between stages of frailty.
Methodology
A cross-sectional feasibility study was conducted with community-dwelling older adults which required participants to independently capture quantitative wearable sensor data during a physical function test and during free-living activities.
Ethical considerations
The study protocol received ethical approval from the School of Health and Science Ethics Committee in Dundalk Insititute of Technology. Before beginning, each participant signed a written informed consent form.
Participants
Participants for this study were recruited through advertisements in local golf, bridge and church community groups. Eligibility was assessed by a member of the research team over the telephone using the following criteria; 65 years of age and over, independently mobile, able to perform a series of mobility tests, had no cognitive or neurological deficits and no history in the past 6 months of lower limb orthopaedic trauma or surgery that would interfere with the ability to exercise. A sample of 52 was calculated based on power 0.8, effect size 0.8, and a P-value .05. 6 The literature supports this with earlier research including comparable sample sizes. 19
Data collection
Participants were visited in their own home and a frailty assessment was conducted based on Fried’s Frailty Phenotype (FFP). 3 The FFP classified participants as frail, pre-frail or non-frail. Participants then performed a Timed Up and Go (TUG) test 14 under the supervision of the researcher. The TUG test evaluates the amount of time it takes a person to stand up from a typical chair, walk 3 m, turn 180°, walk back to the chair and sit down in seconds(s). It is a valid and reliable test of function and mobility. 14
The Kinesis QTUG (Kinesis Health Technologies, Dublin Ireland) was used to provide objective test data during the TUG test. The QTUG provides an objective estimate of frailty in the form of a frailty risk score, which can be understood and used by the user without further analysis or interpretation required. The QTUG system relies on small, lightweight wearable sensors placed on the legs, which makes it unobtrusive and easy to wear, and does not require any complex setup or specialized knowledge, making it user-friendly even for older adults with limited technical skills.
Participants were instrumented with the QTUG sensors (Shimmer 9DoF Inertial Measurement Units, Shimmer Research, Dublin, Ireland) prior to performing the TUG test. The inertial sensors were secured around each shin, above the ankle joint using elastic tubular bandage and tape. Each sensor contains a tri-axial accelerometer, tri-axial gyroscope and a magnetometer. Data from each sensor were synchronized and processed using the Kinesis QTUG software application running on an Android tablet. Participants were requested to repeat the TUG test independently on the subsequent 2 days and obtain the objective frailty risk score using the QTUG system. Participants were instructed to follow the same 3 months course for the TUG test and to use the same chair as in the supervised test. Participants received training and were provided with a reference manual on how to undertake the TUG test independently and how to operate and use the QTUG system.
In addition to performing the TUG test unsupervised, participants were requested to wear the Withings ScanWatch (Withings, Issy-les-Moulineaux, France) for the subsequent 2 days to capture data during free-living activities. The Withings ScanWatch contains a tri-axial accelerometer for monitoring activity, as well as an embedded photoplethysmogram sensor for measuring heart rate and oxygen saturation, and electrodes for electrogram recording. In this study, only the accelerometer data were extracted from the ScanWatch for analysis. Participants were instructed to wear the ScanWatch around their non-dominant wrist, which was the hand less preferred for writing. Wearing a physical activity monitor on the non-dominant wrist is generally preferred because the dominant hand typically has more movement from tasks like writing, eating, or gesturing. This additional movement could lead to overestimation of physical activity. 21 The ScanWatch was paired with a smartphone, however, this was not provided to participants during the 48-hour period.
Data processing
Following the 48-hour period, the researcher collected all equipment from participants. The ScanWatch was synchronized with the Withings HealthMate app and data were downloaded for analysis. Twelve-hours wear time, during waking hours is considered sufficient to capture all relevant periods of activity, particularly in older adults. 22 Therefore, to standardize the ScanWatch data, only data collected between the hours of 8am and 8pm were used and the following data on physical activity were extracted for analysis; total step count, maximum number of bouts and maximum sedentary time. The total step-count is the total number of steps detected during the selected timeframe. Step counts were selected as an intuitive metric of physical activity. Tudor-Locke and Bassett proposed a classification scheme for categorizing adult activity levels based on daily steps, describing individuals with less than 5000 steps per day as sedentary; 5000 to 7499 as low active; 7500 to 9999 as somewhat active; 10 000 to 12 499 as active; and >12 500 as highly active. 23 Walking fewer than 3000 steps per day is associated with functional decline and frailty in community-dwelling older adults.24,25 A bout of activity is each unit of activity in 60-second epochs as identified by the watch when steps are detected. Maximum number of bouts refers to the number of consecutive activity detections in 60-second epochs and reflects continuous activity during a break in sedentary time. Sedentary time is defined as the duration between each bout of activity and is recorded in hours, minutes, and seconds. The maximum sedentary time is calculated for each participant and is the longest uninterrupted sedentary time that is, time between activity bouts when no steps are detected. Sedentary behaviour is associated with frailty and adverse health outcomes in older adults. 26 Prolonged periods of inactivity, such as sitting or lying down while awake, with minimal energy expenditure can accelerate muscle weakness, joint stiffness, and poor mobility, which are central to frailty development.27,28
The Kinesis QTUG system collects raw data from the 2 wearable sensors during the TUG test. This raw data then undergoes multiple preprocessing steps to clean the signals and extract meaningful mobility metrics such as gait speed, stride length, postural sway, and phase durations. These metrics, along with the test subject’s demographic data, are then used by the QTUG software to produce a frailty risk score. Frailty risk scores produced by the QTUG below 50% are considered non-frail, values between 50 and 70% are considered transitionary, values above 70% are frail, while values above 90% are considered very frail. Validity of the underlying algorithms of the QTUG has been widely established.29,30 The frailty risk score obtained from the QTUG from the 2 unsupervised TUG tests were used in the analysis here.
Data Analysis
Data analysis was performed using WEKA V3.8.6 (University of Waikoto, New Zealand). Machine learning classifiers were used to determine the influence of each variable in predicting frailty, focussing on establishing optimal thresholds for the QTUG frailty risk estimate and the 3 parameters extracted from the ScanWatch data (ie, total step count, maximum number of bouts and maximum sedentary time). The process began by using the mean of each variable as an initial reference for threshold selection, with the goal of identifying levels below which frailty risk, classified by the FFP, is predicted. The optimum threshold for each variable was defined as the point where the highest accuracy was achieved.
Following threshold selection, random forest models were applied to all variables. To evaluate the importance of each feature, an information gain attribute evaluation ranker was used. Three random forest models, representing different configurations with varying data subsets and parameters were implemented. The models’ robustness were tested using 10-fold cross-validation, which splits the data into 10 subsets. The models were trained on 9 subsets and tested on the remaining 1, repeating this process 10 times to ensure the models’ accuracy and reliability. This approach allowed for a thorough investigation of the predictive value of each variable for frailty. 31
Results
Fifty-one participants were enrolled in this study and the demographic characteristics of this cohort are presented in Table 1. Fifteen participants were unsuccessful in operating the QTUG system independently. Additionally, 4 participants declined to undertake the unsupervised component of testing. Therefore unsupervised frailty risk scores from the QTUG system were only available for n = 32 participants. ScanWatch data are presented for 45 participants. Data were missing for n = 6 participants due to: lost data by researcher error (n = 2), incomplete data obtained from the manufacturer’s web application (n = 2), and ScanWatch not provided to participants (n = 2) due to the presence of a permanent pacemaker, a contraindication for the smartwatch selected. All remaining participants had 12 hours wear time between the hours of 8am and 8pm for each day and were thus included in the analysis.
Demographic characteristics of participants (n = 51).
Predictive accuracy, the number of correctly classified instances (CCI), sensitivity and specificity for each optimal threshold for each variable are presented in Table 2. Sensitivity is the ability of a test to correctly classify the presence of an outcome while specificity is the ability of a test to correctly classify the absence of an outcome. 32 When examined individually, the unsupervised QTUG performed well in the prediction of frailty, with a threshold frailty estimate of between 35 and 40% providing a predictive accuracy of 75.8%, (CCI 22/29) (sensitivity 54.5%; specificity 72.2%).
Predictive accuracy percentage and the number of correctly classified instances for each optimum threshold.
Abbreviations: CCI n /29, correctly classified instances per total sample; n_Bouts, number of bouts of activity; MAX_ST, maximum sedentary time in minutes.
Confusion matrices and detailed accuracy for models incorporating data obtained from the unsupervised QTUG tests and the ScanWatch are presented in Table 3, while Confusion matrices and detailed accuracy for models incorporating physical activity data obtained from the ScanWatch only are presented in Table 4. The y-axis of the confusion matrix shows the actual classification of non-frail, pre-frail and frail. The x-axis indicates how participants were classified by the model. The detailed accuracy report gives an indication of the performance of the model or classifier. Precision, recall, F-Measure and ROC Area (receiver operating characteristic) are considered the most appropriate measures to include. Precision indicates the true positives that is, of all the data classified into each frailty cohort, what percentage of data actually belong there. Recall indicates the percentage of positives that were captured in each cohort. The F-Measure provides a weighted average of precision and recall while the ROC Area indicates the percentage of time the model would correctly classify a variable/participant. A measure of 0.8 is considered a strong result. 33
Prediction models and confusion matrices and detailed accuracy using ScanWatch and QTUG data.
Prediction models and confusion matrices and detailed accuracy using ScanWatch data only.
Because of the small sample size (n = 29) in the model incorporating the combined data, when classified into non-frail, pre-frail and frail there was only 1 participant in the frail group. For this reason, in the analysis of data from the QTUG and the ScanWatch combined, frailty status was distributed into a binary classification of non-frail and frail, with the frail group consisting of participants classified as pre-frail and frail. Prior to applying the machine learning analysis in the prediction of frailty, the information gains attribute evaluator ranked variables as follows; age, total step-count, number of bouts of activity (n-Bouts), maximum sedentary time (MAX_ST), mean sedentary time (Mean_ST) and unsupervised QTUG frailty estimate percentage. This ranking was used in the development of the prediction models presented.
Discussion
This study examined quantitative physical function and physical activity data captured by older adults independently using wearable sensors and examined whether this data can be used to determine their frailty status. Physical activity data (total step count, maximum number of bouts and maximum sedentary time) were captured continuously for 48-hours during free-living activity using a commercially available smartwatch, the Withings ScanWatch, while physical function data were captured during a series of TUG tests using the Kinesis QTUG.
A machine learning classifier using 10-fold cross-validation was used to evaluate the performance of models derived from the parameters of physical activity obtained from the ScanWatch and from the Kinesis QTUG system and ScanWatch combined. All models incorporating the variables obtained from the unsupervised QTUG and the ScanWatch combined, performed better in the prediction of frail/pre-frail than non-frail as demonstrated in the confusion matrices, each with sensitivity and specificity ⩾ 0.70. This is an important finding as it has been shown that identifying people at the pre-frail stage as opposed to the frail stage increases the likelihood of a favourable transition between phases of frailty,34,35 therefore presenting an opportunity for appropriate distribution of limited resources for timely intervention. The QTUG data also performed well when analysed separately with the threshold of a frailty risk score between 35% and 40% providing a prediction accuracy of 75.8%. This is in keeping with the literature on the Kinesis QTUG system that supports its use in the classification of frailty. 36 It is interesting to note however that despite the QTUG performing well in the prediction of frailty, when ranked using information gains evaluation for the development of prediction models, the QTUG variable was ranked last and the prediction model performed better when the QTUG data was omitted, with 79.3% accuracy, compared to 72.4%. One explanation for this may be the fact that the QTUG, while performed by the participants unsupervised in their own home, was performed in what could be perceived as test-like conditions and may have inadvertently resulted in response bias. The ScanWatch physical activity data was obtained in a continuous manner, without direct engagement required, which may have minimized any bias. As not all participants’ data were included in the analysis of the ScanWatch data and not all participants were able to successfully obtain a frailty score using the QTUG by themselves, the sample size (n = 29) used in the predictive models incorporating data from both the QTUG and the ScanWatch is reduced.
Models incorporating parameters of physical activity obtained from the ScanWatch performed best in the prediction of pre-frail with CCI n23/28 that is, accuracy of 82% in each model. This is consistent with the favourable prediction accuracy for pre-frail in the models incorporating the QTUG data. Thresholds derived from simple machine learning methods on each variable from the ScanWatch demonstrate predictive accuracy for frailty ranging between almost 52% for number of bouts of activity, 58% for total step-count and almost 70% for maximum sedentary time. A predictive accuracy percentage of 52% when analysed alone is of little value as chance is expected to achieve 50%.
The prevalence and technological advancement of wearables and smartphones have resulted in a notable surge in the accessibility of mobile applications and body-worn devices for health monitoring and evaluation in recent times. These technologies can be used to objectively and accurately assess the quantity and quality of movements in everyday and clinical settings, giving clinicians data that can be used to tailor, customize, and improve therapy. A more recent trend in the literature has been the increase in individuals self-monitoring information pertaining to their health and/or physical activity using wearables and illustrates the interest people have in monitoring and analysing their own data, referred to as quantified self-assessment.37,38 A self-directed, remote assessment of frailty status would enable prompt intervention and lower the likelihood of frailty, which would lessen the impact on both the individual and society as a whole. With its promise of genuine scalability, this technique has enormous potential to form part of community risk screening programmes that could use regular measurements taken by individuals in their homes.
This study has a number of limitations which should be considered. A sample recruited from community-based hospital clinics and social groups was expected to represent the target population of community-dwelling older adults. However few frail participants were recruited. This study took place during the COVID-19 pandemic which may have limited the recruitment of more frail older adults. Nonetheless, the sample’s combined 73% prevalence of frailty and pre-frailty is consistent with findings from other studies of a similar nature39 -41 and reflects the population prevalence. 42 The small sample (n = 51) included in this study is another limitation, and is unlikely to be powered sufficiently for machine learning analysis. Previous studies using machine learning have included sample sizes ranging from 240 to 5000, 43 however other research conducted to examine the use of wearable technology to monitor gait and physical activity in frail older adults in the home environment have included similar numbers. 44 While the results here should be regarded cautiously, this study does provide evidence to support the feasibility of deploying wearable sensors to older adults to capture physical function and physical activity data independently.
While wrist-worn devices offer a convenient and non-invasive way to monitor physical activity and movement, there are limitations to their use. Everyday hand movements, such as gesturing, typing, or eating, can be misclassified as physical activity, leading to overestimation of activity levels. 45 To minimize this, participants were instructed to wear the ScanWatch device on their non-dominant wrist. While the QTUG system provides more detailed, quantitative data on mobility, the software interface is designed for clinician/researcher use, and is not intended to be administered by older adults. Many participants who attempted to use the QTUG system independently were unsuccessful for reasons including system or battery failure, poor eyesight and self-reported lack of confidence to attempt the test without support. The latter two reasons are related to biophysical restrictions and reduced confidence, both associated with ageing, and confirm the literature which identifies these as limiting factors to the use of technology among older adults. 46 These challenges likely introduced bias by excluding or limiting the participation of individuals with more severe biophysical limitations or lower confidence levels. As a result, the findings may not fully represent the feasibility of the technology across the entire spectrum of older adults, particularly those living with frailty. Future studies should consider incorporating alternative assessment tools that are more user-friendly and specifically tailored to the needs of older adults to address these limitations.
Nonetheless, these findings are encouraging. They will guide future work to highlight to community-dwelling older adults the importance of early frailty recognition, emphasize the relevance of its identification to their independence and quality of life, and guide the development of a tool for older adults to use for remote continuous monitoring of their frailty risk.
Footnotes
Acknowledgements
The authors thank Daniel Kelly for advice on data analysis and all those who participated in this research and gave so freely of their time.
Declaration Of Conflicting Interests:
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
This publication is based on research co-funded by the Higher Education Authority Landscape Funding and Dundalk Institute of Technology, with additional financial support from Taighde Éireann – Research Ireland under Grant Number 22/PATH-S/10766.
Data Availability Statement
The data that support the findings of this study are available from the corresponding author upon reasonable request.
Ethical Approval and Informed Consent Statements
The study protocol received ethical approval from the School of Health and Science Ethics Committee, in Dundalk Institute of Technology. All participants were informed about the purpose, methods, risks, and benefits of the study. Written informed consent was obtained before participation.
