Abstract
Keywords
INTRODUCTION
For the definition of dementia, impairment in activities of daily living (ADL) is one of the key clinical criteria [1]. The assessment of ADL functioning is also important for patients suffering from mild cognitive impairment (MCI), as MCI patients with deficits in complex ADL functioning have a higher risk of conversion to dementia than MCI patients without ADL deficits [2, 3]. In MCI, basic ADL functioning like eating or walking is preserved, but instrumental ADL (IADL) are often impaired. IADL requiring higher neuropsychological processes, like financial capacities, telephone use, and finding things at home, are most at risk of decline [4]. Investigating functional and cognitive abilities in MCI participants, Bangen et al. found an association between IADL deficits and global cognitive functioning [5]. A study by Farias et al. revealed impairment of IADL domains that depend heavily on memory function [6].
In clinical practice, ADL functioning is usually assessed by informant-report measures like interviews or standardized questionnaires; less common is the use of self-report or direct performance-based measures. All of these measures have specific advantages and disadvantages: Informant-report allows a quick evaluation of a broad range of everyday competences; however, a reliable proxy is not always available and evaluation can be prone to judgment biases [7, 8]. Self-report also allows a quick evaluation of ADL functioning, however, patients with dementia lack awareness of their problems. In MCI, there are inconsistent results regarding patients’ self-assessment: Some studies report preserved [9, 10], others reduced awareness of deficits [11, 12]. Using performance-based measures, a proxy is not necessary and judgment bias is a minor problem. Examples of existing performance-based measures are the “Revised Observed Tasks of Daily Living” [13], which assesses nine different IADL domains and has good psychometric properties or the “Financial Capacity Instrument” [14], which thoroughly analyzes financial abilities in seven domains. However, existing performance-based assessments are often time-consuming and mostly evaluate only a small range of ADL functioning, e.g., financial capacity [14]. Furthermore, the testing environment is quite artificial, which enhances internal validity but reduces ecological validity. A possible solution to this problem could be provided by smart home environments. A smart home is defined as ‘a physical world that is richly and invisibly interwoven with sensors, actuators, displays, and computational elements, embedded seamlessly in the everyday objects of our lives, and connected through a continuous network’ [15]. Smart homes have initially been developed to support people in their everyday life, monitor their health status, or detect falls. Research concentrated on activity recognition [16], detection of emergency situations, or automation of processes [17]. The diagnostic value of smart homes, however, has only been recognized by few researchers so far who focus on the automated assessment of cognitive health [18]. Another stream of research concentrates on the development of fully automated video analyses to detect deficits in everyday functioning [19–21], however, they do not apply any additional sensor technology.
As smart homes are equipped with advanced technological devices and video cameras, those settings could be used to evaluate a person’s IADL functioning. The advantage of a smart home is that it offers a controllable, yet ecologically valid testing environment. Furthermore, rater bias could be thoroughly eliminated, as the technology offers the opportunity for a fully automated assessment, given the right algorithms. The aim of this study is to investigate the potential of smart home technologies for IADL assessment in MCI. Video analyses and sensor-based data will be recorded to find differences in IADL performance between patients with mild cognitive impairment and healthy controls. Furthermore, relationships between task performance and traditional ADL questionnaires will be analyzed.
METHODS
Participants
Participants aged 65 to 80 years were recruited at the memory clinic of the Central Institute of Mental Health in Mannheim, Germany. MCI was determined using the Petersen clinical criteria [22]. Healthy controls were age- and gender-matched. All participants underwent a neuropsychological assessment to evaluate cognitive functioning. The assessment consisted of the CERAD-plus test battery [23], the Logical Memory task from the Wechsler-Memory Scale [24], the Clock Drawing Test [25], and the Mini-Mental State Examination (MMSE) [26]. For the MCI group, participants had to be impaired in at least one cognitive domain (i.e., 1.5 SD below age- and education adjusted norms) and the MMSE had to be higher than 25 points. For the HC group, no cognitive deficits (i.e., all tests within age- and education-adjusted norms) were allowed. Patients with aberrant motor activity, or psychotic or major depressive disorder according to the Diagnostic and Statistical Manual of Mental Disorders (DSM-IV-TR) [27] were not included. For MCI participants, brain MRI scans were obtained via a 3.0-T MR system (Magnetom Trio, Siemens Medical Systems, Erlangen, Germany). MRI data were analyzed by experienced neuroradiologists using qualitative rating scales. Mediotemporal atrophy was assessed via the Scheltens’ visual rating scale [28].
To control for depressive symptoms, the Geriatric Depression Scale (GDS) [29] was administered to all potential participants. GDS scores of 6 and higher were an exclusion criterion. For the assessment of ADL functioning, participants’ proxies completed the Barthel-ADL [30], the Bayer-ADL [31], and the ADCS-MCI-ADL-18 [32]. The Barthel-ADL assesses basic ADL functioning via 10 items, which include, among others, mobility, eating and continence. Maximum score is 100 points and indicates perfect ADL functioning. The Bayer-ADL consists of 25 items assessing basic and instrumental ADL functioning. Each item is rated on a 10-point scale, ranging from 1 (has never problems) to 10 (has always problems). All answered items are summed up and divided by the number of answered items so that total scores range from 1 to 10. The ADCS-MCI-ADL consists of 18 items that mainly assesses IADL functioning. The maximum score is 57 points and indicates completely intact ADL functioning.
The study was approved by the ethics committee of Heidelberg University, Germany. Informed consent was obtained from all participants and their proxies prior to enrolment.
IADL assessment in the smart home environment
The IADL assessment was conducted at the Fraunhofer Institute in Kaiserslautern, Germany. The smart home environment consisted of a 60 square meters two-room flat (see Fig. 1) equipped with (hidden) activity sensors and video cameras in every room.
The flat was fully furnished and equipped with everyday objects like a television, book shelves, a kettle, armchairs, and a telephone (see Fig. 2). Participants were told to imagine they moved into a holiday apartment and had to solve six tasks. Before the tasks started, participants had a 5-min exploration phase to get familiar with the environment. The six tasks (see Fig. 3) were standardized and participants were handed over an instruction sheet for each task.
Participants were instructed to do each task as quickly and accurately as they could. After task completion participants were instructed to exit the apartment via the hallway door to get instructions for the next task.
Assessed parameters in the smart home environment
Task performance, i.e., IADL functioning, was assessed via different parameters. First of all, time to solve the single tasks was recorded via the activity sensors (when did participant start/stop the specific activity). Furthermore, the video material was analyzed to assess qualitative task performance. Two independent raters evaluated the different steps of task completion, interrater agreement was 98%. For example, task 4 (preparing a sandwich) consisted of 9 steps: 1) go into the kitchen, 2) get the bread, 3) toast the bread, 4) get a plate, 5) get a knife, 6) get the jam, 7) get the butter, 8) spread the toasted bread with jam and butter, 9) put the plate with the bread on the table. Correctly performed steps were evaluated with 1 point each, i.e., in task 4, a maximum of 9 points could be achieved. The 9 steps outlined above were mandatory to solve task 4 successfully and get the full score. However, to be scored as correct, the single steps to complete a task did not have to follow a specific order. This scoring procedure was chosen to enhance ecological validity, as there is a lot of individual variability in solving the tasks correctly. For all tasks together, the maximum score was 60 points.
Furthermore, task irrelevant behavior (e.g., stirring prepared cup of coffee while solving the television task) and searching behavior (e.g., opening cupboards to find a plate) were documented.
Feasibility questionnaire
After completion of all tasks, a semi-structured interview was conducted with each participant to evaluate feasibility of the IADL assessment in the smart home environment. The interview consisted of 14 questions, 9 of them had answer categories with a 5-point Likert Scale. Participants were asked whether the flat was “natural”, the tasks resembled everyday tasks, the tasks were easy to understand, or whether they felt uncomfortable at any time. Furthermore, they had to indicate things that could be improved and tasks they experience as difficult in their everyday life.
Statistical analyses
As data did not follow a normal distribution, non-parametric tests were applied for data analysis. For group comparisons, the Kolmogorov-Smirnov-Z test was applied, since it is recommended for small sample sizes and independent variables with few categories. Furthermore, it provided more conservative results than the Mann-Whitney-U test. For correlation analyses, Kendall’s tau (
RESULTS
Sample characteristics
The sample consisted of 11 MCI patients (mean age = 74.6 years, SD = 4.9) and 10 HC (mean age = 73.4 years, SD = 4.4). Clinical and demographic data of the sample are depicted in Table 1. The majority of participants was female (MCI 73%, HC 70%). As groups were matched for age and gender, no group differences were observed for these variables. Furthermore, no group differences emerged for years of education, GDS score, and the Barthel-ADL. Significant intergroup differences were found for the MMSE score (MCI: M = 27.5 points, SD = 1.0; HC: M = 29.6 points, SD = 0.5), the CERAD subtests, the Bayer-ADL score (MCI: M = 2.9, SD = 1.0; HC: M = 1.3, SD = 0.4) and the ADCS-MCI-ADL score (MCI: M = 45.4, SD = 4.4; HC: M = 54.1, SD = 2.8). For MCI participants, structural neuroimaging data, i.e., brain MRI scans, were available: 9 of 11 MCI participants (82%) showed clinically significant mediotemporal atrophy.
Performance in the smart home environment
Significant intergroup differences were observed for the performance of the IADL tasks in the smart home environment (see Table 2 for details). The MCI group needed more time to complete the six tasks than the HC group (1384 versus 938 seconds,
Correlation analyses
Correlation analyses revealed that neither IADL performance in the smart home nor ADL questionnaire scores were correlated with participants’ age (see Table 3 for details).
Total time to perform the six tasks was significantly negatively correlated with the MMSE scores,
Table 4 depicts correlations between selected CERAD-subtests and completion time of the single tasks. Generally, all reported correlations are negative: The smaller the z-score in the CERAD-subtests (indicating worse performance), the more time was needed for task completion. Task 3 ‘making a phone call’ and task 6 ‘retrieving the objects’ were significantly correlated with all CERAD-subtests. The fewest correlations were found for task 2 ‘making coffee’ which showed moderate correlations with Trail Making Test A and B. Completion time of each of the 6 tasks was moderately correlated with Trail Making Test B.
Feasibility
The participants evaluated the smart home environment and the tasks as realistic (4.24 points, SD = 0.99, on a 5-point Likert scale, and 4.81 points, SD = 0.41, respectively). Moreover, they did not feel uncomfortable while solving the tasks (M = 1.2 points, SD = 0.5) or experienced the scenario as too long (M = 1.1 points, SD = 0.3). 52.4% evaluated task 6 ‘retrieving the objects’ as the most difficult task, 14.3% considered task 3 ‘making a phone call’ the most difficult.
DISCUSSION
The present study investigated the potential of smart home technologies to assess IADL in MCI. Results show that the new assessment tool detected differences between MCI participants and healthy controls. First of all, MCI participants needed more time to complete the tasks than healthy controls. This is in line with findings of Wadley et al. who observed reduced speed in MCI participants while solving IADL-related tasks [34]. Analyzing the subtasks in our sample, significant intergroup differences were observed for placing and retrieving objects, making a phone call, and operating the TV, whereas no differences regarding completion time emerged for making coffee and preparing a sandwich. The latter two tasks could be considered as not highly cognitive demanding: While they required the use of electronic devices (i.e., kettle and toaster, respectively) the participant only had to operate the on/off switch, not multiple steps as in the TV or telephone tasks. Research on IADL in MCI mainly comes to the conclusion that IADL requiring complex neuropsychological processes, e.g., financial capacity or operating technological devices, are affected early in the course of the disease [4, 35]. Reppermund et al. conducted a factor analysis by which they subdivided the Bayer-ADL items in items with high or low cognitive demand. Only the high cognitive demand items (e.g., observing important dates, doing two things at a time) reliably differentiated MCI patients from healthy controls [36].
In the present study, MCI participants not only needed more time to complete tasks, but also made more errors (i.e., scored fewer total points) than healthy controls. Looking at the subtasks, differences were observed for using the telephone, operating the TV, and retrieving the objects. This means that qualitative task performance only differed in three of six tasks, partially supporting the findings of Wadley et al. who evidenced reduced speed in MCI patients but qualitatively intact IADL functioning [34]. Investigating IADL performance in a naturalistic setting, Seelye et al. also observed that MCI participants made more errors than healthy controls while solving tasks but profited from indirect prompting [37].
Correlation analyses in the present study revealed moderate to strong relationships between “traditional” ADL questionnaires and the IADL assessment in the smart home environment. This underlines the usefulness of the newly developed method, as it reflects proxies’ evaluation. As the study aimed to develop a “proxy-free” assessment, the significant correlations are promising. Furthermore, the Trail Making Test B (a measure of executive functioning) was significantly correlated with completion time in each of the 6 tasks. This underlines the importance of intact executive functioning for task completion. Another interesting finding is that tasks 3 and 6, which were experienced as most difficult by participants, were significantly correlated with performance in
One major shortcoming of the present study is the small sample size. This is due to the fact that IADL evaluation in smart homes is an innovative field of research and cost-intensive. To some extent, logistic reasons were also responsible for the small sample size as participants had to be transported to the testing site which had the monitoring technology installed. However, the sample was very carefully chosen: MCI patients were matched to the healthy controls regarding age and gender. Only participants without any mobility constraints or major depression were included. The majority of MCI patients had clinically significant mediotemporal atrophy indicating underlying AD pathology. Moreover, MCI participants had an average MMSE of 27.5 points, which is quite high compared to other studies investigating intergroup differences between MCI and healthy controls (see [4] for an overview). Nevertheless, significant IADL deficits were observed for the MCI group. The biggest strength of the study can be seen in the ecologically valid IADL assessment. While performance-based assessments are most often conducted in quite artificial laboratory settings, our study provided participants with a fully furnished two-room flat. Thus, participants were able to profit from environmental cues which facilitate ADL performance. To make the setting even more naturalistic, future studies could incorporate distracters (e.g., a second person) and interruptions (e.g., a ringing phone which has to be answered) or tasks requiring multi-tasking abilities (e.g., listening to the radio and remembering the songs while making a sandwich).
By means of the sensor data and video recording, it was possible to unobtrusively observe and analyze
Another shortcoming of the study is that it partially relied on an observer-rating of IADL performance. After successful pilot testing, the development of fully automated video and sensor data analyses should be intensified. Research groups already showed that automatic video monitoring systems can successfully detect differences in ADL performance (see [19]). Future research should concentrate on the validation of the tasks in a bigger sample and promote a fully-automated IADL assessment via sensors and video recordings. Besides, longitudinal studies exploring IADL performance of community-dwelling elders at baseline and their risk of conversion to dementia in the following years would be of interest. A first step into this direction has already been taken by Kaye et al. who unobtrusively collected in-home activity data in the homes of 265 elderly participants. The authors intend to use their assessment technology for the detection of incident cognitive and functional decline [38]. Similarly, it seems possible to implement the smart home technologies of our study at care facilities to identify IADL deficits and provide individual assistance.
CONCLUSIONS
In sum, this study demonstrates the big potential of smart home technologies for the assessment of IADL functioning. Smart homes offer an ecologically valid environment, in which–via sensor-based technology in combination with video recording–more information about a patient’s IADL can be gathered than via questionnaires. Future research should be conducted with a larger sample to validate tasks and concentrate on a fully-automated assessment of IADL functioning.
