Abstract
Objective:
To explore the effect of goal-setting on physical functioning, quality of life and duration of rehabilitation in geriatric rehabilitation compared to care as usual.
Data sources:
Medline, Embase, CINAHL, PsycINFO and the Cochrane Library were searched from initiation to October 2018.
Methods:
We included randomized controlled trials (RCTs), controlled before–after studies and studies using historic controls of older patients (mean age ⩾55 years) receiving rehabilitation for acquired disabilities. Our primary outcome was physical functioning; secondary outcomes were quality of life and rehabilitation duration. Cochrane guidelines were used to assess the risk of bias of the studies and extract data. Only RCT data were pooled using standardized mean difference (SMD).
Results:
We included 14 studies consisting of a total of 1915 participants with a mean age ranging from 55 to 83 years. Ten out of the 14 studies had a randomized controlled design, 7 of which could be pooled for the primary outcome. The risk of bias was judged high in several domains in all included studies. The meta-analysis showed no statistically significant differences between goal-setting and care as usual for physical functioning (SMD −0.11 (−0.32 to 0.10)), quality of life (SMD 0.09 (−0.56 to 0.75)) and rehabilitation duration (MD 13.46 days (−2.46 to 29.38)).
Conclusion:
We found low-quality evidence that goal-setting does not result in better physical functioning compared to care as usual in geriatric rehabilitation. For quality of life and duration of rehabilitation, we could not exclude a clinically relevant effect.
Introduction
Goal-setting is regarded as an essential part of rehabilitation. 1 It has been defined as the establishment or negotiation of rehabilitation goals and refers to the intended future state of the patient, which will usually involve a change from the current situation.1,2 In 2015, a Cochrane review of randomized controlled trials (RCTs) concluded that goal-setting did not result in higher levels of physical functioning, although there was evidence that goal-setting can result in higher levels of self-efficacy and health-related quality of life in adult rehabilitation patients. 1 Because of the limited quality of the 39 included studies, the authors concluded that there is only very low-quality evidence for the beneficial effects of goal-setting for adult rehabilitation patients.
Although this review included a few studies which were conducted in older patients, it did not specifically study the effects of goal-setting in geriatric rehabilitation. Geriatric rehabilitation can be defined and characterized as multidisciplinary treatment to improve independent functioning aimed at older patients who are often frail and have several comorbidities, including cognitive dysfunction and communication problems.3,4 This means that there are both practical and theoretical differences between geriatric and adult rehabilitation which might lead to a different goal-setting process and effect.
This is in accordance with earlier research, which found that this heterogeneous group of older patients with various degrees of frailty find it hard to shape and discuss their personal rehabilitation programme and need guidance in defining their rehabilitation goals.5,6 Furthermore, a systematic review identified several barriers for patient-centred goal-setting, which especially apply to this patient group. It showed that clinicians have difficulty and reservations about involving patients in goal-setting who have problems with communication and cognition. 7 In conclusion, there is evidence that the goal-setting process in geriatric rehabilitation is different than that of adult rehabilitation and its effect might therefore be different as well.
The purpose of this review was to systematically identify, critically appraise and synthesize the available evidence on the effects of goal-setting in geriatric rehabilitation. To this end, we conducted a systematic review and meta-analysis to assess the effectiveness of goal-setting versus care as usual on physical functioning, quality of life and duration of rehabilitation of older rehabilitation patients with acquired disabilities.
Methods
A systematic review and meta-analysis was carried out in three stages following PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines 8 : (1) literature search; (2) data extraction and critical appraisal; (3) data synthesis. A review protocol was created before the start of the study. There was one deviation. Originally, we planned to only include studies of inpatient geriatric rehabilitation patients. Because we ended up with a limited number of studies, we decided to also include studies with participants from outpatient settings and combined inpatient and outpatient settings.
Literature search
The primary author conducted a systematic computerized search to identify studies on 15 October 2018. Five electronic databases were searched: Medline, Embase, CINAHL, PsycINFO and the Cochrane Library. The search was not limited by any time restrictions or language (if necessary, a translation service would be used). Search terms were used relating to the following themes: rehabilitation, goal-setting and goal-setting instruments. Rehabilitation was used as a solitary search term and several search term were used to capture the theme goal-setting, like ‘goal-setting’, ‘goal pursuit’ and ‘goal achievement’. In addition, several goal-setting instruments (i.e. ‘Canadian Occupational Performance Measure’ and ‘Talking Mats’) were also used as individual search terms, to make sure studies using these instruments as goal-setting method would be included in our search results. Specific goal-setting instruments which were included in the search were adopted from an earlier review. 9 Finally, the reference lists of included articles were scrutinized for other potentially relevant articles. The search terms and strategy for Medline is provided in Supplemental Appendix 1; for the other databases, we adapted the search strings accordingly.
Trials had to report on geriatric rehabilitation to be included in the review, which was defined as a group of rehabilitation patients with an average age of 55 years or older. 3 Based on previous reviews, we expected a low number of RCTs that would probably result in too few studies to draw meaningful conclusions; hence, we decided to also include non-randomized studies. Results of the NRSIs will not be included in the meta-analysis but can provide evidence additional to that available from randomized trials.
We included studies that met all of the following criteria: (1) (quasi- or cluster) randomized controlled trials, non-randomized controlled trials, controlled before–after studies or studies using historic controls; (2) people receiving rehabilitation for disabilities acquired in adulthood; (3) studies involving any type of goal-setting versus care as usual. Studies were excluded based on the following criteria: (1) mean age of the study population under 55 years; (2) studies without data on physical functioning and/or recovery; (3) studies dealing solely with cognitive or psychiatric rehabilitation; (4) mixed or combined intervention studies, that is, when goal-setting was part of a larger intervention.
A full list of articles was composed combining the search results of all five databases and removing duplicates. Two reviewers (E.B.S., H.B.) independently screened titles and abstracts of the full list and agreement had to be reached before the article was subjected to a full-text assessment. In case, an article was only selected by one reviewer a discussion took place between the two reviewers to determine whether the study should be selected for a full-text analysis. A third reviewer (J.vd.W) could be consulted in case that the two reviewers could not reach consensus on inclusion. Next, both reviewers independently assessed the full text of the selected articles. Studies were included in a similar fashion. Our primary outcome was mobility and activities of daily living and the secondary outcomes were quality of life and duration of the rehabilitation.
Data extraction and critical appraisal
The two reviewers independently assessed the study quality and extracted the data from each included study. The results of the quality assessment and data extraction were compared and discrepancies were resolved through discussion. Data were extracted using a standard data extraction form adapted from the Cochrane Consumers and Communication Review Group’s Data Extraction Template and were entered into Covidence (www.covidence.com), a web-based software platform for the production of systematic reviews. The following study characteristics were extracted: study design, patient characteristics, sample size, goal-setting method, functional outcomes and secondary study outcomes. The methodological quality of the individual studies was assessed in accordance with Cochrane guidelines focussing on the following criteria: sequence generation, allocation concealment, blinding of participants and personnel, incomplete data, selective reporting and other sources of bias. 10 Thus, we used one tool to assess risk of bias in order to enhance comparability of the risk of bias assessments between the different types of studies. The risk of bias was rated as high, low or unclear. 10 The extracted data were entered into Review Manager 11 version 5.3 by the primary author; accuracy of the data entry was checked by a second reviewer (H.B.).
Data synthesis
Data synthesis started off by summarizing all available data in order to determine whether statistical pooling of the data was suitable by comparing participants, goal-setting method and outcome measures. For the meta-analysis, we only included studies that randomized individuals, studies using a quasi-randomized design and cluster-randomized studies. We used a mean difference for pooling in cases of similar unit of measurement; otherwise, a standardized mean difference (SMD) was calculated for each study. 10 Consequently, we could only include those studies which reported a mean outcome value in the meta-analysis. If a study did not report a standard deviation (SD), we replaced it with the SD of a comparable study which used the same measurement and metric in case that the original authors of the study could not provide it. When a study applied multiple instruments to assess the same outcome, the most appropriate measurement instrument was selected. In addition, when outcomes were assessed at multiple points in time, we preferably used the score at discharge from the intervention; when not available, we used the score obtained at the first follow-up time with a minimum of two weeks. For the cluster-randomized study that did not take the design into account in the analysis, 12 we adapted the study size by adjusting for the design effect,10,13 using an intraclass cluster coefficient of 0.08. 14 Finally, apart from selecting randomized controlled trials, we did not take additional risks of bias of individual studies into account when excluding studies for pooling.
We used a random effects model to pool the data from all the available studies either with a mean difference or with a SMD. 15 Heterogeneity between studies was assessed first by visual inspection of the forest plot. Next, we computed the Q-statistic and I2. Substantial statistical heterogeneity was assumed if the Q-statistic was significant (P < 0.05) and the I2 value was more than 50%.15,16
Results
Study selection
The PRISMA flowchart of the entire search and selection procedure is shown in Figure 1. In summary, 14 out of the 3851 articles met the inclusion criteria and were included in the systematic review; seven of these could be included in the meta-analysis for the primary outcome. Reasons for exclusion in the full-text assessment phase were incorrect age group, no experimental design, not reporting our primary outcome, no goal-setting intervention or a mixed intervention, and finally, we excluded articles containing duplicate outcomes of the same study patients. Three articles reported data from the same study: Guidetti et al. 12 and Bertilsson et al.17,18 We only used Guidetti et al., 12 because it reported the most accurate data at three months of follow-up of all the participants.

PRISMA flowchart.
Study characteristics
A total of 14 studies met the selection criteria for the current review12,19–31; the summary of the study characteristics can be found in Table 1. The mean age ranged from 55 to 93 years and the patients were admitted for various reasons. One study reported cognitive dysfunction in 26.6% of the participants 19 ; four studies reported an average score on the Mini-Mental State Examination with average scores ranging from 23 to 27.6.12,20,23,27 Finally,three of the included studies in the systematic review reported data on the proportion of patients having at least one comorbid condition ranging from 4.5% to 68.5%.12,19,24
Study characteristics.
In case of absence of a total median age, the lowest age median was given of either the control or intervention group.
There were two distinct approaches to goal-setting in the included studies. Eight studies used a goal-setting instrument to set goals.19,20,26–31 These instruments were the Canadian Occupational Performance Measure (COPM), the Rehabilitation Activities Profile (RAP), the Goal Attainment Scaling (GAS) and the Aid for Decision-making in Occupation Choice (ADOC). The other six studies used a standardized approach to goal-setting with predefined intervention.12,21–25 These were the Client-Centred Self Care Intervention (CCSCI), the Client-centred Activities of Daily Living (CADL) and the Take Charge Session (TCS).
The study designs of the included studies were individually randomized controlled trials (RCTs) (n = 7), cluster RCTs (n = 2), non-randomized controlled trials (n = 2), quasi-RCT; controlled before-after study and historic control study (each n = 1).
Critical appraisal
A summary of the risk of bias assessment of the included studies is presented in Supplemental Table 1. The most frequent source of methodological bias was lack of blinding for the intervention, which was classified as high in all studies. In addition, ‘other sources of bias’ were classified as high in 12 of the 14 included studies. The main reason was the presence of baseline imbalances in patient characteristics between control group and intervention group, which was found in six studies.
Primary outcome
All of the 14 included studies (1915 participants) reported data on physical functioning at follow-up. The 14 studies in the systematic review showed mixed results, 11 found no differences between the intervention group and the control group on our primary outcome (Table 1). Two studies reported a statistically significant difference in favour of the control group19,31 and one study found a statistically significant higher level for the upper-body dressing subscale of the Functional Independent Measure in the goal-setting group. 22 The meta-analysis included seven (n = 354 participants analysed) studies (Figure 2) showed no significant difference in physical functioning between goal-setting and care as usual (SMD −0.11, 95% confidence interval (CI) –0.32 to 0.10).

Meta-analysis – physical functioning.
Secondary outcomes
Four of the included studies reported data on quality of life and these studies (n = 178 participants analysed) could all be used for data pooling. Only one individual study reported a significant difference in quality of life between the two groups, in favour of the goal-setting intervention. 24 The meta-analysis (Figure 3) showed no statistically significant difference in quality of life between goal-setting and care as usual (SMD 0.09, 95% CI −0.56 to 0.75). There was evidence of substantial heterogeneity between the studies.

Meta-analysis – quality of life.
Data on duration of rehabilitation (days) were reported in four studies, one of which found a statistically significant difference: duration of the rehabilitation was significantly longer in the intervention group. 28 We used the mean difference to pool all the data, because the unit of measurement was the same for all included studies. The meta-analysis (Figure 4) included three studies (n = 111 participants analysed) and showed a non-significant difference between goal-setting and care as usual for the duration of rehabilitation (MD 13.46 days, 95% CI −2.46 to 29.38).

Meta-analysis – duration of rehabilitation.
Discussion
This systematic review and meta-analysis studied the effect of goal-setting on rehabilitation outcomes in older rehabilitation patients. The current meta-analysis did not show a statistically significant effect of goal-setting in geriatric rehabilitation for any of the primary and secondary outcomes. The power of our meta-analysis was sufficient to exclude a clinically relevant effect on our primary outcome, as the 95% confidence interval excluded a clinically relevant effect, that is, a SMD >0.5. 32 In conclusion, our study found low-quality evidence that goal-setting does not have a relevant effect on physical functioning. For quality of life and duration of rehabilitation, the available studies could not exclude clinically relevant effects of goal-setting. The overall risk of bias of the included studies was judged to be considerable.
This review identified three studies with a positive outcome in favour of the control group and two studies in favour of the intervention group. There are some differences between these studies, which appear to be minor, like research design and goal-setting method. For example, all the studies favouring the control group used a specific goal-setting measurement instrument as a means to implement the intervention, namely the RAP or COPM, instead of only prescribing actions how to perform the intervention. Still, it is likely that this difference is due to chance since there are also two studies in the review which used the COPM and found no significant differences. The same goes for the custom approaches to goal-setting, two of these studies found statistical differences in favour of the intervention groups and the other four found no differences.
Similar to the Cochrane review, our study found that goal-setting does not lead to higher levels of physical functioning. 1 Three studies from the Cochrane review were also included in the current review.21,24,25 In addition, we included four other and newer studies and found similar evidence that goal-setting does not yield better results than care as usual in terms of physical functioning.
Regarding quality of life, our results differ from those of the Cochrane review. 1 Our study suggests that goal-setting does not result in higher levels of quality of life, although we could not to exclude a clinically relevant effect in either direction, as shown by the boundaries of the confidence interval (−0.56 to 0.75). Nonetheless, the Cochrane review found some evidence that goal-setting can lead to improved psychosocial outcomes like health-related quality of life in adult rehabilitation. Three studies from the Cochrane review were also included in our meta-analysis21,24,28 and one individually randomized RCT we included was not included in the Cochrane review. 29 Pooling these four studies resulted in a non-significant effect; there was, however, considerable statistical heterogeneity between the studies.
Furthermore, our review differs in several ways from the Cochrane review which necessitates the use of an independent search and review. 1 Most importantly, our review specifically studied the effect of goal-setting on older rehabilitation patients, whereas the Cochrane review included patients from the age of 18 years. Second, the Cochrane review included several psychosocial outcomes, whereas our review focused exclusively on quality of life as psychosocial outcome. In addition, our review also studied the effect of goal-setting on duration of rehabilitation, while the Cochrane review did not. Third, the Cochrane review included the study of Sewell et al., 33 while we excluded this study, because goal-setting was not compared to care as usual. Finally, as mentioned, our search was updated in 15 October 2018; the latest update search for the Cochrane review was in January 2014.
There are several potential explanations for not finding a significant result in this review. First, all 14 included studies lacked a process evaluation, including an assessment of adherence to protocol. Process evaluation is considered an essential part of designing and testing complex interventions.34,35 The absence of a proper process evaluation prohibits drawing conclusions on the extent and quality of the implementation and the level of protocol adherence of the goal-setting interventions in the included studies. And so it is not surprising that a significant effect cannot be demonstrated in a study in which the goal-setting intervention was implemented incorrectly or incompletely.
Second, goal-setting could already have been integrated in care as usual to some degree. A recent study which explored goal-setting during inpatient rehabilitation actually found that all participating rehabilitation units in their study conducted at least therapist-led goal-setting. 36 In therapist-led goal-setting, it is the therapist who identifies the problems, defines rehabilitation goals and evaluates the process. 36 At the same time, there is evidence that patients are not always involved in goal-setting, and that the goal-setting process itself is often incomplete.36,37 Goal-setting is not merely about establishing rehabilitation goals but also includes negotiation of goals, that is, involving the patient in defining and evaluating them. In short, there is some evidence that care as usual might not be an entirely true control group because to some extent goal-setting is already integrated in usual care. In other words, perhaps we were only able to study the additive effect of standardized goal-setting, that is, goal-setting by means of an instrument or a predefined approach, compared to non-standardized goal-setting in care as usual.
In conclusion, this study found low-quality evidence that goal-setting does not result in better physical functioning compared to care as usual in geriatric rehabilitation. In addition, we found low-quality evidence that goal-setting does not result in higher levels of quality of life and/or shortened duration of rehabilitation. However, because of the wide 95% confidence interval, we could not exclude a clinically relevant effect for these secondary outcomes.
The current review has several limitations. First, we used a basic operationalization to define geriatric rehabilitation patients, namely a group of rehabilitation patients with an average age of 55 years or older (cf. Bachmann et al. 3 ). It should be noted that only a minority of the included studies reported data on the prevalence of comorbidity and cognitive functioning. Thus, the included studies contain a heterogeneous group of older patients of varying complexity. We still believe that this mix of the patients with varying comorbidity is an accurate reflection of the current practice of geriatric rehabilitation.3,4,38
Second, we included studies with a variety of approaches to goal-setting. Despite this heterogeneity, these studies, in our opinion, cover the broad spectrum of goal-setting.
Third, most of the studies lacked a clear description of what was considered usual care. A recent study showed that goal-setting in clinical practice is often therapist-led and does not include monitoring progress and revising goals with the patient. 36 This makes it difficult to get an idea about the level of goal-setting in the control group.
Based on our results, we cannot recommend the implementation of standardized approaches to goal-setting in rehabilitation of older adults in order to improve physical recovery and quality of life. However, within the framework of shared decision-making, goal-setting may be considered desirable or even imperative from an ethical point of view, since goal-setting involves patients in decision-making and is therefore a means to respect the preferences, values and autonomy of patients.39,40 Future studies should aim at improving quality of evidence by reducing the risk of bias using clear study outcomes and publishing trial protocols and using sufficient sample sizes in the trials to reduce baseline imbalance. Furthermore, these studies should conduct a process evaluation to check the implementation and the level of protocol adherence of the goal-setting intervention.
Clinical messages
The evidence reviewed found that standardized goal-setting did not result in better physical functioning or quality of life in geriatric rehabilitation.
The included studies showed a high risk of bias and process evaluation and adherence to protocol was lacking in all studies.
Supplemental Material
Supplemental_Material – Supplemental material for Goal-setting in geriatric rehabilitation: a systematic review and meta-analysis
Supplemental material, Supplemental_Material for Goal-setting in geriatric rehabilitation: a systematic review and meta-analysis by Ewout B Smit, Hylco Bouwstra, Cees MPM Hertogh, Elizabeth M Wattel and Johannes C van der Wouden in Clinical Rehabilitation
Footnotes
Acknowledgements
Study concept and design: Ewout Smit, Hylco Bouwstra, Johannes van der Wouden, Cees Hertogh. Acquisition of data: Ewout Smit. Analysis and interpretation of data: Ewout Smit, Hylco Bouwstra, Johannes van der Wouden, Lizette Wattel, Cees Hertogh. Drafting of the manuscript: Ewout Smit. Critical revision of the manuscript for important intellectual content: Ewout Smit, Hylco Bouwstra, Johannes van der Wouden, Lizette Wattel, Cees Hertogh. There are no other people who participated in or made contribution to the study.
Declaration of conflicting interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship and/or publication of this article.
Funding
The author(s) received no financial support for the research, authorship and/or publication of this article.
Supplemental material
Supplemental Material for this article is available online.
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
