Abstract
Background:
A challenge for commissioners and providers of end-of-life care in dementia is to translate recommendations for good or effective care into quality indicators that inform service development and evaluation.
Aim:
To identify and critically evaluate quality indicators for end-of-life care in dementia.
Results:
We found 8657 references, after de-duplication. In all, 19 publications describing 10 new and 3 updated sets of indicators were included in this review. Ultimately, 246 individual indicators were identified as being relevant to dementia end-of-life care and mapped against EAPC guidelines.
Conclusions:
We systematically derived and assessed a set of quality indicators using a robust framework that provides clear definitions of aspects of palliative care, which are dementia specific, and strengthens the theoretical underpinning of new complex interventions in end-of-life care in dementia.
Keywords
Dementia is becoming a leading cause of death, but end-of-life care for people with dementia may be poor with improvements needed in many areas.
Standard measures of quality and efficacy of care used in other medical conditions may not be appropriate in the assessment of outcomes for end-of-life care in patients with dementia.
Research for people with dementia at the end of life tends to borrow definitions of what constitutes good care from cancer models, without analysing which elements are transferable and which are not.
A summary of quality indicators available to assess optimal palliative care in older people with dementia, derived using a robust framework that provides clear definitions of aspects of palliative care which are dementia specific.
Identification of major gaps related to aspects of palliative care in dementia for which indicators remain to be developed.
Results provide a dementia-specific resource and framework for future research and the rigorous development and evaluation of complex intervention in end-of-life care in dementia.
Background
Dementia has become the leading cause of death among women in England, and the second most common cause among men. 1 Research has consistently shown that end-of-life care for people with dementia may be poor with improvements needed in many areas.2–6 People with advanced dementia experience a range of symptoms similar to those found in the terminal stages of cancer (including pain, increased risk of cachexia, aspiration, with impaired immunological function), but many lack the capacity required to make decisions about their care and treatment. This has a profound impact on providing the vital components of good end-of-life care. 7 End-of-life care for this group is further complicated by the fact that many people with dementia are cared for in the community by relatives, homecare workers or care home staff and the general practitioner, resulting in the involvement of multiple care professionals; also, people with dementia often have multiple comorbidities and frailty, meaning that no one specialist is best suited or has a clearly defined role to care for the person with dementia at the end of life, thus potentially undermining continuity of care. 8
In England, the trend towards increasing hospital deaths among people with a death certificate mention of dementia has reversed with a reciprocal increase in care home deaths, and home and inpatient hospice deaths in dementia are rare. 9 The European Association for Palliative Care (EAPC) recently published its official position paper defining palliative care for people with dementia as distinct from palliative care for other patient groups, 10 an important step in the progress of research and service delivery in dementia at the end of life. The White Paper introduced a definition of palliative care that is specific to dementia, through the development of core domains with salient recommendations for each domain. One of the challenges for commissioners and providers of care as well as researchers is how to translate these recommendations into measurable and practically relevant indicators of good or effective care that can inform the development of services and their evaluation. Other recent reviews11–13 have focused on the identification of outcome measures for the evaluation of end-of-life care in dementia and in long-term care settings (e.g. QUALIDEM, ADRQL, DQoL), rather than quality indicators. A quality indicator is a measurable aspect of care, generally expressed as a number or percentage and expressed at an aggregate level, often the level of care organisations. 14 A quality indicator further requires explicit and defined components, including a numerator (e.g. number of patients with improvement in pain score between admission and <48 h), a denominator (e.g. total number of patients for whom pain is scored at admission/48 h) and finally a norm or standard (e.g. at least 50% report improved pain). 15 Where outcome measures assess how much of a difference we are making, quality indicators assess how ‘good’ a job we are doing; 15 in this way, quality indicators infer a judgement about the quality of care provided. 16 It is useful to further differentiate between structure-, process- and outcome-related quality indicators, whereby structure denotes the setting in which care occurs, process denotes what is actually done in giving and receiving the care, and outcome denotes changes in health status or quality of life that can be attributed to the preceding care (including patient and family satisfaction with healthcare, Quality of life of patient, Quality of Life of Family and Loved ones and Quality of Dying Patient).17–19
The Supporting Excellence in End of life care in Dementia (SEED) research programme (https://research.ncl.ac.uk/seed/) comprises a series of studies focused on facilitating professionals to deliver better quality care in this area, with the ultimate aim of developing an effective and feasible intervention to support providers and commissioners of community-based end-of-life care in dementia. The aim of this paper is to inform the rigorous evaluation of these types of complex interventions in end-of-life care in dementia by systematically identifying and critically appraising existing quality indicators for palliative care to EAPC domains, thereby using a dementia lens to identify which palliative care indicators have most relevance for people living and dying with dementia in a range of settings.
Methods
Data sources and searches
To identify quality indicators with the potential to assess optimal palliative care in older people with dementia, we updated a systematic review of quality indicators for palliative care performed by de Roo et al. 20 in 2011. We used the search strategy developed by de Roo et al. that identified publications by means of searches in computerised bibliographic databases (i.e. Medline via Ovid, EMBASE via Ovid, PsycINFO via Ovid, and CINAHL via EBSCO) with no limitations with regard to language or year of publication, using keywords and medical-subject headings for palliative care with keywords and medical-subject headings for quality indicators. For Medline search strategy see Supplementary file 1, Appendix 1); the search strategies performed in other databases were similar and are available on request. The search period ran from the inception of the databases to 21 January 2018.
Inclusion criteria and study selection
Papers were eligible for inclusion if they met the following inclusion criteria developed by de Roo et al.: 20 (1) the publication describes the development process and/or characteristics of quality indicators developed specifically for palliative care provided by care organisations or professionals and (2) numerators and denominators are defined for the quality indicators, or can be deduced directly from the description of the quality indicators, or performance standards given. English translations of indicators described in the non-English literature could be included if available. Excluded references were (1) editorials, letters to the editor, comments and narrative case reports, (2) indicators focusing on national palliative care policy or the organisation of palliative care at the national level and (3) publications describing the application of existing quality indicators in clinical practice or reviews of several sets of quality indicators without any new developments. All references were screened by two reviewers independently in a two-stage inclusion process. In the first stage, references were screened by two reviewers independently (N.K. and S.A.) by title and abstract. All references deemed eligible for inclusion proceeded to the second selection stage, in which two reviewers (E.L.S. and S.A.) independently examined the remaining references by reading the full texts. Where references selected in the second stage related to conference abstracts and proceedings, we sought to identify any available full publications.
Methodological assessment
As in de Roo, the quality indicators were assessed methodologically using the Appraisal of Indicators through Research and Evaluation (AIRE) instrument, 21 by two of the authors (E.L.S. and S.A.) independently for the entire sets of indicators rather than for each quality indicator separately. Standardised scores for each of the three AIRE categories range between 0% and 100%, with a higher score indicating a higher methodological level (see de Roo et al. 20 for further details regarding score calculation).
Screening and mapping unique indicators against EAPC framework
To establish indicators of relevance to people dying with or from dementia, we extracted the relevant data from the included literature, including if available, the numerator, denominator, exclusion(s), performance standards, measurement question and/or item, and the type of indicator (i.e. whether the indicator describes a structure, process or outcome of care). We screened and then mapped newly identified indicators as well as indicators previously identified by de Roo et al., 10 against the EAPC framework for optimal palliative care in older people with dementia. The framework comprises 11 key domains determined through a rigorous international consensus process, which are (1) applicability of palliative care, (2) person-centred care, communication and shared decision-making, (3) setting care goals and advance planning, (4) continuity of care, (5) prognostication and timely recognition of dying, (6) avoiding overly aggressive, burdensome or futile treatment, (7) optimal treatment of symptoms and providing comfort, (8) psychosocial and spiritual support, (9) family care and involvement, (10) education of the healthcare team and (11) societal and ethical issues. The review was carried out by a multidisciplinary team of experts in palliative and dementia care, with clinical and research expertise in community nursing, old age psychiatry, psychology and primary care. First, indicators were screened by three reviewers independently (E.L.S., C.G. and S.A.) using the exclusion criteria detailed in Table 2. Any discrepancies between reviewers’ exclusions were discussed until agreement was reached. The remaining indicators were then mapped blinded and independently against EAPC domains by two reviewers (E.L.S., S.A.). Any disagreements between reviewers’ classifications were adjudicated by a third reviewer (C.G.). L.R. oversaw the work and provided feedback at each stage of the review process.
Results
Search results
A total of 8657 potentially relevant references were found in this 2018 update, after de-duplication. Of these, 12 were publications included in the de Roo update; the remaining de Roo references were not found through the computerised searches, but all figured in the identified publications’ reference lists. We reference tracked all 29 publications included in the de Roo review for any updates, which resulted in the inclusion of 5 new publications22–26 describing 3 updated sets of indicators. We also included one of the 12 publications previously identified by de Roo, to assess one of the updated sets. 27
Furthermore, 66 new publications were retained for a full text read, following screening of titles and abstracts. Six publications that had not previously been identified by de Roo met the inclusion criteria.28–33 Seven additional publications34–40 not found in the computerised searches were included after reference tracking publications selected for full text review, and identification of full publications from conference proceedings. Finally, two publications were duplicates not picked up by the reference manager software. Hence, a total of 19 publications have been included in this review (see Supplementary file 1, Appendix 3). These 19 publications describe a total of 13 sets of indicators, 10 of which had not been previously identified in the de Roo update; the remaining three are updates of sets previously identified by de Roo (see flow chart presented in Figure 1).

Study selection and screening flow chart.
Methodological characteristics of quality indicators
Publications varied widely as to the level of detail regarding the development of indicator sets. Three sets were attributed the maximum score for the ‘Stakeholder involvement’ and ‘Scientific evidence’ domains’.22,23,25,36 Overall, the sets performed less well on the ‘Additional evidence, formulation and usage’ domain; the quality indicators for palliative care 29 performed best on this domain with a maximum score of 85%. Individual items on which sets performed poorly included ‘the supporting evidence has been critically appraised’ and ‘a strategy for risk adjustment has been considered and described’.
Screening
The original review identified 17 sets of quality indicators for palliative care containing 326 unique indicators. We identified a further 10 sets as well as 3 updated sets previously identified by de Roo, containing an additional 309 unique indicators. In total, we screened and mapped a total of 635 indicators using the methods described above.
After screening using the criteria detailed in Table 1, we excluded over 60% of indicators (n = 389; 61.3%) because they were not operationalised or lacked conceptual clarity (n = 176; 45.2% of excluded indicators), were not applicable to long-term care settings (n = 75; 19.3%), lacked procedural relevance (n = 72; 18.5%), were specific to a particular scale (n = 49; 12.6%) or were not applicable to UK care settings (n = 17; 4.4%). Table 2 provides a summary of excluded indicators by exclusion criteria with examples for each (a complete list of indicators is collated in Supplementary file 1, Appendix 2).
Methodological characteristics of sets of quality indicators using AIRE.
AIRE: appraisal of indicators through research and evaluation; CAHPS: consumer assessment of healthcare providers and systems; PCOC: Palliative Care Outcomes Collaboration; NICE: national institute for clinical excellence; QOPI: quality oncology practice initiative.
Summary of excluded indicators (N = 389) with examples by exclusion criteria.
Numbers in parenthesis are quality indicator ID numbers.
Quality indicator ID numbers 1–326 are indicators previously identified by de Roo, ID numbers 327–635 are indicators identified in this review.
Mapping
The remaining indicators (n = 246; 38.7%) were mapped against EAPC domains 2–11. EAPC Domain 1 (i.e. applicability of palliative care) was not retained as a domain against which to map indicators due to its more conceptual nature. 10 Two-thirds of quality indicators retained related to processes of care (n = 165; 67%) and very few to structures of care (n = 11; 4.5%). Close to 30% (n = 70; 28.5%) related to outcomes of care, a significant number of which developed as a part of the newly identified quality indicators for palliative care set. 29 Below, we examine the extent to which indicators are able to form a complete reflection of the domain to which they are ascribed (see Van der Steen et al. 10 for a detailed description of each domain) and areas in need of further development or not. Table 3 provides a summary of available indicators, key results, gaps and examples for each domain.
Summary of available indicators (N = 246) with key results, examples and identified gaps by EAPC domain.
Numbers in parenthesis are quality indicator ID numbers.
Quality indicator ID numbers 1–326 are indicators previously identified by de Roo, ID numbers 327–635 are indicators identified in this review.
Domain 2. Person-centred care, communication and shared decision-making
Indicators mapped to Domain 2 (n = 24; 9.8% of indicators mapped to EAPC guidelines) include (1) evidence of an explanation of the medical condition to the patient, the risks and benefits of treatment and documentation of the patient’s insight into the disease, as well as evidence to confirm patient/family/caregiver participation in the discussion and development of treatment goals and plans (e.g. preference for place of care and Do Not Attempt Cardiopulmonary Resuscitation order (DNACPR)). We found no indicators to assess evidence of the management of behaviour that challenges which acknowledges the personhood of people with dementia, 10 highlighting a potential gap in measuring the application of person-centred care towards and at end of life. Other indicators mapped to this domain include (2) evidence of a discussion with family about the goals of care, as well as regular discussions within the healthcare team around the needs of those approaching end of life and a strategy of care, and finally (3) evidence of interdisciplinary meetings with patients and family, joint decisions taken by the care team and family, and discussion of the medical condition and goals for treatment with a designated surrogate.
Domain 3. Setting care goals and advance planning
Indicators mapped to Domain 3 (n = 31; 12.6%) include evidence of (1) mechanisms to assess and document the needs of those approaching end of life (e.g. Gold Standards Framework (http://www.goldstandardsframework.org.uk/) or equivalent), (2) ongoing quality-of-life assessment reflected in the treatment plan, (3) mechanisms to discuss, record and communicate the wishes and treatment preferences of those approaching end of life, including withholding or withdrawing life-sustaining treatments (e.g. DNACPR, no tube feeding, no hospital transfer), (3) documentation of a surrogate decision-maker (or lack thereof) and evidence that (5) interventions not wanted by individuals are not performed and individuals are able to die in the location of their preference.
Domain 4. Continuity of care
Domain 4 indicators (n = 24; 9.8%) include evidence (1) of the nomination of a key worker, (2) of effective communication between services (e.g. between ambulance services and GPs), (3) that care plans are implemented by all providers consistent with goals of care, (4) that essential services in the community are accessible 24/7 to enable people to live and die in the place of their choice, (5) of a locality-wide register of those approaching end of life and (6) of knowledge and recognition of advance care plans across care settings. Hospital-specific indicators that assess evidence of procedures at the interface between community and acute settings (e.g. percentage of all patients with documentation of a discharge plan including statements such as ‘likely to require health services at discharge’ or ‘not expected to survive this admission’ within 4 days of admission) are also mapped to this domain, since they may potentially maintain continuity of care between both.
Domain 5. Prognostication and timely recognition of dying
Indicators mapped to Domain 5 (n = 15; 6%) include evidence that people approaching the end of life are identified and referrals to palliative care are made in a timely manner (or evidence of documentation why there was not referral), but also evidence that patients and family/caregivers understand and are satisfied with provider communication about prognosis, communication about the risks and benefits of treatment and their participation in the development of treatment goals.
Domain 6. Avoiding overly aggressive, burdensome or futile treatment
Indicators mapped to Domain 6, (n = 12; 4.9%) measure numbers of unscheduled hospital visits (i.e. A&E or unscheduled admissions) and proportion dying in hospital and at home, which may be used to assess evidence of potentially overly aggressive treatment and of inappropriate hospital transfers at the end of life. Further development is required to fully assess recommendations related to the appropriateness of pharmacological interventions and other care at the end of life in dementia (i.e. administration of medication for long-term conditions and comorbid diseases, use of restraints, hydration and tube nutrition, use of antibiotics and transfers to hospital).
Domain 7. Optimal treatment of symptoms and providing comfort
Indicators mapped to Domain 7 (n = 82; 33.3%) include evidence of (1) multidisciplinary input, (2) comprehensive palliative care assessments (including pain, dyspnea, depression, emotional distress, delirium/agitation), and follow-up to assess the effectiveness of interventions and evidence that symptom relief was achieved and (3) practical arrangements in place (e.g. equipment and crisis boxes) to support those dying at home or in a care home and the timely provision of medical aids to ensure preferred place of care. No indicators are available to assess evidence of nursing care specifically (or involvement of dementia care specialist expertise if needed), the use of non-pharmacological interventions or the integration of family and professional caregiver views.
Domain 8. Psychosocial and spiritual support
Indicators mapped to Domain 8 (n = 13; 5.3%) include evidence of assessment of religious affiliation, discussion of spiritual concerns and that spiritual support was offered, as well as documentation of patients’ and families’ emotional reaction to explanation of medical condition. Domain 8 contains an additional recommendation related to the quality of the dying environment for which we found no indicators.
Domain 9. Family care and involvement
Indicators mapped to Domain 9 (n = 36; 14.6%) include evidence (1) that family has been provided with an explanation of the medical condition, the course of disease until death and patient’s impending death (2) of documentation of family’s preference of explanation of medical condition, of family’s insight of the disease, of configuration of family relationships and key person involved in the patient’s care, (3) evidence of assessment and documentation of carer needs, family’s preferences or expectations, and preferred place of care and (4) evidence of a care strategy for family, including referral to bereavement services.
Domain 10. Education of the healthcare team
Very few indicators mapped onto Domain 10 (n = 2; 0.8%). Two indicators assess organisational processes for identifying training needs through measurement of the proportion of workers attending educational programmes, but do not reflect recommendations related to skill mix within the healthcare team.
Domain 11. Societal and ethical issues
Similarly, few indicators mapped onto Domain 11 (n = 7, 2.9%). This is not surprising considering the criteria applied in previous reviews, which excluded indicators focusing on national palliative care policy or the organisation of palliative care at the national level, and on which mapping reported here is based. As such, indicators mapped onto Domain 11 reflect only recommendations related to the availability of palliative care for people with dementia and assess neither levels of collaboration between dementia and palliative care nor economic or systemic incentives.
Discussion
Main findings
In this paper, we provide a summary of the quality indicators available to assess optimal palliative care in older people with dementia as defined by the EAPC guidelines, and identify the major gaps related to recommendations for which indicators remain to be developed (see Table 2).
Strengths and limitations
The assessment of outcomes for end-of-life care in patients with dementia is methodologically difficult, as standard measures of quality and efficacy of care, employed in other medical conditions, may not be appropriate. 42 Too often, research for people with dementia at the end of life borrows the assumptions of what is good care from cancer models, without analysing which elements are directly transferable, which are not and which can be transferable with modification. 43 In our study, a multidisciplinary team of experts in palliative and end-of-life care in dementia considered 635 systematically derived indicators for palliative care on an individual basis, using a robust framework that provides clear definitions of aspects of palliative care which are dementia specific. We excluded over half of the existing indicators for palliative care at the screening stage, close to 40% for lack of applicability to populations for whom dementia is the lead condition further complicating the dying trajectory.
Examining processes of care to assess the quality of care relies heavily on evidence that what is assumed to be a good process will produce a good outcome.17,18 The methodological assessment of selected indicator sets undertaken here (i.e. using the AIRE instrument) suggests a need for greater critical appraisal of the supporting evidence upon which indicators identified in this review are based. Only then can the presence or absence of certain procedures in specific situations be accepted as evidence of good or bad quality, without the need for further ascertainment. 17 The assessment of optimal palliative care in older people with dementia is more likely to require a mix of all three types of indicators (i.e. structure, process and outcome) to capture the quality of care at both the service level and from the perspective of the person with dementia and their families and/or carers (see Leemans et al. 44 for a detailed discussion).
Our work builds on indicators that reflect a biomedical approach to care for people with dementia at the end of life. It is possible that quality indicators based on other approaches, for example, of the person-centeredness of care of older people with dementia 45 or the quality of life in dementia and/or in long-term care settings46,47 may be better suited to assessing optimal end-of-life care in dementia. No indicators were specifically developed for use in settings with no on-site medical and/or nursing staff, which is typical of UK residential care homes and therefore limits the number of indicators applicable to community care settings. Also, quality indicators should adhere as far as possible to some fundamental a priori characteristics, 16 and the properties of indicators identified here (e.g. validity) remain to be assessed.
What this study adds
A major contribution of this study is to have rendered a comprehensive but large list of indicators into a dementia-specific resource, and a framework for future research and implementation of dementia specific end-of-life care. There have been recent calls 43 to strengthen the theoretical development underpinning new complex interventions designed to improve end-of-life care in dementia – such an approach would benefit quality indicators used to assess the effectiveness of these types of interventions. Questions remain as to (1) the feasibility of developing a set of quality indicators that could be used across the community settings in which older people are living and dying with dementia (e.g. home settings, long-term care settings with and without on-site nursing), (2) where along the dementia trajectory quality indicators for end-of-life care should be introduced and (3) whether quality indicators that are considered important to people with dementia and their families coincide with those habitually used by commissioners (see also Leemans et al. 48 ). Overall, a focus on clear and measurable indicators has not so far been able to capture how to apply these over time to reflect what is often an extended dying trajectory involving multiple patient representatives, carers and healthcare professionals at key points. Given the increasing numbers of people who will die with dementia, future work should focus on the development of quality indicators which reflect all aspects of optimal palliative care in dementia, including the use of non-pharmacological interventions, avoidance of overly aggressive, burdensome or futile treatment and skill mix within the healthcare team, potentially building upon indicators developed within person-centred approaches to care aimed at improving comfort and quality of life towards the end of life.
Supplemental Material
834227_Supplementary_material_for_online_publication_190225_R – Supplemental material for A systematic review and critical appraisal of quality indicators to assess optimal palliative care for older people with dementia
Supplemental material, 834227_Supplementary_material_for_online_publication_190225_R for A systematic review and critical appraisal of quality indicators to assess optimal palliative care for older people with dementia by Sarah Amador, Elizabeth L Sampson, Claire Goodman and Louise Robinson in Palliative Medicine
Footnotes
Acknowledgements
The authors gratefully acknowledge Dr Nuriye Kupeli’s expertise and contribution in the first stage of the screening process. All authors made a substantial contribution to the design of the work, and the analysis and interpretation of data. SA drafted the article, which was revised critically by ELS, CG and LR. All authors approved the version to be published, and take public responsibility for the content.
Declaration of conflicting interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship and/or publication of this article.
Funding
The author(s) disclosed receipt of the following financial support for the research, authorship and/or publication of this article: This paper is an independent research funded by the National Institute for Health Research (Programme Grants for Applied Research, Supporting Excellence in End of Life Care in Dementia, RP-PG-0611-20005). The views expressed in this publication are those of the authors and not necessarily those of the National Health Service, the National Institute for Health Research or the Department of Health.
Supplemental material
Supplemental material for this article is available online.
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
