EAPC White Paper on outcome measurement in palliative care: Improving practice,attaining outcomes and delivering quality services – Recommendations from the European Association for Palliative Care (EAPC) Task Force on Outcome Measurement
Restricted accessReview articleFirst published online January, 2016
EAPC White Paper on outcome measurement in palliative care: Improving practice,attaining outcomes and delivering quality services – Recommendations from the European Association for Palliative Care (EAPC) Task Force on Outcome Measurement
Outcome measurement plays an increasing role in improving the quality, effectiveness, efficiency and availability of palliative care.
Aim:
To provide expert recommendations on outcome measurement in palliative care in clinical practice and research.
Methods:
Developed by a European Association for Palliative Care Task Force, based on literature searches, international expert workshop, development of outcome measurement guidance and international online survey. A subgroup drafted a first version and circulated it twice to the task force. The preliminary final version was circulated to wider expert panel and 28 international experts across 20 European Association for Palliative Care member associations and the European Association for Palliative Care Board of Directors and revised according to their feedback. The final version was approved by the European Association for Palliative Care Board for adoption as an official European Association for Palliative Care position paper.
Results:
In all, 12 recommendations are proposed covering key parameters of measures, adequate measures for the task, introduction of outcome measurement into practice, and national and international outcome comparisons and benchmarking. Compared to other recommendations, the White Paper covers similar aspects but focuses more on outcome measurement in clinical care and the wider policy impact of implementing outcome measurement in clinical palliative care. Patient-reported outcome measure feedback improves awareness of unmet need and allows professionals to act to address patients’ needs. However, barriers and facilitators have been identified when implementing outcome measurement in clinical care that should be addressed.
Conclusion:
The White Paper recommends the introduction of outcome measurement into practice and outcomes that allow for national and international comparisons. Outcome measurement is key to understanding different models of care across countries and, ultimately, patient outcome having controlled for differing patients characteristics.
GruenewaldDAHigginsonIJVivatB. Quality of life measures for the palliative care of people severely affected by multiple sclerosis: a systematic review. Mult Scler2004; 10(6): 690–704.
2.
CurrowDCAllinghamSYatesP. Improving national hospice/palliative care service symptom outcomes systematically through point-of-care data collection, structured feedback and benchmarking. Support Care Cancer2015; 23(2): 307–315.
HardingRHigginsonIJ. PRISMA: a pan-European co-ordinating action to advance the science in end-of-life cancer care. Eur J Cancer2010; 46(9): 1493–1501.
5.
BauseweinCHigginsonIJBenaliaA. PRISMA WP4 scoping exercise. Resources for outcome measures in palliative care. London: PRISMA, Cicely Saunders Institute KCL, 2009.
6.
BauseweinCSimonSTBenaliaH. Implementing patient reported outcome measures (PROMs) in palliative care – users’ cry for help. Health Qual Life Outcomes2011; 9: 27.
7.
HardingRSimonSTBenaliaH. The PRISMA Symposium 1: outcome tool use. Disharmony in European outcomes research for palliative and advanced disease care: too many tools in practice. J Pain Symptom Manage2011; 42(4): 493–500.
8.
DavesonBASimonSTBenaliaH. Are we heading in the same direction? European and African doctors’ and nurses’ views and experiences regarding outcome measurement in palliative care. Palliat Med2012; 26(3): 242–249.
9.
SimonSTHigginsonIJHardingR. Enhancing patient-reported outcome measurement in research and practice of palliative and end-of-life care. Support Care Cancer2012; 20(7): 1573–1578.
10.
BauseweinCDavesonBABenaliaA. Outcome measurement in palliative care – the essentials. London: PRISMA, 2009.
11.
HigginsonIJEvansCJGrandeG. Evaluating complex interventions in end of life care: the MORECare statement on good practice generated by a synthesis of transparent expert consultations and systematic reviews. BMC Med2013; 11: 111.
12.
EvansCJBenaliaHPrestonNJ. The selection and use of outcome measures in palliative and end-of-life care research: the MORECare International Consensus Workshop. J Pain Symptom Manage2013; 46(6): 925–937.
13.
BrundageMBlazebyJRevickiD. Patient-reported outcomes in randomized clinical trials: development of ISOQOL reporting standards. Qual Life Res2013; 22(6): 1161–1175.
14.
CellaDYountSRothrockN. The Patient-Reported Outcomes Measurement Information System (PROMIS): progress of an NIH Roadmap cooperative group during its first two years. Med Care2007; 45(5 Suppl. 1): S3–S11.
15.
KaasaSLogeJHFayersP. Symptom assessment in palliative care: a need for international collaboration. J Clin Oncol2008; 26(23): 3867–3873.
16.
EagarKWattersPCurrowDC. The Australian Palliative Care Outcomes Collaboration (PCOC) – measuring the quality and outcomes of palliative care on a routine basis. Aust Health Rev2010; 34(2): 186–192.
17.
PastranaTRadbruchLNauckF. Outcome indicators in palliative care – how to assess quality and success. Focus group and nominal group technique in Germany. Support Care Cancer2010; 18(7): 859–868.
18.
DonabedianA. Explorations in quality assessment and monitoring. Ann Arbor, MI: Health Administration Press, 1980.
19.
PorterME. What is value in health care?N Engl J Med2010; 363(26): 2477–2481.
20.
DawsonJDollHFitzpatrickR. The routine use of patient reported outcome measures in healthcare settings. BMJ2010; 340: c186.
21.
WareJJrSherbourneC. The MOS 36-item short-form health survey (SF-36): I. Conceptual framework and item selection. Med Care1992; 30(6): 473–483.
22.
EuroQol Group. EuroQol – a new facility for the measurement of health-related quality of life. Health Policy1990; 16: 199–208.
23.
GoldbergDHillierV. A scaled version of the General Health Questionnaire. Psychol Med1979; 9(1): 139–145.
24.
BergnerMBobbittRCarterW. The Sickness Impact Profile: development and final revision of a health status measure. Med Care1981; 19(8): 787–805.
25.
HigginsonIJHardingR. Outcome measurement. In: Addington-HallJBrueraEHigginsonIJ. (eds) Research methods in palliative care. Oxford: Oxford University Press, 2007, pp. 99–114.
26.
HearnJHigginsonIJ. Development and validation of a core outcome measure for palliative care: the palliative care outcome scale. Palliative Care Core Audit Project Advisory Group. Qual Health Care1999; 8(4): 219–227.
27.
BrueraEKuehnNMillerM. The Edmonton Symptom Assessment System (ESAS): a simple method for the assessment of palliative care patients. J Palliat Care1991; 7(2): 6–9.
28.
GroenvoldMPetersenMAAaronsonNK. The development of the EORTC QLQ-C15-PAL: a shortened questionnaire for cancer patients in palliative care. Eur J Cancer2006; 42(1): 55–64.
29.
CleelandCSRyanKM. Pain assessment: global use of the Brief Pain Inventory. Ann Acad Med Singapore1994; 23(2): 129–138.
30.
Lynn SnowACookKFLinPS. Proxies and other external raters: methodological considerations. Health Serv Res2005; 40(5 Pt 2): 1676–1693.
31.
LaugsandEASprangersMABjordalK. Health care providers underestimate symptom intensities of cancer patients: a multicenter European study. Health Qual Life Outcomes2010; 8: 104.
32.
ZloklikovitsSAndritschEFrohlichB. Assessing symptoms of terminally-ill patients by different raters: a prospective study. Palliat Support Care2005; 3(2): 87–98.
33.
McPhersonCJAddington-HallJ. Judging the quality of care at the end of life: can proxies provide reliable information?Soc Sci Med2003; 56(1): 95–109.
34.
HigginsonIJGaoW. Caregiver assessment of patients with advanced cancer: concordance with patients, effect of burden and positivity. Health Qual Life Outcomes2008; 6: 42.
35.
GaoWBennettMIStarkD. Psychological distress in cancer from survivorship to end of life care: prevalence, associated factors and clinical implications. Eur J Cancer2010; 46(11): 2036–2044.
36.
MaguirePPitceathlyC. Key communication skills and how to acquire them. BMJ2002; 325(7366): 697–700.
37.
HomsiJWalshDRiveraN. Symptom evaluation in palliative medicine: patient report vs systematic assessment. Support Care Cancer2006; 14(5): 444–453.
38.
AbernethyAPShelby-JamesTFazekasBS. The Australia-modified Karnofsky Performance Status (AKPS) scale: a revised scale for contemporary palliative care clinical practice [ISRCTN81117481]. BMC Palliat Care2005; 4: 7.
39.
CollinCWadeDTDaviesS. The Barthel ADL Index: a reliability study. Int Disabil Stud1988; 10(2): 61–63.
40.
CurrowDCEagarKAounS. Is it feasible and desirable to collect voluntarily quality and outcome data nationally in palliative oncology care?J Clin Oncol2008; 26(23): 3853–3859.
41.
BennettMRyallN. Using the modified Barthel index to estimate survival in cancer patients in hospice: observational study. BMJ2000; 321(7273): 1381–1382.
42.
SelmanLHardingsRGyselsM. The measurement of spirituality in palliative care and the content of tools validated cross-culturally: a systematic review. J Pain Symptom Manage2011; 41(4): 728–753.
43.
PuchalskiCFerrellBViraniR. Improving the quality of spiritual care as a dimension of palliative care: the report of the consensus conference. J Palliat Med2009; 12(10): 885–904.
44.
HardingRSelmanLAgupioG. Validation of a core outcome measure for palliative care in Africa: the APCA African Palliative Outcome Scale. Health Qual Life Outcomes2010; 8: 10.
45.
PowellRADowningJHardingR. APCA. Development of the APCA African Palliative Outcome Scale. J Pain Symptom Manage2007; 33(2): 229–232.
46.
NekolaichukCLMaguireTOSuarez-AlmazorM. Assessing the reliability of patient, nurse, and family caregiver symptom ratings in hospitalized advanced cancer patients. J Clin Oncol1999; 17(11): 3621–3630.
47.
SteinhauserKEClippECBosworthHB. Measuring quality of life at the end of life: validation of the QUAL-E. Palliat Support Care2004; 2(1): 3–14.
48.
CohenSMountBStrobelM. The McGill Quality of Life Questionnaire: a measure of quality of life appropriate for people with advanced disease. A preliminary study of validity and acceptability. Palliat Med1995; 9(3): 207–219.
49.
PayneS; EAPC Task Force on Family Carers. White Paper on improving support for family carers in palliative care: part 1. Recommendations from the European Association for Palliative Care (EAPC) Task Force on Family Carers. Eur J Palliat Care2010; 17(5): 238–245.
50.
PayneS; EAPC Task Force on Family Carers. White Paper on improving support for family carers in palliative care: part 2. Recommendations from the European Association for Palliative Care (EAPC) Task Force on Family Carers. Eur J Palliat Care2010; 17(6): 286–290.
51.
DavesonBAAlonsoJPCalanzaniN. Learning from the public: citizens describe the need to improve end-of-life care access, provision and recognition across Europe. Eur J Public Health2014; 24(3): 521–527.
52.
HudsonPLTrauerTGrahamS. A systematic review of instruments related to family caregivers of palliative care patients. Palliat Med2010; 24(7): 656–668.
53.
HigginsonIJGaoWJacksonD. Short-form Zarit Caregiver Burden Interviews were valid in advanced conditions. J Clin Epidemiol2010; 63(5): 535–542.
54.
EwingGToddCRogersM. Validation of a symptom measure suitable for use among palliative care patients in the community: CAMPAS-R. J Pain Symptom Manage2004; 27(4): 287–299.
55.
HenrikssonACarlanderIArestedtK. Feelings of rewards among family caregivers during ongoing palliative care. Palliat Support Care. Epub ahead of print 16October2013. DOI: 10.1017/S1478951513000540.
56.
StreinerDLNormanGR. Health measurement scales: a practical guide to their development and use, 4th ed.Oxford: Oxford University Press, 2008.
57.
International Society for Quality of Life Research, prepared by AaronsonNChoucairAElliottT. User’s guide to implementing patient-reported outcomes assessment in clinical practice, 11November2011, http://www.isoqol.org/UserFiles/file/UsersGuide.pdf
58.
MarshallSHaywoodKFitzpatrickR. Impact of patient-reported outcome measures on routine practice: a structured review. J Eval Clin Pract2006; 12(5): 559–568.
59.
GreenhalghJ. The applications of PROs in clinical practice: what are they, do they work, and why?Qual Life Res2009; 18(1): 115–123.
60.
HughesEFWuAWCarducciMA. What can I do? Recommendations for responding to issues identified by patient-reported outcomes assessments used in clinical practice. J Support Oncol2012; 10(4): 143–148.
MularskiRARosenfeldKCoonsSJ. Measuring outcomes in randomized prospective trials in palliative care. J Pain Symptom Manage2007; 34(1 Suppl): S7–S19.
63.
FieldingSFayersPMLogeJH. Methods for handling missing data in palliative care research. Palliat Med2006; 20(8): 791–798.
64.
INVOLVE. INVOLVE strategy 2012–2015: putting people first in research. London: National Institute for Health Research, 2012.
65.
EtkindSNDavesonBAKwokW. Capture, transfer, and feedback of patient-centered outcomes data in palliative care populations: does it make a difference? A systematic review. J Pain Symptom Manage2015; 49(3): 611–624.
66.
AntunesBHardingRHigginsonIJ. Implementing patient-reported outcome measures in palliative care clinical practice: a systematic review of facilitators and barriers. Palliat Med2014; 28(2): 158–175.
67.
CampbellSMBraspenningJHutchinsonA. Research methods used in developing and applying quality indicators in primary care. BMJ2003; 326(7393): 816–819.
68.
OstgatheCVoltzR. Quality indicators in end-of-life care. Curr Opin Support Palliat Care2010; 4(3): 170–173.
69.
ShekellePGMacLeanCHMortonSC. Assessing care of vulnerable elders: methods for developing quality indicators. Ann Intern Med2001; 135(8 Pt 2): 647–652.
70.
SingerPAMartinDKBowmanK. Quality end-of-life care: where do we go from here?J Palliat Med2000; 3(4): 403–405.
71.
PasmanHRBrandtHEDeliensL. Quality indicators for palliative care: a systematic review. J Pain Symptom Manage2009; 38(1): 145–156.
72.
De RooMLLeemansKClaessenSJ. Quality indicators for palliative care: update of a systematic review. J Pain Symptom Manage2013; 46(4): 556–572.
73.
ClaessenSJFranckeALBelarbiHE. A new set of quality indicators for palliative care: process and results of the development trajectory. J Pain Symptom Manage2011; 42(2): 169–182.
74.
PeruselliCPaciEFranceschiP. Outcome evaluation in a home palliative care service. J Pain Symptom Manage1997; 13(3): 158–165.
75.
WoithaKVan BeekKAhmedN. Development of a set of process and structure indicators for palliative care: the Europall project. BMC Health Serv Res2012; 12: 381.
76.
SelmanLHardingR. How can we improve outcomes for patients and families under palliative care? Implementing clinical audit for quality improvement in resource limited settings. Indian J Palliat Care2010; 16(1): 8–15.
77.
HjermstadMJLieHCCaraceniA. Computer-based symptom assessment is feasible in patients with advanced cancer: results from an international multicenter study, the EPCRC-CSA. J Pain Symptom Manage2012; 44(5): 639–654.
78.
AbernethyAPHerndonJE2ndWheelerJL. Improving health care efficiency and quality using tablet personal computers to collect research-quality, patient-reported data. Health Serv Res2008; 43(6): 1975–1991.
79.
AbernethyAPAhmadAZafarSY. Electronic patient-reported data capture as a foundation of rapid learning cancer care. Med Care2010; 48(6 Suppl): S32–S38.
80.
BennettAVJensenREBaschE. Electronic patient-reported outcome systems in oncology clinical practice. CA Cancer J Clin2012; 62(5): 337–347.
CurrowDCTiemanJJGreeneA. Refining a checklist for reporting patient populations and service characteristics in hospice and palliative care research. J Pain Symptom Manage2012; 43(5): 902–910.
84.
AntunesB. The Palliative care Outcome Scale (POS) – manual for cross-cultural adaptation and psychometric validation. London: Cicely Saunders Institute, 2012.
85.
EisenchlasJHHardingRDaudML. Use of the palliative outcome scale in Argentina: a cross-cultural adaptation and validation study. J Pain Symptom Manage2008; 35(2): 188–202.
86.
RadbruchLStrasserFElsnerF. Fatigue in palliative care patients – an EAPC approach. Palliat Med2008; 22(1): 13–32.
87.
KamalAHCurrowDCRitchieC. The value of data collection within a palliative care program. Curr Oncol Rep2011; 13(4): 308–315.
88.
StielSPastranaTBalzerC. Outcome assessment instruments in palliative and hospice care – a review of the literature. Support Care Cancer2012; 20(11): 2879–2893.
89.
DunckleyMAspinalFAddington-HallJM. A research study to identify facilitators and barriers to outcome measure implementation. Int J Palliat Nurs2005; 11(5): 218–225.
90.
Department of Health. Strengthening palliative care: policy and strategic directions 2011–2015. Melbourne, VIC, Australia: Department of Health, 2011.
91.
CalvertMBlazebyJAltmanDG. Reporting of patient-reported outcomes in randomized trials: the CONSORT PRO extension. JAMA2013; 309(8): 814–822.
92.
HigginsonIJCostantiniM. Dying with cancer, living well with advanced cancer. Eur J Cancer2008; 44(10): 1414–1424.
93.
SimonSTGomesBKoeskerogluP. Population, mortality and place of death in Germany (1950–2050) – implications for end-of-life care in the future. Public Health2012; 126(11): 937–946.
94.
PotterMGordonSHamerP. The Nominal Group Technique: a useful consensus methodology in physiotherapy research. New Zeal J Physiother2004; 32(3): 126–130.
95.
EvansCJHardingRHigginsonIJ. ‘Best practice’ in developing and evaluating palliative and end-of-life care services: a meta-synthesis of research methods for the MORECare project. Palliat Med2013; 27(10): 885–898.
96.
RothAKornblithABatel-CopelL. Rapid screening for psychologic distress in men with prostate carcinoma. Cancer1998; 82(10): 1904–1908.
97.
DowningJDMarstonJSelwynC. Developing children’s palliative care in Africa through beacon centres: lessons learnt. BMC Palliat Care2013; 12: 8.
98.
WongDLBakerCM. Pain in children: comparison of assessment scales. Pediatr Nurs1988; 14(1): 9–17.
99.
HicksCLvon BaeyerCLSpaffordPA. The Faces Pain Scale-Revised: toward a common metric in pediatric pain measurement. Pain2001; 93(2): 173–183.
100.
StevensB. Pain assessment and management in infants with cancer. Pediatric Blood & Cancer2007; 49(7 Suppl): 1097–1101.
101.
ShermanSAEisenSBurwinkleTM. The PedsQL Present Functioning Visual Analogue Scales: preliminary reliability and validity. Health Qual Life Outcomes2006; 4: 75.
102.
DowningJOjingMPowellRA. A palliative care outcome measure for children in sub-Saharan Africa: early development findings. Eur J Palliat Care2012; 19(6): 292–295.
103.
GreenhalghJLongAFBrettleAJ. Reviewing and selecting outcome measures for use in routine practice. J Eval Clin Pract1998; 4(4): 339–350.
104.
MokkinkLBTerweeCBKnolDL. The COSMIN checklist for evaluating the methodological quality of studies on measurement properties: a clarification of its content. BMC Med Res Methodol2010; 10: 22.
105.
TavakolMDennickR. Making sense of Cronbach’s alpha. Int J Med Educ2011; 2: 53–55.
106.
LandisJRKochGG. The measurement of observer agreement for categorical data. Biometrics1977; 33(1): 159–174.
107.
US Department of Health and Human Services, Food and Drug Administration, Center for Drug Evaluation and Research, et al. Guidance for industry: patient-reported outcome measures: use in medical product development to support labeling claims. Silver Spring: US Food and Drug Administration, 2009.
108.
TerweeCBBotSDMde BoerMR. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol2007; 60(1): 34–42.
109.
JaeschkeRSingerJGuyattGH. Measurement of health status: ascertaining the minimal clinically important difference. Contr Clin Trials1989; 10(4): 407–415.
110.
SloanJA. Assessing the minimally clinically significant difference: scientific considerations, challenges and solutions. COPD2005; 2(1): 57–62.
111.
PappasGWolfRCMorineauG. Validity of measures of pain and symptoms in HIV/AIDS infected households in resources poor settings: results from the Dominican Republic and Cambodia. BMC Palliat Care2006; 5: 3.
112.
DowningJAtienoMPowellRA. Initial results from the development of the APCA African Children’s Palliative Outcome Scale (APCA African POS). PaedPalLit Special Supplementary ed. 2010, p. 31.
113.
DowningJSimonSTMwangi-PowellFN. Outcomes ‘out of Africa’: the selection and implementation of outcome measures for palliative care in Africa. BMC Palliat Care2012; 11: 1.
114.
DefilippiKMCameronS. Expanding the reach of palliative care to community-based home care programs. J Pain Symptom Manage [Research Support, Non-U.S. Gov’t] 2010; 40(1): 3–5.
115.
HardingRHigginsonIJ. Palliative care in sub-Saharan Africa. Lancet2005; 365(9475): 1971–1977.
