The Delphi technique is widely used for the development of guidance in palliative care, having impact on decisions with relevance for patient care.
Aim:
To systematically examine the application of the Delphi technique for the development of best practice guidelines in palliative care.
Design:
A methodological systematic review was undertaken using the databases PubMed, CINAHL, Web of Science, Academic Search Complete and EMBASE.
Data sources:
Original articles (English language) were included when reporting on empirical studies that had used the Delphi technique to develop guidance for good clinical practice in palliative care. Data extraction included a quality appraisal on the rigour in conduct of the studies and the quality of reporting.
Results:
A total of 30 empirical studies (1997–2015) were considered for full-text analysis. Considerable differences were identified regarding the rigour of the design and the reporting of essential process and outcome parameters. Furthermore, discrepancies regarding the use of terms for describing the method were observed, for example, concerning the understanding of a ‘round’ or a ‘modified Delphi study’.
Conclusion:
Substantial variation was found concerning the quality of the study conduct and the transparency of reporting of Delphi studies used for the development of best practice guidance in palliative care. Since credibility of the resulting recommendations depends on the rigorous use of the Delphi technique, there is a need for consistency and quality both in the conduct and reporting of studies. To allow a critical appraisal of the methodology and the resulting guidance, a reporting standard for Conducting and REporting of DElphi Studies (CREDES) is proposed.
BlackNMurphyMLampingDet al. Consensus development methods: a review of best practice in creating clinical guidelines. J Health Serv Res Policy1999; 4(4): 236–248.
2.
FinkAKosecoffJChassinMet al. Consensus methods: characteristics and guidelines for use. Am J Public Health1984; 74(9): 979–983.
3.
NairRAggarwalRKhannaD. Methods of formal consensus in classification/diagnostic criteria and guideline development. Semin Arthritis Rheum2011; 41(2): 95–105.
4.
IqbalSPipon-YoungL. The Delphi method. A step-by-step guide. Psychologist2009; 22(7): 598–601.
5.
JüngerS. Die Delphi-Methode: teil 1. Zeitschrift für Palliativmedizin2011; 12(6): 245–248.
6.
BiondoPDNekolaichukCLStilesCet al. Applying the Delphi process to palliative care tool development: lessons learned. Support Care Cancer2008; 16(8): 935–942.
7.
GeistMR. Using the Delphi method to engage stakeholders: a comparison of two studies. Eval Program Plann2010; 33(2): 147–154.
8.
HassonFKeeneyS. Enhancing rigour in the Delphi technique research. Technol Forecast Soc2011; 78: 1695–1704.
9.
DayJBobevaM. A generic toolkit for the successful management of Delphi studies. Electron J Bus Res Meth2005; 3(2): 103–116.
10.
FerrisFDBalfourHMBowenKet al. A model to guide patient and family care: based on nationally accepted principles and norms of practice. J Pain Symptom Manage2002; 24(2): 106–123.
11.
GreenhalghTHowickJMaskreyN. Evidence based medicine: a movement in crisis?BMJ2014; 348: g3725.
12.
BurnsPBRohrichRJChungKC. The levels of evidence and their role in evidence-based medicine. Plast Reconstr Surg2011; 128(1): 305–310.
13.
Addington-HallJM. Introduction. In: Addington-HallJMBrueraEHigginsonIet al. (eds) Research methods in palliative care. Oxford, New York: Oxford University Press, 2007, pp. 1–9.
14.
AounSMNekolaichukC. Improving the evidence base in palliative care to inform practice and policy: thinking outside the box. J Pain Symptom Manage2014; 48(6): 1222–1235.
15.
VisserCHadleyGWeeB. Reality of evidence-based practice in palliative care. Cancer Biol Med2015; 12(3): 193–200.
16.
BaderSWeberMBeckerG. Ist die pharmakologische therapie der Obstipation in der Palliativmedizin evidenzbasiert? Eine systematische Literaturübersicht [Is the pharmacological treatment of constipation in palliative care evidence based? A systematic literature review]. Schmerz2012; 26(5): 568–586.
17.
KleinCStielSBukkiJet al. Medikamentöse Therapie der gastrointestinalen Obstruktion bei schwerkranken und sterbenden Patienten. Eine systematische Literaturübersicht [Pharmacological treatment of malignant bowel obstruction in severely ill and dying patients: a systematic literature review]. Schmerz2012; 26(5): 587–599.
18.
NublingGAllmendingerSLorenzlS. Medikamentöse Therapie der Angst bei Patienten mit fortgeschrittenen Tumorerkrankungen bzw. Patienten in der palliativen Situation. Systematische Literaturübersicht [Drug therapy of anxiety and fear in palliative care patients with cancer or other illnesses: a systematic review]. Schmerz2012; 26(5): 537–549.
19.
SimonSTKoskerogluPBauseweinC. Medikamentöse Therapie der refraktären Atemnot. Eine systematische Literaturübersicht [Pharmacological therapy of refractory dyspnoea: a systematic literature review]. Schmerz2012; 26(5): 515–522.
20.
ThiemARolkeRRadbruchL. Glukokortikoide und Androgene zur Behandlung von Müdigkeit und Schwäche bei Palliativpatienten. Eine systematische Übersichtsarbeit [Glucocorticoids and androgens for treatment of tiredness and weakness in palliative care patients: a systematic review]. Schmerz2012; 26(5): 550–567.
21.
UjeylMMuller-OerlinghausenB. Antidepressiva zur Behandlung der Depression bei Palliativpatienten. Eine systematische Literaturübersicht [Antidepressants for treatment of depression in palliative patients: a systematic literature review]. Schmerz2012; 26(5): 523–536.
22.
HassonFKeeneySMcKennaH. Research guidelines for the Delphi survey technique. J Adv Nurs2000; 32(4): 1008–1015.
23.
FranceEFRingNThomasRet al. A methodological systematic review of what’s wrong with meta-ethnography reporting. BMC Med Res Methodol2014; 14: 119.
24.
FryerCMackintoshSStanleyMet al. Qualitative studies using in-depth interviews with older people from multiple language groups: methodological systematic review. J Adv Nurs2012; 68(1): 22–35.
25.
LilfordRJRichardsonAStevensAet al. Issues in methodological research: perspectives from researchers and commissioners. Health Technol Assess2001; 5(8): 1–57.
26.
O’BrienMRClarkD. Use of unsolicited first-person written illness narratives in research: systematic review. J Adv Nurs2010; 66(8): 1671–1682.
27.
Centre for Reviews and Dissemination. Systematic reviews: CRD’s guidance for undertaking reviews in health care. Heslington: York Publishing Services Ltd, 2009.
28.
MoherDLiberatiATetzlaffJet al. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ2009; 339: b2535.
29.
DiamondIRGrantRCFeldmanBMet al. Defining consensus: a systematic review recommends methodologic criteria for reporting of Delphi studies. J Clin Epidemiol2014; 67(4): 401–409.
30.
BridgmanHCarrE. The provision of family-focused palliative care in hospital using the Delphi technique (including commentary by Corner J). J Res Nurs1997; 2(6): 443–454.
31.
BridgmanHCarrE. Providing family care in hospital. Nurs Times1998; 94(1): 44–47.
32.
De LimaL. International Association for Hospice and Palliative Care list of essential medicines for palliative care. Ann Oncol2007; 18(2): 395–399.
33.
De LimaL. Key concepts in palliative care: the IAHPC list of essential medicines in palliative care. Eur J Hosp Pharm2012; 19(1): 34–37.
34.
De LimaLKrakauerELLorenzKet al. Ensuring palliative medicine availability: the development of the IAHPC list of essential medicines for palliative care. J Pain Symptom Manage2007; 33(5): 521–526.
35.
DownarJHawryluckL. What should we say when discussing ‘code status’ and life support with a patient? A Delphi analysis. J Palliat Med2010; 13(2): 185–195.
36.
DreesenMFoulonVHieleMet al. Quality of care for cancer patients on home parenteral nutrition: development of key interventions and outcome indicators using a two-round Delphi approach. Support Care Cancer2013; 21(5): 1373–1381.
37.
HolmesHMSachsGAShegaJWet al. Integrating palliative medicine into the care of persons with advanced dementia: identifying appropriate medication use. J Am Geriatr Soc2008; 56(7): 1306–1311.
38.
HudsonPRemediosCZordanRet al. Guidelines for the psychosocial and bereavement support of family caregivers of palliative care patients. J Palliat Med2012; 15(6): 696–702.
39.
LindqvistOLundquistGDickmanAet al. Four essential drugs needed for quality care of the dying: a Delphi-study based international expert consensus opinion. J Palliat Med2013; 16(1): 38–43.
40.
MahlerDASeeckyPAHarrodCG. Management of dyspnea in patients with advanced lung or heart disease: practical guidance from the American College of Chest Physicians Consensus Statement. Pol Arch Med Wewn2010; 120(5): 160–165.
41.
MahlerDASeleckyPAHarrodCGet al. American College of Chest Physicians consensus statement on the management of dyspnea in patients with advanced lung or heart disease. CHEST2010; 137(3): 674–691.
42.
MoritaTBitoSKuriharaYet al. Development of a clinical guideline for palliative sedation therapy using the Delphi method. J Palliat Med2005; 8(4): 716–729.
43.
MoritaTBitoSKoyamaHet al. Development of a national clinical guideline for artificial hydration therapy for terminally ill patients with cancer. J Palliat Med2007; 10(3): 770–780.
44.
Onwuteaka-PhilipsenBDvan der WalG. A protocol for consultation of another physician in cases of euthanasia and assisted suicide. J Med Ethics2001; 27(5): 331–337.
45.
PigniABrunelliCGibbinsJet al. Content development for EUROPEAN GUIDELINES on the use of opioids for cancer pain: a systematic review and Expert Consensus Study. Minerva Anestesiol2010; 76(10): 833–843.
46.
RaynerLPriceAHotopfMet al. The development of evidence-based European guidelines on the management of depression in palliative cancer care. Eur J Cancer2011; 47(5): 702–712.
47.
RaynerLPriceAHotopfMet al. Expert opinion on detecting and treating depression in palliative care: a Delphi study. BMC Palliat Care2011; 10: 10.
48.
Van der MaadenTvan der SteenJTde VetHCet al. Development of a practice guideline for optimal symptom relief for patients with pneumonia and dementia in nursing homes using a Delphi study. Int J Geriatr Psychiatry2014; 30: 487–496.
49.
VermandereMLepeleireJVan MechelenWet al. Spirituality in palliative home care: a framework for the clinician. Support Care Cancer2013; 21(4): 1061–1069.
50.
VignaroliEBennettMINekolaichukCet al. Strategic pain management: the identification and development of the IAHPC opioid essential prescription package. J Palliat Med2012; 15(2): 186–191.
51.
StruppJRomotzkyVGalushkoMet al. Palliative care for severely affected patients with multiple sclerosis: when and why? Results of a Delphi survey of health care professionals. J Palliat Med2014; 17(10): 1128–1136.
52.
Van der SteenJTRadbruchLHertoghCMet al. White paper defining optimal palliative care in older people with dementia: a Delphi study and recommendations from the European Association for Palliative Care. Palliat Med2014; 28(3): 197–209.
53.
BradfordNHerbertAMottCet al. Components and principles of a pediatric palliative care consultation: results of a Delphi study. J Palliat Med2014; 17(11): 1206–1213.
54.
CarterBSBhatiaJ. Comfort/palliative care guidelines for neonatal practice: development and implementation in an academic medical center. J Perinatol2001; 21(5): 279–283.
55.
CatlinACarterB. Creation of a neonatal end-of-life palliative care protocol (reprinted by permission of Journal of Perinatology, vol. 22, pp. 184–195). Neonatal Netw2002; 21(4): 37–49.
56.
FinlayFLewisMLentonSet al. Planning for the end of children’s lives: the lifetime framework. Child Care Health Dev2008; 34(4): 542–544.
57.
MendesJCCda SilvaLJ. Neonatal palliative care developing consensus among neonatologists using the Delphi technique in Portugal. Adv Neonatal Care2013; 13(6): 408–414.
58.
BradleyCTBraselKJ. Developing guidelines that identify patients who would benefit from palliative care services in the surgical intensive care unit. Crit Care Med2009; 37(3): 946–950.
59.
De LimaLBennettMIMurraySAet al. International Association for Hospice and Palliative Care (IAHPC) List of Essential Practices in Palliative Care. J Pain Palliat Care Pharmacother2012; 26(2): 118–122.
60.
HawryluckLAHarveyWRCLemieux-CharlesLet al. Consensus guidelines on analgesia and sedation in dying intensive care unit patients. BMC Med Ethics2002; 3: E3.
61.
JüngerSPayneSBrearleySet al. Consensus building in palliative care: a Europe-wide Delphi study on common understandings and conceptual differences. J Pain Symptom Manage2012; 44(2): 192–205.
62.
SasaharaTKizawaYMoritaTet al. Development of a standard for hospital-based palliative care consultation teams using a modified Delphi method. J Pain Symptom Manage2009; 38(4): 496–504.
63.
SprungCLTruogRDCurtisJRet al. Seeking worldwide professional consensus on the principles of end-of-life care for the critically ill. The Consensus for Worldwide End-of-Life Practice for Patients in Intensive Care Units (WELPICUS) Study. Am J Respir Crit Care Med2014; 190(8): 855–866.
64.
Temkin-GreenerHLadwigSCaprioTet al. Developing palliative care practice guidelines and standards for nursing home–based palliative care teams: a Delphi study. J Am Med Dir Assoc2015; 16(1): 86.e1–e7.
65.
KeeneySHassonFMcKennaH. Consulting the oracle: ten lessons from using the Delphi technique in nursing research. J Adv Nurs2006; 53(2): 205–212.
66.
SchulzKFAltmanDGMoherD. CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. BMJ2010; 340: c332.
67.
TongASainsburyPCraigJ. Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups. Int J Qual Health C2007; 19(6): 349–357.
68.
BirkoSDoveESOzdemirV. Evaluation of Nine Consensus Indices in Delphi Foresight Research and Their Dependency on Delphi Survey Characteristics: a Simulation Study and Debate on Delphi Design and Interpretation. PLoS One2015; 10(8): e0135162.
69.
MurphyMKBlackNALampingDLet al. Consensus development methods, and their use in clinical guideline development. Health Technol Assess1998; 2(3): i–iv, 1–88.
70.
GuzysDDickson-SwiftVKennyAet al. Gadamerian philosophical hermeneutics as a useful methodological framework for the Delphi technique. Int J Qual Stud Health Well-being2015; 10: 26291.
71.
MitroffIITuroffM. Philosophical and methodological foundations of Delphi. In: LinstoneHATuroffM (eds) The Delphi method: techniques and applications. Boston, MA: Addison-Wesley, 2002, pp. 17–34.
72.
ScheeleDS. Reality construction as a product of Delphi interaction. In: LinstoneHATuroffM (eds) The Delphi method: techniques and applications. Boston, MA: Addison-Wesley, pp. 35–67.
