Abstract
Background:
Specialist palliative care services have various configurations of staff, processes and interventions, which determine how care is delivered. Currently, there is no consistent way to define and distinguish these different models of care.
Aim:
To identify the core components that characterise and differentiate existing models of specialist palliative care in the United Kingdom.
Design:
Mixed-methods study: (1) semi-structured interviews to identify criteria, (2) two-round Delphi study to rank/refine criteria, and (3) structured interviews to test/refine criteria.
Setting/participants:
Specialist palliative care stakeholders from hospice inpatient, hospital advisory, and community settings.
Results:
(1)
(2)
(3)
Conclusion:
In this innovative study, we derive 20 criteria to characterise and differentiate models of specialist palliative care – a major paradigm shift to enable accurate reporting and comparison in practice and research.
Specialist palliative care is facing an increasing, ageing population and restricted resources.
Currently, there is no consistency in the way models of specialist palliative care are defined in clinical practice or research.
This constrains our understanding of what models of care (or components) are most clinically effective and cost-effective.
This paper provides a set of criteria to define and compare models of UK specialist palliative care.
Researchers and clinicians will be able to clearly define and distinguish models of specialist palliative care.
Background
Specialist palliative care is facing an increasing, ageing population and restricted resources. 1 If recent mortality trends continue, 160,000 more people in England and Wales will need palliative care by 2040, 1 and healthcare systems and models of specialist palliative care will need to adapt to meet the rapidly growing needs of palliative care. Existing models of specialist palliative care are often historically oriented towards cancer care and may lack responsiveness to societies’ changing needs. 2 There are also major geographical variations in NHS provision of care resulting in often poor match between palliative care needs of patients and families and the resources provided to meet these needs.3,4
To improve responsiveness of specialist palliative care and evolve models of care to better meet population needs, we need to understand and define different models of care. The term ‘model of care’ is used infrequently and inconsistently in the published evidence on specialist palliative care. 5 A ‘model of care’ has been defined as the way in which health care services are delivered and is ‘a descriptive picture of practice which adequately represents the real thing’. 6
While there is agreement on the definition of specialist palliative care, 7 existing models of specialist palliative care are not characterised or reported in a consistent way. This limits the ability to compare and evaluate existing or new models. The underreporting of the components of specialist palliative care services and the inability to compare and contrast different models are well recognised8,9 and are major barriers to the evolution of specialist palliative care. 9 Once models are consistently defined, comparisons between models can more readily be made, and research can be conducted into which components of a model of care increase effectiveness and cost-effectiveness.
Specialist palliative care services are provided in a range of different settings, including hospital, home, hospice inpatient units, outpatients and day services. 10 Current research largely focuses on the effectiveness of palliative care in a specific setting (hospice inpatient, hospital or community) or in the specialty as a whole.11–13 However, specialist palliative care even within one setting (hospital, hospice or home) is delivered in a wide range of different ways.5,14–16 Therefore, studies on effectiveness of one setting or the profession as a whole include diverse teams that provide specialist palliative care in differing ways, including offering a variety of interventions, skill mix, the patient population they see and frequencies of visit. 12 More work is needed to test the specific components of palliative care team activity and to discover which configurations or components are most clinically effective and cost-effective. 12 It is therefore important that specialist palliative care services can consistently define their models of care, 5 to develop the foundational work that will allow for comparisons between models and will enable further research into effectiveness of different models. 12
We therefore aimed to identify the core components that characterise and differentiate existing models of specialist palliative care in the United Kingdom.
Methods
This study employed a mixed-methods design and was conducted in three stages: (1) semi-structured interviews to derive criteria from a range of established and innovative existing models of UK specialist palliative care, (2) Delphi study with expert consensus to identify any missing criteria, refine the criteria derived from Stage 1 and rank them in terms of overall importance, and (3) structured interviews with hospice inpatient, hospital advisory, and community team leads to test and refine the criteria derived from Stages 1 and 2. This study was UK based and may not apply to other countries, although it could provide preliminary criteria as a basis for a similar study elsewhere.
Stage 1: semi-structured interviews
A rapid scoping review (Supplemental Appendix 5) was conducted to identify literature related to models of palliative care. Original papers and reviews were examined for possible criteria that could help define models of specialist palliative care and a topic guide was created covering the 28 preliminary criteria identified from this literature (Supplemental Appendix 1). Semi-structured interviews using the topic guide (Supplemental Appendix 1) were conducted with 14 palliative care service or team leads from eight organisations discussing 12 settings of care (five hospice inpatient units, two hospital advisory teams, and five community teams). These organisations were taking part in a programme of research – C-CHANGE – that aims to develop and validate a case-mix classification for palliative care in the United Kingdom (funded by the National Institute for Health Research (NIHR) RP-PG-1210-12015). These organisations had been selected to be nationally representative in terms of the populations served. Participants consented to be interviewed and recorded. The interviews were begun by asking participants whether they could describe how care was provided in their own service(s) (Supplemental Appendix 1, Prompt 4). The questions on the interview guide were used as prompts. Audio recordings of the interviews were analysed, using thematic content analysis to identify all the criteria that were discussed in the interviews to characterise the various models of specialist palliative care. Two researchers (A.F. and S.O’B.) independently analysed the interviews, results were compared and – where there was disagreement – discussed with a third researcher (F.M.) until consensus was reached. These criteria were then used for Stage 2.
Stage 2: Delphi study
We selected the Delphi survey method for this second stage as it enabled us to present potential criteria derived from Stage 1 to all respondents, allowed them time to absorb this complex information at their own speed and enabled us to sample a wide range of views in a way which allowed for all opinions to have equal weight. A two-round Delphi survey of UK clinical, policy or patient/public involvement leads were invited from the OACC (The Outcome Assessment and Complexity Collaborative) network (a multidisciplinary network of professionals engaged in the implementation of outcome measures in specialist palliative care in England – see www.kcl.ac.uk/nursing/departments/cicelysaunders/research/studies/oacc/index.aspx), and the national NIHR-funded project C-CHANGE sites (RP-PG-1210-12015). Participants were told that we were aiming to establish a list of key criteria to describe and compare models of care. The Delphi study was conducted to refine the criteria from Stage 1, to identify any additional criteria, to achieve consensus on how each criterion was defined and to rank the criteria in terms of importance. The Delphi method was chosen as it is a widely known method for group decision making, 17 allowing for a range of views without undue dominance from any participants (important when the status and seniority of participants are varied). CREDES (Guidance on Conducting and REporting DElphi Studies) in palliative care were followed. 18
An online survey was developed using Bristol Online Survey. 19 The survey was piloted for face validity by four palliative care clinicians (non-participants) prior to the survey going live. Email invitations were sent out and participants received a description of the Delphi study and instructions on how to access the online survey. Consent was assumed for any participant who chose to reply to the survey. Each round of the survey remained open for 2½ weeks and one reminder email was sent for each round of the survey a week before the survey closed.
Delphi Round 1: evaluation of preliminary criteria
In the first Delphi round, panel members were presented with a list of 34 criteria from Stage 1. Participants were asked to state whether they agreed with the inclusion of each criterion as important for describing and comparing models of specialist palliative care (yes/no/don’t know) and their reasons for this. Participants were advised that we aimed to reduce the list of components to those that were most useful to characterise and compare models. They were also asked to comment on the phrasing and clarity of the criterion, as well as the answer options listed. Finally, participants were asked to suggest any additional criteria they thought should be included.
Responses were analysed and collated, and each criterion was retained if at least 75% participants agreed ‘Yes’. Data were collated and analysed using IBM SPSS version 22 using descriptive analysis (frequencies). Free-text comments were analysed using content analysis and used to refine and expand the set of criteria.
Delphi Round 2: feedback and ranking
In Round 2 of the Delphi process, participants received anonymised feedback from Round 1 and the amended list of criteria for further refinement and ranking. Participants were asked to rate the importance of each criterion for characterising and comparing different models of care on a 5-point Likert-type scale (1 = not at all important; 2 = not very important; 3 = important; 4 = very important; 5 = extremely important). In addition to the rating scales, participants were also given the opportunity to add additional free-text comments to help refine criterion and answer options.
Responses were analysed to capture both central tendency (median rating) and dispersion (interquartile range (IQR)). Consensus was deemed to have been reached for criteria that received aggregated responses with an IQR of ⩽1 and a median of 4 or 5. Both methods are considered to offer robust measurements for Delphi surveys.20,21 Criteria reaching this consensus were then included in the final set.
Ranking responses were collated and analysed using IBM SPSS. Free-text responses underwent content analysis and were used to refine the criteria and response options.
Stage 3: structured interviews to test for acceptability and feasibility
The criteria developed from Stage 2 were then tested with clinical leads from three different specialist palliative care settings (hospice inpatient, hospital advisory teams and community) settings, using structured interviews. These were the same organisations taking part in the C-CHANGE programme of research (funded by the NIHR RP-PG-1210-12015) that had participated in Stage 1, although 18 months passed between conducting Stage 1 and Stage 3 interviews, and some leads and services (especially in community settings) had changed. Participants consented to be interviewed and recorded. Results from these interviews were entered into Excel to identify whether criteria were able to discriminate between services.
Ethics
Ethical approval was received from King’s College London (LRS-15/16-2449).
Results
Stage 1: semi-structured interviews
Semi-structured interviews were conducted with 14 service leads, from eight organisations, discussing 12 settings of care (five hospice inpatient units, two hospital advisory teams and five community teams). Interviews were median 72 min (range = 48–101 min).
An early finding was that the clinical leads struggled to know at which level within the organisation to describe their models of care: ‘Sorry, which bit of our service do you want us to describe? There’s so much of it here and it’s all run quite differently’ (Interview 3). It was often confusing when an organisation covered multiple settings of care (i.e. hospice inpatient, community, hospital inpatient, day services) and also provided multiple services within each setting, which often overlapped. For example, a hospice may have inpatient hospice, homecare and ambulatory settings. Within any one of these settings, multiple services or teams were often running. Within the day services, there may be a physiotherapy clinic, a lymphoedema service, and a day service, all operating with different models of care. Figure 1 was therefore developed after the first three interviews to help facilitate understanding and guide subsequent interviews.

Defining multiple models of specialist palliative care within one organisation.
After all interviews were completed, from the 28 criteria in the topic guide, 11 were removed as not reported as useful; 17 criteria were refined; and a further 17 criteria were created. This resulted in 34 criteria to take forward into Stage 2 (see Table 2).
Stage 2: Delphi survey
Delphi Round 1 (assessing eligibility of criteria)
A total of 190 participants were invited to take part in the Delphi survey. Of the 190 clinical, policy and patient/public involvement leads contacted, 54 agreed to participate (response rate = 28.4%). Demographic details of participants who took part in Delphi Rounds 1 and 2 are shown in Table 1.
Demographic information for Delphi Round 1 and Round 2 respondents.
Removal of seven criteria
Results of Round 1 are presented in Table 2; of 34 criteria, six were removed due to not reaching the 75% consensus rate (Criteria 3, 9, 11, 14, 17 and 34). After analysing respondents’ free-text comments, it was further agreed that Criterion 10 (multidisciplinary team meetings) would also be removed (five participants had interpreted the criterion differently, and two further participants had not understood it. Multidisciplinary team meetings/discussions were also reported by some respondents as ‘standard’ for all specialist palliative care teams, and it was felt this criterion would not therefore discriminate between different models of care).
Delphi results.
IQR, interquartile range; MDT, multidisciplinary team.
Refined criteria from previous round.
New criteria based on feedback from Round 1.
Addition of seven new criteria
After reviewing responses to the final question of the survey, ‘
Delphi Round 2 (ranking of criteria)
Thirty participants (of 54 in Round 1) completed Round 2 (60% response rate). The 34 revised criteria were ranked and rated, and criteria not meeting the predetermined consensus level were excluded. Sixteen criteria reached consensus (Table 3). These 16 criteria included setting, type of care, size of service, diagnosis, disciplines, mode of care, types of interventions, out-of-hours referrals, out-of-hours service times, disciplines of out-of-hours care, mode of out-of-hours care, type of out-of-hours care, external education, outcomes and experience measures, standard bereavement follow-up and provision for complex grief.
Final agreed criteria to define models of palliative care.
Stage 3: structured interviews
Interviews were conducted with 21 service leads from 19 different services (six hospice inpatients, four hospital advisory and nine community settings). The responses to each criterion were compared to see whether the criteria could distinguish and discriminate effectively between services (see Tables 4 and 5). A further four criteria relating to context were also added; these were felt to be important by the clinical leads for the practical application of the criteria and to ensure a more thorough representation of the context for each model of care. These four ‘contextual criteria’ were the purpose of the team, who funds/manages the team, ability to self-refer, and discharge of patients (Supplemental Appendix 2).
Comparing services models of care Criteria 1–9.
OOH, out of hours.
Comparing services models of care Criteria 10–17.
OOH, out of hours.
Discussion
This is, to the best of our knowledge, one of the first attempts at deriving empirical criteria that may be used to define and distinguish different specialist palliative care models. Using mixed methods, we have developed a set of criteria from these primary data to characterise and distinguish different UK specialist palliative care services (including setting, type of care, size of service, diagnoses accepted, disciplines, mode of care, types of interventions, out-of-hours characteristics, external education provision, use of outcome/experience measures, bereavement provision, plus the purpose of the team, who funds/manages the team, ability to self-refer, and discharge processes). These criteria capture the key
It is important to note, however, that these criteria should
Palliative care services until now have often been described simply in terms of their place of delivery, receiving care at hospice, hospital, ambulatory unit or in the community, with very limited description of their varying components. More detailed description of the models of care components are needed due to the large variation in service provision. 10 Bainbridge et al., 8 in their review of systematic reviews of community end-of-life care, do report which components are most strongly associated with positive outcomes. Of note, core elements (a holistic care model, end-of-life training and multidisciplinary care) were most strongly associated with positive outcomes. However, this may simply reflect the limitations of the evidence, with models of care rarely reported in the evidence. Having criteria to define models of UK specialist palliative care will enable researchers to conduct evaluations of various models of care and compare the effectiveness and cost-effectiveness of different models to determine which elements work best (and most cost-effectively). It will also enable specialist palliative care services to clearly define their services and consider the similarities and differences between the services they offer and other providers.
The strengths of this study are that it has sought expert consensus from ‘real world’ professionals to identify the key criteria to characterise and differentiate these highly varied models of specialist palliative care. It has also used a sequential mixed-methods approach to painstakingly build a model framework – step-by-step – using empirical data. As recommended, we used the Delphi process to ‘explore or expose underlying assumptions or information’ and to ‘seek out information’ and ‘correlate informed judgements’. 17 We also followed the recommendations of recent guidance on conducting and reporting Delphi studies in palliative care, 18 including justification for our choice of Delphi, detail of the process, definition of how consensus was defined/reached, piloting, and reporting steps. We have not had external validation. Other limitations are that this study is UK based and may not apply to other countries (although it could provide preliminary criteria as a basis for a similar study elsewhere). The response rate to the Delphi study was low, and dropout for Round 2 of the Delphi was high; however, this was not surprising due to the participants being clinical staff and the considerable time and engagement required from participants to complete the Delphi.
Conclusion
Until now, there has not been a clear set of criteria to define models of UK specialist palliative care, making it challenging to compare different models of care provided by services. This paper identifies 20 criteria to characterise and differentiate models of specialist palliative care – a major paradigm shift to enable accurate reporting and comparison in practice and research.
Supplemental Material
858237_supp_mat – Supplemental material for Establishing key criteria to define and compare models of specialist palliative care: A mixed-methods study using qualitative interviews and Delphi survey
Supplemental material, 858237_supp_mat for Establishing key criteria to define and compare models of specialist palliative care: A mixed-methods study using qualitative interviews and Delphi survey by Alice M Firth, Suzanne M O’Brien, Ping Guo, Jane Seymour, Heather Richardson, Christopher Bridges, Mevhibe B Hocaoglu, Gunn Grande, Mendwas Dzingina, Irene J Higginson and Fliss EM Murtagh in Palliative Medicine
Footnotes
Declaration of conflicting interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This article presents independent research funded by the National Institute for Health Research (NIHR) under the Programme Grants for Applied Research scheme (C-CHANGE RP-PG-1210-12015) and the NIHR CLAHRC funding scheme, through the Collaboration for Leadership in Applied Health Research and Care South London (NIHR CLAHRC South London) at King’s College Hospital NHS Foundation Trust. The C-CHANGE research team acknowledges the support of the National Institute of Health Research Clinical Research Network (NIHR CRN). The views expressed in this article are those of the author(s) and not necessarily those of the National Health Service, the NIHR, or the Department of Health and Social Care.
Supplemental material
Supplemental material for this article is available online.
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
