Abstract
Chronic breathlessness is highly distressing for people with advanced disease and their informal carers, yet health services for this group remain highly heterogeneous. We aimed to generate evidence-based stakeholder-endorsed recommendations for practice, policy and research concerning services for people with advanced disease and chronic breathlessness. We used transparent expert consultation, comprising modified nominal group technique during a stakeholder workshop, and an online consensus survey. Stakeholders, representing multiple specialities and professions, and patient/carers were invited to participate. Thirty-seven participants attended the stakeholder workshop and generated 34 separate recommendations, rated by 74 online survey respondents. Seven recommendations had strong agreement and high levels of consensus. Stakeholders agreed services should be person-centred and flexible, should cut across multiple disciplines and providers and should prioritize breathlessness management in its own right. They advocated for wide geographical coverage and access to expert care, supported through skills-sharing among professionals. They also recommended recognition of informal carers and their role by clinicians and policymakers. Overall, stakeholders' recommendations reflect the need for improved access to person-centred, multi-professional care and support for carers to provide or access breathlessness management interventions. Future research should test the optimal models of care and educational strategies to meet these recommendations.
Introduction
Breathlessness affects up to 95% of people with chronic lung disease, around 70% of people with lung cancer and over 60% of people living with heart disease. 1 Breathlessness generally progresses with disease severity and becomes chronic, that is, it persists despite optimal treatment of the underlying condition and results in disability. 2 Chronic breathlessness is highly distressing and associated with considerable anxiety, disability and social isolation. 3 It can result in disrupted sleep and high levels of stress and burden for informal carers of people with breathlessness. 4 This is often compounded by additional and interacting symptoms experienced alongside breathlessness such as fatigue, anxiety and cough 5,6 and the frequent presence of co-morbidities.
Rehabilitation services, for example, pulmonary rehabilitation, can aid management of breathlessness through exercise, education and behavioural interventions. 7,8 However, lack of referral, 9 potential stigma, restricting symptoms and health deterioration can prevent participation in some patients. 10,11 Recently, breathlessness-triggered services that focus on holistic assessment, multi-professional care, education and psychosocial support have been shown to improve outcomes for people with chronic breathlessness in advanced disease. 12 However, the operation of such services remains highly heterogeneous with regard to structure and delivery. As such, there is limited consensus around optimal practices to support people living with chronic breathlessness in advance disease and their informal carers.
As multiple specialities (e.g. respiratory, cardiology, oncology, palliative care) and professions (e.g. health and social care, voluntary sector, research) have expertise relevant to supporting people living with chronic breathlessness in advance disease, it is important to incorporate a range of perspectives in guiding future practice. While commonly used, nominal group and survey techniques have been criticized for lacking transparency, reliability and opportunities for clarification. 13 The Delphi technique overcomes these issues, but it can be time-consuming with multiple rounds of consultation, and the initial content can be shaped by a minority. In response, transparent expert consultation (TEC) methods have been developed 13,14 and used successfully to generate recommendations in palliative and end-of-life care research. 15 –19 The TEC process involves structured opportunities for expression of views at a face-to-face meeting (similar to nominal group technique), followed by consideration of generated recommendations in a wider consensus survey (similar to a single-round Delphi technique), to enable rapid consultation of multiple key stakeholders. We therefore aimed to generate evidence-based recommendations for clinical practice, policy and research around services for people living with chronic breathlessness in advanced disease, using TEC.
Methods
Design
TEC 13,14 methods were used, comprising a modified nominal group technique during a stakeholder workshop and an online consensus survey (Figure 1).

Transparent expert consultation.
Participants
People representing different specialties, professional groups, service providers and service commissioners involved in caring for people living with chronic breathlessness, including voluntary sector organizations and patient and carer representatives, were purposively invited by email to participate in the stakeholder workshop. Participants were identified through contact lists of people and organizations held by the authors, additional recommendations from these participants and online literature and website searches. All who were invited to participate in the workshop were also invited to complete the online consensus survey. Additional individuals from groups who were less well represented in the workshop (e.g. patient and carer representatives) were purposefully selected using the above-mentioned methods and invited to complete the online consensus survey.
Procedure
Identifying critical issues
Critical issues in relation to services for people with chronic breathlessness in advanced disease were identified through a systematic review
12
examining the components, outcomes and recipients’ experiences of holistic breathlessness services. Review findings were discussed within our project advisory group (PAG: comprising researchers, clinicians and service user representatives), which led to the identification of three critical questions to discuss during the stakeholder workshop: (1) How do we define and deliver ‘holistic breathlessness services’? (2) How and where can holistic breathlessness services be integrated into current practice? (3) How should the success of holistic breathlessness services be measured/monitored?
Stakeholder workshop
The workshop took place on 4 October 2017. On arrival, participants received a pack which included a reminder of the study information (first provided with the email invitation), consent forms to complete prior to the group work sessions and the workshop schedule. An artist was present throughout the event to create a live graphic recording of the discussions.
The workshop began with whole-group presentations and discussions on the following topics: defining, acceptability of and experiences of breathlessness services, rehabilitation services, care bundles and supporting informal carers of people with chronic breathlessness. Following this, participants were purposefully allocated into one of three parallel group sessions (based on expertise and to ensure diverse roles within each group) to focus on one of the critical questions. These sessions used a modified nominal group technique, facilitated and scribed by members of the research team. Following guidance prepared before the workshop, the facilitators led participants through a structured process (Table 1) and were responsible for chairing the discussion in a way that allowed everyone to contribute.
Structured process for workshop group work.
Group discussions were audio-recorded and completed response booklets were collected to provide a record. Scribes noted the top recommendations on flip chart paper in each parallel group to feedback to the whole group. The workshop closed with a summary and information about the upcoming online consensus survey.
Following the workshop, one researcher (LJB) reviewed materials generated and summarized the main themes of the discussions throughout the day, including within each parallel group. This primarily involved synthesizing common and salient points from the written notes and referring to the audio recordings where there was lack of clarity. This was summarized in a narrative and checked by other members of the research team to ensure a transparent record of the workshop discussions surrounding the development of individual recommendations.
Online consensus survey
Individual recommendations (with their rationale, ranking and grouping) were anonymized and entered into Microsoft Excel. Recommendations were categorized by two authors (LJB, MM) into clinical practice, research and policy (assigned to the predominant category where ≥2 selected) and ordered by participants’ rankings from most important to least important.
After familiarization through multiple readings, two authors (LJB, MM) undertook a process of deduplication and synthesizing similar recommendations within each category. Where further clarity was needed, the graphic recording, flip chart records, scribes’ notes and audio recordings were examined. Recommendations were not retained if they were deemed to be: replicating the existing recommendations, unclear, outside the scope (e.g. not specific to chronic breathlessness in advanced disease), redundant (e.g. practice recommendations already exist) and/or ranked low priority by the participant who wrote it. Where possible recommendations retained participants’ original language, with amendments only to enhance clarity and avoid inflexible statements (e.g. changing ‘must’ to ‘could’). 15,17 Areas of uncertainty and the final list of recommendations were discussed and revised with the PAG, who had been given a copy of all the original recommendations for transparency. This final list of recommendations was formatted into an online survey, which was piloted by a clinical academic, researcher and patient representative from the PAG to assess and improve user-friendliness and clarity.
Potential participants received a personalized email invitation, followed by two reminders, to complete the online survey. All were offered the option of receiving a hard copy of the survey with a freepost return envelope, if preferred. The survey ran from 12 February 2018 to 26 February 2018.
Survey respondents were asked to select their profession/role and area(s) of expertise, with a free-text ‘other’ option if required. Participants were then presented with the three sets of recommendations for research, clinical practice and policy and asked to indicate their level of agreement with each recommendation from 1 (strongly disagree) to 9 (strongly agree). An opportunity for free-text comments was presented at the end of each section. 14,19,20
Analysis
Survey responses were analysed using descriptive statistics (frequencies, median, interquartile range, range) to determine the levels of agreement and consensus in line with predetermined categories used in a previous study. 16 Classification of agreement and consensus is shown in Table 2.
Classification of agreement and consensus with recommendations.
IQR: interquartile range.
Free-text comments were collated within each recommendation category and analysed thematically to aid understanding of the issues raised by the proposed recommendations. 21
Ethics
Ethics approval for this study was obtained from the King’s College London research ethics committee (ref. LRS-16/17-4692). Workshop participants provided signed consent prior to the recorded discussions and booklet completion and were reimbursed reasonable travel costs for attending. Consent for the online survey was presumed through participation.
Results
Participants
Of 117 stakeholders invited, 40 registered for and 37 attended the workshop. Most participants were from the United Kingdom, two attended from abroad. Thirty-three stakeholders participated in the group work and completed response booklets (group 1 (n = 12); group 2 (n = 8); group 3 (n = 13)). Two patient representatives could not attend the event but completed a response booklet to provide their recommendations. Characteristics of participants who completed the response booklets are shown in Table 3.
Participant characteristics.a
a Workshop and survey participants could select more than one option for both sections.
b Music and mindfulness therapist.
c Rehabilitation, cognitive behavioural therapist, breathlessness/informal carers and dermatology.
Of 160 people (workshop invitees and 43 additional people) invited to take part in the online consensus survey, 74 participated, representing a 46% response rate. One invitee declined to participate, three email addresses were no longer valid, six were away until after the survey close date and 78 did not respond. Of the 74 survey respondents, 26 had previously completed a workshop response booklet.
Stakeholder workshop
Throughout the event, there were strong themes of the need for improved collaboration, integrated working and standardization. Participants acknowledged successful elements of existing practices, across multiple specialities and disciplines, which should be built upon and not duplicated. The graphic recording summarizing the group discussions is shown in Figure 2.

Graphic recording of stakeholder workshop discussions.
Group 1: How do we define and deliver ‘holistic breathlessness services’? Participants suggested that to define and deliver these services, different models of care needed to be evaluated for clinical and cost-effectiveness. These services need to be evidence-based and integrated with collection of routine data to review access and outcomes. A key component of delivery should be establishing, and upskilling a range of clinicians in, core breathlessness management skills, and supporting them to integrate this into their routine practice.
Group 2: How and where can holistic breathlessness services be integrated into current practice? Participants in group 2 also felt that upskilling clinicians in breathlessness management skills was core to integrating breathlessness services. This should include attention to both the physical and the psychological components of breathlessness, should consider ways to enable self-management and should not be disease-specific. Challenges with service integration and different approaches across different localities were noted.
Group 3: How should the success of holistic breathlessness services be measured/monitored? Discussions here centred on ensuring outcomes were patient-led, clearly mapped to service aims and psychometrically robust. Inclusion (and development) of carer-reported outcomes was also discussed. Participants felt strongly that any approach to measurement should be based on existing successful methods, should be consistent, and should be integrated with existing practices.
In total, 187 individual recommendations were generated for research, clinical practice and/or policy. Most recommendations had implications for research (n = 101), followed by clinical (n = 76) and policy (n = 41) implications (multiple categories could be selected). Synthesis of these 187 recommendations resulted in 34 recommendations for the online consensus survey.
Online consensus survey
The online consensus survey included 34 final recommendations: 10 for clinical practice, 8 for policy and 16 for research. The recommendations and the scores received in the online consensus survey are shown in Table 4, with box plots in Figure 3.
Recommendations and online consensus survey responses.
IQR: interquartile range.
aScores ranged from 1 to 9.

Box plots of online consensus survey scores.
Recommendations for clinical practice
The most strongly supported recommendations were those calling for person-centred care (C1), and drawing on multiple expertise (C2), with widest possible coverage both geographically and demographically (C3). They also included acknowledgement of the role of informal carers (C7), valuing and being able to respond to breathlessness as a symptom in its own right (C9) and sharing these skills with other professionals and informal carers (C10). This was reflected in free-text comments about the importance of holistic care, particularly acknowledging psychological concerns, and the importance of skills sharing. Participants noted that multidisciplinary working could include multidisciplinary teams or single-discipline teams with strong links to other specialities.
Despite strong agreement, there was low consensus around defining referral criteria (C4), using multiple strategies to raise awareness of breathlessness (C6) and responding to under-recognized related issues (C8). One respondent commented that referral structures should not be too rigid, as this may be a barrier where presentation to the service is atypical. The most contentious recommendation was around the option for patients to self-refer to services (C5): comments highlighted concerns around self-referral and ensuring joined up healthcare, medical record access and ensuring medications are maximized and reversible conditions ruled out. Overall comments on the clinical recommendations noted the need for better understanding of how these services would sit alongside existing practice, without duplication.
Recoomendations of policy
The most strongly supported recommendation for policy was recognition of informal carers in terms of their role, importance and support needs (P7). The remaining recommendations received high overall agreement but low consensus.
Comments highlighted contention over the utility of mapping (P1, P3) and national audit (P4, P5), questioning their benefit to day-to-day practice. Multiple comments stressed the importance of education (of the public as well as care professionals) as a priority area (P6, P8), particularly to support existing services. However, concerns were also raised around how best to achieve this in a way that learning isn’t ‘lost’ within larger education schemes. Another comment noted that breathlessness-triggered services (P2) should be developed through adapting existing services, rather than introducing something new. One participant highlighted that the policy recommendations had a strong healthcare focus, despite people with breathlessness spending most of their time outside of health services. Work to understand the role of social care and communities in supporting patients with breathlessness and their carers was suggested.
Recommendations for research
None of the research recommendations received high agreement and high consensus. The only recommendation receiving high consensus (and moderate agreement) was the need for economic modelling of breathlessness services (R9).
The remaining recommendations received low consensus, with strong (R1, R3–R7, R10, R14–R16) or moderate (R2, R8, R11–R13) agreement. Most comments suggested that low consensus resulted, in part, from inadequate definitions of the population of interest (e.g. people having unplanned admissions due to breathlessness: R7) or insufficient justification for the area of research (e.g. effectiveness for care/nursing home residents: R8). Participants commented that they also assigned lower agreement where they felt good understanding or evidence already existed (e.g. the impact of breathlessness: R1). Additional suggestions for research included the role of psychological factors, psychosocial interventions, community support and the best ways to support informal carers.
Discussion
The strongest recommendations from this stakeholder consultation centre on how clinicians provide care for people with advanced disease and chronic breathlessness. Stakeholders recommend care that is person-centred and flexible; cuts across multiple disciplines, professions and providers, and focuses on breathlessness management in its own right. This should be developed in the context of wide geographical coverage and access to expert care, supported through a focus on skills-sharing among healthcare professionals and informal carers. In line with this, participants call for clinicians and policymakers to recognize the role and potential support needs of informal carers in supporting people with chronic breathlessness.
A focus on the symptom of breathlessness and promotion of joint working was also recommended in a previous consultation exercise focused on breathlessness rehabilitation for people with chronic obstructive pulmonary disease and heart failure, 22 while the need for greater education and skills-sharing was raised in another consensus study defining chronic breathlessness. 2 It is noteworthy that multiple elements of the clinical recommendations are in line with a palliative care approach, including person-centred care, multidisciplinary input and inclusion of informal carers in the unit of care. 23 These characteristics are commonly observed in holistic services for people with advanced disease and chronic breathlessness 12 and working to build links with, or learn from, palliative care may be an efficient way to facilitate working in line with recommendations from this and previous consultations. Future work is needed to understand the variation in models of care (including core and optional components) and how best to share breathlessness management skills across individuals, professions and disciplines. This could be facilitated by the inclusion of these recommendations in future priority-setting exercises (e.g. James Lind Alliance partnerships 24 ).
Two of the most supported recommendations were around recognizing the role and importance of informal carers and, where appropriate, supporting and encouraging their participation in care. These recommendations are reinforced by recent evidence demonstrating the substantial contribution of informal carers to people with advanced disease and chronic breathlessness, 25 including that their input saves approximately two-thirds of what would otherwise be formal care costs, 26 and the impact this has on their own health and wellbeing. 26,27 Additional research is necessary to determine optimal methods of supporting informal carers of patients with breathlessness, and work is currently underway to develop evidence-based interventions. 28,29
Methodological reflections
It is a strength that participants in the workshop and online consensus survey represented a wide and relevant range of stakeholders, including patient and carer representatives. However, it may be that this diversity of expertise and knowledge of existing research led to the lower consensus around the research-related recommendations. Most participants were based in UK universities and National Health Service settings within secondary care, and a high proportion of participants were doctors and researchers. The latter partially reflects the tendency for these participants to have dual roles: 69% of the researcher participants were also healthcare professionals; 47% of doctors had additional roles (e.g. researcher, commissioner, charity organization role). Although these proportions reflect who was invited (rather than differing response rates; see the Online Supplementary Table S1), these characteristics may have biased the types of recommendations generated and made them more applicable to health and social care within the United Kingdom. The response rate to the online survey was also limited; however, it was similar to previous studies using this method, 16 –18 and all key stakeholder groups were represented.
It is notable that only a small number of patient/carer representatives attended the workshop and completed booklets. This format may be less suitable to people with severe breathlessness and/or caring responsibilities. However, having multiple service user representatives on the PAG enabled their input in the design of the workshop and synthesizing and revising the resulting recommendations. This included working closely together to ensure the recommendations were clear and understandable for people with a range of professional and personal expertise, and incorporating their suggestion to offer the opportunity to speak with a member of the research team if clarification was needed.
Having a clear, structured process incorporating focused discussion and specific questions during the workshop ensured efficient collection of participants’ views. Although face-to-face consultation techniques can be subject to bias through some participants contributing more than others in discussions, we mitigated this through providing the opportunity to submit individual written recommendations in a response booklet and primarily focusing on these responses when generating the online consensus survey. While following the full Delphi process 30 or having additional consultation rounds may have provided more opportunity to refine the recommendations, the TEC technique maximized on the multiple forms of data collected at the workshop (e.g. scribe notes, graphic recording, response booklets, audio recordings) and enabled the multidisciplinary project team to rapidly synthesize and revise the recommendations. Although a substantial part of synthesizing and revising the recommendations was completed by two researchers, the full list of original recommendations had been shared with the PAG for transparency. Importantly, individual recommendations were only removed in line with the reasons stated earlier (e.g. duplicates, low priority) and not on the basis of controversy or creativity. Moreover, this method still resulted in generally high levels of agreement and consensus, particularly around clinical recommendations. With a growing emphasis on consulting stakeholders as part of the development and evaluation of complex interventions, 31,32 this efficient method of obtaining recommendations and consensus from a diverse group of stakeholders may be increasingly useful.
Conclusions
This stakeholder consultation has generated multiple recommendations for clinical practice, policy and guidance around services for people with chronic breathlessness in advanced disease. The recommendations with strongest agreement and consensus centred on improved access to person-centred, multi-professional care and the ability of formal and informal carers to provide or access breathlessness management interventions. Stakeholders called for clinical practice and policy to recognize the role of informal carers in supporting people with chronic breathlessness in advanced disease. Future research is needed to identify and test the optimal models of care and educational strategies to meet these recommendations.
Supplemental material
TEC_Supplementary_Material - Recommendations for services for people living with chronic breathlessness in advanced disease: Results of a transparent expert consultation
TEC_Supplementary_Material for Recommendations for services for people living with chronic breathlessness in advanced disease: Results of a transparent expert consultation by Lisa Jane Brighton, India Tunnard, Morag Farquhar, Sara Booth, Sophie Miller, Deokhee Yi, Wei Gao, Sabrina Bajwah, William DC Man, Charles C Reilly, Margaret Ogden, Sylvia Bailey, Colleen Ewart, Irene J Higginson, and Matthew Maddocks in Chronic Respiratory Disease
Footnotes
Acknowledgements
The authors would like to thank their team of service user representatives who have provided their reflections and feedback throughout this study, their colleagues at the Collaboration for Leadership in Applied Health Research and Care North West London who helped to organize the stakeholder workshop day, Lucy Fettes, Jo Bayly and Natasha Lovell for scribing during the group work and Joel Cooper (
) for capturing the day in a graphic recording. Finally, they also thank all who participated in the stakeholder workshop, including those who agreed to be named here: Sabrina Bajwah; Noel Baxter; Jo Bayly; James Beattie; Kate Binnie; Sara Booth; Lisa Brighton; Julie Burkin; John Cleland; Patrick Doherty; Sarah Elkin; Rachael Evans; Colleen Ewart; Morag Farquhar; Kate Flemming; Marjolein Gysels; Georgia Hardavella; Irene Higginson; Natasha Lovell; Rachel Macklin; Matthew Maddocks; Vince Mak; Finbarr Martin; Dionne Matthew; Sophie Miller; Margaret Ogden; Charlie Reilly; Louise Restrick; Natasha Smallwood; Gao Wei; Jenny Wingham; Trish Winn.
Author contributions
MM and IJH designed the study, obtained funding and take overall responsibility for its content. LJB, IT and MM collected the workshop and online survey data, all authors contributed to the interpretation of the data and refining the recommendations and LJB and IT led the write-up with supervision from MM. All authors contributed to the manuscript and approved the final version.
Data sharing
Requests for access to anonymized data should be directed to the corresponding author.
Declaration of conflicting interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This study was conducted as part of a project funded by an NIHR Health Services and Delivery Research Grant (NIHR HSDR 16/02/18). The work of MM and GW was supported by the NIHR Collaboration for Leadership in Applied Health Research and Care (CLAHRC) South London; the work of MM was supported by an NIHR Career Development Fellowship (CDF-2017-009); the work of WM was supported by the NIHR CLAHRC Northwest London; and IJH holds an NIHR Emeritus Senior Investigator Award and is supported by Cicely Saunders International. The views expressed in this publication are those of the author(s) and not necessarily those of the NHS, the National Institute for Health Research or the Department of Health and Social Care.
Supplemental material
Supplemental material for this article is available online.
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
