Abstract
Background:
Over the last decades, patient-reported outcome measures (PROM) have been developed for a better understanding of patient needs. The Integrated Palliative Care Outcome Scale (IPOS) is an internationally recommended PROM in palliative care. The validated electronic version of IPOS (eIPOS) was implemented in four German specialist palliative home care (SPHC) teams for use in everyday clinical practice. Patients reported symptoms and concerns via eIPOS, which were transmitted directly to the electronic patient record of the respective SPHC team.
Objectives:
The aim of the study was to describe and explore the health care professionals’ (HCPs’) experiences regarding acceptance and use of eIPOS in clinical practice in SPHC.
Design:
The mixed-methods sequential explanatory design comprised an anonymized quantitative online survey followed by qualitative focus groups.
Methods:
The online survey asked in both closed and open questions for HCP’s experience with eIPOS. Ambiguous results from the survey were discussed in two focus groups. Survey data were analysed with descriptive and univariable statistics, and the framework approach was used for qualitative data. In a further step, we conducted integrated analysis of quantitative and qualitative results using joint displays.
Results:
All HCPs of the four SPHC teams (
Conclusion:
Successful use of ePROMs is affected by the possibility of easy integration into the teams’ different structures and processes and the HCPs’ perceptions of potentials regarding ePROM use in SPHC.
Registration
The study is registered on clinicaltrials.org (NCT03879668).
Plain Language Summary
Patient-reported outcome measures (PROMs) are short questionnaires developed to assess a patient’s health status at a particular point in time. The Integrated Palliative Care Outcome Scale (IPOS) is such a questionnaire, and eIPOS is an electronic version of IPOS. IPOS asks about patients’ symptoms and problems when they suffer from advanced diseases. We conducted this study to understand what health care professionals (HCPs) think about electronic PROMs (ePROMs) in palliative home care. We first asked the HCPs to answer questions in an online survey. Then, HCPs discussed the use of eIPOS in small discussion groups. This study design is called ‘Mixed-Methods sequential design’. We found that all HCPs used the information they received through eIPOS – some frequently and some less often. Many HCPs see potential in using ePROMs to support care. For example, because ePROMs help them to understand patients’ symptoms and problems better. However, they also pointed out that eIPOS needs technical improvement. Also, the procedures of eIPOS need to fit into the work routine of the palliative care team. The findings demonstrate the perspectives of HCPs on ePROM. These are valuable to understand how ePROM can be implemented in palliative home care. We can also learn about how to implement other digital tools in other settings of palliative care.
Keywords
Introduction
Health systems around the world are facing major challenges as the number of older people with multi-morbid conditions increases and the need for palliative care will rise. 1 To address the current challenges, variations in the quality of health care need to be approached by improving outcomes. 2 The best way to achieve this is to measure individual patient-centred outcomes. 3 Patient-reported outcome measures (PROMs) are validated questionnaires completed by patients to measure their perceptions of their own health status/well-being. 4 With the increasing adaptation of internet-enabled devices in our everyday life, electronic PROMs (ePROMs) appear as a feasible option to improve the quality of assessment and could play an important role in the development of new digital health interventions. 5 Electronic as well as classic PROMs can be used at a single point of time to support multi-perspective assessment or regularly, to measure the effectiveness of care interventions or monitor health status. Use in palliative care settings shows that (e)PROMs can potentially foster person-centredness, patient empowerment, better communication and support identification of not recognized symptoms.6–9 Exemplary instruments developed especially for palliative care include the Edmonton Symptom Assessment Scale, 10 the European Organization for Research and Treatment of Cancer Quality of Life Questionnaire Core 15 Palliative 11 or the Palliative Care Outcome Scale (POS). 12 The Integrated POS (IPOS), as a further development of the POS, is a widely recommended PROM in palliative care and validated in many languages as well as diverse palliative care setting.13–16 When palliative care patients are no longer able to provide information about their palliative care needs, IPOS can be also used as proxy tool by professionals. It covers patients’ main concerns, common symptom burden, patient/family distress, existential well-being, sharing feelings with family or friends, information received and practical concerns, in 17 items within a timeframe of 3 or 7 days. 14
Given the afore-mentioned benefits of (e)PROM use, we conducted the project Palli-MONTOR (‘Monitoring of palliative care needs in specialist home-based palliative care using an electronic version of the Integrated Palliative Care Outcome Scale’, clinical trials NCT03879668), which aims to test the electronic version of the previously validated paper-based IPOS (eIPOS) in a German specialist palliative home care (SPHC) setting.17,18 Multi-professional teams are typical for SPHC which provide end-of-life care for patients with complex symptom burden using a holistic and patient-centred approach. 19 Implementation means the systematic introduction of an innovation, using a planned process with the goal of integration into in daily care routine. 20
Despite potential benefits, implementing innovations such as ePROMs holds various challenges. Dealing with stakeholders’ resistance is one great potential barrier for the success of implementing change. 21 Thus, health care professionals (HCPs) and patients are important factors for the success of the implementation process in health care. Therefore, our study aimed to describe and explore the HCPs’ experiences of using the eIPOS in everyday clinical practice in SPHC. The objectives of the study were: (i) the effort of eIPOS use, (ii) its implications on care as well as (iii) developed routines in clinical practice.
Materials and methods
Study design
Based on the taxonomy of Creswell and Plano Clark, a mixed-methods sequential explanatory design was chosen to gain deeper understanding of HCPs’ perspective.
22
This mixed-methods study followed the guidelines for the design, implementation and reporting of findings of the good reporting of a mixed-methods study (GRAMMS).
23
First, a specially developed and anonymized online survey was addressed to all HCPs of the four SPHC teams participating in the overall project (

Study design: visual model for mixed-methods sequential explanatory approach (based on Ivankova, et al. 2006). 25
Setting and participants
Participating teams were recruited in scope of the overall study Palli-MONITOR. As SPHC provides holistic end-of-life care with symptom control and support regarding psychological, social or spiritual issues, multi-professional teams consist of nurses and doctors and partly additional professions like social workers, psychologists or physiotherapists. All provide care for adult patients with complex symptom burden, suffering from life limiting oncological or non-oncological disease. Apart from this, structure and organization of the participating teams differ widely. Two teams are located in rural and two in urban regions of Bavaria, Germany. The participating teams are working with two different software (SW) systems for documentation and administration, which offer the same functions but differ in design and workflows. For example, the button indicating that a patient usually uses eIPOS is only visible after opening the patient’s individual case report in SW1, while SW2 makes this button visible in the overview of all patients. Access to the eIPOS report sent by the patients is similar: In both software programmes, the individual case report must be opened to see the values from eIPOS. The urban teams participating in the study are using SW1, whereas the rural teams use SW2.
In both online-survey and focus groups, participants were informed about the respective parts of the study and the option to drop out at any time. Informed consent was provided via a dialog box at the beginning of the survey and with signed consent declaration of focus groups‘ participants, respectively. The study population included all 52 HPCs (physicians and nurses) of the SPHC teams, being actively involved in the use of eIPOS. All were invited to participate in the online survey. As the objective of the study was understanding professionals’ experience using eIPOS in SPHC as part of the overall study Palli-MONITOR, the basic sample was determined by the number of professionals working in the respective teams. Due to the small sample, we did not collect any information about gender, age, profession and experience to ensure anonymity in the small and highly connected German SPHC setting. Purposeful sampling for the focus groups was informed by the results of the online survey. To foster multi-perspectives in the discussion, we aimed for a diverse group composition considering the following criteria: region (urban/rural), used IT-system (SW1/SW2) and profession (nurse/physician). It was possible for HCPs to participate in both the survey and the focus groups.
Data collection
Data collection took place in April and May 2021.
Online Survey
All physicians and nurses of the four SPHC teams were invited via email to participate. The questionnaire was based on a survey used in a similar project in Freiburg, Germany. 26 Our questions focussed on the following topics, as their importance is highlighted by relevant literature: the effort of use, the ability to integrate the system and its role in daily care routine.20,27–29 The survey contained closed questions asking for the HCPs’ experiences with eIPOS in routine care and open questions to report barriers and suggestions for improvement. The survey questions are summarized in Table 1. The completion time was estimated to be about 7 min. Participants were able to skip questions and complete the survey in one or more sessions. After cognitive testing, small adjustments were made before the start of the survey. The survey was open for 4 weeks. After 2 weeks, the HCPs received an email as reminder.
Descriptive statistics.
Focus groups
Subsequently, we conducted semi-structured online focus groups to explore contrasting experiences of the participants. To counter recruitment problems, we offered two focus groups at different times of the day. The interview guide was informed by results of the online survey and covered the following topics: attitude towards eIPOS (personal and in the team), use of the eIPOS in daily care in the SPHC setting technical implementation. Two researchers moderated the groups (IBF and KH), and one researcher (SK) provided technical support during the discussion. The conversations were audio recorded and transcribed verbatim; postscripts saved information that were not captured in the audios. To ensure confidentiality, all data were anonymized.
Analysis
Data were analysed in three phases: descriptive analysis of the online survey, qualitative analysis of transcripts and postscripts of the focus groups and an integrated analysis of both quantitative and qualitative data.
Online Survey
The closed survey questions were analysed descriptively, and the absolute and relative frequencies were reported. The Chi-square test and the Fischer exact test were used to test for statistically significant differences between categorical variables. Due to the small sample size, only the Fischer exact test was reported. The objective of the univariable tests was to examine the dependence of the effort of use, frequency of use, perceived changes and software type on other factors identified in the survey. Univariable analysis was conducted with SAS Studio (SAS 9.04.01M6P110718). Qualitative content analysis was performed to examine the free-text answers, using MAXQDAv.2018.2. 30 Analytic consensus was reached through coding review by the research team (IBF, SK and KH).
Focus Groups
To analyse transcripts and postscripts, we followed the framework approach using MAXQDAv.2018.2. The framework approach developed by Ritchie and Lewis allows transparent and structured management and analysis of qualitative data. 31 After getting familiar with the data material and identifying important topics, the content is displayed in thematic charts that allow further analysis and interpretation. 32 Our thematic framework was built with both deductive codes derived from the results of the online survey and inductive codes to cover all aspects of the data. Coding reviews and discussion of disagreements in the team (IBF, SK and KH) supported consistent analysis.
Integration
For the integrated analysis of both data sets, we developed joint displays. 22 These combine the quantitative detailed results with thematically matching qualitative data. The goal of the triangulation was to elucidate the survey outcomes with our qualitative findings.
Results
The overall response rate in the online survey was 62% (32/52). Nineteen out of 32 participants (59%) used software SW2, and 12/32 (38%) participants used software SW1. One participant did not answer this question. One of the nine questions, which asked whether the IPOS could be considered a suitable basis for an ePROM, was misinterpreted by most participants. The answers referred to the implemented electronic IPOS instead of the IPOS as a suitable digital PROM instrument. Therefore, it was not included in the analysis. For an overview of descriptive survey results, see Table 1. Table 2 shows the results of the univariable analysis. In the two focus groups (FG1
Univariable analysis.
CI, confidence interval; OR, odds ratio.
ref. indicates the reference categories.
eIPOS as support tool in everyday care
All participants had opened eIPOS and looked at the patients’ statements during the project at least once (
In the discussion, professionals claimed that the free-text questions of eIPOS are of special interest for identification of unrecognized aspects. Benefits using eIPOS were mainly perceived in the identification of psychosocial issues. A total of 28 participants (88%) stated that the information sent via eIPOS was useful for their work and 23 (72%) adapted care. One HCP explained in which way he used the provided information:
eIPOS use: implications on care
Leaving
Implementing eIPOS in daily care routine
Nearly half of the survey participants (
This seems to be different in SW1 users’ team, where HCPs do not share patients among each other and are very involved in their current situation. Therefore, in this team, HCPs do not check the documentation every day. Another focus group participant from the second team using SW1 confirms this practice for his own team. The conclusion from this dialogue between focus group participants about the different routines with eIPOS in SPHC is reflected by SW2 user:
Effort of using eIPOS
The majority (
Suggestions for improvement
More than half of the survey participants (

Joint display of the integrated data: eIPOS in SPHC - suggested improvements and perceived barriers.
Focus groups provided further results about eIPOS use. HCPs revealed the advantages using eIPOS in additional settings and populations of palliative home care (see Table 3). Support from relatives was mentioned as one possibility to enable eIPOS use for patients with high symptom burden or little technical practice.
Additional qualitative results.
Discussion
To our knowledge, this is one of the first studies to describe and explore the perspective of HCPs on the use of electronic PROMs in the clinical practice of SPHC. An important finding was that all HCPs had accessed the information provided via eIPOS and had discussed the patient statements submitted via eIPOS in their teams. Many HCPs felt that patients’ distress or symptoms and palliative care needs were sometimes better recognized thanks to eIPOS. The focus groups revealed differences between the two software programmes used in the four teams. However, the software itself was not the reason for whether the introduction of eIPOS was successful in everyday care. Rather, it was due to the specific organizational structure of the clinical practice and the patients cared for in the teams.
HCPs’ perception on ePROM in (specialist) palliative home care
The results of the online survey highlighted that all HCPs reviewed the information provided through eIPOS. However, the online survey and focus groups showed that not all managed to check eIPOS regularly. Nevertheless, compared with other results, our findings show a relatively good compliance of HCPs using ePROM. Taarnhøj
Effort of using eIPOS and integration of eIPOS into the daily care routine
While former studies described PROM use as time-consuming,35,36 our results regarding cost–benefit assessment were more divers. Most HCPs estimated the effort for the use of eIPOS as low. However, almost half of them stated that the benefit–effort ratio was not appropriate. As eIPOS realization differed between the two software systems, we tested association between perceived effort and documentation system. While we found no statistical significance here, documentation system proved to have a statistically significant influence on benefit-effort relation (in favour of SW1). In addition, the focus groups revealed that display of the submitted eIPOS in the patient record was an important aspect in the perception of HCPs. Nevertheless, our findings conformed the perceived effort of use to be an important factor that should be considered in the implementation of ePROM. For example, HCPs perceiving effort as low had a 16 times higher chance to interpret eIPOS values as helpful. This is consistent with former studies, showing that natural integration of PROMs’ feedback might reduce perceived effort. 27 Furthermore, the results of the focus groups showed that the respective organizational structure and workflows in the teams are very important aspects for the successful integration of eIPOS. While the two teams using SW1 reported that they do not check documentation records on a daily basis, one team using SW2 stated the opposite, due to the completely different workflows. Therefore, there was the opportunity for them to check the transmitted eIPOS values regularly. The other team using SW2 worked with a closely integrated home care team. As a result, this team mainly supported patients in crisis situations who were not able to use eIPOS. Therefore, the team rarely had the opportunity to become proficient in its use. Grol and Wensing explained that implemented changes must also fit into the existing workflow. 20 These results confirm previous studies that found the key factor for successful implementation of (e)PROM to be the smooth integration into organizational structures 34 as well as the perceived effort.27,29,33,35
Implications of eIPOS on care
Focusing on the setting of SPHC, our study underpins results of previous studies describing more benefits of PROM use, for example, regarding support of recognition of patients’ symptom burden and needs as well as improvement of communication with the patients and care.6,9,13,37,38 In our study, some respondents indicated that they noticed an improvement in the communication in the team. This result is also consistent with former findings. 39 In the focus groups, HCPs identified a main benefit of eIPOS as tool to address and integrate psychosocial issues even more. This seems to be especially relevant, as participants stated that this aspect of holistic care tends to be neglected for the benefit of physical symptom burden in a crisis-ridden care situation. In a previous study, HCPs without experience with the ePROM stated in an interview that they doubted the suitability of this standardized assessment for psychosocial issues. 40 These concerns have been eliminated by our findings. HCPs who noticed improvement in patients’ quality of life using eIPOS were more likely to see better identification in both patients’ burden and symptoms and palliative needs.
Suggestions for improvement and perceived barriers
HCPs saw a need for improvement, especially in the technical implementation of eIPOS information in the patient record. In line with other studies, our data primarily support that the electronic implementation of PROM promotes effectiveness – assuming that the technical design meets the individual needs of the setting.26,41–43 However, adjusting technical issues does not help to overcome all setting specific barriers: our results confirm that many patients in SPHC might be too ill for (e)PROM use, as seen already in former research.13,38 Summarizing our results, most participants saw the potential of ePROM use in home-based palliative care – as far as it is technically easy to handle and can be easily integrated into daily work. An impressive and novel result is the connection between the different structures and processes of clinical practice in the participating teams and the HCPs’ perceptions of potentials regarding ePROM use in SPHC. HCPs suggested using eIPOS in home-based palliative care with less ill patients, involving general practitioners and family caregivers.
Strengths and weaknesses
Due to the small sample of professionals and the close contact between the research team and the participating teams, age and gender were not indicated in the online survey to ensure anonymity. As a result, however, important confounding factors are missing from our analysis. This must be taken into account in the interpretation. Due to the COVID-19 pandemic and prolonged high workload in the SPHC teams, recruitment for the focus group discussion was challenging – the number of participants was low. However, the mixed-methods design compensated for this weakness. Mostly, integrating the data, qualitative findings provided explanation and deeper understanding of the quantitative results. Nevertheless, some contradictory results of the survey and focus groups could not be clarified with the available data. One reason could be that the survey was open to all HCPs who have experience with eIPOS, while participation in the focus groups was only possible for a few. As our results about professionals’ perspectives on ePROM use in palliative home care are based on a feasibility study of eIPOS in SPHC, some detailed findings are context and setting specific, for example, when addressing explicit organizational structures of SPHC or eIPOS-specific content. However, our general results about ePROM use in palliative home care can be also partly transferred to provide starting points for further research using alternative tools in different settings or populations of palliative care.
Conclusion
Successful use of ePROM is crucially affected by the possibility of naturally integrating the system into the existing workflow. As the structure of SPHC in Germany is extremely diverse, we found varying HCPs’ perspectives on eIPOS. In some teams, structural and organizational issues mean that patients can only be cared for in SPHC in acute crisis and only shortly before they die. Introducing ePROM in this condition is disadvantageous; therefore, HCPs participating in our study recommend the use of ePROM in earlier stages of palliative home care or supported by relatives. On a policy level, equalization of SPHC framework conditions would be desirable.
Supplemental Material
sj-pdf-1-pcr-10.1177_26323524231186827 – Supplemental material for Implementing ePROM in specialist palliative home care: the professionals’ perspective – a mixed-methods study
Supplemental material, sj-pdf-1-pcr-10.1177_26323524231186827 for Implementing ePROM in specialist palliative home care: the professionals’ perspective – a mixed-methods study by Isabel Burner-Fritsch, Stefanie Kolmhuber, Farina Hodiamont, Claudia Bausewein and Katerina Hriskova in Palliative Care and Social Practice
Footnotes
Acknowledgements
The authors would like to thank all participants of the study for taking their time supporting our research. Many thanks to the project team MySupport, Department of Palliative Medicine, Medical Centre, University of Freiburg, for supporting us.
Declarations
Supplemental material
Supplemental material for this article is available online.
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
