Abstract
Background:
The American Association of Colleges of Nursing introduced hospice/palliative/supportive care as a focus area for baccalaureate nursing and identified pre-licensure competency-based education as essential for a safe and effective entry-to-practice nurse workforce. Yet many nursing educators lack knowledge and skills to teach competency-based primary palliative care (PPC).
Method:
We piloted an educational intervention for baccalaureate nursing faculty in developing a competency-based PPC learning activity. The intervention consisted of workshops during which pre- and posttest data were collected. Intervention materials included an open-access PPC faculty resource Guide and a Learning Activity Template developed by the first author.
Results:
Paired samples t tests demonstrated significant knowledge gains and changes in attitudes post-intervention in 17 of 20 areas assessed including “I am confident in my ability to teach nursing students about end-of-life care.” There was a statistically significant increase in the total palliative care score (all 20 areas assessed) from pretest (M = 70.25, standard deviation [SD] = 9.54) to posttest (M = 80.40, SD = 10.10), t (39) = 9.18, p < 0.001 [two-tailed]). The Cohen’s d statistic (1.45) indicated a large effect size. Additionally, over half of the participants created unique learning activities (n = 22) for teaching competency-based PPC.
Conclusion:
This intervention addresses a faculty need in the context of new accreditation expectations. The open-access intervention materials shared in this article can be used to create course learning activities aligned with nursing needs for competency-based PPC. Future research should focus on effective faculty teaching interventions and reliable and valid assessment tools for faculty needs and student competency.
Introduction
In 2021, the American Association of the Colleges of Nursing (AACN) released a revised Essentials document to guide quality and provide standards in nursing education programs. Major changes included a competency-based education (CBE) focus and a new requirement that baccalaureate nursing students demonstrate competency in hospice/palliative/supportive care. 1 To meet the new Essentials standard of integrating hospice/palliative/supportive care into curriculum, faculty require access to evidence-based resources and knowledge of how to teach primary palliative care (PPC) according to national standards and CBE principles. 1
Palliative care is the provision of supportive interdisciplinary services to address and ameliorate discomforting symptoms for persons with serious illness of any age and in any setting. The intention is to promote physical, psychosocial, emotional, and spiritual well-being and interventions that are aligned with patient and family values. Palliative care is considered specialty health care and can be provided concurrently with curative interventions. Hospice care is a part of palliative care and focuses on symptom management and quality of life for persons with a prognosis of six months or less, and who are not pursuing curative treatments, or there are no further curative treatment options.2,3
PPC nursing applies holistic assessment and intervention to relieve suffering and improve quality of life across the lifespan, illness trajectory, and setting and can be delivered by nonspecialty nurses.2,3 The World Health Organization declared that all health care systems are ethically responsible for providing palliative care. 4 However, palliative care is not equitably available across clinical settings or communities. For example, rural communities with small hospitals are less likely to have palliative care than in urban areas.5,6 Good communication plays a key role in palliative care provision. Palliative communication competency includes asking patients questions about what matters most to them, what they would prioritize if they become sicker, or assisting in identifying a surrogate decision-maker and choices for end-of-life care. Without palliative care, patients may experience preventable or unwanted hospitalizations for symptom management or illness exacerbations. 6 When nurses have education and experience in using palliative communication, clarification, and congruence of patient values and treatment can reduce emotional burden for patients, families, and nurses.7–9 This is notable because nurses across practice settings have been challenged to meet PPC needs for patients with serious illness. 2 The American Academy of Nursing Expert Panels made recommendations for improving palliative care access internationally, including expanding palliative care nursing education and nurses educating interdisciplinary colleagues, the public, and policy makers about positive patient and family outcomes of palliative care. 10 However, nursing education programs have been slow to integrate PPC. The End-of-Life Nursing Consortium (ELNEC) reports that ∼135 of 996 baccalaureate nursing programs in the United States offered standardized PPC education from 2021 to 2023.11,12 Challenges to integration of PPC content in nursing education include a general PPC faculty knowledge gap and a paucity of resources for educating faculty to teach and incorporate PPC content. Thus, prelicensure faculty education and training interventions are needed to meet this call for PPC nursing.
The foremost resource for teaching pre-licensure nursing students PPC has been the ELNEC Undergraduate/New Graduate online curriculum. 13 These evidence-based textual modules, videos, quizzes, and tests were developed and revised by palliative/hospice care nurse experts in alignment with PPC competencies outlined in the Competencies and Recommendations for Educating nursing Students (CARES).14–16 More than 150 nursing programs in the United States have used the ELNEC modules which are free for nursing faculty and charge students a modest fee. 11 The ELNEC modules provide a strong introduction to evidence-based PPC, focusing on knowledge, one element of CBE. 11 However, an important gap between ELNEC undergraduate/new graduate and student achievement of PPC competencies is the lack of leveled CBE learning activities, critical to the development of student competency over time. Competency is evident when nursing students embody what nurses do by synthesizing knowledge, skills, and attitudes, rather than identifying what it is that nurses know.17–19
Since existing PPC materials are largely knowledge versus competency based and knowing that PPC competencies need to be threaded throughout the curriculum, nursing educators without PPC expertise require guidance in developing scaffolded CBE PPC course materials. To meet this need, the first author developed an educational intervention for faculty about best-practice resources in PPC and developing a PPC CBE course learning activity. A guidebook, Integrating the AACN Hospice/Palliative/Supportive Care Sphere in Undergraduate Nursing Education: A Practical Guide for Faculty, hereafter referred to as the Guide, was used during workshops to orient faculty to PPC resources that can be integrated into courses. 20 To our knowledge, this was the first faculty-focused intervention used to build PPC teaching and CBE capacity in baccalaureate nursing education using a standardized faculty education module and resource guide for the development of a learning activity. 21 This article reports the results of piloting the faculty intervention which also included education about CBE, the Essentials, 1 and palliative care definitions.
Methods
Design
This study was an education intervention pilot program with a descriptive pretest–posttest design. Data were collected from January to May of 2024 at one face-to-face workshop and two online workshops.
Participants
Faculty who taught undergraduate nursing courses were eligible. Since the intervention content was presented in English, the only exclusion criteria to participate was not being able to communicate in English. Forty participants consented and were enrolled in the study.
Setting
The intervention included in-person workshops at the authors’ school and an online option for remote attendees. Workshops were publicized via email invitations, at faculty assembly meetings, via national nursing organization listservs (AACN and HPNA), and by word-of-mouth through the first author’s professional networks, such as faculty colleagues at other universities. Study activities were conducted during the intervention workshops. For online participants, virtual breakout rooms were created to facilitate interaction during activities. Pre- and posttest surveys were administered online using Qualtrics (https://www.qualitrics.com).
Ethical considerations
The authors’ institutional review board approved this study (OUIRB-FY2023-104). Consent-to-participate was completed via an online form prior to completing the pre- and posttests. For privacy and matching of pretest and posttest survey responses, each participant created and used a unique identifier.
Procedure
Faculty were invited to participate in the educational workshop using the methods described previously; however, recruitment to complete the pre- and posttest surveys occurred during the intervention workshop welcome. Thus, study participants comprised a convenience sample of self-selected faculty at each of the three workshops. Participants completed the pre- and posttest surveys prior to the start of the workshop and at the conclusion of the workshop respectively. In-person workshop participants received continuing education credits as compensation, whereas virtual participants could opt into a drawing to win one of four palliative care textbooks.
The study intervention consisted of a one-time, three-hour-long interactive workshop to educate faculty about evidence-based, no-cost educational resources in PPC and to develop a PPC CBE course learning activity. Workshop content included a review of the Essentials and competencies/sub-competencies related to PPC, 1 introduction to the Guide, 20 and a Learning Activity Template. 21 The primary goal of the workshop and study outcome was to aid faculty in developing a competency-based learning activity for their course which met Essentials competencies/sub-competencies. 1 The Learning Activity Template was the documentation tool used to determine whether this outcome was achieved. 21
An internal Oberhauser Award from the Oakland University School of Nursing paid for workshop materials, which remain available in perpetuity as open-source digital documents and videos.20–22 The workshop content was developed by the first author, a board-certified hospice and palliative care nurse, holding a teaching certificate in nursing education and with experience teaching interdisciplinary clinical palliative care. The first author presented the workshops three times, using a standardized script. The first workshop was in-person for faculty at the authors’ institution. Two co-authors were participants in the faculty workshop (J.A.K. and T.L.G.). The second and third workshops were presented via a synchronous online platform. The workshop format was a live slide presentation with the instructor on camera. The agenda was as follows: introduction and invitation to participate in study; survey completion for study participants; review of objectives; participation question: “What do you think of when you hear palliative care’?” with chat responses; formal definitions of palliative care and hospice mini lecture; overview of AACN Essentials 1 mini-lecture; chat-based poll “What do you know about ELNEC CARES14,15 competencies?”; example of integrated CARES14,15 and Essentials 1 domain/competency/subcompetency; breakout room exercise one (10 minutes to identify a domain/competency/subcompetency for use in learning activity); breakout room exercise two (20 minutes to look over the Guide 20 and select a topical area and resource to use in learning activity development); CBE mini-lecture; breakout room exercise three (60 minutes to work independently developing a learning activity using the Learning Activity Template 21 ); large group discussion participant sharing of content developed in breakout sessions; posttest survey for study participants; workshop conclusion. The workshop remains available for use as a 3-hour self-paced online learning unit. 22
The Guide is an open-source PPC guidebook created to introduce baccalaureate nursing faculty to a wide range of learning activities and evidence-based sources. 20 All Guide resources are cost-free, enabling faculty to develop or incorporate learning activities without adding to student out-of-pocket expenses. 20 A Learning Activity Template was designed to walk participants through selecting a domain, competency, and sub-competency from the Essentials; 1 selecting a PPC topical area and resource from the Guide; 20 and developing a course learning activity. 21 Study participants were taught how to use the Learning Activity Template in three phases, each of which scaffolded on the previous phase content (e.g., first selecting an Essentials domain, 1 then selecting a content topic and Guide resource, followed by developing a unique learning activity).20,21
Instruments
The first author developed surveys based on the objectives of the workshop to assess faculty’s knowledge and attitudes/beliefs about PPC and perceived ability to teach PPC nursing. The pretest and posttest surveys included 20 identical items. To ensure face and content validity of the tools, the initial pre- and posttest surveys were revised based on input from three baccalaureate nursing faculty who maintain hospice and palliative nurse certification. Reliability was tested prior to the implementation of the survey with 22 baccalaureate nursing faculty at the authors’ institution, and the surveys were determined to have good reliability (Cronbach’s alpha 0.908) (O Ehrlich & K Moxley, 2023, unpublished data). For this study, the pretest Cronbach’s alpha = 0.821 and the posttest Cronbach’s alpha = 0.919.
An additional three questions on the pretest survey elicited specialty training, previously taught PPC course content, and PPC teaching needs. Ten additional items on the posttest survey related to the usefulness of the workshop and Learning Activity Template are listed in Table 1. 21 Additionally, demographic data were obtained including participant educational background, institution name and location, and previous formal or informal education, training, or life experiences with palliative care.
Pretest and Posttest Survey Items for Helpfulness and Learning Activity Development
CBE, competency-based education.
An a priori power analysis was conducted using an online statistical calculator, Statulator, by Dhand and Khatkar. 23 The sample size needed to achieve 80% power for detecting a medium effect and a significance level of α = 0.05 was n = 34. Therefore, our sample size of n = 40 is adequate to test our hypothesis.
Analysis
Data were analyzed using IBM SPSS software (version 29). Only 0.49% of pretest and 1.34% of posttest items were missing from the dataset because they were unanswered. A nonsignificant Little’s MCAR test, χ2(76) = 90.90, p = 0.117 (pretest) and χ2(66) = 46.05, p = 0.971 (posttest) revealed that the data were missing completely at random. 24
When <5% of data are missing and if these data are missing completely at random, then imputation using variable means produces unbiased parameter estimates and is considered acceptable. 25 Mean imputation is also supported by Peng et al. who assert this method can be used when no >10%–20% of data are missing. 26 Tabachnick and Fidell additionally highlight that almost any procedure for handling missing data (if <5%) will produce similar results if the data are missing completely at random. 25 In this study, missing data were imputed using individual variable means. Variables were analyzed using counts and percentages. Paired samples t tests were used to compare differences in pre- and posttest scores. A priori content analysis was used to categorize and describe the data obtained from the open-ended survey questions.
Results
There were 66 workshop participants, representing 102 nursing institutions from 36 (72%) U.S. states. Workshop participants reported a range of terminal degrees from baccalaureate to doctorate degrees, with 44 (66%) having earned a doctorate, 21 (38%) a master’s degree, and 1 (2%) a baccalaureate degree. Specialty certification in palliative care was reported by 5 (8%) participants. Additionally, 24 (36%) attendees reported either specialty training, nursing experience, or personal experience in palliative care or pain management. No training or palliative care experience was reported by nine participants (13%) and 14 (21%) did not answer the question.
The paired-samples t test revealed 17 statistically significant pairs of results with 7 pairs of results with a Cohen’s d effect size >0.5 (but <0.8) indicating a moderate effect and 3 pairs with an effect size >1.0 indicating a large effect (see Table 2). Confidence in ability to teach nursing students about end-of-life care and in ability to define palliative care nursing both had large effect sizes as well as “I am familiar with learning materials and resources that an instructor of nursing can incorporate into coursework to discuss various palliative care nursing topics.” Additionally, the total scale score for the pretest was compared to the total scale score for the posttest with statistically significant results with the Cohen’s d = 1.43 indicating that the intervention had a large effect (Table 2).
Paired Samples t-Test Comparison of Pre- and Post- Survey Scores for Faculty Who Completed Palliative Care Trainings (n = 40)
SD, standard deviation.
Intervention completion
Intervention completion was determined by the rate of participants who reported completing the Learning Activity Template. 21 All 40 participants responded to a posttest survey item, “By participating in this workshop, I was able to develop a PPC CBE learning activity.” Totally, 22 participants (55%) selected “5-completely” for completion, with 13 (33%) responding, “4,” four (10%) responding with “3,” and one (3%) with “1.”
Analysis of Free-Text survey questions
Free text questions were phrased to gather information in the participants’ own words about challenges or needs for integrating PPC into their courses (pretest survey), the Essentials domains on which they had focused, content used from the Guide, and how the Learning Activity Template was completed during the workshops (posttest survey).1,20,21
Faculty challenges and needs
Of 40 participants who completed the pretest survey, four (10%) stated that they had no needs or challenges in incorporating PPC content into courses taught, including one certified PC nurse. Two participants (5%) identified a need for student access to clinical placements in palliative or hospice care. Twenty-five participants (63%) reported a need for faculty access to evidence-based resources and learning activities for use in live and asynchronous virtual settings. Within this 63% who reported a need, 4 participants had PC certification, 4 had completed an ELNEC training, and 2 had PC work experience without nationally recognized training. For those who were certified or had PC experience, this quote is representative of expressed needs: “I’m confident with the content. I’m not sure how to develop competency-based assessments.” Examples of other reported participant needs included lesson plans, case studies, simulations, guides for use in serious illness and advance care planning communication, competency-based assessment tools, guidance using the CARES competencies,14,15 or having an expert colleague available for consultation.
Learning activity template categories
There was variation in PPC topical content focus when participants completed the Learning Activity Template. 21 Seven of the 10 Essentials domains were used, incorporating 17 competencies and 28 subcompetencies for development of a learning activity. 1 Twenty-four Guide resources were used in 28 unique learning activities 20 ; Table 3 lists a selection of the resources used. Five examples of participants’ learning activities and the Essentials content with which they aligned are provided in Table 4.
Learning Activity Template Themes from Posttest Questions
Participant Learning Activity Template Examples
Discussion
This nursing faculty workshop intervention that reviewed hospice and palliative care definitions, basic elements of CBE learning activities, introduced faculty to the Guide, and taught participants how to use the Learning Activity Template to develop PPC CBE learning activities resulted in positive outcomes for participants.20,21 These included significant gains in knowledge about topical content essential to teaching PPC to nursing students. Additionally, participant attitudes/beliefs indicated significantly greater confidence in teaching end-of-life care and survey scores for the belief that PPC nursing education is an essential content area for prelicensure courses increased although not significantly.
When considering the wide range of workshop participant locations with 72% of U.S. states represented, it is apparent that nursing faculty across the country need guidance in locating evidence-based source materials and implementing content into baccalaureate courses. This was consistent with the self-identified needs reported by participants; only 7.5% reported specialty certification in palliative and hospice care, indicative that faculty feel the need to strengthen their teaching related to PPC. Of note, even those participants who reported confidence in teaching PPC in the pretest survey listed knowledge of CBE implementation (especially student assessment) as an area of need. Some of the needs reported in the preintervention survey had been met after participation, for example, all participants had identified a resource to use in learning activity development and several developed simulations and communication activities, which had been identified as priority needs. While we assessed a general faculty challenges question in the survey, there remains a need for a faculty PPC CBE needs assessment tool which can validly and reliably identify various types of needs. It was evident from pretest survey responses that most workshop participants did not have knowledge of or access to evidence-based resources to use in planning the integration and teaching of PPC content in their courses prior to the intervention, but there were significant gains in participant knowledge of PPC educational content after completing the workshop. Additional knowledge gains included significantly higher mean scores after the intervention workshop on understanding differences between hospice and palliative care; pain and dyspnea management; and empathetic communication. Mean scores increased but not significantly for pain and generalized symptom assessment; teaching culturally appropriate PPC; talking about dying; and discussing grief, bereavement, and loss. Faculty needs for teaching these topics would warrant further exploration. Importantly, by the end of the intervention workshop, 55% of participants had developed a complete PPC CBE learning activity, and 35% had developed most of a learning activity. All participants started the process of developing a PPC CBE learning activity.
The range of topics that participants selected for use in developing a CBE PPC learning activity is reflective of how nurse faculty comprehend the definition of palliative care—across age groups and serious illnesses, settings, and within a context of health inequities. It is also evident that as faculty participants work at home institutions to address the hospice/palliative/supportive care sphere, most Essentials domains will be represented. 1 All domains will need to be addressed at each academic program as course revisions are made; however, faculty may determine which domains will address PPC.
Nursing’s holistic approach to care is reflected in the creative and diverse ways that study participants applied the resources and knowledge presented in the intervention workshop. Study limitations include a small, self-selected, homogenous sample and a survey instrument which lacked extensive validity testing. When interpreting our results, it must be considered that study participants self-selected both attendance at the workshop which offered incentives directly relevant to their teaching responsibilities and participation in the study, and thus with a population of faculty who were not responsible for integrating PPC in their programs, outcomes may have been different. Therefore, conclusions about generalizability of the study results may be limited. Furthermore, this study was based on a single time point intervention and evaluation, so conclusions about long-term impacts cannot be made. Although study results do not necessarily represent baccalaureate nursing faculty nationally, this study lays groundwork for future research with fully powered samples and provides nursing educators with important qualitative faculty input.
Conclusion
Baccalaureate nursing faculty benefit from resources that support integration of the AACN Essentials hospice/palliative/supportive care sphere into programs and courses. 1 The ELNEC undergraduate/new graduate modules fill a niche for online knowledge-based learning for students. 13 However, faculty lack resources to use and guidance in developing CBE PPC learning activities. 12 This intervention for faculty is an important step in meeting that need. Additional challenges for hospice/palliative/supportive care CBE integration in baccalaureate nursing education include a need for a variety of learning activities across each Essentials domain as well as assessment instruments for faculty needs and student competency. 1 Research will be needed to evaluate efficacy of learning activities as well as validity and reliability of assessment instruments. This pilot study demonstrated how an intervention addressed one of these needs. Participants had positive outcomes that can influence coursework taught in the future across the United States. Importantly, and uniquely, the resources used in the intervention, as open-source digital items, remain freely available for any faculty to access and utilize.
Footnotes
Acknowledgment
The authors would like to thank Kyle Moxley for guidance in the study analysis approach.
Authors’ Contributions
O.E.: Conceptualization and methodology (lead); writing—original draft (lead); investigation (lead); formal thematic analysis (lead); and writing—review and editing (equal); J.A.K.: writing—original draft (supporting); quantitative analysis conceptualization and statistical analyses (lead); and writing review and editing (equal); A.L.: Investigation, data collection, cleaning (lead); formal quantitative analyses (supporting); demographic data (supporting); and writing—review and editing (equal); T.L.G.: Conceptualization and methodology (supporting); writing—original draft (supporting); formal thematic analysis (supporting); and writing—review and editing (equal).
Author Disclosure Statement
The authors declare no conflicts of interest.
Funding Information
No funding was received for this article.
