Abstract
Objectives:
To present the findings of a systematic review on the use of simulation-based learning experiences (SBLEs) to teach communication skills to nursing students and clinicians who provide palliative and end-of-life care to patients and their families.
Background:
Palliative care communication skills are fundamental to providing holistic patient care. Since nurses have the greatest amount of direct exposure to patients, building such communication competencies is essential. However, exposure to patients and families receiving palliative and end-of-life care is often limited, resulting in few opportunities to learn these skills in the clinical setting. Simulation-based learning experiences can be used to supplement didactic teaching and clinical experiences to build the requisite communication skills.
Methods:
Searches of CINAHL, MEDLINE, PsychINFO, ERIC, and Web of Science electronic databases and Grey Literature returned 442 unique records. Thirty articles met the established criteria, including the SBLE must contain a nursing role.
Results:
Simulation-based learning experience are being used to teach palliative and end-of-life communication skills to nursing students and clinicians. Lack of standardization, poor evaluation methods, and limited exposure to the entire interprofessional team makes it difficult to identify and disseminate validated best practices.
Conclusion:
While the need for further research is acknowledged, we recommend this evidence be augmented by training programs that utilize SBLEs through (1) applying standards, (2) clearly specifying goals and objectives, (3) integrating externally validated scenarios, and (4) employing rigorous evaluation methods and measures that link the SBLE to the training objectives and desired clinician practice behaviors and patient outcomes.
Introduction
Effective communication among members of the interprofessional team and with the patient is essential to achieving desired patient outcomes. Curricula for members of the health-care team are replete with objectives focused on developing communication skills; however, curricula that outline specific communication skills needed in palliative and end-of-life (EOL) care remain deficient. Recent national reports have emphasized the need to improve primary palliative care, including patient-centered communication, which focuses on fostering healing relationships, exchanging information, and responding to emotions, for both students and clinicians. 1 –3 As a result, educators are increasingly using simulation-based learning activities to help build critical communication skills in the clinical setting. 4 As frontline providers of care, nurses are key members of the interprofessional team. The purpose of this article is to report the findings of a systematic review designed to identify how simulation is being used to teach communication skills to nursing students and clinicians who care for patients and families receiving palliative and EOL care.
Palliative care communication skills are essential to providing patients with effective symptom management, psychosocial and spiritual support, and advance care planning. 5 For nurses, the ability to develop skills in caring for dying patients and their families is a significant professional rite of passage—one that they remember for the remainder of their careers. 6,7 As nurses develop skills in caring for dying patients, they gain more confidence in the care they provide. 8 Students who participate in palliative care immersion experiences that allow them to hone their communication skills report they feel better prepared to care for dying patients in their first year of professional practice. 9
Time constraints and limited availability of clinical settings in nursing education may not allow direct experience in palliative and EOL care for large cohorts of nursing students. Therefore, most new nurses must develop communication competencies in palliative and EOL care on the job, which is not ideal and can be unnecessarily anxiety-provoking. 10 Furthermore, nurse clinicians—who are accustomed to advocating for their patients’ needs—cite a need for more education on palliative and EOL care. 11 –13 The use of simulation-based learning may enable educators to reach greater numbers of nursing students and clinicians to foster the development of these important communications skills. 14
Simulation-based learning experiences (SBLEs) offer an opportunity to enhance students’ and clinicians’ communication skills. Simulation typically involves mimicking the real-world scenarios to provide learners with pertinent experiences under controlled or practice conditions. 15,16 The SBLEs involve a variety of simulated learning methods, including manikin-based, standardized/simulated patients or computer-based programs, virtual reality, or hybrid simulation to achieve realistic environments representative of the learner’s professional responsibilities. 17 An important concept in SBLEs is fidelity, defined as “the degree to which a simulated learning experience approaches reality.” 18 Fidelity goes beyond the manikin itself and includes environmental fidelity, conceptual fidelity, and psychological fidelity. Fidelity allows the SBLE to replicate the practice environment, typically the hospital, as closely as possible and allows learners to practice their skills in a safe environment.
In the following sections, we report the methods and findings of a systemic review of the literature for SBLE exemplars focused on palliative care and EOL communication that include the nursing role. For this article, SBLE is defined as a method of accomplishing learning goals through interacting with people, simulators, computers, or task trainers that in some way mimic or represent the real-world experiences and responsibilities, adapted from Agency for Healthcare Research and Quality’s definition. 17 The communication component of the SBLE is defined as the exchange of thoughts, messages, or information related to palliative care or EOL care through speech and behavior using actors or artifacts to represent patients, families, caregivers, or members of health-care teams.
Methods
Data Sources
The sponsoring institution’s nursing librarian, with the other coauthors of the article, performed a comprehensive systematic literature search on February 15, 2017, of the PubMed, CINAHL, ERIC, Web of Science, and PsycINFO databases. Searches of the grey literature resources—ProQuest Dissertations & Theses Global, Worldcat Dissertations and Theses, and NLM Gateway—were also performed. All search strategies included terms related to the concepts of simulation, palliative care, EOL, and nursing. The complete strategy is available upon request. No date, study, or subject filters were applied. Comprehensive details of the protocol for this systematic review were registered on PROSPERO at http://www.crd.york.ac.uk/PROSPERO/display_record.asp?ID=CRD42017058046. 19
Inclusion and Exclusion Criteria
Explicit inclusion and exclusion criteria were established to ensure a uniform selection of articles amongst reviewers. The inclusion criteria were articles that (1) described a simulated learning experience that (a) involved technology (b) was delivered to nursing students or practicing nurses (c) and focused on palliative care or EOL communication and (2) included an evaluative component. The exclusion criteria were letters, commentaries, news items, and articles not published in English. In addition, we excluded articles that did not provide a description of the sample, lacked evaluation results, or had insufficient details about the learning scenarios. These criteria excluded articles that did not provide sufficient details to determine whether an SBLE involving communication was performed and evaluated. A list of articles excluded during the full-text review phase and the rationale for exclusions are available upon request. Our final list of 30 articles includes all instances of SBLEs in which other health disciplines were either included in the scenarios or participated in the training. The list, however, does not include interprofessional SBLEs that took place without direct involvement from the nursing profession (an inclusion criteria).
Review Process
The Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) flow diagram 20 (Figure 1) lists the number of articles included during each phase of the systematic review (identification, screening, eligibility, included). The database and grey literature search identified 442 studies, excluding duplicates. During the screening phase, 2 reviewers (M.S. and T.M.) independently reviewed all abstracts for inclusion and exclusion criteria. Disagreements between reviewers were resolved through discussion and consensus (M.S., T.M., G.K.). All articles that met the inclusion criteria and none of the exclusions or had abstracts with insufficient information available to determine whether they met inclusion status were moved to the eligibility (full text) review phase. Two reviewers separately (M.S. and T.M.) evaluated 53 full-text articles during the eligibility review phase to confirm those that met all of the inclusion and none of the exclusion criteria. All discrepancies between the 2 reviewers in this phase were resolved by a third reviewer (G.K.). In total, 30 articles matched the eligibility criteria.

PRISMA flow diagram illustrating the selection process of articles.
Kirkpatrick’s Level of Evaluation
The Kirkpatrick Model 21,22 was used to differentiate the level of evaluation assessment completed for the training reported in each of the articles reviewed. The model consists of 4 levels: (1) participants responses—REACTION—to training (eg, satisfaction); (2) extent of knowledge, attitude, or skills gained—LEARNING; (3) extent to which desired behaviors are being used on the job—BEHAVIOR; and (4) extent to which desired behaviors are producing the desired outcomes in practice—RESULTS— (eg, achieving desired patient outcomes). The level of evaluation for each article is reported in the last column of Table 1.
Summary of SBLE Facets and Communication Components of Included Articles.
Abbreviations: ACE.S, Advancing Care Excellence for Seniors; ABSN, Accelerated Bachelor of Science in Nursing; BSN, Bachelor of Science in Nursing; ELNEC, End-of-Life Nursing Education Consortium; ELNEC-KAT, ELNEC-Knowledge Assessment Tool; FNP, Family Nurse Practitioner; METI, Medical Education Technologies; NLN, National League for Nursing; PC-ELNEC, Perceived Competences in meeting ELNEC standards; SBLE, simulation-based learning experience.
Results
In the 30 articles that met the eligibility criteria, the research team focused on identifying the use of SBLEs to educate nursing students and clinicians (practicing nurses) about palliative care or EOL communication. A word cloud of the review articles was generated from summaries of each article’s synthesis to provide a visual of the themes and strengths that characterized the simulation exercises described (Figure 2). The top themes included family, care, patient, EOL, symptoms, management, grief, conflict, palliative, and support. The following paragraphs summarize information from the articles that help contextualize the communication component of the SBLEs reported in the articles (Table 1).

A word cloud generated using summaries of each article included in the review. Font size and boldness of the terms increase with frequency to highlight keywords and themes of the simulation-based learning experiences.
Target Learner Audience
The undergraduate nursing student was a target learner in a majority of the articles (n = 22). 10,25,27 –36,38 –40,42 –45,48 –50 In the remaining 8 articles, the main target learners were the graduate nurse trainee, 46 the practicing nurse, 23,24,26,37,51 and both nursing students and practicing nurses together. 41,47 Other members of the health team participated (were physically present) in 7 of the SBLEs. These included social workers/students, 29,33,37,46,47,51 medical students/residents/physicians, 29,33,48,51 chaplains/students, 29 and hospice care workers. 47
Simulation-Based Learning Experience Communication Focus and Interprofessional Team Members
The specific communication content varied widely across SBLE scenarios, with the majority (n = 18) focused on EOL conversations. 10,23,26,27,32 –34,38,40 –47,50,51 The remaining 12 articles 24,25,28 –31,35 –37,39,48,49 focused on palliative care-related communication. Over half (n = 16) of the scenario conversations involved only nurses, patients, and family members. The remaining 14 included at least one additional member of the interprofessional team (eg, physician, social worker, chaplain, hospice worker). Only half of the 14 involved direct participation by interprofessional members of the team, 29,33,37,46 –48,51 for the other half these roles were played by actors. 10,23 –26,30,44
Debriefing
Debriefing was a central element of nearly all (n = 28) simulation exercises. Debriefing methods included videotaped session review, simple question and answer sessions, guided questions, reflective sessions, and the use of published debriefing guides (eg, Debriefing with Good Judgement). 52 Nursing faculty typically facilitated the debriefings but actors, registered nurses, and emergency room residents also coled these sessions.
Technology
High-fidelity simulators were the most common technology used in the scenarios (n = 21) or medium-fidelity manikins 33 though details were limited. Most authors indicated that their SBLEs were supported by video review, either of the actual simulation experience (n = 9) 10,23,28,32,34,38,44,46,48 or review of previously recorded video scenarios (n = 9). 24 –26,29,35,37,39,42,43 Two simulation experiences were recorded and streamed live to separate classrooms. 44,50 Other technology used included online modules, 29 audio recordings, 31,38 virtual and phone communication, 37 social media, 39 and manikins with programmable physiologic changes. 40,41,43,45,51
Scenario Enactment
The authors reported a variety of “features” used to enact their scenarios. Twenty-eight of the exercises involved role play by actors or the actual participants. Roles played by others included the patient, family member, nurse, physician, social worker, chaplain, and hospice worker. In 8 of the articles, the authors reported using scripts. 24,26,27,31,41,44,46,47 Other features of the SBLEs included workshops, 29 lectures, 24 –26,35,37,38,40,43 case studies, 24,43 student presentations, 35,43 board games/gaming, 40,43 panel discussions, 43 group tutorial sessions, 35,37,38 self-directed learning, 46 standardized patient interviews, 47 framework-guided content, 49 and debates. 43
Scenario Sources
The simulation exercise scenarios were most frequently developed by internal faculty and personnel (n = 20). Eight of the 30 scenarios utilized externally developed scenarios and 2 of the articles provided no scenario source information. The externally developed scenarios utilized in these SBLEs included the following: (1) the Memorial Sloan Kettering Cancer Center for EOL care 53,54 adapted curriculum, 26 (2) the adapted Scheikl and O’Neill 55 simulation scenario, 28 (3) the National League for Nursing (NLN) Advancing Care Excellence for Seniors (ACE.S) 56 module, 39 (4) the adapted Simulation Clinical Experience (SCE) EOL care scenarios from CAE Healthcare (previously known as Medical Education Technologies [METI]), 40,43,45 (5) “A Lion in the House” 57 video, 35 and (6) “Evan Mayday’s Good Death” 58 video. 39
Simulation Frameworks and Curriculum
Some of the authors reported using existing evidence-based frameworks and curricula to guide the development or design of their SBLE. Three 27,28,30 authors used the Nursing Education Simulation Framework by Jeffries, 59 1 40 reported use of the Simulation Learning Pyramid, 60 and 5 36,39,42,43,47 utilized aspects of the End-of-Life Nursing Education Consortium (ELNEC) curriculum. 61
Patient-Related Characteristics
Most of the scenarios focused on an adult patient (n = 25); 15 in the hospital setting, 10,24 –26,29,30,33,34,36,40,41,43,44,49,50 7 in a hospice setting, 23,27,28,31,37,42,47 and 3 in homecare settings 38,39,45 with life-limiting illnesses such as cancer, chronic diseases, and cranial hemorrhage at various stages. One SBLE focused on a hospitalized young adult 48 and 3 articles reported using pediatric scenarios, 2 in the hospital setting, 32,51 and 1 unspecified. 35
Evaluation
As noted earlier, The Kirkpatrick Model 21,22 was used to differentiate the level of evaluation assessment completed for the training reported in each of the 30 articles reviewed (see Table 1). In 16 of the articles, a level 1 (REACTION) post-training assessment was conducted and typically focused on the user’s satisfaction with, perceived value of, or perceived learning from the training. Twelve articles were classified as including level 2 (LEARNING) assessments. All 12 reported conducting pre- and postevaluations to assess changes in knowledge level, attitudes, and/or self-confidence with palliative care or EOL patients and their families. A level 3 (BEHAVIOR) was reported in 2 of the articles. There were no level 4 (RESULTS) reported in the 30 articles reviewed.
Authors reported using a variety of instruments to evaluate the SBLEs, but for most, there was no evidence provided about previous testing or psychometrics. There were several authors, however, who reported using existing tools to conduct their evaluations. These tools included the followings: Frommelt Attitudes on Care of the Dying, 62 (n = 3), 25,27,44 the Perceived Competences in meeting ELNEC standards or ELNEC-Knowledge Assessment Tool 63 (n = 3), 24,36,44 and the Caring Efficacy Scale 64 (n=1). 23 In one study, 48 the authors used 3 different tools: the General Self-Efficacy Scale, 65 the Jefferson Scale of Attitudes Toward Physician/Nurse Collaboration, 66 and the Team Objective Structured Clinical Examination Tool. 67 While all of the articles included a communication component in the SBLE, these were almost always embedded within a larger scenario that included physical care or monitoring patient status. As a result, the evaluations typically did not specify the component to which the responses referred making it impossible to draw conclusions about the individual components.
Finally, we noted the absence of information that seems critical to assessing the quality and outcomes of the SBLEs in these articles. One is the length of the SBLE. Although the descriptions indicated the SBLEs varied in length, most did not provide sufficient information to assess the actual time involved. The length and depth of the scenario are certain to have an impact. Second, all aspects of the communication component are not clearly specified in these articles, making it difficult to duplicate or compare across SBLEs. Third, the articles contain virtually no information about the potential impact of enacting or only observing the direct nurse communicator role. In most instances, the nurses and nursing students only observed the direct nurse communicator role. We therefore wonder whether trainees who enact the direct nurse communicator role during an SBLE (active learner) achieve a higher level of communication competency than their colleagues who only observe the role.
Discussion
In this systematic review, we examined 30 articles to determine how SBLEs are being used to build the communication skills of nursing students and clinicians with palliative care and EOL patients and families. Though commonalities were reported, the wide variation in the details of these SBLEs and range of evaluation levels and tools make it difficult to draw general conclusions. These findings support what others have found as well. 4,68 Below, we discuss our findings and the potential implications of them.
As was noted in the previous section, we observed a number of important differences among the SBLEs. For the scenarios, these included the learning aims, patient characteristics (eg, health issue/s, gender, age), setting simulated (eg, hospital, hospice, homecare), content and length of the scenario, timing of the communication (eg, initial diagnosis, EOL), individuals involved (eg, parents, spouses, care team members), and enactment features (eg, manikin, actors, standardized patients, scripts, roles played by the students/clinicians). The debriefing process also varied widely even though the authors reported using some form of debriefing in 28 of the SBLEs. Though the differences across scenarios signify the diversity of SBLEs, the inability to compare the impact of these on trainee outcomes is problematic.
The evaluations reported in the articles are problematic for several reasons. For a number of the SBLEs, the objectives and desired competencies were not clearly articulated. In the absence of clear objectives and competencies, it is not possible to ascertain whether they are achieved. In addition, the tools used in the evaluations were most often internally developed and not previously validated, as is typically done to evaluate SBLEs in undergraduate courses. The majority of these evaluations were posttest measures (n = 16) capturing the perceptions or reactions of the students and nurses to the exercises (Kirkpatrick level 1). 21,22 Since the main purpose of palliative and EOL communication SBLEs is to prepare nursing students and practicing nurses to enhance their communication skills, a level 2 evaluation at minimum is needed to determine actual knowledge gained. While level 2 evaluation need not involve pre- and posttest, this is most desirable. Levels 3 and 4 assessments provide even greater understanding of the impact of SBLEs since they assess translation of behavior into practice (level 3) and achievement of desired patient outcomes as a result of nurse behaviors (level 4). Our results, however, concur with those of others 4,68 who found that there is little attention on assessing important relationships between SBLEs and clinician behaviors in the clinical setting (level 3) and desired patient outcomes (level 4), the ultimate end goal of this training.
Of the 2 level 3 evaluations reported in this review, one was particularly creative in assessing the relationship between an SBLE and the use of the knowledge in practice. Venkatasalu and colleagues 50 evaluated the impact of the SBLE on behaviors in practice through interviews with students who had taken care of EOL patients in the clinical setting, following the completion of either a seminar-based session or SBLE. The authors found that those in the SBLE group were stronger in emotional and clinical preparedness and in converting knowledge into practice compared to those who completed the seminar training.
On another front, we were surprised to find that only 14 SBLEs included other members of the interprofessional team. Seven of the 14 involved actual participation by a member of another discipline, while in the remaining 7, the interprofessional roles were acted out by nursing students, practicing nurses, faculty, or other actors. This is concerning evidence that nurses and other interprofessional team members are not consistently trained together. Since palliative and EOL care are typically provided by interprofessional teams, training nurses and other members of the team together are particularly important to prepare teams for managing the real-time situations. Further interprofessional communication is a core competency endorsed by numerous nursing and interprofessional standards bodies including, American Association of Colleges of Nursing 69 –71 and the Interprofessional Education Collaborative. 72 Communication with the patient and family about their palliative and EOL care nearly always has a direct or indirect impact on the overall quality of care the team provides. It is crucial therefore to include appropriate disciplines in the training plan when developing and implementing communication scenarios for palliative and EOL care.
In summary, our findings suggest that SBLEs are being used to support the development of communication competencies for nursing students and clinicians when providing palliative and EOL care, but the true impact is elusive. Given the costs involved in the training, it is crucial to not only understand the impact of SBLEs but also to be able to identify best practices and the minimum content needed to achieve desired trainee outcomes. Since our review captured both the research studies and nonstudies published in this area, we are able to see that the state of the science is very limited. Furthermore, the lack of evidence and the absence of sufficient opportunities to develop the desired communication competencies under the “real-time” conditions appear to be driving the development and use of SBLEs that are not fully validated. Though we strongly support further research in this area, effective alternative strategies for implementing SBLEs that build important palliative and EOL communication competencies in nursing students and clinicians are needed now. In conclusion, we offer the following recommendations to enhance the quality and validity of SBLEs designed to build communication competencies in palliative and EOL care. Ultimately, this strategy will augment research by simultaneously generating practice-based evidence that can also validate and be used to improve SBLEs.
Utilize existing standards to structure SBLEs: In this review, 9 articles reported using an existing framework or curriculum in the design of their SBLEs. We support the NLN’s endorsement of the use of standards in simulation projects.
73
As we observed, these standards provide a context for systematically developing and integrating an SBLE into a curriculum. Of note is the ELNEC framework that contains specific content pertinent to palliative care and EOL training to the entire interprofessional team. In addition, we also endorse the use of the International Nursing Association for Clinical Simulation and Learning standards.
16
These standards were first published in 2011. While none of the articles reviewed referenced these standards, they have gained solid recognition as the most comprehensive set of guidelines for simulation in the field. They comprise 7 evidence-based best practice guidelines that inform the design,
16
facilitation,
74
evaluation,
75
integrity,
76
collaboration of interprofessional team members,
77
debriefing practices,
78
and objective and outcomes.
79
The Sim-IPE (Simulation Enhanced Interprofessional Education) provides guidance for integrating interprofessional team members into SBLEs that support patient and family goals and ultimately high-quality patient outcomes.
77
Clearly specify the goals and objectives to be achieved with the SBLE. The foundation for evaluating the impact of any SBLE starts with identifying the objectives and competencies you wish to achieve through this mechanism. In the absence of these objectives, it is not possible to measure and demonstrate the impact of the SBLEs and competencies to be achieved by the learners. In this review, it was difficult to ascertain the specific communication competencies the SBLEs were expected to achieve. As we observed, it certainly makes sense to integrate communication with patients and family into learning opportunities that include other aspects of care that naturally occur simultaneously (eg, physical). In such instances, however, it is crucial to clearly articulate the specific communication objectives to be accomplished by the SBLE (eg, learners will demonstrate the use of effective communication skills while assisting a hospitalized adult patient receiving palliative care to create an advanced directive under simulated conditions). Clear articulation of a communication objective provides the foundation for determining the degree to which the objective has been met.
Utilize externally validated scenarios where appropriate to meet specified objectives. Though the use of simulation in education is still relatively young, it is growing rapidly. As a result, there are numerous sources of validated cases or scenarios that can be integrated into SBLEs, avoiding the need to develop a scenario from scratch. Eight of the articles reviewed included externally developed patient scenarios in their SBLEs. The NLN was one of the scenario sources utilized and provides access to a large library of scenarios that have been previously validated.
56
We recommend consulting current sources of validated scenarios before building a scenario from scratch. It is critical, however, to ensure that any scenario selected from a bank or built from scratch provides the content needed to meet the clearly articulated objectives of the SBLE. When building communication competencies in palliative and EOL care, the scenarios must include content that allows assessment of relevant objectives.
Apply feasible, rigorous, and appropriate evaluation methods: Given the importance of health team communication to outcomes of patients receiving palliative and EOL care, it is critical to ensure our teaching strategies build the requisite competencies. Since the nurse members of the health-care team have the most frequent and direct exposure to such patients, it is particularly crucial for nurses to possess strong communication skills with patients, families, and teams. While we have assumed that the impact of SBLEs on communication competencies in palliative and EOL care is not being validated, this may be because authors did not report such information. Regardless, it is essential to understand the impact of communication training on expected outcomes when using SBLEs in order to make decisions about their ongoing use and value in training. Thus, we want to underscore the importance of utilizing strong evaluation methods and tools that can assess both the achievement of the clearly articulated training objectives and the level of learning achieved (eg, as articulated by the Kirkpatrick model). By so doing, the knowledge gained from using SBLEs in training programs (focused on building communication competencies in palliative and EOL care) can augment the research being done and speed our capability to identify and disseminate best practices.
Footnotes
Acknowledgment
The authors would like to thank Debra McDonald for her expert editorial assistance.
Declaration of Conflicting Interests
The authors declared no potential conflict of interest with respect to the research, authorship, and/or publication of this article.
Funding
The authors received no financial support for the research, authorship, and/or publication of this article.
