Abstract
OBJECTIVES
The goal of this implementation study was to describe the implementation and evaluation of the impact of an online pediatric palliative care training program in Nepal, using the Project ECHO model.
METHODS
The study used mixed methods, including a program case study describing the online learning program and before-and-after surveys of program participants, assessing learning through changes in knowledge, comfort, and attitudes. An end-of-program survey was used to evaluate participants’ overall experiences with the learning program and use of the learning resources.
RESULTS
A literature review, stakeholder surveys, and expert input informed the design of the intervention. The course used the Project ECHO model of online education, with modifications based on the leadership team's previous ECHO experiences and local stakeholder input. The intervention occurred over 9 months, with 22 online teaching sessions. Each session consisted of a didactic lecture, case presentation, and interactive discussion with expert clinical teachers. Fifty-five clinicians in Nepal participated, including physicians (47%), nurses (44%), and psychotherapists (5%). Clinicians reported improvements in knowledge, skills, and attitudes after program participation. Program acceptability scores were high, with 93% of participants reporting that the course provided effective learning.
CONCLUSIONS
Project ECHO can be successfully implemented to deliver continuing professional development in Nepal. Delivering palliative care education online using the Project ECHO model, leads to improved knowledge, skills, and attitudes for clinicians. Project ECHO suggests an innovative solution which can provide training and support to clinicians in settings where educational opportunities in palliative care are limited.
Keywords
Introduction
Children's palliative care focusses on preventing and relieving suffering for children with cancer and other serious or life-limiting illnesses by providing physical, psychological, social, and spiritual support to children and their families. As the global burden of non-communicable diseases continues to increase, the need for children's palliative care in low- and middle-income countries (LMICs) will rise. 1 Already, more than 97% of all children requiring palliative care reside in LMICs, and most cannot access palliative care, due to lack of clinical care programs in these countries.2,3 Despite global recognition that palliative care is important for children with cancer and other life-limiting conditions, there are very few initiatives which have been developed to address these huge gaps globally.3–5
Nepal is a lower-middle income country, where an estimated 43,000 children require palliative care annually, however, there are currently no specialized children's palliative care services available.1,3,6 Without access to palliative care, children and their families are unable to access appropriate medications, supplies, and support from trained healthcare providers (HCP), leaving them without the essential supports they need to relieve suffering in the face of progressive or life-threatening illness. 7
The lack of children's palliative care programs in Nepal means that there are very few clinical experts who can teach the subject, and thus it is very challenging to build the capacity of HCP to provide children's palliative care.8,9 Without local palliative care services there are few opportunities for clinical training of HCP, leaving HCP unaware of the importance and potential benefits of palliative care for children and without the skills to treat pain, symptoms, and other sources of suffering.6,10,11
In Nepal, most medical and nursing colleges have not incorporated palliative care, and it is not mandated nationally. 12 Beyond the undergraduate level, there are no children's palliative care specialist training programs, forcing clinicians to travel to India or further away to access training. This creates significant barriers related to cost of travel and absences from clinical duties and family responsibilities. Several short clinical and classroom-based training programs focussed on adult palliative care have been developed in Nepal, however, these programs see very few children and cannot provide adequate clinical training in children's palliative care. 6
Online education suggests a potential solution to address the huge shortage of palliative care clinicians by enabling training to reach HCP, even those in rural or remote areas.13,14 Project ECHO (Extension for Community Healthcare Outcomes) is a model of online education which facilitates learning and mentorship between clinicians in underserved areas and clinical experts in well-resourced areas. 15 ECHO employs a “hub-and-spoke” design, where clinical experts at the “hub” connect with HCPs (“spokes”) on a regular basis to provide education through formal teaching and case discussions, as shown in Figure 1. 16
Illustrative example of hub and spoke design of project ECHO. From “Pediatric Project ECHO®: A Virtual Community of Practice to Improve Palliative Care Knowledge and Self-Efficacy among Interprofessional Health Care Providers,” by C. Lalloo et al., 2021, Journal of Palliative Medicine, 24(7), p. 1239. CC-BY NC 4.0. Reprinted with permission.
Project ECHO suggests an innovative model of online learning which can help to address the gaps in availability of palliative care training for HCP. Furthermore, project ECHO focusses on building communities of clinicians who can receive mentoring, supporting the implementation of new knowledge into clinical practice.17,18 Despite the proposed benefits of Project ECHO, there is limited evidence describing its implementation in LMICs.17,19 Two recent studies have described palliative care ECHO programs in India and Bangladesh, reporting on improvements in knowledge, skills and attitudes towards palliative care among participants.18,20,21 Studying the implementation and impacts of online training in Nepal is particularly important, to ensure that training meets the local educational, resource, and cultural learning needs of participants. These studies are also important to guide teachers in understanding how Project ECHO and other forms of online education can overcome barriers to accessing education (eg cost of travel and take time off to attend training) and support learning for participants.
Despite the proposed benefits of online education, several studies identify that the lack of face-to-face interaction can be challenging for learners.13,14 Skilled teachers, who create opportunities for discussion and participation among learners may reduce the impact of online-only interactions, with ECHO participants in India and Bangladesh identifying the importance of teachers in maintaining a learning environment where they felt safe to share their ideas and experiences.
20
The aim of this implementation study was to describe the process of development and implementation of an online palliative care training program in Nepal, designed to enhance HCP knowledge and skills. The study addressed the following research questions:
What was the context of the intervention (ECHO program), including factors influencing its implementation?
What were the modifications to the original ECHO model and the rationale for these modifications? What was the effect of the training program on learners’ knowledge, skills, and attitudes towards palliative care? What were the facilitators and barriers to optimal learning and participation?
Methods
This was a descriptive implementation study using mixed methods (qualitative and quantitative). The study incorporates a narrative case study and before-and-after surveys of program participants describing the intervention (an online palliative care training program), following the Educational Design Research cycle of Analysis and Exploration; Design and Construction; Evaluation and Reflection. 22 A narrative case study is used in implementation research to identify and describe the phenomenon including the context of the implementation and the factors influencing implementation and explain how the implementation can leads to changes. 23 Quantitative methods included before-and-after surveys of program participants, which measured learning through changes in knowledge, skill, and attitudes before the course and at the time of course completion; and end-of-program surveys which evaluated participants’ overall experiences with the ECHO program and use of course learning resources.
Context
In 2017, the government of Nepal adopted a National Strategy for Palliative Care, which led stakeholders (eg, government, HCP, palliative care organizations) to identify the vast gap in children's palliative care, and local HCP have started to consider how to develop children's palliative care to meet this need. The Nepalese Association of Palliative Care (NapCARE) is the national palliative care organization which focusses on palliative care education and advocacy. NapCARE has a committed leadership and strong interest in developing children's palliative care. Two Worlds Cancer Collaboration (TWCC) is a Canadian non-profit foundation, which has been helping build palliative care activities with local partners in Nepal for more than 20 years, including education via in-person workshops and clinical training. Kanti Children's Hospital (KCH), the national government pediatric referral hospital in Kathmandu, is well positioned to lead the development of palliative care services across the country, with interested HCP and healthcare administrators, and the hospital cares for many children with serious illness who would benefit from palliative care each year. However, KCH staff require training and mentorship to be able to develop palliative care services. Similar education and mentorship is needed, for HCP working in more rural and remote regions, since most children with serious illnesses reside in rural areas (82% of the population is rural) and these children frequently access healthcare at regional secondary- or primary-level health centers.
Target sites/personnel
The targeted “sites” (organizations) involved in designing and leading the implementation of the ECHO program included NapCARE, KCH, TWCC, and the Hyderabad Centre for Palliative Care (HCPC). These organizations brought together Project ECHO implementation experts, children's palliative care subject matter experts, and palliative care clinicians in Nepal. Together with TWCC, HCPC has co-lead the implementation of more than 20 palliative care ECHO programs in South Asia, and the team has identified key ECHO modifications which facilitate and enhance learning in the South Asian context. 18 Target learners included multidisciplinary HCP (nurses, physicians, psychologists, counsellors, dieticians, and other allied health workers) who are caring for children with serious illnesses across Nepal. Children needing palliative care included those with cancer, serious neurological, cardiac, respiratory, renal and other relevant conditions, as described in the literature on palliative care. 24
Participant survey
ECHO learners were invited to participate in online surveys: 1) At the time of registration (before); and 2) Immediately upon completion of the ECHO program (after). Baseline demographic data was collected at the time of enrolling in the ECHO program. Learners were eligible to complete follow up surveys, if they attended a least one ECHO session and completed the baseline survey. All ECHO learners who completed the surveys were included in analysis of the results.
Data collection and data collection tools
Participants were sent invitations containing links to the online surveys by email and WhatsApp. Participants were asked about their expectations of Project ECHO, their knowledge and attitudes towards palliative care, and comfort related to performing palliative care skills, with specific questions corresponding to the course learning outcomes. Due to a lack of validated tools for interdisciplinary clinicians, the study team developed a palliative care knowledge, skills, and attitudes questionnaire based on previous experiences assessing other palliative care ECHO programs in South Asia. The survey was piloted (4 participants, 9.3%) and the wording of several attitude questions was modified to better reflect palliative care concepts in Nepal, based on feedback from local palliative care experts and incorporating ideas from Lalloo et al (2020), who measured participants knowledge, self-efficacy and experiences with a pediatric project ECHO in Canada. 16 Participants were also asked about their experiences and satisfaction with the ECHO program, use of additional learning materials (recordings and database materials), as well self-assessment of knowledge, confidence, and attitudes about palliative care in the end-of-program survey. Survey items include multiple choice questions, open text boxes, and 7-point Likert scales (response options ranged from [1] “strongly disagree” to [7] “strongly agree”; as shown in Supplement S2).
Demographic data about education, professional specialization, professional role, and experience, work location, and the number of children needing palliative care seen each month were collected. Participants’ knowledge was assessed in general and for specific topics included in the training, with 7 specific knowledge items including the stem question “for my scope of practice, I have an appropriate level of knowledge about…”. In the skills domain, there were 15 questions with the stem “within my scope of practice, I am confident in my ability to…”. Previous project ECHO programs have found that participants tend to over-estimate their level of knowledge and confidence prior to participating in education, so participants were asked to re-rate their baseline abilities in these areas during follow up surveys. These adjusted baseline responses were used in subsequent analyses. To evaluate the overall program impacts, we asked participants to describe their overall change in clinical management, with a 5-item rating scale from “no change” to “a large improvement”. Several open-ended questions related to changes in clinical practice, how to improve the program and challenges to participation, were included in the end-of-program surveys of participants’ overall experiences.
Statistical analysis
Descriptive statistics were obtained using Microsoft Excel. Mann-Whitney U-tests were performed to evaluate differences between knowledge, skills, and attitude mean scores that participants reported after completion of the ECHO and before starting the ECHO program. An a-priori statistical significance was set to P = .05. Effect Size was calculated using Cohen's Ds, with an effect size 0.8 or more suggesting a large effect. In some cases, Likert scales were reverse coded to improve clarity of results in presentation. Raw open-ended responses were reviewed and analysed by 2 research team members (CM, MD), responses were grouped based on identified commonalities and subsequently sorted into categories.
Ethics statement
The study was approved by the Children's Hospital of Eastern Ontario Research Ethics Board (CHEO 17/201X, date of approval: Dec 15, 2020). All participants provided written informed consent after receiving comprehensive written information about the study. The study was also reviewed by local ECHO program leaders, although formal local approval was not required.
Results
Narrative case study: Pediatric palliative care ECHO for Nepal
Analysis and exploration phase
A leadership team of key local and international palliative care experts and stakeholders was established, with technical and administrative support from a program coordinator. Input from learners was obtained from a convenience sample of 6 potential participants (pediatricians and pediatric nurses) who completed a brief online survey, about palliative care topics most relevant to them and their program structure preferences (timing and duration of sessions). These results, along with input from stakeholders and experts, and a literature review informed the curriculum development process.18,20,25
Design and construction phase
The Project ECHO structure enhanced learning by encouraging participants to adapt palliative care principles to the cultural context of Nepal thereby enhancing practice change and mitigating the lack of face-to-face contact in online education.20,26
Modifications to ECHO model
Modifications to the original Project ECHO model included incorporating local, regional, and international experts in the leadership team to ensure the program met the needs of local HCP. Local faculty believed that international experts would increase participants’ enthusiasm for the program. 18 Several palliative medicine residents were included in the leadership team, and gradually transitioned into more senior leadership roles as their skill increased, thereby developing and mentoring new ECHO leaders. Several of the residents have subsequently lead ECHO programs in India and Bangladesh. Other key adaptations are shown in Table 1.
Key adaptions and refinements of the original ECHO model.
During this phase, the leadership team met regularly every 2–4 weeks to develop and plan the ECHO program, and these meetings included discussion of the availability of medications and specific treatments in Nepal to support international faculty to understand the local healthcare situation. Figure 2 illustrates a timeline of the key preparatory steps.
Timeline of leadership team activities prior to launching pediatric palliative care ECHO for Nepal.
Learning program participant recruitment
Social media, text messages, telephone, and word of mouth were used to recruit pediatric health care providers caring for children with life-threatening or life-limiting conditions in Nepal. There were no costs or restrictions to participation, nor were any incentives provided. The program was designed to meet learning needs of HCP but was also open to healthcare administrators and trainees. Program registration was completed online. Information about upcoming sessions was shared with participants by email and through a private group chat on social media (WhatsApp). Participants were permitted to join at any time during the program's duration and were encouraged to register to benefit from access to the course materials and communication.
Program structure and format
Fifty-five learners registered for the program and 46 attended a least one session. Based on feedback from participants and the leadership team about the need to balance the time commitment required for the program and other clinical and personal duties, there were 22 weekly learning sessions conducted in two parts (June to Aug 2020 and January-March 2021). The session topics are shown in Table 2. All sessions used Zoom videoconferencing technology.
Teaching topics of pediatric palliative care ECHO sessions.
Weekly sessions followed the structure shown in Table 3. A case presentation template was provided to participants to support clear and succinct case presentations which focussed on key palliative care issues. During sessions written feedback, questions and discussion was encourage both verbally and using the Zoom chat feature, and one faculty member was assigned to moderate the chat and respond to written questions. If relevant, written questions from the chat were read aloud and discussed.
Key sections of a pediatric palliative care ECHO session (adapted from Doherty, Rayala et al (2021)).
Facilitator
Each session was facilitated by a member of the leadership team and who focussed on creating a warm and welcoming environment. This was based on a previous study which identified creating a supportive learning environment as an important facilitator activity which made participants feel that they could share their ideas. 20
Additional asynchronous learning
In addition to the live (synchronous) videoconference sessions, participants were encouraged to interact between sessions through a group social chat on WhatsApp, which was moderated by faculty. Chat discussion included clinical queries, clarification of new practices and knowledge, and sharing of additional learning resources. After each session, the presentation slides, a summary of key learning points, and the private video recording link were shared with participants via email and WhatsApp. Participants were encouraged to review these materials and share them with colleagues outside of the ECHO program as well, since previous programs have identified the benefits of learners using these resources to teach their colleagues and for personal study. 20
Participants completed a group project (Supplement S1) at the midpoint of the course, consisting of developing a plan for how to increase access to pediatric palliative care at their health facility. The goal of the project was to support participants to identify the barriers and enablers of palliative care locally and reflect on how best to address the barriers.
Evaluation and reflection phase
Debriefing
Weekly leadership team debriefings after each ECHO session facilitated rapid adaptions of the learning program. Modifications to the style of facilitation were made to increase learner participation during discussions. Debriefing also helped faculty to identify knowledge gaps or misunderstandings which they then addressed in subsequent sessions. Potential harms to participants were also discussed and strategies were developed to mitigate these. There were no significant harms to participants identified.
Learner survey: Participants characteristics
Forty-three (78.1% of registrants) HCP completed the knowledge, skills and attitudes survey before the ECHO program and 27 out of 41 (65.8%) eligible HCP completed the survey at the end of the course. Participant characteristics are shown in Table 4. The average number of participants per session was 33 (range 21-38). The average attendance for individual learners was 14 sessions (range 1-22).
Characteristics of participants for project ECHO on pediatric palliative care in Nepal (n = 43).
Multiple responses permitted
Learner survey: Changes in participants’ knowledge, skills, and attitudes
Baseline responses indicated the areas where participants perceived their knowledge to be lacking, as indicated by responses of “strongly disagree”, “disagree” and “somewhat disagree”. These areas included management of end-of-life care (n = 7/26, 26.9%), breaking bad news (n = 6/26, 23.1%), managing pain (n = 6/26, 23.1%), and managing anxiety and depression in children (n = 6/26, 23.1%).
Areas where participants commonly perceived their clinical skills to be lacking included transitioning from a curative to palliative care approach (n = 7/26, 26.9%), serving as a workplace expert in palliative care (n = 7/26, 26.9%), caring for bereaved family members (n = 6/26, 23.1%) and discussing death with parents (n = 6/26, 23.1%).
Participants’ baseline attitudes related to palliative care included a belief that avoidance of talking about death with parents of a dying child was appropriate as 12 of 26 participants (46.1%) agreed with this statement (includes “strongly agree”, “agree”, and “somewhat agree” responses). Nine of 26 respondents (34.6%) also agreed with the statement that “palliative care represents a failure of modern medicine” at baseline. By the end of the course, average participant responses towards palliative care improved in all 8 areas evaluated, statistically significant changes in 6 of the 8 areas. Sub-group analyses using years of professional experience and type of HCP were performed comparing professional and there were no significant differences identified. Table 5 shows the change in mean knowledge, skills, and palliative care attitudes before and after participation.
Changes in Likert scale scores of participants’ knowledge, self-rated confidence, comfort, and attitudes about palliative care at baseline and the end of ECHO program. (n ranged from 25-27 for each individual question, full data set available on request).a
Item response options ranged from strongly agree to strongly disagree, (1 = strongly disagree to 7 = strongly agree). Further details of question wording can be found in Data Supplement S2.
Effect Size (Cohen's Ds.). Effects of ≥ 0.8 generally suggest large effect.
Participants provided qualitative responses to questions about changes in their clinical practice since starting the course, reporting how they implemented pain scales (n = 5), used morphine for pain management (n = 4), and encouraged therapeutic play to support emotional coping in children (n = 3). Other responses included more appropriate use of artificial hydration and nutrition at end of life and more skilled counselling of families. One participant also noted that their colleagues were more receptive to initiation of palliative care after these colleagues participated the ECHO program.
Program acceptability and satisfaction
Participants’ course satisfaction was very positive, with the majority indicating that the course was a valuable experience for them (n = 25/27, 92.6%), that they would recommend the course to colleagues (n = 24/27, 88.9%) and that the ECHO structure was an effective way for them to learn (n = 25/27, 92.6%).
The baseline survey evaluated the most common obstacles to participation, which included lack of time (n = 26/37, 70.3%), along with technical issues with Zoom or Internet connection (n = 20/27, 54.1%). No participants indicated that language was a barrier to participation. The end-of-program survey asked participants to identify obstacles preventing them making clinical practice changes and these included: a need for more formal teaching/training courses in pediatric palliative care (n = 12/27, 44.4%), not having enough time to provide the level of care discussed in the ECHO (n = 9/27, 33.3%), and a need for hands-on clinical exposure and mentorship (n = 8/27, 29.6%). Further details related to the perceived benefits and challenges of practice change are shown in Table 6.
Participants’ comfort and learning experience of ECHO program.
Includes strongly agree, agree, or somewhat agree.
Multiple responses permitted.
Access to learning resources
Most participants were aware of the additional learning resources available to complement the online live sessions (n = 25/27, 92.6%). The most common reasons for reviewing the recordings were to review missed sessions (n = 16/27, 59.2%,) or to review content/learn more (n = 8/27, 29.6%). All participants reported that they reviewed the key learning points for each session, with most doing this all or most of the time (n = 22/27, 81.4%).
Discussion
This study describes the implementation and evaluation of an online palliative care course for clinicians in Nepal, a lower-middle-income country. The course content and structure incorporated feedback from key stakeholders, through consultation and a review of the relevant literature. The learning program was led by a collaborative team of national, regional, and international subject matter experts and teachers from Nepal, India, and Canada. The course consisted of 22 online sessions and used the Project ECHO model. Modifications to Project ECHO, based on previous finding and experiences using online learning in palliative care in South Asia. Learners reported significant improvements in their palliative care knowledge, comfort in performing palliative care skills, and attitudes towards palliative care after participating in the course. Most participants were highly satisfied with the program, noting that the course was effective for their learning and that they would recommend it to others.
We observed significant positive impacts on participants’ knowledge and comfort with palliative care skills from participation in the ECHO program. Our findings are similar to a recent ECHO project in Canada, which also describes significant improvements in participants’ perceived knowledge and self-efficacy. 16 While there are some differences in study design (program length, session frequency, timeframe of data collection), the benefits of the Project ECHO model are present in both high and lower-middle-income countries, suggesting that Project ECHO supports education for healthcare professionals from a range of backgrounds and resource levels. Providing palliative care education which is readily available to pediatric HCPs in Nepal is particularly important since there are currently no palliative care services for children available, and training and mentoring local HCP is needed to support new palliative care programs to develop in Nepal. Project ECHO can support palliative care capacity building activities for HCPs in LMICs and is particularly relevant because this model addresses geographical barriers and resource-limitations of face-to-face training.
Online learning programs have been widely discussed as a model which can increase access to education in remote and rural areas, however, to be most effective virtual learning programs must be adapted to the local health care situation and should introduce participants to clinical management techniques that can be implemented in their local healthcare setting. 13 The development of this course incorporated these key considerations, with an experienced leadership team ensuring that medication and health resources availability considerations were considered and addressed during didactic teaching and case discussions. This is particularly relevant for courses with international speakers, who may otherwise struggle to provide management recommendations which are applicable locally. The study evaluation findings suggest that this program was successful in providing locally appropriate treatment recommendations, with most learners reporting that the medications discussed in the course were available or affordable for their patients. Discussing the challenges of opioid availability is particularly important when conducting palliative care training in Nepal and other LMICs since difficulty in accessing opioids is a frequent barrier to pain control. 27 This course successfully incorporated teaching from local opioid policy experts to ensure that considerations of local opioid availability were addressed.
The course incorporated additional modifications to the original Project ECHO model, including involving key stakeholders and residents in the course leadership team and using brief mobile-friendly surveys to assess potential participants’ learning needs during the course development. Other Project ECHO programs in LMICs should consider implementing these modifications, which may help to ensure that online courses are sustainable. We have previously described additional modifications to Project ECHO, which were implemented during this program including the use of tangible learning materials, in the form of video recordings and presentation materials, to facilitate asynchronous learning. 18 The use of familiar social media platforms and local networks to recruit, engage, and seek program feedback from participants, is an important consideration when implementing online learning, which educators should incorporate when planning new ECHO programs.
Internet connectivity in Nepal has increased significantly in recent years, which enabled this course to encounter minimal technical barriers; however, despite the recent improvements in internet connectivity, more than half of participants still mentioned technology as a barrier to participation. Interestingly, 85% of participants also reported watching session recordings online afterwards, suggesting that the video recordings were easily accessible to participants.
A 2019 systematic review comparing online and offline medical education found no evidence that offline learning improves learning outcomes, suggesting that educators should consider incorporating online learning into medical education. 28 However, despite the potential benefits of this approach, further studies are needed to compare the quality of learning online compared to in-person, in palliative care and in LMICs. Several participants in this study identified a need for further clinical training in palliative care, suggesting that the impact of online training may be enhanced by pairing it with clinical placements or workplace-based training.
When designing learning programs in LMICs, the instructional language should be carefully considered, as programs in English may be a significant barrier to learning and our study sought to explore the issue of language as a barrier to learning.13,25 Interestingly, in this program, none of the participants indicated that English language instruction was a barrier to participation. This may be because most participants were nurses and physicians who are more likely to be comfortable learning in English, compared to community health workers or mid-level health workers in rural settings. Potential participants who were not comfortable in English may have chosen not to participate in the program. Our findings differ from our previous study of Project ECHO in India and Bangladesh, where language was identified as a challenge to full participation for some participants and suggest that educational programs in English can be effective when training nurses and physicians in Nepal. 20
Study strengths and limitations
This study describes an innovative online synchronous palliative care course in Nepal. Our findings describe learning experiences of a broad range of professionals including both nurses and physicians from a variety of clinical specialties, suggesting some degree of transferability of findings. Only 59% of eligible participants responded to the final survey, which could lead to selection bias, particularly favoring participants who found the program to be effective or were highly engaged with the learning or who did not face significant language barriers or internet connectivity issues. The questionnaire was administered online but required considerably less bandwidth than the online learning program itself. We also used self-report of knowledge and confidence scores which may not reflect participants’ true capabilities or changes to clinical practice. To reduce language barriers to completing the survey, questions were reviewed with local health care professionals and the wording was revised to better reflect key ideas and concepts as understood in Nepal. Future studies should seek to assess the impact of these programs on the experiences of patients and families.
Conclusion
This study's findings demonstrated that Project ECHO can be successfully implemented to deliver continuing professional development in Nepal. Using an experienced collaborative team of national, regional, and international subject matter experts supports implementation. The study described a model of online training which learners rated as highly effective for learning. The program was associated with significant improvements in palliative care knowledge, skills, and attitudes for learners. Educators and policy makers should consider using Project ECHO to address the urgent need for palliative care for children in settings with limited access to pediatric palliative care expertise.
Supplemental Material
sj-docx-1-mde-10.1177_23821205241234541 - Supplemental material for An Online Pediatric Palliative Care Education and Mentoring (Project ECHO) in Nepal: A Program Implementation Case Study and Assessment of Changes in Healthcare Providers’ Knowledge, Confidence, and Attitudes
Supplemental material, sj-docx-1-mde-10.1177_23821205241234541 for An Online Pediatric Palliative Care Education and Mentoring (Project ECHO) in Nepal: A Program Implementation Case Study and Assessment of Changes in Healthcare Providers’ Knowledge, Confidence, and Attitudes by Anisha Lynch-Godrei, Sudhir Sapkota, Jennifer Rowe, Bishnu Dutta Paudel, Garima Aryal and Megan Doherty in Journal of Medical Education and Curricular Development
Supplemental Material
sj-docx-2-mde-10.1177_23821205241234541 - Supplemental material for An Online Pediatric Palliative Care Education and Mentoring (Project ECHO) in Nepal: A Program Implementation Case Study and Assessment of Changes in Healthcare Providers’ Knowledge, Confidence, and Attitudes
Supplemental material, sj-docx-2-mde-10.1177_23821205241234541 for An Online Pediatric Palliative Care Education and Mentoring (Project ECHO) in Nepal: A Program Implementation Case Study and Assessment of Changes in Healthcare Providers’ Knowledge, Confidence, and Attitudes by Anisha Lynch-Godrei, Sudhir Sapkota, Jennifer Rowe, Bishnu Dutta Paudel, Garima Aryal and Megan Doherty in Journal of Medical Education and Curricular Development
Supplemental Material
sj-docx-3-mde-10.1177_23821205241234541 - Supplemental material for An Online Pediatric Palliative Care Education and Mentoring (Project ECHO) in Nepal: A Program Implementation Case Study and Assessment of Changes in Healthcare Providers’ Knowledge, Confidence, and Attitudes
Supplemental material, sj-docx-3-mde-10.1177_23821205241234541 for An Online Pediatric Palliative Care Education and Mentoring (Project ECHO) in Nepal: A Program Implementation Case Study and Assessment of Changes in Healthcare Providers’ Knowledge, Confidence, and Attitudes by Anisha Lynch-Godrei, Sudhir Sapkota, Jennifer Rowe, Bishnu Dutta Paudel, Garima Aryal and Megan Doherty in Journal of Medical Education and Curricular Development
Footnotes
Acknowledgements
The authors would like to acknowledge the support of Two Worlds Cancer Collaboration Foundation, the Nepalese Association of Palliative Care, the Pain Relief and Palliative Care Society (India), and ECHO India for their support with the implementation of this Project ECHO. The support of Vineela Rapelli and Dr Gayatri Palat in the development and implementation of the Project ECHO were instrumental to facilitating this research.
Author contributions
Conception and Design: MD, ALG, BP GA, JR, SS
Administrative support: GA, JR
Provision of study materials or patients: BP, MD, SS
Collection and assembly of data: MD, ALG, JR, GA
Data analysis and interpretation: ALG, MD, JR, GA
Drafting of the article or revising it for intellectual content: all authors
Final approval of manuscript: all authors
Accountable for all aspects of the work: all authors
Declaration of conflicting interests
The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The authors disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: JR was supported by funding from the 2020 OMSA/AMS Medical Student Education Research Grant.
Ethics statement
The study was approved by the Children's Hospital of Eastern Ontario Research Ethics Board (CHEO 17/201X). All participants provided written informed consent after receiving comprehensive written information about the study.
Supplemental material
Supplemental material for this article is available online.
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
