Sage Journals: Discover world-class research

Abstract

The aim of this scoping review is to outline the existing landscape of how real patients participate in the workplace-based assessment of trainees across diverse healthcare professions. In 2019–2020, the authors searched MEDLINE, EMBASE, CINAHL, PsycINFO, ERIC, and Web of Science databases for studies that included descriptions of experiences whereby patients received care from a health professional trainee and participated in workplace-based assessments of that trainee. Full-text articles published in English from 2009 to 2020 were included in the search. Of the 8770 studies screened; 77 full-text articles were included. Analysis showed that strategies for patient participation in workplace-based assessment varied widely. Aspects studied ranged from validation of an assessment tool to evaluation of the impact of an educational intervention on trainees’ performance. Assessment of patient satisfaction was the most common approach to patient involvement. The majority of studies were conducted in North America and in the context of physician training. Formal patient participation in the assessment of health professional trainees appears heterogeneous across health professions. Gaps in the literature are evident; therefore, this review points to an inclusive approach to workplace-based assessment to ensure patient feedback of the trainees who care for them is represented.

Keywords

health professions education patient-centred education workplace-based assessment competency-oriented feedback workplace-based learning

Introduction

Training health professionals who are ready to meet the challenges of current and changing societal needs is necessary for quality healthcare delivery (Frank et al., 2010; Suikkala et al., 2018; Touchie & ten Cate, 2016). Given the emphasis on patient-centred care, educational programs must equip trainees with competencies to address patients’ individual values, needs, and preferences. Involvement of patients in the training process can transform how health professional trainees ultimately communicate and practice safe patient care. (Lehane et al., 2019). Despite continuous efforts to provide patient-centred care, incorporation of patients in the assessment of health professional trainees appears to be lagging. The patient voice is noticeably absent from competency-based assessments even though patient participation throughout the educational spectrum aligns with true patient-centred health professions education and increased patient feedback opportunities would enhance trainee social accountability (Regan de Bere & Nunn, 2016).

Active patient participation in health professions education at undergraduate, postgraduate, and continuing professional development levels has increased dramatically during the last 20 years (Suikkala et al., 2018). Real patients play critical roles in health professional trainee learning experience as standardized patients (SPs), simulated patients, patient volunteers, virtual patients, patient partners, patient tutors, and real patients (Hudson & Ratnapalan, 2014; Towle, 2006). A “real” patient is defined as “someone who has a direct lived experience with the disease and/or condition they sought to display” (Rowland et al., 2019). This description distinguishes real patients from individuals who do not actually have a condition or a disease and who have been trained to represent it or “role-play” (Towle et al., 2010). Various contributions of real patients to health professions education, such as their role in curriculum development (Towle, 2006) and delivery (Bollard et al., 2012), storytelling of lived experiences (Rowland & Kumagai, 2018), and bedside teaching (Monrouxe et al., 2009) have been explored. However, in our view, research demonstrating patient involvement workplace-based assessment (WBA) of health professional trainees has been neglected.

Workplace-based assessment encompasses different assessment techniques of trainee performance (e.g., case-based discussions, direct observation of procedural skills, and mini-clinical evaluation exercises) in a clinical learning environment combined with feedback (Guraya, 2015; Moreau et al., 2019) provided by a supervisor, in some disciplines known as a clinical educator, preceptor, or field advisor. (Bridge et al., 2014). Fostering reflective practice of trainees through the observation of trainee performance together with pertinent feedback, is a hallmark of WBA (Guraya, 2015). In conventional WBA, the patient’s perspective is proxied by the trainee’s supervisor (Bridge et al., 2014). The supervisor observes the-trainee-patient interaction and provides performance feedback to the trainee which may not fully represent the patient’s own experience. We argue that patients themselves are able to bring insightful perspectives on the trainee’s performance owing to their direct interactions with them.

Providing patients with opportunities to offer feedback regarding the care trainees provide can promote the provision of holistic patient-centred care (Bowe & Armstrong, 2017; Carraccio et al., 2016; Kogan & Holmboe, 2013). A patient-generated perspective would be a valuable supplement to existing assessment strategies and serve as a potential patient-focused means of identifying areas of future improvement for trainees (McMahon-Parkes et al., 2016). Feedback in health professional WBA is also facilitates trainee transition into practices committed to patient-centred health care using patient knowledge and lived experiences in clinical settings (Suikkala et al., 2018). Prior research illustrates the variety of ways patients participate in health professions education, but real patients' perspectives on the care they receive or their involvement in non-physician trainee assessment is understudied (Suikkala et al., 2018). Khalife et al. (2022) have recently explored the literature on patient involvement in the assessment of medical trainees and found that patients may take part either as a stand-alone group or as part of a multi-source feedback process. Moreover, patients made comments about the professional conduct and communication skills they witnessed, as opposed to assessments by physicians who focused on the trainee’s medical knowledge (Khalife et al., 2022). Unfortunately, the review by Khalife and team (2022) was limited to evidence on the ways patient participate in competency-based assessment of post-graduate physician trainees (e.g., medical residents and fellows). However, we argue that the need for understanding patient perspectives on trainee performance is required across all health professions education. Accordingly, we conducted this scoping review which is guided by the following broad research question, “What published experiences exist regarding active participation by real patients in the workplace-based assessment of health professional trainees?”

Methods

We chose to perform a scoping review as it seeks to identify a body of emerging evidence (Munn et al., 2018) and offer a broad perspective of a topic in question (Pham et al., 2014). We conducted a comprehensive, structured literature review utilizing the expertise of a medical librarian (VK) to map the evidence and gauge the state of the published experiences regarding real patients’ involvement in the education and, in particular, the assessment of a learner in training across diverse health care professions. Our scoping review was conducted using a framework initially proposed by Arksey and O’Malley (2005) then adapted by Levac and team (2010). This framework consists of a five-step process: (1) composing the research question; (2) identifying potentially eligible studies; (3) selecting relevant studies according to a predefined criterion; (4) charting the data; and (5) collating, summarizing, and reporting the findings.

Search Strategy

A search strategy was developed using the PICO format (Population, Intervention, Comparison, and Outcome) (Schardt et al., 2007) to identify published studies and conference proceedings using the electronic databases MEDLINE, EMBASE, CINAHL, ERIC, Web of Science, and PsycINFO (see Supplemental Digital Appendix A). An initial search was performed in Medline (Ovid), the results of which went through a Peer Review of Electronic Search Strategies (PRESS) (McGowan et al., 2016) (see Supplemental Digital Appendix A) for search submission and peer review assessment form). Once the PRESS was completed, the search strategy was applied to all other databases, with adaptions to keywords, subject headings, and index terms as needed to align with the characteristics and properties of each database (see Supplemental Digital Appendix B for search terms used). Two searches were conducted, one for medicine and nursing and a one for various other health professions, including pharmacy, dentistry, physical therapy, occupational therapy, dietetics/nutrition, emergency medical technician (EMT)/paramedic, respiratory therapy, and social work. Our rationale for conducting two separate searches was to account for the variety and relevance of subject coverage in specific bibliographic databases as well as the need to differentiate themes arising in each health profession. The searches were carried out between January 2020 and May 2020 without applying any geographical limits. To ensure that the search was as exhaustive as possible, additional studies were identified by hand-searching and screening the reference lists of the full-text articles selected and included in the review.

Citation Management

All the references were exported into RefWorks ProQuest. Articles were grouped according to the database and health profession, either medicine + nursing or other health professions. Duplicates were removed manually and using the deduplication feature in RefWorks ProQuest.

Study Screening and Selection

A two-phase screening process was used. In phase one, AN independently screened titles and abstracts for relevance based on the following criteria: 1) empirical studies and conference proceedings published in English; 2) contained an abstract; and 3) included descriptions of systems or experiences whereby patients received care from a health professional trainee in a workplace setting and participated in performance assessment of the trainee. In phase two, full-text articles were reviewed independently by two researchers, with AN as the first screener and one of either KW or MP as the second screener. Inclusion and exclusion criteria applied in our screening are summarized in Table 1. Disagreements were resolved through discussion to reach consensus (AN, KW, and MP).

Table 1.

Summary of Inclusion and Exclusion Criteria

Criteria	Inclusion	Exclusion
Language	English	Non-English
Type of publication	Full-text articles, thesis/dissertation, conference proceedings, posters, and book chapters	Review articles
Study population	Real patients, their family members and/or caregivers OR service users AND cared for by a learner in training (undergraduate student, graduate student, trainee, intern, resident, or fellow)	Standardized, simulated, trained, volunteer, or role-playing patients, patient partners, patient tutors, health mentors, or health educators OR care providers who were practicing health care professional such as attendings, supervisors, faculty members, preceptors, specialists, or consultants
Intervention	Assessment/evaluation/feedback/opinion on care provided by a health professional trainee AND focused and directed at an individual trainee	General and unfocused perceptions of health professional trainee involvement in patient care
Setting	Learning context OR clinical learning environment OR competency-oriented OR workplace-based	Objective structured clinical examination (OSCE) OR classroom teaching

Data Extraction

Relevant data from eligible papers was collected using a predesigned data extraction form (see Supplemental Digital Appendix C) on which following information was collected: 1) citation; 2) study location/country; 3) study setting (discipline, site/context, study participants and inclusion criteria); 4) study objectives; 5) methods (study design, theoretical framework, data collection tools, and analysis); 6) outcomes; 7) results; and 8) conclusion.

Data Synthesis and Analysis

We conducted content analysis for the included studies. Because our analysis is of descriptive nature, we combined qualitative, quantitative, and mixed-methods in the same analysis (Suikkala et al., 2018) and categorized the included studies based on their objectives and/or aims. We did not perform risk of bias or quality assessments of the selected studies because, unlike systematic reviews, such assessments are not typically conducted for scoping reviews since the former are frequently carried out to give an overview of the available evidence, regardless of the methodological quality or risk of bias (Tricco et al., 2018).

Results

Overview of Included Studies

We included 77 articles in this scoping review after screening and the exclusion of 8693 articles (Figure 1). The majority of published experiences describing patient involvement in WBA is found within physician training programs (n = 65; 84.4%) followed distantly by nursing education (n = 7; 9%). More than half of the articles identified were situated in the United States (n= 43; 55.8%) (Table 2). We organized these study objectives and subsequent findings into six specific categories of patient participation in the WBA of health professional trainees which include; 1) patient satisfaction with trainee care; 2) patient feedback using an assessment tool; 3) patients as contributors to multi-source feedback systems; 4) patient feedback to evaluate an educational intervention (such as a workshop, curriculum, or module) on trainee performance and skills.; 5) patient feedback and influence on trainee learning; and 6) factors influencing patient feedback. Some studies had several objectives that were organized into more than one of the categories discussed below (see Supplemental Digital Appendix D for characteristics of included studies). In many studies, patients were asked to provide feedback not on overall trainee performance but instead on specific skills and behaviour such as communication, empathy levels, interpersonal skills, and professionalism by completing questionnaires and/or participating in interviews.

Figure 1.

PRISMA Flow Diagram for the Scoping Review Process

Table 2.

Location of Full-Text Articles Included (n = 77), Scoping Review of the Literature on Patient Involvement in Workplace-Based Assessment of Health Professional Trainees 2009–2020

Location	No. (%)
Health profession
Medicine	65 (84.4)
Nursing	7 (9.0)
Dentistry	3 (3.9)
Social work	1 (1.3)
Radiotherapy	1 (1.3)
Geographic location
USA	43 (55.8)
Europe	10 (13.0)
UK	9 (11.7)
Canada	5 (6.5)
Asia	4 (5.2)
Australia and New Zealand	3 (3.9)
Brazil	2 (2.6)
Database
MEDLINE	41 (53.2)
CINAHL	17 (22.1)
EMBASE	13 (16.9)
PsycINFO	4 (5.2)
Web of science	2 (2.6)

Patient Satisfaction with Trainee Care

Among the most common aspects of patient involvement in the WBA of health professional trainees is examining patient satisfaction with care provided by trainees (Canales et al., 2019; Dalia & Schiffman, 2010; Sherbuk & Barakat, 2019). Patients and/or their families and caregivers were asked to characterize their satisfaction with the quality of their care encounter with a trainee alone (Oskay et al., 2015; Turner et al., 2016) or when the trainee joined the care provided by a clinical supervisor (Beard et al., 2020; Li et al., 2018). Patients views on trainee performance and competency in aspects of care such as professionalism (Niedermier, 2017), communication (Niedermier, 2017; Oda et al., 2014; Stewart et al., 2011), and interpersonal skills (Niedermier, 2017; Oda et al., 2014) were gathered, sometimes using a standard tool such as the patient satisfaction questionnaire (PSQ) (Nouri et al., 2018). Patient satisfaction was also examined in relation to other factors such as training level (Dudas et al., 2010; Nadkarni et al., 2014), trainee self-satisfaction (Kamangar et al., 2016; Francis et al., 2014), quality of care, or workload (Francis et al., 2014). Other researchers used survey questionnaires to measure patient satisfaction with care provided by a health professional trainee within a trainee-run clinic (Riddle et al., 2014; Witherspoon et al., 2019).

Patient Feedback using an Assessment Tool

The objective of some studies was to test the feasibility and/or value of collecting assessment data from patients using an assessment tool to gain insight into patients’ perspectives on their involvement in trainee assessment process (Bridge et al., 2014), capture the patient experience of trainee care by examining the facilitators and barriers to obtaining feedback from patients (Mahoney et al., 2019) or develop and validate a new patient feedback tool (Debyser et al., 2020; Dine et al., 2014; Reinders et al., 2009; Sripada et al., 2011). Diachun and colleagues (2012) studied patients’ and caregivers’ ability to complete a performance evaluation following trainee care. Ward and Benbow (Ward & Benbow, 2016) also sought to collect information about trainee performance through the patients’ own words using a feedback form. In the same study, researchers also examined how patient feedback would reflect the qualities patients value when receiving care from a health professional trainee (Ward & Benbow, 2016). Le Comte and colleagues (2016) used a standard tool (patient surveys) to assess patient perceptions of the health professional trainees care including respect, listening, understanding the patient concerns and confidentiality. In other more specific circumstances, patients were asked about their perceptions of certain aspects of trainees’ communication skills (Khan et al., 2016; Newcomb et al., 2017; Wen et al., 2012), shared understanding between patients and trainees (Khan et al., 2016), and trainee knowledge and the clinical care patients received, (Pecha et al., 2015) using questionnaires, patient opinions of the education they received during challenging consultations by trainees was compared to that of their supervisors (Wouda & van de Wiel, 2015). Schoenborn and team (2017) aimed to gain an insight into patient perspectives of the communication and clinical decisions made by trainees during primary care. In another study, Wiggins et al. (Wiggins et al., 2009) solicited patient perceptions on whether trainees demonstrated professionalism through certain behavioral, communicative and personal characteristics. Scheffer and colleagues (2013) adopted existing questionnaires to examine patient experiences with trainee empathy, patient-centredness, and patient enablement in an education ward, where health professional trainees were involved in direct patient care. The researchers also compared the patient experience in an educational ward with a regular non-education ward (Scheffer et al., 2013).

The Communication Assessment Tool (CAT), a validated instrument developed for patient assessment of the interpersonal communication skills of physicians (Makoul et al., 2007) was used by several researchers. For example, patients were asked to complete the CAT to evaluate the effectiveness of a specific educational intervention (e.g., history-taking) received by health professional trainees (Yu et al., 2018) or to assess the impact of a curriculum on trainees’ performance using patient feedback (DeBlasio et al., 2019; Dubosh et al., 2019). In other circumstances, the CAT was used to solicit patient feedback on trainees’ communication and confidence (Newcomb et al., 2018) or to examine whether trainee-related characteristics influence patient ratings of communication (Myerholtz et al., 2010). Newcomb and team (2017) also elicited SPs’ and real patients’ perceptions using CAT to develop and validate a feasible process for assessing trainees’ communication.

Patients as Contributors to Multi-Source Feedback Systems

Patient assessment of health professional trainees was sought as part of MSF initiatives which also included patients’ families and caregivers, trainee preceptors and mentors, health care site administrators, nurses, physicians, peers, and/or trainee self-assessment (Bernardo et al., 2019; Braend et al., 2010; Garra et al., 2011; Kamangar et al., 2016; McMahon-Parkes et al., 2016; Riveros et al., 2016; Tiao et al., 2013). Patient feedback was triangulated with trainee self-assessment (Braend et al., 2010; Persson et al., 2013), assessment from trainee and faculty (Keister et al., 2017), clinician and non-clinician (Murphy et al., 2009), faculty and non-faculty evaluators (Warm et al., 2010), or grades assigned by the trainee’s tutor (Santiago & Neto, 2016). Speers and Lathlean (Speers & Lathlean, 2015) designed, evaluated, and examined a multisource feedback system that helped trainees seek patient perspective of trainee interpersonal skills on their own, independent of their supervisors.

Other purposes for obtaining patient input as part of wider stakeholder feedback in WBA included: 1) developing and implementing a multi-source assessment method (Sharma et al., 2012; Wener et al., 2011); 2) examining the reliability and/or feasibility of a validated MSF tool (Garra et al., 2011; Murphy et al., 2009); or adapting an existing MSF instrument (LaMantia et al., 2017); 3) associating patient feedback on trainee communication skills with trainee self-perception (Ford et al., 2014); 4) evaluating the feasibility and acceptability of video supervision of patient care (Groener et al., 2015); or 5) assessing the degree of patient-centredness in a clinic (Mazanec et al., 2015). Noordman and colleagues (2019) specifically evaluated trainee patient-centred skills such as communication and empathy from a trifocal point of view through feedback offered by patients, observers, and the trainees themselves. Hall et al., (2019) also examined the correlation between trainees’ scores on standardized video interviews with faculty- and patient-rated scores of communication, professionalism, and interpersonal skills. Another study compared perspectives of SPs with that of actual patients to see how closely they agreed on rating trainee communication skills and professionalism (Sattler et al., 2017). Similarly, Debyser and team (2011) examined how patient feedback on trainee performance was consistent with feedback solicited from the trainee and their educators. In one study, the researchers compared how patients and their families perceived bad news delivered by health professional trainees with how the bad news was perceived by physicians (Toutin-Dias et al., 2016).

Patient Feedback to Evaluate an Educational Intervention

In some instances, patient feedback was collected to assess the impact of an educational intervention on health professional trainees’ competencies and skills, sometimes using a validated assessment tool or a patient satisfaction questionnaire (Oda et al., 2014). Educational interventions involved the creation and delivery of an educational experience of a coaching experience (Rassbach et al., 2019), a new curriculum (Canales et al., 2019; DeBlasio et al., 2019; Dubosh et al., 2019; Mitchell et al., 2016; Niedermier, 2017; Oda et al., 2014), training program (Bylund et al., 2018; Latta et al., 2013; Schutte et al., 2018; Yu et al., 2018), or an educational module (Lin et al., 2013; McElroy et al., 2014) where patient perspectives were collected to determine changes in specific in trainee performance such as patient history-taking, communication, confidence, interpersonal skills, and professionalism.

Patient Feedback and Influence on Learning

Patient responses to questions about trainee communication were elicited to determine its nature, its value as a means of providing feedback for trainees (Gharib et al., 2017), and how trainees perceived it (Grieveson et al., 2011). Davies and Lunn (2009) recruited patients to offer their formative assessment and examined the potential role of patients in participating in trainee assessment from the trainees’ point of view. Other researchers explored the process of collecting feedback from patients and how it could be used as a potential learning opportunity for future practice (Masters & Forrest, 2010; Pearl et al., 2018) and whether patient feedback contributed to trainees passing or failing (Pearl et al., 2018).

Factors Influencing Patient Feedback

In one study, the demographics of patients and their families such as socioeconomic status or race/ethnicity were assessed in relation to patient ratings of the care they received from a health professional trainee to examine the potential contextual influences on patient feedback (Long et al., 2014). Other studies examined the correlation of patients’ and/or caregivers’ attitudes towards trainees with trainee-related characteristics such as level of training (Dudas et al., 2010; Myerholtz et al., 2010; Nadkarni et al., 2014), trainee gender and first language (Myerholtz et al., 2010), or patient and trainee demographics (Persson et al., 2013). Ratelle and team (2020) refined an existing tool to examine the correlation between patient assessment of trainee professionalism with patient demographic data such as sex, race/ethnicity, and education level and resident characteristics like sex, age, and previous medical training.

Discussion

To our knowledge and to this date, this is the first scoping review to locate published experiences describing real patient participation in the WBA of health professional trainees. Specifically, our review broadens the perspective on the existing landscape of patient participation in WBA of trainees in important ways: the inclusion of diverse health professions and the assessment methods employed. Yet aside from assessment of physicians- and nurses -in-training, this scoping review discouragingly found no published experiences of the patient role in WBA of other health professional trainees. Our synthesis aligns with other scholars who also underlined the abundance of research on real patient participation in the clinical learning of medical trainees compared to trainees from other disciplines such as pharmacy and dentistry (Bing-You et al., 2017; Suikkala et al., 2018).

The lack of evidence on patient participation in the WBA of a broader health professional trainee population is alarming and warrants a prompt action. If health professional training programs claim to be educating future patient-centred practitioners, patients must be offered more accountability, specifically by having an active voice in the trainee assessment process. Our review suggests that medicine and nursing professions have a more diverse, yet still scattered and unsystematic means for patient assessment of trainees compared to other health professions. Correspondingly, a more concerted effort and collaboration is needed to understand how to better incorporate patients within our assessment systems. Although students in other health professions programs are typically outnumbered by medical and nursing trainees (U.S. Bureau of Labor Statistics, 2020), these curricula often share a mutual competency-based approach to education (Gruppen et al., 2012; Lucey et al., 2018) and in fact have overlapping professional training needs such as communication, professionalism, and interpersonal skills. We strongly encourage health professions educators from different backgrounds and disciplines to take a step towards an inclusive patient-centred education by borrowing from the experiences of the health professions highlighted in our review. For example, the data assessment methods used such as the CAT and aspects of trainee performance and skills assessed by patients. The CAT has the advantage of being a pre-existing and validated assessment tool which was used by multiple researchers included in this review and could be readily adopted by any health profession to collect patient feedback on trainee communication (Makoul et al., 2007). Less is known how the perspectives of patients’ family members or caregivers could be incorporated in MSF provision (Moreau et al., 2019). The experiences and views of the patient’s family member or caregiver are vital to enrich health professional trainees’ learning as they might hold additional opinions of trainees’ performance owing to the prominent role, they sometimes play in the patient’s health care journey. Another area that is worth navigating is the feasibility and value of having trainees directly solicit the patient perspective as we highlighted earlier in the work undertaken by Speers and Lathlean (2015).

There are specific patient-centred ethical aspects worth emphasizing in the process of patient involvement in the WBA of trainees (Suikkala et al., 2018). In particular, some patients might have certain concerns or reservations with respect to how sharing their perspectives on trainees might impact the quality of care they receive; therefore, it is of crucial importance that the patient’s right to self-determination is acknowledged and respected. Correspondingly, ethical aspects which should be considered when requesting patient feedback include honouring the patient’s preferences on their anonymity, confidentiality, and vulnerability along with feedback timing and patient’s capability and availability when requesting their feedback (Suikkala et al., 2018). Our review also proposes some aspirational avenues for future research in which the position of the health professional trainee in the patient assessment interface including their role, perspectives, and receptiveness of patient feedback, is considered. For instance, coaching feedback has been extensively used in medical education in which trainees are trained with a coach to process feedback by analyzing and reflecting on it to define goals and build a strategy to achieve them (Armson et al., 2019; Khalife et al., 2022). We believe that understanding how coaching feedback based on patient input may promote trainee professional growth, learning, and practice improvements that ultimately enhance patient care and outcome warrants future research (Khalife et al., 2022).

Research reveals several benefits of involving patients in health professional trainees’ assessment, including enhancing trainees’ partnership, advocacy, and communication, and detecting potential areas of improvement in the teaching and learning process (Crawley & Frazer, 2015; Khalife et al., 2022). The responsibility of teaching health professional trainees the value and benefits of involving patients in their assessment is mostly shouldered by health professions educational institutions and programs. The use of patient-centred approaches to health professions education is continuously evolving and health professions curricula are the best place to start incorporating more patient perspectives. Health professions educators must adjust their curricula to meet the dynamic and critical changes in the health care environment. Incorporating the patient voice into the processes for assessment of experiential and workplace-based learning would be a valuable addition to the curriculum. In rapidly changing clinical and educational settings, patient input would also be an asset in curriculum design, evaluation, and improvement to maintain course quality and promote trainees learning outcomes. The notion of involving patients in the WBA of health professional trainees was found to be welcomed and well-received by both trainees and patients. Several studies examined the potential for involving patients in the assessment of medical (Davies & Lunn, 2009; Grujich et al., 2012) and nursing (Duygulu & Abaan, 2013) trainees by soliciting trainees’ perspectives on having patients be part of the trainee WBA. Some trainees reported feeling at ease with having patients assess their performance and some trainees stated that receiving patient feedback boosted their confidence (Davies & Lunn, 2009), others favored the involvement patients in their assessment process and thought that it would be beneficial to have patients as part of the assessment during clinical placements (Duygulu & Abaan, 2013). Students justified their preferences by stating that patients spend considerable time with them in the practice setting (Duygulu & Abaan, 2013). Research also shows that patients deem their contribution to trainee educational experience as an altruistic means of giving back to their community (Morgan et al., 2013; Suikkala et al., 2018; Wykurz & Kelly, 2002).

Strengths and Limitations

Strengths and limitations of this scoping review warrant discussion. Having three researchers working independently screen and synthesize articles helped ensure reliability. However, the search strategy was limited to studies published in English language; therefore, we may not have located all available evidence regarding real patients’ active participation in the WBA of health professional trainees. Over 50% of the included studies were conducted in the United States and therefore our findings are contextualized for a North American training and assessment landscape. In addition, our review did not incorporate any grey literature that may have reported anecdotal experiences. As educational scholarship is an evolving field, it is possible that reports exploring patient involvement in health professional trainee assessment are limited. Academic programs may be incorporating patient input into their curricula without disseminating their research findings or publishing their experiences.

Conclusion

Although real patient perspectives are valuable in trainees’ skill development and professional growth, research on formalized patient roles in WBA of health professional trainees is lacking. Overall, there is limited evidence of patient participation in competency-based feedback of trainees in medicine and nursing fields and even less evidence that patients’ perspectives are incorporated in the feedback process for other health professional trainees. Published experiences from medicine and nursing educational contexts indicate that both professions have more diverse and concrete means for patient assessment of trainees than other health professions. This review also reveals that formal patient roles in health professional trainee assessment are inconsistent in the ways patient feedback is elicited and the outcomes that are assessed. This gap in the literature points to the need to change the existing pedagogical techniques of WBA by incorporating the patient voice into trainees’ assessment processes.

Supplemental Material

Supplemental Material - Real Patient Participation in Workplace-Based Assessment of Health Professional Trainees: A Scoping Review

Supplemental Material for Real Patient Participation in Workplace-Based Assessment of Health Professional Trainees: A Scoping Review by Arwa Nemir, Marion Pearson, Vanessa Kitchin, and Kerry Wilbur in Evaluation & the Health Professions

Footnotes

Acknowledgments

We acknowledge the hard work, time, and dedication of all the included authors in this scoping review.

Authors’ Contributions

Arwa Nemir, Marion Pearson, Vanessa Kitchin, and Kerry Wilbur made significant contributions to the conception of this scoping review, including being responsible for all the key decisions regarding the study design, database screening, data acquisition, abstraction, analysis, and interpretation of the data, writing of the review, and presentation of results. All authors granted final approval of the version to be published and agreed to be responsible for all elements of the work, including ensuring that any issues about the work’s accuracy or integrity are properly investigated and addressed.

Declaration of Conflicting Interests

The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Funding

The author(s) received no financial support for the research, authorship, and/or publication of this article.

Supplemental Material

Supplemental material for this article is available online.

References

Arksey

O’Malley

(2005). Scoping studies: Towards a methodological framework. International Journal of Social Research Methodology, 8(1), 19–32. https://doi.org/10.1080/1364557032000119616

Armson

Lockyer

J. M.

Zetkulic

Könings

K. D.

Sargeant

(2019). Identifying coaching skills to improve feedback use in postgraduate medical education. Medical Education, 53(5), 477–493. https://doi.org/10.1111/medu.13818

Beard

A. S.

Candy

A. E.

Anderson

T. J.

Derrico

N. P.

Ishani

K. A.

Gravely

A. A.

Englander

Ercan-Fang

N. G.

(2020). Patient satisfaction with medical student participation in a longitudinal integrated clerkship: A controlled trial. Academic Medicine: Journal of the Association of American Medical Colleges, 95(3), 417–424. https://doi.org/10.1097/ACM.0000000000003021

Bernardo

M. O.

Cecilio-Fernandes

Lima

A. R. d. A.

Silva

J. F.

Ceccato

H. D.

Costa

M. J.

de Carvalho-Filho

M. A.

(2019). Investigating the relation between self-assessment and patients’ assessments of physicians-in-training empathy: A multicentric, observational, cross-sectional study in three teaching hospitals in Brazil. BMJ Open, 9(6), Article e029356. https://doi.org/10.1136/bmjopen-2019-029356

Bing-You

Hayes

Varaklis

Trowbridge

Kemp

McKelvy

(2017). Feedback for learners in medical education: What is known? A scoping review. Academic Medicine: Journal of the Association of American Medical Colleges, 92(9), 1346–1354. https://doi.org/10.1097/ACM.0000000000001578

Bollard

Lahiff

Parkes

(2012). Involving people with learning disabilities in Nurse Education: Towards an inclusive approach. Nurse Education Today, 32(2), 173–177. https://doi.org/10.1016/j.nedt.2011.10.002

Bowe

C. M.

Armstrong

(2017). Assessment for systems learning: A holistic assessment framework to support decision making across the medical education continuum. Academic Medicine: Journal of the Association of American Medical Colleges, 92(5), 585–592. https://doi.org/10.1097/ACM.0000000000001321

Braend

A. M.

Gran

S. F.

Frich

J. C.

Lindbaek

(2010). Medical students’ clinical performance in general practice – triangulating assessments from patients, teachers and students. Medical Teacher, 32(4), 333–339. https://doi.org/10.3109/01421590903516866

Bridge

Pirihi

Carmichael

(2014). The role of radiotherapy patients in provision of student interpersonal skills feedback. Journal of Radiotherapy in Practice, 13(2), 141–148. https://doi.org/10.1017/S1460396913000290

10.

Bylund

C. L.

Banerjee

S. C.

Bialer

P. A.

Manna

Levin

T. T.

Parker

P. A.

Schofield

Bartell

Chou

Hichenberg

S. A.

Dickler

Kissane

D. W.

(2018). A rigorous evaluation of an institutionally-based communication skills program for post-graduate oncology trainees. Patient Education and Counseling, 101(11), 1924–1933. https://doi.org/10.1016/j.pec.2018.05.026

11.

Canales

Strom

Anderson

C. T.

Fortier

M. A.

Cannesson

Rinehart

J. B.

Kain

Z. N.

Perret

(2019). Humanistic medicine in anaesthesiology: Development and assessment of a curriculum in humanism for postgraduate anaesthesiology trainees. British Journal of Anaesthesia, 123(6), 887–897. https://doi.org/10.1016/j.bja.2019.08.021

12.

Carraccio

Englander

Holmboe

E. S.

Kogan

J. R.

(2016). Driving care quality: Aligning trainee assessment and supervision through practical application of entrustable professional activities, competencies, and milestones. Academic Medicine: Journal of the Association of American Medical Colleges, 91(2), 199–203. https://doi.org/10.1097/ACM.0000000000000985

13.

Crawley

Frazer

(2015). Posters as assessment strategies: Focusing on service users. British Journal of Nursing, 24(16), 830–832. https://doi.org/10.12968/bjon.2015.24.16.830

14.

Dalia

Schiffman

F. J.

(2010). Who’s my doctor? First-year residents and patient care: Hospitalized patients’ perception of their “main physician. Journal of Graduate Medical Education, 2(2), 201–205. https://doi.org/10.4300/JGME-D-09-00082.1

15.

Davies

C. S.

Lunn

(2009). The patient’s role in the assessment of students’ communication skills. Nurse Education Today, 29(4), 405–412. https://doi.org/10.1016/j.nedt.2008.08.018

16.

DeBlasio

Real

F. J.

Ollberding

N. J.

Klein

M. D.

(2019). Provision of parent feedback via the communication assessment tool: Does it improve resident communication skills? Academic Pediatrics, 19(2), 152–156. https://doi.org/10.1016/j.acap.2018.06.013

17.

Debyser

Grypdonck

M. H. F.

Defloor

Verhaeghe

S. T. L.

(2011). Involvement of inpatient mental health clients in the practical training and assessment of mental health nursing students: Can it benefit clients and students? Nurse Education Today, 31(2), 198–203. https://doi.org/10.1016/j.nedt.2010.06.001

18.

Debyser

Van Hecke

Duprez

Malfait

Beeckman

Verhaeghe

(2020). The evaluation of nursing students by patients instrument (ENSPA): Development and validation. Nurse Education Today, 89, 104391. https://doi.org/10.1016/j.nedt.2020.104391

19.

Diachun

L. L.

Klages

K. B.

Hansen

K. T.

Blake

Gordon

(2012). The comprehensive geriatric assessment guide: An exploratory analysis of a medical trainee performance evaluation tool. Academic Medicine: Journal of the Association of American Medical Colleges, 87(12), 1679–1684. https://doi.org/10.1097/ACM.0b013e318271cad8

20.

Dine

C. J.

Ruffolo

Lapin

Shea

J. A.

Kogan

J. R.

(2014). Feasibility and validation of real-time patient evaluations of internal medicine interns’ communication and professionalism skills. Journal of Graduate Medical Education, 6(1), 71–77. https://doi.org/10.4300/JGME-D-13-00173.1

21.

Dubosh

Hall

Novack

Shafat

Shapiro

Ullman

(2019). A multimodal curriculum with patient feedback to improve medical student communication: Pilot study. The Western Journal of Emergency Medicine, 21(1), 115–121. https://doi.org/10.5811/westjem.2018.11.44318

22.

Dudas

R. A.

Lemerman

Barone

Serwint

J. R.

(2010). PHACES (photographs of academic clinicians and their educational status): A tool to improve delivery of family-centered care. Academic Pediatrics, 10(2), 138–145. https://doi.org/10.1016/j.acap.2009.12.006

23.

Duygulu

Abaan

(2013). Turkish nursing students’ views on practice assessments and service user involvement. Contemporary Nurse, 43(2), 201–212. https://doi.org/10.5172/conu.2013.43.2.201

24.

Ford

D. W.

Downey

Engelberg

Back

A. L.

Curtis

J. R.

(2014). Association between physician trainee self-assessments in discussing religion and spirituality and their patients’ reports. Journal of Palliative Medicine, 17(4), 453–462. https://doi.org/10.1089/jpm.2013.0388

25.

Francis

M. D.

Warm

Julian

K. A.

Rosenblum

Thomas

Drake

Gwisdalla

K. L.

Langan

Nabors

Pereira

Smith

Sweet

Varney

Francis

M. L.

(2014). Determinants of patient satisfaction in internal medicine resident continuity clinics: Findings of the educational innovations project ambulatory collaborative. Journal of Graduate Medical Education, 6(3), 470–477. https://doi.org/10.4300/JGME-D-13-00398.1

26.

Frank

J. R.

Snell

L. S.

Cate

O. T.

Holmboe

E. S.

Carraccio

Swing

S. R.

Harris

Glasgow

N. J.

Campbell

Dath

Harden

R. M.

Iobst

Long

D. M.

Mungroo

Richardson

D. L.

Sherbino

Silver

Taber

Talbot

Harris

K. A.

(2010). Competency-based medical education: Theory to practice. Medical Teacher, 32(8), 638–645. https://doi.org/10.3109/0142159X.2010.501190

27.

Garra

Wackett

Thode

(2011). Feasibility and reliability of a multisource feedback tool for emergency medicine residents. Journal of Graduate Medical Education, 3(3), 356–360. https://doi.org/10.4300/JGME-D-10-00173.1

28.

Gharib

Rolland

S. L.

Bateman

Ellis

J. S.

(2017). Just one thing: A novel patient feedback model. British Dental Journal, 222(10), 797–802. https://doi.org/10.1038/sj.bdj.2017.457

29.

Grieveson

Kirton

J. A.

Palmer

N. O. A.

Balmer

M. C.

(2011). Evaluation of workplace based assessment tools in dental foundation training. British Dental Journal, 211(4), E8–E8. https://doi.org/10.1038/sj.bdj.2011.681

30.

Groener

Bugaj

Scarpone

Koechel

Stiepak

Branchereau

(2015). Video-based on-ward supervision for final year medical students. BMC Medical Education, 15(1), 163. https://doi.org/10.1186/s12909-015-0430-2

31.

Grujich

N. N.

Razmy

Zaretsky

Styra

R. G.

Sockalingam

(2012). Evaluation of professional role competency during psychiatry residency. Academic Psychiatry: The Journal of the American Association of Directors of Psychiatric Residency Training and the Association for Academic Psychiatry, 36(2), 126–128. https://doi.org/10.1176/appi.ap.10060085

32.

Gruppen

L. D.

Mangrulkar

R. S.

Kolars

J. C.

(2012). The promise of competency-based education in the health professions for improving global health. Human Resources for Health, 10(1), 43. https://doi.org/10.1186/1478-4491-10-43

33.

Guraya

(2015). Workplace-based assessment; applications and educational impact. 6.

34.

Hall

Lewis

Joseph

Ketterer

Rosen

Dubosh

(2019). Standardized video interview scores correlate poorly with faculty and patient ratings. The Western Journal of Emergency Medicine, 21(1), 145–148. https://doi.org/10.5811/westjem.2019.11.44054

35.

Hudson

Ratnapalan

(2014). Teaching clinical skills with patient resources. Canadian family physician Medecin de famille canadien, 60(7), 674–677, e372-5.

36.

Kamangar

Davari

Parsi

K. K.

C.-S.

Wang

Mathis

Fazel

(2016). 360-degree evaluations on physician performance as an effective tool for interprofessional teams: A critical analysis of physician self-assessment as compared to nursing staff and patient evaluations of providers. Dermatology Online Journal, 22(7). https://doi.org/10.5070/D3227031661

37.

Keister

D. M.

Hansen

S. E.

Dostal

(2017). Teaching resident self-assessment through triangulation of faculty and patient feedback. Teaching and Learning in Medicine, 29(1), 25–30. https://doi.org/10.1080/10401334.2016.1246249

38.

Khalife

Gupta

Gonsalves

Park

Y. S.

Riddle

Tekian

Horsley

(2022). Patient involvement in assessment of postgraduate medical learners: A scoping review. Medical Education, 56(6), 602–613. https://doi.org/10.1111/medu.14726.

39.

Khan

Rogers

J. E.

Forster

C. S.

Furtak

S. L.

Schuster

M. A.

Landrigan

C. P.

(2016). Communication and shared understanding between parents and resident-physicians at night. Hospital Pediatrics, 6(6), 319–329. https://doi.org/10.1542/hpeds.2015-0224

40.

Kogan

J. R.

Holmboe

(2013). Realizing the promise and importance of performance-based assessment. Teaching and Learning in Medicine, 25(Suppl 1), S68–S74. https://doi.org/10.1080/10401334.2013.842912

41.

LaMantia

Yarris

L. M.

Sunga

Weizberg

Hart

Farina

Rodriguez

Lucas

Mahmooth

Snock

Lockyear

(2017). Developing and implementing a multisource feedback tool to assess competencies of emergency medicine residents in the United States. AEM Education and Training, 1(3), 243–249. https://doi.org/10.1002/aet2.10043

42.

Latta

Tordoff

Manning

Dent

(2013). Enhancing clinical skill development through an Ambulatory Medicine Teaching Programme: An evaluation study. Medical Teacher, 35(8), 648–654. https://doi.org/10.3109/0142159X.2013.801553

43.

Le Comte

Hayward

Hughes

Villa

Madell

(2016). Evaluation of general practice house officer attachments in Counties Manukau: Insights and benefits. Journal of Primary Health Care, 8(4), 288–294. Article 4 https://doi.org/10.1071/HC16001

44.

Lehane

Leahy-Warren

O’Riordan

Savage

Drennan

O’Tuathaigh

O’Connor

Corrigan

Burke

Hayes

Lynch

Sahm

Heffernan

O’Keeffe

Blake

Horgan

Hegarty

(2019). Evidence-based practice education for healthcare professions: An expert view. BMJ Evidence-Based Medicine, 24(3), 103–108. https://doi.org/10.1136/bmjebm-2018-111019

45.

Levac

Colquhoun

O’Brien

K. K.

(2010). Scoping studies: Advancing the methodology. Implementation Science: IS, 5(1), 69. https://doi.org/10.1186/1748-5908-5-69

46.

S. S.

Herrick

N. L.

Deshpande

R. R.

Cronin

B. J.

Reid

C. M.

Brandel

M. G.

Dobke

M. K.

Johnson

C. A.

Gosman

A. A.

(2018). The impact of residents on patient satisfaction. Annals of Plastic Surgery, 80(5S Suppl 5), S247–S250. https://doi.org/10.1097/SAP.0000000000001339

47.

Lin

Cuccurullo

S. J.

Innerfield

C. E.

Strax

T. E.

Petagna

(2013). Neuromuscular medicine competency in physical medicine and rehabilitation residents: A method of development and assessment. American Journal of Physical Medicine & Rehabilitation, 92(3), 258–266. https://doi.org/10.1097/PHM.0b013e3182745ed9

48.

Long

A. C.

Engelberg

R. A.

Downey

Kross

E. K.

Reinke

L. F.

Cecere Feemster

Dotolo

Ford

D. W.

Back

A. L.

Curtis

J. R.

(2014). Race, income, and education: Associations with patient and family ratings of end-of-life care and communication provided by physicians-in-training. Journal of Palliative Medicine, 17(4), 435–447. https://doi.org/10.1089/jpm.2013.0214

49.

Lucey

C. R.

Thibault

G. E.

ten Cate

(2018). Competency-based, time-variable education in the health professions: Crossroads. Academic Medicine: Journal of the Association of American Medical Colleges, 93(3S Competency-Based, Time-Variable Education in the Health Professions), S1–S5. https://doi.org/10.1097/ACM.0000000000002080

50.

Mahoney

Bogetz

Hirsch

Killmond

Phillips

Bhavaraju

McQueen

Orlov

Blankenburg

Rassbach

C. E.

(2019). The challenges of multisource feedback: Feasibility and acceptability of gathering patient feedback for pediatric residents. Academic Pediatrics, 19(5), 555–560. https://doi.org/10.1016/j.acap.2018.12.002

51.

Makoul

Krupat

Chang

C.-H.

(2007). Measuring patient views of physician communication skills: Development and testing of the Communication Assessment Tool. Patient Education and Counseling, 67(3), 333–342. https://doi.org/10.1016/j.pec.2007.05.005

52.

Masters

Forrest

(2010). How did I do? An analysis of service user feedback on mental health student nurses’ practice in acute inpatient mental health placements. The Journal of Mental Health Training, Education and Practice, 5(1), 11–19. https://doi.org/10.5042/jmhtep.2010.0215

53.

Mazanec

Arfons

Smith

Curry

Berman

Dimick

Lynch

Alvarado

Latini

D. M.

(2015). Preparing trainees to deliver patient-centered care in an ambulatory cancer clinic. Journal of Cancer Education: The Official Journal of the American Association for Cancer Education, 30(3), 460–465. https://doi.org/10.1007/s13187-014-0719-6

54.

McElroy

Cuccurullo

S. J.

Perret-Karimi

Hata

Ferrer

S. M.

Demesmin

Petagna

A. M.

(2014). Interventional pain management skills competency in pain medicine fellows: A method for development and assessment. American Journal of Physical Medicine & Rehabilitation, 93(8), 724–731. https://doi.org/10.1097/PHM.0000000000000142

55.

McGowan

Sampson

Salzwedel

D. M.

Cogo

Foerster

Lefebvre

(2016). PRESS peer review of electronic search strategies: 2015 guideline statement. Journal of Clinical Epidemiology, 75, 40–46. https://doi.org/10.1016/j.jclinepi.2016.01.021

56.

McMahon-Parkes

Chapman

James

(2016). The views of patients, mentors and adult field nursing students on patients’ participation in student nurse assessment in practice. Nurse Education in Practice, 16(1), 202–208. https://doi.org/10.1016/j.nepr.2015.08.007

57.

Mitchell

J. D.

Wong

Fisher

L. J.

Muret-Wagstaff

S. L.

Ott

Shahul

Bose

Tibbles

Jones

S. B.

(2016). The impact of a resident communication skills curriculum on patients’ experiences of care. A & A Case Reports, 6(3), 65–75. https://doi.org/10.1213/XAA.0000000000000277

58.

Monrouxe

L. V.

Rees

C. E.

Bradley

(2009). The construction of patients’ involvement in hospital bedside teaching encounters. Qualitative Health Research, 19(7), 918–930. https://doi.org/10.1177/1049732309338583

59.

Moreau

K. A.

Eady

Jabbour

(2019). Exploring residents’ reactions to and use of parent feedback in a pediatric emergency department: A grounded theory study. Medical Teacher, 41(2), 207–214. https://doi.org/10.1080/0142159X.2018.1460658

60.

Morgan

D. L.

Ataie

Carder

Hoffman

(2013). Introducing dyadic interviews as a method for collecting qualitative data. Qualitative Health Research, 23(9), 1276–1284. https://doi.org/10.1177/1049732313501889

61.

Munn

Peters

M. D. J.

Stern

Tufanaru

McArthur

Aromataris

(2018). Systematic review or scoping review? Guidance for authors when choosing between a systematic or scoping review approach. BMC Medical Research Methodology, 18(1), 143. https://doi.org/10.1186/s12874-018-0611-x

62.

Murphy

D. J.

Bruce

D. A.

Mercer

S. W.

Eva

K. W.

(2009). The reliability of workplace-based assessment in postgraduate medical education and training: A national evaluation in general practice in the United Kingdom. Advances in Health Sciences Education: Theory and Practice, 14(2), 219–232. https://doi.org/10.1007/s10459-008-9104-8

63.

Myerholtz

Simons

Felix

Nguyen

Brennan

Rivera-Tovar

Martin

Hepworth

Makoul

(2010). Using the communication assessment tool in family medicine residency programs. Family Medicine, 42(8), 567–573.

64.

Nadkarni

Sabharwal

M. S.

Ammakkanavar

N. R.

Annapureddy

Malhan

Mehta

Kanakadandi

V. N.

Agarwal

S. K.

Fried

E. D.

Fried

D. E.

(2014). Patient satisfaction and resident postgraduate year status. International Journal of Health Care Quality Assurance, 27(3), 182–189. https://doi.org/10.1108/IJHCQA-05-2012-0049

65.

Newcomb

Burton

Edwards

(2017). Service user or service provider? How social work and human services students integrate dual identities. Social Work Education, 36(6), 678–689. https://doi.org/10.1080/02615479.2017.1327574

66.

Newcomb

Trickey

A. W.

Lita

Dort

(2018). Evaluating surgical residents’ patient-centered communication skills: Practical alternatives to the “apprenticeship model. Journal of Surgical Education, 75(3), 613–621. https://doi.org/10.1016/j.jsurg.2017.09.011

67.

Niedermier

(2017). Understanding patient experience: A course for residents. MedEdPORTAL: The Journal of Teaching and Learning Resources, 13(1), 10558–18265. https://doi.org/10.15766/mep_2374-8265.10558

68.

Noordman

Post

van Dartel

A. A. M.

Slits

J. M. A.

olde Hartman

T. C.

(2019). Training residents in patient-centred communication and empathy: Evaluation from patients, observers and residents. BMC Medical Education, 19(1), 128. https://doi.org/10.1186/s12909-019-1555-5

69.

Nouri

Ghaffarifar

Sadeghi-Bazargani

(2018). Development of the Persian patient satisfaction questionnaire. International Journal of Health Care Quality Assurance, 31(8), 988–999. https://doi.org/10.1108/IJHCQA-06-2017-0101

70.

Oda

Onishi

Sakemi

Fujimoto

Koizumi

(2014). Improvement in medical students’ communication and interpersonal skills as evaluated by patient satisfaction questionnaire after curriculum reform. Journal of Clinical Biochemistry and Nutrition, 55(1), 72–77. https://doi.org/10.3164/jcbn.14-29

71.

Oskay

Ü.

Güngör

Basgöl

(2015). Evaluation of patients’ satisfaction with nursing students’ care on a perinatology ward. The Journal of Nursing Education, 54(12), 696–703. https://doi.org/10.3928/01484834-20151110-06

72.

Pearl

Williams

Brown

Hollington

Gruffydd

Jones

Yorke

Statham

(2018). Service user and carer feedback: Simply pass/fail or a genuine learning tool? Social Work Education, 37(5), 553–564. https://doi.org/10.1080/02615479.2017.1420768

73.

Pecha

F. Q.

Nicolello

T. S.

Xerogeanes

J. W.

Karas

Labib

S. A.

(2015). Patient perceptions of Athletic trainers and orthopaedic medical residents as primary clinical support staff in sports medicine practice. Journal of Allied Health, 44(4), 6.

74.

Persson

Haines

Lang

(2013). Parent assessment of medical student’s skills in ambulatory pediatrics. 10.

75.

Pham

M. T.

Rajić

Greig

J. D.

Sargeant

J. M.

Papadopoulos

McEwen

S. A.

(2014). A scoping review of scoping reviews: Advancing the approach and enhancing the consistency. Research Synthesis Methods, 5(4), 371–385. https://doi.org/10.1002/jrsm.1123

76.

Rassbach

C. E.

Bogetz

A. L.

Orlov

McQueen

Bhavaraju

Mahoney

Leibold

Blankenburg

R. L.

(2019). The effect of faculty coaching on resident attitudes, confidence, and patient-rated communication: A multi-institutional randomized controlled trial. Academic Pediatrics, 19(2), 186–194. https://doi.org/10.1016/j.acap.2018.10.004

77.

Ratelle

J. T.

Halvorsen

A. J.

Mandrekar

Sawatsky

A. P.

Reed

D. A.

Beckman

T. J.

(2020). Internal medicine resident professionalism assessments: Exploring the Association with patients’ overall satisfaction with their hospital stay. Academic Medicine: Journal of the Association of American Medical Colleges, 95(6), 902–910. https://doi.org/10.1097/ACM.0000000000003114

78.

Regan de Bere

Nunn

(2016). Towards a pedagogy for patient and public involvement in medical education. Medical Education, 50(1), 79–92. https://doi.org/10.1111/medu.12880

79.

Reinders

M. E.

Blankenstein

A. H.

Knol

D. L.

de Vet

H. C. W.

van Marwijk

H. W. J.

(2009). Validity aspects of the patient feedback questionnaire on consultation skills (PFC), a promising learning instrument in medical education. Patient Education and Counseling, 76(2), 202–206. https://doi.org/10.1016/j.pec.2009.02.003

80.

Riddle

M. C.

Lin

Steinman

J. B.

Salvi

J. D.

Reynolds

M. M.

Kastor

A. S.

Harris

Boutin-Foster

(2014). Incorporating the principles of the patient- centered medical home into a student-run free clinic. Advances in Medical Education and Practice, 5, 289–297. https://doi.org/10.2147/AMEP.S66762

81.

Riveros

Kimatian

Castro

Dhumak

Honar

Mascha

E. J.

(2016). Multisource feedback in professionalism for anesthesia residents. Journal of Clinical Anesthesia, 34, 32–40. https://doi.org/10.1016/j.jclinane.2016.03.038

82.

Rowland

Anderson

Kumagai

A. K.

McMillan

Sandhu

V. K.

Langlois

(2019). Patient involvement in health professionals’ education: A meta-narrative review. Advances in Health Sciences Education: Theory and Practice, 24(3), 595–617. https://doi.org/10.1007/s10459-018-9857-7

83.

Rowland

Kumagai

A. K.

(2018). Dilemmas of representation: Patient Engagement in health professions education. Academic Medicine: Journal of the Association of American Medical Colleges, 93(6), 869–873. https://doi.org/10.1097/ACM.0000000000001971

84.

Santiago

L. M.

Neto

(2016). SOAP methodology in general practice/Family medicine teaching in practical context. Acta Médica Portuguesa, 29(12), 854–859. https://doi.org/10.20344/amp.8405

85.

Sattler

A. L.

Merrell

S. B.

Lin

S. Y.

Schillinger

(2017). Actual and standardized patient evaluations of medical students’ skills. Family Medicine, 49(7), 548–552.

86.

Schardt

Adams

M. B.

Owens

Keitz

Fontelo

(2007). Utilization of the PICO framework to improve searching PubMed for clinical questions. BMC Medical Informatics and Decision Making, 7, 16. https://doi.org/10.1186/1472-6947-7-16

87.

Scheffer

Tauschel

Neumann

Lutz

Valk-Draad

Edelhäuser

(2013). Active Student participation may enhance patient centeredness: Patients’ assessments of the clinical education ward for integrative medicine. Evidence-based Complementary and Alternative Medicine: eCAM, 2013, 743832–743838. https://doi.org/10.1155/2013/743832.

88.

Schoenborn

N. L.

Cayea

McNabney

Ray

Boyd

(2017). Prognosis communication with older patients with multimorbidity: Assessment after an educational intervention. Gerontology & Geriatrics Education, 38(4), 471–481. https://doi.org/10.1080/02701960.2015.1115983

89.

Schutte

Prince

Richir

Donker

van Gastel

Bastiaans

de Vries

Tichelaar

van Agtmael

(2018). Opportunities for students to prescribe: An evaluation of 185 consultations in the student-run cardiovascular risk management programme. Basic & Clinical Pharmacology & Toxicology, 122(2), 299–302. https://doi.org/10.1111/bcpt.12904

90.

Sharma

Cui

Leighton

J. P.

White

J. S.

(2012). Team-based assessment of medical students in a clinical clerkship is feasible and acceptable. Medical Teacher, 34(7), 555–561. https://doi.org/10.3109/0142159X.2012.669083

91.

Sherbuk

J. E.

Barakat

L. A.

(2019). Training the next generation of HIV providers: Impact of trainees on patient satisfaction in an urban HIV clinic. AIDS Care, 31(1), 41–44. https://doi.org/10.1080/09540121.2018.1476663

92.

Speers

Lathlean

(2015). Service user involvement in giving mental health students feedback on placement: A participatory action research study. Nurse Education Today, 35(9), e84-e89. https://doi.org/10.1016/j.nedt.2015.07.004

93.

Sripada

B. N.

Henry

D. B.

Jobe

T. H.

Winer

J. A.

Schoeny

M. E.

Gibbons

R. D.

(2011). A randomized controlled trial of a feedback method for improving empathic accuracy in psychotherapy: Empathy. Psychology and Psychotherapy, 84(2), 113–127. https://doi.org/10.1348/147608310X495110

94.

Stewart

E. A.

Marzio

D. H.-D.

Guggenheim

D. E.

Gotto

Veloski

J. J.

Kane

G. C.

(2011). Resident scores on a patient satisfaction survey: Evidence for maintenance of communication skills throughout residency. Journal of Graduate Medical Education, 3(4), 487–489. https://doi.org/10.4300/JGME-D-11-00047.1

95.

Suikkala

Koskinen

Leino-Kilpi

(2018). Patients’ involvement in nursing students’ clinical education: A scoping review. International Journal of Nursing Studies, 84, 40–51. https://doi.org/10.1016/j.ijnurstu.2018.04.010

96.

Tiao

M.-M.

Huang

L.-T.

Huang

Y.-H.

Tang

K.-S.

Chen

C.-J.

(2013). Multisource feedback analysis of pediatric outpatient teaching. BMC Medical Education, 13(1), 145. https://doi.org/10.1186/1472-6920-13-145

97.

Touchie

ten Cate

(2016). The promise, perils, problems and progress of competency-based medical education. Medical Education, 50(1), 93–100. https://doi.org/10.1111/medu.12839

98.

Toutin-Dias

Daglius-Dias

Scalabrini-Neto

(2018). Breaking bad news in the emergency department: A comparative analysis among residents, patients and family members’ perceptions. European Journal of Emergency Medicine: Official Journal of the European Society for Emergency Medicine, 25(1), 71–76. https://doi.org/10.1097/MEJ.0000000000000404.

99.

Towle

(2006). Where’s the patient’s voice in health professional education? Nurse Education in Practice, 6(5), 300–302. https://doi.org/10.1016/j.nepr.2006.04.009

100.

Towle

Bainbridge

Godolphin

Katz

Kline

Lown

Madularu

Solomon

Thistlethwaite

(2010). Active patient involvement in the education of health professionals: Active patient involvement in education. Medical Education, 44(1), 64–74. https://doi.org/10.1111/j.1365-2923.2009.03530.x

101.

Tricco

A. C.

Lillie

Zarin

O’Brien

K. K.

Colquhoun

Levac

Moher

Peters

M. D. J.

Horsley

Weeks

Hempel

Akl

E. A.

Chang

McGowan

Stewart

Hartling

Aldcroft

Wilson

M. G.

Garritty

Straus

S. E.

(2018). PRISMA extension for scoping reviews (PRISMA-ScR): Checklist and explanation. Annals of Internal Medicine, 169(7), 467–473. https://doi.org/10.7326/M18-0850

102.

Turner

J. S.

Pettit

K. E.

Buente

B. B.

Humbert

A. J.

Perkins

A. J.

Kline

J. A.

(2016). Medical student use of communication elements and association with patient satisfaction: A prospective observational pilot study. BMC Medical Education, 16(1), 150. https://doi.org/10.1186/s12909-016-0671-8

103.

U.S. Bureau of Labor Statistics . (2020, April 27). Registered nurses made up 30 percent of hospital employment in may 2019. The Economics Daily: U.S. Bureau of Labor Statistics. https://www.bls.gov/opub/ted/2020/registered-nurses-made-up-30-percent-of-hospital-employment-in-may-2019.htm

104.

Ward

Benbow

(2016). The role of service-user feedback in undergraduate nursing courses. British Journal of Nursing, 25(13), 752–756. https://doi.org/10.12968/bjon.2016.25.13.752

105.

Warm

E. J.

Schauer

Revis

Boex

J. R.

(2010). Multisource feedback in the ambulatory setting. Journal of Graduate Medical Education, 2(2), 269–277. https://doi.org/10.4300/JGME-D-09-00102.1

106.

Wener

M. E.

Schönwetter

D. J.

Mazurat

(2011). Developing new dental communication skills assessment tools by including patients and other stakeholders. Journal of Dental Education, 75(12), 1527–1541. https://doi.org/10.1002/j.0022-0337.2011.75.12.tb05212.x

107.

Wen

Huang

Mosley

Afsar-manesh

(2012). Promoting patient-centred care through trainee feedback: Assessing Residents’ C-I-CARE (ARC) Program. BMJ Quality & Safety, 21(3), 225–233. https://doi.org/10.1136/bmjqs-2011-000332

108.

Wiggins

M. N.

Coker

Hicks

E. K.

(2009). Patient perceptions of professionalism: Implications for residency education. Medical Education, 43(1), 28–33. https://doi.org/10.1111/j.1365-2923.2008.03176.x

109.

Witherspoon

Jalali

Roberts

M. T.

(2019). Resident-run urology clinics: A tool for use in competency-based medical education for teaching and assessing transition-to-practice skills. Canadian Urological Association Journal, 13(9)E279–E284. https://doi.org/10.5489/cuaj.5710

110.

Wouda

J. C.

van de Wiel

H. B. M.

(2015). Supervisors’ and residents’ patient-education competency in challenging outpatient consultations. Patient Education and Counseling, 98(9), 1084–1091. https://doi.org/10.1016/j.pec.2015.05.010

111.

Wykurz

Kelly

(2002). Developing the role of patients as teachers: Literature review. BMJ, 325(7368), 818–821. https://doi.org/10.1136/bmj.325.7368.818

112.

M. X.

Jiang

X. Y.

Y. J.

Shen

Z. Y.

Zhuang

S. Q.

Y. F.

(2018). Evaluation of medical record quality and communication skills among pediatric interns after standardized parent training history-taking in China. Medical Teacher, 40(2), 188–192. https://doi.org/10.1080/0142159X.2017.1395833

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.30 MB