Sage Journals: Discover world-class research

Abstract

Patient case simulation software are described in pharmacy education literature as useful tools to improve skills in patient assessment (including medication history-taking and physical assessment), clinical reasoning and communication, and are typically well-received by students and instructors. The virtual interactive case (VIC) system is a web-based software developed to deliver deliberate practice opportunities in simulated patient encounters across a spectrum of clinical topics. This article describes the implementation and utilization of VIC in the undergraduate curriculum at one Canadian pharmacy school. Methods: At our facility, the use of VIC was integrated across the training spectrum in the curriculum, including core and elective didactic courses and practice labs, experiential learning, interprofessional education, and continuing education. Its use was evaluated through student and instructor surveys and qualitative student interviews). VIC is easy to navigate and created a positive and realistic learning environment. Students identified that it enhanced their ability to identify relevant patient information, accurately simulated hospital pharmacy practice and thereby helped them to prepare for their upcoming experiential courses. The use of VIC has expanded beyond its original intended purpose for individual student practice to become a valuable addition to pharmacy undergraduate education. Future plans include ongoing development of cases and exploration of further uses of VIC within the didactic curriculum, for remediation in experiential courses, and for pharmacist continuing education.

Keywords

clinical pharmacy education simulation clinical practice continuing education pharmaceutical care

Introduction

Numerous patient case simulation software have been described in pharmacy education literature as useful tools to improve skills in patient assessment, clinical reasoning, and communication.^1
-9 These tools can improve student performance in medication history-taking and physical assessment skills, and they have been well-received for their value-add and utility in pharmacy education.^{1,2,4
-6,10
-12} Most importantly, simulation software provides the opportunity for deliberate practice, which is considered a crucial step in the development of expertise in one’s field.¹³ The virtual interactive case (VIC) system is a web-based software developed to deliver deliberate practice opportunities in simulated patient encounters across a spectrum of clinical topics (http://pie.med.utoronto.ca/vic/VIC_content/VIC_pharmacyCases.html). The virtual interactive case is a proprietary software product that was developed in 2011 locally at our university and utilized in our healthcare curricula (eg, medicine in 2011, nursing in 2014). The software program was designed to create cases about patient clinical encounters, including functional assessments, physical exams, ordering/utilizing appropriate laboratory tests, consulting with specialists, reviewing diagnostic tests to determine a problem or diagnosis, and its treatment. The program provides debriefing, including steps taken that were essential, actions that were inappropriate, and actions done in an incorrect order.¹⁴ It is this use in other curricula, and VIC’s potential advantages, that interested us in adapting for teaching in our university’s pharmacy curriculum.

The VIC system provides an environment to practice foundational pharmacy skills, such as information-gathering, patient assessment, problem-solving, and critical thinking while providing specific and timely feedback tailored to the student’s performance. VIC offers several unique advantages over traditional paper cases, including better representation of the healthcare environment.¹⁵ A limiting factor of paper cases (which are often used in our undergraduate pharmacy curriculum) is that relevant information needed to identify patient issues is provided directly to students. In VIC, users must extract information that is perceived to be pertinent to the case and discern irrelevant details (rather than being presented with all the required information). Automated feedback is provided and tailored to the user’s selected responses during the information-gathering stage, identifying the drug therapy problem (DTP), and care plan implementation steps. VIC may be adapted for any pharmacy practice setting (community, ambulatory, and inpatient) and can seamlessly integrate multiple disease states simultaneously into one patient case allowing for a diverse breadth of patient complexities, thereby providing authentic patient encounters. In addition, the entire VIC process is timed to simulate real-life time constraints. VIC contains time and cost scores to help students gauge the efficiency of their assessment skills and discourage accessing non-essential or irrelevant items. Feedback about accessing non-essential or irrelevant items is provided at the end of each case summary. The ease of use and positive experience by users suggests that VIC has potential to be used as a tool to deliver continuing education to enhance pharmacist’s clinical practice.^10,16 This article describes the implementation and evolution of VIC in the undergraduate curriculum at one Canadian pharmacy school, including lessons learned for pharmacy curricula.

Application of VIC in Pharmacy Education

At our faculty, VIC has been implemented across the training spectrum in the curriculum: (1) pre-clinical learning, (2) experiential learning, (3) interprofessional education, and (4) continuing education (Figure 1). For pre-clinical learning, VIC cases are incorporated into several core and elective courses (eg, endocrinology, nephrology, and antimicrobial stewardship) where students use them to self-assess their content knowledge and ability to interpret findings of investigations, such as lab results and diagnostic imaging reports. Examples of VIC clinical scenarios include treatment of Clostridium difficile infection, insulin management, and medication management in patients with chronic kidney disease. In pharmacy skills labs, students review the VIC patient charts to gather pertinent information, identify the DTP(s), and formulate care plans. They then proceed to communicate their recommendations directly to a standardized clinician. VIC has been used to help facilitate interprofessional case discussions where VIC stems have been used as the basis of the discussion. In undergraduate clinical rotations, students use VIC to review or practice their patient care process prior to working-up real patients, which is particularly useful for preparation for specialty rotations, such as antimicrobial stewardship. In addition, VIC is used for remediation for students struggling in Advanced Pharmacy Practice Experience (APPE) rotations. In this setting, faculty members have students work on VIC cases concurrent to their APPE or use them as part of academic support to improve students’ chance of success prior to completion of a supplemental APPE rotation. The cases are selected from the VIC pharmacy page and chosen to address the areas in need of practice for the individual student. A summary of the courses in which VIC is used in our curriculum is found in Table 1. Finally, for continuing education, VIC may be used to provide illustrative case examples that supplement lecture, practice examples, and training materials (eg, for minor ailment prescribing and anticoagulation management training). In all of these settings, the cases can be used in multiple ways. In the practice labs and some pharmacotherapy courses, they are primarily used for information-gathering, where the student goes on to identify the DTPs and create their own care plans that are then presented to the clinical instructor either verbally or in writing. In these cases, the instructors would grade the students in line with the specific course rubrics. In other courses, VIC is used to its full capability, where the students pick the correct DTP and care plan items from the options provided. Students are then given feedback in the case by the software on the answers chosen, why they were correct or incorrect as well as feedback on their process, including time and cost, and which components of the case they missed or reviewed unnecessarily. When used for APPE remediation, we have also created companion activities for the cases, which may include questions from health care team members, “what if” scenarios, critical appraisal activities and interprofessional team activities. Table 2 provides some examples of these activities.

Figure 1.

Application of VIC across different stages of pharmacy education.

Table 1.

Courses Where VIC Is Used in the Curriculum.

Course code	Course name	Description
PHM202H	Pharmacotherapy 3 (Endocrine, Nephrology, Urology)	Cases used for pharmacotherapy workups and care planning (in lieu of paper cases)
PHM206H	Medication Therapy Management-3 (MTM-3)	Cases used to mimic a hospital patient chart for information-gathering
PHM251H	Early Practice Experience-2 (EPE-2)	Cases not used explicitly in this course, but VIC used in PHM206 to better prepare for this experience
PHM305H	Medication Therapy Management-4 (MTM-4)	Cases used to mimic a hospital patient chart for information-gathering
PHM383H	Antimicrobial Stewardship	Cases used for in class discussions
PHM385H	Diabetes Care	Cases used for pharmacotherapy workups and care planning (in lieu of paper cases)
PHM401/402/424H (and others)	Advanced Pharmacy Practice Experiences	Used for extra practice for patient care workups while on APPE rotations or for remedial work

Abbreviations: APPE, Advanced Pharmacy Practice Experience; VIC, virtual interactive case.

Table 2.

Examples of Companion Activities Used in Remediation.

Activity	Sample
Drug information questions	The patient’s wife requests more information on smoking cessation products for her husband. How do you respond verbally?The RN asks if 2 medications can be combined in the same IV bag. Write a written response.
“What if” scenarios	What if the patient was 29 years old?What if the patient was pregnant?How does your plan change?
Critical appraisal	Present a journal article review of one of the references used in your assessment.
Interprofessional team	Identify members of the health care team to whom your patient may benefit from a referral.The team dietician asks for information on which of the patient’s medications can be crushed. Write a response.
Continuity of care	Create a best possible medication discharge plan for this patient if he were to be discharged today.

Evaluation of VIC

VIC has been evaluated in a number of ways. The original hospital pharmacy case template and cases were assessed for usability and student feedback in a qualitative study. Five main themes were derived from the student interviews in this study: VIC facilitated students’ skills in information-gathering; students learned from the built-in, real-time, formative feedback; students had a fun and positive learning experience; VIC cases were realistic; and the VIC system was user-friendly.¹⁵ This early feedback set the stage for further case development and use of VIC for the educational purposes described previously.

When VIC was first introduced into a second-year skills lab course (Medication Therapy Management-3 (MTM3), we sought student and clinical instructor feedback as the format and flow of the lab was very different than a typical lab. A summary of the student feedback is found in Tables 3 and 4. Most students in the first cohort (62%) indicated that they would have liked more than the 20 minutes allotted to review the VIC prior to presenting their findings and recommendations to the clinical instructor. More students (75%) in a subsequent cohort, who were given the same amount of time to review the case plus an additional 5 minutes to organize their thoughts prior to the interaction with clinical instructors found the allotted 20 minutes to be adequate. As one of the goals of including VIC in the lab was to allow students an opportunity to gather information in a manner that forced them to select necessary information to identify the DTP and create a plan, we found this to be important feedback. Despite the time pressure felt by students, performance was similar to other non-VIC labs in both cohorts. Students were asked whether they felt that use of VIC in this course would assist them with their future hospital experiential courses, and 49% of students in the first cohort and 76% in the second cohort responded favorably (Table 4). A clinical instructor feedback survey indicated that they felt students generally performed well on the lab, and interaction time between the instructor and the student was sufficient (Tables 5 and 6).

Table 3.

Student Feedback on Time Allotted to Review the VIC in the Lab (20 Minutes) (MTM-3).

Cohort	Number of students responded/number of students in class	Too little, N (%)	Just right, N (%)	Too much, N (%)
2018	55/236	34 (62)	30 (36)	1 (2)
2019	227/241^a	57 (25)	161 (71)	0 (0)

Abbreviation: MTM, Medication Therapy Management.

In 2019, students completed feedback survey prior to leaving the lab rather than an optional online feedback survey in 2018.

Table 4.

Student Feedback on VIC Preparing Them for Hospital Practice (MTM-3).

Cohort	Number of students responded/number of students in class	Strongly agree, N (%)	Agree, N (%)	Neutral, N (%)	Disagree, N (%)	Strongly disagree, N (%)
2018	55/236	2 (4)	25 (45)	16 (29)	10 (18)	2 (4)
2019	227/241	23 (10)	150 (66)	49 (22)	5 (2)	0 (0)

Abbreviation: MTM, Medication Therapy Management.

Table 5.

Clinical Instructor Feedback “Students Generally Performed Well on the Lab” (MTM-3).

Cohort	Number of CIs	Strongly agree, N (%)	Agree, N (%)	Neutral, N (%)	Disagree, N (%)	Strongly disagree, N (%)
2018	22/22	1 (4.5)	15 (68.2)	3 (1.4)	2 (9.1)	1 (4.5)
2019	14/19	3 (21.4)	10 (71.4)	0 (0)	1 (7.1)	0 (0)

Abbreviation: MTM, Medication Therapy Management.

Table 6.

Clinical Instructor Feedback on Time Allotted for Student Interaction (MTM-3).

Cohort	Number of CIs	Too little (%)	Just right (%)	Too much (%)
2018	22/22	0 (0)	22 (100)	0 (0)
2019	14/19	0 (85.7)	12 (100)	2 (14.3)

Abbreviation: MTM, Medication Therapy Management.

To assess further the impact of VIC cases on the preparation of students for hospital practice, 136 students who completed their Early Practice Experience-2 (EPE-2) placements in a hospital pharmacy setting were invited to participate in an interview to explore the contribution of VIC to their perceived readiness for a hospital placement. Thirteen students who agreed to participate were interviewed by one of the VIC project team members. These semi-structured interviews were conducted in person or over the telephone using an interview guide (Appendix A). These students had also been exposed to VIC cases in a second-year pharmacotherapy course as well as the practice lab course discussed above. Although the 13 students represented approximately 10% (13/136) of all eligible students who were invited to participate, it was determined that data saturation occurred at the eighth participant, as no new themes were identified in subsequent interviews during data analysis. Themes derived from these interviews revealed some similarities to the original qualitative study¹⁵ as they also found VIC software easy to navigate. Additional themes included: VIC enhances students’ ability to identify relevant patient information; VIC accurately simulated hospital pharmacy practice, thereby helping to prepare students for their rotations; and students recommended an expanded role of VIC in the curriculum.

When VIC was subsequently introduced into the third-year skills lab (Medication Therapy Management–4, MTM-4) to assess students’ skills at discharge medication reconciliation similar feedback was obtained. Sixty-four percent felt that they needed more time to review the case, 90% felt that it would help prepare them for future APPEs, and almost all students (98%) successfully passed the lab (Tables 7 and 8).

Table 7.

Student Feedback on Time Allotted to Review the VIC in the Lab (20 Minutes) (MTM-4).

Cohort	Number of students responded/number of students in class	Too little, N (%)	Just right, N (%)	Too much, N (%)
2019	203/225	130 (64)	73 (36)	0 (0)

Abbreviation: MTM, Medication Therapy Management.

Table 8.

Student Feedback on VIC Preparing Them for Hospital Practice (MTM-4).

Cohort	Number of students responded/number of students in class	Strongly agree, N (%)	Agree, N (%)	Neutral, N (%)	Disagree, N (%)	Strongly disagree, N (%)
2019	203/225	14 (7)	116 (57)	65 (32)	8 (4)	0 (0)

Abbreviation: MTM, Medication Therapy Management.

A formal evaluation on the use of VIC in the interfaculty pain curriculum has not been undertaken due to the volume of metrics already assessed in this multi-faculty undertaking. Anecdotal feedback from interprofessional facilitators in the first year the cases were used included suggestions for making the program accessible on tablets and mobile devices. This is now possible with the updated version of the software.

Feedback collected from experiential education Course Coordinators indicates that VIC assists students with information-gathering and patient care process skills as well as for creating thorough care plans. Using VIC within APPEs allows for students to build confidence outside of the rotation site by practicing individually with multiple cases. In addition, coordinators indicate that a case can also be used to form the foundation for other skills, including answering hypothetical drug information questions that could arise from team members, presenting a verbal case summary, suggesting referrals that may be indicated for the patient and creating best possible medication discharge plans.

Similar feedback on the use of VIC has been garnered from multiple users and student cohorts suggesting that not only is VIC practical and versatile to use, but it also helps prepare learners for practice.

Implications and Significance for Practice

The VIC software was developed to help students bridge the skill gap during the transition from the classroom to practice setting, with the intention to enhance students’ preparedness for their experiential rotations and clinical practice.¹⁴ Our experience suggests that VIC is a useful tool to support improved patient data-gathering skills, better preparation for practice by mimicking the practice environment more closely than traditional paper cases, and improved critical thinking. The VIC model of case writing is also versatile, in that it is adaptable to many patient types and complexities, clinical scenarios, and practice environments.

The use of VIC in various Doctor of Pharmacy courses was well-received by students, and the overall positive response from using virtual patient cases is consistent with previous literature and other simulation programs.^{1,2,5,7,10,17,18} Our experiences highlight the realism of the VIC software in simulating electronic medical records and practice environments.

The use of multiple VICs in a particular topic area with different patient characteristics is achievable. This unique feature enables implementation into pharmacotherapy or skills-based courses and allows for easy modification and updating of cases from year to year. In addition, cases of any level of complexity (eg, one simple DTP to several concurrent DTPs) and any therapeutic area can be created. Furthermore, VIC can be written for any practice environment (eg, inpatient hospital, ambulatory care, primary care, community pharmacy), expanding its use for preparing students to common practice environments encountered by pharmacy students. Our findings suggest that the use of VIC can also be expanded to other pharmacy faculties as well as continuing education programs for pharmacists. These realistic practice cases could help with not only knowledge acquisition, but continued skills development. As a starting point, a selection of pharmacy VICs is freely available on the VIC website.

Limitations and Lessons Learned

The process of developing VIC for pharmacy students required a significant collaborative effort from a wide array of faculty members (experiential, practice-based, and course-based). This collaborative process could be expanded to include members to enhance the case inventory suitable for practicing pharmacists. Although VICs are relatively easy to create using the case manual, it does require technical support to export the cases and host them on a web page for access. This expertise would typically be found within educational institutions. An initial financial outlay for a VIC software license ($5000) may also be a limitation for some sites. As with other simulation programs, VIC is a bridge to real-life practice, but VICs are not a substitute for experiential learning with real patients. However, the use of VIC is less costly than live simulations with standardized patients and is easier to deploy. A summary of the advantages and disadvantages of VIC based on our experience is found in Table 9.

Table 9.

Summary of VIC Advantages and Disadvantages.

Advantages	Disadvantages
Easy to use for participants	Initial learning required of user
Easy to write new cases	Initial training or review of case writing guide required
Less expensive than standardized actors or other patient simulation software	Expensive relative to paper cases. One-time license cost $5000
Cases can be hosted on a webpage for easy access	Requires technical support to host cases on a web page
Cases can be adapted to a variety of patient complexities or multiple disease state	Cases are not as authentic as live patient cases
Cases are easily modified to develop a bank of cases on one specific disease state to enable multiple opportunities to practice (deliberate practice)	Cases may need to be updated to reflect new evidence/practice change
Cases include images of laboratory values, medication lists or other reports as required
Cases can be adapted for any pharmacy practice setting
Can be adapted for many levels of pharmacy learners (eg, undergraduate student, remediation, continuing pharmacist education)
Helps develop patient assessment skills as students need to discern between relevant and irrelevant information
Provides feedback on accessing non-essential/irrelevant data
Automated feedback tailored to user’s selected response	Some students may require more feedback than automated system gives
Provides time and cost of intervention scores → helps students gauge efficiency of their assessment skills

Conclusion

The use of VIC has expanded beyond its original intended purpose for individual student practice to become a valuable addition to pharmacy undergraduate education. Future plans include ongoing development of cases and exploration of further uses of VIC within the didactic curriculum, for remediation in experiential courses, and for pharmacist continuing education.

Footnotes

Appendix A

Authors’ Note

A portion of this work was presented at the Association of Faculties of Pharmacy of Canada annual conference in June 2019.

Disclosures

Gordon Tait managed the team of developers that created VIC. Sale of VIC licenses goes toward software maintenance.

Declaration of Conflicting Interests

The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Funding

The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: The authors received a Faculty of Pharmacy Innovation Award ($2500) which funded part of this work.

ORCID iD

Karen Cameron

References

Fidler

. Use of a virtual patient simulation program to enhance the physical assessment and medical history taking skills of doctor of pharmacy students. Curr Pharm Teach Learn. 2020;12(7):810-816.

Borja-Hart

Spivey

George

. Use of virtual patient software to assess student confidence and ability in communication skills and virtual patient impression: a mixed-methods approach. Curr Pharm Teach Learn. 2019;11(7):710-718.

Smith

Waite

. Utilization of a virtual patient for advanced assessment of student performance in pain management. Curr Pharm Teach Learn. 2017;9(5):893-897.

Taglieri

Crosby

Zimmerman

Schneider

Patel

. Evaluation of the use of a virtual patient on student competence and confidence in performing simulated clinic visits. Am J Pharm Educ. 2017;81(5):87.

Barnett

Gallimore

Pitterle

Morrill

. Impact of a paper vs virtual simulated patient case on student-perceived confidence and engagement. Am J Pharm Educ. 2016;80(1):5.

Douglass

Casale

Skirvin

DiVall

. A virtual patient software program to improve pharmacy student learning in a comprehensive disease management course. Am J Pharm Educ. 2013;77(1):9.

Benedict

Schonder

McGee

. Promotion of self-directed learning using virtual patient cases. Am J Pharm Educ. 2013;77(9):192.

Menendez

Balisa-Rocha

Jabbur-Lopes

, et al. Using a virtual patient system for the teaching of pharmaceutical care. Int J Med Inform. 2015;84(9):640-646.

Stultz

Forder

Pakyz

. Virtual pediatric patient activities with randomized scenarios as an instructional tool for pharmacy students. J Pediatr Pharmacol Ther. 2017;22(6):444-452.

10.

Dahri

MacNeil

Chan

, et al. Curriculum integration of virtual patients. Curr Pharm Teach Learn. 2019;11(12):1309-1315.

11.

Smith

Mohammad

Benedict

. Use of virtual patients in an advanced therapeutics pharmacy course to promote active, patient-centered learning. Am J Pharm Educ. 2014;78(7):137.

12.

Al-Dahir

Bryant

Kennedy

Robinson

. Online virtual-patient cases versus traditional problem-based learning in advanced pharmacy practice experiences. Am J Pharm Educ. 2014;78(7):140.

13.

Ericsson

. Deliberate practice and acquisition of expert performance: a general overview. Acad Emerg Med. 2008;15(11):988-994.

14.

Virtual Interactive Case System Toronto General Hospital Department of Anaesthesia. Perioperative interactive education. Accessed November 17, 2023. https://pie.med.utoronto.ca/VIC/index.htm.

15.

Bravo

Natsheh

Tait

Austin

Cameron

. Descriptive analysis of Pharmacy students’ impressions on virtual interactive case software. Am J Pharm Educ. 2019;83(1):6821.

16.

Perry

Gaspar

Moaveni

, et al. Utilizing Virtual Interactive Cases in an On-Line Learning Environment to Develop Students’ Clinical Reasoning Skills. Toronto, Ontario, Canada: Canadian Nursing Education Conference; 2016.

17.

Coons

Kobulinsky

Farkas

Lutz

Seybert

. Virtual electronic health record technology with simulation-based learning in an acute care pharmacotherapy course. Pharmacy. 2018;6(4):123.

18.

Smith

Benedict

. Effectiveness of educational technology to improve patient care in pharmacy curricula. Am J Pharm Educ. 2015;79(1):15.

Implementation of Virtual Interactive Cases for Pharmacy Education: A Single-Center Experience

Abstract

Keywords

Introduction

Application of VIC in Pharmacy Education

Evaluation of VIC

Implications and Significance for Practice

Limitations and Lessons Learned

Conclusion

Footnotes

Appendix A

Authors’ Note

Disclosures

Declaration of Conflicting Interests

Funding

ORCID iD

References