This systematic review aims to evaluate the effectiveness of systems-based practice (SBP) curricula from the perspective of health professions students and workers. A total of 8468 citations were sourced from six electronic databases and manual searches conducted independently by two researchers, of which 44 studies were eventually included. A meta-analysis using a random effects model and a meta-synthesis using the thematic synthesis approach were conducted. Most studies targeted medical students, residents, and resident physicians from various clinical specialties. Almost half of all studies focused on didactic or knowledge-based interventions to teach SBP. About a third of all studies measured non-self-evaluated knowledge change, clinical abilities, and clinical outcomes. Both meta-analysis and meta-synthesis results revealed positive outcomes of increased knowledge of SBP, increased recognition of SBP as a core competency in one’s profession, and increased application of SBP knowledge in one’s profession. Meta-synthesis results also revealed negative outcomes at the institutional and teacher/health professions level. This review highlights the importance of SBP education and supports the effectiveness of SBP curricula. There is a need to address the negative outcomes at the institutional and teacher/health professions level. Moreover, future studies could investigate the integration of self-assessment outcomes with comparison to some external standard.
*AboumatarH. J.ThompsonD.WuA.DawsonP.ColbertJ.MarstellerJ.KentP.LubomskiL. H.PaineL.PronovostP. (2012). Development and evaluation of a 3-day patient safety curriculum to advance knowledge, self-efficacy and system thinking among medical students. BMJ Quality and Safety, 21(5), 416–422. http://dx.doi.org/10.1136/bmjqs-2011-000463
4.
*AckermanS. L.BoscardinC.KarlinerL.HandleyM. A.ChengS.GaitherT. W.HageyJ.HenneinL.MalikF.ShawB.TrinidadN.ZahnerG.GonzalesR. (2016). The action research program: Experiential learning in systems-based practice for first-year medical students. Teaching and Learning in Medicine, 28(2), 183–191. https://doi.org/10.1080/10401334.2016.1146606
5.
AthyS.TalmonG.SamsonK.MartinK.NelsonK. (2021). Faculty versus resident self-assessment using pathology milestones: How aligned are we?Academic Pathology, 8(1), 1–7. https://doi.org/10.1177/23742895211060526
6.
BataldenP. B.LeachD. C. (2009). Sharpening the focus on systems-based practice. Journal of Graduate Medical Education, 1(1), 1–3. https://doi.org/10.4300/01.01.0001
7.
BekaluY. E.WuduM. A. (2023). Level of professionalism and associated factors among nurses working in South Wollo zone public hospitals, Northeastern Ethiopia, 2022, (9, pp. 1–8). Sage Open Nursing. https://doi.org/10.1177/23779608231158976
8.
*BoltriJ. M.VogelR. L.TindallW. N.TeddersS. H. (2002). Improving medical students’ knowledge of systems-based practice. Managed Care Quarterly, 10(1), 29–32. https://pubmed.ncbi.nlm.nih.gov/15991398/
9.
BorkanJ. M.HammoudM. M.NelsonE.OylerJ.LawsonL.StarrS. R.GonzaloJ. D. (2021). Health systems science education: The new post-Flexner professionalism for the 21st century. Medical Teacher, 43(sup2), S25–S31. https://doi.org/10.1080/0142159X.2021.1924366
10.
*BrandonC. J.MullanP. B. (2013). Teaching medical management and operations engineering for systems-based practice to radiology residents. Academic Radiology, 20(3), 345–350. https://doi.org/10.1016/j.acra.2012.09.025
11.
CareyG.MalbonE.CareyN.JoyceA.CrammondB.CareyA. (2015). Systems science and systems thinking for public health: A systematic review of the field. BMJ Open, 5(12), 1–9. http://dx.doi.org/10.1136/bmjopen-2015-009002
12.
*CastroM. R. H.CalthorpeL. M.FoghS. E.McAllisterS.JohnsonC. L.IsaacsE. D.IshizakiA.KozasA.LoD.RennkeS.DavisJ.ChangA. (2021). Lessons from learners: Adapting medical student education during and post COVID-19. Academic Medicine, 96(12), 1671–1679. https://doi.org/10.1097/ACM.0000000000004148
13.
*ChanE. Y.DezielD. J.OrkinB. A.WoolN. L. (2015). Systems-based practice: Learning the concepts using a teamwork competition model. American Journal of Surgery, 209(1), 40–44. https://doi.org/10.1016/j.amjsurg.2014.08.034
ColbertC. Y.OgdenP. E.OwnbyA. R.BoweC. (2011). Systems-based practice in graduate medical education: Systems thinking as the missing foundational construct. Teaching and Learning in Medicine, 23(2), 179–185. https://doi.org/10.1080/10401334.2011.561758
16.
*DavidR. A.ReichL. M. (2005). The creation and evaluation of a systems-based practice/managed care curriculum in a primary care internal medicine residency program. The Mount Sinai. Journal of Medicine, New York, 72(5), 296–299. https://pubmed.ncbi.nlm.nih.gov/16184291/
17.
DolanskyM. A.MooreS. M. (2013). Quality and Safety Education for Nurses (QSEN): The key is systems thinking. Online Journal of Issues in Nursing, 18(3), 1–12. https://doi.org/10.3912/OJIN.Vol18No03Man01
*EiserA. R.Connaughton-StoreyJ. (2008). Experiential learning of systems-based practice: A hands-on experience for first-year medical residents. Academic Medicine, 83(10), 916–923. https://doi.org/10.1097/ACM.0b013e31818509ca
20.
FleissJ. L. (1993). Review papers: The statistical basis of meta-analysis. Statistical Methods in Medical Research, 2(2), 121–145. https://doi.org/10.1177/096228029300200202
21.
FlemingM.VautourD.McMullenM.CofieN.DalgarnoN.PhelanR.MizubutiG. B. (2021). Examining the accuracy of residents' self-assessments and faculty assessment behaviours in anesthesiology. Canadian Medical Education Journal, 12(4), 17–26. https://doi.org/10.36834/cmej.70697
22.
*FuraL. A.WisserK. Z. (2017). Development and evaluation of a systems thinking education strategy for baccalaureate nursing curriculum: A pilot study. Nursing Education Perspectives, 38(5), 270–271. https://doi.org/10.1097/01.NEP.0000000000000165
23.
GabbardT.RomanelliF. (2021). The accuracy of health professions students’ self-assessments compared to objective measures of competence. American Journal of Pharmaceutical Education, 85(4), 275–280. https://doi.org/10.5688/ajpe8405
24.
*GauppR.KörnerM.FabryG. (2016). Effects of a case-based interactive e-learning course on knowledge and attitudes about patient safety: A quasi-experimental study with third-year medical students. BMC Medical Education, 16(1), 1–8. https://doi.org/10.1186/s12909-016-0691-4
25.
*GheihmanG.ForesterB. P.SharmaN.So-ArmahC.WittelsK. A.MilliganT. A. (2020). Introduction to quality improvement and systems-based practice: A two-part module for clinical clerkship students. Journal of General Internal Medicine, 35(12), 3742–3744. https://doi.org/10.1007/s11606-020-05788-0
26.
*GillenJ. R.RamirezA. G.FarineauD. W.HokeT. R.SchirmerB. D.WilliamsM. D.LauC. L. (2016). Using interdisciplinary workgroups to educate surgery residents in systems-based practice. Journal of Surgical Education, 73(6), 1052–1059. https://doi.org/10.1016/j.jsurg.2016.05.017
27.
*GonzaloJ. D.DavisC.ThompsonB. M.HaidetP. (2019). Unpacking medical students’ mixed engagement in health systems science education. Teaching and Learning in Medicine, 32(3), 250–258. https://doi.org/10.1080/10401334.2019.1704765
28.
GonzaloJ. D.DekhtyarM.StarrS. R.BorkanJ.BrunettP.FancherT.GreenJ.GrethleinS. J.LaiC.LawsonL.MonradS.O’SullivanP.SchwartzM. D.SkochelakS. (2017a). Health systems science curricula in undergraduate medical education: Identifying and defining a potential curricular framework. Academic Medicine, 92(1), 123–131. https://doi.org/10.1097/ACM.0000000000001177
29.
*GonzaloJ. D.GraafD.KassL. E.PromesS. B.WolpawD. R.GeorgeD. R. (2017b). Medical students as systems ethnographers: Exploring patient experiences and systems vulnerabilities in the emergency department. AEM Education and Training, 1(3), 225–233. https://doi.org/10.1002/aet2.10038.
30.
GonzaloJ. D.HaidetP.BlattB.WolpawD. R. (2016). Exploring challenges in implementing a health systems science curriculum: A qualitative analysis of student perceptions. Medical Education, 50(5), 523–531. https://doi.org/10.1111/medu.12957
31.
*GonzaloJ. D.WolpawD.GraafD.ThompsonB. M. (2018). Educating patient-centered, systems-aware physicians: A qualitative analysis of medical student perceptions of value-added clinical systems learning roles. BMC Medical Education, 18(1), 248. https://doi.org/10.1186/s12909-018-1345-5
32.
*HackenB.Jarvis-SelingerS. S.ArmstrongA. D.BlackS.PrattD.BlackK. P. (2019). A systems-based practice curriculum in orthopaedics: Successes and challenges moving forward. The Journal of Bone and Joint Surgery, 101(1), 1–7. https://doi.org/10.2106/JBJS.17.00595
33.
HigginsJ. P. T.ThompsonS. G.DeeksJ. J.AltmanD. G. (2003). Measuring inconsistency in meta-analyses. British Medical Journal, 327(7414), 557–560. https://doi.org/10.1136/bmj.327.7414.557
34.
HongQ. N.FàbreguesS.BartlettG.BoardmanF.CargoM.DagenaisP.GagnonM. P.GriffithsF.NicolauB.O'CathainA.RousseauM. C.VedelI.PluyeP. (2018). The Mixed Methods Appraisal Tool (MMAT) version 2018 for information professionals and researchers. Education for Information, 34(4), 285–291. https://doi.org/10.3233/EFI-180221
35.
*IyerM. S.LoC. B.ScherzerD. J.MacDowellD.GuptaN.McManusE.StewartC.LinakisS. W.StanleyR. (2021). The COVID-19 elective for pediatric residents: Learning about systems-based practice during a pandemic. Cureus, 13(2), Article e13085. https://doi.org/10.7759/cureus.13085
36.
*KerfootB. P.ConlinP. R.TravisonT.McMahonG. T. (2007). Web-based education in systems-based practice: A randomized trial. Archives of Internal Medicine, 167(4), 361–366. https://doi.org/10.1001/archinte.167.4.361
37.
KhannaP.RobertsC.LaneA. (2021). Designing health professional education curricula using systems thinking perspectives. BMC Medical Education, 21(1), 1–8. https://doi.org/10.1186/s12909-020-02442-5
38.
*KimY. M.YoonY. S.HongH. C.MinA. (2019). Effects of a patient safety course using a flipped classroom approach among undergraduate nursing students: A quasi-experimental study. Nurse Education Today, 79(1), 180–187. https://doi.org/10.1016/j.nedt.2019.05.033
39.
*KöningsK. D.de JongN.LohrmannC.SumskasL.SmithT.O’ConnorS. J.SpanjersI. A. E.Van MerriënboerJ. J. G.CzabanowskaK. (2018). Is blended learning and problem-based learning course design suited to develop future public health leaders? An explorative European study. Public Health Reviews, 39(1), 1–12. https://doi.org/10.1186/s40985-018-0090-y
40.
KwameA.PetruckaP. M. (2021). A literature-based study of patient-centered care and communication in nurse-patient interactions: Barriers, facilitators, and the way forward. BMC Nursing, 20(1), 1–10. https://doi.org/10.1186/s12912-021-00684-2
41.
*LappJ.CaldwellK. A. (2012). Using food ethnographies to promote systems thinking and intergenerational engagement among college undergraduates. Food, Culture and Society, 15(3), 491–509. https://doi.org/10.2752/175174412X13276629246082
42.
*LiL.GuptaN.WasserT. (2019). A novel initiative contextualizing quality improvement and systems based practice in psychiatric clinical teaching settings. The Journal of Mental Health Training, Education and Practice, 14(3), 156–163. https://doi.org/10.1108/JMHTEP-10-2018-0060
43.
*LoomanW. S. (2020). Teaching systems thinking for advanced family nursing practice: A theory-based tool. Journal of Family Nursing, 26(1), 5–14. https://doi.org/10.1177/1074840719891439
44.
*MartinezJ.PhillipsE.FeinO. (2013). Perspectives on the changing healthcare system: Teaching systems-based practice to medical residents. Medical Education Online, 18(1), 1–5. https://doi.org/10.3402/meo.v18i0.20746
45.
*MehtaT.StraussS.BelandD.FortunatoG.StaffI.LeeN. (2018). Stroke simulation improves acute stroke management: A systems-based practice experience. Journal of Graduate Medical Education, 10(1), 57–62. https://doi.org/10.4300/JGME-D-17-00167.1
46.
*MillsL. M.HoffmanA. B.KhanA.LaiC. J. (2017). Integrating health systems science in early undergraduate medical education: Barriers to implementation and lessons learned. MedEdPublish, 6(4), 1–9. https://doi.org/10.15694/mep.2017.000204
47.
*MitchellJ. D.ParharP.NarayanaA. (2010). Teaching and assessing systems-based practice: A pilot course in health care policy, finance, and law for radiation oncology residents. Journal of Graduate Medical Education, 2(3), 384–388. https://doi.org/10.4300/JGME-D-09-00092.1
48.
*NaglerA.AndolsekK.DossaryK.SchlueterJ.SchulmanK. (2010). Addressing the systems-based practice requirement with health policy content and educational technology. Medical Teacher, 32(12), Article e559-e565. https://doi.org/10.3109/0142159X.2010.528809
49.
*O'ConnellM. T.RivoM. L.MechaberA. J.WeissB. A. (2004). A curriculum in systems-based care: Experiential learning changes in student knowledge and attitudes. Family Medicine, 36(1), 98–104. Retrieved fromhttps://pubmed.ncbi.nlm.nih.gov/14961411/
50.
PageM. J.McKenzieJ. E.BossuytP. M.BoutronI.HoffmannT. C.MulrowC. D.ShamseerL.TetzlaffJ. M.AklE. A.BrennanS. E.ChouR.GlanvilleJ.GrimshawJ. M.HróbjartssonA.LaluM. M.LiT.LoderE. W.Mayo-WilsonE.McDonaldS.MoherD. (2021). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. International Journal of Surgery, 88(1), 1–9. https://doi.org/10.1016/j.ijsu.2021.105906
51.
*PerezJ. A.JrFaustC.KenyonA. (2009). The virtual practice: Using the residents’ continuity clinic to teach practice management and systems-based practice. Journal of Graduate Medical Education, 1(1), 104–108. https://doi.org/10.4300/01.01.0017
52.
*PetersA. S.KimuraJ.LaddenM. D.MarchE.MooreG. T. (2008). A self-instructional model to teach systems-based practice and practice-based learning and improvement. Journal of General Internal Medicine, 23(7), 931–936. https://doi.org/10.1007/s11606-008-0517-0
53.
PhillipsJ. M.StalterA. M. (2016). Integrating systems thinking into nursing education. Journal of Continuing Education in Nursing, 47(9), 395–397. https://doi.org/10.3928/00220124-20160817-05
54.
PlackM. M.GoldmanE. F.ScottA. R.BrundageS. B. (2019). Systems thinking in the healthcare professions: A guide for educators and clinicians. The George Washington University.
55.
*PulcranoM.ChahineA. A.SaratsisA.Divine-CadavidJ.NarraV.EvansS. R. T. (2015). Putting residents in the office: An effective method to teach the systems-based practice competency. Journal of Surgical Education, 72(2), 286–290. https://doi.org/10.1016/j.jsurg.2014.09.001
56.
RosenM. A.DiazGranadosD.DietzA. S.BenishekL. E.ThompsonD.PronovostP. J.WeaverS. J. (2018). Teamwork in healthcare: Key discoveries enabling safer, high-quality care. The American Psychologist, 73(4), 433–450. https://doi.org/10.1037/amp0000298
57.
RusojaE.HaynieD.SieversJ.MustafeeN.NelsonF.ReynoldsM.SarriotE.SwansonR. C.WilliamsB. (2018). Thinking about complexity in health: A systematic review of the key systems thinking and complexity ideas in health. Journal of Evaluation in Clinical Practice, 24(3), 600–606. https://doi.org/10.1111/jep.12856
58.
SandelowskiM.BarrosoJ. (2006). Handbook for synthesizing qualitative research. Springer Publishing Company.
59.
*SankoJ. S.GattamortaK.YoungJ.DurhamC. F.SherwoodG.DolanskyM. (2020). A multisite study demonstrates positive impacts to systems thinking using a table-top simulation experience. Nurse Educator, 46(1), 29–33. https://doi.org/10.1097/NNE.0000000000000817
60.
*SantenS. A.HamstraS. J.YamazakiK.GonzaloJ.LomisK.AllenB.LawsonL.HolmboeE. S.TriolaM.GeorgeP.GormanP. N.SkochelakS. (2021). Assessing the transition of training in health systems science from undergraduate to graduate medical education. Journal of Graduate Medical Education, 13(3), 404–410. https://doi.org/10.4300/JGME-D-20-01268.1
61.
*SheuL.O’BrienB.O’SullivanP. S.KwongA.LaiC. J. (2013). Systems-based practice learning opportunities in student-run clinics: A qualitative analysis of student experiences. Academic Medicine, 88(6), 831–836. https://doi.org/10.1097/ACM.0b013e31828ff92c
62.
*SiriJ.ReedA. I.FlynnT. C.SilverM.BehrnsK. E. (2007). A multidisciplinary systems-based practice learning experience and its impact on surgical residency education. Journal of Surgical Education, 64(6), 328–332. https://doi.org/10.1016/j.jsurg.2007.05.002
63.
*SotoR. G.CormicanD. S.GallagherC. J.SeidmanP. A. (2010). Teaching systems-based competency in anesthesiology residency: Development of an education and assessment tool. Journal of Graduate Medical Education, 2(2), 250–259. https://doi.org/10.4300/JGME-D-09-00078.1
64.
*SpikerM.HegeA.GiddensJ.CummingsJ.SteinmetzJ.TagtowA.BergquistE.BurnsL.CampbellC.StadlerD.CombsE.PrangeN.SchwartzA.BrownK.SauerK. (2021). Leveraging online learning to promote systems thinking for sustainable food systems training in dietetics education. Frontiers in Nutrition, 8(1), 1–9. https://doi.org/10.3389/fnut.2021.623336
65.
StalterA. M.PhillipsJ. M.DolanskyM. A. (2017). QSEN institute RN-BSN task force: White paper on recommendation for systems-based practice competency. Journal of Nursing Care Quality, 32(4), 354–358. https://doi.org/10.1097/NCQ.0000000000000262
66.
StraussA.CorbinJ. (1994). Grounded theory methodology: An overview. In DenzinN.LincolnY. (Eds), Handbook of qualitative research (pp. 273–285). Sage Publications, Inc.
67.
*Thornton BaconC.TrentP.McCoyT. P. (2018). Enhancing systems thinking for undergraduate nursing students using friday night at the ER. The Journal of Nursing Education, 57(11), 687–689. https://doi.org/10.3928/01484834-20181022-11
68.
*TurleyC. B.RoachR.MarxM. (2007). Systems survivor: A program for house staff in systems-based practice. Teaching and Learning in Medicine, 19(2), 128–138. https://doi.org/10.1080/10401330701332201
*WilperA. P.SmithC. S.WeppnerW. (2013). Instituting systems-based practice and practice-based learning and improvement: A curriculum of inquiry. Medical Education Online, 18(1), 1–6. https://doi.org/10.3402/meo.v18i0.21612
71.
*ZenniE. A.RavagoL.EwartC.LivingoodW.WoodD.GoldhagenJ. (2006). A walk in the patients’ shoes: A step toward competency development in systems-based practice. Ambulatory Pediatrics, 6(1), 54–57. https://doi.org/10.1016/j.ambp.2005.08.003
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
