Does Repeated Exposure to Critical Situations in a Screen-Based Simulation Improve the Self-Assessment of Non-Technical Skills in Postpartum Hemorrhage Management?
Restricted accessResearch articleFirst published online April, 2019
Does Repeated Exposure to Critical Situations in a Screen-Based Simulation Improve the Self-Assessment of Non-Technical Skills in Postpartum Hemorrhage Management?
Background.Postpartum hemorrhage (PPH) is the leading cause of maternal death in the world. Non-technical skills (e.g. communication) are now recognized as a contributing factor to medical safety. In the field of simulation, screen-based simulations are currently very popular with computer/technological development. This study evaluates a screen-based simulation device, PerinatSims, developed to improve technical and non-technical skills in PPH situation. This experiment hypothesized that exposure and repetition of training with PerinatSims would improve the self-assessment of non-technical skills, and therefore increase the ability to manage PPH.
Methods. The primary endpoint was a self-assessment of non-technical skills during simulation session of PPH on a digital simulator. Twenty French midwives performed three of nine 25 minutes sessions of PPH screen-based simulation. Four self-assessment questionnaires were administered at the end of each simulation session: a leadership/team working questionnaire (BAT), a negative feelings/emotional questionnaire (DASS-21), a Flow questionnaire and a mental load questionnaire (NASA-TLX). Results between sessions were compared using a repeated measures ANOVA followed by a Bonferroni post hoc test.
Results. The study showed a positive evolution during the three screen-based simulation sessions: an increase of leadership and team working self-assessment, an increase of Flow sense, and a decrease of negative emotions (anxiety and depression in the DASS-21 score). Significant decrease of stress was found only between the second and the third sessions, and significant differences in the NASA-TLX were observed only in two dimensions, Performance and Frustration.
Conclusion. A repeated exposure to PPH situations with a screen-based simulation tool improved the midwives’ self-assessment, especially for leadership, team working, emotion management and Flow sense. Furthermore, midwives had a very positive feedback on the device. They highlighted the desire to use PerinatSims more often to be trained to PPH management, for technical as well as non-technical skills.
AbouZahrC. (2003). Global burden of maternal death and disability. British Medical Bulletin, 67(1), 1-11. doi:10.1093/bmb/ldg015
2.
AhlborgL.HedmanL.NisellH.Felländer-TsaiL.EnochssonL. (2013). Simulator training and non-technical factors improve laparoscopic performance among OBGYN trainees. Actaobstetricia et gynecologica Scandinavica, 92(10), 1194-1201. doi:10.1111/aogs.12218
AndersonJ. M.WarrenJ. B. (2011). Using simulation to enhance the acquisition and retention of clinical skills in neonatology. Seminars in Perinatology, 35(2), 59-67. doi:10.1053/j.semperi.2011.01.004
5.
BangorA.KortumP.MillerJ. (2009). Determining what individual SUS scores mean: Adding an adjective rating scale. Journal of Usability Studies, 4(3), 114-123. doi:10.1.1.177.1240
6.
BantzD.DancerM. M.Hodson-CarltonK.Van HoveS. (2007). A daylong clinical laboratory: From gaming to high-fidelity simulators. Nurse Educator, 32(6), 274-277. doi:10.1097/01.NNE.0000299476.57185.f3
7.
BarréJ.JobA.MicheletD.CabonP.DelgouletC.TesnièreA. (2018). La simulation obstétricale: du mannequin d’Angélique du Coudray aux Environnements Virtuels. Exemple d’un Simulateur numérique pour l’acquisition de Compétences Non-Techniques [Simulation in Obstetrics: from Angélique du Coudray’s doll to Virtual Environments. Example of a digital simulator for non-technical skills acquisition]. SeGaMed2018, Faculté de Médecine de Nice. Retrieved from https://www.researchgate.net/profile/Barre_Jessy/publication/322663119
8.
Barry IssenbergS.McGaghieW. C.PetrusaE. R.Lee GordonD.ScaleseR. J. (2005). Features and uses of high-fidelity medical simulations that lead to effective learning: A BEME systematic review. Medical Teacher, 27(1), 10-28. doi:10.1080/01421590500046924
9.
Bouvier-ColleM. H. (2007). Epidémiologie de la mortalité maternelle en France, fréquence et caractéristiques [Epidemiology of maternal mortality in France, frequency and characteristics]. Réanimation, 16(5), 358-365. doi:10.1016/j.reaurg.2007.07.001
10.
BrookeJ. (1996). SUS: A ‘quick and dirty’ usability scale. In JordanP. W.ThomasB.WeerdmeesterB. A.McClellandI. L. (Eds.), Usability evaluation in industry (pp. 189-194). London, England: Taylor & Francis.
11.
BrownR.DunnS.ByrnesK.MorrisR.HeinrichP.ShawJ. (2009). Doctors’ stress responses and poor communication performance in simulated bad-news consultations. Academic Medicine, 84(11), 1595-1602. doi:10.1097/ACM.0b013e3181baf537
12.
ByersJ. C.BittnerA. C.Jr.HillS. G. (1989). Traditional and raw Task Load Index (TLX) correlations: Are paired comparisons necessary? In MitalA. (Ed.), Advances in industrial ergonomics and safety (pp. 481-485). London, England: Taylor & Francis.
13.
Cannon-DiehlM. R. (2009). Simulation in healthcare and nursing: State of the science. Critical Care Nursing Quarterly, 32(2), 128-136. doi:10.1097/CNQ.0b013e3181a27e0f
14.
CooperJ. B.TaquetiV. (2004). A brief history of the development of mannequin simulators for clinical education and training. BMJ Quality & Safety, 13(Suppl. 1), i11-i18. doi:10.1136/qshc.2004.009886
15.
CornthwaiteK.EdwardsS.SiassakosD. (2013). Reducing risk in maternity by optimising teamwork and leadership: An evidence-based approach to save mothers and babies. Best Practice & Research Clinical Obstetrics & Gynaecology, 27(4), 571-581. doi:10.1016/j.b pobgyn.2013.04.004
16.
CreutzfeldtJ.HedmanL.MedinC.HeinrichsW. L.Felländer-TsaiL. (2010). Exploring virtual worlds for scenario-based repeated team training of cardiopulmonary resuscitation in medical students. Journal of Medical Internet Research, 12(3), e38. doi:10.2196/jmir.1426
17.
CrookallD. (2010). Serious games, debriefing, and simulation/gaming as a discipline. Simulation & Gaming, 41(6), 898-920. doi:10.1177/1046878110390784
18.
CsikszentmihalyiM. (1997). Finding flow: The psychology of engagement with everyday life. New York, NY: Basic Books.
19.
de RibaupierreS.KapralosB.HajiF.StrouliaE.DubrowskiA.EaglesonR. (2014). Healthcare training enhancement through virtual reality and serious games. In MaM.JainL. C.AndersonP. (Eds.), Virtual, augmented reality and serious games for healthcare1 (pp. 9-27). Berlin, Heidelberg: Springer.
20.
de Wit-ZuurendonkL. D.OeiS. G. (2011). Serious gaming in women’s health care. BJOG: An International Journal of Obstetrics & Gynaecology, 118(s3), 17-21. doi:10.1111/j.1471-0528.2011.03176.x
21.
Dit GautierE. J.Bot-RobinV.LibessartA.DoucèdeG.CossonM.RubodC. (2016). Design of a serious game for handling obstetrical emergencies. JMIR Serious Games, 4(2), e21. doi:10.2196/games.5526
22.
DonaldsonM. S.CorriganJ. M.KohnL. T. (2000). To err is human: Building a safer health system. Washington, DC: National Academies Press. doi:10.17226/9728
23.
DreyfusM.BeucherG.MignonA.LangerB. (2004). Prise en charge obstétricale initiale en cas d’hémorragie du post-partum [Initial obstetrical management of post-partum hemorrhage]. Journal de gynécologie obstétrique et biologie de la reproduction, 33(8), 57-64. doi:10.1016/S0368-2315(04)96647-1
24.
DuboisA.GélisJ.DemoyS.PetitcolasJ.BenozioM.BeugnotC.DurierC. (2004). La “machine” de Madame Du Coudray ou l’art des accouchements au XVIIIe siècle [The doll of Madame Du Coudray or the art of deliveries in the eighteenth century]. Rouen, France: Point de vues.
25.
EricssonK. A. (2009). Enhancing the development of professional performance: Implications from the study of deliberate practice. In EricssonK. A. (Ed.), Development of professional expertise: Toward measurement of expert performance and design of optimal learning environments (pp. 405-431). New York, NY: Cambridge University Press.
26.
FanningR. M.GabaD. M. (2007). The role of debriefing in simulation-based learning. Simulation in Healthcare, 2(2), 115-125. doi:10.1097/SIH.0b013e3180315539
27.
FletcherG.FlinR.McGeorgeP.GlavinR.MaranN.PateyR. (2003). Anaesthetists’ Non-Technical Skills (ANTS): Evaluation of a behavioural marker system. British Journal of Anaesthesia, 90(5), 580-588. doi:10.1093/bja/aeg112
28.
FlinR.GlavinR.MaranN.PateyR. (2003). Anaesthetists’ Non-Technical Skills (ANTS) system handbook. Aberdeen, UK: University of Aberdeen.
29.
FlinR.O’ConnorP.CrichtonM. (2008). Safety at the sharp end: A guide to non-technical skills. Aldershot, UK: Ashgate Publishing.
30.
FlinR.YoungsonG.Paterson-BrownS.YuleS.MaranN. (2006). The Non-Technical Skills for Surgeons (NOTSS) system handbook v1. 2. Aberdeen, UK: University of Aberdeen.
31.
FransenA. F.Van de VenJ.MeriénA. E. R.de Wit-ZuurendonkL. D.HoutermanS.MolB. W.OeiS. G. (2012). Effect of obstetric team training on team performance and medical technical skills: A randomised controlled trial. BJOG: An International Journal of Obstetrics and Gynaecology, 119(11), 1387-1393. doi:10.1111/j.1471-0528.2012.03436.x
32.
GabaD. M.DeAndaA. (1988). A comprehensive anesthesia simulation environment: Re-creating the operating room for research and training. Anesthesiology, 69(3), 387-394.
33.
GarrisR.AhlersR.DriskellJ. E. (2002). Games, motivation, and learning: A research and practice model. Simulation & Gaming, 33(4), 441-467. doi:10.1177/1046878102238607
34.
GhaniJ. A. (1995). Flow in human computer interactions: Test of a model. In CareyJ. M. (Ed.), Human factors in information systems: Emerging theoretical bases (pp. 291-311). Norwood, NJ: Ablex Publishing.
35.
GordonC. J.BuckleyT. (2009). The effect of high-fidelity simulation training on medical-surgical graduate nurses’ perceived ability to respond to patient clinical emergencies. The Journal of Continuing Education in Nursing, 40(11), 491-498. doi:10.3928/00220124-20091023-06
36.
Guillén-NietoV.Aleson-CarbonellM. (2012). Serious games and learning effectiveness: The case of It’s a Deal! Computers & Education, 58(1), 435-448. doi:10.1016/j.compedu.2011.07.015
37.
HartS. G.StavelandL. E. (1988). Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. Advances in Psychology, 52, 139-183. doi:10.1016/S0166-4115(08)62386-9
38.
HolzmanR. S.CooperJ. B.GabaD. M.PhilipJ. H.SmallS. D.FeinstemD. (1995). Anesthesia crisis resource management: Real-life simulation training in operating room crises. Journal of Clinical Anesthesia, 7(8), 675-687. doi:10.1016/0952-8180(95)00146-8
39.
HughesC.AndersonG.PattersonD.O’PreyM. (2014). Introducing an obstetric emergency training strategy into a simulated environment. British Journal of Midwifery, 22(3), 201-207. doi:10.12968/bjom.2014.22.3.201
40.
HullL.AroraS.KassabE.KneeboneR.SevdalisN. (2011). Observational teamwork assessment for surgery: Content validation and tool refinement. Journal of the American College of Surgeons, 212(2), 234-243. doi:10.1016/j.jamcollsurg.2010.11.001
KanthanR.SengerJ. L. (2011). The impact of specially designed digital games-based learning in undergraduate pathology and medical education. Archives of Pathology & Laboratory Medicine, 135(1), 135-142. Retrieved from http://www.archivesofpathology.org/doi/pdf/10.1043/2009-0698-OAR1.1
43.
KingH. (2007). Midwifery, obstetrics and the rise of gynaecology: The uses of a sixteenth-century compendium. Aldershot, UK: Ashgate Publishing.
44.
LeedalJ. M.SmithA. F. (2005). Methodological approaches to anaesthetists’ workload in the operating theatre. British Journal of Anaesthesia, 94(6), 702-709. doi:10.1093/bja/aei131
45.
Le FloreJ. L.AndersonM.MichaelJ. L.EngleW. D.AndersonJ. (2007). Comparison of self-directed learning versus instructor-modeled learning during a simulated clinical experience. Simulation in Healthcare, 2(3), 170-177. doi:10.1097/SIH.0b013e31812dfb46
46.
LovibondS. H.LovibondP. F. (1995). Manual for the Depression Anxiety & Stress Scales. Sydney, Australia: Psychology Foundation.
47.
MaM.JainL. C.AndersonP. (2014). Virtual, augmented reality and serious games for healthcare1. Berlin, Germany: Springer.
48.
MarshallN. E.VanderhoevenJ.EdenK. B.SegelS. Y.GuiseJ. M. (2015). Impact of simulation and team training on postpartum hemorrhage management in non-academic centers. The Journal of Maternal-Fetal & Neonatal Medicine, 28(5), 495-499. doi:10.3109/14767058.2014.923393
49.
MaslovitzS.BarkaiG.LessingJ. B.ZivA.ManyA. (2008). Improved accuracy of postpartum blood loss estimation as assessed by simulation. Acta obstetricia et gynecologica Scandinavica, 87(9), 929-934. doi:10.1080/00016340802317794
50.
McGrathJ.KmanN.DanforthD.BahnerD. P.KhandelwalS.MartinD. R.NelsonR. (2015). Virtual alternative to the oral examination for emergency medicine residents. Western Journal of Emergency Medicine, 16(2), 336-343. doi:10.5811/westjem.2015.1.24344
51.
NakamuraJ.CsikszentmihalyiM. (2002). The concept of flow. In SnyderC. R.LopezS. J. (Eds.), Handbook of positive psychology (pp. 89-105). New York, NY: Oxford University Press.
52.
NorrisG. (2008). The midwifery curriculum: Introducing obstetric emergency simulation. British Journal of Midwifery, 16(4), 232-235. doi:10.12968/bjom.2008.16.4.29047
53.
O’dowdM. J.PhilippE. E. (2000). The history of obstetrics and gynaecology. London, England: Taylor & Francis.
54.
PasquierP.MératS.MalgrasB.PetitL.QueranX.BayC.PerezJ. P. (2016). A serious game for massive training and assessment of French soldiers involved in forward combat casualty care (3D-SC1): Development and deployment. JMIR Serious Games, 4(1), e51-e10. doi:10.2196/games.5340
55.
PronovostP. J.WeastB.HolzmuellerC. G.RosensteinB. J.KidwellR. P.HallerK. B.RubinH. R. (2003). Evaluation of the culture of safety: Survey of clinicians and managers in an academic medical center. BMJ Quality & Safety, 12(6), 405-410. doi:10.1136/qhc.12.6.480
56.
ScholesJ.EndacottR.BiroM.BulleB.CooperS.MilesM.JonesJ. (2012). Clinical decision-making: Midwifery students’ recognition of, and response to, post partum haemorrhage in the simulation environment. BMC Pregnancy and Childbirth, 12, Article 19. doi:10.1186/1471-2393-12-19
57.
ShouhedD.GewertzB.WiegmannD.CatchpoleK. (2012). Integrating human factors research and surgery: A review. Archives of Surgery, 147(12), 1141-1146. doi:10.1001/jamasurg.2013.596
58.
StewartS.DavisD. (2012). On the MUVE or in decline: Reflecting on the sustainability of the Virtual Birth Centre developed in Second Life. Australasian Journal of Educational Technology, 28(3), 480-503. doi:10.14742/ajet.846
59.
StreufertS.SatishU.BarachP. (2001). Improving medical care: The use of simulation technology. Simulation & Gaming, 32(2), 164-174. doi:10.1177/104687810103200205
60.
TaekmanJ. M.FouremanM. F.BulambaF.SteeleM.ComstockE.KintuA.OlufolabiA. (2017). A novel multiplayer screen-based simulation experience for African learners improved confidence in management of postpartum hemorrhage. Frontiers in Public Health, 5, Article 248. doi:10.3389/fpubh.2017.00248
61.
VermeulenJ.BeeckmanK.TurcksinR.Van WinkelL.GucciardoL.LaubachM.SwinnenE. (2017). The experiences of last-year student midwives with High-Fidelity Perinatal Simulation training: A qualitative descriptive study. Women and Birth, 30(3), 253-261. doi:10.1016/j.wombi.2017.02.014
62.
VincentC.Taylor-AdamsS.StanhopeN. (1998). Framework for analysing risk and safety in clinical medicine. British Medical Journal, 316(7138), 1154-1157.
63.
WattanasoontornV.MagdicsM.BoadaI.SbertM. (2013). A kinect-based system for cardiopulmonary resuscitation simulation: A pilot study. In MaM.Fradinho OliveiraM.SobahA.HaugeJ. Baalsrud (Eds.), Serious games development and applications (pp. 51-63). Berlin, Heidelberg: Springer. doi:10.1007/978-3-642-40790-1_5
64.
WeickK.SutcliffeK. M. (2011). Managing the unexpected: Resilient performance in an age of uncertainty (2nd ed.). San Francisco, CA: John Wiley & Sons.
65.
WiechaJ.HeydenR.SternthalE.MerialdiM. (2010). Learning in a virtual world: Experience with using second life for medical education. Journal of Medical Internet Research, 12(1), e11-e27. doi:10.2196/jmir.1337
66.
WienerE. L. (1980). Midair collisions: The accidents, the systems, and the realpolitik. Human Factors, 22(5), 521-533. doi:10.1177/001872088002200502
YoungG.ZavelinaL.HooperV. (2008). Assessment of workload using NASA Task Load Index in perianesthesia nursing. Journal of PeriAnesthesia Nursing, 23(2), 102-110. doi:10.1016/j.jopan.2008.01.008
70.
YurkoY. Y.ScerboM. W.PrabhuA. S.AckerC. E.StefanidisD. (2010). Higher mental workload is associated with poorer laparoscopic performance as measured by the NASA-TLX tool. Simulation in Healthcare, 5(5), 267-271. doi:10.1097/SIH.0b013e3181e3f329
