Background. Training of medical professionals is important to improve care during mass-causality events. Therefore, it is essential to extend knowledge on how to design valid and usable simulation-based training environments.
Purpose. This article investigates how distributed cognition and simulation theory concepts can guide design of simulation-based training environments. We present the design and user evaluation of DigEmergo, a simulator for training and assessing emergency medicine management.
Design approach. A prior Distributed Cognition in Teamwork (DiCoT) analysis of the Emergo Train System (ETS) guided the design process. The design objective of DigEmergo was to be useful, usable, retain distributed cognition features of ETS, and strengthen validity and output reliability.
Evaluation. Eight expert ETS instructors participated in a formative system evaluation. The Technology Assessment Model (TAM) questionnaire was used to measure usefulness and ease of use. Observations and post-test interviews were conducted to contextualize the measures.
Results. The results showed that DigEmergo was perceived as somewhat to quite useful and somewhat easy to use. Overall, expert users considered DigEmergo promising and successful in retaining core ETS features.
Conclusions. The study indicates that a design methodology based on distributed cognition and simulation theory can be successfully combined to guide simulator (re)design and strengthen simulator validity.
AlessiS. M. (1988). Fidelity in the design of instructional simulations. Journal of Computer-Based Instruction, 15(2), 40-47. Retrieved from http://psycnet.apa.org/psycinfo/1989-13468-001
BewleyW. L.O’NeilH. F. (2013). Evaluation of medical simulations. Military Medicine, 178(10, Suppl.), 64-75. doi:10.7205/MILMED-D-13-00255
4.
BlackwellT. H.KaufmanJ. S. (2002). Response time effectiveness: Comparison of response time and survival in an urban emergency medical services system. Academic Emergency Medicine, 9(4), 288-295. doi:10.1111/j.1553-2712.2002.tb01321.x
5.
BollingR.EhrlinY.ForsbergR.RüterA.SoestV.VikströmT.. . . BrändströmH. (2007). KAMEDO Report 90: Terrorist attacks in Madrid, Spain, 2004. Prehospital and Disaster Medicine, 22(3), 252-257. Retrieved from http://www.ncbi.nlm.nih.gov/pubmed/17894223
6.
CassK.LauerT. W. (2004). Media transitions: The cases of digital imagery and e-mail. Information Technology & People, 17(3), 252-267. doi:10.1108/09593840410554175
7.
CohenD.SevdalisN.TaylorD.KerrK.HeysM.WillettK.. . . DarziA. (2013). Emergency preparedness in the 21st century: Training and preparation modules in virtual environments. Resuscitation, 84(1), 78-84. doi:10.1016/j.resuscitation.2012.05.014
8.
DavisF. (1989). Perceived usefulness, perceived ease of use, and user acceptance. MIS Quarterly, 13(3), 319-339. doi:10.2307/249008
9.
FeinsteinA. H.CannonH. M. (2002). Constructs of simulation evaluation. Simulation & Gaming, 33(4), 425-440. doi:10.1177/1046878102238606
10.
FurnissD.BlandfordA. (2006). Understanding emergency medical dispatch in terms of distributed cognition: A case study. Ergonomics, 49(12-13), 1174-1203. doi:10.1080/00140130600612663
11.
GarbisC. (2000). Communication and coordination through public and private representations in control rooms. In Proceedings of the Chi, 2000, extended abstracts on Human factors in computing systems (pp. 67-68). New York, USA: ACM. Retrieved from http://doi.org/10.1145/633292.633334
12.
GrythD.RådestadM.NilssonH.NerfO.SvenssonL.CastrénM.RüterA. (2010). Evaluation of medical command and control using performance indicators in a full-scale, major aircraft accident exercise. Prehospital and Disaster Medicine, 25(2), 118-124. Retrieved from http://journals.cambridge.org/production/action/cjoGetFulltext?fulltextid=8559047
13.
HancockP.VincenziD.WiseJ.MoulouaM. (2010). Human factors in simulation and training. Boca Raton, FL: CRC Press.
14.
HochmitzI.Yuviler-GavishN. (2011). Physical fidelity versus cognitive fidelity training in procedural skills acquisition. Human Factors, 53(5), 489-501. doi:10.1177/0018720811412777
15.
HutchinsE.LinternG. (1995). Cognition in the wild. Cambridge, MA: MIT Press.
16.
IssenbergS. B.McGaghieW. C.HartI. R.MayerJ. W.FelnerJ. M.PetrusaE. R.. . . EwyG. A. (1999). Simulation technology for health care professional skills training and assessment. Journal of the American Medical Association, 282(9), 861-866.
17.
IssenbergS. B.McGaghieW. C.PetrusaE. R.Lee GordonD.ScaleseR. J. (2005). Features and uses of high-fidelity medical simulations that lead to effective learning: A BEME systematic review. Medical Teacher, 27(1), 10-28. doi:10.1080/01421590500046924
18.
JaspersM. W. M. (2009). A comparison of usability methods for testing interactive health technologies: Methodological aspects and empirical evidence. International Journal of Medical Informatics, 78(5), 340-353. doi:10.1016/j.ijmedinf.2008.10.002
19.
JuffermansJ.BierensJ. (2010). Recurrent medical response problems during five recent disasters in the Netherlands. Prehospital and Disaster Medicine, 25(2), 127-136.
20.
KirshD. (1995). The intelligent use of space. Artificial Intelligence, 73(1-2), 31-68.
21.
LegemaateG. A.BurkleF. M.Jr.BierensJ. J. (2012). The evaluation of research methods during disaster exercises: Applicability for improving disaster health management. Prehospital and Disaster Medicine, 27(1), 18-26. doi:10.1017/S1049023X11006789
22.
LennquistS. (2005). Education and training in disaster medicine. Scandinavian Journal of Surgery: Official Organ for the Finnish Surgical Society and the Scandinavian Surgical Society, 94(4), 300-310. Retrieved from http://www.ncbi.nlm.nih.gov/pubmed/16425626
23.
LukoschH.KurapatiS.GroenD.VerbraeckA. (2016). Microgames for situated learning: A case study in interdependent planning. Simulation & Gaming, 47(3), 346-367. doi:10.1177/1046878116635468
24.
MaranN. J.GlavinR. J. (2003). Low- to high-fidelity simulation—A continuum of medical education?Medical Education, 37(1), 22-28. Retrieved from http://www.ncbi.nlm.nih.gov/pubmed/14641635
25.
McAulayL. (2007). Unintended consequences of computer-mediated communications. Behaviour & Information Technology, 26(5), 385-398. doi:10.1080/01449290500535343
26.
McGaghieW. C.IssenbergS. B.PetrusaE. R.ScaleseR. J. (2006). Effect of practice on standardised learning outcomes in simulation-based medical education. Medical Education, 40, 792-797. doi:10.1111/j.1365-2929.2006.02528.x
27.
McGaghieW. C.IssenbergS. B.PetrusaE. R.ScaleseR. J. (2010). A critical review of simulation-based medical education research: 2003-2009. Medical Education, 44(1), 50-63. Retrieved from http://doi.org/10.1111/j.1365-2923.2009.03547.x
NilssonH.VikströmT.RüterA. (2010). Quality control in disaster medicine training—Initial regional medical command and control as an example. American Journal of Disaster Medicine, 5(1), 35-40. Retrieved from http://www.ncbi.nlm.nih.gov/pubmed/20349701
30.
PerryM. (2003). Distributed cognition. In CarrollJ. M. (Ed.), HCI models, theories, and frameworks: Toward a multidisciplinary science (pp. 212-223). San Francisco, CA: Morgan Kaufmann.
31.
RådestadM.NilssonH.CastrénM.SvenssonL.RüterA.GrythD. (2012). Combining performance and outcome indicators can be used in a standardized way for creating lessons learned in disaster response training: An observational study of two of multidisciplinary, full-scale major aircraft exercises. Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine, 20, Article 58. doi:10.1186/1757-7241-20-58
32.
RybingJ.NilssonH.JonsonC.-O.BangM. (2016). Studying distributed cognition of simulation-based team training with DiCoT. Ergonomics, 59(3), 423-434. doi:10.1080/00140139.2015.1074290
33.
SokolowskiJ. A.BanksC. M. (2010). Modeling and simulation fundamentals: Theoretical underpinnings and practical domains (SokolowskiJ. A.BanksC. M., Eds.). Hoboken, NJ: John Wiley.
34.
SundnesK.BirnbaumM. (2003). Health disaster management: Guidelines for evaluation and research in the Utstein Style. Volume I. Conceptual framework of disasters. Prehospital and Disaster Medicine, 17(3), 1-177.
35.
ToupsZ. O.KerneA.HamiltonW. A.ShahzadN. (2011). Zero-fidelity simulation of fire emergency response: Improving team coordination learning. Chi, 2011, 1959-1968. doi:10.1145/1978942.1979226
36.
van Engen-VerheulM. M.PeuteL. W. P.de KeizerN. F.PeekN.JaspersM. W. M. (2016). Optimizing the user interface of a data entry module for an electronic patient record for cardiac rehabilitation: A mixed method usability approach. International Journal of Medical Informatics, 87, 15-26. doi:10.1016/j.ijmedinf.2015.12.007
