The objective of this work was to assess the functional utility of new display concepts for an emergency department information system created using cognitive systems engineering methods, by comparing them to similar displays currently in use. The display concepts were compared to standard displays in a clinical simulation study during which nurse-physician teams performed simulated emergency department tasks. Questionnaires were used to assess the cognitive support provided by the displays, participants’ level of situation awareness, and participants’ workload during the simulated tasks. Participants rated the new displays significantly higher than the control displays in terms of cognitive support. There was no significant difference in workload scores between the display conditions. There was no main effect of display type on situation awareness, but there was a significant interaction; participants using the new displays showed improved situation awareness from the middle to the end of the session. This study demonstrates that cognitive systems engineering methods can be used to create innovative displays that better support emergency medicine tasks, without increasing workload, compared to more standard displays. These methods provide a means to develop emergency department information systems—and more broadly, health information technology—that better support the cognitive needs of healthcare providers.
Adobe. (2010). Adobe Flash Builder (Version 4.6). San Jose, CA: Adobe Systems Inc.
2.
AhlstromU. (2005). Work domain analysis for air traffic controller weather displays. Journal of safety research, 36(2), 159-169.
3.
Association of American Medical Colleges, Center for Workforce Studies Colleges. (2012). 2012 physician specialty data book. Washington, DC: Author.
4.
BagnascoA.TubinoB.PiccottiE.RosaF.AleoG.Di PietroP.… GambinoL. (2013). Identifying and correcting communication failures among health professionals working in the Emergency Department. International Emergency Nursing, 21(3), 168-172.
5.
BisantzA. M. (2008). Cognitive engineering applications in health care. Paper presented at the Frontiers of Engineering: Reports on Leading-Edge Engineering from the 2008 Symposium, San Diego, CA.
6.
BisantzA. M.BurnsC. M. (2008). Applications of cognitive work analysis. Boca Raton, FL: CRC Press.
7.
BisantzA. M.BurnsC. M.FairbanksR. J. (2014). Cognitive systems engineering in health care. Boca Raton, FL: CRC Press, Taylor & Francis.
8.
BisantzA. M.PennathurP. R.GuarreraT. K.FairbanksR. J.PerryS. J.ZwemerF.WearsR. L. (2010). Emergency department status boards: A case study in information systems transition. Journal of Cognitive Engineering and Decision Making, 4(1), 39-68.
9.
BisantzA. M.RothE. (2008). Analysis of cognitive work. Paper presented at the Reviews of Human Factors and Ergonomics, Santa Monica, CA.
10.
BurnsC. M.BisantzA. M.RothE. M. (2004). Lessons from a comparison of work domain models: Representational choices and their implications. Human Factors: The Journal of the Human Factors and Ergonomics Society, 46(4), 711-727.
ChisholmC. D.CollisonE. K.NelsonD. R.CordellW. H. (2000). Emergency department workplace interruptions are emergency physicians “interrupt-driven” and “multitasking”?Academic Emergency Medicine, 7(11), 1239-1243. doi: 10.1111/j.1553-2712.2000.tb00469.x
13.
ClarkL. N.GuarreraT. K.McGeorgeN. M.HettingerA. Z.HernandezA.LaVergneD. T.… BisantzA. M. (2014). Usability evaluation and assessment of a novel emergency department IT system developed using a cognitive systems engineering approach. Paper presented at the Proceedings of the 2014 International Symposium on Human Factors and Ergonomics in Healthcare: Leading the Way, Chicago.
14.
CroskerryP.SinclairD. (2001). Emergency medicine: A practice prone to error?Canadian Journal of Emergency Medicine, 3(4), 271.
15.
EffkenJ. A. (2002). Different lenses, improved outcomes: A new approach to the analysis and design of healthcare information systems. International Journal of Medical Informatics, 65(1), 59-74. doi: http://dx.doi.org/10.1016/S1386-5056(02)00003-5
16.
EffkenJ. A.BrewerB. B.LogueM. D.GephartS. M.VerranJ. A. (2011). Using Cognitive Work Analysis to fit decision support tools to nurse managers’ work flow. International Journal of Medical Informatics, 80(10), 698-707. doi: http://dx.doi.org/10.1016/j.ijmedinf.2011.07.003
17.
EffkenJ. A.LoebR. G.KangY.LinZ.- C. (2008). Clinical information displays to improve ICU outcomes. International Journal of Medical Informatics, 77(11), 765-777. doi: 10.1016/j.ijmedinf.2008.05.004
18.
EndsleyM. R. (2000). Theoretical underpinnings of situation awareness: A critical review. In EndsleyM. R.GarlandD. J. (Eds.), Situation awareness analysis and measurement (pp. 3-32). Mahwah, NJ: Lawrence Erlbaum Associates.
19.
FairbanksR. J.BisantzA. M.SunmM. (2007). Emergency department communication links and patterns. Annals of Emergency Medicine, 50(4), 396-406.
20.
FairbanksR.KarnK.CaplanS.GuarreraT.ShahM.WearsR. (2008). Use error hazards from a popular emergency department information system. Paper presented at the Usability Professionals Association 2008 International Conference, Baltimore.
21.
GuarreraT. K.McGeorgeN. M.ClarkL. N.LaVergneD. T.HettingerZ. A.FairbanksR. J.BisantzA. M. (2015). Cognitive engineering design of an emergency department information system. In BisantzA. M.BurnsC. M.FairbanksR. J. (Eds.), Cognitive systems engineering in healthcare (pp. 43-74). Boca Raton, FL: CRC Press, Taylor & Francis.
22.
GuarreraT. K.StephensR. J.ClarkL. N.McGeorgeN. M.FairbanksR. J. T.PerryS. J.… BisantzA. M. (2012). Engineering better health IT: Cognitive systems engineering of a novel emergency department IT system. Paper presented at the Proceedings of the 2012 Symposium on Human Factors and Ergonomics in Health Care, Baltimore.
23.
HajdukiewiczJ. R.VicenteK. J.DoyleD. J.MilgramP.BurnsC. M. (2001). Modeling a medical environment: An ontology for integrated medical informatics design. International Journal of Medical Informatics, 62(1), 79-99. doi: http://dx.doi.org/10.1016/S1386-5056(01)00128-9
24.
HartS. (2006). NASA-task load index (NASA-TLX); 20 years later. Paper presented at the Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Santa Monica, CA.
25.
HartS.StavelandL. E. (1988). Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. Human Mental Workload, 1(3), 139-183.
26.
HertzumM.SimonsenJ. (2013). Work-practice changes associated with an electronic emergency department whiteboard. Health Informatics Journal, 19(1), 46-60.
27.
HertzumM.SimonsenJ. (2015). Visual overview, oral detail: The use of an emergency-department whiteboard. International Journal of Human-Computer Studies, 82(0), 21-30. doi: http://dx.doi.org/10.1016/j.ijhcs.2015.04.004
28.
JamiesonG.MillerC. A.HoW. H.VicenteK. J. (2007). Integrating task- and work domain-based work analyses in ecological interface design: A process control case study. Systems, Man and Cybernetics, Part A: Systems and Humans, IEEE Transactions on, 37(6), 887-905.
29.
JiancaroT.JamiesonG. A.MihailidisA. (2013). Twenty years of cognitive work analysis in health care: A scoping review. Journal of Cognitive Engineering and Decision Making, 8(1), 3-22.
30.
KilnerE.SheppardL. A. (2010). The role of teamwork and communication in the emergency department: A systematic review. International Emergency Nursing, 18(3), 127-137.
31.
KwokJ.BurnsC. M. (2005). Usability evaluation of a mobile ecological interface design application for diabetes management. Paper presented at the Proceedings of the Human Factors and Ergonomics Society Annual Meeting.
32.
LaxmisanA.HakimzadaF.SayanO. R.GreenR. A.ZhangJ.PatelV. L. (2007). The multitasking clinician: Decision-making and cognitive demand during and after team handoffs in emergency care. International Journal of Medical Informatics, 76(11-12), 801-811. doi: 10.1016/j.ijmedinf.2006.09.019
33.
LimR.AndersonJ.BuckleP. (2008). Analysing care home medication errors: A comparison of the London protocol and work domain analysis. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 52(4), 453-457. doi: 10.1177/154193120805200453
34.
NaikarN. (2013). Work domain analysis: Concepts, guidelines, and cases. Boca Raton, FL: CRC Press.
35.
NaikarN.MoylanA.PearceB. (2006). Analysing activity in complex systems with cognitive work analysis: Concepts, guidelines and case study for control task analysis. Theoretical Issues in Ergonomics Science, 7(4), 371-394.
36.
NemethC.AndersS.BrownJ.GromeA.CrandallB.PamplinJ. C. (2015). Support for ICU Clinician Cognitive Work through CSE. In BisantzA. M.BurnsC. M.FairbanksR. J. (Eds.), Cognitive systems engineering in healthcare (pp. 127-152). Boca Raton, FL: CRC Press, Taylor & Francis.
37.
ParushA. (2015). Displays for health care teams: A conceptual framework and design methodology. In BisantzA. M.BurnsC. M.FairbanksR. J. (Eds.), Cognitive systems engineering in health care (pp. 75-95). Boca Raton, FL: CRC Press.
38.
ParushA.KramerC.Foster-HuntT.MomtahanK.HunterA.SohmerB. (2011). Communication and team situation awareness in the OR: Implications for augmentative information display. Journal of Biomedical Informatics, 44(3), 477-485.
39.
PennathurP. R.BisantzA. M.FairbanksR. J.PerryS. J.ZwemerF.WearsR. L. (2007). Assessing the impact of computerization on work practice: Information technology in emergency departments. Paper presented at the Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Santa Monica, CA.
40.
PennathurP. R.CaoD.SuiZ.LinL.BisantzA. M.FairbanksR. J.… WearsR. L. (2010). Development of a simulation environment to study emergency department information technology. Simulation in Healthcare, 5(2), 103-111.
41.
PennathurP. R.GuarreraT. K.BisantzA. M.FairbanksR. J.PerryS. J.WearsR. L. (2008). Cognitive artifacts in transition: An analysis of information content changes between manual and electronic patient tracking systems. Paper presented at the Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Santa Monica, CA.
42.
PerryS. J. (2004). An overlooked alliance: Using human factors engineering to reduce patient harm. Joint Commission Journal on Quality and Patient Safety, 30(8), 455-459.
43.
RasmussenJ.PejtersenA. M.GoodsteinL. P. (1994). Cognitive systems engineering. New York: John Wiley & Sons, Inc.
44.
RedfernE.BrownR.VincentC. (2009). Identifying vulnerabilities in communication in the emergency department. Emergency Medicine Journal, 26(9), 653-657.
45.
SarcevicA.LeskM. E.MarsicI.BurdR. S. (2008). Quantifying adaptation parameters for information support of trauma teams. Paper presented at the CHI ‘08 Extended Abstracts on Human Factors in Computing Systems, Florence, Italy.
46.
SchenkelS. (2000). Promoting patient safety and preventing medical error in emergency departments. Academic Emergency Medicine, 7(11), 1204-1222. doi: 10.1111/j.1553-2712.2000.tb00466.x
47.
SeamsterT. L.ReddingR. E.KaempfG. L. (1997). Applied cognitive task analysis in aviation. Aldershot, UK: Ashgate.
48.
SharpT. D.HelmickiA. J. (1998). The application of the ecological interface design approach to neonatal intensive care medicine. Paper presented at the Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Santa Monica, CA.
49.
TruxlerR.RothE.ScottR.SmithS.WamplerJ. (2012). Designing collaborative automated planners for agile adaptation to dynamic change. Paper presented at the Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Santa Monica, CA.
50.
U.S. Census Bureau. (2013). Men in nursing occupations: American Community Survey highlight report. Washington, DC: Author.
51.
VicenteK. J. (1999). Cognitive work analysis: Toward safe, productive, and healthy computer-based work. Boca Raton, FL: CRC Press.
52.
WearsR. L.PerryS. J.WilsonS.GalliersJ.FoneJ. (2006). Emergency department status boards: User-evolved artefacts for inter- and intra-group coordination. Cognition, Technology & Work, 9(3), 163-170. doi: 10.1007/s10111-006-0055-7
53.
XiaoY.ProbstC. A. (2015). Engagement and macroergonomics: Using cognitive engineering to improve patient safety. In BisantzA. M.BurnsC. M.FairbanksR. J. (Eds.), Cognitive systems engineering in healthcare (pp. 175-198). Boca Raton, FL: CRC Press, Taylor & Francis.
54.
XiaoY.SchenkelS.FarajS.MackenzieC. F.MossJ. (2007). What whiteboards in a trauma center operating suite can teach us about emergency department communication. Annals of Emergency Medicine, 50(4), 387-395. doi: 10.1016/j.annemergmed.2007.03.027
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
