Effective decision-making in crisis events is challenging due to time pressure, uncertainty, and dynamic decisional environments. We conducted a systematic literature review in PubMed and PsycINFO, identifying 32 empiric research papers that examine how trained professionals make naturalistic decisions under pressure. We used structured qualitative analysis methods to extract key themes. The studies explored different aspects of decision-making across multiple domains. The majority (19) focused on healthcare; military, fire and rescue, oil installation, and aviation domains were also represented. We found appreciable variability in research focus, methodology, and decision-making descriptions. We identified five main themes: (1) decision-making strategy, (2) time pressure, (3) stress, (4) uncertainty, and (5) errors. Recognition-primed decision-making (RPD) strategies were reported in all studies that analyzed this aspect. Analytical strategies were also prominent, appearing more frequently in contexts with less time pressure and explicit training to generate multiple explanations. Practitioner experience, time pressure, stress, and uncertainty were major influencing factors. Professionals must adapt to the time available, types of uncertainty, and individual skills when making decisions in high-risk situations. Improved understanding of these decisional factors can inform evidence-based enhancements to training, technology, and process design.
AndersS.RealeC.SalweiM. E.SlagleJ.MilitelloL. G.GabaD.SusherebaC.WeingerM. B. (2022). Using a hybrid decision making model to inform qualitative data coding. In Paper presented at the International Symposium on Human Factors and Ergonomics in Health Care, New Orleans, LA, 20-23 March, 2022.
2.
AxelssonA.JanssonA. A. (2018). On the importance of mental time frames: A case for the need of empirical methods to investigate adaptive expertise. Journal of Applied Research in Memory and Cognition, 7(1), 51–59. https://doi.org/10.1016/j.jarmac.2017.12.004
3.
BarwoodM. J.DalzellJ.DattaA. K.ThelwellR. C.TiptonM. J. (2006). Breath-hold performance during cold water immersion: effects of psychological skills training. Aviation, Space, and Environmental Medicine, 77(11), 1136–1142.
4.
BearmanC.BremnerP. A. (2013). A day in the life of a volunteer incident commander: errors, pressures and mitigating strategies. Applied Ergonomics, 44(3), 488–495. https://doi.org/10.1016/j.apergo.2012.10.011
5.
BearmanC.PaletzS. B.OrasanuJ. (2009). Situational pressures on aviation decision making: Goal seduction and situation aversion. Aviation, Space, and Environmental Medicine, 80(6), 556–560. https://doi.org/10.3357/asem.2363.2009
6.
ChrouserK. L.XuJ.HallbeckS.WeingerM. B.PartinM. R. (2018). The influence of stress responses on surgical performance and outcomes: Literature review and the development of the surgical stress effects (SSE) framework. The American Journal of Surgery, 216(3), 573–584. https://doi.org/10.1016/j.amjsurg.2018.02.017
7.
CioffiJ. (2000). Nurses’ experiences of making decisions to call emergency assistance to their patients. Journal of Advanced Nursing, 32(1), 108–114. https://doi.org/10.1046/j.1365-2648.2000.01414.x
8.
CohenI. (2008). Improving time-critical decision making in life-threatening situations: Observations and insights. Decision Analysis, 5(2), 100–110. https://doi.org/10.1287/deca.1080.0111
9.
Cohen-HattonS. R.ButlerP. C.HoneyR. C. (2015). An investigation of operational decision making in situ: Incident command in the UK fire and rescue service. Human Factors, 57(5), 793–804. https://doi.org/10.1177/0018720815578266
10.
Cohen-HattonS. R.HoneyR. C. (2015). Goal-oriented training affects decision-making processes in virtual and simulated fire and rescue environments. Journal of Experimental Psychology: Applied, 21(4), 395–406. https://doi.org/10.1037/xap0000061
11.
CristanchoS. M.VanstoneM.LingardL.LeBelM.-E.OttM. (2013). When surgeons face intraoperative challenges: A naturalistic model of surgical decision making. The American Journal of Surgery, 205(2), 156–162. https://doi.org/10.1016/j.amjsurg.2012.10.005
DominguezC. O. (2001). Expertise and metacognition in laparoscopic surgery: A field study. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 45(17), 1298–1302. https://doi.org/10.1177/154193120104501709
14.
DyreL.TaborA.RingstedC.TolsgaardM. G. (2017). Imperfect practice makes perfect: Error management training improves transfer of learning. Medical Education, 51(2), 196–206. https://doi.org/10.1111/medu.13208
15.
EddyD. M. (1996). Clinical decision making: From theory to practice.
16.
FarnanJ. M.JohnsonJ. K.MeltzerD. O.HumphreyH. J.AroraV. M. (2008). Resident uncertainty in clinical decision making and impact on patient care: a qualitative study. BMJ Quality & Safety, 17(2), 122–126. https://doi.org/10.1136/qshc.2007.023184
17.
FlinR.SlavenG.StewartK. (1996). Emergency decision making in the offshore oil and gas industry. Human Factors, 38(2), 262–277. https://doi.org/10.1518/001872096779048110
18.
FlottorpS. A.OxmanA. D.KrauseJ.MusilaN. R.WensingM.Godycki-CwirkoM.BakerR.EcclesM. P. (2013). A checklist for identifying determinants of practice: A systematic review and synthesis of frameworks and taxonomies of factors that prevent or enable improvements in healthcare professional practice. Implementation Science, 8(1), 1–11. https://doi.org/10.1186/1748-5908-8-35
19.
FranklinB. R.DykeC.DurningS. J.ArtinoA. R.BowyerM. W.NealeighM. D.KuceraW. B.RitterE. M. (2021). Piloting the fire: A novel error management training simulation curriculum for fasciotomy instruction. Journal of Surgical Education, 78(2), 655–664. https://doi.org/10.1016/j.jsurg.2020.08.027
20.
GabaD. M.FishK. J.HowardS. K.BurdenA. (2014). Crisis management in anesthesiology E-Book. Elsevier Health Sciences.
Hamui-SuttonA.Vives-VarelaT.Gutiérrez-BarretoS.LeenenI.Sánchez-MendiolaM. (2015). A typology of uncertainty derived from an analysis of critical incidents in medical residents: A mixed methods study. BMC Medical Education, 15(1), 198. https://doi.org/10.1186/s12909-015-0459-2
24.
HausmannD.ZulianC.BattegayE.ZimmerliL. (2016). Tracing the decision-making process of physicians with a decision process matrix. BMC Medical Informatics and Decision Making, 16(1), 133. https://doi.org/10.1186/s12911-016-0369-1
25.
HorsleyT.DingwallO.SampsonM. (2011). Checking reference lists to find additional studies for systematic reviews. Cochrane Database of Systematic Reviews, 2011(8), MR000026. https://doi.org/10.1002/14651858.mr000026.pub2
26.
IlgenJ. S.RegehrG.TeunissenP. W.SherbinoJ.de BruinA. B. (2021). Skeptical self-regulation: Resident experiences of uncertainty about uncertainty. Medical Education, 55(6), 749–757. https://doi.org/10.1111/medu.14459
27.
IlgenJ. S.TeunissenP. W.de BruinA. B.BowenJ. L.RegehrG. (2021). Warning bells: how clinicians leverage their discomfort to manage moments of uncertainty. Medical Education, 55(2), 233–241. https://doi.org/10.1111/medu.14304
28.
JohnstonJ. H.DriskellJ. E.SalasE. (1997). Vigilant and hypervigilant decision making. Journal of Applied Psychology, 82(4), 614–622. https://doi.org/10.1037/0021-9010.82.4.614
29.
KaempfG. L.KleinG.ThordsenM. L.WolfS. (1996). Decision making in complex naval command-and-control environments. Human Factors, 38(2), 220–231. https://doi.org/10.1518/001872096779047986
30.
KahnemanD. (2011). Thinking, fast and slow. Macmillan.
31.
KahnemanD.KleinG. (2009). Conditions for intuitive expertise. American Psychologist, 64(6), 515–526. https://doi.org/10.1037/a0016755
32.
KeithN.FreseM. (2008). Effectiveness of error management training: A meta-analysis. Journal of Applied Psychology, 93(1), 59–69. https://doi.org/10.1037/0021-9010.93.1.59
33.
KleinG. (1989). Recognition-primed decisions. In RouseW. (Ed.), Advances in man-machine systems research (5, pp. 47–92). JAI Press.
34.
KleinG. A. (1993). A recognition-primed decision (RPD) model of rapid decision making. Decision Making in Action: Models and Methods, 5(4), 138–147.
35.
KrebsW. K.McCarleyJ. S.BryantE. V. (1999). Effects of mission rehearsal simulation on air-to-ground target acquisition. Human Factors, 41(4), 553–558. https://doi.org/10.1518/001872099779656725
McClernonC. K. (2009). Stress effects on transfer from virtual environment flight training to stressful flight environments. http://hdl.handle.net/10945/10441
38.
McLennanJ.OmodeiM. M. (1996). The role of prepriming in recognition-primed decisionmaking. Perceptual and Motor Skills, 82(3_suppl), 1059–1069. https://doi.org/10.2466/pms.1996.82.3c.1059
39.
MilitelloL. G.AndersS. (2018). Incident-based methods for studying expertise. In WardP.SchraagenJ. M.GoreJ.RothE. (Eds.), The oxford handbook of expertise (pp. 429–450). Oxford Library of PsychologyOxford Academic.
40.
MilitelloL. G.SusherebaC. E.RamachandranS. (2023). Handbook of augmented reality training design principles. Cambridge University Press.
41.
MosierK. L.SethiN.McCauleyS.KhooL.OrasanuJ. M. (2007). What you don’t know can hurt you: Factors impacting diagnosis in the automated cockpit. Human Factors, 49(2), 300–310. https://doi.org/10.1518/001872007x312513
42.
OrasanuJ.DismukesR. K.FischerU. (1993). Decision errors in the cockpit. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 37(4), 363.
43.
PauleyK.FlinR.Azuara-BlancoA. (2013). Intra-operative decision making by ophthalmic surgeons. British Journal of Ophthalmology, 97(10), 1303–1307. https://doi.org/10.1136/bjophthalmol-2012-302642
44.
PauleyK.FlinR.YuleS.YoungsonG. (2011). Surgeons' intraoperative decision making and risk management. The American Journal of Surgery, 202(4), 375–381. https://doi.org/10.1016/j.amjsurg.2010.11.009
45.
PelacciaT.TardifJ.TribyE.AmmiratiC.BertrandC.DoryV.CharlinB. (2014). How and when do expert emergency physicians generate and evaluate diagnostic hypotheses? A qualitative study using head-mounted video cued-recall interviews. Annals of Emergency Medicine, 64(6), 575–585. https://doi.org/10.1016/j.annemergmed.2014.05.003
46.
RasmussenJ. (1983). Skills, rules, and knowledge; signals, signs, and symbols, and other distinctions in human performance models. IEEE Transactions on Systems, Man, and Cybernetics, 13(3), 257–266. https://doi.org/10.1109/TSMC.1983.6313160
47.
RealeC.SusherebaC.AndersS.GabaD.BurdenA.MilitelloL. (2021). What good are models? In Paper presented at the Naturalistic Decision Making/Resilience Engineering Conference, France, 21-23 June, 2021.
ShortlandN.AlisonL.ThompsonL.Barrett-PinkC.SwanL. (2020). Choice and consequence: a naturalistic analysis of least-worst decision-making in critical incidents. Memory & Cognition, 48(8), 1334–1345. https://doi.org/10.3758/s13421-020-01056-y
50.
TallentireV. R.SmithS. E.SkinnerJ.CameronH. S. (2011). Understanding the behaviour of newly qualified doctors in acute care contexts. Medical Education, 45(10), 995–1005. https://doi.org/10.1111/j.1365-2923.2011.04024.x
51.
ThompsonC.BucknallT.EstabrookesC. A.HutchinsonA.FraserK.De VosR.BinnecadeJ.BarratG.SaundersJ. (2009). Nurses’ critical event risk assessments: a judgement analysis. Journal of Clinical Nursing, 18(4), 601–612. https://doi.org/10.1111/j.1365-2702.2007.02191.x
52.
ThompsonC.DalgleishL.BucknallT.EstabrooksC.HutchinsonA. M.FraserK.de VosR.BinnekadeJ.BarrettG.SaundersJ. (2008). The effects of time pressure and experience on nurses’ risk assessment decisions: A signal detection analysis. Nursing Research, 57(5), 302–311. https://doi.org/10.1097/01.nnr.0000338612.31210.ca
53.
ToleJ.StephensA. T.HarrisR.EphrathA. (1982). Visual scanning behavior and mental workload in aircraft pilots. Aviation, Space, and Environmental Medicine, 53(1), 54–61.
54.
WardP.GoreJ.HuttonR.ConwayG. E.HoffmanR. R. (2018). Adaptive skill as the conditio sine qua non of expertise. Journal of Applied Research in Memory and Cognition, 7(1), 35–50. https://doi.org/10.1016/j.jarmac.2018.01.009
55.
WeingerM. B.HerndonO. W.ZornowM. H.PaulusM. P.GabaD. M.DallenL. T. (1994). An objective methodology for task analysis and workload assessment in anesthesia providers. Anesthesiology, 80(1), 77–92. https://doi.org/10.1097/00000542-199401000-00015
56.
WetzelC. M.KneeboneR. L.WoloshynowychM.NestelD.MoorthyK.KiddJ.DarziA. (2006). The effects of stress on surgical performance. The American Journal of Surgery, 191(1), 5–10. https://doi.org/10.1016/j.amjsurg.2005.08.034
57.
WhiteM. R.BraundH.HowesD.EganR.GegenfurtnerA.van MerrienboerJ. J.SzulewskiA. (2018). Getting inside the expert’s head: An analysis of physician cognitive processes during trauma resuscitations. Annals of Emergency Medicine, 72(3), 289–298. https://doi.org/10.1016/j.annemergmed.2018.03.005
58.
WickensC. D.HutchinsS.CarolanT.CummingJ. (2013). Effectiveness of part-task training and increasing-difficulty training strategies: A meta-analysis approach. Human Factors, 55(2), 461–470. https://doi.org/10.1177/0018720812451994
59.
XiaoY.MackenzieC.GroupL. (1995). Decision making in dynamic environments: Fixation errors and their causes. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 39(9), 469.
60.
YangH.ThompsonC.BlandM. (2014). Do nurses reason ‘adaptively’in time limited situations: The findings of a descriptive regression analysis. BMC Medical Informatics and Decision Making, 14(1), 96. https://doi.org/10.1186/1472-6947-14-96
61.
ZivA.Ben-DavidS.ZivM. (2005). Simulation based medical education: An opportunity to learn from errors. Medical Teacher, 27(3), 193–199. https://doi.org/10.1080/01421590500126718
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
