There is a growing popularity of data-driven best practices in a variety of fields. Although we applaud the impulse to replace anecdotes with evidence, it is important to appreciate some of the cognitive constraints on promulgating best practices to be used by practitioners. We use the evidence-based medicine (EBM) framework that has become popular in health care to raise questions about whether the approach is consistent with how people actually make decisions to manage patient safety. We examine six potential disconnects and suggest ways to strengthen best practices strategies.
AmalbertiR. (2013). Navigating safety: Necessary compromises and tradeoffs, theory and practice. Dordrecht, Netherlands: Springer-Verlag.
3.
BrehmerB. (1987). Development of mental models for decision in technological systems. In RasmussenJ.DuncanK.LeplatJ. (Eds.), New technology and human error (pp. 111–120). Chichester, UK: Wiley.
4.
BrehmerB. (1992). Dynamic decision making: Human control of complex systems. Acta Psychologica, 81, 211–241.
5.
ChaseW. G.SimonH. A. (1973). Perception in chess. Cognitive Psychology, 4, 55–81.
6.
ChatterjeeT. (2015). Out of the darkness. Science, 350, 372–375.
7.
CookR. I. (2006). Being bumpable: Consequences of resource saturation and near-saturation for cognitive demands on ICU practitioners. In WoodsD. D.HollnagelE. (Eds.), Joint cognitive systems: Patterns in cognitive systems engineering (pp. 23–35). Boca Raton, FL: CRC Press.
8.
CookR. I.RenderM. L.WoodsD. D. (2000). Gaps in the continuity of care and progress on patient safety. British Medical Journal, 320, 791–794.
9.
DeAndaA.GabaD. (1991). The role of experience in the response to simulated critical incidents. Anesthesia and Analgesia, 72, 308–315.
DenrellJ. (2003). Vicarious learning, undersampling of failure, and the myths of management. Organization Science, 14, 228–243.
12.
DenrellJ.FangC. (2010). Predicting the next big thing: Success as a signal of poor judgment. Management Science, 56, 1653–1667.
13.
EricssonK. A. (2004). Deliberate practice and the acquisition and maintenance of expert performance in medicine and related domains. Academic Medicine, 10, S70–S81.
14.
EricssonK. A.CharnessN.FeltovichP. J.HoffmanR. R. (Eds.). (2006). The Cambridge handbook of expertise and expert performance. Cambridge, UK: Cambridge University Press.
15.
GabaD.MaxwellM.DeAndaA. (1987). Anesthetic mishaps: Breaking the chain of accident evolution. Anesthesiology, 66, 670–676.
16.
GhaffarzadeganN.EpsteinA. J.MartinE. G. (2013). Practice variation, bias, and experiential learning in Cesarean delivery: A data-based system dynamics approach. Health Services Research, 48, 713–734.
17.
GigerenzerG. (2002). Calculated risks: How to know when numbers deceive you. New York, NY: Simon & Schuster.
18.
GrayJ. A. M. (1996). Evidence-based healthcare. London, UK: Churchill Livingstone.
19.
HoffmanR. R.WardP.FeltovichP. J.DiBelloL.FioreS. M.AndrewsD. H. (2014). Accelerated expertise: Training for high proficiency in a complex world. New York, NY: Psychology Press.
KahnemanD.KleinG. A. (2009). Conditions for intuitive expertise: A failure to disagree. American Psychologist, 64, 515–526.
22.
KaiserJ. (2015). The cancer test: A nonprofit’s effort to replicate 50 top cancer papers is shaking up labs. Science, 348, 1411–1413.
23.
KleinD. E. (2009). The forest and the trees: An integrated approach to designing adherence interventions. Australasian Medical Journal, 1, 181–184.
24.
KleinG. (1998). Sources of power: How people make decisions. Cambridge, MA: MIT Press.
25.
KleinG. (2005). The power of intuition. New York, NY: Currency/Doubleday.
26.
KleinG. (2007a). Flexecution as a paradigm for replanning, Part 1. IEEE Intelligent Systems, 22, 79–83.
27.
KleinG. (2007b). Flexecution, Part 2: Understanding and supporting flexible execution. IEEE Intelligent Systems, 22, 108–112.
28.
KleinG. (2009). Streetlights and shadows: Searching for the keys to adaptive decision making. Cambridge, MA: MIT Press.
29.
KleinG.BordersJ. (in press). The ShadowBox approach to cognitive skills training: An empirical evaluation. Journal of Cognitive Decision Making.
30.
KleinG.PliskeR.CrandallB.WoodsD. (2005). Problem detection. Cognition, Technology, and Work, 7, 14–28.
31.
KylestenB. (2013). Dynamic decision-making on an operative level: A model including preconditions and working method. Cognitive Technology & Work, 15, 197–205.
32.
MarshallB. J. (2005, December). Helicobacter connections. Nobel lecture, Stockholm, Sweden.
33.
NemethC.O’ConnorM.KlockP. A.CookR. (2006). Discovering healthcare cognition: The use of cognitive artifacts to reveal cognitive work. Organization Studies, 27, 1011–1035.
34.
O’SullivanG. C. (2010). Advancing surgical research in a sea of complexity. Annals of Surgery, 252, 711–714.
35.
PascaleR.SterninJ. (2010). The power of positive deviance: How unlikely innovators solve the world’s toughest problems. Boston, MA: Harvard Business Review Press.
36.
PerryS. J.WearsR. L. (2011). Large scale coordination of work: Coping with complex chaos within healthcare. In MosierK. L.FisherU. (Eds.), Informed by knowledge: Expert performance in complex situations (pp. 55–59). New York, NY: Taylor & Francis.
37.
PronovostP.NeedhamD.BerenholtzS.SinopoliD.ChuH.CosgroveS.SextonB.HyzyR.WelshR.RothG.BanderJ.KeprosJ.GoeschelC. (2006). An intervention to decrease catheter-related bloodstream infections in the ICU. New England Journal of Medicine, 355, 2725–2732.
38.
RittelH. W. J.WeberM. M. (1973). Dilemmas in a general theory of planning. Policy Sciences, 4, 155–169.
39.
RobertsA. R.YeagerK. R. (Eds.), (2004). Evidence-based practice manual: Research and outcome measures in health and human services. New York, NY: Oxford University Press.
40.
RudolphJ. W.MorrisonJ. B.CarrollJ. S. (2009). The dynamics of action-oriented problem solving: Linking interpretation and choice. Academy of Management Review, 34, 733–756.
41.
StaszewskiJ. (2004). Models of expertise as blueprints for cognitive engineering: Applications to landmine detection. In Proceedings of the Human Factors and Ergonomics Society 48th Annual Meeting (pp. 458–462). Santa Monica, CA: Human Factors and Ergonomics Society.
42.
SuchmanL. A. (1987). Plans and situated actions: The problem of human–machine communication. Cambridge, UK: Cambridge University Press.
43.
TimmermansS.BergM. (2003). The gold standard: The challenge of evidence-based medicine and standardization in healthcare. Philadelphia, PA: Temple University Press.
44.
WearsR. L.HunteG. S. (2014). Seeing patient safety “like a state.”Safety Science, 67, 50–57.
45.
WearsR. L.SchubertC. C. (2015). Visualizing expertise in context. Annals of Emergency Medicine. Advance online publication. doi:10.1016/j.annemergmed.2015.11.027
46.
WoodsD. D. (1994). Cognitive demands and activities in dynamic fault management. In StantonN. (Ed.), Human factors in alarm design (pp. 63–92). London, UK: Taylor & Francis.
47.
WoodsD. D. (2005). Creating foresight: Lessons for resilience fromColumbia. In StarbuckW. H.FarjounM. (Eds.), Organization at the limit: NASA and the Columbia disaster (pp. 289–308). Malden, MA: Blackwell.
48.
WoodsD. D.HollnagelE. (2006). Joint cognitive systems: Patterns in cognitive systems engineering. Boca Raton, FL: Taylor & Francis.
49.
WoodsD. D.RothE. M.BennettK. B. (1990). Explorations in joint human–machine cognitive systems. In RobertsonS.ZacharyW.BlackJ. (Eds.), Cognition, computing and cooperation (pp. 123–158). Norwood, NJ: Ablex.
50.
ZelikD.PattersonE. S.WoodsD. D. (2010). Measuring attributes of rigor in information analysis. In PattersonE. S.MillerJ. (Eds.), Macrocognition metrics and scenarios: Design and evaluation for real-world teams (pp. 65–83). Aldershot, UK: Ashgate.
