Adoption of clinical decision support has been limited. Important barriers include an emphasis on algorithmic approaches to decision support that do not align well with clinical work flow and human decision strategies, and the expense and challenge of developing, implementing, and refining decision support features in existing electronic health records (EHRs). We applied decision-centered design to create a modular software application to support physicians in managing and tracking colorectal cancer screening. Using decision-centered design facilitates a thorough understanding of cognitive support requirements from an end user perspective as a foundation for design. In this project, we used an iterative design process, including ethnographic observation and cognitive task analysis, to move from an initial design concept to a working modular software application called the Screening & Surveillance App. The beta version is tailored to work with the Veterans Health Administration’s EHR Computerized Patient Record System (CPRS). Primary care providers using the beta version Screening & Surveillance App more accurately answered questions about patients and found relevant information more quickly compared to those using CPRS alone. Primary care providers also reported reduced mental effort and rated the Screening & Surveillance App positively for usability.
BaxterG.SommervilleI. (2011). Socio-technical systems: From design methods to systems engineering. Interacting With Computers, 23, 4–17.
2.
BeydounH.BeydounM. (2008). Predictors of colorectal cancer screening behaviors among average-risk older adults in the United States. Cancer, Causes, & Control, 19, 339–359.
3.
BrightT. J.WongA.DhurjatiR.BristowE.BastianL.CoeytauxR. R.… LobachD. (2012). Effect of clinical decision-support systems: a systematic review. Annals of Internal Medicine, 157, 29–43.
4.
Centers for Disease Control and Prevention. (2013). Vital signs: Colorectal cancer screening test use. United States, 2012. Morbidity and Mortality Weekly Report, 62, 881–888.
5.
CrandallB.KleinG.HoffmanR. R. (2006). Working minds: A practitioner’s guide to cognitive task analysis. Cambridge, MA: MIT Press.
6.
FrazierA. L.ColditzG. A.FuchsC. S.KuntzK. M. (2000). Cost-effectiveness of screening for colorectal cancer in the general population. JAMA, 284, 1954–1961.
7.
GreenesR. (2007). Definition, scope, and challenges. In GreenesR. (Ed.), Clinical decision support (pp. 4–31). Burlington, MA: Elsevier.
8.
GreenesR.BloomrosenM.Brown-ConnollyN. E.CurtisC.DetmerD.EnbergR.… ShahH. (2010). The Morningside Initiative: Collaborative development of a knowledge repository to accelerate adoption of clinical decision support. Open Medical Informatics Journal, 4, 278–290.
9.
HarrisonM. I.KoppelR.Bar-LevS. (2007). Unintended consequences of information technologies in health care: An interactive sociotechnical analysis. Journal of the American Medical Informatics Association, 14, 542–549.
10.
HoffmanR.MilitelloL. G. (2008). Perspectives on cognitive task analysis: Historical origins and modern communities of practice. New York, NY: Taylor and Francis.
11.
KaempfG. L.KleinG.ThordsenM. L.WolfS. (1996). Decision making in complex naval command-and-control environments. Human Factors, 38, 220–231.
12.
KawamotoK. (2007). Integration of knowledge resources into applications to enable clinical decision support: Architectural considerations. In GreenesR. (Ed.), Clinical decision support: The road ahead (pp. 503–539). Burlington, MA: Elsevier.
13.
KawamotoK. (2011, July). OpenCDS: An open-source, standards-based, service-oriented framework for scalable CDS. Paper presented at the SOA in Healthcare 2011 Conference, Herndon, VA. Retrieved from http://opencds.org/
14.
KilsdonkE.PeuteL. W.KnijnenburgS. L.JaspersM. W. (2011). Factors known to influence acceptance of clinical decision support systems. Studies in Health Technology and Information, 169, 150–154.
15.
KleinG.MoonB. M.HoffmanR. R. (2006). Making sense of sensemaking 1: Alternative perspectives. IEEE Intelligent Systems, 21(4), 70–73.
16.
KleinG.PliskeR.CrandallB.WoodsD. D. (2005). Problem detection. Cognition, Technology & Work, 7, 14–28.
LevinB.LiebermanD. A.McFarlandB.SmithR. A.BrooksD.AndrewsK. S.… WinawerS. J. (2008). Screening and surveillance for the early detection of colorectal cancer and adenomatous polyps, 2008: A joint guideline from the American Cancer Society, the US Multi-Society Task Force on Colorectal Cancer, and the American College of Radiology. CA: A Cancer Journal for Clinicians, 58, 130–160.
19.
LopezC. E.MilitelloL. G. (2012). Colorectal cancer screening decision support: Final report. Unpublished technical report (Contract No. 200-2011-M-41884).
20.
MandlK. D.MandelJ. C.MurphyS. N.BernstamE. V.RamoniR. L.KredaD. A.… KohaneI. S. (2012). The SMART platform: Early experience enabling substitutable applications for electronic health records. Journal of the American Medical Informatics Association. doi:10.1136/amiajnl-2011-000622
21.
MiddletonB. (2009). The Clinical decision support consortium. In. AdlassnigK.-P.BlobelB.MantasJ. (Eds.), Medical informatics in a united and healthy Europe. Amsterdam: IOS Press.
22.
MilitelloL. G.ArbuckleN. B.SaleemJ. J.PattersonE. S.FlanaganM. E.HaggstromD. A.DoebbelingB. N. (2014). Sources of variation in primary care clinical workflow: Implications for the design of cognitive support. Health Informatics Journal, 20, 35–49.
23.
MilitelloL. G.BordersM. R.ArbuckleN. B.FlanaganM. E.HallN. P.SaleemJ. J.DoebbelingB. N. (2014). Persuasive health educational materials for colorectal cancer screening. In Proceedings of the Human Factors and Ergonomics Society 58th Annual Meeting (pp. 609–613). Santa Monica, CA: Human Factors and Ergonomics Society.
24.
MilitelloL. G.DiiulioJ. B.BordersM. R.SusherebaC. E.SaleemJ. J.HaverkampD.ImperialeT. F. (2015). Evaluating a modular decision support application for colorectal cancer screening. Manuscript submitted for publication.
25.
MilitelloL. G.HuttonR. J. B. (1998). Applied cognitive task analysis (ACTA): A practitioner’s toolkit for understanding cognitive task demands. Ergonomics Special Issue: Task Analysis, 41, 1618–1641.
26.
MilitelloL. G.KleinG. (2013). Decision-centered design. In LeeJ. D.KirlikA. (Eds.), The Oxford handbook of cognitive engineering (pp. 261–271). Oxford, UK: Oxford University Press.
27.
MillerA.MilitelloL. G. (2015). The role of cognitive engineering in improving clinical decision support. In BisantzA. M.BurnsC. M.FairbanksR. J. (Eds.), Cognitive engineering applications in health care (pp. 7–26). New York, NY: CRC Press.
28.
OluochT.SantasX.KwareD.WereM.BiondichP.BaileyC.… de KeizerN. (2012). The effect of electronic medical record-based clinical decision support on HIV care in resource constrained settings: A systematic review. International Journal of Medical Informatics, 81, e83–92.
29.
PattersonS. M.HughesC.KerseN.CardwellC. R.BradleyM. C. (2012). Interventions to improve the appropriate use of polypharmacy for older people. Cochrane Database of Systematic Reviews, 5, CD008165.
30.
SahotaN.LloydR.RamakrishnaA.MackayJ. A.ProrokJ. C.Weise-KellyL.… HaynesR. B. (2011). Computerized clinical decision support systems for acute care management: A decision-maker-researcher partnership systematic review of effects on process of care and patient outcomes. Implementation Science, 6, 91–98.
31.
SaleemJ. J.HaggstromD. A.MilitelloL. G.FlanaganM.KiessC. L.ArbuckleN.DoebbelingB. N. (2011). Redesign of a computerized clinical reminder for colorectal cancer screening: a human-computer interaction evaluation. BMC Medical Informatics and Decision Making, 11, 74.
32.
SaleemJ. J.MilitelloL. G.ArbuckleN. B.FlanaganM.HaagstromD.PattersonE.… DoebbelingB. (2009). Clinical decision support at three benchmark institutions for health IT: Provider perceptions of colorectal cancer screening. In Proceedings of the American Medical Informatics Association Annual Symposium (pp. 558–562). Washington, DC: American Medical Informatics Association.
33.
SaleemJ. J.PattersonE. S.MilitelloL.RenderM. L.OrshanskyG.AschS. A. (2005). Exploring barriers and facilitators to the use of computerized clinical reminders. Journal of the American Medical Informatics Association, 12, 438–47.
34.
ScottT.RundallT. G.VogtT. M.HsuJ. (2007). Implementing an electronic medical record system. Oxford, UK: Radcliffe.
35.
SidebottomA. C.CollinsB.WindenT. J.KnutsonA.BrittH. R. (2012). Reactions of nurses to the use of electronic health record alert features in an inpatient setting. Computers Informatics Nursing, 30, 218–226.
36.
SimI.GormanP.GreenesR. A.HaynesR. B.KaplanB.LehmannH.TangP. C. (2001). Clinical decision support systems for the practice of evidence-based medicine. Journal of the American Medical Informatics Association, 8, 527–534.
37.
StreiffM. B.CarolanH. T.HobsonD. B.KrausP. S.HolzmuellerC. G.DemskiR.… HautE. R. (2012). Lessons from the Johns Hopkins multi-disciplinary venous thromboembolism (VTE) prevention collaborative. BMJ, 344, e3935.
38.
TawfikH.AnyaO.NagarA.K. (2012). Understanding clinical work practices for cross-boundary decision support in e-health. IEEE Transactions on Information Technology in Biomedicine, 16, 530–554.
39.
U.S. Preventive Services Task Force. (2008). Screening for colorectal cancer: U.S. Preventive Services Task Force recommendation statement. Annals of Internal Medicine, 149, 627–637.
40.
VernonS. (1997). Participation in colorectal cancer screening: A review. Journal of the National Cancer Institute, 89, 1406–1422.
41.
VidulichM. A. (1989). The use of judgment matrices in subjective workload assessment: The Subjective Workload Dominance (SWORD) technique. In Proceedings of the Human Factors Society 33rd Annual Meeting (pp. 1406–1410). Santa Monica, CA: Human Factors Society.
42.
VidulichM. A.TsangP. S. (1987). Absolute magnitude estimation and relative judgment approaches to subjective workload assessments. In Proceedings of the Human Factors Society 31st Annual Meeting (pp. 1057–1061). Santa Monica, CA: Human Factors Society.
43.
VidulichM. A.WardG. F.SchuerenJ. (1991). Using the Subjective Workload Dominance (SWORD) technique for projective workload assessment. Human Factors, 33, 677–691.
44.
WanQ.MakehamM.ZwarN. A.PetcheS. (2012). Qualitative evaluation of a diabetes electronic decision support tool: Views of users. BMC Medical Informatics and Decision Making, 12, 61.
45.
WatersonP.RobertsonM. M.CookeN. J.MilitelloL.RothE.StantonN. A. (2015). Defining the methodological challenges and opportunities for an effective science of sociotechnical systems and safety. Ergonomics, 58, 565–599.
46.
WuH. W.DavisP. K.BellD. S. (2012). Advancing clinical decision support using lessons from outside of healthcare: an interdisciplinary systematic review. BMC Medical Informatics and Decision Making, 12, 90.
47.
YenP. Y.SousaK. H.BakkenS. (2014). Examining construct and predictive validity of the Health-IT Usability Evaluation Scale: Confirmatory factor analysis and structural equation modeling results. Journal of the American Medical Informatics Association, 21, 241–248.
48.
ZauberA. G.WinawerS. J.O’BrienM. J.Lansdorp-VogelaarI.van BallegooijenM.HankeyB. F.… WayeJ. D. (2012). Colonoscopic polypectomy and long-term prevention of colorectal-cancer deaths. New England Journal of Medicine, 366, 687–696.
49.
ZijlstraF.Van DoornL. (1958). The construction of a subjective effort scale Technical report, Delft University of Technology, Delft, Netherlands.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
