Integration of Cognitive Modeling into the Evaluation of Electronic Health Records

Abstract

Previous research has consistently cited the importance of a usable interface in the successful adoption of the electronic health record (EHR). Among the most time intensive EHR activities is Computerized Physician Order Entry (CPOE) a method of creating and modifying orders through an electronic interface. The Marshfield Clinic, a non-profit, regional health care organization in Wisconsin, is in the process of implementing a new CPOE system. As a part of early evaluation, cognitive and behavioral modeling was coupled with formative usability testing to better understand the potential use of a new CPOE design. Participants consisted of 11 medical residents. Results suggest that participants were able to complete the majority of task scenarios in less than 20 seconds per task. Additionally, the integration of a cognitive and behavioral tool provided new evaluation information to help aid in future design efforts.

Get full access to this article

View all access options for this article.

References

Armijo

McDonnell

Werner

. Electronic health record usability. Interface Design Considerations. Rockville, MD: Agency for Healthcare Research and Quality, US Department of Health and Human Services, 2009.

Bates

D.W.

Leape

L.L.

Cullen

D.J.

Laird

Petersen

L.A.

Teich

J.M.

Burdick

Hickey

Kleefield

Shea

Effect of computerized physician order entry and a team intervention on prevention of serious medication errors. JAMA: the journal of the American Medical Association, 280 (15):1311–1316, 1998.

Joey

Benedek

Trish

Miner

. Measuring desirability: New methods for evaluating desirability in a usability lab setting. Proceedings of Usability Professionals Association, pages 8–12, 2002.

Beuscart-Zephir

M.C.

Pelayo

Anceaux

Meaux

J.J.

Degroisse

Degoulet

. Impact of cpoe on doctor– nurse cooperation for the medication ordering and administration process. International journal of medical informatics, 74(7):629–641, 2005.

Beuscart-Zephir

M.C.

Pelayo

Bernonville

. Example of a human factors engineering approach to a medication administration work system: potential impact on patient safety. International journal of medical informatics, 79 (4):43, 2010.

Brooke

John

. Sus-a quick and dirty usability scale. Usability evaluation in industry, 189:194, 1996.

Goldschmidt

P.G.

Hit and mis: implications of health information technology and medical information systems. Communications of the ACM, 48(10):68–74, 2005.

Han

J.A.

Carcillo

S.T.

Venkataraman

R.S.B.

Clark

R.S.

Watson

T.C.

Nguyen

Bayir Orr

R.A

. Unexpected increased mortality after implementation of a commercially sold computerized physician order entry system. Pediatrics, 116(6):1506–1512, 2005.

Hillestad

Bigelow

Bower

Girosi

Meili

Scoville Taylor

. Can electronic medical record systems transform health care? potential health benefits, savings, and costs. Health Affairs, 24(5):1103–1117, 2005.

10.

John

Bonnie E.

Using predictive human performance models to inspire and support ui design recommendations. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI ’11, pages 983–986, New York, NY, USA, 2011. ACM. ISBN 978-1-4503-0228-9. doi: 10.1145/1978942.1979088. URL http://doi.acm.org/10.1145/1978942.1979088.

11.

Khajouei

Jaspers

M.W.M.

Cpoe system design aspects and their qualitative effect on usability. Studies in health technology and informatics, 136:309, 2008.

12.

Koppel

Metlay

J.P.

Cohen

Abaluck

Localio

A.R.

Kimmel

S.E.

Strom

B.L

. Role of computerized physician order entry systems in facilitating medication errors. JAMA: the journal of the American Medical Association, 293 (10):1197–1203, 2005.

13.

Lee

Cain

Young

Chockley

Burstin

The adoption gap: health information technology in small physician practices. Health Affairs, 24(5):1364–1366, 2005.

14.

McDonnell

Werner

Wendel

Electronic health record usability. Vendor Practices and Perspectives: AHRQ-James Bell Associates, The Altarum Institute, Rockville, 2010.

15.

Morris

Savelyich

BSP

Avery

Cantrill

Sheikh

. Patient safety features of clinical computer systems: questionnaire survey of gp views. Quality and Safety in Health Care, 14(3):164–168, 2005.

16.

Poissant

Lise

Pereira

Jennifer

Tamblyn

Robyn

Kawasumi

Yuko

. The impact of electronic health records on time efficiency of physicians and nurses: a systematic review. Journal of the American Medical Informatics Association, 12(5):505–516, 2005.

17.

Walsh

S.H.

The clinician’s perspective on electronic health records and how they can affect patient care. Bmj, 328(7449): 1184–1187, 2004.