Sage Journals: Discover world-class research

Abstract

The objective of this work was to design and evaluate a health information technology (HIT) dashboard that presents evidence-based quality indicators for the purpose of evaluating patient risk in a hospital care setting. A focus group of nurse managers, physicians, and hospital quality professionals was conducted to identify design criteria for the HIT dashboard. The dashboard was developed from dynamic process data from a medical surgical unit in a Midwestern, academic hospital using human factors principles. Heuristic and system usability evaluations were performed to assess the HIT dashboard’s functionality and usability. Evaluation results suggest that the HIT dashboard was considered “good” by evaluators (following System Usability Scale criteria), with five suggested changes being recommended by 40% or more of the heuristic evaluators. This work provides a preliminary model for the development of future HIT dashboards intended to communicate patient risk information to hospital care staff.

Get full access to this article

View all access options for this article.

References

Abrams

R.A.

Christ

S.E.

(2003). Motion onset captures attention. Psychological Science, 14, 427–432.

Abrams

R.A.

Christ

S.E.

(2006). Abrupt Onsets Cannot Be Ignored. Psychonomic Bulletin & Review, 13, 875-80.

Andel

Davidow

S. L.

Hollander

Moreno

D. A.

(2012). The economics of health care quality and medical errors. Journal of health care finance, 39(1), 39.

Aydin

Bolton

L.B.

Donaldson

Brown

D.S.

Mukerji

(2008). Beyond nursing quality measurement:The nation’s first regional nursing virtual dashboard. Retrieved February 12, 2015, from: http://www.ahrq.gov/downloads/pub/advances2/vol1/Advances-Aydin_2.pdf

Bangor

Kortum

P. T.

Miller

J. T.

(2008). An empirical evaluation of the system usability scale. Intl. Journal of Human–Computer Interaction, 24(6), 574-594.

Bangor

Kortum

Miller

(2009). Determining what individual SUS scores mean: Adding an adjective rating scale. Journal of usability studies, 4(3), 114-123.

Bartram

Calvert

Ware

(2003). Moticons: detection, distraction and task. Human-Computer Interaction, 515-545.

Bates

Cohen

Leape

Overhage

J. M.

Shabot

M. M.

Sheridan

(2001). Reducing the frequency of errors in medicine using information technology. Journal of the American Medical Informatics Association, 8(4), 299-308.

Bechtel

Marks

Ward

(2014, October). Steering interprofessional teams to real-time quality metrics. Paper session presented at the ANCC National Magnet Conference, Dallas, TX.

10.

Blumenthal

(2010). Launching HIteCH. New England Journal of Medicine, 362(5), 382-385.

11.

Boucart

Humphreys

G.W.

(1997). Selection by Color and Form in Vision. Journal of Experimental Psychology: Human Perception and Performance, 23, 136-153.

12.

Brooke

(1996). SUS-A quick and dirty usability scale. Usability evaluation in industry, 189, 194.

13.

Buttigieg

M. A.

Sanderson

P. M.

(1991). Emergent features in visual display design for two types of failure detection tasks. Human Factors: The Journal of the Human Factors and Ergonomics Society, 33(6), 631-651.

14.

Buntin

M. B.

Burke

M. F.

Hoaglin

M. C.

Blumenthal

(2011). The benefits of health information technology: a review of the recent literature shows predominantly positive results. Health Affairs, 30(3), 464-471.

15.

Chaudhry

Wang

Maglione

Mojica

Roth

… Shekelle

P. G.

(2006). Systematic review: impact of health information technology on quality, efficiency, and costs of medical care. Annals of internal medicine, 144(10), 742-752.

16.

Classen

D. C.

Resar

Griffin

Federico

Frankel

Kimmel

Whittington

J.C.

Frankel

Seger

James

B. C.

(2011). ‘Global trigger tool’ shows that adverse events in hospitals may be ten times greater than previously measured. Health Affairs, 30(4), 581-9.

17.

Fischer

Anema

H. A.

Klazinga

N. S.

(2012). The validity of indicators for assessing quality of care: a review of the European literature on hospital readmission rate. The European Journal of Public Health, 22(4), 484-491.

18.

Gao

Greenspan

Welsh

Juang

Alm

(2006, January). Vital signs monitoring and patient tracking over a wireless network. In Engineering in Medicine and Biology Society, 2005. IEEE-EMBS 2005. 27th Annual International Conference of the (pp. 102-105). IEEE.

19.

Gelasca

E.D.

Tomasic

Ebrahimi

(2005). Which Colors Best Catch Your Eyes: a Subjective Study of Color Saliency, in: First International Workshop on Video Processing and Quality Metrics for Consumer Electronics, Scottsdale, Arizona, USA, January 2005.

20.

González

Masip

Granollers

Oliva

(2009). Quantitative analysis in a heuristic evaluation experiment. Advances in Engineering Software, 40(12), 1271-1278.

21.

Grube

M. M.

Dohle

Djouchadar

Rech

Bienek

Dietz-Fricke

… Heuschmann

P. U.

(2012). Evidence-Based Quality Indicators for Stroke Rehabilitation. Stroke, 43(1), 142-146.

22.

Haux

(2006). Health information systems–past, present, future. International journal of medical informatics, 75(3), 268-281.

23.

Hayes

Batalden

Goldmann

(2015). A ‘work smarter, not harder’ approach to improving healthcare quality. BMJ Quality and Safety, 24(2), 100-102.

24.

IOM (Institute of Medicine). 2013. Best care at lower cost: The path to continuously learning health care in America. Washington, DC: The National Academies Press.

25.

James

J. T.

(2013). A new, evidence-based estimate of patient harms associated with hospital care. Journal of patient safety, 9(3), 122-128.

26.

Jensen

(2003). United hospital increases capacity usage, efficiency with patient-flow management system. Journal of healthcare information management: JHIM, 18(3), 26.

27.

Kitzinger

(1995). Qualitative research. Introducing focus groups. BMJ: British medical journal, 311(7000), 299.

28.

Kohli

Waldron

Feng

Katis

Jakubowski

Davies

Kohm

(2004). Utilizing the electronic emergency whiteboard to track and manage emergency patients. Medinfo, 1688.

29.

Landrigan

C. P.

Parry

G. J.

Bones

C. B.

Hackbarth

A. D.

Goldmann

D. A.

Sharek

P. J.

2010.Temporal trends in rates of patient harm resulting from medical care. New England Journal of Medicine 363(22):2124-2134.

30.

Levinson

D. R.

2010. Adverse events in hospitals: National incidence among Medicare beneficiaries. Washington, DC: U.S. Department of Health and Human Services, Office of Inspector General.

31.

Lewis

S. J.

Orland

B. I.

(2004). The importance and impact of evidence-based medicine. Journal of managed care pharmacy: JMCP, 10(5 Suppl A), S3.

32.

Mainz

(2003). Defining and classifying clinical indicators for quality improvement. International Journal for Quality in Health Care, 15(6), 523-530.

33.

Malone

Vollbrecht

Stephenson

Burke

Pagel

Goodwin

(2010). Acute care for elders (ACE) tracker and e-geriatrician: Methods to disseminate ACE concepts to hospitals with no geriatricians. Journal of the American Geriatric Society, 58(1).161-7.

34.

Nielsen

Molich

(1990, March). Heuristic evaluation of user interfaces. In Proceedings of the SIGCHI conference on Human factors in computing systems (pp. 249-256). ACM.

35.

Nielsen

(1994, April). Usability inspection methods. In Conference companion on Human factors in computing systems (pp. 413-414). ACM.

36.

Pérez

E. R. F.

Winters

J. L.

Gajic

(2007). The addition of decision support into computerized physician order entry reduces red blood cell transfusion resource utilization in the intensive care unit. American journal of hematology, 82(7), 631-633.

37.

Pollak

V. E.

Lorch

J. A.

(2007). Effect of electronic patient record use on mortality in End Stage Renal Disease, a model chronic disease: retrospective analysis of 9 years of prospectively collected data. BMC Medical Informatics Decision Making, 7(1), 38.

38.

Poon

E. G.

Jha

A. K.

Christino

Honour

M. M.

Fernandopulle

Middleton

Kaushal

(2006). Assessing the level of healthcare information technology adoption in the United States: a snapshot. BMC Medical Informatics and Decision Making, 6(1), 1.

39.

Scott

J. T.

Rundall

T. G.

Vogt

T. M.

Hsu

(2005). Kaiser Permanente’s experience of implementing an electronic medical record: a qualitative study. BMJ: British Medical Journal, 331(7528), 1313.

40.

Sittig

D. F.

Singh

(2011). Defining health information technology-related errors: new developments since to err is human. Archives of internal medicine, 171(14), 1281.

41.

Starmer

A. J.

Sectish

T. C.

Simon

D. W.

Keohane

McSweeney

M. E.

Chung

E. Y.

… Landrigan

C. P.

(2013). Rates of medical errors and preventable adverse events among hospitalized children following implementation of a resident handoff bundle. JAMA, 310(21), 2262-2270.

42.

Stelfox

H. T.

Boyd

J. M.

Straus

S. E.

Gagliardi

A. R.

(2013). Developing a patient and family-centred approach for measuring the quality of injury care: a study protocol. BMC health services research, 13(1), 31.

43.

Treisman

(1986). Features and objects in visual processing. Sci. Am. 255(5), 114–125.

44.

Treisman

Gelade

(1980). A feature-integration theory of attention. Cogn. Psychol. 12, 97–136.

45.

Chaudhry

Wang

Maglione

Mojica

Roth

… Shekelle

P. G.

(2006). Systematic review: impact of health information technology on quality, efficiency, and costs of medical care. Annals of internal medicine, 144(10), 742-752.

Development and Evaluation of a Health Information Technology Dashboard of Quality Indicators

Abstract

Get full access to this article

References