Decision Analysis for Metric Selection on a Clinical Quality Scorecard

Abstract

Clinical quality scorecards are used by health care institutions to monitor clinical performance and drive quality improvement. Because of the rapid proliferation of quality metrics in health care, BJC HealthCare found it increasingly difficult to select the most impactful scorecard metrics while still monitoring metrics for regulatory purposes. A 7-step measure selection process was implemented incorporating Kepner-Tregoe Decision Analysis, which is a systematic process that considers key criteria that must be satisfied in order to make the best decision. The decision analysis process evaluates what metrics will most appropriately fulfill these criteria, as well as identifies potential risks associated with a particular metric in order to identify threats to its implementation. Using this process, a list of 750 potential metrics was narrowed to 25 that were selected for scorecard inclusion. This decision analysis process created a more transparent, reproducible approach for selecting quality metrics for clinical quality scorecards.

Keywords

decision analysis scorecards quality metrics clinical quality

Get full access to this article

View all access options for this article.

References

H.R. 1 (108th): Medicare Prescription Drug, Improvement, and Modernization Act of 2003. http://www.govtrack.us/congress/bills/108/hr1. Accessed October 11, 2013.

Centers for Medicare & Medicaid Services (CMS), HHS. Medicare and Medicaid programs: hospital outpatient prospective payment and ambulatory surgical center payment systems and quality reporting programs; Hospital Value-Based Purchasing Program; organ procurement organizations; quality improvement organizations; Electronic Health Records (EHR) Incentive Program; provider reimbursement determinations and appeals. Final rule with comment period and final rules. Fed Regist. 2013;78:74825-75200.

Agency for Healthcare Research and Quality. AHRQ Quality Indicators. http://www.qualityindicators.ahrq.gov/. Accessed July 24, 2013.

National Quality Forum. NQF Quality Positioning System. http://www.qualityforum.org/QPS/QPSTool.aspx. Accessed January 28, 2014.

Kepner

Tregoe

. The New Rational Manager: An Updated Edition for a New World. Princeton, NJ: Princeton Research Press; 2006.

National Quality Forum. Measure evaluation criteria. http://www.qualityforum.org/docs/measure_evaluation_criteria.aspx. Accessed October 11, 2013.

Pines

Isserman

Hinfey

. The measurement of time to first antibiotic dose for pneumonia in the emergency department: a white paper and position statement prepared for the American Academy of Emergency Medicine. J Emerg Med. 2009;37:335-340.

Agency for Healthcare Research and Quality. Patient Safety Indicators Technical Specifications Updates—Version 5. http://www.qualityindicators.ahrq.gov/Modules/PSI_TechSpec.aspx. Accessed May 6, 2015.

Centers for Medicare & Medicaid Services. Hospital Outpatient Quality Reporting Program. https://www.cms.gov/Medicare/Quality-Initiatives-Patient-Assessment-Instruments/HospitalQualityInits/HospitalOutpatientQualityReportingProgram.html. Accessed March 20, 2014.