Sharing lessons from high-performing hospitals facilitates quality improvement. High-performing hospitals have usually been identified using a small number of performance measures. The objective was to analyze how well 1,006 hospitals performed across a broader range of measures. Five measures were developed from publicly available data: adherence to processes of care, 30-day readmission rates, in-hospital mortality, efficiency, and patient satisfaction. For a subset of hospitals, the authors included two survey-based assessments of patient care quality, one by chief quality officers and one by frontline clinicians. In general, there was little correlation among the publicly available measures (r ≤ .10), though there was notable correlation between objective measures and survey-based measures (r = .23). Hospitals that performed well on a composite measure calculated from the publicly available measures were often not in the top quintile on most individual measures. This highlights the challenge in identifying high-performing hospitals to learn organizational-level best practices.
Health Information Systems. (2005). All-patient refined diagnosis related groups. Wallingford, CT: Author.
2.
AHRQ Quality Indicators. (2007, March). Inpatient quality indicators. Rockville, MD: Agency for Healthcare Research and Quality. Retrieved from http://www.qualityindicators.ahrq .gov/iqi_download.htm
3.
Ash, A.S., Ellis, R.P., Pope, G.C., Ayanian, J.Z., Bates, D.W., Burstin, H., . . .Yu, W. ( 2000). Using diagnoses to describe populations and predict costs . Health Care Financing Review, 21, 7-28.
4.
Berwick, D., Kabcenell, A., & Nolan, T. ( 2005). Pursuing perfection: No Toyota yet, but a start. Modern Healthcare, 35, 18-19.
5.
Bliese, P.D. ( 2006). Within-group agreement, non-independence, and reliability: Implications for data aggregation and analysis. In K. J. Klein & S. W. J. Kozlowski (Eds.), Multilvel theory, research, and methods in organizations: Foundations, extensions, and new directions (pp. 349-381). San Francisco, CA: Jossey-Bass.
6.
Bradley, E.H., Herrin, J., Elbel, B., McNamara, R.L., Magid, D.J., Nallamothu, B.K., . . . Krumholz, H.M. (2006). Hospital quality for acute myocardial infarction: Correlation among process measures and relationship with short-term mortality. Journal of the American Medical Society, 296, 72-78.
7.
Chang, J.T., Hays, R.D., Shekelle, P.G., MacLean, C.H., Solomon, D.H., Reuben, D.B., . . . Wenger, N.S. ( 2006). Patients’ global ratings of their health care are not associated with the technical quality of their care. Annals of Internal Medicine, 144, 665-672.
8.
Cohen, A.B., Restuccia, J.D., Shwartz, M., Drake, J.E., Kang, R., Kralovec, P., . . . Bohr, D. ( 2008). A survey of hospital quality improvement activities. Medical Care Research and Review, 65, 571-595.
9.
The Commonwealth Fund Commission on a High Performance Health System. (2006). Framework for a high performance health system for the United States. New York, NY: The Commonwealth Fund.
10.
The Commonwealth Fund Commission on a High Performance Health System. (2009). The path to a high performance U.S. health system: A 2020 vision and the policies to pave the way. New York, NY: The Commonwealth Fund.
11.
Elixhauser, A., Steiner, C., Harris, D.R., & Coffey, R.M. ( 1998). Comorbidity measures for use with administrative data . Medical Care, 36, 8-27.
12.
Feinstein, A.R. ( 1999). Multi-item "instruments" vs. Virginia Apgar’s principles of clinimetrics. Archives of Internal Medicine, 159, 125-128.
13.
Finkler, S.A. ( 1982). The distinction between cost and charges. Annals of Internal Medicine, 96, 102-109.
14.
Fisher, E.S., Wennberg, D.E., Stukel, T.A., Gottlieb, D.J., Lucas, F.L., & Pinder, E.L. ( 2003a). The implications of regional variation in Medicare spending. Part 1: The content, quality, and accessibility of care. Annals of Internal Medicine, 138, 273-287.
15.
Fisher, E.S., Wennberg, D.E., Stukel, T.A., Gottlieb, D.J., Lucas, F.L., & Pinder, E.L. ( 2003b). The implications of regional variation in Medicare spending. Part 2: Health outcomes and satisfaction with care. Annals of Internal Medicine, 138, 288-298.
16.
Fonarow, G.C., Abraham, W.T., Albert, N.M., Stough, W.G., Gheorghiade, M., Greenberg, B.H., . . . Young, J.B. ( 2007). Association between performance measures and clinical outcomes for patients hospitalized with heart failure. Journal of the American Medical Association, 297, 61-70.
17.
Hines, S., Luna, K., Lofthus, J., Marquardt, M., & Stelmokas, D. ( 2008). Becoming a high reliability organization: Operational advice for hospital leaders (Prepared by the Lewin Group under Contract No. 290-04-0011; AHRQ Publication No. 008-0202). Rockville, MD: Agency for Healthcare Research and Quality .
18.
Iezzoni, L.I. ( 1997). The risks of risk adjustment. Journal of the American Medical Association, 278, 1600-1607.
19.
Iezzoni, L.I. ( 2003). Coded data from administrative sources. In L.I. Iezzoni (Ed.), Risk adjustment for measuring health care outcomes (3rd ed., pp. 93-138). Chicago, IL: Health Administration Press.
20.
Institute of Medicine. (2006). Performance measurement: Accelerating improvement. Washington, DC: National Academies Press.
21.
Isaac, T., Zaslavsky, A.M., Cleary, P.D., & Landon, B.E. ( 2010). The relationship between patients’ perception of care and measures of hospital quality and safety. Health Services Research, 45, 1024-1040.
22.
James, L.R., Demaree, R.G., & Wolf, G. ( 1984). Estimating within-group interrater reliability with and without response bias. Journal of Applied Psychology, 69, 85-98.
23.
Jha, A.K., Orav, E.J., Dobson, A., Book, R.A., & Epstein, A.M. ( 2009). Measuring efficiency: The association of hospital costs and quality of care. Health Affairs, 28, 897-906.
24.
Jha, A.K., Orav, E.J., Li, Z., & Epstein, A.M. ( 2007). The inverse relationship between mortality rates and performance in the Hospital Quality Alliance measures. Health Affairs, 26, 1104-1110.
25.
Jha, A.K., Orav, E.J., Zheng, J., & Epstein, A.M. ( 2008). Patients’ perceptions of hospital care in the United States. New England Journal of Medicine, 359, 1912-1931.
26.
Lee, D.S., Tu, J.V., Chong, A., & Alter, D.A. ( 2008). Patient satisfaction and its relationship with quality and outcomes of care after acute myocardial infarction. Circulation , 118, 1938-1945.
27.
Mehta, R.H., Liang, L., Karve, A.M., Hernandez, A.F., Rumsfeld, J.S., Fonarow, G.C., & Peterson, E.D. (2008). Association of patient case-mix adjustment, hospital process performance rankings, and eligibility for financial incentives. Journal of the American Medical Association, 300, 1897-1903.
28.
Nardo, M., Saisana, M., Trantola, S., Saltelli, A., Hoffman, A., & Giovannini, E. (2005). Handbook on constructing composite indicators, methodology and user guide(OECD Statistics Working Paper). Retrieved from http://www.olis.oecd.org/olis/2005doc.nsf/LinkTo/std-doc
29.
National Quality Forum. (2010). Leadership message. Retrieved from http://beyondmeasure.qualityforum.org/leadership.html
30.
Peterson, E.D., Roe, M.T., Mulgund, J., DeLong, E.R., Lytle, B.L., Brindis, R.G., . . . Ohman, E.M. ( 2006). Association between hospital process performance and outcomes among patients with acute coronary syndromes. Journal of the American Medical Association, 295, 1912-1920.
31.
Premier: Hospital Quality Incentive Demonstration Project. ( 2003). Summary of composite quality scoring methodology. Retrieved from http://www.premierinc.com/quality-safety/tools-services/p4p/hqi/resources/top-performer-summary.pdf
32.
Rosenthal, M.B., & Dudley, R.A. ( 2007). Pay-for-performance: Will the latest payment trend improve care? Journal of the American Medical Association, 297, 740-744.
33.
Rosenthal, M.B., Landrum, M.B., Meara, E., Haiden, H.A., Conti, R.M., & Keating, N.L. ( 2007). Using performance data to identify preferred hospitals . Health Services Research, 42, 2109-2119.
34.
Rosenthal, G.E., Baker, D.W., Norris, D.G., Way, L.E., Harper, D.L., & Snow, R.J. ( 2000). Relationships between in-hospital and 30-day standardized hospital mortality: Implications for profiling hospitals. Health Services Research, 34, 1449-1468.
35.
Shwartz, M., & Ash, A.S. ( 2008). Composite measures: Matching the method to the purpose . Rockville, MD: Agency for Healthcare Research and Quality, National Quality Measures Clearinghouse. Retrieved from http://www.qualitymeasures.ahrq.gov/resources/commentary.aspx?file=Composite.inc
36.
Shwartz, M., Ren, J., Peköz, E.A., Wang, X., Cohen, A.B., & Restuccia, J.D. (2008). Estimating a composite measure of hospital quality from the Hospital Compare database: Differences when using a Bayesian hierarchical latent variable model versus denominator-based weights. Medical Care, 46, 778-785.
37.
Shwartz, M., Young, D.W., & Siegrist, R. ( 1996). The ratio of cost to charges: How good a basis for estimating costs? Inquiry, 32, 476-481.
38.
Werner, R.M., & Bradlow, E.T. ( 2006). Relationship between Medicare’s Hospital Compare performance measures and mortality rates. Journal of the American Medical Association, 296, 2694-2702.
