When Things Go Wrong: The Impact of Being a Statistical Outlier in Publicly Reported Coronary Artery Bypass Graft Surgery Mortality Data

Abstract

The public reporting of hospital quality and safety data is a growing phenomenon. Yet there are few reports of the effects of publicly reported data on individual organizations, particularly when the data show worse than expected performance. In this article, our hospital's response to having a mortality rate from coronary artery bypass graft surgery that was significantly higher than other programs in the Commonwealth of Massachusetts is reported. The data caused suspension of elective cardiac surgery at the institution, and an independent review of the program was undertaken. The effects of the suspension and publication of mortality data on quality and patient safety, the residency training program in cardiothoracic surgery, and the financial performance of the hospital are described. Several lessons were learned that may be of value to other health care organizations that experience a public crisis in clinical quality. (Am J Med Qual 2008;23:90-95)

Keywords

cardiac surgery performance improvement public reporting mortality rates

Get full access to this article

View all access options for this article.

References

Bloche MG Consumer-directed health care. N Engl J Med. 2006;355:1756-1759.

Rowe JW Pay-for-performance and accountability: related themes in improving health care. Ann Intern Med. 2006; 145:695-699.

Werner RM , Asch DA The unintended consequences of publicly reporting quality information. JAMA. 2005;293:1239-1244.

Bentley JM , Nash DB How Pennsylvania hospitals have responded to publicly released reports on coronary artery bypass graft surgery. Jt Comm J Qual Improv . 1998;24:40-49.

Hannan EL , Sarrazin MS , Doran DR , Rosenthal GE Provider profiling and quality improvement efforts in coronary artery bypass graft surgery: the effect on short-term mortality among Medicare beneficiaries . Med Care. 2003;41:1164-1172.

Epstein AJ Do cardiac surgery report cards reduce mortality? Assessing the evidence . Med Care Res Rev. 2006;63:403-426.

Chassin MR Achieving and sustaining improved quality: lessons from New York State and cardiac surgery. Health Aff (Millwood). 2002;21:40-51.

Jha AK , Epstein AM The predictive value of the accuracy of New York State Coronary Artery Bypass Surgery Report-Card System. Health Aff (Millwood) . 2006;25:844-855.

Steinbeck R. Public report cards-cardiac surgery and beyond . N Engl J Med. 2006;355:1847-1849.

10.

Dziuban SW Jr , McIlduff JB , Miller SJ , Dal Col RH How a New York cardiac surgery program uses outcomes data. Ann Thorac Surg. 1994;58:1871-1876.

11.

Department of Health Care Policy, Harvard Medical School. MASS-DAC. Adult Coronary Artery Bypass Graft Surgery in the Commonwealth of Massachusetts January 1-December 31, 2002; Adult Coronary Artery Bypass Graft Surgery in the Commonwealth of Massachusetts January 1-December 31, 2003; Adult Coronary Artery Bypass Graft Surgery in the Commonwealth of Massachusetts January 1-December 31, 2004. http://www.massdac.org/reports/surgery.html . Accessed April 12, 2007.

12.

Rogues F. , Michel P. , Goldstone AR , Nashef SAM. The Logistic EuroScore. Eur Heart J. 2003;24:1-2.

13.

Schwartz LM , Woloshin S. , Birkmeyer JD How do elderly patients decide where to go for major surgery? Telephone Interview Survey. BMJ. 2005;331;821-824.

14.

Hibbard JH , Stockard J. , Tusler M. It isn't about choice: the potential of a public performance report to affect the public image of hospitals. Med Care Res Rev . 2005;62:358-371.

15.

Wilson CT , Woloshon S. , Schwartz LM Choosing where to have major surgery: who makes the decision? Arch Surg. 2007;142:242-246.