Since the 1990s the US and UK healthcare systems have increasingly sought to measure the quality of services in order to stimulate improvement and publish the results. Despite the very different healthcare systems, there are some striking similarities in the results of these schemes. In both countries information that creates the threat of reputational damage and the possibility of gaining kudos is particularly effective in stimulating a response. However, these responses may be perverse: gaming, falsifying of data and measurement fixation have all been uncovered. In the UK context, information is closely aligned to the regulatory and performance management framework, and there should be a role for the new Care Quality Commission in the emerging `information landscape' of the NHS in England.
Marshall M., Shekelle P., Leatherman S., Brook R.The public release of performance data: What do we expect to gain? A review of the evidence. Journal of the American Medical Association2000; 283: 1866-1874
2.
Werner R., Asch D.The unintended consequences of publicly reporting quality information. Journal of the American Medical Association2005; 293: 1239-1244
3.
Rosenthal M. , Frank R.What is the empirical basis for paying for quality in health care. Medical Care Research and Review2006; 63: 135-157
4.
Hamblin R.Publishing `quality' measures: How it works and when it does not. Journal of Quality and Health Care2007; 19(4): 183-186
5.
Levitt R., Solesbury W., Ling T.Evidence for Accountability. The Nature and Uses of Evidence in the Audit Inspection and Scrutiny Functions of Government in the UK. London: The Evidence Network, 2005
6.
Rosenstein A.Hospital report cards: Intent, impact and illusion . American Journal of Medical Quality2004 ; 19: 183-192
7.
Bevan G., Hood C.Have targets improved performance in the English NHS?British Medical Journal2006; 332: 419-422
8.
Department of Health.NHS in England choosing your Hospital FAQs 2006. London: Department of Health, 2006
9.
Leavitt M.Better Care, Lower Cost. Prescription for Value-Driven Health System . http://www.hhs.gov/valuedriven/brochure.pdf
10.
Marshall M. , Shekelle P., Davies H., Smith P.Public reporting on quality in the United States and the United Kingdom. Health Affairs2003; 22: 134-148
11.
Walshe K.The rise of regulation in the NHS. British Medical Journal2002; 324(7343): 967-970
12.
Doran T., Fullwood C., Gravelle H., Reeves D., Kontopantelis E., Hiroeh U., et al. Pay for Performance programs in family practices in the UK. New England Journal of Medicine2006; 355: 375-384
13.
Rosenthal M. , Frank R., Li Z., Epstein A.Early experience with pay for performance from concept to practice. Journal of the American Medical Association2005; 294: 1788-1793
14.
Hibbard J., Stockard J., Tusler M.Hospital performance reports: Impact on quality, market share and reputation . Health Affairs2005; 24: 1150-1160
15.
Fung CH, Linn YW, Mattke S., Damberg C., Shekelle PGSystematic review: The evidence that publishing patient care performance data improves quality of care. Annals of Internal Medicine2008; 148: 111-123
16.
O'Connor G. , Plume S., Olmstead E., Coffin L., Morton J., Maloney C., et al. A regional prospective study of in-hospital mortality associated with coronary artery bypass grafting. The Northern New England Cardiovascular Disease Study Group . Journal of the American Medical Association1991; 266: 803-809
17.
O'Connor G. , Plume S., Olmstead E., Morton J., Maloney C., Nugent W., et al. A regional intervention to improve the hospital mortality associated with coronary artery bypass graft surgery. The Northern New England Cardiovascular Disease Study Group. Journal of the American Medical Association1996; 275: 841-846
18.
Goss J., Whitten R., Phillips R., Johnston G., Hofer B., Mansfield P., et al. Washington State's model of physician leadership in cardiac outcomes reporting. Annals of Thoracic Surgery2000; 70: 695-701
19.
Jencks S., Huff E., Cuerdon T.Change in the quality of care delivered to Medicare beneficiaries 1998-1999 to 2000-2001. Journal of the American Medical Association2003; 289: 305-312
20.
Kiefe C., Allison J., Williams O., Person D., Weaver M., Weissman N.Improving quality improvement using achievable benchmarks for physician feedback: A randomized controlled trial. Journal of the American Medical Association2001; 285: 2871-2879
21.
Beck C., Richard H., Tu J., Pilote L.Administrative data feedback for effective cardiac treatment. Journal of the American Medical Association2005; 294: 309-317
22.
Berner E., Backer C., Funkhouse E., Heudebert G., Allison J., Fargason C.Do local opinion leaders augment hospital quality improvement efforts? A randomized trial to promoted adherence to unstable angina guidelines. Medical Care2003; 41: 420-431
23.
Birkhead JS, Walker L., Pearson M., Weston C., Cunningham AD, Rickards AFNational Audit of Myocardial Infarction Project Steering Group. Improving care for patients with acute coronary syndromes: Initial results from the National Audit of Myocardial Infarction Project (MINAP). Heart2004; 90(9): 1004-1009
24.
Kizer K.The `New VA': A national laboratory for healthcare quality management . American Journal of Medical Quality1999 ; 14: 3-20
25.
Jha A., Perlin J., Kizer K.Effect of the transformation of the Veterans Affairs healthcare system on the quality of care. New England Journal of Medicine2003; 348: 2218-2227
26.
Asch S., McGlynn E., Hogan M., Hayward R., Shekelle P., Rubenstein L., et al. Comparison of quality of care for patients in the Veterans Health Administration and patients in a national sample. Annals of Internal Medicine2004; 141: 938-945
27.
Khuri S., Daley J., Henderson W.The comparative assessment and improvement of quality of surgical care in the department of veterans affairs. Archive of Surgery2002; 137: 20-27
28.
Walter L., Davidowitz N., Heineken P., Covinsky K.Pitfalls of converting practice guidelines into quality measures: Lessons learned from a VA performance measure. Journal of the American Medical Association2004; 291: 2466-2470
29.
Petitti D., Contreras R., Ziel F., Dudl J., Domurat E., Hyatt J.Evaluation of the effect of performance monitoring and feedback on care process, utilization and outcome. Diabetes Care2000 ; 23: 192-196 (abstract)
30.
Freeman T., Walshe K.Achieving progress through clinical governance? A national study of healthcare managers' perceptions in the NHS in England. Quality and Safety in Health Care2004; 13: 335-343
31.
Whitty P.Prescribing how NHS trusts `do' quality: A recipe for committees but little action?Quality and Safety in Health Care2004; 13: 328
32.
Jarman B., Aylin P., Bottle A.CHI ratings and HSMRs: Is there a relation?British Medical Journal2004; 329: 73
33.
Hibbard J.What can we say about the impact of public reporting? Inconsistent execution yields variable results. Annals of Internal Medicine2008; 148: 160-161
34.
Bevan G., Hamblin R.Success and failure to hit targets in England, Wales, Scotland and Northern Ireland: A study of performance measurement of ambulance response times. The Journal of the Royal Statistical Society (forthcoming)
35.
Chassin MR, Hannan EL, De Buono BABenefits and hazards of reporting medical outcomes publicly. New England Journal of Medicine1996; 334: 394-398
36.
Dziuban S., Mcilduff J., Miller S., Dal Col R.How a New York cardiac surgery program uses outcomes data. Annals of Thoracic Surgery1996; 58: 1871-1876
37.
Hannan EL, Siu AL, Kumar D., Kilburn H., Chassin M.The decline in coronary artery bypass graft mortality in New York State. Journal of the American Medical Association1995; 273: 209-213
38.
Burack J., Impellizzeri P., Homel P., Cunningham P.Public reporting of surgical mortality: A survey of New York State cardiothoracic surgeons. Annals of Thoracic Surgery1999; 68: 1195-1202
39.
Green J., Wintfeld N.Report cards on cardiac surgeons - Assessing New York State's approach . New England Journal of Medicine1995; 332: 1229-1232
40.
Narins C., Dozier A., Ling F., Zareba W.The influence of public reporting of outcome data on medical decision-making by physicians. Archives of Internal Medicine2005; 165: 83-87
41.
Omoigui N., Annan K., Brown K., Miller D., Cosgrove D., Loop F.Potential explanation for decreased CABG-related mortality inNew York State: Outmigration to Ohio. Circulation1994; 90: I-93
42.
Omoigui N., Miller D., Brown K., Annan K., Cosgrove D., Lytle B., et al. Outmigration for coronary bypass surgery in an era of public dissemination of clinical outcomes. Circulation1996; 93: 27-33
43.
Schneider E. , Epstein A.Influence of cardiac surgery performance reports on referral practice and access to care. New England Journal of Medicine1996; 335: 251-256
Mannion R., Davies H., Marshall M.Impact of star performance ratings in English acute hospital trusts . Journal of Health Services Research and Policy2005; 10: 18-24
46.
Whitfield, L.DoH urged to get tough over Sun blast. Health Service Journal, 18 October 2004.
47.
Appleby J., Boyle S., Devlin N., Harley M., Harrison A., Thorlby R.Do English NHS waiting time targets distort treatment priorities in orthopaedic surgery. Journal of Health Services Research and Policy2005; 10: 167-172
48.
Audit Commission.Information and Data Quality in the NHS: Key messages from three years of independent review. London: Audit Commission , 2004
49.
Commission for Health Improvement.What CHI has found in: ambulance trusts. London : Commission for Health Improvement, 2003. http://www.healthcarecommission.org.uk/_db/_documents/04000052.pdf
50.
Davies R., Welbourn R., Collins C., Kennedy R., Roylke C.A prospective study to assess the implementation of a fast-track system to meet the two-week target for colorectal cancer. Gut2001; 48: A3
51.
Hanna S., Muneer A., Khalil K.The two-week wait for suspected cancer: Time for a rethink?Journal of Clinical Practice2005; 59: 1334-1339
52.
Lilford R., Mohammed M., Spiegelhalter D., Thomson R.Use and misuse of process and outcome data in managing performance of acute medical care: Avoiding institutional stigma. Lancet2004; 363: 1147-1154
53.
Walsh S., Bruce C., Bennington S., Ravi S.The fourteen-day rule and colorectal cancer. Annals of the Royal College of Surgery of England2002; 84: 386-388
54.
Morrison J. , Gillespie S., Mackenzie I.Two-week wait standards for suspected gynaecological malignancy. On target, but missing the point . Journal of the British Menopause Society2003; 9: 170-172
55.
Mayhew L., Smith D.Using Queuing Theory to Analyse Completion Times in Accident and Emergency Departments in the Light of the Government 4 hour Target. City of London: Cass Business School. Actuarial Research Paper No 177, 2006
56.
Bevan, G.Setting targets for healthcare performance: Lessons from a case study of the English NHS. National Institute Economic Review2006; 197: 67-79
57.
Mannion R., Goddard M.Public disclosure of comparative clinical peformance data: Lessons from the Scottish experience. Journal of Evaluation in Clinical Practice2003; 9(2): 277-286
58.
Clinical Resource and Audit Group. Clinical Outcome Indicators.A report from the Clinical Outcomes Working Group. CRAG, 2002. http://www.crag.scot.nhs.uk
59.
Auditor General for Wales. Ambulance Services in Wales. Cardiff: The Stationery Office, 2006. http://www.wao.gov.uk/assets/englishdocuments/Ambulance_Inquiry.pdf
60.
Petersen LA , Woodard LD, Urech T., Daw C., Sookanan S.Does pay-for-performance improve the quality of healthcare?Annals of Internal Medicine2006; 145(4): 265-272
61.
Thomas Scully. Quoted in: Merit Pay for Top Hospitals - Medicare Plan Would Give Bonuses for Superior Care; Tracking Hip-Surgery Results, Wall Street Journal, 27 May 2003 (cited by Rosenthal & Frank (2006) above)
62.
Berwick D.The toxicity of pay for performance. Quality Management in Healthcare1995; 4(1): 27-33
63.
Lindernauer P., Remus D., Roman S., Rothberg M., Benjamin E., Ma A., et al. Public reporting and pay for performance in hospital quality improvement. New England Journal of Medicine2007; 356(5): 486-496
64.
Grossbart SRWhat's the return? Assessing the effect of `pay-for-performance' initiatives on the quality of care delivery. Medical Care Research and Review2006; 63 (Suppl 1): 29S-48S
65.
Levin-Scherz J., DeVita N., Timbie J.Impact of pay-for-performance contracts and network registry on diabetes and asthma HEDIS measures in an integrated delivery network. Medical Care Research and Review2006; 63 (Suppl 1): 14S-28S
66.
Kouides R., Bennett N., Lewis B., Cappuccio J., Barker W., LaForce F.Performance-based physician reimbursement and influenza immunization rates in the elderly. American Journal of Preventive Medicine1998; 14: 89-95
67.
Amundsen G. , Solberg L., Reed M., Martini E., Carlson R.Paying for quality improvement. Compliance with tobacco cessation guidelines. Joint Commission Journal on Quality and Safety2003; 29: 59-65
68.
Hillman A., Ripley K., Goldfarb N., Weiner J., Nuamah I., Lusk E.The use of physician financial incentives and feedback to improve pediatric preventive care in Medicaid managed care. Pediatrics1999; 104: 931-935
69.
Fairbrother G. , Hanson K., Friedman S., Butts G.The impact of physician bonuses, enhanced fees, and feedback on childhood immunization coverage rates . American Journal of Public Health1999; 89: 171-175
70.
Roski J., Jeddeloh R., An L., Lando H., Hannan P., Hall C., et al. The impact of financial incentives and a patient registry on preventive care quality: Increasing provider adherence to the evidence-based smoking cessation practice guidelines. Preventive Medicine2003; 36: 291-299
71.
Pourat N., Rice T., Tao-Seale M., Bolan G., Nihalani J.Association between physician compensation methods and delivery of guideline-concordant STD care: Is there a link?American Journal of Managed Care2005; 11: 426-432
72.
Carter G., Newhouse J., Young S.How much change in the case mix index is DRG creep?Journal of Health Economics1990; 9: 411-428
73.
Frank R., Gaynor M.Organizational failure and transfers in the public sector: Evidence from an experiment in the financing of mental healthcare. Journal of Human Resources1994; 29: 108-125
74.
Fleetcroft R., Cookson R.Do the incentive payments in the new NHS contract for primary care reflect likely population health gains?Journal of Health Service Research and Policy2006; 11: 27-31
75.
Ashworth M. , Armstrong D.The relationship between general practice characteristics and quality of care: A national survey of quality indicators used in the UK Quality and Outcomes Framework, 2004-05. BMC Family Practice2006; 7: 68
76.
McLean G., Suton M., Guthrie B.Deprivation and quality of primary care services: Evidence for persistence of the inverse care law from the UK Quality and Outcomes Framework. Journal of Epidemiology and Community Health2006; 60: 917-922
77.
Epstein A.Paying for performance in the US and abroad. New England Journal of Medicine2006; 355: 406-408
78.
BBC News.GPs `angry' over salary hike row, 26 April 2006. http://news.bbc.co.uk/1/hi/scotland/4948758.stm
79.
BBC News.Q&A: GPs' pay, 19 January 2007. http://news.bbc.co.uk/1/hi/health/4918040.stm
