Impact of ‘high-profile’ public reporting on utilization and quality of maternity care in England: a difference-in-difference analysis

Abstract

Objectives

To evaluate the impact of ‘high-profile’ (with extensive media coverage) public reporting versus public reporting without ‘high profile’ coverage on utilization and perceived quality of maternity services in England’s National Health Service.

Methods

Analysis of national hospital administrative data using difference-in-difference models with propensity score matching, and of two maternity surveys from 2007 and 2010. Outcomes were counts of women admitted for delivery of a baby and the percentage of women rating their care positively in 2007 and 2010.

Results

Hospitals highly publicized as providing the best maternity care in England had fewer admissions annually and lower occupancy rates than the national comparison group (63.0% vs. 77.3%; p = 0.09). There was no statistically significant change in overall maternity admissions in the best hospitals (+2.2%, p = 0.40 at six months), or the worst hospitals (−2.8%, p = 0.49 at six months) during any period in the 36 months after public reporting relative to their matched comparison groups. Survey analyses found that compared to the national comparison group of hospitals without ‘high profile’ media coverage, the worst rated hospitals experienced greater improvements in perceived quality after public reporting but these findings were not maintained in the analysis of matched hospitals.

Conclusions

‘High-profile’ public reporting of maternity care in England was not associated with changes in the use of maternity services or improvements in patient-reported quality. These findings provide further evidence that public reporting is unlikely to drive major improvements in health system performance through the mechanism of patient choice.

Keywords

health policy patient choice public reporting

Get full access to this article

View all access options for this article.

References

Fung

Lim

Mattke

. Systematic review: the evidence that publishing patient care performance data improves quality of care. Ann Intern Med 2008; 148: 111–123.

Berwick

James

Coye

. Connections between quality measurement and improvement. Med Care 2003; 41: I30–I38.

Department of Health. Handbook to the NHS constitution 2013. http://www.nhs.uk/choiceinthenhs/rightsandpledges/nhsconstitution/documents/2013/handbook-to-the-nhs-constitution.pdf (2013, accessed 12 January 2015).

Department of Health. The NHS Constitution 2013. https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/170656/NHS_Constitution.pdf (2013, accessed 12 January 2015).

Department of Health. Reforming NHS Financial Flows: Introducing payment by results 2002. http://webarchive.nationalarchives.gov.uk/+/www.dh.gov.uk/en/Consultations/Closedconsultations/DH_4016901 (2002, accessed 12 January 2015).

Department of Health. Choose and book: patients' choice of hospital and booked appointment 2004. http://webarchive.nationalarchives.gov.uk/+/www.dh.gov.uk/en/Publicationsandstatistics/Publications/PublicationsPolicyAndGuidance/DH_4088353 (2004, accessed 12 January 2015).

Mannion

Goddard

. Public disclosure of comparative clinical performance data: lessons from the Scottish experience. J Eval Clin Pract 2003; 9: 277–286.

Dixon A, Appleby J, Robertson R, et al. Patient choice: how patients choose and how providers respond. London: The King's Fund, 2010. http://www.kingsfund.org.uk/publications/patient-choice (accessed 23 January 2015).

Shekelle

Public performance reporting on quality information. In: Smith

(ed.). Performance measurement for health system improvement: experiences, challenges and prospects, Cambridge: Cambridge University Press, 2009.

10.

Healthcare Commission. Towards better births 2008. http://image.guardian.co.uk/sys-files/Society/documents/2008/07/10/Towards_better_births.pdf (2008, accessed 12 Januray 2015).

11.

BirthChoiceUK 2007. http://www.birthchoiceuk.com/ (2007, accessed 12 January 2015).

12.

BBC News 2008. NHS maternity units falling short 2008 http://news.bbc.co.uk/1/hi/health/7207215.stm (2008, accessed 12 January 2015).

13.

Brocklehurst

. Perinatal and maternal outcomes by planned place of birth for healthy women with low risk pregnancies: the Birthplace in England national prospective cohort study. BMJ 2011; 343: d7400–d7400.

14.

Office for National Statistics Population Estimates. http://www.ons.gov.uk/ons/taxonomy/index.html?nscl=Population+Estimates+by+Age+and+Sex (accessed 12 January 2015).

15.

The Healthcare Commission. Women's experiences of maternity care in the NHS in England: key findings from a survey of NHS trusts carried out in 2007 http://www.nhssurveys.org/Filestore/CQC/2007_Maternity_services_survey_report.pdf (2007, accessed 12 January 2015).

16.

National NHS patient survey programme. Survey of women’s experiences of maternity services. London: Care Quality Commission, 2010.

17.

Blundell

Costa Dias

. Evaluation methods for non experimental data. Fiscal Studies 2000; 21: 427–468.

18.

Dixon A, Mays N and Jones L. Understanding New Labour's market reforms of the English NHS. London: The King's Fund, 2011. http://www.kingsfund.org.uk/publications/understanding-new-labours-market-reforms-english-nhs (2011, accessed 12 January 2015).

19.

The Nuffield Trust. Rating providers for quality: a policy worth pursuing? http://www.nuffieldtrust.org.uk/publications/rating-providers-quality (2013, accessed 12 January 2015).

20.

Ketelaar

Faber

Flottorp

. Public release of performance data in changing the behaviour of health care consumers, professionals or organisations. Cochrane Database Syst Rev 2011; 47: CD004538–CD004538.

21.

Laverty

Smith

Pape

. High-profile investigations into hospital safety problems in England did not prompt patients to switch providers. Health Aff (Millwood) 2012; 31: 593–601.

22.

Gaynor M, Moreno-Serra R and C P. Death by market power: reform, competition and patient outcomes in the National Health Service 2010. http://www.bristol.ac.uk/cmpo/publications/papers/2010/wp242.pdf (2010, accessed 12 January 2015).

23.

Hibbard

Stockard

Tusler

. Does publicizing hospital performance stimulate quality improvement efforts. Health Aff (Millwood) 2003; 22: 84–94.

24.

Hall E, Propper C and Reenen Jv. Can pay regulation kill? Panel data evidence on the effect of labor markets on hospital performance 2008. Centre for Economic Performance discussion paper no 843. London: London School of Economics and Political Science http://www.nber.org/papers/w13776 (2008, accessed 12 January 2015).

25.

Raleigh

Hussey

Seccombe

. Ethnic and social inequalities in women's experience of maternity care in England: results of a national survey. J R Soc Med 2010; 103: 188–198.

26.

http://www.esundhed.dk/Sider/Forside.aspx Danish patient information pages (accessed 12 January 2015).

27.

http://www.cbc.ca/news2/health/features/ratemyhospital/ CBC News Health. Rate my hospital (accessed 12 January 2015).

28.

LeGrand J. The other invisible hand. Princeton: Princeton University Press, 2007.

29.

Department of Health. The NHS friends and family test. Publication guidance 2013. https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/141446/Friends-and-Family-Test-Publication-Guidance-v2-FOR-PUBLIC_E2_80_A6.pdf.pdf (2013, accessed 12 January 2015).