Approximately two decades ago, federally mandated public reporting began for U.S. nursing homes through a system now known as Nursing Home Compare. The goals were to provide information to enable consumers to choose higher quality nursing homes and to incent providers to improve the quality of care delivered. We conduct a systematic review of the literature on responses to Nursing Home Compare and its effectiveness in meeting these goals. We find evidence of modest but meaningful response by both consumers and providers. However, we also find evidence that some improvement in scores does not reflect true quality improvement, that disparities by race and income have increased, that risk-adjustment of the measures is likely inadequate, and that several key domains of quality are not represented. Our results support moderate success of Nursing Home Compare in achieving intended goals but also reveal the need for continued refinement.
ArlingG.LewisT.KaneR. L.MuellerC.FloodS. (2007).
Improving quality assessment through multilevel modeling: The case of nursing home compare. Health Services Research,
42(3 Pt 1), 1177–1199. https://doi.org/10.1111/j.1475-6773.2006.00647.x
3.
ArrowK. J. (1963).
Uncertainty and the welfare economics of medical care. American Economic Review,
53(5), 941–973.
4.
BergerZ. D.JoyS. M.HutflessS.BridgesJ. F. (2013).
Can public reporting impact patient outcomes and disparities? A systematic review. Patient Education and Counseling,
93(3), 480–487. https://doi.org/10.1016/j.pec.2013.03.003
5.
BowblisJ. R.LucasJ. A.BruntC. S. (2015).
The effects of antipsychotic quality reporting on antipsychotic and psychoactive medication use. Health Services Research,
50(4), 1069–1087. https://doi.org/10.1111/1475-6773.12281
6.
BraunerD.WernerR. M.ShippeeT. P.CursioJ.SharmaH.KonetzkaR. T. (2018).
Does Nursing Home Compare reflect patient safety in nursing homes?Health Affairs (Millwood),
37(11), 1770–1778. https://doi.org/10.1377/hlthaff.2018.0721
7.
CaiS.Temkin-GreenerH. (2011).
Influenza vaccination and its impact on hospitalization events in nursing homes. Journal of Post-Acute and Long-Term Care Medicine,
12(7), 493–498. https://doi.org/10.1016/j.jamda.2010.03.005
8.
CalikogluS.ChristmyerC. S.KozlowskiB. U. (2012). My eyes, your eyes–the relationship between CMS five-star rating of nursing homes and family rating of experience of care in Maryland. Journal for Healthcare Quality,
34(6), 5–12. https://doi.org/10.1111/j.1945-1474.2011.00159.x
9.
CasalinoL. P.ElsterA.EisenbergA.LewisE.MontgomeryJ.RamosD. (2007).
Will pay-for-performance and quality reporting affect health care disparities?Health Affairs (Millwood),
26(3), w405-w414. https://doi.org/10.1377/hlthaff.26.3.w405
10.
CastleN. G. (2005).
Nursing home administrators’ opinions of the nursing home compare web site. The Gerontologist,
45(3), 299–308. https://doi.org/10.1093/geront/45.3.299
11.
CastleN. G. (2009a).
Consumers’ use of Internet-based nursing home report cards. Joint Commission Journal on Quality and Patient Safety,
35(6), 316–323. https://doi.org/10.1016/S1553-7250(09)35045-X
12.
CastleN. G. (2009b).
The Nursing Home Compare report card: Consumers’ use and understanding. Journal of Aging & Social Policy,
21(2), 187–208. https://doi.org/10.1080/08959420902733272
13.
CastleN. G.EngbergJ.LiuD. (2007).
Have Nursing Home Compare quality measure scores changed over time in response to competition?BMJ Quality & Safety,
16(3), 185–191. https://doi.org/10.1136/qshc.2005.016923
14.
CastleN. G.LiuD.EngbergJ. (2008). The association of Nursing Home Compare quality measures with market competition and occupancy rates. Journal for Healthcare Quality,
30(2), 4–14. https://doi.org/10.1111/j.1945-1474.2008.tb01129.x
ClementJ. P.BazzoliG. J.ZhaoM. (2012).
Nursing home price and quality responses to publicly reported quality information. Health Services Research,
47(1 Pt 1), 86–105. https://doi.org/10.1111/j.1475-6773.2011.01306.x
18.
CornellP. Y.GrabowskiD. C.NortonE. C.RahmanM. (2019).
Do report cards predict future quality? The case of skilled nursing facilities. Journal of Health Economics,
66(July), 208–221. https://doi.org/10.1016/j.jhealeco.2019.05.008
19.
Feng LuS. (2012).
Multitasking, information disclosure, and product quality: Evidence from nursing homes. Journal of Economics & Management Strategy,
21(3), 673–705. https://doi.org/10.1111/j.1530-9134.2012.00341.x
20.
Feng LuS. (2016).
The role of donations in quality disclosure: Evidence from nonprofit nursing homes. American Journal of Health Economics,
2(4), 431–462. http://dx.doi.org/10.1111/j.1530-9134.2012.00341.x
21.
FullerR. L.GoldfieldN. I.HughesJ. S.McCulloughE. C. (2019).
Nursing Home Compare star rankings and the variation in potentially preventable emergency department visits and hospital admissions. Population Health Management,
22(2), 144–152. https://doi.org/10.1089/pop.2018.0065
22.
GengF.StevensonD. G.GrabowskiD. C. (2019).
Daily nursing home staffing levels highly variable, often below CMS expectations. Health Affairs (Millwood),
38(7), 1095–1100. https://doi.org/10.1377/hlthaff.2018.05322
23.
GerteisM.GerteisJ. S.NewmanD.KoepkeC. (2007). Testing consumers’ comprehension of quality measures using alternative reporting formats. Health Care Financing Review,
28(3), 31–45.
24.
GrabowskiD. C.TownR. J. (2011).
Does information matter? Competition, quality, and the impact of nursing home report cards. Health Services Research,
46(6 Pt 1), 1698–1719. https://doi.org/10.1111/j.1475-6773.2011.01298.x
HanX.YaraghiN.GopalR. (2017).
Winning at all costs: Analysis of inflation in nursing homes’ rating system. Production and Operations Management,
27(2), 215–233. https://doi.org/10.1111/poms.12804
27.
HarrisY.ClauserS. B. (2002). Achieving improvement through nursing home quality measurement. Health Care Financing Review,
23(4), 5–18.
28.
HeD.KonetzkaR. T. (2015).
Public reporting and demand rationing: Evidence from the nursing home industry. Health Economics,
24(11), 1437–1451. https://doi.org/10.1002/hec.3097
29.
HolmstromB.MilgromP. (1991).
Multitask principal agent analyses: Incentive contracts, asset ownership, and job design. Journal of Law Economics & Organization,
7(January), 24–52. https://doi.org/10.1093/jleo/7.special_issue.24
30.
HuangS. S.HirthR. A. (2016).
Quality rating and private-prices: Evidence from the nursing home industry. Journal of Health Economics,
50(December), 59–70. https://doi.org/10.1016/j.jhealeco.2016.08.007
31.
Institute of Medicine. (1986). Improving the quality of care in nursing homes.
National Academy of Sciences.
32.
KimA. S. (2016a).
Market conditions and performance in the Nursing Home Compare five-star rating. Journal of Health Politics, Policy and Law,
41(5), 939–968. https://doi.org/10.1215/03616878-3632221
KimS. J.ParkE. C.KimS.NakagawaS.LungJ.ChoiJ. B.RyuW. S.MinT. J.ShinH. P.KimK.YooJ. W. (2014).
The association between quality of care and quality of life in long-stay nursing home residents with preserved cognition. Journal of Post-Acute and Long-Term Care Medicine,
15(3), 220–225. https://doi.org/10.1016/j.jamda.2013.10.012
35.
KissamS.GiffordD.ParksP.PatryG.PalmerL.WilkesL.FitzgeraldM.PetrulisA. S.BarnetteL. (2003).
Approaches to quality improvement in nursing homes: Lessons learned from the six-state pilot of CMS’s Nursing Home Quality Initiative. BMC Geriatrics,
3, Article 2. https://doi.org/10.1186/1471-2318-3-2
36.
KonetzkaR. T.BraunerD. J.Coca PerraillonM.WernerR. M. (2015).
The role of severe dementia in nursing home report cards. Medical Care Research and Review,
72(5), 562–579. https://doi.org/10.1177/1077558715588436
37.
KonetzkaR. T.BraunerD. J.ShegaJ.WernerR. M. (2014).
The effects of public reporting on physical restraints and antipsychotic use in nursing home residents with severe cognitive impairment. Journal of the American Geriatric Society,
62(3), 454–461. https://doi.org/10.1111/jgs.12711
38.
KonetzkaR. T.GrabowskiD. C.PerraillonM. C.WernerR. M. (2015).
Nursing home 5-star rating system exacerbates disparities in quality, by payer source. Health Affairs (Millwood),
34(5), 819–827. https://doi.org/10.1377/hlthaff.2014.1084
39.
KonetzkaR. T.GrayZ. S. (2017).
The role of socioeconomic status in nursing home quality ratings.Seniors Housing and Care Journal,
25(1), 3–14.
40.
KonetzkaR. T.PerraillonM. C. (2016).
Use of Nursing Home Compare website appears limited by lack of awareness and initial mistrust of the data. Health Affairs (Millwood),
35(4), 706–713. https://doi.org/10.1377/hlthaff.2015.1377
41.
KonetzkaR. T.PolskyD.WernerR. M. (2013).
Shipping out instead of shaping up: Rehospitalization from nursing homes as an unintended effect of public reporting. Journal of Health Economics,
32(2), 341–352. https://doi.org/10.1016/j.jhealeco.2012.11.008
42.
LiY.CaiX.GlanceL. G.SpectorW. D.MukamelD. B. (2009).
National release of the nursing home quality report cards: Implications of statistical methodology for risk adjustment. Health Services Research,
44(1), 79–102. https://doi.org/10.1111/j.1475-6773.2008.00910.x
43.
LiY.SchnelleJ.SpectorW. D.GlanceL. G.MukamelD. B. (2010).
The “Nursing Home Compare” measure of urinary/fecal incontinence: Cross-sectional variation, stability over time, and the impact of case mix. Health Services Research,
45(1), 79–97. https://doi.org/10.1111/j.1475-6773.2009.01061.x
LoomerL.GandhiA.GengF.GrabowskiD. C. (2019).
Secret shopper data on private prices in the nursing home industry from 2008 to 2010. Medical Care Research and Review. Advance online publication. https://doi.org/10.1177/1077558719879022
46.
LucasJ. A.ChakravartyS.BowblisJ. R.GerhardT.KalayE.PaekE. K.CrystalS. (2014).
Antipsychotic medication use in nursing homes: A proposed measure of quality. International Journal of Geriatric Psychiatry,
29(10), 1049–1061. https://doi.org/10.1002/gps.4098
47.
MukamelD. B.AminA.WeimerD. L.LaddH.SharitJ.SchwarzkopfR.SorkinD. H. (2016).
Personalizing Nursing Home Compare and the discharge from hospitals to nursing homes. Health Services Research,
51(6), 2076–2094. https://doi.org/10.1111/1475-6773.12588
48.
MukamelD. B.AminA.WeimerD. L.SharitJ.LaddH.SorkinD. H. (2016).
When patients customize nursing home ratings, choices and rankings differ from the government’s version. Health Affairs (Millwood),
35(4), 714–719. https://doi.org/10.1377/hlthaff.2015.1340
49.
MukamelD. B.CaprioT.AhnR.ZhengN. T.NortonS.QuillT.Temkin-GreenerH. (2012).
End-of-life quality-of-care measures for nursing homes: Place of death and hospice. Journal of Palliative Medicine,
15(4), 438–446. https://doi.org/10.1089/jpm.2011.0345
50.
MukamelD. B.GlanceL. G.LiY.WeimerD. L.SpectorW. D.ZinnJ. S.MosquedaL. (2008).
Does risk adjustment of the CMS quality measures for nursing homes matter?Medical Care,
46(5), 532–541. https://doi.org/10.1097/MLR.0b013e31816099c5
51.
MukamelD. B.HaederS. F.WeimerD. L. (2014).
Top-down and bottom-up approaches to health care quality: The impacts of regulation and report cards. Annual Review of Public Health,
35, 477–497. https://doi.org/10.1146/annurev-publhealth-082313-115826
52.
MukamelD. B.LaddH.CaprioT.Temkin-GreenerH. (2016).
Prototype end-of-life quality measures based on MDS 3 data. Medical Care,
54(11), 1024–1032. https://doi.org/10.1097/MLR.0000000000000576
53.
MukamelD. B.LaddH.WeimerD. L.SpectorW. D.ZinnJ. S. (2009).
Is there evidence of cream skimming among nursing homes following the publication of the Nursing Home Compare report card?The Gerontologist,
49(6), 793–802. https://doi.org/10.1093/geront/gnp062
54.
MukamelD. B.SpectorW. D.ZinnJ.WeimerD. L.AhnR. (2010).
Changes in clinical and hotel expenditures following publication of the nursing home compare report card. Medical Care,
48(10), 869–874. https://doi.org/10.1097/MLR.0b013e3181eaf6e1
55.
MukamelD. B.SpectorW. D.ZinnJ. S.HuangL.WeimerD. L.DozierA. (2007).
Nursing homes’ response to the nursing home compare report card. Journals of Gerontology B: Psychological Sciences and Social Sciences,
62(4), S218–S225. https://doi.org/10.1093/geronb/62.4.S218
56.
MukamelD. B.WatsonN. M.MengH.SpectorW. D. (2003).
Development of a risk-adjusted urinary incontinence outcome measure of quality for nursing homes. Medical Care,
41(4), 467–478. https://doi.org/10.1097/01.MLR.0000053227.95476.02
57.
MukamelD. B.WeimerD. L.MushlinA. I. (2007).
Interpreting market share changes as evidence for effectiveness of quality report cards. Medical Care,
45(12), 1227–1232. https://doi.org/10.1097/MLR.0b013e31812f56bb
58.
MukamelD. B.WeimerD. L.SpectorW. D.LaddH.ZinnJ. S. (2008).
Publication of quality report cards and trends in reported quality measures in nursing homes. Health Services Research,
43(4), 1244–1262. https://doi.org/10.1111/j.1475-6773.2007.00829.x
59.
NeumanM. D.WirtallaC.WernerR. M. (2014).
Association between skilled nursing facility quality indicators and hospital readmissions. Journal of the American Medical Association,
312(15), 1542–1551. https://doi.org/10.1001/jama.2014.13513
ParkJ.WernerR. M. (2011).
Changes in the relationship between nursing home financial performance and quality of care under public reporting. Health Economics,
20(7), 783–801. https://doi.org/10.1002/hec.1632
62.
PerraillonM. C.BraunerD. J.KonetzkaR. T. (2017).
Nursing home response to Nursing Home Compare: The provider perspective. Medical Care Research and Review,
76(4), 425–443. https://doi.org/10.1177/1077558717725165
63.
PerraillonM. C.KonetzkaR. T.HeD.WernerR. M. (2019). Consumer response to composite ratings of nursing home quality. American Journal of Health Economics,
5(2), 165–190. https://doi.org/10.1162/ajhe_a_00115
64.
RyskinaK. L.KonetzkaR. T.WernerR. M. (2018).
Association between 5-star nursing home report card ratings and potentially preventable hospitalizations. INQUIRY: The Journal of Health Care Organization, Provision, and Financing. Advance online publication. https://doi.org/10.1177/0046958018787323
65.
SalibaD.WeimerD. L.ShiY.MukamelD. B. (2018).
Examination of the New Short-Stay Nursing Home Quality Measures: Rehospitalizations, Emergency Department Visits, and Successful Returns to the Community. INQUIRY: The Journal of Health Care Organization, Provision, and Financing. Advance online publication. https://doi.org/10.1177/0046958018786816
66.
SchapiraM. M.SheaJ. A.DueyK. A.KleimanC.WernerR. M. (2016).
The Nursing Home Compare report card: Perceptions of residents and caregivers regarding quality ratings and nursing home choice. Health Services Research,
51(Suppl. 2), 1212–1228. https://doi.org/10.1111/1475-6773.12458
67.
SharmaH.KonetzkaR. T.SmieliauskasF. (2017).
The relationship between reported staffing and expenditures in nursing homes. Medical Care Research and Review,
76(6), 758–783. https://doi.org/10.1177/1077558717739214
68.
SharmaH.PerraillonM. C.WernerR. M.GrabowskiD. C.KonetzkaR. T. (2019).
Medicaid and nursing home choice: Why do duals end up in low-quality facilities?Journal of Applied Gerontology. Advance online publication. https://doi.org/10.1177/0733464819838447
69.
SnyderD. J.KroshusT. R.KeswaniA.GardenE. B.KoenigK. M.BozicK. J.JevsevarD. S.PoeranJ.MouchaC. S. (2019).
Are Medicare’s nursing home compare ratings accurate predictors of 90-day complications, readmission, and bundle cost for patients undergoing primary total joint arthroplasty?Journal of Arthroplasty,
34(4), 613–618. https://doi.org/10.1016/j.arth.2018.12.002
70.
StevensonD. G. (2006).
Is a public reporting approach appropriate for nursing home care?Journal of Health Politics, Policy and Law,
31(4), 773–810. https://doi.org/10.1215/03616878-2006-003
TottenA.WagnerJ.TiwariA.O’HaireC.GriffinJ.WalkerM. (2012). Closing the quality gap: Revisiting the state of the science (Vol. 5: Public reporting as a quality improvement strategy). https://pubmed.ncbi.nlm.nih.gov/24422977/
74.
UnroeK. T.GreinerM. A.Colon-EmericC.PetersonE. D.CurtisL. H. (2012).
Associations between published quality ratings of skilled nursing facilities and outcomes of Medicare beneficiaries with heart failure. Journal of Post-Acute and Long-Term Care Medicine,
13(2), 188.e1–188.e6. https://doi.org/10.1016/j.jamda.2011.04.020
75.
VukovicV.ParenteP.CampanellaP.SulejmaniA.RicciardiW.SpecchiaM. L. (2017).
Does public reporting influence quality, patient and provider’s perspective, market share and disparities? A review. European Journal of Public Health,
27(6), 972–978. https://doi.org/10.1093/eurpub/ckx145
76.
WeimerD. L.SalibaD.LaddH.ShiY.MukamelD. B. (2019).
Using contingent valuation to develop consumer-based weights for health quality report cards. Health Services Research,
54(4), 947–956. https://doi.org/10.1111/1475-6773.13155
77.
WernerR.StuartE.PolskyD. (2010).
Public reporting drove quality gains at nursing homes. Health Affairs (Millwood),
29(9), 1706–1713. https://doi.org/10.1377/hlthaff.2009.0556
78.
WernerR. M.AschD. A. (2005).
The unintended consequences of publicly reporting quality information. Journal of the American Medical Association,
293(10), 1239–1244.
79.
WernerR. M.KonetzkaR. T.KimM. M. (2013).
Quality improvement under nursing home compare: The association between changes in process and outcome measures. Medical Care,
51(7), 582–588. https://doi.org/10.1097/MLR.0b013e31828dbae4
80.
WernerR. M.KonetzkaR. T.KruseG. B. (2009).
Impact of public reporting on unreported quality of care. Health Services Research,
44(2 Pt 1), 379–398. https://doi.org/10.1111/j.1475-6773.2008.00915.x
81.
WernerR. M.KonetzkaR. T.PolskyD. (2016).
Changes in consumer demand following public reporting of summary quality ratings: An evaluation in nursing homes. Health Services Research,
51(Suppl. 2), 1291–1309. https://doi.org/10.1111/1475-6773.12459
82.
WernerR. M.KonetzkaR. T.StuartE. A.NortonE. C.PolskyD.ParkJ. (2009).
Impact of public reporting on quality of postacute care. Health Services Research,
44(4), 1169–1187. https://doi.org/10.1111/j.1475-6773.2009.00967.x
83.
WernerR. M.KonetzkaR. T.StuartE. A.PolskyD. (2011). Changes in patient sorting to nursing homes under public reporting: Improved patient matching or provider gaming?Health Services Research,
46(2), 555–571. https://doi.org/10.1111/j.1475-6773.2010.01205.x
84.
WernerR. M.NortonE. C.KonetzkaR. T.PolskyD. (2012).
Do consumers respond to publicly reported quality information? Evidence from nursing homes. Journal of Health Economics,
31(1), 50–61. https://doi.org/10.1016/j.jhealeco.2012.01.001
85.
WilliamsA.StrakerJ. K.ApplebaumR. (2016).
The nursing home five star rating: How Does it compare to resident and family views of care?The Gerontologist,
56(2), 234–242. https://doi.org/10.1093/geront/gnu043
86.
XuD.KaneR.ArlingG. (2019).
Relationship between nursing home quality indicators and potentially preventable hospitalisation. BMJ Quality & Safety,
28(7), 524–533. https://doi.org/10.1136/bmjqs-2018-008924
87.
ZimmermanD.KaronS. L.ArlingG.ClarkB.CollinsT.RossR.SainfortF. (1995).
Development and Testing of Nursing Home Quality Indicators. Health Care Financing Review,
16(4), 107–127.
88.
ZinnJ.SpectorW.HsiehL.MukamelD. B. (2005).
Do trends in the reporting of quality measures on the nursing home compare web site differ by nursing home characteristics? TheGerontologist,
45(6), 720–730. https://doi.org/10.1093/geront/45.6.720
89.
ZinnJ. S.SpectorW. D.WeimerD. L.MukamelD. B. (2008).
Strategic orientation and nursing home response to public reporting of quality measures: An application of the miles and snow typology. Health Services Research,
43(2), 598–615. https://doi.org/10.1111/j.1475-6773.2007.00781.x
90.
ZinnJ. S.WeimerD. L.SpectorW.MukamelD. B. (2010).
Factors influencing nursing home response to quality measure publication: A resource dependence perspective. Health Care Management Review,
35(3), 256–265. https://doi.org/10.1097/HMR.0b013e3181e23d64
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
