Impact of Accountable Care Organizations on Utilization,Care,and Outcomes: A Systematic Review

Abstract

Since 2010, more than 900 accountable care organizations (ACOs) have formed payment contracts with public and private insurers in the United States; however, there has not been a systematic evaluation of the evidence studying impacts of ACOs on care and outcomes across payer types. This review evaluates the quality of evidence regarding the association of public and private ACOs with health service use, processes, and outcomes of care. The 42 articles identified studied ACO contracts with Medicare (N = 24 articles), Medicaid (N = 5), commercial (N = 11), and all payers (N = 2). The most consistent associations between ACO implementation and outcomes across payer types were reduced inpatient use, reduced emergency department visits, and improved measures of preventive care and chronic disease management. The seven studies evaluating patient experience or clinical outcomes of care showed no evidence that ACOs worsen outcomes of care; however, the impact on patient care and outcomes should continue to be monitored.

Keywords

accountable care quality of care clinical outcomes Medicare Shared Savings alternative payment models

Get full access to this article

View all access options for this article.

References

Ackerman

(2006). Evaluating statewide disease management programs. Rockville, MD: AHRQ Medicaid Care, Management Learning Network.

Barry

C. L.

Stuart

E. A.

Donohue

J. M.

Greenfield

S. F.

Kouri

Duckworth

. . . Huskamp

H. A.

(2015). The early impact of the “Alternative Quality Contract” on mental health service use and spending in Massachusetts. Health Affairs, 34, 2077-2085. doi:10.1377/hlthaff.2015.0685

Berenson

R. A.

Burton

R. A.

McGrath

(2016). Do accountable care organizations (ACOs) help or hinder primary care physicians’ ability to deliver high-quality care? Healthcare (Amsterdam), 4, 155-159. doi:10.1016/j.hjdsi.2016.02.011

Brennan

Gaus

(2016). ACOs at a crossroads: Costs, risk and MACRA. Washington, DC: National Association of ACOs.

Burwell

S. M.

(2015). Setting value-based payment goals—HHS efforts to improve U.S. health care. New England Journal of Medicine, 372, 897-899.

Busch

A. B.

Huskamp

H. A.

McWilliams

J. M.

(2016). Early efforts by Medicare accountable care organizations have limited effect on mental illness care and management. Health Affairs, 35, 1247-1256. doi:10.1377/hlthaff.2015.1669

Center for Healthcare Strategies Inc. (2017) “Medicaid Accountable Care Organizations: State Update Fact Sheet.” accessed June 8. https://www.chcs.org/resource/medicaid-accountable-care-organizations-state-update/.

Chernew

M. E.

Mechanic

R. E.

Landon

B. E.

Safran

D. G.

(2011). Private-payer innovation in Massachusetts: The ‘alternative quality contract’. Health Affairs, 30, 51-61.

Chien

A. T.

Schiavoni

K. H.

Sprecher

Landon

B. E.

McNeil

B. J.

Chernew

M. E.

Schuster

M. A.

(2016). How accountable care organizations responded to pediatric incentives in the Alternative Quality Contract. Academic Pediatrics, 16, 200-207. doi:10.1016/j.acap.2015.10.008

10.

Chien

A. T.

Song

Chernew

M. E.

Landon

B. E.

McNeil

B. J.

Safran

D. G.

Schuster

M. A.

(2014). Two-year impact of the Alternative Quality Contract on pediatric health care quality and spending. Pediatrics, 133, 96-104. doi:10.1542/peds.2012-3440

11.

Christensen

E. W.

Payne

N. R.

(2016a). Effect of attribution length on the use and cost of health care for a pediatric Medicaid accountable care organization. JAMA Pediatrics, 170, 148-154. doi:10.1001/jamapediatrics.2015.3446

12.

Christensen

E. W.

Payne

N. R.

(2016b). Pediatric inpatient readmissions in an accountable care organization. Journal of Pediatrics, 170, 113-119. doi:10.1016/j.jpeds.2015.11.022

13.

Chukmaitov

Harless

D. W.

Bazzoli

G. J.

Carretta

H. J.

Siangphoe

(2015). Delivery system characteristics and their association with quality and costs of care: Implications for accountable care organizations. Health Care Management Review, 40, 92-103. doi:10.1097/hmr.0000000000000014

14.

Claffey

T. F.

Agostini

J. V.

Collet

E. N.

Reisman

Krakauer

(2012). Payer-provider collaboration in accountable care reduced use and improved quality in Maine Medicare Advantage plan. Health Affairs, 31, 2074-2083. doi:10.1377/hlthaff.2011.1141

15.

Colla

C. H.

Goodney

P. P.

Lewis

V. A.

Nallamothu

B. K.

Gottlieb

D. J.

Meara

(2014). Implementation of a pilot accountable care organization payment model and the use of discretionary and nondiscretionary cardiovascular care. Circulation, 130, 1954-1961. doi:10.1161/circulationaha.114.011470

16.

Colla

C. H.

Lewis

V. A.

Gottlieb

D. J.

Fisher

E. S.

(2013). Cancer spending and accountable care organizations: Evidence from the Physician Group Practice Demonstration. Healthcare (Amsterdam), 1, 100-107. doi:10.1016/j.hjdsi.2013.05.005

17.

Colla

C. H.

Lewis

V. A.

Kao

L. S.

O’Malley

A. J.

Chang

C. H.

Fisher

E. S.

(2016). Association between Medicare accountable care organization implementation and spending among clinically vulnerable beneficiaries. JAMA Internal Medicine, 176, 1167-1175. doi:10.1001/jamainternmed.2016.2827

18.

Colla

C. H.

Wennberg

D. E.

Meara

Skinner

J. S.

Gottlieb

Lewis

V. A.

. . . Fisher

E. S.

(2012). Spending differences associated with the Medicare Physician Group Practice Demonstration. JAMA Journal of the American Medical Association, 308, 1015-1023. doi:10.1001/2012.jama.10812

19.

Felt-Lisk

Gimm

Peterson

(2007). Making pay-for-performance work in Medicaid. Health Affairs, 26, w516-w527.

20.

Fisher

E. S.

Shortell

S. M.

Kreindler

S. A.

Van Citters

A. D.

Larson

B. K.

(2012). A framework for evaluating the formation, implementation, and performance of accountable care organizations. Health Affairs, 31, 2368-2378.

21.

Flodgren

Eccles

M. P.

Shepperd

Scott

Parmelli

Beyer

F. R.

(2011). An overview of reviews evaluating the effectiveness of financial incentives in changing healthcare professional behaviours and patient outcomes. Cochrane Database of Systematic Reviews, 7, CD009255. doi:10.1002/14651858.CD009255

22.

Fullerton

C. A.

Henke

R. M.

Crable

Hohlbauch

Cummings

(2016). The impact of Medicare ACOs on improving integration and coordination of physical and behavioral health care. Health Affairs, 35, 1257-1265. doi:10.1377/hlthaff.2016.0019

23.

Geyer

B. C.

Peak

D. A.

Velmahos

G. C.

Gates

J. D.

Michaud

Petrovick

. . . Raja

A. S.

(2016). Cost savings associated with transfer of trauma patients within an accountable care organization. American Journal of Emergency Medicine, 34, 455-458. doi:10.1016/j.ajem.2015.11.067

24.

Gilmore

A. S.

Zhao

Kang

Ryskina

K. L.

Legorreta

A. P.

Taira

D. A.

Chung

R. S.

(2007). Patient outcomes and evidence-based medicine in a preferred provider organization setting: A six-year evaluation of a physician pay-for-performance program. Health Services Research, 42(6 Pt. 1), 2140-2159.

25.

Green

(2016a). Advance payment ACO final report. In Evaluation of CMMI Accountable Care Organizations Initiative. Washington, DC: L&M Policy Research.

26.

Green

(2016b). Pioneer ACO final report. In Evaluation of CMMI Accountable Care Organization Initiatives. Washington, DC: L&M Policy Research.

27.

Haun

Woods

Shachak

Heyworth

Clark

Marcello

T. B.

. . . Simon

S. R.

(2013). Aligning medication reconciliation and secure messaging: Qualitative study of primary care providers’ perspectives. Journal of Medical Internet Research, 15(2), e264. doi:10.2196/jmir.2793

28.

Hefner

J. L.

Hilligoss

Sieck

Walker

D. M.

Sova

Song

P. H.

McAlearney

A. S.

(2016). Meaningful engagement of ACOs with communities: The new population health management. Medical Care, 54, 970-976. doi:10.1097/mlr.0000000000000622

29.

Herrel

L. A.

Norton

E. C.

Hawken

S. R.

Hollenbeck

B. K.

Miller

D. C.

(2016). Early impact of Medicare accountable care organizations on cancer surgery outcomes. Cancer, 122, 2739-2746. doi:10.1002/cncr.30111

30.

Hewner

Casucci

Castner

(2016). The roles of chronic disease complexity, health system integration, and care management in post-discharge healthcare utilization in a low-income population. Research in Nursing & Health, 39, 215-228. doi:10.1002/nur.21731

31.

Allen

T. K.

Kim

Keenan

W. P.

Ku-Goto

M. H.

Sanderson

(2016). Measuring the cost implications of the Collaborative Accountable Care initiative in Texas. American Journal of Managed Care, 22, e304-e310.

32.

Huskamp

H. A.

Greenfield

S. F.

Stuart

E. A.

Donohue

J. M.

Duckworth

Kouri

E. M.

. . . Barry

C. L.

(2016). Effects of global payment and accountable care on tobacco cessation service use: An observational study. Journal of General Internal Medicine, 31, 1134-1140. doi:10.1007/s11606-016-3718-y

33.

Jha

A. K.

Joynt

K. E.

Orav

E. J.

Epstein

A. M.

(2012). The long-term effect of premier pay for performance on patient outcomes. New England Journal of Medicine, 366, 1606-1615.

34.

Kautter

Pope

G. C.

Leung

Trisolini

Adamache

Smith

. . . Schwartz

(2012, September). Evaluation of the Medicare Physician Group Practice Demonstration: Final Report. Research Triangle Park, NC: RTI International.

35.

Kelleher

K. J.

Cooper

Deans

Carr

Brilli

R. J.

Allen

Gardner

(2015). Cost saving and quality of care in a pediatric accountable care organization. Pediatrics, 135, e582-e589. doi:10.1542/peds.2014-2725

36.

King

B. J.

Gilmore-Bykovskyi

A. L.

Roiland

R. A.

Polnaszek

B. E.

Bowers

B. J.

Kind

A. J.

(2013). The consequences of poor communication during transitions from hospital to skilled nursing facility: A qualitative study. Journal of American Geriatrics Society, 61, 1095-1102. doi:10.1111/jgs.12328

37.

Kocot

S. L.

Dang-Vu

White

McClellan

(2013). Early experiences with accountable care in Medicaid: Special challenges, big opportunities. Population Health Management, 16(Suppl. 1), S4-S11.

38.

Lewis

V. A.

Colla

C. H.

Schpero

W. L.

Shortell

S. M.

Fisher

E. S.

(2014). ACO contracting with private and public payers: A baseline comparative analysis. American Journal of Managed Care, 20, 1008-1014.

39.

Lewis

V. A.

Schoenherr

Fraze

Cunningham

(2016). Clinical coordination in accountable care organizations: A qualitative study. Health Care Management Review. doi:10.1097/hmr.0000000000000141

40.

Lewis

V. A.

Tierney

K. I.

Fraze

Murray

G. F.

(2019). Care transformation strategies and approaches of accountable care organizations. Medical Care Research and Review, 73(3), 291-341.

41.

Lin

Yin

Huang

(2016). Impact of pay for performance on behavior of primary care physicians and patient outcomes. Journal of Evidence-Based Medicine, 9, 8-23.

42.

Marcoux

R. M.

Larrat

E. P.

Vogenberg

F. R.

(2012). Accountable care organizations: An improvement over HMOs? P & T Pharmacy and Therapeutics, 37, 629-650.

43.

Marmor

Oberlander

(2012). From HMOs to ACOs: The quest for the Holy Grail in U.S. health policy. Journal of General Internal Medicine, 27, 1215-1218.

44.

McClellan

Kent

Beales

S. J.

Cohen

S. I.

Macdonnell

Thoumi

. . . Darzi

(2014). Accountable care around the world: A framework to guide reform strategies. Health Affairs, 33, 1507-1515.

45.

McClellan

McKethan

A. N.

Lewis

J. L.

Roski

Fisher

E. S.

(2010). A national strategy to put accountable care into practice. Health Affairs, 29, 982-990.

46.

McClellan

Saunders

(2017). Growth of ACOs and alternative payment models in 2017. Health Affairs Blog. Retrieved from http://www.healthaffairs.org/do/10.1377/hblog20170628.060719/full/

47.

McConnell

K. J.

Renfro

Chan

B. K.

Meath

T. H.

Mendelson

Cohen

. . . Lindrooth

R. C.

(2017). Early performance in Medicaid accountable care organizations: A comparison of Oregon and Colorado. JAMA Internal Medicine, 177, 538-545. doi:10.1001/jamainternmed.2016.9098

48.

McWilliams

J. M.

Chernew

M. E.

Landon

B. E.

Schwartz

A. L.

(2015). Performance differences in year 1 of pioneer accountable care organizations. New England Journal of Medicine, 372, 1927-1936. doi:10.1056/NEJMsa1414929

49.

McWilliams

J. M.

Gilstrap

L. G.

Stevenson

D. G.

Chernew

M. E.

Huskamp

H. A.

Grabowski

D. C.

(2017). Changes in postacute care in the Medicare Shared Savings Program. JAMA Internal Medicine, 177, 518-526. doi:10.1001/jamainternmed.2016.9115

50.

McWilliams

J. M.

Hatfield

L. A.

Chernew

M. E.

Landon

B. E.

Schwartz

A. L.

(2016). Early performance of accountable care organizations in Medicare. New England Journal of Medicine, 374, 2357-2366. doi:10.1056/NEJMsa1600142

51.

McWilliams

J. M.

Landon

B. E.

Chernew

M. E.

(2013). Changes in health care spending and quality for Medicare beneficiaries associated with a commercial ACO contract. JAMA Journal of the American medical Association, 310, 829-836. doi:10.1001/jama.2013.276302

52.

McWilliams

J. M.

Landon

B. E.

Chernew

M. E.

Zaslavsky

A. M.

(2014). Changes in patients’ experiences in Medicare accountable care organizations. New England Journal of Medicine, 371, 1715-1724. doi:10.1056/NEJMsa1406552

53.

Mendelson

Kondo

Damberg

Low

Motúapuaka

Freeman

. . . Kansagara

(2017). The effects of pay-for-performance programs on health, health care use, and processes of care: A systematic review. Annals of Internal Medicine, 166, 341-353.

54.

Miller

R. H.

Luft

H. S.

(2002). HMO plan performance update: An analysis of the literature, 1997-2001. Health Affairs, 21, 63-86.

55.

Muhlestein

Gardner

Caughey

de Lisle

(2015). Projected growth of accountable care organizations. Salt Lake City, UT: Leavitt Partners.

56.

Muhlestein

McClellan

(2016, April 21). Accountable care organizations in 2016: Private and public-sector growth and dispersion. Health Affairs Blog. Retrieved from http://healthaffairs.org/blog/2016/04/21/accountable-care-organizations-in-2016-private-and-public-sector-growth-and-dispersion/

57.

Muhlestein

de Lisle

Merrill

(2016). Hospital participation in ACOs associated with other value-based program improvement. American Journal of Managed Care, 22, e241-e248.

58.

Narayan

A. K.

Harvey

S. C.

Durand

D. J.

(2016). Impact of Medicare Shared Savings Program accountable care organizations at screening mammography: A retrospective cohort study. Radiology. doi:10.1148/radiol.2016160554

59.

Nyweide

D. J.

Lee

Cuerdon

T. T.

Pham

H. H.

Cox

Rajkumar

Conway

P. H.

(2015). Association of pioneer accountable care organizations vs traditional Medicare fee for service with spending, utilization, and patient experience. JAMA, 313, 2152-2161. doi:10.1001/jama.2015.4930

60.

Ouayogode

M. H.

Colla

C. H.

Lewis

V. A.

(2016). Determinants of success in shared savings programs: An analysis of ACO and market characteristics. Healthcare (Amsterdam). doi:10.1016/j.hjdsi.2016.08.002

61.

Peiris

Phipps-Taylor

M. C.

Stachowski

C. A.

Kao

L. S.

Shortell

S. M.

Lewis

V. A.

. . . Colla

C. H.

(2016). ACOs holding commercial contracts are larger and more efficient than noncommercial ACOs. Health Affairs, 35, 1849-1856. doi:10.1377/hlthaff.2016.0387

62.

Peterson

Muhlestein

(2014, May 30). ACO results: What we know so far. Health Affairs Blog. doi:10.1377/hblog20140530.039242

63.

Pope

Kautter

Leung

Trisolini

Adamache

Smith

(2014). Financial and quality impacts of the Medicare physician group practice demonstration. Medicare & Medicaid Research Review, 4(3). doi:10.5600/mmrr.004.03.a01

64.

Ramirez

A. G.

Tracci

M. C.

Stukenborg

G. J.

Turrentine

F. E.

Kozower

B. D.

Jones

R. S.

(2016). Physician-owned surgical hospitals outperform other hospitals in Medicare value-based purchasing program. Journal of the American College of Surgeons, 223, 559-567. doi:10.1016/j.jamcollsurg.2016.07.014

65.

Rosenthal

M. B.

Frank

R. G.

(2006). What is the empirical basis for paying for quality in health care? Medical Care Research and Review, 63, 135-157.

66.

Rosenthal

M. B.

Frank

R. G.

Epstein

A. M.

(2005). Early experience with pay-for-performance: from concept to practice. JAMA Journal of the American Medical Association, 294, 1788-1793.

67.

Rosenthal

M. B.

Landon

B. E.

Normand

S. L.

Frank

R. G.

Epstein

A. M.

(2006). Pay for performance in commercial HMOs. New England Journal of Medicine, 355, 1895-1902.

68.

Rosenthal

M. B.

Landrum

M. B.

Robbins

J. A.

Schneider

E. C.

(2016). Pay for performance in Medicaid: Evidence from three natural experiments. Health Services Research, 51, 1444-1466.

69.

Salmon

R. B.

Sanderson

M. I.

Walters

B. A.

Kennedy

Flores

R. C.

Muney

A. M.

(2012). A collaborative accountable care model in three practices showed promising early results on costs and quality of care. Health Affairs, 31, 2379-2387. doi:10.1377/hlthaff.2012.0354

70.

Schwartz

A. L.

Chernew

M. E.

Landon

B. E.

McWilliams

J. M.

(2015). Changes in low-value services in Year 1 of the Medicare pioneer accountable care organization program. JAMA Internal Medicine, 175, 1815-1825. doi:10.1001/jamainternmed.2015.4525

71.

D. A.

Mason

M. H.

(2012). Michigan’s Physician Group Incentive Program offers a regional model for incremental “fee for value” payment reform. Health Affairs, 31, 1993-2001. doi:10.1377/hlthaff.2012.0328

72.

Singh

Khosla

Sethi

(2015). Comparison of healthcare quality outcomes between accountable care organizations and physician group practices. Journal of Medical Practice Management, 30, 261-264.

73.

Song

Rose

Chernew

M. E.

Safran

D. G.

(2017). Lower-versus higher-income populations in the Alternative Quality Contract: Improved quality and similar spending. Health Affairs, 36, 74-82. doi:10.1377/hlthaff.2016.0682

74.

Song

Rose

Safran

D. G.

Landon

B. E.

Day

M. P.

Chernew

M. E.

(2014). Changes in health care spending and quality 4 years into global payment. New England Journal of Medicine, 371, 1704-1714. doi:10.1056/NEJMsa1404026.

75.

Song

Safran

D. G.

Landon

B. E.

Ellis

R. P.

Mechanic

R. E.

. . . Chernew

M. E.

(2011). Health care spending and quality in year 1 of the Alternative Quality Contract. New England Journal of Medicine, 365, 909-918. doi:10.1056/NEJMsa1101416

76.

Song

Safran

D. G.

Landon

B. E.

Landrum

M. B.

Mechanic

R. E.

. . . Chernew

M. E.

(2012). The “Alternative Quality Contract,” based on a global budget, lowered medical spending and improved quality. Health Affairs, 31, 1885-1894. doi:10.1377/hlthaff.2012.0327

77.

Stuart

E. A.

Barry

C. L.

Donohue

J. M.

Greenfield

S. F.

Duckworth

Song

. . . Huskamp

H. A.

(2016). Effects of accountable care and payment reform on substance use disorder treatment: Evidence from the initial 3 years of the Alternative Quality Contract. Addiction. doi:10.1111/add.13555

78.

Sutton

Nikolova

Boaden

Lester

McDonald

Roland

(2012). Reduced mortality with hospital pay for performance in England. New England Journal of Medicine, 367, 1821-1828.

79.

Taylor

E. F.

Lake

Nysenbaum

Peterson

Meyers

(2011). Coordinating care in the medical neighborhood: Critical components and available mechanisms. Rockville, MD: Mathematica Policy Research.

80.

U.S. Government Accountability Office. (2015). Results from the first two years of the pioneer accountable care organization model (Report to the Ranking Member, Committee on Ways and Means, House of Representatives). Washington, DC: Author.

81.

Wagner

E. H.

(1999). Care of older people with chronic illness. In Calkins

Boult

Wagner

E. H.

Pacala

J. T.

(Eds.), New ways to care for older people (pp. 39-64). New York, NY: Springer.

82.

Walker

D. M.

Mora

A. M.

McAlearney

A. S.

(2016). Accountable care organization hospitals differ in health IT capabilities. American Journal of Management Care, 22, 802-807.

83.

Weil

T. P.

2012a. “Accountable care organizations: HMOs by another name?” Journal of Family Practice 61(1):10.

84.

Weil

T. P.

(2012b). “Why are ACOs doomed for failure?” Journal of Medical Practice Management 27(5):263-7.

85.

Werner

R. M.

Konetzka

R. T.

Polsky

(2013). The effect of pay-for-performance in nursing homes: Evidence from state Medicaid programs. Health Services Research, 48, 1393-1414.

86.

Winblad

Mor

McHugh

J. P.

Rahman

(2017). ACO-affiliated hospitals reduced rehospitalizations from skilled nursing facilities faster than other hospitals. Health Affairs, 36, 67-73. doi:10.1377/hlthaff.2016.0759

87.

F. M.

Shortell

S. M.

Rundall

T. G.

Bloom

J. R.

(2017). The role of health information technology in advancing care management and coordination in accountable care organizations. Health Care Management Review, 42, 282-291. doi:10.1097/hmr.0000000000000123

88.

Zhang

Caines

K. J.

Powers

C. A.

(2017). Evaluating the effects of pioneer accountable care organizations on Medicare Part D drug spending and utilization. Medical Care. doi:10.1097/mlr.0000000000000686

89.

Zutshi

Peikes

Smith

Azur

Genevro

Parchman

Meyers

(2013). The medical home: What do we know, what do we need to know? A review of the earliest evidence on the effectiveness of the patient-centered medical home model. Rockville, MD: Mathematica Policy Research.