The authors’dual-purpose evaluation assesses the effectiveness of formal collaboratives in stimulating organizational changes to improve chronic illness care (the chronic care model or CCM). Intervention and comparison sites are compared before and after introduction of the CCM. Multiple data sources are used to measure the degree of implementation, patient-level processes and outcomes, and organizational and team factors associated with success. Despite challenges in timely recruitment of sites and patients, data collection on 37 participating organizations, 22 control sites, and more than 4,000 patients with diabetes, congestive heart failure, asthma, or depression is nearing completion. When analyzed, these data will shed new light on the effectiveness of collaborative improvement methods and the CCM.
Get full access to this article
View all access options for this article.
References
1.
Baker, R. 1996. Your experience in the breakthrough series: An assessment of the experience of collaborative participants in carrying out change in the IHI breakthrough series. Waits and Delays Post-Collaborative Survey. N.p.
2.
Berwick, D. M. 1989. Continuous improvement as an ideal in health care. New England Journal of Medicine320(1): 53-56.
3.
Berwick, D. M. 1996. Quality comes home. Annals of Internal Medicine125(10): 839-843.
4.
Berwick, D. M. 1998. Developing and testing changes in delivery of care. Annals of Internal Medicine128(8): 651-656.
5.
Bickman, L. 2000. Summing up program theory. In New directions for evaluation, no. 87, edited by P. Rogers, R. Hacsi, A. Petro, and T. Huebner, 103-112. San Francisco: Jossey-Bass.
6.
Bickman, L., E. W. Lambert, A. R. Andrade, and R. V. Penaloza. 2000. The Fort Bragg continuum of care for children and adolescents: Mental health outcomes over five years. Journal of Consulting and Clinical Psychology68(4): 710-716.
7.
Blumenthal, D., and C. M. Kilo. 1998. A report card on continuous quality improvement. Milbank Quarterly76(4): 625-648.
8.
Bonomi,A. E., E. H. Wagner, R. E. Glasgow, and M. Von Korff. 2002. Assessment of Chronic Illness Care (ACIC): A practical tool to measure quality improvement. Health Services Research37(3): 791-820.
9.
Brook, R. H., E. A. McGlynn, and P. D. Cleary. 1996. Measuring quality of care: Part 2 of 6. New England Journal of Medicine335(13): 966-970.
10.
Calkins, C. B., E. H. Wagner, and J. Pacala. 1999. New ways to care for older people: Building systems on evidence. New York: Springer.
11.
Cheadle, A., E. Wagner, C. Anderman, M. Walls, C. McBride, M. A. Bell, R. F. Catalano, and E. Pettigrew. 1998. Measuring community mobilization in the Seattle Minority Youth Health Project. Evaluation Review22(6): 699-716.
12.
Cochran, W. G. 1983. Planning and analysis of observational studies. New York: John Wiley.
13.
Cook,T. H.,and D. T. Campbell.1979. Quasi-experimentation. New York: Houghton Mifflin.
14.
Crofton, C., J. S. Lubalin, and C. Darby. 1999. Consumer Assessment of Health Plans Study (CAHPS). Foreword. Medical Care37(3 Suppl): MS1-9.
15.
Ferlie, E. B., and S. M. Shortell. 2001. Improving the quality of health care in the United Kingdom and the United States: A framework for change. Milbank Quarterly79(2): 281-315.
16.
Flamm, B. L., D. M. Berwick, and A. I. Kabcenell. 1998. Reducing cesarean section rates safely: Lessons from a breakthrough series collaborative. Birth25(2): 117-124.
17.
Gandek, B., J. E. Ware, N. K. Aaronson, G. Apolone, J. B. Bjorner, J. E. Brazier, M. Bullinger, S. Kaasa, A. Leplege, L. Prieto, and M. Sullivan. 1998. Cross-validation of item selection and scoring for the SF-12 health survey in nine countries: Results from the IQOLA project. International quality of life assessment. Journal of Clinical Epidemiology51(11): 1171-1178.
18.
Gordon,P. R., L. Carlson,A. Chessman,M. L. Kundrat,P. S. Morahan,and L. A. Headrick.1996. A multisite collaborative for the development of interdisciplinary education in continuous improvement for health professions students. Academic Medicine71(9): 973-978.
19.
Grol, R., and J. M. Grimshaw. 1999. Evidence-based implementation of evidence-based medicine. Joint Commission Journal on Quality Improvement25(10): 503-513.
20.
Harris, M. I. 2000. Health care and health status and outcomes for patients with Type 2 diabetes. Diabetes Care23(6): 754-758.
21.
Harris-Kojetin, L. D., F. J. Fowler Jr., J. A. Brown, J. A. Schnaier, and S. F. Sweeny. 1999. The use of cognitive testing to develop and evaluate CAHPS 1.0 core survey items. Consumer assessment of health plans study. Medical Care37(3 Suppl): MS10-21.
22.
Hays, R. D., J. A. Shaul, V. S. Williams, J. S. Lubalin, L. D. Harris-Kojetin,S.F.Sweeny,and P. D. Cleary. 1999. Psychometric properties of the CAHPS 1.0 survey measures. Consumer assessment of health plans study. Medical Care37(3 Suppl): MS22-MS31.
23.
Huq, Z., and T. N. Martin. 2000. Workforce cultural factors in TQM/CQI implementationin hospitals. Health Care Management Review25(3): 80-93.
24.
Institute for Health and Aging UCSF. 1996. Chronic care in America: A 21st century challenge. Princeton, NJ: Robert Wood Johnson Foundation.
25.
Jatulis, D. E., Y. Y. Meng, R. M. Elashoff, A. L. Schocket, R. M. Evans, A. G. Hasan, and A. P. Legorreta. 1998. Preventive pharmacologic therapy among asthmatics: Five years after publication of guidelines. Annals of Allergy, Asthma and Immunology81(1): 82-88.
26.
Jenkinson,C., R. Layte, D. Jenkinson,K. Lawrence, S. Petersen, C. Paice, and J. Stradling.1997. A shorter form health survey: Can the SF-12 replicate results from the SF-36 in longitudinal studies? Journal of Public Health and Medicine19(2): 179-186.
27.
Kilo, C. M. 1998. A framework for collaborative improvement: Lessons from the Institute for Healthcare Improvements breakthrough series. Quality Management in Health Care6(4): 1-13.
28.
Laffel, G., and D. Blumenthal.1989. The case for using industrial quality management science in healthcare organizations. Journal of the American Medical Association262(20):2869-2873.
29.
Langley, G. J., K. M. Nolan, T. W. Nolan, C. L. Norman, and L. P. Provost. 1996. The improvement guide: A practical approach to enhancing organizational performance. San Francisco: Jossey-Bass.
30.
Leape, L. L., A. I. Kabcenell, T. K. Gandhi, P. Carver, T. W. Nolan, and D. M. Berwick. 2000. Reducing adverse drug events: Lessons from a breakthrough series collaborative. Joint Commission Journal on Quality Improvement26(6): 321-331.
31.
Nelson, K., R. E. Garcia, J. Brown, C. M. Mangione, T. A. Louis, E. Keeler, and S. Cretin. 2002. Do patient consent procedures affect participation rates in health services research? Medical Care40(4): 283-288.
32.
OVretveit, J., P. Bate, P. Cleary, S. Cretin, D. Gustafson, K. McInnes, H. McLeod, T. Molfenter, P. Plsek, G. Robert, S. Shortell, and T. Wilson. 2002. Quality collaboratives: Lessons from research. Quality and Safety in Health Care11(4): 345-351.
33.
Renders, C. M., G. D. Valk, S. Griffin, E. H. Wagner, J. T. Eijk, and W. J. J. Assendelft. 2001. Interventionsto improve the management of diabetes mellitus in primary care, out patient and community settings (Cochrane Review). In Cochrane Library. Oxford, UK: Update Software.
34.
Rich, M. W. 1999. Heart failure disease management: A critical review. Journal of Cardiac Failure5(1): 64-75.
35.
Samsa, G., and D. Matchar. 2000. Can continuous quality improvement be assessed using randomized trials? Health Services Research35(3): 687-700.
36.
SAS Institute. 1999. SAS/STAT users guide, Version 8. Cary, NC: Author.
37.
Shaw, K. M., and E. Replogle.1996. Challengesin evaluatingschool-linked services. Evaluation Review20(4): 424-469.
38.
Shortell, S. M., C. L. Bennett, and G. R. Byck. 1998. Assessing the impact of continuous quality improvement on clinical practice: What it will take to accelerate progress. Milbank Quarterly76(4): 593-624.
39.
Shortell, S. M., J. L. O’Brien, J. M. Carman, R. W. Foster, E. F. X. Hughes, H. Boerstler, and E. J. OConnor. 1995. Assessing the impact of continuous quality improvement/total quality management: Concept versus implementation. Health Services Research30(2): 377-401.
40.
Solberg, L. I., T. E. Kottke, M. L. Brekke, S. Magnan, G. Davidson, C. A. Calomeni, S. A. Conn, G. M. Amundson,and A. F. Nelson. 2000. Failure of a continuousquality improvement intervention to increase the delivery of preventive services. A randomized trial. Effective Clinical Practice3(3): 105-115.
41.
Thorsen, T., and M. Makela, eds. 1999. Changing professional practice: Theory and practice of clinical guidelines implementation. Copenhagen: Institut for Sundhedsvasen (Danish Institute for Health Services Research and Development).
42.
Von Korff, M., J. Gruman, J. Schaefer, S. J. Curry, and E. H. Wagner. 1997. Collaborative management of chronic illness. Annals of Internal Medicine127(12): 1097-1102.
43.
Wagner, E. H. 1998. Chronic disease management: What will it take to improve care for chronic illness? Effective Clinical Practice1(1): 2-4.
44.
Wagner, E. H., B. T. Austin, C. Davis, M. Hindmarsh, J. Schaefer, and A. E. Bonomi. 2001. Improving chronic illness care: Translating evidence into action. Health Affairs (Millwood)20(6): 64-78.
45.
Wagner, E. H., B. T. Austin, and M. Von Korff. 1996. Organizing care for patients with chronic illness. Milbank Quarterly74(4): 511-544.
46.
Wagner, E. H., R. E. Glasgow, C. Davis, A. E. Bonomi, L. Provost, D. McCulloch, P. Carver, and C. Sixta. 2001. Quality improvement in chronic illness care: A collaborative approach. Joint Commission Journal on Quality Improvement27(2): 63-80.
47.
Weinberger, M., E. Z. Oddone, W. G. Henderson, D. M. Smith, J. Huey, A. Giobbie-Hurder, and J. R. Feussner. 2001. Multisite randomized controlled trials in health services research: Scientific challenges and operational issues. Medical Care39(6): 627-634.
48.
Whiting-O’Keefe, Q. E., C. Henke, and D. W. Simborg. 1984.Choosing the correct unit of analysis in medical care experiments. Medical Care22(12): 1101-1114.
49.
Whyte, W. F. 1991. Social theory for action: How individuals and organizations learn to change. Newbury Park, CA: Sage.
50.
Young, A. S., R. Klap, C. D. Sherbourne, and K. B. Wells. 2001. The quality of care for depressive and anxiety disorders in the United States. Archives of General Psychiatry58:55-61.
