The difficulties of conducting randomized trials to evaluate community-based initiatives have led some researchers to argue in favor of a case study “logic model” approach to evaluation. This article describes a case study logic approach adopted for the evaluation of one community initiative, the Health Improvement Initiative (HII) funded by the California Wellness Foundation (TCWF). The HII is a comprehensive, community-based initiative designed to improve population health by implementing and sustaining community-level systems changes. Nine communities received funding to create broad-based community coalitions (Health Partnerships) that were charged with developing and implementing action plans around systems change. The HII is being evaluated using a case-study logic-model approach that uses quantitative and qualitative data to construct indicators of coalition functioning, systems changes, and population health. By examining the relationship between these indicators over time, it should be possible to determine if any changes in intermediate or long-term outcomes are associated with Health Partnership activities.
Get full access to this article
View all access options for this article.
References
1.
Annie E. Casey Foundation. (1998). Evaluating comprehensive community change. Baltimore: Author.
2.
Campbell, D.T. (1979). “Degrees of freedom” and the case study. In T.D. Cook & C.S. Reichardt (Eds.), Qualitative and quantitative methods in evaluation research (pp. 49-67). Beverly Hills, CA: Sage.
3.
Campbell, D., & Stanley, J. (1963). Experimental and quasi-experimental designs for research. Boston: Houghton Mifflin.
4.
Carleton, R.A., Lasater, T.M., Assaf, A.R., Feldman, H.A., & McKinlay, S. (1995). The Pawtucket Heart Health Program: Community changes in cardiovascular risk factors and projected disease risk. American Journal of Public Health, 85, 777-785.
5.
COMMIT Research Group. (1995a). Community intervention trial for smoking cessation (COMMIT): I. Cohort results from a four-year community intervention. American Journal of Public Health, 85, 183-192.
6.
COMMIT Research Group. (1995b). Community intervention trial for smoking cessation (COMMIT): II. Changes in adult cigarette smoking prevalence. American Journal of Public Health, 85, 193-200.
7.
El-Askari, G., Freestone, J., Irizarry, C., Kraut, K.L., Mashiyama, S.T., Morgan, M.A., & Walton, S. (1998). The healthy neighborhoods project: A local health department’s role in catalyzing community development. Health Education and Behavior, 25(2), 146-159.
8.
Farquhar, J.W., Fortman, S.P., Flora, J.A., Taylor, C.B., Haskell, W.L., Williams, P.T., Maccoby, N., & Wood, P.D. (1990). Effects of community-wide education on cardiovascular disease risk factors: The Stanford five-city project. Journal of the American Medical Association, 264, 359-365.
9.
Julian, D. (1997). The utilization of the logic model as a system level planning and evaluation device. Evaluation and Program Planning, 20, 251-257.
10.
Koepsell, T.D., Martin, D.M., Diehr, P.K., Psaty, B.M., Wagner, E.H., Perrin, E.B., & Cheadle, A. (1991). Data analysis and sample size issues in evaluation of community-based health promotion and disease prevention programs: A mixed-model analysis of variance approach. Journal of Clinical Epidemiology, 44, 701-713.
11.
Koepsell, T.D., Wagner, E.H., Cheadle, A.C., Patrick, D.C., Kristal, A.R., Allan-Andrilla, C.H., Dey, L.J., Martin, D.C., Diehr, P.H., & Perrin, E.B. (1992). Selected methodological issues in evaluating community-based health promotion and disease prevention programs. Annual Review of Public Health, 13, 31-57.
12.
Kubisch, A.C., Fulbright-Anderson, K., & Connell, J.P. (1998). Evaluating community-based initiatives: A progress report. In K. Fulbright-Anderson, A.C. Kubisch & J.P. Connell (Eds.), New approaches to evaluating community initiatives. Retrieved from http://www.aspenroundtable.org/vol2/
13.
Lefebvre, R.C., Kasater, T.M., Carleton, R.A., & Peterson, G. (1987). Theory and delivery of health programming in the community: The Pawtucket Heart Health Program. Preventative Medicine, 16, 80-95.
14.
Luepker, R.V., Rastam, L., Hannan, P.J., Murray, D.M., Gray, C., Baker, W.L., Crow, R., Jacobs, D.R., Pirie P.L., Mascioli, S.R., Mittlemark, M.B., & Blackburn, H. (1996). Community education for cardiovascular disease prevention. Morbidity and mortality results from the Minnesota Heart Health Program. American Journal of Epidemiology, 144, 351-362.
15.
National Association of County and City Health Officials. (2001). Advancing community public health systems in the 21st century (The Turning Point Initiative, sponsored by the W.K. Kellogg and Robert Wood Johnson Foundations). Washington, DC: Author.
16.
The National Community Care Network Demonstration Program (CCN). (1995, April.). Chicago, IL: Hospital Research and Educational Trust.
17.
Norris, T., & Pittman, M. (2000). The healthy communities movement and the coalition for healthier cities and communities. Public Health Reports, 115, 118-124.
18.
QSR. (1997). NUDIST. Software for Qualitative Data Analysis (Rev 4) [Computer software]. Scolari: Thousand Oaks, CA.
19.
Tarlow, A.R., Kehrer, B.H., Hall, D.P., Sammuels, S.E., Brown, G.S., Felix, M.R., & Ross, J.A. (1987). Foundation work: The health promotion program on the Henry J. Kaiser Family Foundation. American Journal of Health Promotion, 2, 74-80.
20.
Wagner, E.H., Koepsell, T.D., Anderman, C.A., Cheadle, A., Curry, S.J., Psaty, B.M., Wickizer, T.M., Beery, W.L., Diehr, P.K., Ehreth, J.L., Kehrer, B.H., Pearson, D.C., & Perrin, E.B. (1991). The evaluation of the Henry J. Kaiser Family Foundation’s Community Health Promotion Grant Program: Design. Journal of Clinical Epidemiology, 44, 685-699.
21.
Wagner, E.H., Wickizer, T.M., Cheadle, A., Psaty, B.M., Koepsell, T.D., Diehr, P., Curry, S.J., Von Korff, M., Anderman, C., Beery, W.L., & Perrin, E.B. (2000). The community health promotion grants program in the West II: Changes in attitudes, environments and behaviors. Health Services Research, 35, 561-589.
22.
Wallerstein, N. (1999). Power between evaluator and community research relationships within New Mexico’s healthier communities. Social Science and Medicine, 49, 39-53.
23.
Yin, R.K. (1994). Case study research: Design and methods (Applied Social Research Methods Series). Thousand Oaks, CA: Sage.
