Collective impact (CI) initiatives provide a promising collaborative community-based approach for addressing health disparities, but they are challenging to evaluate. This paper provides a detailed strategy for addressing these challenges through a case study, with the goal of not only of evaluating the CI, but also putting organizations in a position to implement and maintain sustainable self-evaluation efforts over time. A three-phase evaluation strategy was developed and implemented via a community-academic partnership to assess the impact of the CI. Process and outcome data from a CI to address health disparities in a Chicago community were collected and analyzed. The evaluation strategy, following the developmental, formative, and summative phases, helped a CI overcome barriers and build capacity for ongoing evaluative work for its members. Considering the flexible, low-technology approach, this strategy is a valuable resource in assisting individuals seeking to create a successful and sustainable CI evaluation.
BakerE. A.Teaser-PolkC. (1998). Measuring community capacity: Where do we go from here?Health Education & Behavior, 25(3), 279–283. https://doi.org/10.1177/109019819802500304
2.
BrownP. (1995). The role of the evaluator in comprehensive community initiatives. In ConnellJ. P.KubischA. C.SchorrL. B.WeissC. H. (Eds.), New approaches to evaluating community initiatives: Concepts, methods, and contexts (pp. 127–172). Aspen Institute.
3.
CabajM. (2014). Evaluating collective impact: Five simple rules. The Philanthropist, 26(1), 1–16.
4.
ChavisD.LeeK.JonesE. (2001). Principles for Evaluating Comprehensive Community Initiatives. Washington, DC: National Funding Collaborative on Violence Prevention.
5.
ChenH. T. (2010). The bottom-up approach to integrative validity: A new perspective for program evaluation. Evaluation and Program Planning, 33(3), 205–214. https://doi.org/10.1016/j.evalprogplan.2009.10.002
6.
CornJ. O.ByromE.KnestisK.MatzenN.ThriftB. (2012). Lessons learned about collaborative evaluation using the capacity for applying project evaluation (CAPE) framework with school and district leaders. Evaluation and Program Planning, 35(4), 535–542. https://doi.org/10.1016/j.evalprogplan.2011.12.008
7.
FawcettS. B.Paine-AndrewsA.FranciscoV. T.SchultzJ. A.RichterK. P.LewisR. K., … LopezC. M. (1995). Using empowerment theory in collaborative partnership for community health and development. American Journal of Community Psychology, 23(5), 677–697. https://doi.org/10.1007/BF02506987
8.
GoodmanR. M.WandersmanA.ChinmanM.ImmP.MorrisseyE. (1996). An ecological assessment of community-based interventions for prevention and health promotion: Approaches to measuring community coalitions. American Journal of Community Psychology, 24(1), 33–61. https://doi.org/10.1007/BF02511882
9.
GrannerM. L.SharpeP. A. (2004). Evaluating community coalition characteristics and functioning: A summary of measurement tools. Health Education Research, 19(5), 514–532. https://doi.org/10.1093/her/cyg056
10.
GuptaR. S.BallesterosJ.SpringstonE. E.SmithB.MartinM.WangE.DamitzM. (2010). The state of pediatric asthma in Chicago's humboldt park: A community-based study in two local elementary schools. BMC pediatrics, 10(1), 1–10. https://doi.org/10.1186/1471-2431-10-45
11.
IsraelB. A.SchulzA. J.ParkerE. A.BeckerA. B. (1998). Review of community-based research: Assessing partnership approaches to improve public health. Annual Review of Public Health, 19(1), 173–202. https://doi.org/10.1146/annurev.publhealth.19.1.173
KreuterM. W.LezinN. A.YoungL. A. (2000). Evaluating community-based collaborative mechanisms: Implications for practitioners. Health Promotion Practice, 1(1), 49–63. https://doi.org/10.1177/152483990000100109
16.
LandersG.PriceK.MinyardK. (2018). Developmental evaluation of a collective impact initiative: Insights for foundations. The Foundation Review, 10(2), 10. https://doi.org/10.9707/1944-5660.1417
17.
LiM.YuanF. (2022). Historical redlining and food environments: A study of 102 urban areas in the United States. Health & Place, 75(102775), 1–10. https://doi.org/10.1016/j.healthplace.2022.102775.
18.
MilsteinB.WetterhallS. A. (2005). A framework featuring steps and standards for program evaluation. Health Promotion Practice, 1(3), 221–228. https://doi.org/10.1177/152483990000100304
19.
MinklerM. (2004). Ethical challenges for the “outside” researcher in community-based participatory research. Health Education & Behavior, 31(6), 684–697. https://doi.org/10.1177/1090198104269566
20.
MujahidM. S.GaoX.TabbL. P.MorrisC.LewisT. T. (2021). Historical redlining and cardiovascular health: The multi-ethnic study of atherosclerosis. Proceedings of the National Academy of Sciences, 118(51), e2110986118. https://doi.org/10.1073/pnas.2110986118
21.
PanjwaniS.Graves-BoswellT.GarneyW. R.MuraleetharanD.SpadineM.FloresS. (2023). Evaluating collective impact initiatives: A systematic scoping review. American Journal of Evaluation, 44(3), 406–423. https://doi.org/10.1177/10982140221130266
RaderstrongJ.Boyea-RobinsonT. (2016). The why and how of working with communities through collective impact. Community Development, 47(2), 181–193. https://doi.org/10.1080/15575330.2015.1130072
24.
RossenL. M.TalihM. (2014). Social determinants of disparities in weight among US children and adolescents. Annals of Epidemiology, 24(10), 705–713. https://doi.org/10.1016/j.annepidem.2014.07.010
25.
The Chicago Community Trust Staff. (2017). Community Health Counts: Sinai Community Health Survey 2.0. Chicago, IL: Sinai Health System.
26.
ThorntonR. L.GloverC. M.CenéC. W.GlikD. C.HendersonJ. A.WilliamsD. R. (2016). Evaluating strategies for reducing health disparities by addressing the social determinants of health. Health Affairs, 35(8), 1416–1423. https://doi.org/10.1377/hlthaff.2015.1357
UyedaK.BogartL. M.Hawes-DawsonJ.SchusterM. A. (2009). Development and implementation of a school-based obesity prevention intervention: Lessons learned from community-based participatory research. Progress in Community Health Partnerships: Research, Education, and Action, 3(3), 249–255. https://doi.org/10.1353/cpr.0.0085
29.
WandersmanA.ImmP.ChinmanM.KaftarianS. (2000). Getting to outcomes: A results-based approach to accountability. Evaluation and Program Planning, 23(3), 389–395. https://doi.org/10.1016/S0149-7189(00)00028-8
30.
WellsK. B.StauntonA.NorrisK. C.BluthenthalR.ChungB.GelbergL., … WongM. (2006). Building an academic-community partnered network for clinical services research: The community health improvement collaborative (CHIC). Ethnicity and Disease, 16(1), S3–17. http://www.jstor.org/stable/48666968
31.
WolffT. (2003). A practical approach to evaluation of collaborations. In T. E. Backer (Ed.), Evaluating community collaborations (pp. 57–112). Springer.
