This paper uses a reflective, retrospective case study methodology to analyze data from a 10-year University-Community partnership focused on supporting implementation and improvement of a Prenatal-Grade 3 (P3) system in an elementary school. Using a framework for centering equity in Collective Impact approaches, we analyze the steps we took as research partners/program evaluators to address racial and other inequities while highlighting missed opportunities to better center racial equity in the evaluation and P3 Initiative work. Through our analysis, we seek to identify where and how racial inequities surfaced, to describe how systemic racism influenced the evaluation and P3 Initiative process, and how this served to perpetuate the status quo and prevent transformative systems change. Results speak to opportunities for researchers, funders, and policymakers to identify and disrupt conventionally-accepted approaches to educational research and to work more effectively to advance educational equity for children and their families.
AcevedoN.SolorzanoD. G. (2023). An overview of community cultural wealth: Toward a protective factor against racism. Urban Education, 58, 1470–1488. https://doi.org/10.1177/00420859211016531
2.
AcreeJ.ChouinardJ. A. (2020). Exploring use and influence in culturally responsive approaches to evaluation: A review of the empirical literature. American Journal of Evaluation, 41(2), 201–215.
AlkinM. C.KingJ. A. (2016). The historical development of evaluation use. American Journal of Evaluation, 37(4), 568–579.
5.
ArchibaldT.NeubauerL. C.BrookfieldS. D. (2018). The critically reflective evaluator: Adult education’s contributions to evaluation for social justice. New Directions for Evaluation, 2018(158), 109–123.
6.
BogardK.TakanishiR. (2005). PK-3: An aligned and coordinated approach to education for children 3 to 8 years old. Social Policy Report/Society for Research in Child Development, 19(3), 1–24.
7.
BrunoE. P.IrukaI. U. (2022). Reexamining the Carolina Abecedarian project using an antiracist perspective: Implications for early care and education research. Early Childhood Research Quarterly, 58, 165–176.
8.
CastilloW.GillbornD. (2022). How to “QuantCrit:” Practices and questions for education data researchers and users (No. 22-546). Working Paper.
9.
CelesteL.BaysuG.PhaletK.MeeussenL.KendeJ. (2019). Can school diversity policies reduce belonging and achievement gaps between minority and majority youth? Multiculturalism, colorblindness, and assimilationism assessed. Personality and Social Psychology Bulletin, 45(11), 1603–1618.
10.
ChristensB. D.InzeoP. T. (2015). Widening the view: Situating collective impact among frameworks for community-led change. Community Development, 46(4), 420–435.
11.
CronbachL. J.AmbronS. R.DornbuschS. M.HessR. D.HornikR. C.PhillipsD. C.WalkerD. F.WeinerS. S. (1980). Toward reform of program evaluation (p. 3). Jossey-Bass.
Dean-CoffeyJ. (2018). What’s race got to do with it? Equity and philanthropic evaluation practice. American Journal of Evaluation, 39(4), 527–542.
14.
EnnisG.TofaM. (2020). Collective impact: A review of the peer-reviewed research. Australian Social Work, 73(1), 32–47.
15.
GalindoC.SandersM. (2019). Final thoughts: Working towards the sustainability of full-service community schools. Journal of Education for Students Placed at Risk, 24(3), 314–319.
16.
Gardner-NeblettN.IrukaI. U.HumphriesM. (2023). Dismantling the Black–White achievement gap paradigm: Why and how we need to focus instead on systemic change. Journal of Education, 203, 433–441. https://doi.org/10.1177/00220574211031958
17.
GatesE.DysonL. (2017). Implications of the changing conversation about causality for evaluators. American Journal of Evaluation, 38(1), 29–46.
18.
GatesE. F. (2017). Learning from seasoned evaluators: Implications of systems approaches for evaluation practice. Evaluation, 23(2), 152–171.
19.
GatesE. F.MadresJ.HallJ. N.AlvarezK. B. (2022). It takes an ecosystem: Socioecological factors influencing equity-oriented evaluation in New England, US, 2021. Evaluation and Program Planning, 92, 3–31.
20.
GillbornD. (2010). Reform, racism and the centrality of whiteness: Assessment, ability and the ‘new eugenics.’Irish Educational Studies, 29(3), 231–252.
21.
GillbornD.WarmingtonP.DemackS. (2018). QuantCrit: Education, policy, ‘Big Data’ and principles for a critical race theory of statistics. Race Ethnicity and Education, 21(2), 158–179.
22.
GonzalezR. (2020). Spectrum of family & community engagement for educational equity. Facilitating Power Institute. https://movementstrategy.org/resources
23.
GreenB. L.Hood-KothariB. (2012). Earl Boyles kindergarten readiness assessments: Results for school year 2011-2012. School of Social Work, Portland State University.
24.
GreenB. L.PattersonL. B. (2014). Early works at Earl Boyles: Year end report. School of Social Work, Portland State University.
25.
GreenB. L.PattersonL. B. (2015). Early works at Earl Boyles 2014-15 final report. School of Social Work, Portland State University.
26.
HallJ. N. (2020). The other side of inequality: Using standpoint theories to examine the privilege of the evaluation profession and individual evaluators. American Journal of Evaluation, 41(1), 20–33.
27.
HoodS.HopsonR.KirkhartK. (2015). Culturally responsive evaluation: Theory, practice, and future implications. In NewcomerK. E.HatryH. P.WholeyJ. S. (Eds.), Handbook of practical program evaluation (pp. 281–317). John Wiley & Sons.
28.
HopsonR. K. (2009). Reclaiming knowledge at the margins: Culturally responsive evaluation in the current evaluation moment. In RyanK. E.CousinsJ. B. (Eds.), The Sage international handbook of educational evaluation (pp. 429–446). Sage Publications.
29.
IrukaI. U.Gardner-NeblettN.TelferN. A.Ibekwe-OkaforN.CurentonS. M.SimsJ.SansburyA. B.NeblettE. W. (2022). Effects of racism on child development: Advancing antiracist developmental science. Annual Review of Developmental Psychology, 4, 109–132.
30.
IshimaruA. M. (2019). Just schools: Building equitable collaborations with families and communities. Teachers College Press.
31.
IzumiB. T.WilsonD. P. (2014). Community health and key informant surveys: Findings and recommendations. School of Community Health, Portland State University.
32.
KaniaJ.KramerM. (2011). Collective impact. Stanford Social Innovation Review, 9(1), 36–41.
33.
KaniaJ.WilliamsJ.SchmitzP.BradyS.KramerM.JusterJ. S. (2022). Centering equity in collective impact. Stanford Social Innovation Review, 20(1), 38–45.
34.
KauerzK.CoffmanJ. (2013). Framework for planning, implementing, and evaluating preK-3rd grade approaches. College of Education, University of Washington.
35.
Ladson-BillingsG. (1995a). Toward a theory of culturally relevant pedagogy. American Educational Research Journal, 32(3), 465–491.
36.
Ladson-BillingsG. (1995b). But that's just good teaching! The case for culturally relevant pedagogy. Theory Into Practice, 34(3), 159–165.
37.
Ladson-BillingsG. (2006). From the achievement gap to the education debt: Understanding achievement in US schools. Educational Researcher, 35(7), 3–12.
38.
LambertD.RichardsT.MerrillT. (2016). Keys to implementation of child welfare systems change initiatives. Journal of Public Child Welfare, 10(2), 132–151.
McCallR. B.GreenB. L. (2004). Beyond the Methodological Gold Standards of Behavioral Research: Considerations for Practice and Policy. Social Policy Report. Society for Research in Child Development, 18(2).
41.
McBrideD.CasillasW.LoPiccoloJ. (2020). Inciting social change through evaluation. New Directions for Evaluation, 2020, 119–127.
42.
MidgleyG. (2006). Systems thinking for evaluation. Systems concepts in evaluation: An expert anthology (pp. 11–34). EdgePress.
43.
MinklerM.RebanalR. D.PearceR.AcostaM. (2019). Growing equity and health equity in perilous times: Lessons from community organizers. Health Education & Behavior, 46(1_suppl), 9S–18S.
44.
MitchellL.GreenB. L. (2020). Early works at Earl Boyles 2019-20 data highlights and recommendations. School of Social Work, Portland State University.
45.
MitchellL.PattersonL. B.GreenB. L. (2019). Early works at Earl Boyles Evaluation systems & sustainability interviews: Key findings 2018-2019. School of Social Work, Portland State University.
46.
NeubauerL. C.HallM. E. (2020). Is inciting social change something evaluators can do? Should do?New Directions for Evaluation, 2020(166), 129–135.
47.
ParkerL.GillbornD. (Eds.) (2020). Critical race theory in education. Routledge.
48.
SafirS.DuganJ. (2021). Street data: A next-generation model for equity, pedagogy, and school transformation. Corwin.
49.
ScrivenM. (1991). Evaluation thesaurus. Sage.
50.
ShimkhadaR.ScheitlerA. J.PonceN. A. (2021). Capturing racial/ethnic diversity in population-based surveys: Data disaggregation of health data for Asian American, Native Hawaiian, and Pacific Islanders (AANHPIs). Population Research and Policy Review, 40(1), 81–102.
51.
Souto-ManningM.Rabadi-RaolA. (2018). (Re)Centering quality in early childhood education: Toward intersectional justice for minoritized children. Review of Research in Education, 42(1), 203–225.
52.
StakeR. E. (2010). Qualitative research: Studying how things work. Guilford Press.
53.
SymonetteH.MillerR. L.BarelaE. (2020). Power, privilege, and competence: Using the 2018 AEA Evaluator competencies to shape socially just evaluation practice. New Directions for Evaluation, 2020(168), 117–132.
54.
TardiS. (2019). Case study: Defining and differentiating among types of case studies. In BaronA.McNealK., (Eds). Case study methodology in higher education. (pp. 1–19). IGI Global.
55.
WaltonM. (2014). Applying complexity theory: A review to inform evaluation design. Evaluation and Program Planning, 45, 119–126.
56.
WolffT.MinklerM.WolfeS. M.BerkowitzB.BowenL.ButterfossF. D.ChristensB. D.FranciscoV. T.HimmelmanA. T.LeeK. S. (2017). Collaborating for equity and justice: Moving beyond collective impact. Nonprofit Quarterly, 9, 42–53.
57.
YossoT. J. (2005). Whose culture has capital? A critical race theory discussion of community cultural wealth. Race Ethnicity and Education, 8(1), 69–91.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
