The effects of race can manifest in various ways in evaluation contexts, making it critical for evaluators to unpack how race and racism are “complex and destructive forces” for racially minoritized and Indigenous communities. The clarion calls by evaluators on the need for greater attention to issues of race and racism in evaluation underscore the profound urgency to investigate the topic now, given that evaluation can be an important driver in creating societal change, both with and as part of racially minoritized and Indigenous communities. Our purpose in this article is to share findings from 29 semi-structured interviews that address racial equity conceptualizations advanced by programs or evaluators and how evaluators navigated differing conceptualizations or viewpoints of racial equity when working with community members, program leaders or staff, and funders or commissioners.
ArchibaldT.NeubauerL. C.BrookfieldS. D. (2018). The critically reflective evaluator: Adult education's contributions to evaluation for social justice. New Directions for Evaluation, 158, 109–123. https://doi.org/10.1002/ev.20319
5.
AventC. M. (2025). The criticality of language: Exploring STEM education evaluators conceptualizations of equity, diversity, and inclusion and the influence on their roles and practice. Evaluation and Program Planning, 108. https://doi.org/10.1016/j.evalprogplan.2024.102511
6.
AventC. M.ReidA.MollerJ.SingletaryB.AdetogunA.BoyceA. S. (2024). Navigating the field while Black: A critical race analysis of peer and elder advice to and from Black evaluators. American Journal of Evaluation, 45(2), 263–279. https://doi.org/10.1177/10982140231184902
7.
AvineriN.GrahamL.JohnsonE.Conley RinerR.RosaJ. (Eds.). (2019). Language and social justice in practice. Routledge.
8.
BellD. (1992). Faces at the bottom of the well: The permanence of racism. Basic Books.
9.
BledsoeK. L. (2018). Introduction to the section on race and evaluation. American Journal of Evaluation, 39(4), 511–513. https://doi.org/10.1177/1098214018798510
10.
Bowman-FarrellN. R. (2018). Looking backward but moving forward: Honoring the sacred and asserting the sovereign in indigenous evaluation. American Journal of Evaluation, 39(4), 543–568. https://doi.org/10.1177/1098214018790412
11.
BowmanN. R.FrancisC. D.TyndallM. (2015). Culturally responsive indigenous evaluation: A practical approach for evaluating indigenous projects in tribal reservation contexts. In HoodS.HopsonR.FriersonH. (Eds.), Continuing the journey to reposition culture and cultural context in evaluation theory and practice (pp. 335–359). Information Age Publishing.
12.
BoyceA. S.HallJ. N.AventC. M. (2024). Cultural Responsiveness in Evaluation. In NewcomerK.WhiteT. (Eds.), Handbook on Research and Evaluation (pp. 98–115). Edward Elgar Publishing.
13.
BoyceA. S.ReidA.AventC. M.AdetogunA.MollerJ.SingletaryB. (2023). Social justice as ontology: The intersection of black evaluators’ identity, role, and practice. American Journal of Evaluation, 44(3), 528–548. https://doi.org/10.1177/10982140221108664
14.
BoyceA. S.ToveyT. L.OnwukaO.MollerJ. R.ClarkT.SmithA. (2022). Exploring NSF-funded evaluators’ and principal Investigators’ definitions and measurement of diversity, equity, and inclusion. American Journal of Evaluation, 44(1), 50–73. https://doi.org/10.1177/10982140221108662
15.
CaldwellL. D.BledsoeK. L. (2019). Can social justice live in a house of structural racism? A question for the field of evaluation. American Journal of Evaluation, 40(1), 6–18. https://doi.org/10.1177/1098214018815772
16.
ClaysonZ. C.CastañedaX.SanchezE.BrindisC. (2002). Unequal power-changing landscapes: Negotiations between evaluation stakeholders in Latino communities. American Journal of Evaluation, 23(1), 33–44. https://doi.org/10.1177/109821400202300104
17.
ConnerR. F. (2004). Developing and implementing culturally competent evaluation: A discussion of multicultural validity for two HIV programs for Latinos. New Directions in Evaluation, 102, 51–65. https://doi.org/10.1002/ev.115
18.
Dahler-LarsenP.AbmaT.BusteloM.IrimiaR.KosunenS.KravchukI., Minina, E., Segerholm, C., Shiroma, E., Stame, N., & Tshali, C. K. (2017). Evaluation, language, and untranslatables. American Journal of Evaluation, 38(1), 114–125. https://doi.org/10.1177/1098214016678682
19.
Dean-CoffeyJ. (2018). What’s race got to do with it? Equity and philanthropic evaluation practice. American Journal of Evaluation, 39(4), 527–542. https://doi.org/10.1177/1098214018778533
20.
DixsonA. D.Ladson-BillingsG. J.SuarezC. E.TrentW. T.AndersonJ. D. (2020). Introduction: Is race a condition or a process in education? In DixsonA. D.Ladson-BillingsG. J.SuarezC. E.TrentW. T.AndersonJ. D. (Eds.), Condition or process? Researching race in education (pp. 1–11). American Educational Research Association.
21.
FriersonH. T.ThomasV. G.JonesB.CT. (2022). Recognizing of the influences of race in program evaluation and the role of Historically Black Colleges and Universities in producing culturally responsive evaluators. In HoodS.FriersonH. T.HopsonR. K.ArbuthnotK. N. (Eds.), Race and culturally responsive inquiry education: Improving research, evaluation, and assessment (pp. 157–174). Harvard Education Press.
22.
GaribayC.TeasdaleR. M. (2019). Equity and evaluation in informal STEM education. New Directions for Evaluation, 161, 87–106. https://doi.org/10.1002/ev.20352
23.
GuajardoA. D.Robles-SchraderG. M.Aponte-SotoL.NeubauerL. C. (2020). Latcrit theory as a framework for social justice evaluation: Considerations for evaluation and evaluators. New Directions for Evaluation, 166, 65–75. https://doi.org/10.1002/ev.20409
24.
HallM. E. (2018). Evaluation’s race problem in the U.S.: A call to action for the profession and the American Journal of Evaluation. American Journal of Evaluation, 39(4), 569–583. https://doi.org/10.1177/1098214011422592
25.
HallJ. N. (2020). The other side of inequality: Using standpoint theories to examine the privilege of the evaluation profession and individual evaluators. American Journal of Evaluation, 41(1), 20–33. https://doi.org/10.1177/1098214019828485
26.
HallJ. N.AhnJ.GreeneJ. C. (2012). Values engagement in evaluation: Ideas, illustrations, and implications. American Journal of Evaluation, 33(2), 195–207. https://doi.org/10.1177/109821401142259
27.
HernandezA. (December 16, 2023). Personal communication.
28.
HoodS. L.FriersonH. T.HopsonR. K.ArbuthnotK. N. (2022). Race and culturally responsive inquiry in education: Improving research, evaluation, and assessment. Harvard Education Press.
29.
HoodS.HopsonR. K.KirkhartK. E. (2015). Culturally responsive evaluation: Theory, practice, and future implications. In NewcomerK. E.HatryH. P.WholeyJ. S. (Eds.), Handbook of practical program evaluation (4th ed., pp. 281–317). Jossey-Bass.
30.
HopsonR. K. (2009). Reclaiming knowledge at the margins: Culturally responsive evaluation in the current evaluation moment. In RyanK. E.CousinsJ. B. (Eds.), The SAGE international handbook of educational evaluation (pp. 429–446). Sage.
31.
HopsonR. K.LucasK. J.PetersonJ. A. (2000). HIV/AIDS talk: Implications for prevention intervention and evaluation. New Directions for Evaluation, 86, 29–42. https://doi.org/10.1002/ev.1170
LaFranceJ.NicholsR. (2008). Reframing evaluation: Defining an indigenous evaluation framework. Canadian Journal of Program Evaluation, 23(2), 13–31. https://doi.org/10.3138/cjpe.23.003
36.
LaFranceJ.NicholsR.KirkhartK. E. (2012). Culture writes the script: On the centrality of context in indigenous evaluation. New Directions for Evaluation,135, 59–74. https://doi.org/10.1002/ev.20027
37.
LemosD.GarciaD. (2020). Promoting culturally responsive and equitable evaluation with latinx immigrants. New Directions for Evaluation, 166, 89–100. https://doi.org/10.1002/ev.20027
38.
LincolnY. S.GubaE. G. (1985). Naturalistic inquiry. Sage.
39.
MadisonA. (1992). Primary inclusion of culturally diverse minority program participants in the evaluation process. New Directions for Evaluation, 53, 35–43. https://doi.org/10.1002/ev.1599
40.
MadisonA. M. (2000). Language in defining social problems and in evaluating social programs. New Directions for Evaluation, 86, 17–28. https://doi.org/10.1002/ev.1169
41.
MartinJ. P.DesingR.BorregoM. (2022). Positionality statements are just the tip of the iceberg: Moving towards a reflexive process. Journal of Women and Minorities in Science and Engineering, 28(4), v–vii. https://doi.org/10.1615/JWomenMinorScienEng.2022044277
42.
MathisonS. (2005). Encyclopedia of evaluation. Sage.
43.
McBrideD.CasillasW.LoPiccoloJ. (2020). Inciting social change through evaluation. New Directions for Evaluation, 166, 119–127. https://doi.org/10.1002/ev.20405
44.
MerriamS. B.TisdellE. J. (2015). Qualitative research: A guide to design and implementation. John Wiley & Sons, Inc.
45.
MertensD. M.HopsonR. K. (2006). Advancing evaluation of STEM efforts through attention to diversity and culture. New Directions for Evaluation, 109, 35–51. https://doi.org/10.1002/ev.177
46.
MertensD. M.WilsonA. T. (2019). Program evaluation theory and practice: A comprehensive guide (2nd ed). Guilford Press.
47.
MilesM. B.HubemanA. M.SaldañaJ. (2020). Qualitative data analysis: A methods sourcebook (4th ed). Sage.
48.
MilnerH. R.IV (2007). Race, culture, and researcher positionality: Working through dangers seen, unseen, and unforeseen. Educational Researcher, 36(7), 388–400. https://doi.org/10.3102/0013189X07309471
49.
NeubauerL. C.HallM. E. (2020). Is inciting social change something evaluators can do? Should do?New Directions for Evaluation, 166, 129–135. https://doi.org/10.1002/ev.20408
50.
NeubauerL. C.McBrideD.GuajardoA. D.CasillasW. D.HallM. E. (2020). Examining issues facing communities of color today: The role of evaluation to incite change. New Directions for Evaluation,166, 7–11. https://doi.org/10.1002/ev.20406
51.
O’LearyZ. (2017). The essential guide to doing your research project. Sage.
52.
PattonM. Q. (2015). Qualitative research and evaluation methods. Sage.
PeshkinA. (1988). In search of subjectivity—one's own. Educational Researcher, 17, 17–21.
55.
ReidA.BoyceA. S.AdetogunA.MollerJ.AventC. M. (2020). If not us, then who: Evaluators of color, public policy, and social change. New Directions for Evaluation, 166, 23–36. https://doi.org/10.1002/ev.20407
56.
RothsteinR. (2017). The color of law: A forgotten history of our government segregated America. Liveright Publishing Corporation.
57.
RubinH. J.RubinI. S. (2012). Qualitative interviewing: The art of hearing data. Sage.
SaldañaJ. (2021). The coding manual for qualitative researchers (4th ed.)
60.
SeidmanE. (1986). Justice, values, and social science: Unexamined premises. In Seidman, E., & Rappaport, J. (Eds.), Redefining social problems: Perspectives in social psychology. Plenum Press.
61.
SeidmanI. (2013). Interviewing as qualitative research. Teachers College Press.
62.
ShankerV. (2019). Definitional tension: The construction of race in and through evaluation [Doctoral dissertation, University of Minnesota].
63.
StanfieldJ. H. (1999). Slipping through the front door: Relevant social scientific evaluation in the people of color century. American Journal of Evaluation, 20(3), 415–431. https://doi.org/10.1177/109821409902000301
64.
TeasdaleR.AventC. M.MooreC.YanX.Serrano-AbreuM. (2024). It has to be the common thread: Weaving attention to racial equity and justice across lines of inquiry and evaluative criteria. American Journal of Evaluation. https://doi.org/10.1177/10982140241260069
65.
ThomasV. G.CampbellP. B. (2021). Evaluation in today’s world: Respecting diversity, improving quality, and promoting usability. Sage.
66.
ThomasV. G.MadisonA.RockcliffeF.DeLaineK.McDonald LoweS. (2018). Racism, social programming, and evaluation: Where do we go from here?American Journal of Evaluation, 39(4), 514–526. https://doi.org/10.1177/1098214018772910
