Social Justice as Ontology: The Intersection of Black Evaluators’ Identities,Roles,and Practice

Abstract

Violence, marginalization, oppression, exploitation, erasure, and injustice are cornerstones of the Black experience in the United States. Despite seemingly insurmountable challenges, Black people have worked diligently and competently to earn spaces within the present-day professional arena. While the experiences of Black professionals have been investigated in multiple fields, little is known about Black evaluators. This study aimed to investigate Black evaluators’ experiences in an attempt to understand the intersectionality of their identities, roles, and practice and to ensure voices and contributions of Black evaluators are highlighted. We conducted 26 interviews with Black evaluators across academic, government, nonprofit, philanthropic, and private sectors. We found race and advocate for social justice are central to Black evaluators’ identities, roles, and practice. We developed a thematic framework as a result of our analysis and interpretations of the ways in which Black evaluators’ identities impacted their perceptions of their professional role and practice.

Keywords

social justice identity evaluator role evaluation practice

Get full access to this article

View all access options for this article.

References

Al-Khatib

A. J.

Lash

M. J.

(2017). Professional identity of an early childhood Black teacher in a predominantly White school: A case study. Child Care in Practice, 23(3), 242–257. https://doi.org/10.1080/13575279.2016.1188766

Alkin

M. C.

(2013). Evaluation roots: A wider perspective of theorists’ views and influences, second edition. Thousand Oaks, CA: Sage.

Alkin

M. C.

A. T.

(2017). Evaluation essentials: From A to Z. New York: Guilford Publications.

Anderson

M. B.

(1999). Do no harm: How aid can support peace—or war. United Kingdom: Lynne Rienner Publishers.

Anfara

V. A.

Mertz

N. T.

(2006). Introduction. Theoretical frameworks in qualitative research, xiii–xxxii.

Antonio

A. L.

(2002). Faculty of color reconsidered: Reassessing contributions to scholarship. The Journal of Higher Education, 73(5), 582–602.

Boyce

A. S.

(2017). Lessons learned using a values-engaged approach to attend to culture, diversity, and equity in a STEM program evaluation. Evaluation and Program Planning, 64, 33–43. https://doi.org/10.1016/j.evalprogplan.2017.05.018

Boyce

A. S.

(2019). A re-imagining of evaluation as social justice: A discussion of the education justice project. Critical Education, 10(1), 1–19.

Boyce

A. S.

Chouinard

J. A.

(2017). Moving beyond the buzzword: A framework for teaching culturally responsive approaches to evaluation. Canadian Journal of Program Evaluation, 32(2), 266–279. https://doi.org/10.3138/cjpe.31132

10.

Boyce

A. S.

Reid

Avent

Adetogun

(2017). Say their names: Lived experiences of prominent and emerging black evaluators. Panel presented at the meeting for the American Evaluation Association, Washington, DC.

11.

Braun

Clarke

(2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), 77–101. https://doi.org/10.1191/1478088706qp063oa

12.

Chelimsky

(1987). What have we learned about the politics of program evaluation? Educational Evaluation and Policy Analysis, 9(3), 199–213. https://doi.org/10.3102/01623737009003199

13.

Collins

P. H.

Bilge

(2020). Intersectionality. Hoboken, NJ: John Wiley & Sons.

14.

Crenshaw

(1989). Demarginalizing the intersection of race and sex: A black feminist critique of antidiscrimination doctrine, feminist theory and antiracist politics. University of Chicago, Legal Forum, 139.

15.

Creswell

J. W.

(2015). A concise introduction to mixed methods research. Los Angeles: Sage.

16.

Davidson

(2019). American Evaluation association awards ceremony acceptance speech. Minneapolis, MN.

17.

Greene

J. C.

(1997). Evaluation as advocacy. Evaluation Practice, 18(1), 25–35. https://doi.org/10.1177/109821409701800103

18.

Greene

J. C.

(2007). Mixed methods in social inquiry. Hoboken, NJ: Jossey-Bass.

19.

Greene

J. C.

DeStefano

Burgon

Hall

(2006). An educative, values-engaged approach to evaluating STEM educational programs. New Directions for Evaluation, 2006(109), 53–71. https://doi.org/10.1002/ev.178

20.

Grooms

A. A.

Mahatmya

Johnson

E. T.

(2021). The retention of educators of color amidst institutionalized racism. Educational Policy, 35(2), 180–212. https://doi.org/10.1177/0895904820986765

21.

Hall

J. N.

(2020). The other side of inequality: Using standpoint theories to examine the privilege of the evaluation profession and individual evaluators. American Journal of Evaluation, 41(1), 20–33. https://doi.org/10.1177/1098214019828485

22.

Hall

(2017). Personal communication .

23.

Hall

M. E.

(2018). Evaluation's race problem in the United States: A call to action for the profession and the “American journal of evaluation”. American Journal of Evaluation, 39(4), 569–583. https://doi.org/10.1177/1098214018792624

24.

Hall

M. E.

(2020). Blest be the tie that binds. In L. C. Neubauer, D. McBride, A. D. Guajardo, W. D. Casillas, & M. E. Hall (Eds.), examining issues facing communities of color today: The role of evaluation to incite change. New Directions for Evaluation, 166, 13–22. https://doi.org/10.1002/ev.20414

25.

Hall

(1996). Introduction: Who needs identity? In Hall

Du Gay

(Eds.), Questions of cultural identity (pp. 1–17). Thousand Oaks, CA: Sage.

26.

Hood

(2001). Nobody knows my name: In praise of African American evaluators who were responsive. New Directions for Evaluation, 2001(92), 31–44. https://doi.org/10.1002/ev.33

27.

Hood

(2017). Continuing the exploration of African Americans in the early history of evaluation in the United States: Contributions of Ambrose Caliver in the US office of education. American Journal of Evaluation, 38(2), 262–274. https://doi.org/10.1177/1098214017695482

28.

Hood

Hopson

R. K.

(2008). Evaluation roots reconsidered: Asa Hilliard, a fallen hero in the “nobody knows my name” project, and African educational excellence. Review of Educational Research, 78(3), 410–426. https://doi.org/10.3102/0034654308321211

29.

Hood

Hopson

R. K.

Kirkhart

K. E.

(2015). Culturally responsive evaluation. In Newcomer

K. E.

Hatry

H. P.

Wholey

J. S.

(Eds.), Handbook of practical program evaluation (4th ed., pp. 281–317). Jossey-Bass.

30.

Hsieh

H. F.

Shannon

S. E.

(2005). Three approaches to qualitative content analysis. Qualitative Health Research, 15(9), 1277–1288. https://doi.org/10.1177/1049732305276687

31.

Kanter

J. W.

Williams

M. T.

Kuczynski

A. M.

Manbeck

K. E.

Debreaux

Rosen

D. C.

(2017). A preliminary report on the relationship between microaggressions against Black people and racism among White college students. Race and Social Problems, 9(4), 291–299. https://doi.org/10.1007/s12552-017-9214-0

32.

Kendi

I. X.

(2016). Stamped from the beginning: The definitive history of racist ideas in America. UK: Hachette.

33.

Lee

(2000). The salience of race in everyday life: Black customers’ shopping experiences in black and White neighborhoods. Work and Occupations, 27(3), 353–376. https://doi.org/10.1177/0730888400027003005

34.

Maikuri

Olazabal

Shanker

(January 15, 2021). “ITE TIG Week: Doing no harm with technology in evaluation: Part 1.” AEA 365. https://aea365.org/blog/ite-tig-week-doing-no-harm-with-technology-in-evaluation-part-1-by-antony-maikuri-veronica-olazabal-and-vidhya-shanker-2/.

35.

Mapedzahama

Rudge

West

Perron

(2012). Black nurse in white space? Rethinking the in/visibility of race within the Australian nursing workplace. Nursing Inquiry, 19(2), 153–164. https://doi.org/10.1111/j.1440-1800.2011.00556.x

36.

McBride

Casillas

LoPiccolo

(2020). Inciting social change through evaluation. In L. C. Neubauer, D. McBride, A. D. Guajardo, W. D. Casillas, & M. E. Hall (Eds.), Examining issues facing communities of color today: The role of evaluation to incite change. New Directions for Evaluation, 166, 119–127. https://doi.org/10.1002/ev.20405

37.

McCabe

(2009). Racial and gender microaggressions on a predominantly-White campus: Experiences of Black, Latina/o and White undergraduates. Race, Gender & Class, 16(1), 133–151.

38.

Merriam

S. B.

(2009). Qualitative research: A guide to design and implementation. San Francisco, CA: Jossey-Bass.

39.

Merriam-Webster (2021). Definition of Tokenism. Retrieved from https://www.merriam-webster.com/dictionary/tokenism.

40.

Mertens

D. M.

Hopson

R. K.

(2006). Advancing evaluation of STEM efforts through attention to diversity and culture. New Directions for Evaluation, 109, 35–51. https://doi.org/10.1002/ev.177

41.

Morrison

(2021). Race double standard clear in rioters’ Capitol insurrection. https://apnews.com/article/congress-storming-black-lives-matter-22983dc91d16bf949efbb60cdda4495d.

42.

Moss

Crewe

S. E.

(2020). The black perspective: A framework for culturally competent health-related evaluations for african Americans. In L. C. Neubauer, D. McBride, A. D. Guajardo, W. D. Casillas, & M. E. Hall (Eds.), Examining issues facing communities of color today: The role of evaluation to incite change. New Directions for Evaluation, 166, 77–87.

43.

Movement for Black Lives (2022). https://m4bl.org/

44.

Mustaffa

J. B.

(2017). Mapping violence, naming life: A history of anti-Black oppression in the higher education system. International Journal of Qualitative Studies in Education, 30(8), 711–727. https://doi.org/10.1080/09518398.2017.1350299

45.

Neubauer

L. C.

McBride

Guajardo

A. D.

Casillas

W. D.

Hall

M. E.

(2020). Examining issues facing communities of color today: The role of evaluation to incite change. New Directions for Evaluation, 2020(166), 7–11. https://doi.org/10.1002/ev.20406

46.

Patton

M. Q.

(2013). The roots of utilization-focused evaluation. In Alkin

M. C.

(Ed.), Evaluation roots: A wider perspective of theorists (2nd ed., pp. 293–297). Thousand Oak, CA: Sage.

47.

Pierce

Carew

Pierce-Gonzalez

Willis

(1978). An experiment in racism: TV commercials. In Pierce

(Ed.), Television and education (pp. 62–88). Thousand Oaks, CA: Sage.

48.

Pompper

(2014). Practical and theoretical implications of successfully doing difference in organizations. Social identities are intersectional (pp. 45–61). Essay, Emerald Group Publishing: Bingley. https://doi.org/10.1108/S2051-233320140000001002.

49.

Public Broadcast System (2003). Race the power of an illusion. Retrieved from https://www.pbs.org/race/000_General/000_00-Home.htm.

50.

Reid

A. M.

(2020). Applying an educative approach to engage stakeholder values in evaluations of STEM research and education programs. Evaluation Journal of Australasia, 20(2), 103–108. https://doi.org/10.1177/1035719X20918497

51.

Reid

A. M.

Boyce

A. S.

Adetogun

Moller

Avent

(2020). If not us, then who? Evaluators of color and social change. In L. C. Neubauer, D. McBride, A. D. Guajardo, W. D. Casillas, & M. E. Hall (Eds.), Examining issues facing communities of color today: The role of evaluation to incite change. New Directions for Evaluation, 166, 23–36. https://doi.org/10.1002/ev.20407

52.

Rockquemore

Laszloffy

T. A.

(2008). The black academic’s guide to winning tenure—without losing your soul (p. 261). Boulder, CO: Lynne Rienner Publishers.

53.

Rouse

W. B.

Cannon-Bowers

J. A.

Salas

(1992). The role of mental models in team performance in complex systems. IEEE Transactions on Systems, Man, and Cybernetics, 22(6), 1296–1308. https://doi.org/10.1109/21.199457

54.

Shanker

(2019). Definitional Tension: The Construction of Race In and Through Evaluation. Retrieved from the University of Minnesota Digital Conservancy, https://hdl.handle.net/11299/211799.

55.

Shanker

(2020). The invisible labor of women of color and indigenous women in evaluation. AEA 365. https://aea365.org/blog/the-invisible-labor-of-women-of-color-and-indigenous-women-in-evaluation-by-vidhya-shanker/.

56.

Smith

W. A.

Hung

Franklin

J. D.

(2011). Racial battle fatigue and the miseducation of black men: racial microaggressions, societal problems, and environmental stress. The Journal of Negro Education, 80(1), 63–82.

57.

Stafford

Hoyer

Morrison

(2020). Racial toll of virus grows even starker as more data emerges. https://apnews.com/article/8a3430dd37e7c44290c7621f5af96d6b .

58.

Staiger

(2005). School walls as battlegrounds: Technologies of power, space and identity. Paedagogica Historica, 41(4/5), 555–569. https://doi.org/10.1080/00309230500165759

59.

Sternberg

R. J.

Grigorenko

E. L.

Kidd

K. K.

(2005). Intelligence, race, and genetics. The American Psychologist, 60(1), 46–59. https://doi.org/10.1037/0003-066X.60.1.46

60.

Strauss

Corbin

J. M.

(1997). Grounded theory in practice. Thousand Oaks, CA: Sage.

61.

Sturges

K. M.

(2014). External evaluation as contract work: The production of evaluator identity. American Journal of Evaluation, 35(3), 346–363. https://doi.org/10.1177/1098214013513829

62.

Symonette

(2004). Walking pathways toward becoming a culturally competent evaluator: Boundaries, borderlands, and border crossings. New Directions for Evaluation, 2004(102), 95–109. https://doi.org/10.1002/ev.118

63.

Thomas

V. G.

Madison

(2010). Integration of social justice into the teaching of evaluation. American Journal of Evaluation, 31(4), 570–583. https://doi.org/10.1177/1098214010368426

64.

Thomas

V. G.

Madison

Rockcliffe

DeLaine

Lowe

S. M. D.

(2018). Racism, social programming, and evaluation: Where do we go from here? American Journal of Evaluation, 39(4), 514–526. https://doi.org/10.1177/1098214018772910

65.

Turner

Grauerholz

(2017). Introducing the invisible man: Black male professionals in higher education. Humboldt Journal of Social Relations, 39, 212–227. https://doi.org/10.55671/0160-4341.1013

66.

White

(2020). How will you “shine your light?” in evaluation practice? Retrieved from https://www.evaluationconference.org/About/2020-Theme.

67.

Williams

M. T.

(2019). Adverse racial climates in academia: Conceptualization, interventions, and call to action. New Ideas in Psychology, 55, 58–67. https://doi.org/10.1016/j.newideapsych.2019.05.002