Epistemic Oppression,Construct Validity,and Scientific Rigor: Commentary on Woo et al. (2022)

Abstract

In this commentary, I highlight flaws in the article by Woo and colleagues (this issue) that undermine its credibility and utility as rigorous science that contributes to the field. I do so by discussing (a) the concept of epistemic oppression regarding the glaring exclusion of multiple germane bodies of research and (b) the importance of including construct validity within a psychometric article regarding the Graduate Record Examination (GRE). I conclude with a plea to the authors that the matter of anti-Black violence and murder, which they reference, is one to be taken respectfully, seriously, and somberly.

Keywords

GRE epistemic oppression psychology graduate admissions holistic review construct validity

Get full access to this article

View all access options for this article.

References

American Psychological Association CEMRRAT2 Task Force and Committee on Women in Psychology. (2017). Surviving and thriving in academia: A guide for members of marginalized groups. Retrieved from http://www.apa.org/pi/oema/resources/brochures/surviving.aspx

(2016). Meritocracy 2.0: High-stakes, standardized testing as a racial project of neoliberal multiculturalism. Educational Policy, 30, 39–62.

Bertolero

M. A.

Dworkin

J. D.

David

S. U.

Lloreda

C. L.

Srivastava

Stiso

Zhou

Dzirasa

Fair

D. A.

Kaczkurkin

A. N.

Jones Marlin

Shohamy

Uddin

L. Q.

Zurn

Bassett

D. S.

(2020). Racial and ethnic imbalance in neuroscience reference lists and intersections with gender. BioRxiv. https://doi.org/10.1101/2020.10.12.336230

Black Lives Matter Global Network Foundation, Inc. (n.d). The Black lives matter movement. Retrieved on May 12, 2022, from https://blacklivesmatter.com/about/

Bonilla-Silva

(2006). Racism without racists: Color-blind racism and the persistence of racial inequality in the United States. Rowman & Littlefield.

Bonilla-Silva

(2020). Color-blind racism in pandemic times. Sociology of Race and Ethnicity. Advance online publication. https://doi.org/10.1177/2332649220941024

Bonilla-Silva

(2021). What makes systemic racism systemic? Sociological Inquiry, 91(3), 513–533. https://doi.org/10.1111/soin.12420

British Broadcasting Corporation. (2021, May 24). Who was George Floyd and what happened to Derek Chauvin? https://www.bbc.com/news/world-us-canada-56270334

Buchanan

N. T.

Perez

Prinstein

M. J.

Thurston

I. B.

(2021). Upending racism in psychological science: Strategies to change how science is conducted, reported, reviewed, and disseminated. American Psychologist, 76(7), 1097-1112. https://doi.org/10.1037/amp0000905

10.

Buchanan

N. T.

Wiklund

(2021). Intersectionality research in psychological science: Resisting the tendency to disconnect, dilute, and depoliticize. Research on Child and Adolescent Psychopathology, 49, 25–31. https://doi.org/10.1007/s10802-020-00748-y

11.

Callahan

J. L.

Smotherman

J. M.

Dziurzynski

K. E.

Love

P. K.

Kilmer

E. D.

Niemann

Y. F.

Ruggero

C. J.

(2018). Diversity in the professional psychology training-to-workforce pipeline: Results from doctoral psychology student population data. Training and Education in Professional Psychology, 12, 273–285. https://doi.org/10.1037/tep0000203

12.

Centers for Disease Control and Prevention. (2022a, May 3). COVID-19 testing overview. https://www.cdc.gov/coronavirus/2019-ncov/symptoms-testing/testing.html

13.

Centers for Disease Control and Prevention. (2022b, January 25). Health equity considerations and racial and ethnic minority groups. https://www.cdc.gov/coronavirus/2019-ncov/community/health-equity/race-ethnicity.html

14.

Chakravartty

Kuo

Grubbs

McIlwain

(2018). #CommunicationSoWhite. Journal of Communication, 68(2), 254–266. https://doi.org/10.1093/joc/jqy003

15.

Croizet

J. C.

(2008). The pernicious relationship between merit assessment and discrimination in education. In Adams

Biernat

Bran-Scombe

N. R.

Crandall

C. S.

Wrightsman

L. S.

(Eds.), Decade of behavior. Commemorating brown: The social psychology of racism and discrimination (pp. 153–172). American Psychological Association. https://doi.org/10.1037/11681-009

16.

Cronbach

L. J.

Meehl

P. E.

(1955). Construct validity in psychological tests. Psychological Bulletin, 52(4), 281–302.

17.

Dotson

(2012). A cautionary tale: On limiting epistemic oppression. Frontiers: A Journal of Women Studies, 33(1), 24–47. https://www.jstor.org/stable/10.5250/fronjwomestud.33.1.0024

18.

Dotson

(2014). Conceptualizing epistemic oppression. Social Epistemology, 28(2), 115–138.

19.

Dressler

W. W.

Oths

K. S.

Gravlee

C. C.

(2005). Race and ethnicity in public health research: Models to explain health disparities. Annual Review of Anthropology, 34, 231–252.

20.

Dreyer

B. P.

Trent

Anderson

A. T.

Askew

G. L.

Boyd

Coker

T. R.

Coyne-Beasley

Fuentes-Afflick

Johnson

Mendoza

Williams

Montoya Oyeku

S. O.

Poitevien

Spinks-Franklin

A. A. I.

Thomas

O. W.

Walker-Harding

Willis

Wright

J. L.

Berman

. . . Stein

(2020). The death of George Floyd: Bending the arc of history toward justice for generations of children. Pediatrics, 146(3): Article e2020009639. https://doi.org/10.1542/peds.2020-009639

21.

Educational Testing Service. (2019). Graduate Record Examination (GRE): Guide to the use of scores. https://www.ets.org/s/gre/pdf/gre_guide.pdf

22.

Fisk-Vanderbilt Bridge Program. (n.d). The Fisk-Vanderbilt master’s-to-PhD bridge program: Toolkit for Practitioners. Retrieved on May 12, 2022, from https://www.fisk-vanderbilt-bridge.org/toolkit

23.

Gómez

J. M.

(2022). Diversity wanted! Utilizing transdisciplinary scholarship on structural inequality to educate psychology graduate students. Teaching of Psychology. Advance online publication. https://doi.org/10.1177/00986283211061687

24.

Gómez

J. M.

Caño

Baltes

B. B.

(2021). Who are we missing? Examining the Graduate Record Examination quantitative score as a barrier to admission into psychology doctoral programs for capable ethnic minorities. Training and Education in Professional Psychology, 153(3), 211–218. https://doi.org/10.1037/tep0000336

25.

Greco

A. N.

Wharton

R. M.

Brand

(2016). Demographics of scholarly publishing and communication professionals. Learned Publishing, 29(2), 97–101. https://doi.org/10.1002/leap.1017

26.

Harrell

S. P.

(2000). A multidimensional conceptualization of racism-related stress: Implications for the well-being of people of color. American Journal of Orthopsychiatry, 70(1), 42–57.

27.

Hernández-Colón

I. R.

Caño

Wurm

L. H.

Sanders

Nava

(2021). Instructional set moderates the effect of GRE on faculty appraisals of applicant competence: A vignette study with implications for holistic review. Frontiers in Psychology, 12, Article 749621. https://doi.org/10.3389/fpsyg.2021.749621

28.

Hicken

M. T.

Kravitz-Wirtz

Durkee

Jackson

J. S.

(2018). Racial inequalities in health: Framing future research. Social Science & Medicine, 199, 11–18. https://10.1016/j.socscimed.2017.12.027

29.

Hinkin

T. R.

(1998). A brief tutorial on the development of measures for use in survey questionnaires. Organizational Research Methods, 1(1), 104–121.

30.

Kalsbeek

Sandlin

Sedlacek

(2013). Employing noncognitive variables to improve admissions, and increase student diversity and retention. Strategic Enrollment Management Quarterly, 1, 132–150.

31.

Kent

J. D.

McCarthy

M. T.

(2016). Holistic review in graduate admissions. Council of Graduate Schools.

32.

Mathur

Cano

Dickson

M. W.

Matherly

L. H.

Maun

Neale

A. V.

(2019). Portfolio review in graduate admissions: Outcomes of a pilot program. Strategic Enrollment Management Quarterly, 7(1), 7–24.

33.

Maton

K. I.

Kohout

J. L.

Wicherski

Leary

G. E.

Vinokurov

(2006). Minority students of color and the psychology graduate pipeline: Disquieting and encouraging trends, 1989-2003. American Psychologist, 61, 117–131. https://doi.org/10.1037/0003-066X.61.2.117

34.

Miller

A. L.

Stern

Neville

(2019). Forging diversity-science-informed guidelines for research on race and racism in psychological science. Journal of Social Issues, 75(4), 1240–1261. https://doi.org/10.1111/josi.12356

35.

Miller

Stassun

K. A.

(2014). A test that fails. Nature, 510, 303–304.

36.

Mills

C. W.

(1997). The racial contract. Cornell University Press.

37.

Muñoz-Dunbar

Stanton

A. L.

(1999). Ethnic diversity in clinical psychology: Recruitment and admission practices among doctoral programs. Teaching of Psychology, 26, 259–263.

38.

Nunnally

J. C.

(1976). Psychometric theory (2nd ed.). McGraw-Hill.

39.

O’Reilly

(2020, June 5). Systems centered language: Speaking truth to power during COVID-19 while confronting racism. Medium. https://medium.com/@meagoreillyphd/systems-centered-language-a3dc7951570e

40.

Osbeck

(2018). Values in psychological science: Re-imagining epistemic priorities at a new frontier. Cambridge University Press.

41.

Plaut

V. C.

(2010a). Diversity science: Why and how difference makes a difference. Psychological Inquiry, 21(2), 77–99. https://doi.org/10.1080/10478401003676501

42.

Plaut

V. C.

(2010b). Diversity science: Who needs it? Psychological Inquiry, 21(2), 168–174. https://doi.org/10.1080/1047840X.2010.492753

43.

Posselt

J. R.

(2014). Toward inclusive excellence in graduate education: Constructing merit and diversity in PhD admissions. American Journal of Education, 120, 481–514.

44.

Ray

(2019). A theory of racialized organizations. American Sociological Review, 84(1), 26–53. https://doi.org/10.1177/0003122418822335

45.

Roberts

M. C.

Ostreko

(2018). GREs, public posting, and holistic admissions for diversity in professional psychology: Commentary on Callahan et al. (2018). Training and Education in Professional Psychology, 12, 286–290. https://doi.org/10.1037/tep0000219

46.

Rogers

M. R.

Molina

L. E.

(2006). Exemplary efforts in psychology to recruit and retain graduate students of color. American Psychologist, 61, 143–156. https://doi.org/10.1037/0003-066X.61.2.143

47.

Stewart

Haynes

(2016). An alternative approach to standardized testing: A model that promotes racial equity and college access. Journal of Critical Scholarship on Higher Education and Student Affairs, 2, 122–136.

48.

Syed

McLean

K. C.

(2021). Master narrative methodology: A primer for conducting structural-psychological research. Cultural Diversity and Ethnic Minority Psychology. Advance online publication. https://doi.org/10.31234/osf.io/8d7t9

49.

Taylor

K. Y.

(2016). From# BlackLivesMatter to black liberation. Haymarket Books.

50.

Teo

(2008). From speculation to epistemological violence in psychology: A critical-hermeneutic reconstruction. Theory & Psychology, 18, 47–67. https://doi.org/10.1177/0959354307086922

51.

Vasquez

M. J. T.

Jones

J. M.

(2006). Increasing the number of psychologists of color: Public policy issues for affirmative diversity. American Psychologist, 61, 132–142.

52.

Wing

(2020, October 20). Faces of Black men, women, children whose lives came to a violent end are the heart of memorial. KNKX Public Radio. https://www.knkx.org/news/2020-10-20/faces-of-black-men-women-children-whose-lives-came-to-a-violent-end-are-the-heart-of-memorial

53.

Woo

S. E.

LeBreton

Keith

Tay

(2022). Bias, fairness, and validity in graduate admissions: A psychometric perspective. Perspectives on Psychological Science, 18(1), 3–31. https://doi.org/10.1177/17456916211055374

54.

Wrigley-Field

(2020). US racial inequality may be as deadly as COVID-19. Proceedings of the National Academy of Sciences, USA, 117(36), 21854–21856.

55.

Yoshino

(2007). Covering: The hidden assault on our civil rights. Random House Trade Paperbacks.

56.

Zuberi

Bonilla-Silva

(2008). White logic, white methods: Racism and methodology. Rowman & Littlefield.

57.

Zurn

Bassett

D. S.

Rust

N. C.

(2020). The citation diversity statement: A practice of transparency, a way of life. Trends in Cognitive Sciences, 24(9), 669–672. https://doi.org/10.1016/j.tics.2020.06.009