Sage Journals: Discover world-class research

Abstract

This study replicates and extends Elliott’s research on bias in music performance evaluations, examining whether implicit bias related to race, gender, and instrument type influenced music teachers’ evaluations. In-service music educators (N = 45) evaluated eight videos of trumpet and flute performances with performers of varying races and genders. We synchronized all performances to identical prerecorded audio. Using a repeated measures analysis of variance, we found significant main effects for race (p = .02) and instrument (p < .01) but not gender. Evaluators rated Black performers lower than White performers and trumpet performances lower than flute performances. We observed significant interactions between race and gender (p < .01), race and instrument (p < .01), and gender and instrument (p < .01), revealing complex intersectional relationships. Black female performers consistently received the lowest ratings, highlighting how race and gender interact to create compounded disadvantages. Results underscore the need for intersectional approaches in music teacher education to address these biases, contributing to more equitable evaluation practices.

Keywords

performance evaluation racial bias instrument bias gender bias intersectionality

Get full access to this article

View all access options for this article.

References

Abeles

H. F.

(2009). Are musical instrument gender associations changing? Journal of Research in Music Education, 57(2), 127–139. https://doi.org/10.1177/0022429409335878

Abeles

H. F.

Porter

S. Y.

(1978). The sex-stereotyping of musical instruments. Journal of Research in Music Education, 26(2), 65–75. https://doi.org/10.2307/3344880

Abramo

J. M.

Bernard

C. F.

(2020). Barriers to access and university schools of music: A collective case study of urban high school students of Color and their teachers. Bulletin of the Council for Research in Music Education, 226, 7–26. https://doi.org/10.5406/bulcouresmusedu.226.0007

Bell

(2003). Diversity’s distractions. Columbia Law Review, 103(6), 1622–1633.

Bonilla-Silva

(2017). Racism without racists: Color-blind racism and the persistence of racial inequality in America (5th ed.). Rowman & Littlefield Publishers.

Cheek

(2007). The effect of race and racial perception on adjudicators’ ratings of choral performances attributed to racially homogeneous and racially heterogeneous groups (Publication No. 3259686) [Doctoral dissertation, University of North Carolina at Greensboro]. ProQuest Dissertations and Theses Global.

Cohen

(1988). Statistical power analysis for the behavioral sciences (2nd ed.). Lawrence Erlbaum Associates.

Crenshaw

(2022). Demarginalizing the intersection of race and sex: A Black feminist critique of antidiscrimination doctrine, feminist theory, and antiracist politics. In Calhoun

Gerteis

Moody

Pfaff

Virk

(Eds.), Contemporary sociological theory (pp. 354–362). John Wiley & Sons. (Original work published 1989).

Elliott

(1995). Race and gender as factors in judgements of musical performance. Bulletin of the Council for Research in Music Education, 127, 50–56. https://www.jstor.org/stable/40318766

10.

Elpus

(2015). Music teacher licensure candidates in the United States: A demographic profile and analysis of licensure examination scores. Journal of Research in Music Education, 63(3), 314–335. https://doi.org/10.1177/0022429415602470

11.

Faul

Erdfelder

Lang

A.-G.

Buchner

(2007). G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior Research Methods, 39, 175–191. https://doi.org/10.3758/BF03193146

12.

Foley

H. J.

(2004). Counterbalancing. In Lewis-Beck

Bryman

Futing

Liao (Eds.), The SAGE encyclopedia of social science research methods (p. 206). Sage Publications. https://doi.org/10.4135/9781412950589.n180

13.

Forman

T. A.

Lewis

A. E.

(2015). Beyond prejudice? Young Whites’ racial attitudes in post-civil rights America, 1976 to 2000. American Behavioral Scientist, 59(11), 1394–1428. https://doi.org/10.1177/0002764215588811

14.

Goldin

Rouse

(2000). Orchestrating impartiality: The impact of “blind” auditions on female musicians. The American Economic Review, 90(4), 715–741. https://doi.org/10.1257/aer.90.4.715

15.

Gretzinger

Hicks

Dutton

Smith

(n.d.). Tracking higher ed’s dismantling of DEI. The Chronicle of Higher Education. https://www.chronicle.com/article/tracking-higher-eds-dismantling-of-dei

16.

Griswold

P. A.

Chroback

D. A.

(1981). Sex-role associations of music instruments and occupations by gender and major. Journal of Research in Music Education, 29(1), 57–62. https://doi.org/10.2307/3344680

17.

Hallam

Rogers

Creech

(2008). Gender differences in musical instrument choice. International Journal of Music Education, 26(1), 7–19. https://doi.org/10.1177/0255761407085646

18.

Howard

S. A.

(2012). The effect of selected nonmusical factors on adjudicators’ ratings of high school solo vocal performances. Journal of Research in Music Education, 60(2), 166–185. https://doi.org/10.1177/0022429412444610

19.

Johnson

C. M.

Stewart

E. E.

(2005). Effect of sex and race identification on instrument assignment by music educators. Journal of Research in Music Education, 53(4), 348–357. https://doi.org/10.1177/002242940505300406

20.

Kallio

A. A.

Marsh

Westerlund

Karlsen

Sæther

(2021). Introduction: The politics of diversity in music education. In Kallio

A. A.

Marsh

Westerlund

Karlsen

Sæther

(Eds.), The politics of diversity in music education (pp. 1–11). Springer. https://doi.org/10.1007/978-3-030-65617-1_1

21.

Kaufman

Kladder

Palmer

E. S.

(2024). Adjudicating equity in music performance assessments: A literature review. Update: Applications of Research in Music Education, 43(3), 49–59. https://doi.org/10.1177/87551233241256288

22.

Kelly

S. N.

(1997). An investigation of the influence of timbre on gender and instrument association. Contributions to Music Education, 24(1), 43–56. https://www.jstor.org/stable/24126945

23.

Koza

J. E.

(2010). Listening for whiteness: Hearing racial politics in undergraduate school music. In Regelski

T. A.

Gates

J. T.

(Eds.), Music education for changing times: Guiding visions for practice (pp. 85–95). Springer Netherlands. https://doi.org/10.1007/978-90-481-2700-9_7

24.

MacLeod

R. B.

(2009). A comparison of aural and visual instrument preferences of third- and fifth-grade students. Bulletin of the Council for Research in Music Education, 179, 33–43. https://doi.org/10.2307/40319328

25.

McCrary

(1993). Effects of listeners’ and performers’ race on music preferences. Journal of Research in Music Education, 41(3), 200–211. https://doi.org/10.2307/3345325

26.

McKeage

K. M.

(2004). Gender and participation in high school and college instrumental jazz ensembles. Journal of Research in Music Education, 52(4), 343–356. https://doi.org/10.1177/002242940405200406

27.

McNamee

S. J.

Miller

R. K.

(2014). The meritocracy myth (3rd ed.). Rowman & Littlefield Publishers.

28.

Menon

S. A.

Martin

Bohn

(2025). The case for QuantCrit: An analysis of race and gender in the Journal of Research in Music Education. Journal of Research in Music Education, 73(3), 281–304. https://doi.org/10.1177/00224294241308231

29.

Morrison

S. J.

(1998). A comparison of preference responses of White and African-American students to musical versus musical/visual stimuli. Journal of Research in Music Education, 46(2), 208–222. https://doi.org/10.2307/3345624

30.

Movement Advancement Project. (2024). Dismantling DEI: A coordinated attack on American values. https://www.mapresearch.org/2024-dei-report

31.

Powell

S. R.

Celeste . (2020). Outside in the music teaching machine: Remembrances of marginalization. Bulletin of the Council for Research in Music Education, 223, 26–41. https://doi.org/10.5406/bulcouresmusedu.223.0026

32.

Ryan

Costa-Giomi

(2004). Attractiveness bias in the evaluation of young pianists’ performances. Journal of Research in Music Education, 52(2), 141–154. https://doi.org/10.2307/3345436

33.

Sheldon

D. A.

Hartley

L. A.

(2012). What color is your baton, girl? Gender and ethnicity in band conducting. Bulletin of the Council for Research in Music Education, 192, 39–52. https://doi.org/10.5406/bulcouresmusedu.192.0039

34.

Shouldice

H. N.

Eastridge

J. L.

(2020). A comparison of Virginia band performance assessments in relation to director gender. Journal of Research in Music Education, 68(2), 125–137. https://doi.org/10.1177/0022429420922137

35.

Shouldice

H. N.

Woolnough

(2022). Relationships among band festival ratings, director gender, and other selected factors. Journal of Research in Music Education, 70(2), 156–167. https://doi.org/10.1177/00224294211060449

36.

Siddell-Strebel

(2007). The effects of non-musical components on the ratings of performance quality (Publication No. NR32324) [Doctoral dissertation, McGill University]. ProQuest Dissertations and Theses Global.

37.

Taylor

D. M.

Calaham

(2024). Sassy and strong: Intersections of race, attractional orientation, and gender expression within music education. Journal of Research in Music Education, 72(1), 48–70. https://doi.org/10.1177/00224294231174168

38.

Thompson

Williamon

(2003). Evaluating evaluation: Musical performance assessment as a research tool. Music Perception, 21(1), 21–41. https://doi.org/10.1525/mp.2003.21.1.21

39.

Tsay

C.-J.

(2013). Sight over sound in the judgment of music performance. Proceedings of the National Academy of Sciences, 110(36), 14580–14585. https://doi.org/10.1073/pnas.1221454110

40.

U.S. Department of Education. (2025, January 23). U.S. Department of Education takes action to eliminate DEI [Press release]. https://www.ed.gov/about/news/press-release/us-department-of-education-takes-action-eliminate-dei

41.

VanWeelden

McGee

(2007). The influence of music style and conductor race on perceptions of ensemble and conductor performance. International Journal of Music Education, 25(1), 7–17. https://doi.org/10.1177/0255761407074886

42.

Waddell

Williamon

(2017). Eye of the beholder: Stage entrance behavior and facial expression affect continuous quality ratings in music performance. Frontiers in Psychology, 8, Article 513. https://doi.org/10.3389/fpsyg.2017.00513

43.

Wapnick

Campbell

Siddell-Strebel

Darrow

A. A.

(2009). Effects of non-musical attributes and excerpt duration on ratings of high-level piano performances. Musicae Scientiae, 13(1), 35–54. https://doi.org/10.1177/1029864909013001002

44.

Wapnick

Darrow

A. A.

Kovacs

Dalrymple

(1997). Effects of physical attractiveness on evaluation of vocal performance. Journal of Research in Music Education, 45(3), 470–479. https://doi.org/10.2307/3345540

45.

Wapnick

Mazza

J. K.

Darrow

A.-A.

(1998). Effects of performer attractiveness, stage behavior, and dress on violin performance evaluation. Journal of Research in Music Education, 46, 510–521. https://doi.org/10.2307/3345347

46.

Wapnick

Ryan

Campbell

Deek

Lemire

Darrow

A. A.

(2005). Effects of excerpt tempo and duration on musicians’ ratings of high-level piano performances. Journal of Research in Music Education, 53(2), 162–176. https://doi.org/10.1177/002242940505300206

47.

Watkins

J. G.

Farnum

S. E.

(1954). The Watkins-Farnum performance scale. Hal Leonard.

48.

Wrape

E. R.

Dittloff

A. L.

Callahan

J. L.

(2016). Gender and musical instrument stereotypes in middle school children: Have trends changed? Update: Applications of Research in Music Education, 34(3), 40–47. https://doi.org/10.1177/8755123314564255

49.

Wych

G. M. F.

(2012). Gender and instrument associations, stereotypes, and stratification: A literature review. Update: Applications of Research in Music Education, 30(2), 22–31. https://doi.org/10.1177/8755123312437049

The Effects of Race and Gender on In-Service Music Teachers’ Evaluations of Musical Performance

Abstract

Keywords

Get full access to this article

References