A Brief Pro-Diversity Social Marketing Intervention Improves Grades and Well-Being of Students From Marginalized Groups

Abstract

Despite much research on improving intergroup relations, the evidence for long-term effects in real-world settings is mixed. We used the social marketing approach to create an “Inclusivity Page” that could be added to course syllabi. The page contained three targeted pro-diversity messages based on social norms, personal benefits, and concrete behavioral recommendations. We tested our intervention in a large randomized controlled trial in university classrooms (N_students = 1,799). We obtained students’ course grades and overall college GPAs several years later. A subset of students also completed an outcome survey three months after the intervention. Students from underrepresented racial groups exposed to the intervention early in college had better course grades and GPAs. We also observed an enhanced sense of belonging and better emotional and physical health among students from all marginalized groups. Our research demonstrates the utility of employing a targeted approach to improve experiences of members of marginalized groups.

Keywords

diversity and inclusion interventions social marketing intergroup relations

Get full access to this article

View all access options for this article.

References

Adams

Kurtiş

Salter

P. S.

Anderson

S. L.

(2012). A cultural psychology of relationship: Decolonizing science and practice. In Gillath

Adams

Kunkel

(Eds.), Relationship science: Integrating evolutionary, neuroscience, and sociocultural approaches (pp. 49–70). American Psychological Association. https://doi.org/10.1037/13489-003

American National Election Studies. (2021, July 19). ANES 2020 time series study full release [Dataset and documentation] (2021 Version). www.electionstudies.org

Andreasen

A. R.

(2005). Social marketing in the 21st century. Sage. https://doi.org/10.4135/9781483329192

Bezrukova

Spell

C. S.

Perry

J. L.

Jehn

K. A.

(2016). A meta-analytical integration of over 40 years of research on diversity training evaluation. Psychological Bulletin, 142(11), 1227–1274. https://doi.org/10.1037/bul0000067

Brady

L. M.

Wang

Griffiths

Yang

Markus

H. R.

Fryberg

S. A.

(2024). A leadership-level culture cycle intervention changes teachers’ culturally inclusive beliefs and practices. Proceedings of the National Academy of Sciences, 121(25), Article e2322872121. https://doi.org/10.1073/pnas.2322872121

Brady

S. T.

Cohen

G. L.

Jarvis

S. N.

Walton

G. M.

(2020). A brief social-belonging intervention in college improves adult outcomes for black Americans. Science Advances, 6(18), Article eaay3689. https://doi.org/10.1126/sciadv.aay3689

Brady

S. T.

Hard

B. M.

Gross

J. J.

(2018). Reappraising test anxiety increases academic performance of first-year college students. Journal of Educational Psychology, 110(3), 395–406. https://doi.org/10.1037/edu0000219

Brannon

T. N.

Carter

E. R.

Murdock-Perriera

L. A.

Higginbotham

G. D.

(2018). From backlash to inclusion for all: Instituting diversity efforts to maximize benefits across group lines. Social Issues and Policy Review, 12(1), 57–90. https://doi.org/10.1111/sipr.12040

Brauer

Dumesnil

Campbell

M. R.

(2021). Using a social marketing approach to develop a pro-diversity intervention. Journal of Social Marketing, 11(4), 469–488. https://doi.org/10.1108/JSOCM-09-2020-0174

10.

Brauer

Kennedy

K. R.

(2023). On effects that do occur versus effects that can be made to occur. Frontiers in Social Psychology, 1, Article 1193349. https://doi.org/10.3389/frsps.2023.1193349

11.

Bryan

C. J.

Tipton

Yeager

D. S.

(2021). Behavioural science is unlikely to change the world without a heterogeneity revolution. Nature Human Behaviour, 5(8), 980–989.

12.

Brydon-Miller

(1997). Participatory action research: Psychology and social change. Journal of Social Issues, 53(4), 657–666. https://doi.org/10.1111/0022-4537.00042

13.

Campbell

M. R.

Brauer

(2020). Incorporating social marketing insights into prejudice research: Advancing theory and demonstrating real-world applications. Perspectives on Psychological Science, 15(3), 608–629. https://doi.org/10.1177/174569161989662

14.

Campbell

M. R.

Brauer

(2021). Is discrimination widespread? Testing assumptions about bias on a university campus. Journal of Experimental Psychology: General, 150(4), 756–777. https://doi.org/10.1037/xge0000983

15.

Campbell

M. R.

Brauer

(2022). Social marketing campaigns to address social problems. In Gurung

R. A. R.

(Ed.), The Routledge research encyclopedia of psychology applied to everyday life. Routledge. https://doi.org/10.4324/9780367198459-REPRW103-1

16.

Canning

E. A.

Ozier

Williams

AlRasheed

Murphy

M. C.

(2022). Professors who signal a fixed mindset about ability undermine women’s performance in STEM. Social Psychological and Personality Science, 13(5), 927–937. https://doi.org/10.1177/19485506211030398

17.

Carter

E. R.

Onyeador

I. N.

Lewis

N. A.

(2020). Developing and delivering effective anti-bias training: Challenges and recommendations. Behavioral Science & Policy, 6(1), 57–70. https://doi.org/10.1353/bsp.2020.0005

18.

Chang

E. H.

Milkman

K. L.

Gromet

D. M.

Rebele

R. W.

Massey

Duckworth

A. L.

Grant

A. M.

(2019). The mixed effects of online diversity training. Proceedings of the National Academy of Sciences, 116(16), 7778–7783. https://doi.org/10.1073/pnas.181607611

19.

Cook

J. E.

Purdie-Vaughns

Garcia

Cohen

G. L.

(2012). Chronic threat and contingent belonging: Protective benefits of values affirmation on identity development. Journal of Personality and Social Psychology, 102(3), 479–496. https://doi.org/10.1037/a0026312

20.

Destin

(2020). Identity research that engages contextual factors to reduce socioeconomic disparities in education. Current Directions in Psychological Science, 29(2), 161–166. https://doi.org/10.1177/0963721420901588

21.

Destin

Castillo

Meissner

(2018). A field experiment demonstrates near peer mentorship as an effective support for student persistence. Basic and Applied Social Psychology, 40, 269–278. https://doi.org/10.1080/01973533.2018.1485101

22.

Devine

P. G.

Ash

T. L.

(2022). Diversity training goals, limitations, and promise: A review of the multidisciplinary literature. Annual Review of Psychology, 73, 403–429. https://doi.org/10.1146/annurev-psych-060221-122215

23.

Devine

P. G.

Forscher

P. S.

Austin

A. J.

Cox

W. T. L.

(2012). Long-term reduction in implicit race bias: A prejudice habit-breaking intervention. Journal of Experimental Social Psychology, 48(6), 1267–1278. https://doi.org/10.1016/j.jesp.2012.06.003

24.

Dobbin

Kalev

(2016). Why diversity programs fail. Harvard Business Review, July- August, 2016, 52–60.

25.

Eccles

J. S.

Wigfield

(2002). Motivational beliefs, values, and goals. Annual Review of Psychology, 53(1), 109–132. https://doi.org/10.1146/annurev.psych.53.100901.135153

26.

English

Lambert

S. F.

Tynes

B. M.

Bowleg

Zea

M. C.

Howard

L. C.

(2020). Daily multidimensional racial discrimination among Black U.S. American adolescents. Journal of Applied Developmental Psychology, 66, 101068. https://doi.org/10.1016/j.appdev.2019.101068

27.

Esses

V. M.

(2021). Prejudice and discrimination toward immigrants. Annual Review of Psychology, 72, 503–531. https://doi.org/10.1146/annurev-psych-080520-102803

28.

Gomez

Drahota

Stahmer

A. C.

(2021). Choosing strategies that work from the start: A mixed methods study to understand effective development of community-academic partnerships. Action Research, 19(2), 277–300. https://doi.org/10.1177/1476750318775796

29.

Harackiewicz

J. M.

Canning

E. A.

Tibbetts

Priniski

S. J.

Hyde

J. S.

(2016). Closing achievement gaps with a utility-value intervention: Disentangling race and social class. Journal of Personality and Social Psychology, 111(5), 745–765. https://doi.org/10.1037/pspp0000075

30.

Harackiewicz

J. M.

Hecht

C. A.

Asher

M. W.

Beymer

P. N.

Lamont

L. B.

Wheeler

N. S.

Else-Quest

N. M.

Priniski

S. J.

Smith

J. L.

Hyde

J. S.

Thoman

D. B.

(2023). A prosocial value intervention in gateway STEM courses. Journal of Personality and Social Psychology, 125(6), 1265–1307. https://doi.org/10.1037/pspa0000356

31.

Harackiewicz

J. M.

Priniski

S. J.

(2018). Improving student outcomes in higher education: The science of targeted intervention. Annual Review of Psychology, 69, 409–435. https://doi.org/10.1146/annurev-psych-122216-011725

32.

Hatzenbuehler

M. L.

McLaughlin

K. A.

Keyes

K. M.

Hasin

D. S.

(2010). The impact of institutional discrimination on psychiatric disorders in lesbian, gay, and bisexual populations: A prospective study. American Journal of Public Health, 100(3), 452–459. https://doi.org/10.2105/AJPH.2009.168815

33.

Jones

S. C.

Andrews

Francis

(2017). Combining social norms and social marketing to address underage drinking: Development and process valuation of a whole-of-community intervention. PLOS ONE, 12(1), Article e0169872. https://doi.org/10.1371/journal.pone.0169872

34.

Judd

C. M.

Westfall

Kenny

D. A.

(2012). Treating stimuli as a random factor in social psychology: A new and comprehensive solution to a pervasive but largely ignored problem. Journal of Personality and Social Psychology, 103, 54–69. https://doi.org/10.1037/a0028347

35.

Kaiser

C. R.

Dover

T. L.

Small

Xia

Brady

L. M.

Major

(2022). Diversity initiatives and White Americans’ perceptions of racial victimhood. Personality and Social Psychology Bulletin, 48(6), 968–984. https://doi.org/10.1177/014616722110303

36.

Kenward

M. G.

Roger

J. H.

(1997). Small sample inference for fixed effects from restricted maximum likelihood. Biometrics, 53, 983–997. https://doi.org/10.2307/2533558

37.

Kidd

S. A.

Kral

M. J.

(2005). Practicing participatory action research. Journal of Counseling Psychology, 52(2), 187–195. https://doi.org/10.1037/0022-0167.52.2.187

38.

Lee

N. R.

Kotler

Colehour

(2023). Social marketing: Changing behaviors for good (7th ed.). Sage.

39.

Lee

R. T.

Perez

A. D.

Boykin

C. M.

Mendoza-Denton

(2019). On the prevalence of racial discrimination in the United States. PLOS ONE, 14(1), Article e0210698. https://doi.org/10.1371/journal.pone.0210698

40.

McKenzie-Mohr

(2011). Fostering sustainable behavior: An introduction to community-based social marketing (3rd ed.). New Society.

41.

Miller

A. L.

Stern

Neville

(2019). Forging diversity-science-informed guidelines for research on race and racism in psychological science. Journal of Social Issues, 75(4), 1240–1261. https://doi.org/10.1111/josi.12356

42.

Murrar

Baqai

Padela

A. I.

(2024). Predictors of perceived discrimination in medical settings among Muslim women in the USA. Journal of Racial and Ethnic Health Disparities, 11(1), 150–156. https://doi.org/10.1007/s40615-022-01506-0

43.

Murrar

Campbell

M. R.

Brauer

(2020). Exposure to peers’ pro-diversity attitudes increases inclusion and reduces the achievement gap. Nature Human Behaviour, 4, 889–897. https://doi.org/10.1038/s41562-020-0899-5

44.

National Science Foundation. (2023). Diversity and STEM: Women, minorities, and persons with disabilities. https://ncses.nsf.gov/pubs/nsf23315/report/executive-summary#top

45.

O’Brien

L. T.

Crandall

C. S.

Horstman-Reser

Warner

(2010). But I’m no bigot: How prejudiced White Americans maintain unprejudiced self-images. Journal of Applied Social Psychology, 40(4), 917–946. https://doi.org/10.1111/j.1559-1816.2010.00604.x

46.

Ochocka

Moorlag

Janzen

(2010). A framework for entry: PAR values and engagement strategies in community research. Gateways: International Journal of Community Research and Engagement, 3, 1–19. https://doi.org/10.5130/ijcre.v3i0.1328

47.

Okonofua

J. A.

Harris

L. T.

Walton

G. M.

(2022). Sidelining bias: A situationist approach to reduce the consequences of bias in real-world contexts. Current Directions in Psychological Science, 31(5), 395–404. https://doi.org/10.1177/09637214221102422

48.

Onyeador

I. N.

Hudson

S. T. J.

Lewis

N. A.

(2021). Moving beyond implicit bias training: Policy insights for increasing organizational diversity. Policy Insights from the Behavioral and Brain Sciences, 8(1), 19–26. https://doi.org/10.1177/2372732220983840

49.

Paluck

E. L.

Green

D. P.

(2009). Prejudice reduction: What works? A review and assessment of research and practice. Annual Review of Psychology, 60, 339–367. https://doi.org/10.1146/annurev.psych.60.110707.163607

50.

Paluck

E. L.

Porat

Clark

C. S.

Green

D. P.

(2021). Prejudice reduction: Progress and challenges. Annual Review of Psychology, 72, 533–560. https://doi.org/10.1146/annurev-psych-071620-030619

51.

Pittinsky

T. L.

Rosenthal

S. A.

Montoya

R. M.

(2011). Measuring positive attitudes toward outgroups: Development and validation of the Allophilia Scale. In Tropp

L. R.

Mallett

R. K.

(Eds.), Moving beyond prejudice reduction: Pathways to positive intergroup relations (pp. 41–60). American Psychological Association. https://doi.org/10.1037/12319-002

52.

Prentice

D. A.

Miller

D. T.

(1992). When small effects are impressive. Psychological Bulletin, 112(1), 160–164. https://doi.org/10.1037/0033-2909.112.1.160

53.

Rhodes

Shulman

McClaran

(2020). Changing norms: A meta-analytic integration of research on social norms appeals. Human Communication Research, 46(2–3), 161–191.

54.

Richeson

J. A.

Shelton

J. N.

(2007). Negotiating interracial interactions: Costs, consequences, and possibilities. Current Directions in Psychological Science, 16(6), 316–320. https://doi.org/10.1111/j.1467-8721.2007.00528.x

55.

Schultz

P. W.

Nolan

J. M.

Cialdini

R. B.

Goldstein

N. J.

Griskevicius

(2007). The constructive, destructive, and reconstructive power of social norms. Psychological Science, 18(5), 429–434. https://doi.org/10.1111/j.1467-9280.2007.01917.x

56.

Schwinger

Wirthwein

Lemmer

Steinmayr

(2014). Academic self-handicapping and achievement: A meta-analysis. Journal of Educational Psychology, 106(3), 744–761. https://doi.org/10.1037/a0035832

57.

Silverman

D. M.

Hernandez

I. A.

Destin

(2023). Educators’ beliefs about students’ socioeconomic backgrounds as an avenue for supporting motivation. Personality and Social Psychology Bulletin, 49(2), 215–232. https://doi.org/10.1177/0146167221106194

58.

Solorio

Norton-Shelpuk

Forehand

Montaño

Stern

Aguirre

Martinez

(2016). Tu Amigo Pepe: Evaluation of multi-media marketing campaign that targets young Latino immigrant MSM with HIV testing messages. AIDS and Behavior, 20, 1973–1988. https://doi.org/10.1007/s10461-015-1277-6

59.

Steele

C. M.

Aronson

(1995). Stereotype threat and the intellectual test performance of African Americans. Journal of Personality and Social Psychology, 69(5), 797–811. https://doi.org/10.1037/0022-3514.69.5.797

60.

Stephan

W. G.

Stephan

C. W.

(1985). Intergroup anxiety. Journal of Social Issues, 41, 157–175. https://doi.org/10.1111/j.1540-4560.1985.tb01134.x

61.

Stephan

W. G.

Stephan

C. W.

(2000). An integrated threat theory of prejudice. In Oskamp

(Ed.), Reducing prejudice and discrimination (pp. 23–45). Lawrence Erlbaum.

62.

Trawalter

Richeson

J. A.

Shelton

J. N.

(2009). Predicting behavior during interracial interactions: A stress and coping approach. Personality and Social Psychology Review, 13(4), 243–268. https://doi.org/10.1177/1088868309345850

63.

Walton

G. M.

Crum

A. J.

(Eds.). (2020). Handbook of wise interventions: How social psychology can help people change. The Guilford Press.

64.

Walton

G. M.

Murphy

M. C.

Logel

Yeager

D. S.

Goyer

J. P.

Brady

S. T.

Emerson

K. T. U.

Paunesku

Fotuhi

Blodorn

Boucher

K. L.

Carter

E. R.

Gopalan

Henderson

Kroeper

K. M.

Murdock-Perriera

L. A.

Reeves

S. L.

Ablorh

T. T.

Ansari

. . . Krol

(2023). Where and with whom does a brief social-belonging intervention promote progress in college? Science, 380(6644), 499–505. https://doi.org/10.1126/science.ade4420

65.

Walton

G. M.

Wilson

T. D.

(2018). Wise interventions: Psychological remedies for social and personal problems. Psychological Review, 125(5), 617–655. https://doi.org/10.1037/rev0000115

66.

Walton

G. M.

Yeager

D. S.

(2020). Seed and soil: Psychological affordances in contexts help to explain where wise interventions succeed or fail. Current Directions in Psychological Science, 29(3), 219–226. https://doi.org/10.1177/0963721420904453

67.

S. J.

(2025). Intervention science. In Stern

C. D.

(Ed.) Handbook of Experimental Social Psychology (pp.317-333). Edward Elgar Publishing.

68.

Yeager

D. S.

Carroll

J. M.

Buontempo

Cimpian

Woody

Crosnoe

Muller

Murray

Mhatre

Kersting

Hulleman

Kudym

Murphy

Duckworth

Walton

G. M.

Dweck

C. S.

(2022). Teacher mindsets help explain where a growth mindset intervention does and doesn’t work. Psychological Science, 33(1), 18–32. https://doi.org/10.1177/095679762110289

69.

Yeager

D. S.

Hanselman

Walton

G. M.

Crosnoe

Muller

Tipton

Schneider

Hulleman

C. S.

Hinojosa

C. P.

Paunesku

Romero

Flint

Roberts

Trott

Iachan

Buontempo

Yang

S. M.

Carvalho

C. M.

. . . Dweck

C. S.

(2019). A national experiment reveals where a growth mindset improves achievement. Nature, 573, 364–369. https://doi.org/10.1038/s41586-019-1466-y

70.

Yeager

D. S.

Walton

G. M.

(2011). Social-psychological interventions in education: They’re not magic. Review of Educational Research, 81, 267–301. https://doi.org/10.3102/003465431140599

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.07 MB