Despite much research on improving intergroup relations, the evidence for long-term effects in real-world settings is mixed. We used the social marketing approach to create an “Inclusivity Page” that could be added to course syllabi. The page contained three targeted pro-diversity messages based on social norms, personal benefits, and concrete behavioral recommendations. We tested our intervention in a large randomized controlled trial in university classrooms (Nstudents = 1,799). We obtained students’ course grades and overall college GPAs several years later. A subset of students also completed an outcome survey three months after the intervention. Students from underrepresented racial groups exposed to the intervention early in college had better course grades and GPAs. We also observed an enhanced sense of belonging and better emotional and physical health among students from all marginalized groups. Our research demonstrates the utility of employing a targeted approach to improve experiences of members of marginalized groups.
AdamsG.KurtişT.SalterP. S.AndersonS. L. (2012). A cultural psychology of relationship: Decolonizing science and practice. In GillathO.AdamsG.KunkelA. (Eds.), Relationship science: Integrating evolutionary, neuroscience, and sociocultural approaches (pp. 49–70). American Psychological Association. https://doi.org/10.1037/13489-003
2.
American National Election Studies. (2021, July19). ANES 2020 time series study full release [Dataset and documentation] (2021 Version). www.electionstudies.org
BezrukovaK.SpellC. S.PerryJ. L.JehnK. A. (2016). A meta-analytical integration of over 40 years of research on diversity training evaluation. Psychological Bulletin, 142(11), 1227–1274. https://doi.org/10.1037/bul0000067
5.
BradyL. M.WangC.GriffithsC.YangJ.MarkusH. R.FrybergS. A. (2024). A leadership-level culture cycle intervention changes teachers’ culturally inclusive beliefs and practices. Proceedings of the National Academy of Sciences, 121(25), Article e2322872121. https://doi.org/10.1073/pnas.2322872121
6.
BradyS. T.CohenG. L.JarvisS. N.WaltonG. M. (2020). A brief social-belonging intervention in college improves adult outcomes for black Americans. Science Advances, 6(18), Article eaay3689. https://doi.org/10.1126/sciadv.aay3689
7.
BradyS. T.HardB. M.GrossJ. J. (2018). Reappraising test anxiety increases academic performance of first-year college students. Journal of Educational Psychology, 110(3), 395–406. https://doi.org/10.1037/edu0000219
8.
BrannonT. N.CarterE. R.Murdock-PerrieraL. A.HigginbothamG. D. (2018). From backlash to inclusion for all: Instituting diversity efforts to maximize benefits across group lines. Social Issues and Policy Review, 12(1), 57–90. https://doi.org/10.1111/sipr.12040
9.
BrauerM.DumesnilA.CampbellM. R. (2021). Using a social marketing approach to develop a pro-diversity intervention. Journal of Social Marketing, 11(4), 469–488. https://doi.org/10.1108/JSOCM-09-2020-0174
10.
BrauerM.KennedyK. R. (2023). On effects that do occur versus effects that can be made to occur. Frontiers in Social Psychology, 1, Article 1193349. https://doi.org/10.3389/frsps.2023.1193349
11.
BryanC. J.TiptonE.YeagerD. S. (2021). Behavioural science is unlikely to change the world without a heterogeneity revolution. Nature Human Behaviour, 5(8), 980–989.
12.
Brydon-MillerM. (1997). Participatory action research: Psychology and social change. Journal of Social Issues, 53(4), 657–666. https://doi.org/10.1111/0022-4537.00042
13.
CampbellM. R.BrauerM. (2020). Incorporating social marketing insights into prejudice research: Advancing theory and demonstrating real-world applications. Perspectives on Psychological Science, 15(3), 608–629. https://doi.org/10.1177/174569161989662
14.
CampbellM. R.BrauerM. (2021). Is discrimination widespread? Testing assumptions about bias on a university campus. Journal of Experimental Psychology: General, 150(4), 756–777. https://doi.org/10.1037/xge0000983
15.
CampbellM. R.BrauerM. (2022). Social marketing campaigns to address social problems. In GurungR. A. R. (Ed.), The Routledge research encyclopedia of psychology applied to everyday life. Routledge. https://doi.org/10.4324/9780367198459-REPRW103-1
16.
CanningE. A.OzierE.WilliamsH.AlRasheedR.MurphyM. C. (2022). Professors who signal a fixed mindset about ability undermine women’s performance in STEM. Social Psychological and Personality Science, 13(5), 927–937. https://doi.org/10.1177/19485506211030398
17.
CarterE. R.OnyeadorI. N.LewisN. A. (2020). Developing and delivering effective anti-bias training: Challenges and recommendations. Behavioral Science & Policy, 6(1), 57–70. https://doi.org/10.1353/bsp.2020.0005
18.
ChangE. H.MilkmanK. L.GrometD. M.RebeleR. W.MasseyC.DuckworthA. L.GrantA. M. (2019). The mixed effects of online diversity training. Proceedings of the National Academy of Sciences, 116(16), 7778–7783. https://doi.org/10.1073/pnas.181607611
19.
CookJ. E.Purdie-VaughnsV.GarciaJ.CohenG. L. (2012). Chronic threat and contingent belonging: Protective benefits of values affirmation on identity development. Journal of Personality and Social Psychology, 102(3), 479–496. https://doi.org/10.1037/a0026312
20.
DestinM. (2020). Identity research that engages contextual factors to reduce socioeconomic disparities in education. Current Directions in Psychological Science, 29(2), 161–166. https://doi.org/10.1177/0963721420901588
21.
DestinM.CastilloC.MeissnerL. (2018). A field experiment demonstrates near peer mentorship as an effective support for student persistence. Basic and Applied Social Psychology, 40, 269–278. https://doi.org/10.1080/01973533.2018.1485101
22.
DevineP. G.AshT. L. (2022). Diversity training goals, limitations, and promise: A review of the multidisciplinary literature. Annual Review of Psychology, 73, 403–429. https://doi.org/10.1146/annurev-psych-060221-122215
23.
DevineP. G.ForscherP. S.AustinA. J.CoxW. T. L. (2012). Long-term reduction in implicit race bias: A prejudice habit-breaking intervention. Journal of Experimental Social Psychology, 48(6), 1267–1278. https://doi.org/10.1016/j.jesp.2012.06.003
EnglishD.LambertS. F.TynesB. M.BowlegL.ZeaM. C.HowardL. C. (2020). Daily multidimensional racial discrimination among Black U.S. American adolescents. Journal of Applied Developmental Psychology, 66, 101068. https://doi.org/10.1016/j.appdev.2019.101068
GomezE.DrahotaA.StahmerA. C. (2021). Choosing strategies that work from the start: A mixed methods study to understand effective development of community-academic partnerships. Action Research, 19(2), 277–300. https://doi.org/10.1177/1476750318775796
29.
HarackiewiczJ. M.CanningE. A.TibbettsY.PriniskiS. J.HydeJ. S. (2016). Closing achievement gaps with a utility-value intervention: Disentangling race and social class. Journal of Personality and Social Psychology, 111(5), 745–765. https://doi.org/10.1037/pspp0000075
30.
HarackiewiczJ. M.HechtC. A.AsherM. W.BeymerP. N.LamontL. B.WheelerN. S.Else-QuestN. M.PriniskiS. J.SmithJ. L.HydeJ. S.ThomanD. B. (2023). A prosocial value intervention in gateway STEM courses. Journal of Personality and Social Psychology, 125(6), 1265–1307. https://doi.org/10.1037/pspa0000356
31.
HarackiewiczJ. M.PriniskiS. J. (2018). Improving student outcomes in higher education: The science of targeted intervention. Annual Review of Psychology, 69, 409–435. https://doi.org/10.1146/annurev-psych-122216-011725
32.
HatzenbuehlerM. L.McLaughlinK. A.KeyesK. M.HasinD. S. (2010). The impact of institutional discrimination on psychiatric disorders in lesbian, gay, and bisexual populations: A prospective study. American Journal of Public Health, 100(3), 452–459. https://doi.org/10.2105/AJPH.2009.168815
33.
JonesS. C.AndrewsK.FrancisK. (2017). Combining social norms and social marketing to address underage drinking: Development and process valuation of a whole-of-community intervention. PLOS ONE, 12(1), Article e0169872. https://doi.org/10.1371/journal.pone.0169872
34.
JuddC. M.WestfallJ.KennyD. A. (2012). Treating stimuli as a random factor in social psychology: A new and comprehensive solution to a pervasive but largely ignored problem. Journal of Personality and Social Psychology, 103, 54–69. https://doi.org/10.1037/a0028347
35.
KaiserC. R.DoverT. L.SmallP.XiaG.BradyL. M.MajorB. (2022). Diversity initiatives and White Americans’ perceptions of racial victimhood. Personality and Social Psychology Bulletin, 48(6), 968–984. https://doi.org/10.1177/014616722110303
36.
KenwardM. G.RogerJ. H. (1997). Small sample inference for fixed effects from restricted maximum likelihood. Biometrics, 53, 983–997. https://doi.org/10.2307/2533558
LeeN. R.KotlerP.ColehourJ. (2023). Social marketing: Changing behaviors for good (7th ed.). Sage.
39.
LeeR. T.PerezA. D.BoykinC. M.Mendoza-DentonR. (2019). On the prevalence of racial discrimination in the United States. PLOS ONE, 14(1), Article e0210698. https://doi.org/10.1371/journal.pone.0210698
40.
McKenzie-MohrD. (2011). Fostering sustainable behavior: An introduction to community-based social marketing (3rd ed.). New Society.
41.
MillerA. L.SternC.NevilleH. (2019). Forging diversity-science-informed guidelines for research on race and racism in psychological science. Journal of Social Issues, 75(4), 1240–1261. https://doi.org/10.1111/josi.12356
42.
MurrarS.BaqaiB.PadelaA. I. (2024). Predictors of perceived discrimination in medical settings among Muslim women in the USA. Journal of Racial and Ethnic Health Disparities, 11(1), 150–156. https://doi.org/10.1007/s40615-022-01506-0
43.
MurrarS.CampbellM. R.BrauerM. (2020). Exposure to peers’ pro-diversity attitudes increases inclusion and reduces the achievement gap. Nature Human Behaviour, 4, 889–897. https://doi.org/10.1038/s41562-020-0899-5
O’BrienL. T.CrandallC. S.Horstman-ReserA.WarnerR. (2010). But I’m no bigot: How prejudiced White Americans maintain unprejudiced self-images. Journal of Applied Social Psychology, 40(4), 917–946. https://doi.org/10.1111/j.1559-1816.2010.00604.x
46.
OchockaJ.MoorlagE.JanzenR. (2010). A framework for entry: PAR values and engagement strategies in community research. Gateways: International Journal of Community Research and Engagement, 3, 1–19. https://doi.org/10.5130/ijcre.v3i0.1328
47.
OkonofuaJ. A.HarrisL. T.WaltonG. M. (2022). Sidelining bias: A situationist approach to reduce the consequences of bias in real-world contexts. Current Directions in Psychological Science, 31(5), 395–404. https://doi.org/10.1177/09637214221102422
48.
OnyeadorI. N.HudsonS. T. J.LewisN. A. (2021). Moving beyond implicit bias training: Policy insights for increasing organizational diversity. Policy Insights from the Behavioral and Brain Sciences, 8(1), 19–26. https://doi.org/10.1177/2372732220983840
PittinskyT. L.RosenthalS. A.MontoyaR. M. (2011). Measuring positive attitudes toward outgroups: Development and validation of the Allophilia Scale. In TroppL. R.MallettR. K. (Eds.), Moving beyond prejudice reduction: Pathways to positive intergroup relations (pp. 41–60). American Psychological Association. https://doi.org/10.1037/12319-002
RhodesN.ShulmanH.McClaranN. (2020). Changing norms: A meta-analytic integration of research on social norms appeals. Human Communication Research, 46(2–3), 161–191.
54.
RichesonJ. A.SheltonJ. N. (2007). Negotiating interracial interactions: Costs, consequences, and possibilities. Current Directions in Psychological Science, 16(6), 316–320. https://doi.org/10.1111/j.1467-8721.2007.00528.x
55.
SchultzP. W.NolanJ. M.CialdiniR. B.GoldsteinN. J.GriskeviciusV. (2007). The constructive, destructive, and reconstructive power of social norms. Psychological Science, 18(5), 429–434. https://doi.org/10.1111/j.1467-9280.2007.01917.x
56.
SchwingerM.WirthweinL.LemmerG.SteinmayrR. (2014). Academic self-handicapping and achievement: A meta-analysis. Journal of Educational Psychology, 106(3), 744–761. https://doi.org/10.1037/a0035832
57.
SilvermanD. M.HernandezI. A.DestinM. (2023). Educators’ beliefs about students’ socioeconomic backgrounds as an avenue for supporting motivation. Personality and Social Psychology Bulletin, 49(2), 215–232. https://doi.org/10.1177/0146167221106194
58.
SolorioR.Norton-ShelpukP.ForehandM.MontañoD.SternJ.AguirreJ.MartinezM. (2016). Tu Amigo Pepe: Evaluation of multi-media marketing campaign that targets young Latino immigrant MSM with HIV testing messages. AIDS and Behavior, 20, 1973–1988. https://doi.org/10.1007/s10461-015-1277-6
59.
SteeleC. M.AronsonJ. (1995). Stereotype threat and the intellectual test performance of African Americans. Journal of Personality and Social Psychology, 69(5), 797–811. https://doi.org/10.1037/0022-3514.69.5.797
StephanW. G.StephanC. W. (2000). An integrated threat theory of prejudice. In OskampS. (Ed.), Reducing prejudice and discrimination (pp. 23–45). Lawrence Erlbaum.
62.
TrawalterS.RichesonJ. A.SheltonJ. N. (2009). Predicting behavior during interracial interactions: A stress and coping approach. Personality and Social Psychology Review, 13(4), 243–268. https://doi.org/10.1177/1088868309345850
63.
WaltonG. M.CrumA. J. (Eds.). (2020). Handbook of wise interventions: How social psychology can help people change. The Guilford Press.
64.
WaltonG. M.MurphyM. C.LogelC.YeagerD. S.GoyerJ. P.BradyS. T.EmersonK. T. U.PauneskuD.FotuhiO.BlodornA.BoucherK. L.CarterE. R.GopalanM.HendersonA.KroeperK. M.Murdock-PerrieraL. A.ReevesS. L.AblorhT. T.AnsariS.. . . KrolN. (2023). Where and with whom does a brief social-belonging intervention promote progress in college?Science, 380(6644), 499–505. https://doi.org/10.1126/science.ade4420
65.
WaltonG. M.WilsonT. D. (2018). Wise interventions: Psychological remedies for social and personal problems. Psychological Review, 125(5), 617–655. https://doi.org/10.1037/rev0000115
66.
WaltonG. M.YeagerD. S. (2020). Seed and soil: Psychological affordances in contexts help to explain where wise interventions succeed or fail. Current Directions in Psychological Science, 29(3), 219–226. https://doi.org/10.1177/0963721420904453
67.
WuS. J. (2025). Intervention science. In SternC. D. (Ed.) Handbook of Experimental Social Psychology (pp.317-333). Edward Elgar Publishing.
68.
YeagerD. S.CarrollJ. M.BuontempoJ.CimpianA.WoodyS.CrosnoeR.MullerC.MurrayJ.MhatreP.KerstingN.HullemanC.KudymM.MurphyM.DuckworthA.WaltonG. M.DweckC. S. (2022). Teacher mindsets help explain where a growth mindset intervention does and doesn’t work. Psychological Science, 33(1), 18–32. https://doi.org/10.1177/095679762110289
69.
YeagerD. S.HanselmanP.WaltonG. M.CrosnoeR.MullerC.TiptonE.SchneiderB.HullemanC. S.HinojosaC. P.PauneskuD.RomeroC.FlintK.RobertsA.TrottJ.IachanR.BuontempoJ.YangS. M.CarvalhoC. M.. . . DweckC. S. (2019). A national experiment reveals where a growth mindset improves achievement. Nature, 573, 364–369. https://doi.org/10.1038/s41586-019-1466-y
70.
YeagerD. S.WaltonG. M. (2011). Social-psychological interventions in education: They’re not magic. Review of Educational Research, 81, 267–301. https://doi.org/10.3102/003465431140599
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
