Restricted accessResearch articleFirst published online 2023-12
Use of the Heterosexist Harassment,Rejection,and Discrimination Scale With Different Sexual Orientation,Gender,and Racial/Ethnic Groups: An Examination of Measurement Invariance
The Heterosexist Harassment, Rejection, and Discrimination Scale (HHRDS) is one of the most commonly used measures of sexual orientation-related discrimination, but little is known about its psychometric properties across different sexual orientations, gender, and racial/ethnic groups. A three-factor model was initially obtained, but most studies treat the HHRDS unidimensionally. Therefore, we tested whether the HHRDS exhibited measurement invariance across sexual orientation, gender, and racial/ethnic groups among 792 sexual minority young adults (aged 18–29) who participated in an online study. Across models, the three-factor solution fit better than the one-factor solution. All models achieved configural invariance and most achieved metric invariance; none of the considered models achieved scalar invariance (1–3 items were not equivalent across groups, depending on the comparison). Findings suggest that the HHRDS generally functions equivalently across sexual orientation, gender, and racial/ethnic groups, but some caution in interpreting scores is warranted.
BalsamK. F.MolinaY.BeadnellB.SimoniJ.WaltersK. (2011). Measuring multiple minority stress: The LGBT People of Color Microaggressions Scale. Cultural Diversity and Ethnic Minority Psychology, 17(2), 163–174. https://doi.org/10.1037/a0023244
2.
BrooksV. R. (1981). Minority stress and lesbian women. Lexington Books.
3.
CaseyL. S.ReisnerS. L.FindlingM. G.BlendonR. J.BensonJ. M.SaydeJ. M.MillerC. (2019). Discrimination in the United States: Experiences of lesbian, gay, bisexual, transgender, and queer Americans. Health Services Research, 54(S2), 1454–1466. https://doi.org/10.1111/1475-6773.13229
4.
ChangC. J.FeinsteinB. A.ChuB. C.SelbyE. A. (2022). Application of minority stress and the interpersonal theory of suicide in bisexual+ versus gay/lesbian young adults. Suicide and Life-Threatening Behavior. Advance online publication. https://doi.org/10.1111/sltb.12856
5.
CheungG. W.RensvoldR. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9(2), 233–255. https://doi.org/10.1207/S15328007SEM0902_5
6.
DeBlaereC.BrewsterM. E.BertschK. N.DeCarloA. L.KegelK. A.PresseauC. D. (2014). The protective power of collective action for sexual minority women of color: An investigation of multiple discrimination experiences and psychological distress. Psychology of Women Quarterly, 38(1), 20–32. https://doi.org/10.1177/0361684313493252
7.
DunnT. L.SzymanskiD. M. (2018). Heterosexist discrimination and LGBQ activism: Examining a moderated mediation model. Psychology of Sexual Orientation and Gender Diversity, 5(1), 13–24. https://doi.org/10.1037/sgd0000250
8.
DyarC.FeinsteinB. A. (2018). Binegativity: Attitudes toward and stereotypes about bisexual individuals. In SwanD. J.HabibiS. (Eds.), Bisexuality: Theories, research, and recommendations for the invisible sexuality (pp. 95–111). Springer.
9.
DyarC.FeinsteinB. A.StephensJ.ZimmermanA. R.NewcombM. E.WhittonS. W. (2020). Nonmonosexual stress and dimensions of health: Within-group variation by sexual, gender, and racial/ethnic identities. Psychology of Sexual Orientation and Gender Diversity, 7(1), 12–25. https://doi.org/10.1037/sgd0000348
FeinsteinB. A.GoldfriedM. R.DavilaJ. (2012). The relationship between experiences of discrimination and mental health among lesbians and gay men: An examination of internalized homonegativity and rejection sensitivity as potential mechanisms. Journal of Consulting and Clinical Psychology, 80(5), 917–927. https://doi.org/10.1037/a0029425
12.
FeinsteinB. A.WadsworthL. P.DavilaJ.GoldfriedM. R. (2014). Do parental acceptance and family support moderate associations between dimensions of minority stress and depressive symptoms among lesbians and gay men?Professional Psychology: Research and Practice, 45(4), 239–246. https://doi.org/10.1037/a0035393
13.
FlentjeA.HeckN. C.BrennanJ. M.MeyerI. H. (2020). The relationship between minority stress and biological outcomes: A systematic review. Journal of Behavioral Medicine, 43(5), 673–694. https://doi.org/10.1007/s10865-019-00120-6
14.
FriedmanC.LeaperC. (2010). Sexual minority college women’s experiences with discrimination: Relations with identity and collective action. Psychology of Women Quarterly, 34(2), 152–164. https://doi.org/10.1111/j.1471-6402.2010.01558.x
15.
HequembourgA. L.BrallierS. A. (2009). An exploration of sexual minority stress across the lines of gender and sexual identity. Journal of Homosexuality, 56(3), 273–298. https://doi.org/10.1080/00918360902728517
16.
HermanJ. L. (2013). Gendered restrooms and minority stress: The public regulation of gender and its impact on transgender people’s lives. Journal of Public Management & Social Policy, 19(1), 65–80.
17.
HuL.BentlerP. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. https://doi.org/10.1080/10705519909540118
18.
JeffriesW. L.FloresS. A.Rooks-PeckC. R.GelaudeD. J.BelcherL.RicksP. M.MillettG. A. (2021). Experienced homophobia and HIV infection risk among U.S. gay, bisexual, and other men who have sex with men: A meta-analysis. LGBT Health, 8(1), 1–10. https://doi.org/10.1089/lgbt.2020.0274
19.
KahleE. M.VelizP.McCabeS. E.BoydC. J. (2021). Psychiatric disorders mediates the association between sexual orientation discrimination and substance use disorders among sexual minority adults. Annals of LGBTQ Public and Population Health, 2(4), 236–255. https://doi.org/10.1891/LGBTQ-2021-0002
20.
Katz-WiseS. L.MereishE. H.WoulfeJ. (2017). Associations of bisexual-specific minority stress and health among cisgender and transgender adults with bisexual orientation. The Journal of Sex Research, 54(7), 899–910. https://doi.org/10.1080/00224499.2016.1236181
21.
KingM.SemlyenJ.TaiS. S.KillaspyH.OsbornD.PopelyukD.NazarethI. (2008). A systematic review of mental disorder, suicide, and deliberate self harm in lesbian, gay and bisexual people. BMC Psychiatry, 8(1), Article 70. https://doi.org/10.1186/1471-244X-8-70
22.
KleimanS.SpaniermanL. B.SmithN. G. (2015). Translating oppression: Understanding how sexual minority status is associated with White men’s racial attitudes. Psychology of Men & Masculinity, 16(4), 404–415. https://doi.org/10.1037/a0038797
23.
LeeJ. H.GamarelK. E.BryantK. J.ZallerN. D.OperarioD. (2016). Discrimination, mental health, and substance use disorders among sexual minority populations. LGBT Health, 3(4), 258–265. https://doi.org/10.1089/lgbt.2015.0135
24.
LehavotK.SimoniJ. M. (2011). The impact of minority stress on mental health and substance use among sexual minority women. Journal of Consulting and Clinical Psychology, 79(2), 159–170. https://doi.org/10.1037/a0022839
25.
LiuR. T.SheehanA. E.WalshR. F. L.SanzariC. M.CheekS. M.HernandezE. M. (2019). Prevalence and correlates of non-suicidal self-injury among lesbian, gay, bisexual, and transgender individuals: A systematic review and meta-analysis. Clinical Psychology Review, 74, 101783. https://doi.org/10.1016/j.cpr.2019.101783
MeyerI. H. (2003). Prejudice, social stress, and mental health in lesbian, gay, and bisexual populations: Conceptual issues and research evidence. Psychological Bulletin, 129(5), 674–697. https://doi.org/10.1037/0033-2909.129.5.674
28.
MeyerI. H.FrostD. M. (2013). Minority stress and the health of sexual minorities. In PattersonC. J.D’AugelliA. R. (Eds.), Handbook of psychology and sexual orientation (pp. 252–266). Oxford University Press.
29.
MeyerI. H.RussellS. T.HammackP. L.FrostD. M.WilsonB. D. M. (2021). Minority stress, distress, and suicide attempts in three cohorts of sexual minority adults: A U.S. probability sample. PLOS ONE, 16(3), Article e0246827. https://doi.org/10.1371/journal.pone.0246827
30.
MillsapR. E. (2011). Statistical approaches to measurement invariance. Routledge.
31.
MizockL.WoodrumT. D.RileyJ.SotilleoE. A.YuenN.OrmerodA. J. (2017). Coping with transphobia in employment: Strategies used by transgender and gender-diverse people in the United States. International Journal of Transgenderism, 18(3), 282–294. https://doi.org/10.1080/15532739.2017.1304313
32.
MohrJ. J.RochlenA. B. (1999). Measuring attitudes regarding bisexuality in lesbian, gay male, and heterosexual populations. Journal of Counseling Psychology, 46(3), 353–369. https://doi.org/10.1037/0022-0167.46.3.353
33.
MorrisonT. G.BishopC.MorrisonM. A.Parker-TaneoK. (2016). A psychometric review of measures assessing discrimination against sexual minorities. Journal of Homosexuality, 63(8), 1086–1126. https://doi.org/10.1080/00918369.2015.1117903
OshanaA.KlimekP.BlashillA. J. (2020). Minority stress and body dysmorphic disorder symptoms among sexual minority adolescents and adult men. Body Image, 34, 167–174. https://doi.org/10.1016/j.bodyim.2020.06.001
PutnickD. L.BornsteinM. H. (2016). Measurement invariance conventions and reporting: The state of the art and future directions for psychological research. Developmental Review, 41, 71–90. https://doi.org/10.1016/j.dr.2016.06.004
39.
ReisnerS. L.HughtoJ. M. W.DunhamE. E.HeflinK. J.BegenyiJ. B. G.Coffey-EsquivelJ.CahillS. (2015). Legal protections in public accommodations settings: A critical public health issue for transgender and gender-nonconforming people. The Milbank Quarterly, 93(3), 484–515. https://doi.org/10.1111/1468-0009.12127
40.
RhemtullaM.van BorkR.BorsboomD. (2020). Worse than measurement error: Consequences of inappropriate latent variable measurement models. Psychological Methods, 25(1), 30–45. https://doi.org/10.1037/met0000220
41.
SemlyenJ.KingM.VarneyJ.Hagger-JohnsonG. (2016). Sexual orientation and symptoms of common mental disorder or low wellbeing: Combined meta-analysis of 12 UK population health surveys. BMC Psychiatry, 16(1), Article 67. https://doi.org/10.1186/s12888-016-0767-z
42.
SmithE. R.PerrinP. B.SutterM. E. (2020). Factor analysis of the heterosexist harassment, rejection, and discrimination scale in lesbian, gay, bisexual, transgender, and queer people of colour. International Journal of Psychology: Journal International De Psychologie, 55(3), 405–412. https://doi.org/10.1002/ijop.12585
43.
SutterM.PerrinP. (2016). Discrimination, mental health, and suicidal ideation among LGBTQ people of color. Journal of Counseling Psychology, 63, 98–105. https://doi.org/10.1037/cou0000126
44.
SzymanskiD. M. (2006). Does internalized heterosexism moderate the link between heterosexist events and lesbians’ psychological distress?Sex Roles, 54(3), 227–234. https://doi.org/10.1007/s11199-006-9340-4
45.
SzymanskiD. M. (2009). Examining potential moderators of the link between heterosexist events and gay and bisexual men’s psychological distress. Journal of Counseling Psychology, 56(1), 142–151. https://doi.org/10.1037/0022-0167.56.1.142
46.
SzymanskiD. M.DunnT. L.IkizlerA. S. (2014). Multiple minority stressors and psychological distress among sexual minority women: The roles of rumination and maladaptive coping. Psychology of Sexual Orientation and Gender Diversity, 1(4), 412–421. https://doi.org/10.1037/sgd0000066
47.
SzymanskiD. M.GuptaA. (2009). Examining the relationship between multiple internalized oppressions and African American lesbian, gay, bisexual, and questioning persons’ self-esteem and psychological distress. Journal of Counseling Psychology, 56(1), 110–118. https://doi.org/10.1037/a0013317
48.
SzymanskiD. M.Henrichs-BeckC. (2014). Exploring sexual minority women’s experiences of external and internalized heterosexism and sexism and their links to coping and distress. Sex Roles, 70(1–2), 28–42. https://doi.org/10.1007/s11199-013-0329-5
49.
SzymanskiD. M.IkizlerA. S. (2013). Internalized heterosexism as a mediator in the relationship between gender role conflict, heterosexist discrimination, and depression among sexual minority men. Psychology of Men & Masculinity, 14(2), 211–219. https://doi.org/10.1037/a0027787
50.
VelezB. L.MoradiB.DeBlaereC. (2015). Multiple oppressions and the mental health of sexual minority Latina/o individuals. The Counseling Psychologist, 43(1), 7–38. https://doi.org/10.1177/0011000014542836
51.
WatsonL. B.GrotewielM.FarrellM.MarshikJ.SchneiderM. (2015). Experiences of sexual objectification, minority stress, and disordered eating among sexual minority women. Psychology of Women Quarterly, 39(4), 458–470. https://doi.org/10.1177/0361684315575024
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
