Loneliness in Gender-Diverse and Sexual Orientation–Diverse Adolescents: Measurement Invariance Analyses and Between-Group Comparisons

Abstract

Youth loneliness is a risk factor for myriad adverse psychosocial outcomes, making it a potentially informative construct for assessment and treatment research. Minority stressors may place LGBTQ+ (lesbian, gay, bisexual, transgender, and queer) youths at high risk of loneliness. However, the prevalence of loneliness across gender and sexual identities cannot be precisely estimated or compared without establishing that common measures assess the construct equivalently across groups. In a preregistered study, we determined the optimal structure of the UCLA Loneliness Scale and investigated whether it showed invariance across gender and sexual identities in a national U.S. sample of adolescents with elevated depressive symptoms (N = 2,431; https://osf.io/52ctd). Results supported strict invariance, indicating that loneliness scores can be meaningfully compared across groups in this sample. Exploratory analyses indicated that loneliness levels and LGBTQ+ identity predicted levels of depression and anxiety. We discuss implications for research on loneliness, health disparities, and psychopathology in high-symptom youths.

Keywords

loneliness LGBTQ+measurement invariance health disparities minority stress

Get full access to this article

View all access options for this article.

References

Acevedo-Polakovich

I. D.

Bell

Gamache

Christian

A. S.

(2013). Service accessibility for lesbian, gay, bisexual, transgender, and questioning youth. Youth & Society, 45(1), 75–97.

Allen

R. L.

Oshagan

(1995). The UCLA loneliness scale: Invariance of social structural characteristics. Personality and Individual Differences, 19(2), 185–195.

Austin

B. A.

(1983). Factorial structure of the UCLA Loneliness Scale. Psychological Reports, 53(3), 883–889.

Baams

Dubas

J. S.

Russell

S. T.

Buikema

R. L.

van Aken

M. A.

(2018). Minority stress, perceived burdensomeness, and depressive symptoms among sexual minority youth. Journal of Adolescence, 66, 9–18.

Balsis

Gleason

M. E.

Woods

C. M.

Oltmanns

T. F.

(2007). An item response theory analysis of DSM-IV personality disorder criteria across younger and older age groups. Psychology and Aging, 22(1), 171–185.

Barreto

Victor

Hammond

Eccles

Richins

M. T.

Qualter

(2021). Loneliness around the world: Age, gender, and cultural differences in loneliness. Personality and Individual Differences, 169, 110066.

Brown

T. A.

(2015). Confirmatory factor analysis for applied research. Guilford Press.

Carmel

T. C.

Erickson-Schroth

(2016). Mental health and the transgender population. Journal of Psychosocial Nursing and Mental Health Services, 54(12), 44–48.

Centers for Disease Control and Prevention. (2020). Youth risk behavior survey data. www.cdc.gov/yrbs

10.

Cheung

G. W.

Rensvold

R. B.

(2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9(2), 233–255.

11.

Dargie

Blair

K. L.

Pukall

C. F.

Coyle

S. M.

(2014). Somewhere under the rainbow: Exploring the identities and experiences of trans persons. The Canadian Journal of Human Sexuality, 23(2), 60–74.

12.

D’augelli

A. R.

(2002). Mental health problems among lesbian, gay, and bisexual youths ages 14 to 21. Clinical Child Psychology and Psychiatry, 7(3), 433–456.

13.

Deckx

van den Akker

Buntinx

(2014). Risk factors for loneliness in patients with cancer: A systematic literature review and meta-analysis. European Journal of Oncology Nursing, 18(5), 466–477.

14.

Dodeen

(2014). The effects of positively and negatively worded Items on the factor structure of the UCLA Loneliness Scale. Journal of Psychoeducational Assessment, 33(3), 259–267.

15.

Dueber

D. M.

(2017). Bifactor indices calculator: A Microsoft Excel-based tool to calculate various indices relevant to bifactor CFA models. https://doi.org/10.13023/edp.tool.01

16.

Dussault

Fernet

Austin

Leroux

(2009). Revisiting the factorial validity of the Revised UCLA Loneliness Scale: A test of competing models in a sample of teachers. Psychological Reports, 105(3), 849–856.

17.

Eaton

N. R.

(2020). Measurement and mental health disparities: Psychopathology classification and identity assessment. Personality and Mental Health, 14(1), 76–87.

18.

Eaton

N. R.

Rodriguez-Seijas

Pachankis

J. E.

(in press). Transdiagnostic approaches to sexual- and gender- minority mental health. Current Directions in Psychological Science. https://doi.org/10.1177/09637214211043918

19.

Ebesutani

Fierstein

Viana

A. G.

Trent

Young

Sprung

(2015). The role of loneliness in the relationship between anxiety and depression in clinical and school-based youth. Psychology in the Schools, 52(3), 223–234.

20.

Espinoza

(2014). Out & visible: The experiences and attitudes of lesbian, gay, bisexual and transgender older adults, ages 45-75. SAGE. https://www.sageusa.org/wp-content/uploads/2018/05/sageusa-out-visible-lgbt-market-research-full-report.pdf

21.

Gillig

T. K.

Valente

T. W.

Baezconde-Garbanati

(2020). Depressive symptoms and parental support-seeking in Latinx adolescents: Analyzing variation based on LGBT identity. Journal of LGBT Youth, 17, 1–16.

22.

Gregorich

S. E.

(2006). Do self-report instruments allow meaningful comparisons across diverse population groups? Testing measurement invariance using the confirmatory factor analysis framework. Medical Care, 44(11 Suppl. 3), S78.

23.

Grygiel

Humenny

Rebisz

Świtaj

Sikorska

(2013). Validating the Polish adaptation of the 11-item de Jong Gierveld Loneliness Scale. European Journal of Psychological Assessment. https://www.growkudos.com/publications/10.1027%25252F1015-5759%25252Fa000130/reader

24.

Hartshorne

T. S.

(1993). Psychometric properties and confirmatory factor analysis of the UCLA Loneliness Scale. Journal of Personality Assessment, 61(1), 182–195.

25.

Hatzenbuehler

M. L.

McLaughlin

K. A.

Nolen-Hoeksema

(2008). Emotion regulation and internalizing symptoms in a longitudinal study of sexual minority and heterosexual adolescents. Journal of Child Psychology and Psychiatry, 49(12), 1270–1278.

26.

Heinrich

L. M.

Gullone

(2006). The clinical significance of loneliness: A literature review. Clinical Psychology Review, 26(6), 695–718.

27.

Hsieh

Liu

(2021). Social relationships and loneliness in late adulthood: Disparities by sexual orientation. Journal of Marriage and Family, 83(1), 57–74.

28.

L. T.

Bentler

P. M.

(1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55.

29.

Johns

M. M.

Lowry

Andrzejewski

Barrios

L. C.

Demissie

McManus

Rasberry

C. N.

Robin

Underwood

J. M.

(2019). Transgender identity and experiences of violence victimization, substance use, suicide risk, and sexual risk behaviors among high school students—19 states and large urban school districts, 2017. Morbidity and Mortality Weekly Report, 68(3), 67–71.

30.

Jones

J. M.

(2021). LGBT identification rises to 5.6% in latest US estimate. Politics.

31.

Jones

Hillier

(2013). Comparing trans-spectrum and same-sex-attracted youth in Australia: Increased risks, increased activisms. Journal of LGBT Youth, 10(4), 287–307.

32.

Kim

H. J.

Fredriksen-Goldsen

K. I.

(2016). Living arrangement and loneliness among lesbian, gay, and bisexual older adults. The Gerontologist, 56(3), 548–558.

33.

Kline

R. B.

(2015). Principles and practice of structural equation modeling. Guilford Press.

34.

Kline

(2005). Psychological testing: A practical approach to design and evaluation. SAGE.

35.

Knight

R. G.

Chisholm

B. J.

Marsh

N. V.

Godfrey

H. P. D.

(1988). Some normative, reliability, and factor analytic data for the revised UCLA Loneliness scale. Journal of Clinical Psychology, 44(2), 203–206.

36.

Kovacs

(2011). Children’s Depression Inventory–2 (2nd ed). Multi-Health Systems.

37.

Lasgaard

(2007). Reliability and validity of the Danish version of the UCLA Loneliness Scale. Personality and Individual Differences, 42(7), 1359–1366.

38.

Loades

M. E.

Chatburn

Higson-Sweeney

Reynolds

Shafran

Brigden

Linney

McManus

M. N.

Borwick

Crawley

(2020). Rapid systematic review: The impact of social isolation and loneliness on the mental health of children and adolescents in the context of COVID-19. Journal of the American Academy of Child & Adolescent Psychiatry, 59(11), 1218–1239.

39.

Maes

Vanhalst

Van den Noortgate

Goossens

(2017). Intimate and relational loneliness in adolescence. Journal of Child and Family Studies, 26(8), 2059–2069.

40.

McWhirter

B. T.

(1990). Factor analysis of the revised UCLA loneliness scale. Current Psychology, 9(1), 56–68.

41.

Meredith

Teresi

J. A.

(2006). An essay on measurement and factorial invariance. Medical Care, 44(11 Suppl. 3):S69–S77.

42.

Mereish

E. H.

Katz-Wise

S. L.

Woulfe

(2017). Bisexual-specific minority stressors, psychological distress, and suicidality in bisexual individuals: The mediating role of loneliness. Prevention Science, 18(6), 716–725.

43.

Mereish

E. H.

Poteat

V. P.

(2015). A relational model of sexual minority mental and physical health: The negative effects of shame on relationships, loneliness, and health. Journal of Counseling Psychology, 62(3), 425.

44.

Meyer

I. H.

(1995). Minority stress and mental health in gay men. Journal of Health and Social Behavior, 36, 38–56.

45.

Meyer

I. H.

Frost

D. M.

(2013). Minority stress and the health of sexual minorities. In Patterson

C. J.

D’Augelli

A. R.

(Eds.), Handbook of psychology and sexual orientation (pp. 252–266). Oxford University Press.

46.

Perry

G. R.

(1990). Loneliness and coping among tertiary-level adult cancer patients in the home. Cancer Nursing, 13(5), 293–302.

47.

Reise

S. P.

(2012). The rediscovery of bifactor measurement models. Multivariate Behavioral Research, 47(5), 667–696.

48.

Reise

S. P.

Kim

D. S.

Mansolf

Widaman

K. F.

(2016). Is the bifactor model a better model or is it just better at modeling implausible responses? Application of iteratively reweighted least squares to the Rosenberg Self-Esteem Scale. Multivariate Behavioral Research, 51(6), 818–838.

49.

Rosseel

(2012). Lavaan: An R package for structural equation modeling and more. Version 0.5–12 (BETA). Journal of Statistical Software, 48(2), 1–36.

50.

Russell

D. W.

(1996). UCLA Loneliness Scale (Version 3): Reliability, validity, and factor structure. Journal of Personality Assessment, 66(1), 20–40.

51.

Salerno

J. P.

Doan

Sayer

L. C.

Drotning

K. J.

Rinderknecht

R. G.

Fish

J. N.

(2021). Changes in mental health and well-being are associated with living arrangements with parents during COVID-19 among sexual minority young persons in the U.S. Psychology of Sexual Orientation and Gender Diversity. Advance online publication. http://dx.doi.org/10.1037/sgd0000520

52.

Schleider

J. L.

Mullarkey

M. C.

Fox

Dobias

Shroff

Hart

Roulston

C. A.

(2021). A randomized trial of online single session interventions for adolescent depression during COVID-19. Nature Human Behaviour. https://doi.org/10.31234/osf.io/ved4p

53.

Semlyen

King

Varney

Hagger-Johnson

(2016). Sexual orientation and symptoms of common mental disorder or low wellbeing: Combined meta-analysis of 12 UK population health surveys. BMC Psychiatry, 16(1), 1–9.

54.

Sevil

Ü. M. R. A. N.

Ertem

Kavlak

Ç. O. B. A. N. A

. (2006). The loneliness level of patients with gynecological cancer. International Journal of Gynecologic Cancer, 16(Suppl. 1). https://ijgc.bmj.com/content/16/Suppl_1/472

55.

Shearer

Herres

Kodish

Squitieri

James

Russon

Atte

Diamond

G. S.

(2016). Differences in mental health symptoms across lesbian, gay, bisexual, and questioning youth in primary care settings. Journal of Adolescent Health, 59(1), 38–43.

56.

Shevlin

Murphy

(2014). The latent structure of loneliness. Assessment, 22(2), 208–215.

57.

Spitzer

R. L.

Kroenke

Williams

J. B.

Löwe

(2006). A brief measure for assessing generalized anxiety disorder: The GAD-7. Archives of Internal Medicine, 166(10), 1092–1097.

58.

Williams

K. A.

Chapman

M. V.

(2011). Comparing health and mental health needs, service use, and barriers to services among sexual minority youths and their peers. Health & Social Work, 36(3), 197–206.

59.

Wilson

B. D. M.

Choi

S. K.

Herman

J. L.

Becker

T. L.

Conron

K. J.

(2017, December). Characteristics and mental health of gender nonconforming adolescents in California [Health Policy Fact Sheet]. Williams Institute. https://williamsinstitute.law.ucla.edu/publications/gnc-youth-ca/

60.

Wilson

Cutts

Lees

Mapungwana

Maunganidze

(1992). Psychometric properties of the revised UCLA Loneliness Scale and two short-form measures of loneliness in Zimbabwe. Journal of Personality Assessment, 59(1), 72–81.

61.

Yildirim

Kocabiyik

(2010). The relationship between social support and loneliness in Turkish patients with cancer. Journal of Clinical Nursing, 19(5–6), 832–839.

62.

Zakahi

W. R.

Duran

R. L.

(1982). All the lonely people: The relationship among loneliness, communicative competence, and communication anxiety. Communication Quarterly, 30(3), 203–209.