Measuring depression and anxiety in autistic college students: A psychometric evaluation of the PHQ-9 and GAD-7

Abstract

Anxiety, depression, and suicidality are major concerns among college students, though less is known about these constructs in autistic college students. Given the rising number of autistic individuals entering post-secondary education, adequate measurement and diagnosis of anxiety, depression, and suicidality is necessary to provide clinical care to this population. While the Generalized Anxiety Disorder-7 (GAD-7) and Patient Health Questionnaire-9 (PHQ-9) are commonly used in university settings, these instruments have not been psychometrically evaluated in autistic college students. The current study examines the differential psychometric properties of the GAD-7 and PHQ-9 utilizing invariance testing via structural equation modeling in a sample of self-identified autistic (n = 477) and non-autistic (n = 429) university students. Results showed that although the GAD-7 is invariant, the PHQ-9 was mostly invariant, with one item displaying non-invariance. Specifically, the PHQ-9 item assessing suicidality was found to be non-invariant at the metric level, indicating that autistic and non-autistic college students interpret this question differently. Future investigators should continue to assess the appropriateness of using common screening measures, originally created for non-autistic people, in autistic populations.

Lay abstract

Anxiety, depression, and suicidality are major concerns among college students, though less is known about these constructs in autistic college students. Given the rising number of autistic individuals entering college, adequate screening and diagnosis of mental health difficulties is necessary to provide care to this population. For example, despite widespread usage of the Patient Health Questionnaire-9 (PHQ-9) and Generalized Anxiety Disorder-7 (GAD-7), it is unknown if the two instruments accurately measure depression and anxiety the same way between non-autistic and autistic individuals. Thus, the current study was the first to examine how these instruments measure depression and anxiety symptoms in autistic versus non-autistic college students. Utilizing tests of construct measurement in a sample of autistic (n = 477) and non-autistic (n = 429) university students aged 18–29, results showed that while the GAD-7 and PHQ-9 appear to be accurately capturing anxiety and depression in autistic college students, the PHQ-9 item assessing suicidality was found to be measuring different things. This indicates that autistic college students are not interpreting this question the way non-autistic students are, and thus, the measure is failing to capture suicidality in autistic people. Future investigators should continue to assess the appropriateness of using common screening measures, originally created by non-autistic people, in autistic populations.

Keywords

anxiety autism spectrum disorders college students depression psychometrics

Get full access to this article

View all access options for this article.

References

Accardo

A. L.

Kuder

S. J.

Woodruff

(2019). Accommodations and support services preferred by college students with autism spectrum disorder. Autism, 23(3), 574–583. https://doi.org/10.1177/1362361318760490

Arnold

S. R. C.

Uljarević

Hwang

Y. I.

Richdale

A. L.

Trollor

J. N.

Lawson

L. P.

(2020). Brief report: Psychometric properties of the patient health questionaire-9 (PHQ-9) in autistic adults. Journal of Autism and Developmental Disorders, 50(6), 2217–2225. https://doi.org/10.1007/s10803-019-03947-9

Bauer

A. M.

Chan

Y.-F.

Huang

Vannoy

Unützer

(2013). Characteristics, management, and depression outcomes of primary care patients who endorse thoughts of death or suicide on the PHQ-9. Journal of General Internal Medicine, 28(3), 363–369. https://doi.org/10.1007/s11606-012-2194-2

Beauducel

Herzberg

P. Y.

(2006). On the performance of maximum likelihood versus means and variance adjusted weighted least squares estimation in CFA. Structural Equation Modeling, 13(2), 186–203. https://doi.org/10.1207/s15328007sem1302_2

Borgogna

N. C.

Brenner

R. E.

McDermott

R. C.

(2021). Sexuality and gender invariance of the PHQ-9 and GAD-7: Implications for 16 identity groups. Journal of Affective Disorders, 278, 122–130. https://doi.org/10.1016/j.jad.2020.09.069

Brattmyr

Lindberg

M. S.

Solem

Hjemdal

Havnen

(2022). Factor structure, measurement invariance, and concurrent validity of the Patient Health Questionnaire - 9 and the Generalized Anxiety Disorder scale - 7 in a Norwegian psychiatric outpatient sample. BMC Psychiatry, 22, Article 461. https://doi.org/10.1186/s1288-022-04101-z

Byrd-Bredbenner

Eck

Quick

(2020). Psychometric properties of the generalized anxiety disorder-7 and generalized anxiety disorder-mini in United States university students. Frontiers in Psychology, 11, Article 550533. https://www.frontiersin.org/articles/10.3389/fpsyg.2020.550533

Byrd-Bredbenner

Eck

Quick

(2021). GAD-7, GAD-2, and GAD-mini: Psychometric properties and norms of university students in the United States. General Hospital Psychiatry, 69, 61–66. https://doi.org/10.1016/j.genhosppsych.2021.01.002

Cassidy

S. A.

Bradley

Bowen

Wigham

Rodgers

(2018). Measurement properties of tools used to assess depression in adults with and without autism spectrum conditions: A systematic review. Autism Research, 11(5), 738–754. https://doi.org/10.1002/aur.1922

10.

Cassidy

S. A.

Bradley

Cogger-Ward

Shaw

Bowen

Glod

Baron-Cohen

Rodgers

(2020). Measurement properties of the Suicidal Behaviour Questionnaire-Revised in Autistic Adults. Journal of Autism and Developmental Disorders, 50(10), 3477–3488. https://doi.org/10.1007/s10803-020-04431-5

11.

Cassidy

S. A.

Bradley

Robinson

Allison

McHugh

Baron-Cohen

(2014). Suicidal ideation and suicide plans or attempts in adults with Asperger’s syndrome attending a specialist diagnostic clinic: A clinical cohort study. The Lancet Psychiatry, 1(2), 142–147. https://doi.org/10.1016/S2215-0366(14)70248-2

12.

Cassidy

S. A.

Gould

Townsend

Pelton

Robertson

A. E.

Rodgers

(2020). Is camouflaging autistic traits associated with suicidal thoughts and behaviours? Expanding the interpersonal psychological theory of suicide in an undergraduate student sample. Journal of Autism and Developmental Disorders, 50(10), 3638–3648. https://doi.org/10.1007/s10803-019-04323-3

13.

Chandrasekhar

Sikich

(2015). Challenges in the diagnosis and treatment of depression in autism spectrum disorders across the lifespan. Dialogues in Clinical Neuroscience, 17(2), 219–227. https://doi.org/10.31887/DCNS.2015.17.2/tchandrasekhar

14.

Chen

M.-H.

Pan

T.-L.

Lan

W.-H.

Hsu

J.-W.

Huang

K.-L.

T.-P.

C.-T.

Lin

W.-C.

Wei

H.-T.

Chen

T.-J.

Bai

Y.-M.

(2017). Risk of suicide attempts among adolescents and young adults with autism spectrum disorder: A nationwide longitudinal follow-up study. The Journal of Clinical Psychiatry, 78(9), e1174–e1179. https://doi.org/10.4088/JCP.16m11100

15.

Cheung

G. W.

Lau

R. S.

(2012). A direct comparison approach for testing measurement invariance. Organizational Research Methods, 15(2), 167–198. https://doi.org/10.1177/1094428111421987

16.

Elias

White

S. W.

(2018). Autism goes to college: Understanding the needs of a student population on the rise. Journal of Autism and Developmental Disorders, 48(3), 732–746. https://doi.org/10.1007/s10803-017-3075-7

17.

Fernandes

Haley

Eagan

Shattuck

P. T.

Kuo

A. A.

(2021). Health needs and college readiness in autistic students: The freshman survey results. Journal of Autism and Developmental Disorders, 51(10), 3506–3513. https://doi.org/10.1007/s10803-020-04814-8

18.

Gelbar

N. W.

Smith

Reichow

(2014). Systematic review of articles describing experience and supports of individuals with autism enrolled in college and university programs. Journal of Autism and Developmental Disorders, 44(10), 2593–2601. https://doi.org/10.1007/s10803-014-2135-5

19.

Gotham

Brunwasser

S. M.

Lord

(2015). Depressive and anxiety symptom trajectories from school age through young adulthood in samples with autism spectrum disorder and developmental delay. Journal of the American Academy of Child & Adolescent Psychiatry, 54(5), 369–376.e3. https://doi.org/10.1016/j.jaac.2015.02.005

20.

Healthy Minds Network. (2023). Healthy minds study among colleges and universities, year (2020-2021) [Data set]. Healthy Minds Network, University of Michigan, University of California Los Angeles, Boston University, and Wayne State University. https://healthymindsnetwork.org/reserach/data-for-researchers

21.

Hedley

Batterham

P. J.

Bury

S. M.

Clapperton

Denney

Dissanayake

Fox

Frazier

T. W.

Gallagher

Hayward

S. M.

Robinson

Sahin

Trollor

Uljarević

Stokes

M. A.

(2023). The Suicidal Ideation Attributes Scale-Modified (SIDAS-M): Development and preliminary validation of a new scale for the measurement of suicidal ideation in autistic adults. Autism, 27(4), 1115–1131. https://doi.org/10.1177/13623613221131234

22.

Hedley

Uljarević

Wilmot

Richdale

Dissanayake

(2018). Understanding depression and thoughts of self-harm in autism: A potential mechanism involving loneliness. Research in Autism Spectrum Disorders, 46, 1–7. https://doi.org/10.1016/j.rasd.2017.11.003

23.

Hollocks

M. J.

Lerh

J. W.

Magiati

Meiser-Stedman

Brugha

T. S.

(2019). Anxiety and depression in adults with autism spectrum disorder: A systematic review and meta-analysis. Psychological Medicine, 49(4), 559–572. https://doi.org/10.1017/S0033291718002283

24.

Hout

(2012). Social and economic returns to college education in the United States. Annual Review of Sociology, 38(1), 379–400. https://doi.org/10.1146/annurev.soc.012809.102503

25.

L. T.

Bentler

P. M.

(1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. https://doi.org/10.1080/10705519909540118

26.

Jackson

S. L. J.

Hart

Brown

J. T.

Volkmar

F. R.

(2018). Brief report: Self-reported academic, social, and mental health experiences of post-secondary students with autism spectrum disorder. Journal of Autism and Developmental Disorders, 48(3), 643–650. https://doi.org/10.1007/s10803-017-3315-x

27.

Keum

B. T.

Miller

M. J.

Inkelas

K. K.

(2018). Testing the factor structure and measurement invariance of the PHQ-9 across racially diverse U.S. college students. Psychological Assessment, 30, 1096–1106. https://doi.org/10.1037/pas0000550

28.

Kirby

Bakian

Zhang

Bilder

Keeshin

Coon

(2019). A 20-year study of suicide death in a statewide autism population. Autism Research, 12(4), 658–666. https://doi.org/10.1002/aur.2076

29.

Kline

R. B.

(2023). Principles and practice of structural equation modeling (5th ed.). Guilford Press.

30.

Kroenke

Spitzer

R. L.

Williams

J. B. W.

(2001). The PHQ-9. Journal of General Internal Medicine, 16(9), 606–613. https://doi.org/10.1046/j.1525-1497.2001.016009606.x

31.

Lamela

Soreira

Matos

Morias

(2020). Systematic review of the factor structure and measurement invariance of the Patient Health Questionnaire – 9 (PHQ-9) and validation of the Portuguese version in community setting. Journal of Affective Disorders, 276, 220–233. https://doi.org/10.1016/j.jad.2020.06.066

32.

Lee

Kang

E. H.

Kang

Lee

H. Y.

(2023). Measurement invariance of the Patient Health Questionnaire – 9 depression scale in a nationally representative population-based sample. Frontiers in Psychology, 14, Article 2023. https://doi.org/10.3389/fpsyg.2023.1217038

33.

Zhao

Chen

Peng

(2022). Prevalence and associated factors of depression and anxiety symptoms among college students: A systematic review and meta-analysis. Journal of Child Psychology and Psychiatry, 63(11), 1222–1230. https://doi.org/10.1111/jcpp.13606

34.

Maenner

M. J.

Warren

Williams

A. R.

Amoakohene

Bakian

A. V.

Bilder

D. A.

Durkin

M. S.

Fitzgerald

R. T.

Furnier

S. M.

Hughes

M. M.

Ladd-Acosta

C. M.

McArthur

Pas

E. T.

Salinas

Vehorn

Williams

Esler

Grzybowski

Hall-Lande

. . .Shaw

K. A.

(2023). Prevalence and characteristics of autism spectrum disorder among children aged 8 years—Autism and developmental disabilities monitoring network, 11 Sites, United States, 2020. MMWR. Surveillance Summaries, 72(2), 1–14. https://doi.org/10.15585/mmwr.ss7202a1

35.

McLeod

J. D.

Meanwell

Hawbaker

(2019). The experiences of college students on the autism spectrum: A comparison to their neurotypical peers. Journal of Autism and Developmental Disorders, 49(6), 2320–2336. https://doi.org/10.1007/s10803-019-03910-8

36.

McMorris

C. A.

Baraskewich

Ames

M. A.

Shaikh

K. T.

Ncube

B. L.

Bebko

J. M.

(2019). Mental health issues in post-secondary students with autism spectrum disorder: Experiences in accessing services. International Journal of Mental Health and Addiction, 17(3), 585–595. https://doi.org/10.1007/s11469-018-9988-3

37.

Meyers

L. S.

Gamst

Guarino

A. J.

(2016). Applied multivariate research: Design and interpretation. Sage.

38.

Milfont

Fischer

(2010). Testing measurement invariance across groups: Applications in cross-cultural research. International Journal of Psychological Research, 3(1), 111–130. https://doi.org/10.21500/20112084.857

39.

Muthén

L. K.

Muthén

B. O.

(1998–2017). Mplus user’s guide (8th ed.).

40.

P. J.

Yaramala

S. R.

Kim

J. A.

Kim

Goes

F. S.

Zandi

P. P.

Vande Voort

J. L.

Sutor

Croarkin

Bobo

W. V.

(2018). The PHQ-9 Item 9 based screening for suicide risk: A validation study of the Patient Health Questionnaire (PHQ)−9 Item 9 with the Columbia Suicide Severity Rating Scale (C-SSRS). Journal of Affective Disorders, 232, 34–40. https://doi.org/10.1016/j.jad.2018.02.045

41.

Nah

Y.-H.

Brewer

Young

R. L.

Flower

(2018). Brief report: Screening adults with autism spectrum disorder for anxiety and depression. Journal of Autism and Developmental Disorders, 48(5), 1841–1846. https://doi.org/10.1007/s10803-017-3427-3

42.

Newman

Wagner

Knokey

A.-M.

Marder

Nagle

Shaver

Wei

(2011). The post-high school outcomes of young adults with disabilities up to 8 years after high school a report from the National Longitudinal Transition Study-2 (NLTS2) (NCSER 2011-3005). SRI International. https://doi.org/10.13140/RG.2.2.20600.57600

43.

Nye

C. D.

Bradburn

Olenick

Bialko

Drasgow

(2019). How big are my effects? Examining the magnitude of effect sizes in studies of measurement equivalence. Organizational Research Methods, 22(3), 678–709. https://doi.org/10.1177/1094428118761122

44.

Nye

C. D.

Drasgow

(2011). Effect size indices for analyses of measurement equivalence: Understanding the practical importance of differences between groups. Journal of Applied Psychology, 96(5), 966–980. https://doi.org/10.1037/a0022955

45.

Parent

M. C.

(2013). Handling item-level missing data: Simpler is just as good. The Counseling Psychologist, 41(4), 568–600. https://doi.org/10.1177/0011000012445176

46.

Patel

J. S.

Rand

K. L.

Cyders

M. A.

Kroenke

Stewart

J. C.

(2019). Measurement invariance of the Patient Health Questionnaire - 9 (PHQ-9) depression screener in U.S. adults across sex, race/ethnicity, and education level: NHANES 2005-2016. Depression and Anxiety, 36(9), 813–823. https://doi.org/10.1002/da.22940

47.

Pilunthanakul

Goh

T. J.

Fung

D. S. S.

Sultana

Allen

J. C.

Sung

(2021). Validity of the patient health questionnaire 9-item in autistic youths: A pilot study. BMC Psychiatry, 21(1), Article 564. https://doi.org/10.1186/s12888-021-03556-w

48.

Pinder-Amaker

(2014). Identifying the unmet needs of college students on the autism spectrum. Harvard Review of Psychiatry, 22(2), 125–137. https://doi.org/10.1097/HRP.0000000000000032

49.

Putnick

D. L.

Bornstein

M. H.

(2016). Measurement invariance conventions and reporting: The state of the art and future directions for psychological research. Developmental Review, 41, 71–90. https://doi.org/10.1016/j.dr.2016.06.004

50.

Rosenau

K. A.

Hotez

Fernandes

Gomez

Eagan

Shea

Kuo

(2023). Anxiety and depression in autistic college students: The freshman survey results. Cureus, 15(3), Article e35820. https://doi.org/10.7759/cureus.35820

51.

Rump

K. M.

Giovannelli

J. L.

Minshew

N. J.

Strauss

M. S.

(2009). The development of emotion recognition in individuals with autism. Child Development, 80(5), 1434–1447. https://doi.org/10.1111/j.1467-8624.2009.01343.x

52.

Savalei

(2021). Improving fit indices in structural equation modeling with categorical data. Multivariate Behavioral Research, 56(3), 390–407. https://doi.org/10.1080/00273171.2020.1717922

53.

Segers

Rawana

(2014). What do we know about suicidality in autism spectrum disorders? A systematic review: Systematic review of suicidality in ASD. Autism Research, 7(4), 507–521. https://doi.org/10.1002/aur.1375

54.

Shattuck

P. T.

Narendorf

S. C.

Cooper

Sterzing

P. R.

Wagner

Taylor

J. L.

(2012). Postsecondary education and employment among youth with an autism spectrum disorder. Pediatrics, 129(6), 1042–1049. https://doi.org/10.1542/peds.2011-2864

55.

Simon

G. E.

Rutter

C. M.

Peterson

Oliver

Whiteside

Operskalski

Ludman

E. J.

(2013). Does response on the PHQ-9 depression questionnaire predict subsequent suicide attempt or suicide death? Psychiatric Services, 64(12), 1195–1202. https://doi.org/10.1176/appi.ps.201200587

56.

Spitzer

R. L.

Kroenke

Williams

J. B. W.

Löwe

(2006). A brief measure for assessing generalized anxiety disorder: The GAD-7. Archives of Internal Medicine, 166(10), 1092. https://doi.org/10.1001/archinte.166.10.1092

57.

Stewart

M. E.

Barnard

Pearson

Hasan

O’Brien

(2006). Presentation of depression in autism and Asperger syndrome: A review. Autism, 10(1), 103–116. https://doi.org/10.1177/1362361306062013

58.

Svetina

Rutkowski

(2020). Multiple-group with categorical outcomes using update guidelines: An illustration of using Mplus and the lavaan/semTools Packages. Structural Equation Modeling: A Multidisciplinary Journal, 27, 111–130. https://doi.org/10.1080/10705511.2019.1602776

59.

Viguera

A. C.

Milano

Laurel

Thompson

N. R.

Griffith

S. D.

Baldessarini

R. J.

Katzan

I. L.

(2015). Comparison of electronic screening for suicidal risk with the patient health questionnaire item 9 and the Columbia Suicide Severity Rating Scale in an outpatient psychiatric clinic. Psychosomatics, 56(5), 460–469. https://doi.org/10.1016/j.psym.2015.04.005

60.

White

S. W.

Ollendick

T. H.

Bray

B. C.

(2011). College students on the autism spectrum: Prevalence and associated problems. Autism, 15(6), 683–701. https://doi.org/10.1177/1362361310393363

61.

Widman

C. J.

Lopez-Reyna

N. A.

(2020). Supports for postsecondary students with autism spectrum disorder: A systematic review. Journal of Autism and Developmental Disorders, 50(9), 3166–3178. https://doi.org/10.1007/s10803-020-04409-3

62.

Williams

Z. J.

Everaert

Gotham

K. O.

(2021). Measuring depression in autistic adults: Psychometric validation of the Beck Depression Inventory–II. Assessment, 28(3), 858–876. https://doi.org/10.1177/1073191120952889

63.

Xia

Yang

(2018). RMSEA, CFI, and TLI in structural equation modeling with ordered categorical data: The story they tell depends on the estimation methods. Behavior Research Methods, 51, 409–428. https://doi.org/10.3758/s13428-018-1055-2

64.

Zukerman

Yahav

Ben-Itzchak

(2019). Increased psychiatric symptoms in university students with autism spectrum disorder are associated with reduced adaptive behavior. Psychiatry Research, 273, 732–738. https://doi.org/10.1016/j.psychres.2019.01.098

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB