An Analysis of Measurement Invariance of the Patient Health Questionnaire-9 Between Indonesia,Germany,and the USA

Abstract

The Patient Health Questionnaire-9 (PHQ-9) is a screening tool for assessing depressive symptomatology that has received widespread use. However, there is a scarcity of research on whether the instrument measures the same construct between high-income (HIC) and low- and middle-income countries (LMICs). Online surveys were utilized to assess samples across Indonesia, Germany, and the USA (N = 2350). Measurement Invariance (MI) was computed using multi-group confirmatory factor analyses. We found the general factor model to have a good fit and configural, metric, scalar, and residual MI across three countries. There were no significant differences in mean scores (Indonesia, M = 1.87, SD = 0.56; Germany, M = 1.90, SD = 0.65; USA, M = 1.90, SD = 0.75). These results highlight that depressive symptomatology is universal across distinct geographical regions, regardless of the population’s income levels. Hence, this study further emphasizes the urgency of developing universal, accessible assessment and treatment for depression.

Keywords

depression disorder self-report DSM measurement invariance cross-cultural

Get full access to this article

View all access options for this article.

References

Baas

K. D.

Cramer

A. O. J.

Koeter

M. W. J.

van de Lisdonk

E. H.

van Weert

H. C.

Schene

A. H.

(2011).Measurement invariance with respect to ethnicity of the Patient Health Questionnaire-9 (PHQ-9). Journal of Affective Disorders, 129(1–3), 229–235. https://doi.org/10.1016/j.jad.2010.08.026

Badan Pusat Statistik. (2011). Pengeluaran untuk konsumsi penduduk Indonesia 2011. Badan Pusat Statistik. http://bps.go.id/website/pdf_publikasi/watermark_Pengeluaran%20untuk%20Konsumsi%20Penduduk%20Indonesia2011.pdf

Chen

F. F.

(2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal, 14(3), 464–504. https://doi.org/10.1080/10705510701301834

Deisenhammer

E. A.

Çoban-Başaran

Mantar

Prunnlechner

Kemmler

Alkın

Hinterhuber

(2012). Ethnic and migrational impact on the clinical manifestation of depression. Social Psychiatry and Psychiatric Epidemiology, 47(7), 1121–1129. https://doi.org/10.1007/s00127-011-0417-1

DiStefano

Zhu

Mindrila

(2009). Understanding and using factor scores: Considerations for the applied researcher. Practical Assessment, Research & Evaluation, 14(20), 1–11.

Elhai

J. D.

Contractor

A. A.

Tamburrino

Fine

T. H.

Prescott

M. R.

Shirley

Chan

P. K.

Slembarski

Liberzon

Galea

Calabrese

J. R.

(2012). The factor structure of major depression symptoms: A test of four competing models using the Patient Health Questionnaire-9. Psychiatry Research, 199(3), 169–173. https://doi.org/10.1016/j.psychres.2012.05.018

Fajriana

Z. A.

Novrianto

Dewantary

N. I.

Tobing

P. D. K.

Storch

E. A. L.

Jaya

E. S.

(2025). Understanding depression and anxiety symptom interrelations in Indonesian OCD patients: A network approach. Journal of Psychiatric Research, 184, 359–366. https://doi.org/10.1016/j.jpsychires.2025.03.007

Fekadu

Demissie

Birhane

Medhin

Bitew

Hailemariam

Minaye

Habtamu

Milkias

Petersen

Patel

Cleare

A. J.

Mayston

Thornicroft

Alem

Hanlon

Prince

(2022). Under detection of depression in primary care settings in low and middle-income countries: A systematic review and meta-analysis. Systematic Reviews, 11(1), 21. https://doi.org/10.1186/s13643-022-01893-9

Gilbody

Richards

Brealey

Hewitt

(2007). Screening for depression in medical settings with the Patient Health Questionnaire (PHQ): A diagnostic meta-analysis. Journal of General Internal Medicine, 22(11), 1596–1602. https://doi.org/10.1007/s11606-007-0333-y

10.

González-Blanch

Medrano

L. A.

Muñoz-Navarro

Ruíz-Rodríguez

Moriana

J. A.

Limonero

J. T.

Schmitz

Cano-Vindel

, & on behalf of the PsicAP Research Group. (2018). Factor structure and measurement invariance across various demographic groups and over time for the PHQ-9 in primary care patients in Spain. PLoS One, 13(2), e0193356. https://doi.org/10.1371/journal.pone.0193356

11.

Guo

Kaylor-Hughes

Garland

Nixon

Sweeney

Simpson

Dalgleish

Ramana

Yang

Morriss

(2019). Factor structure and longitudinal measurement invariance of PHQ-9 for specialist mental health care patients with persistent major depressive disorder: Exploratory Structural Equation Modelling. Journal of Affective Disorders, 219, 1–8.

12.

Harry

M. L.

Coley

R. Y.

Waring

S. C.

Simon

G. E.

(2021). Evaluating the cross-cultural measurement invariance of the PHQ-9 between American Indian/Alaska Native adults and diverse racial and ethnic groups. Journal of Affective Disorders Reports, 4, 100121. https://doi.org/10.1016/j.jadr.2021.100121

13.

Bentler

P. M.

(1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. https://doi.org/10.1080/10705519909540118

14.

Huang

F. Y.

Chung

Kroenke

Delucchi

K. L.

Spitzer

R. L.

(2006). Using the patient health questionnaire-9 to measure depression among racially and ethnically diverse primary care patients. Journal of General Internal Medicine, 21(6), 547–552. https://doi.org/10.1111/j.1525-1497.2006.00409.x

15.

Jaya

E. S.

Ascone

Lincoln

T. M.

(2017). Social adversity and psychosis: The mediating role of cognitive vulnerability. Schizophrenia Bulletin, 43(3), 557–565. https://doi.org/10.1093/schbul/sbw104

16.

Jaya

E. S.

Lincoln

T. M.

(2016). Social adversities and psychotic symptoms: A test of predictions derived from the social defeat hypothesis. Psychiatry Research, 245, 466–472. https://doi.org/10.1016/j.psychres.2016.09.002

17.

Jaya

E. S.

Novrianto

Pillny

Wiguna

(2024). Indonesian patient health questionnaire’s clinical utility in psychiatric outpatients: Ruling out conditions per ICD-11 criteria. Asian Journal of Psychiatry, 100, 104184. https://doi.org/10.1016/j.ajp.2024.104184

18.

Kessler

R. C.

Berglund

Demler

Jin

Merikangas

K. R.

Walters

E. E.

(2005). Lifetime prevalence and age-of-onset distributions of DSM-IV disorders in the national comorbidity survey replication. Archives of General Psychiatry, 62(6), 593–602. https://doi.org/10.1001/archpsyc.62.6.593

19.

Keum

B. T.

Miller

M. J.

Inkelas

K. K.

(2018). Testing the factor structure and measurement invariance of the PHQ-9 across racially diverse U.S. college students. Psychological Assessment, 30(8), 1096–1106. https://doi.org/10.1037/pas0000550

20.

Krause

J. S.

Reed

K. S.

McArdle

J. J.

(2010). Factor structure and predictive validity of somatic and nonsomatic symptoms from the Patient Health Questionnaire-9: A longitudinal study after spinal cord injury. Archives of Physical Medicine and Rehabilitation, 91(8), 1218–1224. https://doi.org/10.1016/j.apmr.2010.04.015

21.

Kroenke

(2021). PHQ-9: Global uptake of a depression scale. World Psychiatry, 20(1), 135–136. https://doi.org/10.1002/wps.20821

22.

Kroenke

Spitzer

R. L.

Williams

J. B. W.

(2001). The PHQ-9: Validity of a brief depression severity measure. Journal of General Internal Medicine, 16(9), 606–613. https://doi.org/10.1046/j.1525-1497.2001.016009606.x

23.

Kroenke

Spitzer

R. L.

Williams

J. B. W.

Löwe

(2010). The Patient Health Questionnaire Somatic, Anxiety, and Depressive Symptom Scales: A systematic review. General Hospital Psychiatry, 32(4), 345–359. https://doi.org/10.1016/j.genhosppsych.2010.03.006

24.

Lehti

Hammarström

Mattsson

(2009). Recognition of depression in people of different cultures: A qualitative study. BMC Family Practice, 10(1), 53. https://doi.org/10.1186/1471-2296-10-53

25.

Lim

G. Y.

Tam

W. W.

C. S.

Zhang

M. W.

R. C.

(2018). Prevalence of depression in the community from 30 countries between 1994 and 2014. Scientific Reports, 8(1), 2861. https://doi.org/10.1038/s41598-018-21243-x

26.

Patel

J. S.

Rand

K. L.

Cyders

M. A.

Kroenke

Stewart

J. C.

(2019). Measurement invariance of the patient health questionnaire-9 (PHQ-9) depression screener in U.S. adults across sex, race/ethnicity, and education level: NHANES 2005–2016. Depression and Anxiety, 36(9), 813–823. https://doi.org/10.1002/da.22940

27.

Putnick

D. L.

Bornstein

M. H.

(2016). Measurement invariance conventions and reporting: The state of the art and future directions for psychological research. Developmental Review, 41, 71–90. https://doi.org/10.1016/j.dr.2016.06.004

28.

R Core Team. (2021). R: A language and environment for statistical computing [Computer software]. R Foundation for Statistical Computing. https://www.R-project.org/

29.

Reich

Rief

Brähler

Mewes

(2018). Cross-cultural validation of the German and Turkish versions of the PHQ-9: An IRT approach. BMC Psychology, 6(1), 26. https://doi.org/10.1186/s40359-018-0238-z

30.

Reise

S. P.

Widaman

K. F.

Pugh

R. H.

(1993). Confirmatory factor analysis and item response theory: Two approaches for exploring measurement invariance. Psychological Bulletin, 114(3), 552–566.

31.

Rosseel

(2012). Lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48(2), 1–36.

32.

Ryder

A. G.

Yang

Zhu

Yao

Heine

S. J.

Bagby

R. M.

(2008). The cultural shaping of depression: Somatic symptoms in China, psychological symptoms in North America? Journal of Abnormal Psychology, 117(2), 300–313. https://doi.org/10.1037/0021-843X.117.2.300

33.

Schuler

Strohmayer

Mühlig

Schwaighofer

Wittmann

Faller

Schultz

(2018). Assessment of depression before and after inpatient rehabilitation in COPD patients: Psychometric properties of the German version of the Patient Health Questionnaire (PHQ-9/PHQ-2). Journal of Affective Disorders, 232, 268–275. https://doi.org/10.1016/j.jad.2018.02.037

34.

Shapiro

D. N.

Chandler

Mueller

P. A.

(2013). Using mechanical turk to study clinical populations. Clinical Psychological Science, 1(2), 213–220. https://doi.org/10.1177/2167702612469015

35.

Shevlin

Butter

McBride

Murphy

Gibson-Miller

Hartman

T. K.

Levita

Mason

Martinez

A. P.

McKay

Stocks

T. V.

Bennett

K. M.

Hyland

Vallieres

Valiente

Vazquez

Contreras

Peinado

Trucharte

. . . Bentall

R. P.

(2022). Measurement invariance of the Patient Health Questionnaire (PHQ-9) and Generalized Anxiety Disorder scale (GAD-7) across four European countries during the COVID-19 pandemic. BMC Psychiatry, 22(1), 154. https://doi.org/10.1186/s12888-022-03787-5

36.

Spitzer

R. L.

Kroenke

Williams

J. B.

(1999). Validation and utility of a self-report version of PRIME-MD: The PHQ primary care study. Primary Care Evaluation of Mental Disorders. Patient Health Questionnaire. JAMA, 282(18), 1737–1744. https://doi.org/10.1001/jama.282.18.1737

37.

Statistisches Bundesamt. (2012). Einkommensverteilung, Einkommensarmut und Einkommensreichtum in Deutschland 2008 (Fachserie 15 Heft 6 – 2008 No. 2152606089004). Statistisches Bundesamt. https://www.destatis.de/DE/Publikationen/Thematisch/EinkommenKonsumLebensbedingungen/EinkommenVerbrauch/Einkommensverteilung2152606089004.pdf

38.

Stochl

Fried

E. I.

Fritz

Croudace

T. J.

Russo

D. A.

Knight

Jones

P. B.

Perez

(2022). On dimensionality, measurement invariance, and suitability of sum scores for the PHQ-9 and the GAD-7. Assessment, 29(3), 355–366. https://doi.org/10.1177/1073191120976863

39.

U.S. Census Bureau. (2014). Table HINC-06. Income distribution to $250,000 or more for households: 2014 (Annual Social and Economic Supplement). U.S. Department of Commerce. https://www.census.gov/hhes/www/cpstables/032015/hhinc/hinc06.xls

40.

van de Schoot

Schmidt

De Beuckelaer

Lek

Zondervan-Zwijnenburg

(2015). Editorial: Measurement invariance. Quantitative Psychology and Measurement, 1064. https://doi.org/10.3389/fpsyg.2015.01064

41.

World Health Organization. (2021). Depressive disorder (depression). https://www.who.int/news-room/fact-sheets/detail/depression

42.

Wittkampf

K. A.

Naeije

Schene

A. H.

Huyser

van Weert

H. C.

(2007). Diagnostic accuracy of the mood module of the Patient Health Questionnaire: A systematic review. General Hospital Psychiatry, 29(5), 388–395. https://doi.org/10.1016/j.genhosppsych.2007.06.004

43.

Zhou

Rief

(2020). Are comparisons of mental disorders between Chinese and German students possible? An examination of measurement invariance for the PHQ-15, PHQ-9 and GAD-7. BMC Psychiatry, 20(1), 480. https://doi.org/10.1186/s12888-020-02859-8