Factorial Validity and Invariance of the GHQ-12 Among Clinical and Nonclinical Samples

Abstract

The purpose of this study was to examine the internal reliability, factorial validity, and measurement invariance of a Brazilian–Portuguese version of the General Health Questionnaire–12 (GHQ-12) across clinical and nonclinical groups. The clinical sample consisted of 228 chronic hemodialysis patients (41.7% female), with a mean age of 48.23 (SD = 16.02) years, whereas the nonclinical sample comprised 350 university students (59.1% female), with a mean age of 21.15 (SD = 2.04) years. Initial model fit comparison of 16 factor structures reported in the literature, through confirmatory factor analysis (CFA), provided mixed results. Additional revisions based on CFA modification indices demonstrated that a reduced (8-item) one-factor model with three error covariances provided the best fit to the data in both samples (comparative fit index > .98 and root mean square error of approximation < .05) and acceptable internal reliability estimates (>.70). Pearson’s correlations between the original and the reduced scale was .96 for both samples. Multigroup analysis supported partial strong measurement equivalence across groups. Latent mean differences showed an expected higher factor mean for the clinical sample. Overall results demonstrated that the 8-item one-factor of the GHQ-12 showed good psychometric properties in both samples and provided preliminary support for meaningful comparisons of factor means across clinical and nonclinical groups.

Keywords

GHQ-12 distress reliability factor structure measurement invariance

Get full access to this article

View all access options for this article.

References

Aguado

Campbell

Ascaso

Navarro

Garcia-Esteve

Luciano

J. V.

(2010). Examining the factor structure and discriminant validity of the 12-Item General Health Questionnaire (GHQ-12) among Spanish postpartum women. Assessment. Advance online publication. doi:10.1177/1073191110388146

Andrich

Van Schoubroeck

(1989). The General Health Questionnaire: A psychometric analysis using latent trait theory. Psychological Medicine, 19, 469-485.

Baer

Blais

M. A.

(Eds.). (2010). Handbook of clinical rating scales and assessment in psychiatry and mental health. New York, NY: Humana Press.

Banks

M. H.

Clegg

C. W.

Jackson

P. R.

Kemp

N. J.

Stafford

E. M.

Wall

T. D.

(1980). The use of the General Health Questionnaire as an indicator of mental health in occupational studies. Journal of Occupational Psychology, 53, 187-194.

Bentler

P. M.

(1990). Comparative fit indices in structural models. Psychological Bulletin, 107, 238-246.

Bollen

K. A.

(1989). Structural equations with latent variables. New York, NY: Wiley.

Borges

L. O.

Argolo

J. C.

(2002). Adaptação e validação de uma escala de bem-estar psicológico para uso em estudos ocupacionais [Adaptation and validation of a psychological well-being scale for use in the occupational studies]. Avaliação Psicológica, 1, 17-27.

Browne

M. W.

Cudeck

(1993). Alternate ways of assessing model fit. In Bollen

K. A.

Long

J. S.

(Eds.), Testing structural equation models (pp. 136-162). Newbury Park, CA: Sage.

Byrne

B. M.

(2008). Testing for multigroup equivalence of a measuring instrument: A walk through the process. Psichothema, 20, 872-882.

10.

Byrne

B. M.

Shavelson

R. J.

Muthen

(1989). Testing for the equivalence of factor covariance and mean structures: The issues of partial measurement invariance. Psychological Bulletin, 105, 456-466.

11.

Campbell

Knowles

(2007). A confirmatory factor analysis of the GHQ12 using a large scale Australian sample. European Journal of Psychological Assessment, 23(1), 2-8.

12.

Campbell

Walker

Farrell

(2003). Confirmatory factor analysis of the GHQ-12: Can I see that again? Australian and New Zealand Journal of Psychiatry, 37, 475-483.

13.

Cheung

G. W.

Rensvold

R. B.

(2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9, 233-255.

14.

Corti

(1994). For better or worse? Annual change in smoking, self-assessed health and subjective wellbeing. In Buck

Gershuny

Rose

Scott

(Eds.), Changing households: The British Household Panel Survey 1990-1992 (pp. 199-219). Colchester, England: University of Essex.

15.

Danquah

F. V.

Zimmerman

Diamond

P. M.

Meininger

Bergstrom

(2010). Frequency, severity, and distress of dialysis-related symptoms reported by patients on hemodialysis. Nephrology Nursing Journal, 37, 627-638.

16.

Daradkeh

T. K.

Ghubash

El-Rufaie

O. E.

(2001). Reliability, validity, and factor structure of the Arabic version of the 12-item General Health Questionnaire. Psychological Reports, 89, 85-94.

17.

Doi

Minowa

(2003). Factor structure of the 12-item General Health Questionnaire in the Japanese general adult population. Psychiatry and Clinical Neurosciences, 57, 379-383.

18.

French

Tait

R. J.

(2004). Measurement invariance in the General Health Questionnaire-12 in young Australian adolescents. European Child & Adolescent Psychiatry, 13(1), 1-7.

19.

Gao

Luo

Thumboo

Fones

S.-C.

Cheung

Y.-B.

(2004). Does the 12-item General Health Questionnaire contain multiple factors and do we need them? Health and Quality of Life Outcomes, 2, 63. doi:10.1186/ 1477-7525-2-63

20.

Goldberg

(1972). The detection of psychiatric illness by questionnaire. London, England: Oxford University Press.

21.

Goldberg

Williams

(1988). A user’s guide to the General Health Questionnaire. Windsor, England: NFER-Nelson.

22.

Gouveia

V. V.

Barbosa

G. A.

Andrade

E. O.

Carneiro

M. B.

(2010). Factorial validity and reliability of the General Health Questionnaire (GHQ-12) in the Brazilian physician population. Cadernos de Saúde Pública, 26, 1439-1445.

23.

Gouveia

V. V.

Chaves

S. S.

Oliveira

I. C.

Dias

M. R.

Gouveia

R. S.

Andrade

P. R.

(2003). A utilização do QSG-12 na população geral: Estudo de sua validade de construto [The use of the GHQ-12 in a general population: a study of its construct validity]. Psicologia: Teoria e Pesquisa, 19, 241-248.

24.

Graetz

(1991). Multidimensional properties of the General Health Questionnaire. Social Psychiatry and Psychiatric Epidemiology, 26, 132-138.

25.

Gregorich

S. E.

(2006). Do self-report instruments allow meaningful comparisons across diverse population groups? Testing measurement invariance using the confirmatory factor analysis framework. Medical Care, 44, S78-S94.

26.

Hankins

(2008a). The factor structure of the twelve item General Health Questionnaire (GHQ-12): The result of negative phrasing? Clinical Practice and Epidemiology in Mental Health, 4, 10. doi:10.1186/1745-0179-4-10

27.

Hankins

(2008b). The reliability of the twelve-item General Health Questionnaire (GHQ-12) under realistic assumptions. BMC Public Health, 8, 355. doi:10.1186/1471-2458-8-355

28.

L. T.

Bentler

P. M.

(1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1-55.

29.

W. Y.

Martin

C. R.

(2006). Psychometric properties of the 12-item General Health Questionnaire (GHQ-12) in Chinese women during pregnancy and in the postnatal period. Psychology, Health & Medicine, 11(1), 60-69.

30.

Kalliath

T. J.

O’Driscoll

M. P.

Brough

(2004). A confirmatory factor analysis of the General Health Questionnaire–12. Stress & Health, 20, 11-20.

31.

Keszei

A. P.

Novak

Streiner

D. L.

(2010). Introduction to health measurement scales. Journal of Psychosomatic Research, 68, 319-323.

32.

Kilic

Rezaki

Kaplan

Ozgen

Sağduyu

Oztürk

M. O.

(1997). General Health Questionnaire (GHQ12 & GHQ28): Psychometric properties and factor structure of the scales in a Turkish primary care sample. Social Psychiatry and Psychiatric Epidemiology, 32, 327-331.

33.

Kline

R. B.

(2010). Principles and practice of structural equation modeling (3rd ed.). New York, NY: Guilford Press.

34.

Mäkikangas

Feldt

Kinnunen

Tolvanen

Kinnunen

M.-L.

Pulkkinen

(2006). The factor structure and factorial invariance of the 12-item General Health Questionnaire (GHQ-12) across time: Evidence from two community-based samples. Psychological Assessment, 18, 444-451.

35.

Mari

J. J.

Williams

(1985). A comparison of the validity of two psychiatric screening questionnaires (GHQ-12 and SRQ-20) in Brazil, using relative operating characteristic (ROC) analysis. Psychological Medicine, 15, 651-659.

36.

Martin

(1999). Assessing the multidimensionality of the 12-item General Health Questionnaire. Psychological Reports, 84, 927-935.

37.

McDowell

(2006). Measuring health: A guide to rating scales and questionnaires (3rd ed.). New York, NY: Oxford University Press.

38.

Motl

R. W.

DiStefano

(2002). Longitudinal invariance of self-esteem and method effects associated with negatively worded items. Structural Equation Modeling, 9, 562-578.

39.

Penninkilampi-Kerola

Miettunen

Ebeling

(2006). A comparative assessment of the factor structures and psychometric properties of the GHQ-12 and the GHQ-20 based on data from a Finnish population-based sample. Scandinavian Journal of Psychology, 47, 431-440.

40.

Politi

P. L.

Piccinelli

Wilkinson

(1994). Reliability and validity and factor structure of the 12-item General Health Questionnaire among young males in Italy. Acta Psychiatrica Scandinavica, 90, 432-437.

41.

Raykov

(2001a). Estimation of congeneric scale reliability via covariance structure analysis with nonlinear constraints. British Journal of Mathematical and Statistical Psychology, 54, 315-323.

42.

Raykov

(2001b). Bias of coefficient alpha for congeneric measures with correlated errors. Applied Psychological Measurement, 25, 69-76.

43.

Sarriera

J. C.

Schwarcz

Câmara

S. G.

(1996). Bem-estar psicológico: Análise fatorial da escala de Goldberg (GHQ-12) numa amostra de jovens [Psychological well being: Goldberg’s Scale’s (GHQ-12) factorial analysis in a young people]. Psicologia: Reflexão e Crítica, 9, 293-306.

44.

Schmitz

Kruse

Tress

(1999). Psychometric properties of the General Health Questionnaire (GHQ-12) in a German primary care sample. Acta Psychiatrica Scandinavica, 100, 432-437.

45.

Shevlin

Adamson

(2005). Alternative factor models and factorial invariance of the GHQ-12: A large sample analysis using confirmatory factor analysis. Psychological Assessment, 17, 231-236.

46.

Smith

A. B.

Fallowfield

L. J.

Stark

D. P.

Velikova

Jenkins

(2010). A Rasch and confirmatory factor analysis of the General Health Questionnaire (GHQ)-12. Health and Quality of Life Outcomes, 8, 45. doi:10.1186/1477-7525-8-45

47.

Smith

A. B.

Oluboyede

West

Hewison

House

A. O.

(2012). The factor structure of the GHQ-12: The interaction between item phrasing, variance and levels of distress. Quality of Life Research. Advance online publication. doi:10.1007/s11136-012-0133-7

48.

Tait

R. J.

Hulse

G. K.

Robertson

S. I.

(2002). A review of the validity of the General Health Questionnaire in adolescent populations. Australian and New Zealand Journal of Psychiatry, 36, 550-557.

49.

Tomás

J. M.

Oliver

(1999). Rosenberg’s Self-Esteem Scale: Two factors or method effects. Structural Equation Modeling, 6, 84-98.

50.

Vasconcelos-Raposo

Fernandes

H. M.

Teixeira

C. M.

Bertelli

(2012). Factorial validity and invariance of the Rosenberg Self-Esteem Scale among Portuguese youngsters. Social Indicators Research, 105, 483-498. doi:10.1007/s11205-011-9782-0

51.

Wang

Lin

(2011). Wording effects and the dimensionality of the General Health Questionnaire (GHQ-12). Personality and Individual Differences, 50, 1056-1061.

52.

Werneke

Goldberg

Yalcin

Ustun

(2000). The stability of the factor structure of the General Health Questionnaire. Psychological Medicine, 30, 823-829.

53.

Winefield

H. R.

Coldney

R. D.

Winefield

A. H.

Tiggermann

(1989). The General Health Questionnaire: Reliability and validity for Australian youth. Australian and New Zealand Journal of Psychiatry, 23, 53-58.

54.

Worsley

Gribbin

C. C.

(1977). A factor analytic study of the twelve-item General Health Questionnaire. Australia and New Zealand Journal of Psychiatry, 11, 269-272.

55.

(2009). Factor structure of the General Health Questionnaire (GHQ-12): The role of wording effects. Personality and Individual Differences, 46, 197-201.