Strengths and Difficulties Questionnaire: Psychometric Properties and Normative Data for Spanish 5- to 17-Year-Olds

Abstract

The Strengths and Difficulties Questionnaire (SDQ) has been extensively used to measure common forms of psychopathology among children and adolescents. However, its psychometric properties vary across countries and several controversial issues warrant further investigation. This study aimed to evaluate whether the Spanish version of the SDQ is a reliable and valid tool for assessing emotional and behavioral problems in a sample of 6,775 students aged 5 to 17 years, as rated by parents, teachers, and youth. We examined the internal consistency of the questionnaire, its factor structure, and measurement invariance across child’s gender and age. Criterion validity was tested against the Child Behavior Checklist (CBCL), Teacher’s Report Form (TRF), and Youth Self-Report (YSR), and we measured the ability of the SDQ to identify children with specific psychiatric disorders. Finally, we provide, for the first time, Spanish normative data for children aged 5 to 10 and 11 to 17 years, according to gender and each informant. Our results revealed acceptable reliability estimates for all SDQ subscales. Confirmatory factor analysis supported the original five-factor model and full measurement invariance was found. Furthermore, SDQ scores showed a moderate to strong correlation with those on the equivalent CBCL/TRF/YSR scales, and were effective in discriminating individuals with and without clinical diagnoses.

Keywords

Strengths and Difficulties Questionnaire SDQ ordinal alpha McDonald’s omega confirmatory factor analysis measurement invariance diagnostic accuracy interrater agreement

Get full access to this article

View all access options for this article.

References

Abad

Forns

Amador

J. A.

Martorell

(2000). Fiabilidad y validez del youth self report en una muestra de adolescents [Reliability and validity of youth self-report in a sample of adolescents]. Psicothema, 12(1), 49-54.

Achenbach

T. M.

(1991a). Manual for the Child Behavior Checklist/4-18 and 1991 profile. Department of Psychiatry, University of Vermont.

Achenbach

T. M.

(1991b). Manual for the Teacher’s Report Form and 1991 profile. Department of Psychiatry, University of Vermont.

Achenbach

T. M.

(1991c). Manual for the Youth Self-Report and 1991 profile. Department of Psychiatry, University of Vermont.

Achenbach

T. M.

McConaughy

S. H.

Howell

C. T.

(1987). Child/adolescent behavioral and emotional problems: Implications of cross-informant correlations for situation specificity. Psychological Bulletin, 101(2), 213-232. https://doi.org/10.1037/0033-2909.101.2.213

Achenbach

T. M.

Rescorla

L. A.

(2000). Manual for the ASEBA preschool-age forms and profiles. Research Center for Children, Youth and Families, University of Vermont.

American Psychiatric Association. (2000). Diagnostic and Statistical Manual of Mental Disorders (4th ed., Text rev.). American Psychiatric Publishing Association.

Ayuso

Cruz

Medina

J. L.

(2019). La promoción de salud en la escuela como estrategia para el abordaje de la cronicidad en España [Health promotion in school as a strategy for tackling chronicity in Spain]. Horizonte Sanitario, 18(1), 37-47. https://doi.org/10.19136/hs.a18n1.2433

Barrett

(2007). Structural equation modelling: Adjudging model fit. Personality and Individual Differences, 42(5), 815-824. https://doi.org/10.1016/j.paid.2006.09.018

10.

Becker

Hagenberg

Roessner

Woerner

Rothenberger

(2004). Evaluation of the self-reported SDQ in a clinical setting: Do self-reports tell us more than ratings by adult informants? European Child and Adolescent Psychiatry, 13(Suppl. 2), ii17-ii24. https://doi.org/10.1007/s00787-004-2004-4

11.

Becker

Woerner

Hasselhorn

Banaschewski

Rothenberger

(2004). Validation of the parent and teacher SDQ in a clinical sample. European Child and Adolescent Psychiatry, 13(Suppl. 2), ii11-ii16. https://doi.org/10.1007/s00787-004-2003-5

12.

Bøe

Hysing

Skogen

J. C.

Breivik

(2016). The Strengths and Difficulties Questionnaire (SDQ): Factor structure and gender equivalence in Norwegian adolescents. PLOS ONE, 11(5), Article e0152202. https://doi.org/10.1371/journal.pone.0152202

13.

Chen

F. F.

(2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling, 14(3), 464-504. https://doi.org/10.1080/10705510701301834

14.

Cohen

(1977). Statistical power analysis for the behavioral sciences. Academic Press.

15.

Cohen

(1992). A power primer. Psychological Bulletin, 112(1), 155-159. https://doi.org/10.1037/0033-2909.112.1.155

16.

De Los Reyes

Kazdin

A. E.

(2005). Informant discrepancies in the assessment of childhood psychopathology: A critical review, theoretical framework, and recommendations for further study. Psychological Bulletin, 131(4), 483-509. https://doi.org/10.1037/0033-2909.131.4.483

17.

Dickey

W. C.

Blumberg

S. J.

(2004). Revisiting the factor structure of the Strengths and Difficulties Questionnaire: United States, 2001. Journal of the American Academy of Child & Adolescent Psychiatry, 43(9), 1159-1167. https://doi.org/10.1097/01.chi.0000132808.36708.a9

18.

Ezpeleta

Granero

de la Osa

Penelo

Domènech

J. M.

(2013). Psychometric properties of the Strengths and Difficulties Questionnaire^3-4 in 3-year-old preschoolers. Comprehensive Psychiatry, 54(3), 282-291. https://doi.org/10.1016/j.comppsych.2012.07.009

19.

Gaete

Montero-Marin

Valenzuela

Rojas-Barahona

C. A.

Olivares

Araya

(2018). Mental health among children and adolescents: Construct validity, reliability, and parent-adolescent agreement on the “Strengths and Difficulties Questionnaire” in Chile. PLOS ONE, 13(2), Article e0191809. https://doi.org/10.1371/journal.pone.0191809

20.

Gómez-Beneyto

Nolasco

Moncho

Pereyra-Zamora

Tamayo-Fonseca

Munarriz

Salazar

Tabarés-Seisdedos

Girón

(2013). Psychometric behaviour of the Strengths and Difficulties Questionnaire (SDQ) in the Spanish national health survey 2006. BMC Psychiatry, 13, Article 95. https://doi.org/10.1186/1471-244X-13-95

21.

Goodman

Lamping

D. L.

Ploubidis

G. B.

(2010). When to use broader internalising and externalising subscales instead of the hypothesised five subscales on the Strengths and Difficulties Questionnaire (SDQ): Data from British parents, teachers and children. Journal of Abnormal Child Psychology, 38(8), 1179-1191. https://doi.org/10.1007/s10802-010-9434-x

22.

Goodman

(1997). The Strengths and Difficulties Questionnaire: A research note. Journal of Child Psychology and Psychiatry, 38(5), 581-586. https://doi.org/10.1111/j.1469-7610.1997.tb01545.x

23.

Goodman

(1999). The extended version of the Strengths and Difficulties Questionnaire as a guide to child psychiatric caseness and consequent burden. Journal of Child Psychology and Psychiatry, 40(5), 791-799. https://doi.org/10.1111/1469-7610.00494

24.

Goodman

(2001). Psychometric properties of the Strengths and Difficulties Questionnaire. Journal of the American Academy of Child & Adolescent Psychiatry, 40(11), 1337-1345. https://doi.org/10.1097/00004583-200111000-00015

25.

Goodman

Renfrew

Mullick

(2000). Predicting type of psychiatric disorder from Strengths and Difficulties Questionnaire (SDQ) scores in child mental health clinics in London and Dhaka. European Child and Adolescent Psychiatry, 9(2), 129-134. https://doi.org/10.1007/s007870050008

26.

J. P.

Burstein

Schmitz

Merikangas

K. R.

(2013). The Strengths and Difficulties Questionnaire (SDQ): The factor structure and scale validation in U.S. adolescents. Journal of Abnormal Child Psychology, 41(4), 583-595. https://doi.org/10.1007/s10802-012-9696-6

27.

Kaufman

Birmaher

Brent

Rao

Flynn

Moreci

Williamson

Ryan

(1997). Schedule for Affective Disorders and Schizophrenia for School-Age Children-Present and Lifetime Version (K-SADS-PL): Initial reliability and validity data. Journal of the American Academy of Child & Adolescent Psychiatry, 36(7), 980-988. https://doi.org/10.1097/00004583-199707000-00021

28.

Kovacs

Sharp

(2014). Criterion validity of the Strengths and Difficulties Questionnaire (SDQ) with inpatient adolescents. Psychiatry Research, 219(3), 651-657. https://doi.org/10.1016/j.psychres.2014.06.019

29.

Lemos

Fidalgo

A. M.

Calvo

Menéndez

(1992). Validación de la escala de psicopatología infanto-juvenil YSR [Validation of the YSR Child-Youth Psychopathology Scale]. Clínica y Salud, 3(2), 183-194.

30.

Marsh

H. W.

Hau

K. T.

Wen

Z. L.

(2004). In search of golden rules: Comment on hypothesis-testing approaches to setting cutoff values for fit indexes and dangers in overgeneralizing Hu and Bentler’s (1999) findings. Structural Equation Modeling, 11(3), 320-341. https://doi.org/10.1207/s15328007sem1103_2

31.

Niclasen

Skovgaard

A. M.

Andersen

A. M.

Sømhovd

M. J.

Obel

(2013). A confirmatory approach to examining the factor structure of the Strengths and Difficulties Questionnaire (SDQ): A large scale cohort study. Journal of Abnormal Child Psychology, 41(3), 355-365. https://doi.org/10.1007/s10802-012-9683-y

32.

Ortuño-Sierra

Aritio-Solana

Fonseca-Pedrero

(2018). Mental health difficulties in children and adolescents: The study of the SDQ in the Spanish national health survey 2011-2012. Psychiatry Research, 259(January), 236-242. https://doi.org/10.1016/j.psychres.2017.10.025

33.

Ortuño-Sierra

Chocarro

Fonseca-Pedrero

Riba

S. S. I.

Muñiz

(2015). The assessment of emotional and behavioural problems: Internal structure of the Strengths and Difficulties Questionnaire. International Journal of Clinical and Health Psychology, 15(3), 265-273. https://doi.org/10.1016/j.ijchp.2015.05.005

34.

Ortuño-Sierra

Fonseca-Pedrero

Paino

Sastre

Riba

Muñiz

(2015). Screening mental health problems during adolescence: Psychometric properties of the Spanish version of the Strengths and Difficulties Questionnaire. Journal of Adolescence, 38(January), 49-56. https://doi.org/10.1016/j.adolescence.2014.11.001

35.

Putnick

D. L.

Bornstein

M. H.

(2016). Measurement invariance conventions and reporting: The state of the art and future directions for psychological research. Developmental Review, 41(September), 71-90. https://doi.org/10.1016/j.dr.2016.06.004

36.

Revelle

(2017). psych: Procedures for personality and psychological research [Software]. https://personality-project.org/r/psych-manual.pdf

37.

Revelle

Zinbarg

R. E.

(2009). Coefficients alpha, beta, omega and the glb: Comments on Sijtsma. Psychometrika, 74(1), 145-154. https://doi.org/10.1007/s11336-008-9102-z

38.

Robin

Turck

Hainard

Tiberti

Lisacek

Sanchez

J. C.

Müller

(2011). pROC: An open-source package for R and S+ to analyze and compare ROC curves. BMC Bioinformatics, 12, Article 77. https://doi.org/10.1186/1471-2105-12-77

39.

Rosseel

(2012). lavaan: An R package for structural equation modeling and more: Version 0.5-12 (BETA). Journal of Statistical Software, 48(2), 1-36. https://doi.org/10.18637/jss.v048.i02

40.

Rubio-Stipec

Bird

Canino

Gould

(1990). The internal consistency and concurrent validity of a Spanish translation of the Child Behavior Checklist. Journal of Abnormal Child Psychology, 18(4), 393-406. https://doi.org/10.1007/BF00917642

41.

Ruchkin

Koposov

Vermeiren

Schwab-Stone

(2012). The Strength and Difficulties Questionnaire: Russian validation of the teacher version and comparison of teacher and student reports. Journal of Adolescence, 35(1), 87-96. https://doi.org/10.1016/j.adolescence.2011.06.003

42.

Stone

L. L.

Janssens

J. M.

Vermulst

A. A.

Van Der Maten

Engels

R. C.

Otten

(2015). The Strengths and Difficulties Questionnaire: Psychometric properties of the parent and teacher version in children aged 4-7. BMC Psychology, 3, Article 4. https://doi.org/10.1186/s40359-015-0061-8

43.

Stone

L. L.

Otten

Engels

R. C.

Vermulst

A. A.

Janssens

J. M.

(2010). Psychometric properties of the parent and teacher versions of the Strengths and Difficulties Questionnaire for 4- to 12-year-olds: A review. Clinical Child and Family Psychology Review, 13(3), 254-274. https://doi.org/10.1007/s10567-010-0071-2

44.

Stone

L. L.

Otten

Ringlever

Hiemstra

Engels

R. C. M. E.

Vermulst

A. A.

Janssens

J. M. A. M.

(2013). The parent version of the Strengths and Difficulties Questionnaire: Omega as an alternative to alpha and a test for measurement invariance. European Journal of Psychological Assessment, 29(1), 44-50. https://doi.org/10.1027/1015-5759/a000119

45.

Sveen

T. H.

Berg-Nielsen

T. S.

Lydersen

Wichstrøm

(2013). Detecting psychiatric disorders in preschoolers: Screening with the Strengths and Difficulties Questionnaire. Journal of the American Academy of Child & Adolescent Psychiatry, 52(7), 728-736. https://doi.org/10.1016/j.jaac.2013.04.010

46.

Swets

J. A.

(1988). Measuring the accuracy of diagnostic systems. Science, 240(4857), 1285-1293. https://doi.org/10.1126/science.3287615

47.

Ulloa

R. E.

Ortiz

Higuera

Nogales

Fresán

Apiquian

Cortés

Arechavaleta

Foulliux

Martínez

Hernández

Domínguez

de la Peña

(2006). Interrater reliability of the Spanish version of Schedule for Affective Disorders and Schizophrenia for School-Age Children-Present and Lifetime version (K-SADS-PL). Actas Españolas de Psiquiatría, 34(1), 36-40.

48.

van de Looij-Jansen

P. M.

Goedhart

A. W.

de Wilde

E. J.

Treffers

P. D.

(2011). Confirmatory factor analysis and factorial invariance analysis of the adolescent self-report Strengths and Difficulties Questionnaire: How important are method effects and minor factors? British Journal of Clinical Psychology, 50(2), 127-144. https://doi.org/10.1348/014466510X498174

49.

van den Heuvel

Jansen

D. E. M. C.

Stewart

R. E.

Smits-Engelsman

B. C. M.

Reijneveld

S. A.

Flapper

B. C. T.

(2017). How reliable and valid is the teacher version of the Strengths and Difficulties Questionnaire in primary school children? PLOS ONE, 12(4), Article e0176605. https://doi.org/10.1371/journal.pone.0176605

50.

van Widenfelt

B. M.

Goedhart

A. W.

Treffers

P. D.

Goodman

(2003). Dutch version of the Strengths and Difficulties Questionnaire (SDQ). European Child and Adolescent Psychiatry, 12(6), 281-289. https://doi.org/10.1007/s00787-003-0341-3

51.

Vugteveen

de Bildt

Hartman

C. A.

Timmerman

M. E.

(2018). Using the Dutch multi-informant Strengths and Difficulties Questionnaire (SDQ) to predict adolescent psychiatric diagnoses. European Child and Adolescent Psychiatry, 27(10), 1347-1359. https://doi.org/10.1007/s00787-018-1127-y

52.

World Health Organization. (2016). Child and adolescent mental health. https://www.who.int/mental_health

53.

Yao

Zhang

Zhu

Jing

McWhinnie

C. M.

Abela

J. R.

(2009). Measuring adolescent psychopathology: Psychometric properties of the self-report Strengths and Difficulties Questionnaire in a sample of Chinese adolescents. Journal of Adolescent Health, 45(1), 55-62. https://doi.org/10.1016/j.jadohealth.2008.11.006

54.

Zumbo

B. M.

Gadermann

A. M.

Zeisser

(2007). Ordinal versions of coefficients alpha and theta for Likert rating scales. Journal of Modern Applied Statistical Methods, 6(1), 21-29. https://doi.org/10.22237/jmasm/1177992180

55.

Zwirs

Burger

Schulpen

Vermulst

A. A.

HiraSing

R. A.

Buitelaar

(2011). Teacher ratings of children’s behavior problems and functional impairment across gender and ethnicity: Construct equivalence of the Strengths and Difficulties Questionnaire. Journal of Cross-Cultural Psychology, 42(3), 466-481. https://doi.org/10.1177/0022022110362752

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.20 MB