In Australia, the Strengths and Difficulties Questionnaire (SDQ) has been implemented in several national studies, including the Longitudinal Study of Australian Children (LSAC). However, three previous state-level validations indicated problems with instrument dimensionality, warranting further research. To address this gap, the current study employed exploratory graph analysis to investigate dimensionality of the caregiver-completed SDQ version 4 to 10 years in a nationally representative sample of Australian children. Data were from a dual cohort cross-sequential study (LSAC) that included more than 20,000 responses. Gaussian graphical models were estimated in each study wave and exploratory graph analysis applied. Structural consistency, item stability and network loadings were evaluated. The findings provided mixed support for the original SDQ five-factor structure. The Peer Problem scale displayed low structural consistency since items clustered with the Emotional Symptoms and Prosocial behavior, generating four-dimensional structures. Implications for future use of the SDQ version 4 to 10 years in Australia are provided.
AsparouhovT.MuthénB. (2010). Simple second order chi-square correction. Mplus Technical Appendix.
4.
Australian Institute of Family Studies. (2018). Data user guide—Growing up in Australia: The Longitudinal Study of Australian Children (LSAC). Author. https://doi.org/10.26193/JOZW2U
5.
Australian Institute of Health and Welfare. (2020). Australia’s children. Author.
6.
BøeT.HysingM.SkogenJ. C.BreivikK. (2016). The Strengths and Difficulties Questionnaire (SDQ): Factor structure and gender equivalence in Norwegian adolescents. PLOS ONE, 11(5), Article e0152202. https://doi.org/10.1371/journal.pone.0152202
CharterR. A. (2003). A breakdown of reliability coefficients by test type and reliability method, and the clinical implications of low reliability. Journal of General Psychology, 130(3), 290-304. https://doi.org/10.1080/00221300309601160
9.
CharterR. A.FeldtL. S. (2001). Meaning of reliability in terms of correct and incorrect clinical decisions: The art of decision making is still alive. Journal of Clinical and Experimental Neuropsychology, 23(4), 530-537. https://doi.org/10.1076/jcen.23.4.530.1227
10.
ChauvinB.LeonovaT. (2016). The Strengths and Difficulties Questionnaire (SDQ)revisited in a French-speaking population: Proposition of a reduced version of the parent SDQ. Journal of Psychoeducational Assessment, 34(4), 389-396. https://doi.org/10.1177/0734282915604074
11.
ChristensenA. P.GarridoL. E.GolinoH. (2020). Unique variable analysis: A novel approach for detecting redundant variables in multivariate data. https://psyarxiv.com/4kra2/
12.
ChristensenA. P.GolinoH. (2019). Estimating the stability of the number of factors via bootstrap exploratory graph analysis: A tutorial. https://psyarxiv.com/9deay/
13.
ChristensenA. P.GolinoH. (2020). On the equivalency of factor and network loadings. https://psyarxiv.com/xakez/
14.
ChristensenA. P.GolinoH.SilviaP. J. (2020). A psychometric network perspective on the validity and validation of personality trait questionnaires. European Journal of Personality, 34(6), 1095-1108. https://doi.org/10.1002/per.2265
15.
DalalyanA. S.HebiriM.LedererJ. (2017). On the prediction performance of the lasso. Bernoulli, 23(1), 552-581. https://doi.org/10.3150/15-BEJ756
16.
DambiJ. M.CortenL.ChiwaridzoM.JackH.MlamboT.JelsmaJ. (2018). A systematic review of the psychometric properties of the cross-cultural translations and adaptations of the Multidimensional Perceived Social Support Scale (MSPSS). Health and Quality of Life Outcomes, 16(1), Article 80. https://doi.org/10.1186/s12955-018-0912-0
17.
DeVellisR. F. (2016). Scale development: Theory and applications (Vol. 26). Sage.
18.
DickeyW. C.BlumbergS. J. (2004). Revisiting the factor structure of the Strengths and Difficulties Questionnaire: United States, 2001. Journal of the American Academy of Child and Adolescent Psychiatry, 43(9), 1159-1167. https://doi.org/10.1097/01.chi.0000132808.36708.a9
19.
DuinhofE.LekK.de LoozeM.CosmaA.MazurJ.GobinaI.WüstnerA.VolleberghW. A. M.StevensG. (2020). Revising the self-report Strengths and Difficulties Questionnaire for cross-country comparisons of adolescent mental health problems: The SDQ-R. Epidemiology and Psychiatric Sciences, 29, Article 0246. https://doi.org/10.1017/S2045796019000246
20.
DunnT. J.BaguleyT.BrunsdenV. (2014). From alpha to omega: A practical solution to the pervasive problem of internal consistency estimation. British Journal of Psychology, 105(3), 399-412. https://doi.org/10.1111/bjop.12046
21.
EpskampS.CramerA. O.WaldorpL. J.SchmittmannV. D.BorsboomD. (2012). qgraph: Network visualizations of relationships in psychometric data. Journal of Statistical Software, 48(4), 1-18. https://doi.org/10.18637/jss.v048.i04
22.
EpskampS.FriedE. I. (2018). A tutorial on regularized partial correlation networks. Psychological Methods, 23(4), 617-634. https://doi.org/10.1037/met0000167
23.
EssauC. A.OlayaB.Anastassiou-HadjicharalambousX.PauliG.GilvarryC.BrayD.O’CallaghanJ.OllendickT. H. (2012). Psychometric properties of the Strength and Difficulties Questionnaire from five European countries. International Journal of Methods in Psychiatric Research, 21(3), 232-245. https://doi.org/10.1002/mpr.1364
24.
FischerR.KarlJ. A. (2019). A primer to (cross-cultural) multi-group invariance testing possibilities in R. Frontiers in Psychology, 10, Article 1507. https://doi.org/10.3389/fpsyg.2019.01507
25.
Flores-KanterP. E.GarridoL. E.MorettiL. S.MedranoL. A. (2021). A modern network approach to revisiting the Positive and Negative Affective Schedule (PANAS) construct validity. https://doi.org/10.31234/osf.io/nkp9r
26.
FoygelR.DrtonM. (2010). Extended Bayesian information criteria for Gaussian graphical models. Paper presented at the Advances in Neural Information Processing Systems.
27.
FriedE. I.NesseR. M.ZivinK.GuilleC.SenS. (2014). Depression is more than the sum-score of its parts: IndividualDSM symptoms have different risk factors. Psychological Medicine, 44(10), 2067-2076. https://doi.org/10.1017/S0033291713002900
28.
FruchtermanT. M.ReingoldE. M. (1991). Graph drawing by force-directed placement. Software: Practice and Experience, 21(11), 1129-1164. https://doi.org/10.1002/spe.4380211102
29.
FurrR. M.BacharachV. R. (2013). Psychometrics: An introduction. Sage.
30.
GarridoL. E.BarradaJ. R.AguasvivasJ. A.Martínez-MolinaA.AriasV. B.GolinoH. F.LegazE.FerrísG.Rojo-MorenoL. (2018). Is small still beautiful for the Strengths and Difficulties Questionnaire? Novel findings using exploratory structural equation modeling. Assessment, 27(6), 1349-1367. https://doi.org/10.1177/1073191118780461
31.
GiannakopoulosG.TzavaraC.DimitrakakiC.KolaitisG.RotsikaV.TountasY. (2009). The factor structure of the Strengths and Difficulties Questionnaire (SDQ) in Greek adolescents. Ann Gen Psychiatry, 8(1), Article 20. https://doi.org/10.1186/1744-859X-8-20
32.
GladmanM.LancasterS. (2003). A review of the behaviour assessment system for children. School Psychology International, 24(3), 276-291. https://doi.org/10.1177/01430343030243002
GolinoH.MoulderR.ShiD.ChristensenA. P.GarridoL. E.NietoM. D.NesselroadeJ.SadanaR.ThiyagarajanJ. A.BokerS. M. (2020). Entropy fit indices: New fit measures for assessing the structure and dimensionality of multiple latent variables. Multivariate Behavioral Research. Advance online publication. https://doi.org/10.1080/00273171.2020.1779642
35.
GolinoH.ShiD.ChristensenA. P.GarridoL. E.NietoM. D.SadanaR.ThiyagarajanJ. A.Martinez-MolinaA. (2020). Investigating the performance of exploratory graph analysis and traditional techniques to identify the number of latent factors: A simulation and tutorial. Psychological Methods, 25(3), 292-320. https://doi.org/10.1037/met0000255
36.
GolinoH. F.EpskampS. (2017). Exploratory graph analysis: A new approach for estimating the number of dimensions in psychological research. PLOS ONE, 12(6), Article e0174035. https://doi.org/10.1371/journal.pone.0174035
37.
Gómez-BeneytoM.NolascoA.MonchoJ.Pereyra-ZamoraP.Tamayo-FonsecaN.MunarrizM.SalazarJ.Tabarés-SeisdedosR.GirónM. (2013). Psychometric behaviour of the Strengths and Difficulties Questionnaire (SDQ) in the Spanish national health survey 2006. BMC Psychiatry, 13(1), Article 95. https://doi.org/10.1186/1471-244X-13-95
38.
GoodmanA.LampingD. L.PloubidisG. B. (2010). When to use broader internalising and externalising subscales instead of the hypothesised five subscales on the Strengths and Difficulties Questionnaire (SDQ): Data from British parents, teachers and children. Journal of Abnormal Child Psychology, 38(8), 1179-1191. https://doi.org/10.1007/s10802-010-9434-x
GoodmanR. (2001). Psychometric properties of the Strengths and Difficulties Questionnaire. Journal of the American Academy of Child and Adolescent Psychiatry, 40(11), 1337-1345. https://doi.org/10.1097/00004583-200111000-00015
41.
GoodmanR.MeltzerH.BaileyV. (1998). The Strengths and Difficulties Questionnaire: A pilot study on the validity of the self-report version. European Child and Adolescent Psychiatry, 7(3), 125-130. https://doi.org/10.1007/s007870050057
42.
GoodmanR.ScottS. (1999). Comparing the Strengths and Difficulties Questionnaire and the Child Behavior Checklist: Is small beautiful?Journal of Abnormal Child Psychology, 27(1), 17-24. https://doi.org/10.1023/A:1022658222914
HafekostJ.LawrenceD.BoterhovendeHaanK.JohnsonS. E.SawS.BuckinghamW. J.SawyerM. G.AinleyJ.ZubrickS. R. (2016). Methodology of young minds matter: The second Australian Child and adolescent Survey of Mental Health and Wellbeing. Australian & New Zealand Journal of Psychiatry, 50(9), 866-875. https://doi.org/10.1177/0004867415622270
45.
HallquistM. N.WrightA. G.MolenaarP. C. (2019). Problems with centrality measures in psychopathology symptom networks: Why network psychometrics cannot escape psychometric theory. Multivariate Behavioral Research. Advance online publication. https://doi.org/10.1080/00273171.2019.1640103
46.
HawesD. J.DaddsM. R. (2004). Australian data and psychometric properties of the Strengths and Difficulties Questionnaire. Australian & New Zealand Journal of Psychiatry, 38(8), 644-651. https://doi.org/10.1080/j.1440-1614.2004.01427.x
47.
HayesL. (2007). Problem behaviours in early primary school children: Australian normative data using the Strengths and Difficulties Questionnaire. Australian & New Zealand Journal of Psychiatry, 41(3), 231-238. https://doi.org/10.1080/00048670601172715
48.
HeubeckB. G. (2000). Cross-cultural generalizability of CBCL syndromes across three continents: From the USA and Holland to Australia. Journal of Abnormal Child Psychology, 28(5), 439-450. https://doi.org/10.1023/A:1005131605891
49.
HillC. R.HughesJ. N. (2007). An examination of the convergent and discriminant validity of the Strengths and Difficulties Questionnaire. School Psychology Quarterly, 22(3), 380-406. https://doi.org/10.1037/1045-3830.22.3.380
50.
KellerF.LangmeyerA. N. (2019). An item response theory analysis of the Strengths and Difficulties Questionnaire (SDQ). European Journal of Psychological Assessment, 35(2), 266-279. https://doi.org/10.1027/1015-5759/a000390
51.
KerstenP.CzubaK.McPhersonK.DudleyM.ElderH.TauroaR.VandalA. (2016). A systematic review of evidence for the psychometric properties of the Strengths and Difficulties Questionnaire. International Journal of Behavioral Development, 40(1), 64-75. https://doi.org/10.1177/0165025415570647
KruisJ.MarisG. (2016). Three representations of the Ising model. Scientific Reports, 6, Article 34175. https://doi.org/10.1038/srep34175
54.
LaiK.GreenS. B. (2016). The problem with having two watches: Assessment of fit when RMSEA and CFI disagree. Multivariate Behavioral Research, 51(2-3), 220-239. https://doi.org/10.1080/00273171.2015.1134306
55.
LauritzenS. L. (1996). Graphical models (Vol. 17). Clarendon Press.
56.
LeeE.-H. (2012). Review of the psychometric evidence of the perceived stress scale. Asian Nursing Research, 6(4), 121-127. https://doi.org/10.1016/j.anr.2012.08.004
57.
LehmannS.BøeT.BreivikK. (2017). The internal structure of foster-parent completed SDQ for school-aged children. PLOS ONE, 12(6), Article e0176625. https://doi.org/10.1371/journal.pone.0176625
58.
LiY.WenZ.HauK.-T.YuanK.-H.PengY. (2020). Effects of cross-loadings on determining the number of factors to retain. Structural Equation Modeling: A Multidisciplinary Journal, 27(6), 841-863. https://doi.org/10.1080/10705511.2020.1745075
59.
LiuS.-K.ChienY.-L.ShangC.-Y.LinC.-H.LiuY.-C.GauS. S.-F. (2013). Psychometric properties of the Chinese version of Strength and Difficulties Questionnaire. Comprehensive Psychiatry, 54(6), 720-730. https://doi.org/10.1016/j.comppsych.2013.01.002
60.
Mansbach-KleinfeldI.ApterA.FarbsteinI.LevineS. Z.PoznizovskyA. (2010). A population-based psychometric validation study of the Strengths and Difficulties Questionnaire–Hebrew version. Frontiers in Psychiatry, 1, Article 151. https://doi.org/10.3389/fpsyt.2010.00151
61.
MatsuishiT.NaganoM.ArakiY.TanakaY.IwasakiM.YamashitaY.NagamitsuS.IizukaC.OhyaT.ShibuyaK.HaraM.MatsudaK.TsudaA.KakumaT. (2008). Scale properties of the Japanese version of the Strengths and Difficulties Questionnaire (SDQ): A study of infant and school children in community samples. Brain & Development, 30(6), 410-415. https://doi.org/10.1016/j.braindev.2007.12.003
62.
McCarronR. H.GraceyF.BatemanA. (2020). Detecting mental health problems after paediatric acquired brain injury: A pilot Rasch analysis of the Strengths and Difficulties Questionnaire. Neuropsychological Rehabilitation. Advance online publication. https://doi.org/10.1080/09602011.2020.1760111
MellorD. (2005). Normative data for the Strengths and Difficulties Questionnaire in Australia. Australian Psychologist, 40(3), 215-222. https://doi.org/10.1080/00050060500243475
65.
MellorD.StokesM. (2007). The factor structure of the Strengths and Difficulties Questionnaire. European Journal of Psychological Assessment, 23(2), 105-112. https://doi.org/10.1027/1015-5759.23.2.105
66.
MurisP.MeestersC.van den BergF. (2003). The Strengths and Difficulties Questionnaire (SDQ). European Child and Adolescent Psychiatry, 12(1), 1-8. https://doi.org/10.1007/s00787-003-0298-2
67.
Ortuño-SierraJ.ChocarroE.Fonseca-PedreroE.i RibaS. S.MuñizJ. (2015). The assessment of emotional and behavioural problems: Internal structure of the Strengths and Difficulties Questionnaire. International Journal of Clinical and Health Psychology, 15(3), 265-273. https://doi.org/10.1016/j.ijchp.2015.05.005
68.
Ortuno-SierraJ.Fonseca-PedreroE.PainoM.i RibaS. S.MunizJ. (2015). Screening mental health problems during adolescence: Psychometric properties of the Spanish version of the Strengths and Difficulties Questionnaire. Journal of Adolescence, 38(January), 49-56. https://doi.org/10.1016/j.adolescence.2014.11.001
69.
PercyA.McCrystalP.HigginsK. (2008). Confirmatory factor analysis of the adolescent self-report Strengths and Difficulties Questionnaire. European Journal of Psychological Assessment, 24(1), 43-48. https://doi.org/10.1027/1015-5759.24.1.43
70.
PérezM.-E.PericchiL. R. (2014). Changing statistical significance with the amount of information: The adaptive α significance level. Statistics & Probability Letters, 85(February), 20-24. https://doi.org/10.1016/j.spl.2013.10.018
71.
PonsP.LatapyM. (2005). Computing communities in large networks using random walks. Paper presented at the International symposium on computer and information sciences.
72.
R Core Team. (2013). R: A language and environment for statistical computing. R Foundation for Statistical Computing.
73.
ReijntjesA.KamphuisJ. H.PrinzieP.TelchM. J. (2010). Peer victimization and internalizing problems in children: A meta-analysis of longitudinal studies. Child Abuse & Neglect, 34(4), 244-252. https://doi.org/10.1016/j.chiabu.2009.07.009
74.
ReynoldsC.KamphausR. (1992). Manual for the behavioral assessment system for children. American Guidance Service.
75.
RoccoL.SuhrckeM. (2012). Is social capital good for health? A European perspective. WHO Regional Office for Europe Copenhagen.
76.
RosseelY. (2012). Lavaan: An R package for structural equation modeling and more. Version 0.5–12 (BETA). Journal of Statistical Software, 48(2), 1-36. https://doi.org/10.18637/jss.v048.i02
77.
RuchkinV.JonesS.VermeirenR.Schwab-StoneM. (2008). The Strengths and Difficulties Questionnaire: The self-report version in American urban and suburban youth. Psychological Assessment, 20(2), 175-182. https://doi.org/10.1037/1040-3590.20.2.175
78.
SanneB.TorsheimT.HeiervangE.StormarkK. M. (2009). The Strengths and Difficulties Questionnaire in the Bergen Child Study: A conceptually and methodically motivated structural analysis. Psychological Assessment, 21(3), 352-364. https://doi.org/10.1037/a0016317
79.
SantiagoP. H. R.NielsenT.SmithersL. G.RobertsR.JamiesonL. (2020). Measuring Stress in Australia: Validation of the Perceived Stress Scale (PSS-14) in a national sample. Health and Quality of Life Outcomes, 18, Article 100. https://doi.org/10.1186/s12955-020-01343-x
80.
SantosH. P.Jr.KossakowskiJ. J.SchwartzT. A.BeeberL.FriedE. I. (2018). Longitudinal network structure of depression symptoms and self-efficacy in low-income mothers. PLOS ONE, 13(1), Article e0191675. https://doi.org/10.1371/journal.pone.0191675
81.
SawyerM. G.ArneyF. M.BaghurstP. A.ClarkJ. J.GraetzB. W.KoskyR. J.NurcombeB.PattonG. C.PriorM. R.RaphaelB.ReyJ. M.WhaitesL. C.ZubrickS. R. (2001). The mental health of young people in Australia: Key findings from the child and adolescent component of the National Survey of Mental Health and Well-Being. Australian & New Zealand Journal of Psychiatry, 35(6), 806-814. https://doi.org/10.1046/j.1440-1614.2001.00964.x
82.
SchriesheimC. A.EisenbachR. J. (1995). An exploratory and confirmatory factor-analytic investigation of item wording effects on the obtained factor structures of survey questionnaire measures. Journal of Management, 21(6), 1177-1193. https://doi.org/10.1177/014920639502100609
83.
SiddonsH.LancasterS. (2004). An overview of the use of the child behavior checklist within Australia: Report. Acer Press.
SimmsL. J.WatsonD. (2007). The construct validation approach to personality scale construction. In RobinsR. W.FraleyR. C.KruegerR. F. (Eds.), Handbook of research methods in personality psychology (pp. 240-258). Guilford Press.
86.
SmedjeH.BromanJ.-E.HettaJ.Von KnorringA.-L. (1999). Psychometric properties of a Swedish version of the “Strengths and Difficulties Questionnaire.”European Child and Adolescent Psychiatry, 8(2), 63-70. https://doi.org/10.1007/s007870050086
87.
SoaresG.SantiagoP.WerneckR.Michel-CrosatoE.JamiesonL. (2020). A psychometric network analysis of OHIP-14 across Australian and Brazilian populations. JDR Clinical & Translational Research. Advance online publication. https://doi.org/10.1177/2380084420939931
88.
SteigerJ. H. (2007). Understanding the limitations of global fit assessment in structural equation modeling. Personality and Individual Differences, 42(5), 893-898. https://doi.org/10.1016/j.paid.2006.09.017
89.
StoneL. L.OttenR.EngelsR. C.VermulstA. A.JanssensJ. M. (2010). Psychometric properties of the parent and teacher versions of the Strengths and Difficulties Questionnaire for 4-to 12-year-olds: A review. Clinical Child and Family Psychology Review, 13(3), 254-274. https://doi.org/10.1007/s10567-010-0071-2
90.
TibshiraniR. (1996). Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society: Series B (Methodological), 58(1), 267-288. https://doi.org/10.1111/j.2517-6161.1996.tb02080.x
91.
van BorkR.RhemtullaM.WaldorpL. J.KruisJ.RezvanifarS.BorsboomD. (2019). Latent variable models and networks: Statistical equivalence and testability. Multivariate Behavioral Research. Advance online publication. https://doi.org/10.1080/00273171.2019.1672515
92.
van de Looij-JansenP. M.GoedhartA. W.de WildeE. J.TreffersP. D. (2011). Confirmatory factor analysis and factorial invariance analysis of the adolescent self-report Strengths and Difficulties Questionnaire: How important are method effects and minor factors?British Journal of Clinical Psychology, 50(2), 127-144. https://doi.org/10.1348/014466510X498174
93.
Van LeeuwenK.MeerschaertT.BosmansG.De MedtsL.BraetC. (2006). The Strengths and Difficulties Questionnaire in a community sample of young children in Flanders. European Journal of Psychological Assessment, 22(3), 189-197. https://doi.org/10.1027/1015-5759.22.3.189
94.
Van RoyB.VeenstraM.Clench-AasJ. (2008). Construct validity of the five-factor Strengths and Difficulties Questionnaire (SDQ) in pre-, early, and late adolescence. Journal of Child Psychology and Psychiatry, 49(12), 1304-1312. https://doi.org/10.1111/j.1469-7610.2008.01942.x
95.
WarnickE. M.BrackenM. B.KaslS. (2008). Screening efficiency of the Child Behavior Checklist and Strengths and Difficulties Questionnaire: A systematic review. Child and Adolescent Mental Health, 13(3), 140-147. https://doi.org/10.1111/j.1475-3588.2007.00461.x
96.
WellsC. S.WollackJ. A. (2003). An instructor’s guide to understanding test reliability: Testing and evaluation services. University of Wisconsin.
97.
YuC.-Y. (2002). Evaluating cutoff criteria of model fit indices for latent variable models with binary and continuous outcomes (Vol. 30). University of California.
98.
ZhangB.HorvathS. (2005). A general framework for weighted gene co-expression network analysis. Statistical Applications in Genetics and Molecular Biology, 4(1), Article 17. https://doi.org/10.2202/1544-6115.1128
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
