Malaysian Parent Ratings of the Strengths and Difficulties Questionnaire: Factor Structure and Measurement Invariance Across Language Versions,Gender,Informants,and Race

Abstract

For a Malaysian sample, the current study used exploratory factor analysis (EFA) to determine the best model for parent ratings of the Strengths and Difficulties Questionnaire (SDQ), and then multiple-group confirmatory factor analysis (MCFA) to confirm this model, and to examine measurement invariance across different language versions (Malay and English), child’s gender (boys and girls), informants (mothers and fathers), and racial groups (Malay, Chinese, and Indians). In all 1,407 Malaysian parents completed SDQ ratings of their children (age ranging from 5 to 13 years). The EFA showed most support for a two-factor model oblique model, with factors for a positive construal factor and a psychopathology factor. CFA confirmed this model, and MCFA showed full measurement invariance (configural, metric. and scalar) across the groups in the different comparisons. For all comparisons, there were equivalencies for latent mean scores. The implications of the findings for clinical and research practice involving the SDQ in Malaysia are discussed.

Keywords

Strengths and Difficulties Questionnaire parent ratings measurement invariance exploratory factor analysis multiple-group confirmatory factor analysis

Get full access to this article

View all access options for this article.

References

Allik

McCrae

R. R.

(2004). Toward a geography of personality traits: Patterns of profiles across 36 cultures. Journal of Cross-Cultural Psychology, 35, 13-28.

American Psychiatric Association. (1994). Diagnostic and statistical manual of mental disorders (4th ed.). Washington, DC: Author.

American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Washington, DC: Author.

Ang

P. R.

(2006). Effects of parenting style on personal and social variables for Asian adolescents. American Journal of Orthopsychiatry, 76, 503-511.

Bao

K. B.

Q. M.

(2006). A comparison of attachment in adolescents in mainland China and Malaysia. Chinese Journal of Clinical Psychology, 14, 172-174.

Beauducel

Herzberg

P. Y.

(2006). On the performance of maximum likelihood versus means and variance adjusted weighted least squares estimation in CFA. Structural Equation Modeling, 13, 186-203. doi:10.1207/s15328007sem1302_2

Becker

Woerner

Hasselhorn

Banaschewski

Rothenberger

(2004). Validation of the parent and teacher SDQ in a clinical sample. European Child & Adolescent Psychiatry, 13, ii11-ii16. doi:10.1007/s00787-004-2003-5

Bhaskaran

Sukumaran

(2007). National culture, business culture and management practices: Consequential relationships? Cross Cultural Management: An International Journal, 14, 54-67.

Brown

T. A.

(2006). Confirmatory factor analysis for applied research (1st ed.) New York, NY: Guilford Press.

10.

Brown

T. A.

(2014). Confirmatory factor analysis for applied research (2nd ed.) New York, NY: Guilford Press.

11.

Caci

Morin

A. J.

Tran

(2015). Investigation of a bifactor model of the Strengths and Difficulties Questionnaire. European Child & Adolescent Psychiatry, 24, 1291-1301. doi:10.1007/s00787-015-0679-3

12.

Calmorin

L. P.

Calmorin

M. A.

(2007). Research methods and thesis writing. Manila, Philippines: Rex Book Store.

13.

Castello

A. B.

Osborne

J. W.

(2005). Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Practical Assessment: Research & Evaluation, 10, 1-9.

14.

Chao

R. K.

(1994). Beyond parental control and authoritarian parenting styles: Understanding Chinese parenting through the cultural notion of training. Child Development, 65, 1111-1120.

15.

Cheah

I. G. S.

Yuen

C. W

. (2016). A review of research on child abuse in Malaysia. Medical Journal of Malaysia, 71(Suppl. 1), 87-99.

16.

Chen

F. F.

(2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling, 14, 464-504. doi:10.1080/10705510701301834

17.

Chen

Liu

(2000). Parental warmth, control, and indulgence and their relations to adjustment in Chinese children: A longitudinal study. Journal of Family Psychology, 14, 401-419.

18.

Chiorri

Hall

Casely-Hayford

Malmberg

L. E.

(2016). Evaluating measurement invariance between parents using the Strengths and Difficulties Questionnaire (SDQ). Assessment, 23, 63-74. doi:10.1177/1073191114568301

19.

Cummings

S. M.

Savitz

L. A.

Konrad

T. R.

(2001). Reported response rates to mailed physician questionnaires. Health Services Research, 35, 1347-1355.

20.

Dalhan

H. M.

(1991). Local values in intercultural management. Malaysian Management Review, 1, 45-50.

21.

Department of Statistics, Malaysia. (2010). Evidence. Retrieved from https://www.dosm.gov.my/v1/

22.

Dickey

W. C.

Blumberg

S. J.

(2004). Revisiting the factor structure of the strengths and difficulties questionnaire: United States, 2001. Journal of the American Academy of Child & Adolescent Psychiatry, 43, 1159-1167. doi:10.1097/01.chi.0000132808.36708.a9

23.

Expat Focus. (2018). Malaysia—Speaking the language. Retrieved from http://www.expatfocus.com/expatriate-malaysia-language

24.

Ezpeleta

Granero

de la Osa

Penelo

Domènech

J. M.

(2013). Psychometric properties of the Strengths and Difficulties Questionnaire 3-4 in 3-year-old preschoolers. Comprehensive Psychiatry, 54, 282-291. doi:10.1016/j.comppsych.2012.07.009

25.

Gomez

Stavropoulos

(2019). Parent ratings of the Strengths and Difficulties Questionnaire: What is the optimum factor model? Assessment, 26, 1142-1153. doi:10.1177/1073191117721743

26.

Gomez

Suhaimi

A. F.

(2013). Incidence rates of emotional and behavioural problems in Malaysian children as measured by parent ratings of the Strengths and Difficulties Questionnaire. Asian Journal of Psychiatry, 6, 528-531. doi:10.1016/j.ajp.2013.06.009

27.

Gomez

Suhaimi

A. F.

(2014). Malaysian parent ratings of the short version of the Parent Parental Acceptance-Rejection Questionnaire: Factor structure and invariance across sex, and mother and father. Parenting: Science and Practice, 14, 195-214.

28.

Goodman

Patel

Leon

D. A.

(2010). Why do British Indian children have an apparent mental health advantage? Journal of Child Psychology and Psychiatry, 51, 1171-1183. doi:10.1111/j.1469-7610.2010.02260.x

29.

Goodman

(1997). The Strengths and Difficulties Questionnaire: A research note. Journal of Child Psychology and Psychiatry, 38, 581-586. doi:10.1111/j.1469-7610.1997.tb01545.x

30.

Goodman

(2001). Psychometric properties of the strengths and difficulties questionnaire. Journal of the American Academy of Child & Adolescent Psychiatry, 40, 1337-1345. doi:10.1097/00004583-200111000-00015

31.

Goodman

Meltzer

Bailey

(1998). The Strengths and Difficulties Questionnaire: A pilot study on the validity of the self-report version. European Child & Adolescent Psychiatry, 7, 125-130. doi:10.1007/s007870050057

32.

Goodman

Meltzer

Bailey

(2003). The Strengths and Difficulties Questionnaire: A pilot study on the validity of the self-report version. International Review of Psychiatry, 15, 173-177. doi:10.1080/0954026021000046137

33.

Hawes

D. J.

Dadds

M. R.

(2004). Australian data and psychometric properties of the Strengths and Difficulties Questionnaire. Australian and New Zealand Journal of Psychiatry, 38, 644-651. doi:10.1111/j.1440-1614.2004.01427.x

34.

Hollenstein

Granic

Stoolmiller

Snyder

(2004). Rigidity in parent-child interactions and the development of externalizing and internalizing behavior in early childhood. Journal of Abnormal Child Psychology, 32, 595-607.

35.

Hossain

(2014). Parental beliefs and fathers’ and mothers’ roles in Malaysian families. In Selin

(Ed.), Parenting across cultures: Childrearing, motherhood and fatherhood in non-western cultures (pp. 77-90). Dordrecht, Netherlands: Springer.

36.

L. T.

Bentler

P. M.

(1998). Fit indices in covariance structure modeling: Sensitivity to underparameterized model misspecification. Psychological Methods, 3, 424-453. doi:10.1037/1082-989X.3.4.424

37.

Kadir

Ba’yah

Mustapha

Mutalib

Hanida

Yakub

N. A.

(2015). Using the Strengths and Difficulties Questionnaire (SDQ) to Predict Emotional and Behavioral Difficulties on Positive and Negative Affect Among Adolescents in Disadvantaged Communities. Asian Social Work and Policy Review, 9, 125-137. doi:10.1111/aswp.12052

38.

Kersten

Czuba

McPherson

Dudley

Elder

Tauroa

Vandal

(2016). A systematic review of evidence for the psychometric properties of the Strengths and Difficulties Questionnaire. International Journal of Behavioral Development, 40, 64-75.

39.

Little

T. D.

(1997). Mean and covariance structures (MACS) analyses of cross-cultural data: Practical and theoretical issues. Multivariate Behavioral Research, 32, 53-76.

40.

Lubke

G. H.

Muthén

B. O.

(2004). Applying multigroup confirmatory factor models for continuous outcomes to Likert scale data complicates meaningful group comparisons. Structural Equation Modeling, 11, 514-534. doi:10.1207/s15328007sem1104_2

41.

Meltzer

Gatward

Goodman

Ford

(2000). The mental health of children and adolescents in Great Britain. London, England: HM Stationery Office, Office for National Statistics.

42.

Meredith

(1993). Measurement invariance, factor-analysis and factorial invariance. Psychometrika, 58, 525-543. doi:10.1007/Bf02294825

43.

Mieloo

C. L.

Bevaart

Donker

M. C.

van Oort

F. V.

Raat

Jansen

(2014). Validation of the SDQ in a multi-ethnic population of young children. European Journal of Public Health, 24, 26-32. doi:10.1093/eurpub/ckt100

44.

Milfont

T. L.

Fischer

(2010). Testing invariance across groups: Applications in cross-cultural research. International Journal of Psychological Research, 3, 111-130.

45.

Millsap

R. E.

Yun-Tein

(2004). Assessing factorial invariance in ordered-categorical measures. Multivariate Behavioral Research, 39, 479-515. doi:10.1207/S15327906MBR3903_4

46.

Muthén

L. K.

Muthén

B. O.

(2010). Mplus user’s guide (6th ed.). Los Angeles, CA: Muthén & Muthén.

47.

Muthén

L. K.

Muthén

B. O.

(2013). Users Guide Mplus 7.11. Los Angeles, CA: Muthén & Muthén.

48.

Niclasen

Teasdale

T. W.

Andersen

A. M. N.

Skovgaard

A. M.

Elberling

Obel

(2012). Psychometric properties of the Danish Strength and Difficulties Questionnaire: The SDQ assessed for more than 70,000 raters in four different cohorts. PLoS One, 7, e32025. doi:10.1371/journal.pone.0032025

49.

Nixon

(2012). Growing up in Ireland—How families matter for social and emotional outcomes of 9-year-old children. Dublin, Republic of Ireland: Department of Children and Youth Affairs. Retrieved from https://www.esri.ie/pubs/BKMNEXT316.pdf

50.

Nunnally

J. C.

(1978). Psychometric theory (2nd ed.). New York, NY: McGraw-Hill.

51.

Nye

C. D.

Drasgow

(2011). Assessing goodness of fit: Simple rules of thumb simply do not work. Organizational Research Methods, 14, 548-570. doi:10.1177/1094428110368562

52.

Ortuño-Sierra

Chocarro

Fonseca-Pedrero

i Riba

S. S.

Muñiz

(2015). The assessment of emotional and behavioural problems: Internal structure of the Strengths and Difficulties Questionnaire. International Journal of Clinical and Health Psychology, 15, 265-273. doi:1016/j.ijchp.2015.05.005

53.

Othman

Blunden

Mohamad

Mohd Hussin

Z. A.

Jamil Osman

(2010). Piloting a psycho-education program for parents of pediatric cancer patients in Malaysia. Psycho-Oncology, 19, 326-331. doi:10.1002/pon.1584

54.

Palmieri

P. A.

Smith

G. C.

(2007). Examining the structural validity of the Strengths and Difficulties Questionnaire (SDQ) in a US sample of custodial grandmothers. Psychological Assessment, 19, 189-198. doi:10.1037/1040-3590

55.

Quah

S. R.

(2004). Ethnicity and parenting styles among Singapore families. Marriage & Family Review, 35, 63-83.

56.

Reise

S. P.

Widaman

K. F.

Pugh

R. H.

(1993). Confirmatory factor analysis and item response theory: Two approaches for exploring measurement invariance. Psychological Bulletin, 114, 552-566. doi:10.1037/0033-2909

57.

Rhemtulla

Brosseau-Liard

P. É.

Savalei

(2012). When can categorical variables be treated as continuous? A comparison of robust continuous and categorical SEM estimation methods under suboptimal conditions. Psychological Methods, 17, 354-373. doi:10.1037/a0029315

58.

Rohner

R. P.

(2005). Parental Acceptance–Rejection Questionnaire (PARQ): Test manual. In Rohner

R. P.

Khaleque

(Eds.), Handbook for the study of parental acceptance and rejection (4th ed., pp. 43-106). Storrs, CT: Rohner Research.

59.

Stokes

Mellor

Yeow

Hapidzal

N. F.

(2014). Do parents, teachers and children use the SDQ in a similar fashion? Quality & Quantity, 48, 983-1000. doi:10.1007/s11135-012-9819-8

60.

Stone

L. L.

Otten

Engels

R. C.

Vermulst

A. A.

Janssens

J. M.

(2010). Psychometric properties of the parent and teacher versions of the strengths and difficulties questionnaire for 4-to 12-year-olds: A review. Clinical Child and Family Psychology Review, 13, 254-274. doi:10.1007/s10567-010-0071-2

61.

Stone

L. L.

Otten

Ringlever

Hiemstra

Engels

R. C.

Vermulst

A. A.

Janssens

J. M.

(2013). The parent version of the strengths and difficulties questionnaire. European Journal of Psychological Assessment. doi:10.1027/1015-5759/a000119

62.

Stormshak

E. A.

Bierman

McMahon

R. J.

Lengua

L. J.

(2000). Parenting practices and child disruptive behavior problems in early elementary school. Journal of Clinical Child Psychology, 29, 17-29.

63.

Tabachnick

B. G.

Fidell

L. S.

(2007). Using multivariate statistics. Boston, MA: Allyn & Bacon.

64.

W. M.

(1998). Humanity and self-cultivation: Essays in Confucian thought. Boston, MA: Cheng & Tsui.

65.

W. M.

(2003). Multiple modernities: A preliminary inquiry into the implications of East Asian modernity. In Harrison

L. E.

Huntington

S. P.

(Eds.), Culture matters: How value shape human process (pp. 256-267). New York, NY: Basic Books.

66.

Van Leeuwen

K. V.

Meerschaert

Bosmans

De Medts

Braet

. (2006). The strengths and difficulties questionnaire in a community sample of young children in flanders. European Journal of Psychological Assessment, 22, 189-197. doi:10.1027/1015-5759.22.3

67.

Vandenberg

R. J.

Lance

C. E.

(2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3, 4-70. doi:10.1177/109442810031002

68.

Yakub

N. A.

Kadir

N. B. Y. A.

Malekian

K. A.

Mansor

S. M. S. S

. (2016). Examining the predictors of depressive symptoms among adolescents at federal territory of Putrajaya, Malaysia. Science International (Lahore), 28, 1897-1902.

69.

Yap

S. T.

Baharudin

Yaacob

Osman

(2014). Paternal and maternal involvement in Malaysian adolescents: Test of factor structure, measurement invariance and latent mean differences. Child Indicators Research, 7, 193-208.

70.

Zinbarg

R. E.

Revelle

Yovel

(2005). Cronbach’s α, Revelle’s β, and McDonald’s ωH: Their relations with each other and two alternative conceptualizations of reliability. Psychometrika, 70, 123-133. doi:10.1007/s11336-003-0974-7

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.27 MB