The present study aimed to investigate the measurement invariance across age, gender, clinical status, and informant of the Attention-Deficit/Hyperactivity Disorder Rating Scale–IV (ADHD-RS-IV) Home and School versions. The participants were 1,106 Romanian children and adolescents (mean age = 12.74 years, standard deviation = 2.84, age range 6-18 years). Both parents and teachers assessed ADHD symptoms. The factorial structure of the scale was assessed using confirmatory factor analysis, and measurement invariance was assessed using multigroup confirmatory factor analysis. The results supported the reliability of the ADHD-RS-IV, with high internal consistency coefficients for both versions. Confirmatory factor analysis validated a two-factor model. Multigroup confirmatory factor analysis confirmed the measurement invariance of ADHD-RS-IV across age, gender, clinical status, and informant. ADHD-RS-IV had good psychometric properties in a sample of Romanian children and adolescents. It is a reliable instrument given its strong invariance. Implications for evidence-based assessment of ADHD are discussed.
American Psychiatric Association. (2000). DSM-IV-TR: Diagnostic and statistical manual of mental disorders, text revision (4th ed.). Washington, DC: Author.
2.
American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Arlington, VA: Author.
3.
BarkleyR. A. (1997). ADHD and the nature of self-control. New York, NY: Guilford Press
4.
BarkleyR. A. (2014). Attention-deficit hyperactivity disorder: A handbook for diagnosis and treatment. New York, NY: Guilford Press.
5.
BauermeisterJ. J.BirdH. R.CaninoG.Rubio-StipecM.BravoM.AlegríaM. (1995). Dimensions of attention deficit hyperactivity disorder: Findings from teacher and parent reports in a community sample. Journal of Clinical Child Psychology, 24, 264-271. doi:10.1207/s15374424jccp2403_3
6.
BeauducelA.HerzbergP. Y. (2006). On the performance of maximum likelihood versus means and variance adjusted weighted least squares estimation in CFA. Structural Equation Modeling: A Multidisciplinary Journal, 13, 186-203. doi:10.1207/s15328007sem1302_2
7.
BentlerP. M. (1990). Comparative fit indexes in structural models. Psychological Bulletin, 107, 238-246. doi:10.1037/0033-2909.107.2.238
8.
BentlerP. M.BonettD. G. (1980). Significance tests and goodness of fit in the analysis of covariance structures. Psychological Bulletin, 88, 588-606. doi:10.1037//0033-2909.88.3.588
9.
BowenN. K.MasaR. D. (2015). Conducting measurement invariance tests with ordinal data: A guide for social work researchers. Journal of the Society for Social Work and Research, 6, 229-249. doi:100.1086/681607
10.
BrowneM. W.CudeckR. (1993). Alternative ways of assessing model fit. In BollenK. A.LongJ. S. (Eds.), Testing structural equation models (pp. 136-162). Newbury Park, CA: Sage.
11.
ChenF. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal, 14, 464-504. doi:10.1080/10705510701301834
12.
CheungG. W.RensvoldR. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal, 9, 233-255. doi:10.1207/S15328007SEM0902_5
13.
DavidovE.DülmerH.SchlüterE.SchmidtP.MeulemanB. (2012). Using a multilevel structural equation modeling approach to explain cross-cultural measurement noninvariance. Journal of Cross-Cultural Psychology, 43, 558-575. doi:10.1177/0022022112438397
14.
DeweyD.CrawfordS. G.CreightonD. E.SauveR. S. (2000). Parents’ ratings of everyday cognitive abilities in very low birth weight children. Journal of Developmental & Behavioral Pediatrics, 21, 37-43.
15.
DimitrovD. M. (2010). Testing for factorial invariance in the context of construct validation. Measurement and Evaluation in Counseling and Development, 43, 121-149. doi:10.1177/0748175610373459
16.
DöpfnerM.SteinhausenH.-C.CoghillD.DalsgaardS.PooleL.RalstonS. J., & ADORE Study Group. (2006). Cross-cultural reliability and validity of ADHD assessed by the ADHD rating scale in a pan-European study. European Child & Adolescent Psychiatry, 15, i46-i55. doi:10.1007/s00787-006-1007-8
17.
DunnT. J.BaguleyT.BrunsdenV. (2014). From alpha to omega: A practical solution to the pervasive problem of internal consistency estimation. British Journal of Psychology, 105, 399-412. doi:10.1111/bjop.12046
18.
DuPaulG. J.AnastopoulosA. D.PowerT. J.ReidR.IkedaM.McGoeyK. (1998). Parent ratings of attention-deficit/hyperactivity disorder symptoms: Factor structure and normative data. Journal of Psychopathology and Behavioral Assessment, 20, 83-102.
19.
DuPaulG. J.PowerT. J.AnastopoulosA. D.ReidR. (1998). ADHD Rating Scale–IV: Checklists, norms, and clinical interpretation. New York, NY: Guilford Press.
20.
DuPaulG. J.PowerT. J.AnastopoulosA. D.ReidR.McGoeyK.IkedaM. (1997). Teacher ratings of attention-deficit/hyperactivity disorder: Factor structure and normative data. Psychological Assessment, 9, 436-444.
21.
DuPaulG. J.ReidR.AnastopoulosA. D.LambertM. C.WatkinsM. W.PowerT. J. (2016). Parent and teacher ratings of attention-deficit/hyperactivity disorder symptoms: Factor structure and normative data. Psychological Assessment, 28, 214-225. doi:10.1037/pas0000166
22.
DuPaulG. J.StonerG. (2014). ADHD in the schools: Assessment and intervention strategies. New York, NY: Guilford Press.
23.
GeisingerK. F. (1994). Cross-cultural normative assessment: Translation and adaptation issues influencing the normative interpretation of assessment instruments. Psychological Assessment, 6, 304-312.
24.
GlascoeF. P. (2000). Evidence-based approach to developmental and behavioural surveillance using parents’ concerns. Child: Care, Health and Development, 26, 137-149. doi:10.1046/j.1365-2214.2000.00173.x
25.
Gupte-SinghK.SinghR. R.LawsonK. A. (2017). Economic burden of attention-deficit/hyperactivity disorder among pediatric patients in the United States. Value in Health, 20, 602-609. doi:10.1016/j.jval.2017.01.007
26.
HambletonR. K. (1994). Guidelines for adapting educational and psychological tests: A progress report. European Journal of Psychological Assessment, 10, 229-244.
27.
HambletonR. K.PatsulaL. (1998). Adapting tests for use in multiple languages and cultures. Social Indicators Research, 45, 153-171. doi:10.1023/A:1006941729637
28.
HershbergerS. L. (1994). The specification of equivalent models before the collection of data. In von EyeA.CloggC. C. (Eds.), Latent variables analysis (pp. 68-105). Thousand Oaks, CA: Sage.
29.
HinshawS. P. (1994). Attention deficits and hyperactivity in children. Thousand Oaks, CA: Sage.
30.
HoelterJ. W. (1983). The analysis of covariance structures: Goodness-of-fit indices. Sociological Methods and Research, 11, 325-344.
31.
HuL.BentlerP. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6, 1-55. doi:10.1080/10705519909540118
32.
IvanovaM. Y.AchenbachT. M.RescorlaL. A.DumenciL.AlmqvistF.BathicheM.. . . VerhulstF. C. (2007). Testing the Teacher’s Report Form syndromes in 20 societies. School Psychology Review, 36, 468-483.
33.
KaplanD.GeorgeR. (1995). A study of the power associated with testing factor mean differences under violations of factorial invariance. Structural Equation Modeling: A Multidisciplinary Journal, 2, 101-118. doi:10.1080/10705519509539999
34.
KlineR. B. (2005). Principles and practice of structural equation modeling (2nd ed.). New York, NY: Guilford Press.
35.
LaheyB. B.ApplegateB.McBurnettK.BiedermanJ.GreenhillL.HyndG. W.. . . RichtersJ. (1994). DSM-IV field trials for attention deficit hyperactivity disorder in children and adolescents. American Journal of Psychiatry, 151, 1673-1685. doi:10.1176/ajp.151.11.1673
36.
LaheyB. B.CarlsonC. L. (1991). Validity of the diagnostic category of attention deficit disorder without hyperactivity: A review of the literature. Journal of Learning Disabilities, 24, 110-120. doi:10.1177/002221949102400208
37.
LiJ. J.ReiseS. P.Chronis-TuscanoA.MikamiA. Y.LeeS. S. (2016). Item response theory analysis of ADHD symptoms in children with and without ADHD. Assessment, 23, 655-671. doi:10.1177/1073191115591595
38.
LittleT. D. (1997). Mean and covariance structures (MACS) analyses of cross-cultural data: Practical and theoretical issues. Multivariate Behavioral Research, 32, 53-76. https://doi.org/10.1207/s15327906mbr3201_3
39.
LubkeG. H.MuthénB. (2005). Investigating population heterogeneity with factor mixture models. Psychological Methods, 10, 21-39. doi:10.1037/1082-989X.10.1.21
40.
MagnússonP.SmáriJ.GrétarsdóttirH.PrándardóttirH. (1999). Attention-deficit/hyperactivity symptoms in Icelandic schoolchildren: Assessment with the Attention Deficit/Hyperactivity Rating Scale–IV. Scandinavian Journal of Psychology, 40, 301-306. doi:10.1111/1467-9450.404130
41.
MakranskyG.BilenbergN. (2014). Psychometric properties of the parent and teacher ADHD rating scale (ADHD-RS): Measurement invariance across gender, age, and informant. Assessment, 21, 694-705. doi:10.1177/1073191114535242
42.
MarsellaA. J.KameokaV. A. (1989). Ethnocultural issues in the assessment of psychopathology. In WetzlerS. (Ed.), Measuring mental illness: Psychometric assessment for clinicians (pp. 231-256; The Clinical Practice Series, No. 8). Arlington, VA: American Psychiatric Association.
43.
MarshH. W.HauK.-T.WenZ. (2004). In search of golden rules: Comment on hypothesis-testing approaches to setting cutoff values for fit indexes and dangers in overgeneralizing Hu and Bentler’s (1999) findings. Structural Equation Modeling: A Multidisciplinary Journal, 11, 320-341. doi:10.1207/s15328007sem1103_2
44.
MartelM. M.Von EyeA.NiggJ. T. (2010). Revisiting the latent structure of ADHD: Is there a “g” factor?Journal of Child Psychology and Psychiatry, 51, 905-914. doi:10.1111/j.1469-7610.2010.02232.x
45.
MashE. J.TerdalL. G. (1997). Assessment of child and family disturbance: A behavioral-systems approach. In MashE. J.TerdalL. G. (Eds.), Assessment of childhood disorders (3rd ed., pp. 3-68). New York, NY: Guilford Press.
MillerL. S.KoplewiczH. S.KleinR. G. (1997). Teacher ratings of hyperactivity, inattention, and conduct problems in preschoolers. Journal of Abnormal Child Psychology, 25, 113-119. doi:10.1023/A:1025727428097
48.
MulhernS.DworkinP. H.BernsteinB. (1994). Do parental concerns predict a diagnosis of attention-deficit hyperactivity disorder?Journal of Developmental & Behavioral Pediatrics, 15, 348-352.
MuthénL. K.MuthénB. O. (1998–2015). Mplus user’s guide (7th ed.). Los Angeles, CA: Muthén & Muthén.
51.
PelhamW. E.FabianoG. A.MassettiG. M. (2005). Evidence-based assessment of attention deficit hyperactivity disorder in children and adolescents. Journal of Clinical Child and Adolescent Psychology, 34, 449-476. doi:10.1207/s15374424jccp3403_5
52.
PolanczykG.de LimaM. S.HortaB. L.BiedermanJ.RohdeL. A. (2007). The worldwide prevalence of ADHD: A systematic review and metaregression analysis. American Journal of Psychiatry, 164, 942-948. doi:10.1176/ajp.2007.164.6.942
53.
PolanczykG. V.SalumG. A.SugayaL. S.CayeA.RohdeL. A. (2015). Annual research review: A meta-analysis of the worldwide prevalence of mental disorders in children and adolescents. Journal of Child Psychology and Psychiatry, 56, 345-365. doi:10.1111/jcpp.12381
54.
PowerT. J. (1992). Contextual factors in vigilance testing of children with ADHD. Journal of Abnormal Child Psychology, 20, 579-593. doi:10.1007/BF00911242
55.
ReidR. (1995). Assessment of ADHD with culturally different groups: The use of behavioral rating scales. School Psychology Review, 24, 537-560.
56.
RhemtullaM.Brosseau-LiardP.SavaleiV. (2012). When can categorical variables be treated as continuous? A comparison of robust continuous and categorical SEM estimation methods under suboptimal conditions. Psychological Methods, 17, 354-373. doi:10.1037/a0029315
57.
SatorraA.BentlerP. M. (2001). A scaled difference chi-square test statistic for moment structure analysis. Psychometrika, 66, 507-514. doi:10.1007/BF02296192
58.
SextonC. C.GelhornH. L.BellJ. A.ClassiP. M. (2012). The co-occurrence of reading disorder and ADHD: Epidemiology, treatment, psychosocial impact, and economic burden. Journal of Learning Disabilities, 45, 538-564. doi:10.1177/0022219411407772
59.
SteigerJ. H. (1990). Structural model evaluation and modification: An interval estimation approach. Multivariate Behavioral Research, 25, 173-180. doi:10.1207/s15327906mbr2502_4
60.
StevanovicD.JafariP.KnezR.FranicT.AtilolaO.DavidovicN.. . . LakicA. (2017). Can we really use available scales for child and adolescent psychopathology across cultures? A systematic review of cross-cultural measurement invariance data. Transcultural Psychiatry, 54, 125-152. doi:10.1177/1363461516689215
61.
SturmA.McCrackenJ. T.CaiL. (2017). Evaluating the hierarchical structure of ADHD symptoms and invariance across age and gender. Assessment, 26, 508-523. doi:10.1177/1073191117714559
62.
SuY.WangH.GengY.-G.SunL.DuY.-S.FanF.SuL.-Y. (2015). Parent ratings of ADHD symptoms in Chinese urban schoolchildren: Assessment with the Chinese ADHD Rating Scale–IV: Home version. Journal of Attention Disorders, 19, 1022-1033. doi:10.1177/1087054712461177
63.
SzomlaiskiN.DyrborgJ.RasmussenH.SchumannT.KochS.BilenbergN. (2009). Validity and clinical feasibility of the ADHD Rating Scale (ADHD-RS): A Danish nationwide multicenter study. Acta Pædiatrica, 98, 397-402. doi:10.1111/j.1651-2227.2008.01025.x
64.
TakayanagiN.YoshidaS.YasudaS.AdachiM.Kaneda-OsatoA.TanakaM.. . . NakamuraK. (2016). Psychometric properties of the Japanese ADHD-RS in preschool children. Research in Developmental Disabilities, 55, 268-278. doi:10.1016/j.ridd.2016.05.002
65.
TaniI.OkadaR.OhnishiM.NakajimaS.TsujiiM. (2010). Japanese version of home form of the ADHD-RS: An evaluation of its reliability and validity. Research in Developmental Disabilities, 31, 1426-1433. doi:10.1016/j.ridd.2010.06.016
66.
ThomasR.SandersS.DoustJ.BellerE.GlasziouP. (2015). Prevalence of attention-deficit/hyperactivity disorder: A systematic review and meta-analysis. Pediatrics, 135, e994-e1001. doi:10.1542/peds.2014-3482
67.
ValoS.TannockR. (2010). Diagnostic instability of DSM-IV ADHD subtypes: Effects of informant source, instrumentation, and methods for combining symptom reports. Journal of Clinical Child and Adolescent Psychology, 39, 749-760. doi:10.1080/15374416.2010.517172
68.
VandenbergR. J.LanceC. E. (2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3, 4-70. doi:10.1177/109442810031002
69.
Weziak-BialowolskaD. (2015). Differences in gender norms between countries: Are they valid? The issue of measurement invariance. European Journal of Population, 31, 51-76. doi:10.1007/s10680-014-9329-6
70.
WillcuttE. G. (2012). The prevalence of DSM-IV attention-deficit/hyperactivity disorder: A meta-analytic review. Neurother-apeutics, 9, 490-499. doi:10.1007/s13311-012-0135-8
71.
World Health Organization. (1992). International statistical classification of diseases and related health problems, 10th revision (ICD-10). Geneva, Switzerland: Author.
72.
YoonM.LaiM. H. C. (2018). Testing factorial invariance with unbalanced samples. Structural Equation Modeling: A Multidisciplinary Journal, 25, 201-213. doi:10.1080/10705511.2017.1387859
73.
YoungK. T.DavisK.SchoenC.ParkerS. (1998). Listening to parents: A national survey of parents with young children. Archives of Pediatrics & Adolescent Medicine, 152, 255-262. doi:10.1001/archpedi.152.3.255
74.
ZhangS.FariesD. E.VowlesM.MichelsonD. (2005). ADHD Rating Scale IV: Psychometric properties from a multinational study as clinician-administered instrument. International Journal of Methods in Psychiatric Research, 14, 186-201. doi:10.1002/mpr.7
