Restricted accessResearch articleFirst published online 2013-12
The Incremental Utility of Behavioral Rating Scales and a Structured Diagnostic Interview in the Assessment of Attention-Deficit/Hyperactivity Disorder
The current study examined the incremental utility of rating scales, a structured diagnostic interview, and multiple informants in a comprehensive assessment of attention-deficit/hyperactivity disorder (ADHD). The sample included 185 children with ADHD (Mage = 9.22, SD = 0.95) and 82 children without ADHD (Mage = 9.24, SD = 0.88). Logistic regressions were used to examine the incremental contribution of each method within an assessment of ADHD. Results indicated that information collected from a structured diagnostic interview was unable to significantly improve a prediction model including parent and teacher ratings (Block χ2 = 0.91, ρ = .64). Teacher ratings on symptom-based scales resulted in significant model improvement beyond parent ratings alone (Block χ2 = 48.47, ρ < .001). Exploratory analyses indicated that using behavioral rating scales correctly classified all participants by diagnosis. Clinical implications are highlighted, and future research directions are discussed.
AchenbachT. M.RescorlaL. A. (2001). Manual for the ASEBA school-age forms and profiles. Burlington, VT: University of Vermont, Research Center for Children, Youth, & Families.
2.
AlbertA.AndersonJ. A. (1984). On the existence of maximum likelihood estimates in logistic regression models. Biometrika, 71, 1–10.
3.
American Academy of Pediatrics. (2000). Clinical practice guideline: Diagnosis and evaluation of the child with attention deficit/hyperactivity disorder. Pediatrics, 105, 1158–1170.
4.
American Psychiatric Association. (1987). Diagnostic and statistical manual of mental disorders (3rd ed., Rev.). Washington, DC: Author.
5.
American Psychiatric Association. (1994). Diagnostic and statistical manual of mental disorders (4th ed.). Washington, DC: Author.
6.
American Psychiatric Association. (2000). Diagnostic and statistical manual of mental disorders (4th ed., text rev.). Washington, DC: Author.
7.
ChenW. J.FaraoneS. V.BiedermanJ.TsuangM. T. (1994). Diagnostic accuracy of the Child Behavior Checklist Scales for attention-deficit hyperactivity disorder: A receiver-operating characteristic analysis. Journal of Consulting and Clinical Psychology, 62, 1017–1025.
8.
CohenP.O’ConnerP.LewisS.VelezC. N.MalachowskiB. (1987). Comparison of the DISC and K-SADS-P interviews of an epidemiological sample of children. Journal of the American Academy of Child & Adolescent Psychiatry, 26, 662–667.
9.
CollettB. R.OhanJ. L.MyersK. M. (2003). Ten-year review of rating scales. V: Scales assessing attention-deficit/hyperactivity disorder. Journal of the American Academy of Child & Adolescent Psychiatry, 42, 1015–1037.
10.
DuPaulG. J.PowerT. J.McGoeyK. E.IkedaM. J.AnastopoulosA. D. (1998). Reliability and validity of parent and teacher ratings of attention-deficit/hyperactivity disorder symptoms. Journal of Psychoeducational Assessment, 16, 55–68.
11.
HartmanR. R.StageS. A.Webster-StrattonC. (2003). A growth curve analysis of parent training outcomes: Examining the influence of child risk factors (inattention, impulsivity, and hyperactivity problems), parental, and family risk factors. Journal of Child Psychology and Psychiatry, 44, 388–398.
12.
HeinzG.SchemperM. (2002). A solution to the problem of separation in logistic regression. Statistics in Medicine, 30, 2409–2419.
13.
HodgesK. (1993). Structured interviews for assessing children. Journal of Child Psychology and Psychiatry, 34, 49–68.
14.
HosmerD.LemeshowS. (2000). Applied logistic regression (2nd ed.). New York, NY: Wiley.
15.
JensenP. S.EdelbrockC. (1999). Subject and interview characteristics affecting reliability of the Diagnostic Interview Schedule for Children-IV. Journal of Abnormal Child Psychology, 27, 413–415.
16.
JensenP. S.WantanabeJ.RichtersJ.RoperN.HibbsE.SalzbergA.LiuS. (1996). Scales, diagnoses, and child psychopathology: II. Comparing the CBCL and the DISC against external validators. Journal of Abnormal Child Psychology, 24, 151–168.
17.
JohnstonC.MurrayC. (2003). Incremental validity in the psychological assessment of children and adolescents. Psychological Assessment, 15, 496–507.
18.
LoeberR.GreenS. M.LaheyB. B.Stouthamer-LoeberM. (1991). Differences and similarities between children, mothers, and teacher as informants on disruptive child behavior. Journal of Abnormal Child Psychology, 19, 75-95.
19.
MassettiG. M.PelhamW. E.ChackoA.WalkerK. S.ArnoldF. W.ColesE. K. . . . Burrows-MacLeanL. (2003, November). Situational variability of ADHD, ODD, and CD: Psychometric properties of the DBD Interview and Rating Scale. Poster presented at the Association for Advancement of Behavior Therapy Conference, Boston, MA.
20.
McClellanJ. M.WerryJ. S. (2000). Introduction: Research psychiatric diagnostic interviews for children and adolescents. Journal of the American Academy of Child & Adolescent Psychiatry, 39, 19–27.
21.
McConaughyS.AchenbachT. (2004). Manual for the ASEBA test observation form. Burlington, VT: University of Vermont, Research Center for Children, Youth, & Families.
22.
MilichR.BalentineA. C.LynamD. R. (2001). ADHD combined type and ADHD predominantly inattentive type are distinct and unrelated disorders. Clinical Psychology: Science and Practice, 8, 463–488.
23.
MillerG. A.ChapmanJ. P. (2001). Misunderstanding analysis of covariance. Journal of Abnormal Psychology, 110, 40–48.
24.
MTA Cooperative Group. (1999). 14-month randomized clinical trial of treatment strategies for children with attention-deficit/hyperactivity disorder. Archives of General Psychiatry, 56, 1073–1086.
25.
OstranderR.WeinfurtK. P.YarnoldP. R.AugustG. J. (1998). Diagnosing attention deficit disorders with the Behavioral Assessment System for Children and the Child Behavior Checklist: Test and construct validity analyses using optimal discriminant classification trees. Journal of Consulting and Clinical Psychology, 66, 660–672.
26.
PelhamW. E.FabianoG. A.MassettiG. M. (2005). Evidence-based assessment of attention deficit hyperactivity disorder in children and adolescents. Journal of Clinical Child and Adolescent Psychology, 34, 449–476.
27.
PelhamW. E.GnagyE. M.GreensladeK. E.MilichR. (1992). Teacher ratings of DSM-III-R symptoms for the disruptive behavior disorders. Journal of the American Academy of Child & Adolescent Psychiatry, 31, 210–218.
28.
PiacentiniJ.RoperM.JensenP.LucasC.FisherP.BirdH. . . . DulcanM. (1999). Informant-based determinants of symptom attenuation in structured child psychiatric interviews. Journal of Abnormal Child Psychology, 27, 417–428.
29.
PiacentiniJ.ShaggerD.FisherP.Schwab-StoneM.DaviesM.GioiaP. (1993). The Diagnostic Interview Schedule for Children–Revised Version (DISC-R): III. Concurrent criterion validity. Journal of the American Academy of Child & Adolescent Psychiatry, 32, 658–665.
30.
PowerT. J.AndrewsT. J.EiraldiR. B.DohertyB. J.IkedaM. J.DuPaulG. J.LandauS. (1998). Evaluating attention deficit hyperactivity disorder using multiple informants: The incremental utility of combining teacher with parent reports. Psychological Assessment, 10, 250–260.
31.
PowerT. J.CostiganT. E.LeffS. S.EiraldiR. B.LandauS. (2001). Assessing ADHD across settings: Contributions of behavioral assessment to categorical decision making. Journal of Clinical Child Psychology, 30, 399–412.
32.
PowerT. J.DohertyB. J.Panichelli-MindelS. M.KarustisJ. L.EiraldiR. B.AnastopoulosA. D.DuPaulG. J. (1998). The predictive validity of parent and teacher reports of ADHD symptoms. Journal of Psychopathology and Behavioral Assessment, 20, 57–81.
33.
ReidR.MaagJ. W. (1994). How many fidgets in a pretty much: A critique of behavior rating scales for identifying students with ADHD. Journal of School Psychology, 32, 339–354.
34.
RobertsR. E.SolovitzB. L.ChenY.CasatC. (1996). Retest stability of DSM-III-R diagnoses among adolescents using the Diagnostic Interview Schedule for Children-IV (DISC-2.1C). Journal of Abnormal Child Psychology, 24, 349–362.
35.
RowlandA. S.UmbachD. M.CatoeK. E.StalloneL.LongS.RabinerD. . . . SandlerD. P. (2001). Studying the epidemiology of attention-deficit hyperactivity disorder. Canadian Journal of Psychiatry, 46, 931–940.
36.
SayalK.LetchN.AbdS. E. (2008). Evaluation of screening in children referred for an ADHD assessment. Child and Adolescent Mental Health, 13, 41–46.
37.
SchafferD.FisherP.LucasC.DulcanM.Schwab-StoneM. (2000). NIMH Diagnostic Interview Schedule for Children-IV version IV (NIMH DISC-IV): description, differences from previous versions, and reliability of some common diagnoses. Journal of the American Academy of Child & Adolescent Psychiatry39, 28-38.
38.
ShafferD.FisherP.LucasC.DulcanM.Schwab-StoneM. (2000). NIMH Diagnostic Interview Schedule for Children, version IV (NIMH DISC-IV): Description, differences from previous versions, and reliability of some common diagnoses. Journal of the American Academy of Child & Adolescent Psychiatry, 39, 28–38.
39.
SimonsenB. M.BullisM. D. (2007). The effectiveness of using a multiple gating procedure to discriminate among ADHD subtypes. Journal of Emotional and Behavioral Disorders, 15, 223–236.
40.
TrippE. A.ClarkeB. (2006). Parent and teacher rating scales in the evaluation of attention-deficit hyperactivity disorder: Contribution to diagnosis and differential diagnosis in clinically referred children. Journal of Developmental & Behavioral Pediatrics, 27, 209–228.
41.
WenderE. (2004). ADHD symptoms and parent-teacher agreement. Journal of Developmental & Behavioral Pediatrics, 25, 48–49.
42.
WolraichM. L.LambertE. W.BickmanL.SimmonsT.DoffingM. A.WorleyK. A. (2004). Assessing the impact of parent and teacher agreement on diagnosing attention-deficit hyperactivity disorder. Journal of Developmental & Behavioral Pediatrics, 25, 41–47.
43.
WoodcockR. W.McGrewK. S.MatherN. (2001). Woodcock-Johnson III Tests of Cognitive Abilities. Itasca, IL: Riverside.
44.
WrightK. D.WaschbuschD. A.FranklandB. W. (2007). Combining data from parent ratings and parent interview when assessing ADHD. Journal of Psychopathology and Behavioral Assessment, 29, 141–148.
