Over the last 15 years, adequate psychometric properties of the different versions of the Dominic led to the development of the Dominic Interactive for Adolescents (DIA). The DIA is a Diagnostic and Statistical Manual of Mental Disorders (DSM), Fourth Edition, Text Revision-based self-administered computerized pictorial instrument for assessing the most frequent mental disorders in adolescents aged 12 to 15 years. Our study aims to verify the internal consistency, the test-retest estimate of reliability, and the criterion-related validity of this instrument.
Method:
The total sample included 607 adolescents living in the Montreal urban area recruited from the community (465 French-speaking) and the clinical population (142 French-speaking). Internal consistency was evaluated by Cronbach's alpha coefficients and test-retest estimate of reliability by the kappas and intraclass correlation coefficients (ICCs). Two criteria are indicative of criterion-related validity of the DIA: clinical judgment on the presence or absence of symptoms (scored independently by 3 judges) and the adolescents' referrals to outpatient psychiatric clinics.
Results:
For most symptom scales of the DIA, Cronbach's alpha coefficients varied from 0.69 to 0.89, test-retest kappas were 0.50 or greater, and ICCs ranged from 0.78 to 0.87. The criterion-related validity was demonstrated for symptoms, symptom scales, and the categories based on the symptom scale cut-off points.
Conclusion:
As no informant can be considered the criterion standard of psychopathology, the interview with adolescents regarding their own symptoms is necessary. Findings from our study reasonably support adequate psychometric properties of the DIA in adolescents aged 12 to 15 years.
References
1.
KingRA. Adolescence. In: MartinAVolkmarFR, editors. Lewis's child and adolescent psychiatry: A comprehensive textbook. 4th ed.Baltimore (MA): Williams & Wilkins; 2007. p 279–291.
2.
LewisML. Overview of development from infancy through adolescence. In: WienerJMDulcanMK, editors. Textbook of child and adolescent psychiatry. 3rd ed.Washington (DC): American Psychiatric Publishing; 2004. p 13–44.
3.
RutterM.Development and psychopathology. In: RutterMTaylorE, editors. Child and adolescent psychiatry. 4th ed.Oxford (GB): Blackwell Science Ltd; 2002. p 309–324.
4.
AngoldAErkanliASilbergJ. Depression scale scores in 8–17-year-olds: Effects of age and gender. J Child Psychol Psychiatry. 2002;43:1052–1063.
5.
BergeronLVallaJPBretonJJ. Correlates of mental disorders in the Quebec general population of 6 to 14-year olds. J Abnorm Child Psychol. 2000;28:47–62.
6.
BergeronLVallaJPSmollaN. Correlates of depressive disorders in the Quebec general population 6 to 14 years of age. J Abnorm Child Psychol. 2007;35:459–474.
7.
BergeronLVallaJPGauthierAK. L'épidémiologie des troubles anxieux chez les enfants et les adolescents. In: TurgeonLGendreauPL, editors. Les troubles anxieux chez l'enfant et l'adolescent. Marseille (FR): Collection “Troubles du développement psychologique et des apprentissages,” Solal; 2007. p 11–47.
8.
BretonJJBergeronLVallaJP. Quebec Child Mental Health Survey: Prevalence of DSM-III-R mental health disorders. J Child Psychol Psychiatry. 1999;40:375–384.
9.
CostelloEJMustilloSErkanliA. Prevalence and development of psychiatric disorders in childhood and adolescence. Arch Gen Psychiatry. 2003;60:837–844.
10.
CostelloEJEggerHAngoldA.10-year research update review: The epidemiology of child and adolescent psychiatric disorders: I. Methods and public health burden. J Am Acad Child Adolesc Psychiatry. 2005;44:972–986.
11.
CostelloEJFoleyDLAngoldA.10-year research update review: The epidemiology of child and adolescent psychiatric disorders. II. Developmental epidemiology. J Am Acad Child Adolesc Psychiatry. 2006;45:8–25.
12.
FombonneE.Épidémiologie des troubles psychiatriques en pédopsychiatrie. EMC-Psychiatrie. 2005;2:169–194.
13.
FordTGoodmanRMeltzerH.The British Child and Adolescent Mental Health Survey 1999: The prevalence of DSM-IV disorders. J Am Acad Child Adolesc Psychiatry. 2003;39:39–48.
14.
AchenbachTMMcConaughySHHowellCT. Child/adolescent behavioral and emotional problems: Implications of cross-informant correlations for situational specificity. Psychol Bull. 1987;101:213–232.
15.
AchenbachTMMcConaughySH. The Achenbach system of empirically based assessment. In: ReynoldsCRKamphausRW, editors. Handbook of psychological and educational assessment of children: Personality, behavior, and context. 2nd ed.New York (NY): Guilford Press; 2003. p 406–430.
16.
AngoldACostelloEJEggerH.Structured interviews. In: MartinAVolkmarFR, editors. Lewis's child and adolescent psychiatry: A comprehensive textbook. 4th ed.Baltimore (MA): Williams and Wilkins; 2007. p 344–357.
17.
JensenPSRubio-StipecMCaninoG. Parent and child contributions to diagnosis of mental disorder: Are both informants always necessary? J Am Acad Child Adolesc Psychiatry. 1999;38:1569–1579.
18.
LoneyBRFrickPJ. Structured diagnostic interviewing. In: ReynoldsCRKamphausRW, editors. Handbook of psychological & educational assessment of children: Personality, behavior, and context. 2nd ed.New York (NY): Guilford Press; 2003. p 235–247.
19.
McClellanJ.Diagnostic interviews. In: WienerJMDulcanMK, editors. Textbook of child and adolescent psychiatry. 3rd ed.Washington (DC): American Psychiatric Publishing; 2004. p 137–148.
20.
ShafferDFisherPWLucasC.Respondent-based interviews. In: ShafferDLucasCPRichtersJE, editors. Diagnostic assessment in child and adolescent psychopathology. New York (NY): Guilford Press; 1999. p 3–33.
21.
SmollaNVallaJPBergeronL. Development and reliability of a pictorial mental disorders screen for young adolescents. Can J Psychiatry. 2004;49:828–837.
22.
VallaJPBergeronLSmollaN.The Dominic-R: A pictorial interview for 6- to 11-year-old children. J Am Acad Child Adolesc Psychiatry. 2000;39:85–93.
23.
VallaJPKovessVCheeC Chan. A French study of the Dominic Interactive. Soc Psychiatry Psychiatr Epidemiol. 2002;37:441–448.
24.
HoagwoodKOlinS.The NIMH blueprint for change report: Research priorities in child and adolescent mental health. J Am Acad Child Adolesc Psychiatry. 2000;41:760–767.
25.
ShafferDFisherPLucasC. NIMH Diagnostic Interview Schedule for Children Version IV (NIMH DISC-IV): Description, differences from previous versions, and reliability of some common diagnoses. J Am Acad Child Adolesc Psychiatry. 2000;39:28–38.
26.
HoTPLeungPWLeeCC. Test–retest reliability of the Chinese version of the Diagnostic Interview Schedule for Children-Version 4 (DISC-IV). J Child Psychol Psychiatry. 2005;46:1135–1138.
27.
JensenPRoperMFisherP. Test–retest reliability of the Diagnostic Interview Schedule for Children (DISC-2.1): Parent, child and combined algorithms. Arch Gen Psychiatry. 1995;52:61–71.
28.
ShroutPESpitzerRLFleissJL. Quantification of agreement in psychiatric diagnosis revisited. Arch Gen Psychiatry. 1987;44:172–177.
29.
LewczykCMGarlandAFHurlburtMS. Comparing DISC-IV and clinician diagnoses among youths receiving public mental health services. J Am Acad Child Adolesc Psychiatry. 2003;42:349–356.
30.
BretonJJBergeronLVallaJP. Do children aged 9 through 11 years understand the DISC version 2.25 questions?J Am Acad Child Adolesc Psychiatry. 1995;34:946–956.
31.
ButcherHJ. Human intelligence: Its nature and assessment. New York (NY): Harper and Row; 1972.
32.
CaseR.Theories of learning and theories of development. Educ Psychol. 1993;28:219–233.
33.
CaseRDemetriouAPlatsidouM. Integrating concepts and tests of intelligence from the differential and developmental traditions. Intelligence. 2001;29:307–336.
34.
DemetriouA.Mind, intelligence and development: A cognitive, differential and developmental theory of intelligence. In: DemetriouARaftopoulosA, editors. Cognitive developmental change: Theories, models and measurement. Cambridge (GB): Cambridge University Press; 2004. p 21–73.
35.
KeatingDP. Cognitive and brain development. In: LernerRMSteinbergL, editors. Handbook of adolescent psychology. 2nd ed.New Jersey (NJ): John Wiley and Sons; 2004. p 45–84.
36.
PiagetJ.The intellectual development of adolescent. In: CaplanGLeboviciS, editors. Adolescence: Psychosocial perspectives. New York (NY): Basic Books; 1969. p 22–26.
37.
PiagetJ. L'épistémologie génétique. Paris (FR): Presses Universitaires de France; 1970.
38.
SpreenORisserAHEdgellD. Developmental neuropsychology. New York (NY): Oxford University Press; 1995.
39.
YatesT.Theories of cognitive development. In: LewisM, editor. Child and adolescent psychiatry. Baltimore (MA): Williams and Wilkins; 1991. p 109–129.
40.
American Psychiatric Association. Diagnostic and statistical manual of mental disorders. 3rd ed.Washington (DC): APA; 1987.
41.
VallaJPBergeronLBérubéH. A structured pictorial questionnaire to assess DSM-III-R-based diagnoses in children (6–11 years): Development, validity, and reliability. J Abnorm Child Psychol, 1994;22:403–423.
42.
VallaJPBergeronLBidaut-RusselM. Reliability of the Dominic-R: A young child mental health questionnaire combining visual and auditory stimuli. J Child Psychol Psychiatry, 1997;38:717–724.
43.
American Psychiatric Association. Diagnostic and statistical manual of mental disorders. 4th ed. Text revision. Washington (DC): APA; 2000.
44.
BergeronLSmollaNVallaJP. Psychometric properties of the Dominic Interactive in children aged 6–11. Paper presented at the meeting of the American Academy of Child and Adolescent Psychiatry; 2008 Oct 23–28; Boston (MA).
45.
ScottTJ LinaresShortEJSingerLT. Psychometric properties of the Dominic Interactive assessment: A computerized self-report for children. Assessment. 2006;13:16–26.
ShroutPE. Reliability. In: TsuangMTTohenM, editors. Textbook in psychiatric epidemiology. 2nd ed.New York (NY): Wiley-Liss; 2002. p 131–147.
48.
KendellRJablenskyA.Distinguishing between the validity and utility of psychiatric diagnoses. Am J Psychiatry. 2003;160:4–12.
49.
BoyleMHOffordDRRacineY. Adequacy of interviews vs checklists for classifying childhood psychiatric disorder based on parent reports. Arch Gen Psychiatry. 1997;54:793–799.
50.
GoldsteinJMSimpsonJC. Validity: Definitions and applications to psychiatric research. In: TsuangMTTohenM, editors. Textbook in psychiatric epidemiology. 2nd ed.New York (NY): Wiley-Liss; 2002. p 149–163.
51.
RobinsLN. Birth and development of psychiatric interviews. In: TsuangMTTohenM, editors. Textbook in psychiatric epidemiology. 2nd ed.New York (NY): Wiley-Liss; 2002. p 257–271.
52.
AchenbachTM. Manual for the Child Behavior Checklist/4–18. Burlington (VT): University of Vermont, Department of Psychiatry; 1991.
53.
AchenbachTMBeckerADöpfnerM. Multicultural assessment of child and adolescent psychopathology with ASEBA and SDQ instruments: Research findings, applications, future directions. J Child Psychol Psychiatry. 2008;49:251–275.
54.
RobinsLN. How to choose among the riches: Selecting a diagnostic instrument. Int J Methods Psychiatr Res. 1995;5:103–109.
55.
CohenJA. Coefficient of agreement for nominal scale. Educ Psychol Meas. 1960;20:37–46.
56.
FallonTSchwab-StoneM.Determinants of reliability in psychiatric surveys of children. J Child Psychol Psychiatry. 1994;35:1391–1408.
57.
CronbachLJ. Coefficient alpha and the internal structure of tests. Psychometrika. 1951;16:297–234.
FleissJL. Statistical methods for rates and proportions. 2nd ed.New York (NY): John Wiley & Sons, Inc; 1981.
60.
LucasCPFisherPPiacentiniJ. Features of interview questions associated with attenuation of symptoms reports. J Abnorm Child Psychol. 1999;27:429–437.
61.
BergsmaW. Marginal models for categorical variables. Tilburg (NL): Tilburg University Press; 1997.
62.
VermuntKV. LEM: A general program for the analysis of categorical data. Tilburg (NL): Tilburg University Press; 1997.
63.
CicchettiDV. Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychol Assess. 1994;6:284–290.
64.
PedhazurESchmelkinL Pedhazur. Measurement, design and analysis: An integrated approach. New Jersey (NJ): Lawrence Erlbaum Associates; 1991.
65.
KastrupMCRamosAB. Global mental health. Dan Med Bull. 2007;54:42–43.
66.
MurrayCJLLopezAD. The global burden of disease and injury series, volume 1: A comprehensive assessment of mortality and disability from diseases, injuries, and risk factors in 1990 and projected to 2020. Cambridge (MA): Harvard University Press; 1996.
67.
CronbachLJMeehlPE. Construct validity in psychological tests. Psychol Bull. 1955;52:281–302.
