This study examined the construct validity of the Adjustment Scales for Children and Adolescents (ASCA; McDermott, Marston, & Stott, 1993). Distinct group differences and discriminative validity (Youngstrom, Findling, Danielson, & Calabrese, 2001) were examined with a sample of 106 students ranging from grade 1 through 6 (53 met the DSM-IV/DISCIV criteria for ADHD, and 53 were members of a randomly selected and matched control group). Statistically significant group differences were observed with large effect sizes. Further, the ASCA demonstrated near perfect discrimination of the two groups and all diagnostic efficiency statistics were highly supportive in differentiating students meeting DISC-IV/DSM-IV criteria for ADHD from a random and matched control group
Get full access to this article
View all access options for this article.
References
1.
Achenbach, T. M. (1991). Manual for the Teacher's Report Form and 1991 Profile. Burlington, VT: University of Vermont Department of Psychiatry.
2.
Achenbach, T. M., & Edelbrock, C. (1983). Manual for the Child Behavior Checklist and Revised Child Behavior Profile. Burlington, VT: University of Vermont Department of Psychiatry.
3.
American Psychiatric Association. (1994). Diagnostic and statistical manual of mental disorders (DSM-JV) (4th ed.). Washington, DC: Author.
4.
American Psychiatric Association. (2000). Diagnostic and statistical manual of mental disorders: Text revision (DSM-JV-TR) (4th ed.). Washington, DC: Author.
5.
Canivez, G. L. (1994). Automated Calculation of Diagnostic Efficiency Statistics. Microsoft® Excel™ Spreadsheet Template for the Apple® Macintosh™ Microcomputer. Phoenix, AZ: Author.
6.
Canivez, G. L. (2001). Review of the Adjustment Scales for Children and Adolescents. In J. Impara & B. Plake (Eds.), The fourteenth mental measurements yearbook (pp. 22-24). Lincoln, NE: Buros Institute of Mental Measurements, University of Nebraska.
7.
Canivez, G. L. (2004). Replication of the Adjustment Scales for Children and Adolescents core syndrome factor structure. Psychology in the Schools, 41, 191-199.
8.
Canivez, G. L., & Bordenkircher, S. E. (2002). Convergent and divergent validity of the Adjustment Scales for Children and Adolescents and the Preschool and Kindergarten Behavior Scales. Journal of Psychoeducational Assessment, 20, 30-45.
9.
Canivez, G. L., Neitzel, R., & Martin, B. E. (in press). Construct Validity of the Kaufman Brief Intelligence Test, Wechsler Intelligence Scale for Children-Third Edition, and Adjustment Scales for Children and Adolescents. Journal of Psychoeducational Assessment.
10.
Canivez, G. L., Perry, A., & Weller, E. (2001). Stability of the Adjustment Scales for Children and Adolescents. Psychology in the Schools, 38, 217-227.
11.
Canivez, G. L., & Rains, J. D. (2002). Construct validity of the Adjustment Scales for Children and Adolescents and the Preschool and Kindergarten Behavior Scales: Convergent and divergent evidence. Psychology in the Schools, 39, 621-633.
12.
Canivez, G. L., & Watkins, M. W. (1996). Automated calculation of diagnostic efficiency statistics. Behavior Research Methods, Instruments, & Computers, 28, 132-133.
13.
Canivez, G. L., & Watkins, M. W. (2002). Interrater agreement for Syndromic Profile Classifications on the Adjustment Scales for Children and Adolescents. Assessment for Effective Intervention, 28, 3946.
14.
Canivez, G. L., Watkins, M. W., & Schaefer, B. A. (2002). Interrater agreement of Discriminant Classifications for the Adjustment Scales for Children and Adolescents. Psychology in the Schools, 39, 375-384.
15.
Cicchetti, D., & Toth, S. L. (1991). A developmental perspective on internalizing and externalizing disorders. In D. Cicchetti & S. L. Toth (Eds.), Internalizing and externalizing expressions of dysfunction: Rochester symposium on developmental psychopathology (Vol. 2, pp. 1-19). Hillsdale, NJ: Erlbaum.
16.
Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20, 3746.
17.
Cohen, J. (1992). A power primer. Psychological Bulletin, 112, 155-159.
18.
Cohen, R. J., & Swerdlik, M. E. (2002). Psychological testing and assessment: An introduction to tests and measurement (5th ed.). Mountain View, CA: Mayfield.
19.
Doyle, A. E., Biederman J., Seidman, L.J., Weber, W., & Faraone, S. V. (2000). Diagnostic efficiency of neuropsychological test scores for discriminating boys with and without attention deficit-hyperactivity disorder. Journal of Consulting & Clinical Psychology, 68, 477-488.
20.
Doyle, A., Ostrander, R., Skare, S., Crosby, R. D., & August, G. J. (1997). Convergent and criterion-related validity of the Behavior Assessment System for Children-Parent Rating Scale. Journal of Clinical Child Psychology, 26, 276-284.
21.
Elliott, C. D. (1990). Differential Ability Scales; Introductory and technical handbook. San Antonio: The Psychological Corporation.
22.
Fleiss, J. L. (1981). Statistical methods for rates and proportions (2nd ed.). New York: Wiley.
23.
Forbes, G. B. (2001). A comparison of the Conners' Parent and Teacher Rating Scales, the ADD-H Comprehensive Teacher's Rating Scale, and the Child Behavior Checklist in the clinical diagnosis of ADHD. Journal of Attention Disorders, 5, 2540.
24.
Glass, G. V., & Hopkins, K. D. (1996). Statistical methods in education and psychology (3rd ed.). Needham Heights, MA: Allyn and Bacon.
25.
Hart, E. L., & Lahey, B. B. (1999). General child behavior rating scales. In D. Shaffer, C. P. Lucas, & J. E. Richters (Eds.), Diagnostic assessment in child and adolescent psychopathology (pp. 65-87). New York: Guilford.
26.
Johnson, S., Barrett, P., Dadds, M., Fox, T., & Shortt, A. (1999). The Diagnostic Interview Schedule for Children, Adolescents, and Parents: Initial reliability and validity data. Behaviour Change, 3, 155-164.
27.
Kamphaus, R. W., & Frick, P. J. (1996). Clinical assessment of child and adolescent personality and behavior. Boston: Allyn and Bacon.
28.
Kessel, J. B., & Zimmerman, M. (1993). Reporting errors in studies of the diagnostic performance of self-administered questionnaires: Extent of the problem, recommendations for standardized presentation of results, and implications for the peer review process. Psychological Assessment, 5, 395-399.
29.
Landau, S., Milich, R., & Widiger, T. A. (1991). Predictive power methods may be more helpful in making a diagnosis than sensitivity and specificity. Journal of Child and Adolescent Psychopharmacology, 1, 343-351.
30.
McDermott, P. A. (1988). Agreement among diagnosticians or observers: Its importance and determination. Professional School Psychology, 3, 225-240.
31.
McDermott, P. A. (1993). National standardization of uniform multisituational measures of child and adolescent behavior pathology. Psychological Assessment, 5, 413-424.
32.
McDermott, P. A. (1994). National profiles in youth psychopathology: Manual of Adjustment Scales for Children and Adolescents. Philadelphia: Edumetric and Clinical Science.
33.
McDermott, P. A. (1995). Sex, race, class, and other demographics as explanations for children's ability and adjustment: A national appraisal. Journal of School Psychology, 33, 75-91.
34.
McDermott, P, A., Marston, N. C., & Stott, D. H. (1993). Adjustment Scales for Children and Adolescents. Philadelphia: Edumetric and Clinical Science.
35.
McDermott, P. A., Watkins, M. W., Sichel, A. F., Weber, E. M., Keenan, J. T., Holland, A. M., & Leigh, N. M. (1995). The accuracy of new national scales for detecting emotional disturbance in children and adolescents. The Journal of Special Education, 29, 337-354.
36.
Meehl, P. E. (1956). Wanted-A good cookbook. American Psychologist, 11, 263-272.
37.
Meehl, P. E., & Rosen, A. (1955). Antecedent probability and efficiency of psychometric signs, patterns, or cutting scores. Psychological Bulletin, 52, 194-216.
38.
Merrell, K. W. (1994a). Assessment of behavioral, social, and emotional problems. New York: Long-man.
39.
Merrell, K. W. (1994b). Preschool and Kindergarten Behavior Scales. Brandon, VT: Clinical Psychology Publishing.
40.
Merrell, K. W. (2003). Behavioral, social, and emotional assessment of children and adolescents. Mahwah, NJ: Erlbaum.
41.
Messick, S. (1995). Validity of psychological assessment: Validation of inferences from person's responses and performances as scientific inquiry into score meaning. American Psychologist, 50, 741-749.
42.
Milich, R., Widiger, T. A., & Landau, D. (1987). Differential diagnosis of attention deficit and conduct disorders using conditional probabilities. Journal of Consulting and Clinical Psychology, 55, 762-767.
43.
Piacentini, J. (1993). Checklists and rating scales. In T. H. Ollendick & M. Hersen (Eds.), Handbook of child and adolescent assessment (pp. 82-97). Boston: Allyn and Bacon.
44.
Quay, H. C. (1986). Classification. In H. C. Quay & J. S. Werry (Eds.), Psychopathological disorders of childhood (3rd ed., pp. 142). New York: Wiley.
45.
Reschly, D. J., & Ysseldyke, J. E. (1995). School psychology paradigm shift. In A. Thomas &J. Grimes (Eds.), Best practices in school psychology-III (pp. 17-32). Washington, DC: National Association of School Psychologists.
46.
Reynolds, C. R., & Kamphaus, R. W. (1992). Behavior Assessment System for Children. Circle Pines, MN: American Guidance Service.
47.
Reynolds, C. R., & Kamphaus, R. W. (2004). Behavior Assessment System for Children (2nd ed.). Circle Pines, MN: American Guidance Service.
48.
Salvia, J., & Ysseldyke, J. E. (1995). Assessment. Boston: Houghton Mifflin.
49.
Shaffer, D., Fisher, P., Lucas, C., Dulcan, M., & Schwab-Stone, M. (2000). NIMH Diagnostic Interview Schedule for Children Version IV (NIMH DISC-IV): Description, differences from previous versions, and reliability of some common diagnoses. Journal of the American Academy of Child & Adolescent Psychiatry, 39, 28-38.
50.
Stinnett, T. A., Havey, J. M., & Oehler-Stinnett, J. (1994). Current test usage by practicing school psychologists: A national survey. Journal of Psychoeducational Assessment, 12, 331-350.
51.
Tabachnick, B. G., & Fidell, L. S. (2001). Using multivariate statistics (4th ed.). Boston: Allyn and Bacon.
52.
Trites, R. L., Blouin, A. G. A., & Laprade, K. (1982). Analysis of the Conners Teacher Rating Scale based on a large normative sample. Journal of Consulting and Clinical Psychology, 50, 615-623.
53.
Watkins, M. W., & Canivez, G. L. (1997). Interrater agreement of the Adjustment Scales for Children and Adolescents. Diagnostique, 22, 205-213.
54.
Youngstrom, E. A., Findling, R. L., Danielson, C. K., & Calabrese, J. R. (2001). Discriminative validity of parent report of hypomanic and depressive symptoms on the General Behavior Inventory. Psychological Assessment, 13, 267-276.
