Standardized behavior rating scales and checklists offer unobtrusive evaluations of students' behavior in natural social environments. This study investigated the interrater agreement of the Adjustment Scales for Children and Adolescents (ASCA), a behavior rating scale used in school settings. Participants were 71 students enrolled in a variety of special programs who were rated by 29 observers in 24 classrooms. Resulting interrater reliability coefficients were substantial, and level differences, although significant, were not clinically meaningful. It was concluded that the ASCA produced acceptable levels of interrater agreement when educational professionals and paraprofessionals observed exceptional students within a common environment.
Get full access to this article
View all access options for this article.
References
1.
Achenbach, T.M., McConaughy, S.H., & Howell, C.T. (1987). Child/adolescent behavioral and emotional problems: Implications of cross-infotmant correlations of situational specificity. Psychological Bulletin, 101, 231-232.
2.
Barkley, R.A. (1990). Attention deficit hyperactivity disorder: A handbook for diagnosis and treatment. New York: Guilford.
3.
Cohen, J. (1987). Statistical power analysis for the behavioral sciences (Revised Edition). Hillsdale, NJ: Erlbaum.
4.
Edelbrock, C. (1983). Problems and issues in using rating scales to assess child personality and psychopathology. School Psychology Review, 12, 293-299.
5.
Glass, G.V., McGraw, B., & Smith, M.L. (1991). Meta analysis in social research. Beverly Hills, CA: Sage.
6.
Guilford, J.P., & Fruchter, B. (1978). Fundamental statistics in psychology and education (6th ed.). New York: McGraw-Hill.
7.
Kamphaus, R.W., & Frick, P.J. (1996). Clinical assessment of child and adolescent personality and behavior. Boston: Allyn and Bacon.
8.
Knoff, H.M. (1995). Best practices in personality assessment. In A. Thomas & J. Grimes (Eds.), Best practices in school psychology-III (pp. 849-864). Washington, DC: National Association of School Psychologists .
9.
Kratochwill, T.R., & McGivern, J.E. (1996). Clinical diagnosis, behavioral assessment, and functional analysis: Examining the connection between assessment and intervention. School Psychology Review, 25, 342-355.
10.
Lee, S.W., Elliott, J., & Barbour, J.D. (1994). A comparison of cross-informant behavior ratings in school-based diagnosis. Behavioral Disorders, 19, 87-97.
11.
Martin, R.P., Hooper, S., & Snow, J. (1986). Behavior rating scale approaches to personality assessment in children and adolescents. In H.M. Knoff (Ed.), The assessment of child and adolescent personality (pp.309-351). New York: Guilford.
12.
McConaughy, S.H., & Ritter, D.R. (1995). Best practices in multidimensional assessment of emotional or behavioral disorders, Best practices in school psychology-III (pp. 865-877). Washington, DC: National Association of School Psychologists .
13.
McDermott, P.A. (1988). Agreement among diagnosticians or observers: Its importance and determination. Professional School Psychology , 3, 225-240.
14.
McDermott, P.A. (1993). National standardization of uniform multisituational measures of child and adolescent behavior pathology. Psychological Assessment, 5, 413-424.
15.
McDermott, P.A. (1994). National profiles in youth psychopathology: Manual of Adjustment Scales for Children and Adolescents. Philadelphia : Edumetric and Clinical Science.
16.
McDermott, P.A. (1996). A nationwide study of developmental and gender prevalence for psychopathology in childhood and adolescence. Journal of Abnormal Child Psychology, 24, 53-66.
17.
McDermott, P.A., Marston, N.C., & Stott, D.H. (1993). Adjustment Scales for Children and Adolescents . Philadelphia: Edumetric and Clinical Science.
18.
McDermott, P.A.Watkins, M.W., Sichel, A.F., Weber, E.M., Keenan, J.T., Holland, A.M., & Leigh, N.M. (1996). The accuracy of new national scales for detecting emotional disturbance in children and adolescents. Journal of Special Education, 29, 337-354.
Naglieri, J., LeBuffe, P.A., & Pfeiffer, S.I. (1993). Devereux Behavior Rating Scale-School Form. San Antonio, TX: The Psychological Corporation.
21.
Power, T.J., & Ikeda, M.J. (1996). The clinical utility of behavior rating scales: Comments on the diagnostic assessment of ADHD. Journal of School Psychology, 34, 379-385.
22.
Reed, R., & Maag, J.W. (1994). How many fidgets in a pretty much: A critique of behavior rating scales for identifying students with ADHD. Journal of School Psychology, 32, 339-354.
23.
Reschly, D.J., & Ysseldyke, J.E. (1995). School psychology paradigm shift. In A. Thomas & J. Grimes (Eds.), Best practices in school psychology-III (pp. 17-32). Washington, DC: National Association of School Psychologists.
Stinnett, T.A., Havey, J.M., & Oehler-Stinett, J. (1994). Current test usage by practicing school psychologists: A national survey. Journal of Psychoeducational Assessment, 12, 331-350.
