The ecological validity of the Conners' Continuous Performance Test II (CPT-II) was examined using a sample of 206 first- and second-grade children. Children's CPT-II scores were correlated with observations of inattentive/hyperactive behavior during CPT-II administration, observations of children's behavior during analogue academic task, classroom observations, and parent/teacher reports. CPT-II scores showed moderate correlations with test session behavior but low correlations with external measures of inattention/hyperactivity. On the other hand, test session observations, analogue task observations, classroom observations, and teacher reports showed moderate and significant intercorrelations. Furthermore, test session observations predicted a significant amount of variance in children's classroom behavior above and beyond CPT-II scores alone. Results suggest that psychologists should supplement CPT-II scores with observational data to estimate children's functioning outside the test setting.
Get full access to this article
View all access options for this article.
References
1.
American Educational Research Association. (1999). Standards for educational and psychological testing. Washington, DC: Author.
2.
Aylward, G. P., Gordon, M., & Verhulst, S. J. (1997). Relationships between continuous performance task scores and other cognitive measures: Causality or commonality?Assessment, 4, 325-336.
3.
Barkley, R. A. (1998). Attention-Deficit/Hyperactivity Disorder. In E. J. Mash & L. G. Terdal (Eds.), Assessment of childhood disorders (pp. 71-129). New York: Guilford.
4.
Barkley, R. A. (1991). The ecological validity of laboratory and analogue assessment methods of ADHD symptoms. Journal of Abnormal Child Psychology, 19, 2945.
5.
Barkley, R. A., DuPaul, G. J., & McMurray, M. B. (1990). A comprehensive evaluation of attention deficit disorder with and without hyperactivity as defined by research criteria. Journal of Consulting and Clinical Psychology, 58, 775-789.
6.
Barkley, R. A., Fischer, M., Newby, R. F., & Breen, M. J. (1988). Development of a multimethod clinical protocol for assessing stimulant drug response in children with Attention Deficit Disorder. Journal of Clinical Child Psychology, 17, 14-24.
7.
Breton, J., Bergeron, L., Valla, J. P., Berthiaume, C., Gaudet, N., Lambert, J.St. Georges., M., Houde, L., & Lepine, S. (1999). Quebec Children Mental Health Survey: Prevalence of DSM-III-R mental health disorders. Journal of Child Psychology and Psychiatry, 40, 375-384.
8.
Burns, G. L., & Patterson, D. R. (2000). Factor structure of the Eyberg Child Behavior Inventory: A parent rating scale of Oppositional Defiant Behavior Toward Adults, Inattentive Behavior, and Conduct Problem Behavior. Journal of Clinical Child Psychology, 29, 569-577.
9.
Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56, 81-105.
10.
Cohan, M. F. (1995). Validity investigation of the Conners' Continuous Performance Test. Unpublished doctoral dissertation. State University of New York, Albany.
11.
Conners, C. K. (2000). Conners' Continuous Performance Test II user's manual. Toronto: MHS.
12.
Conners, C. K. (1999). Kiddie Continuous Performance Test II user's manual. Toronto: MHS.
13.
Conners, C. K. (1997). Conners' Rating Scales-Revised technical manual. Toronto: MHS.
14.
Conners, C. K. (1995). Conners' Continuous Performance Test user's manual. Toronto: MHS.
15.
Daleiden, E., Drabman, R. S., & Benton, J. (2002). The Guide to the Assessment of Test Session Behavior: Validity in relation to cognitive testing and parent-reported problems in a clinical sample. Journal of Child and Adolescent Psychology, 31, 263-271.
16.
DuPaul, G. J., Power, T. J., McGoey, K. E., Ikeda, M. J., & Anastopoulos, A. D. (1998). Reliability and validity of parent and teacher ratings of Attention-Deficit/Hyperactivity Disorder symptoms. Journal of Psychoeducational Assessment, 16, 55-68.
17.
Foster, S. L., & Cone, J. D. (1986). Design and use of direct observation. In A. R. Ciminero, K. S. Calhoun, & H. E. Adams (Eds.), Handbook of behavioral assessment. New York: Wiley.
18.
Frick, P. J. (2000). Laboratory and performance-based measures of childhood disorders. Journal of Clinical Child Psychology, 29, 475-478.
19.
Gordon, M. (1983). The Gordon Diagnostic System. DeWitt, NY: Gordon Systems.
20.
Gordon, M., DiNiro, D., Mettelman, B. B., & Tallmadge, J. (1989). Observations of test behavior, quantitative scores, and teacher ratings. Journal of Psychoeducational Assessment, 7, 141-147.
21.
Handen, B. L., McAuliffe, S., Janosky, J., Feldman, H., & Breaux, A. M. (1998). A playroom observation procedure to assess children with mental retardation and ADHD. Journal of Abnormal Child Psychology, 26, 269-277.
22.
Haynes, S. N., Nelson, K., & Blaine, D. C. (1998). Psychometric foundations of assessment research. In J. N. Butcher, G. M. Holmbeck, & P. C. Kendall (Eds.), Handbook of research methods in clinical psychology (pp. 125-154). New York: Wiley.
23.
Haynes, S. N., & O'Brien, W. H. (2000). Principles and practice of behavioral assessment. New York: Kluwer.
24.
Jacob, R. G., O'Leary, K. D., & Rosenblad, C. (1978). Formal and informal classroom settings: Effects of hyperactivity. Journal of Abnormal Child Psychology, 6, 47-59.
25.
Kaufman, A. S. (1994). Intelligent testing with the WISC-II. New York: Wiley.
26.
Kaufman, A. S., & Kaufman, N. L. (1990). Kaufman Brief Intelligence Test manual. Circle Pines, MN: American Guidance Service.
27.
Knoff, H. M. (2001). Review of Conners' Rating Scales-Revised. 14 Mental Measurements Yearbook. Retrieved March 6, 2003, from SilverPlatter Mental Measurements Yearbook database.
28.
McGee, R. A., Clark, S. E., & Symons, D. K. (2000). Does the Conners' Continuous Performance Test aid in ADHD diagnosis?Journal of Abnormal Child Psychology, 28, 415-424.
29.
Milich, R. (1984). Cross-sectional and longitudinal observations of activity level and sustained attention in a normative sample. Journal of Abnormal Child Psychology, 12, 261-276.
30.
Milich, R., Loney, J., & Landau, S. (1982). Independent dimensions of hyperactivity and aggression: A validation with playroom observation data. Journal of Abnormal Psychology, 91, 183-198.
31.
Miller, D. (1995). Review of the Kaufman Brief Intelligence Test. 12 Mental Measurements Yearbook. Retrieved March 6, 2003, from SilverPlatter Mental Measurements Yearbook database.
32.
Platzman, K. A., Stoy, M. R., Brown, R. T., Coles, C. D., Smith, I. E., & Falek, A. (1992). Review of observational methods in Attention Deficit Hyperactivity Disorder (ADHD): Implications for diagnosis. School Psychology Quarterly, 7, 155-177.
33.
Rapport, M. D., Chung, K.,Shore, G., Denny, C. B., & Isaacs, P. (2000). Upgrading the science and technology of assessment and diagnosis: Laboratory and clinic-based assessment of children with ADHD. Journal of Clinical Child Psychology, 29, 555-568.
34.
Reynolds, C. R., & Kamphaus, R. W. (1998). Behavioral Assessment System for Children manual. Circle Pines, MN: American Guidance Service.
35.
Riccio, C. A., Reynolds, C. R., & Lowe, P. A. (2001). Clinical applications of continuous performance tests. New York: Wiley.
36.
Roberts, M. A. (1990). A behavioral observation method for differentiating hyperactive and aggressive boys. Journal of Abnormal Child Psychology, 18, 131-142.
37.
Routh, D. K., & Schroeder, C. S. (1976). Standardized playroom measures as indices of hyperactivity. Journal of Abnormal Child Psychology, 4, 199-207.
38.
Sattler, J. M. (1992). Assessment of children. San Diego: Author.
39.
Schachar, R., Sandberg, S., & Rutter, M. (1986). Agreement between teachers' ratings and observations of hyperactivity, inattentiveness, and defiance. Journal of Abnormal Child Psychology, 14, 331-345.
40.
Szatmari, P.Offord, D. R., & Boyle, M. H. (1989). Correlates, associated impairments, and patterns of service utilization of children with attention deficit disorders: Findings from the Ontario Child Health Study. Journal of Child Psychology and Psychiatry, 30, 205-217.
41.
Wechsler, D. A. (1991). Wechsler Intelligence Scale for Children-Third Edition manual. San Antonio, TX: The Psychological Corporation.
42.
Weis, R. (2003). Wisconsin Test of Behavioral Inhibition manual. Unpublished manual.
43.
Witt, J. C., & Jones, K. M. (2000). Review of the Behavioral Assessment System for Children. 13 Mental Measurements Yearbook. Retrieved March 6, 2003, from SilverPlatter Mental Measurements Yearbook database.
44.
Young, J. W. (1995). Review of the Kaufman Brief Intelligence Test. 12 Mental Measurements Yearbook. Retrieved March 6, 2003, from SilverPlatter Mental Measurements Yearbook database.
