Modern scale construction techniques have been used to develop scales measuring examiner ratings of examinees’ test session behavior (TSB) on Wechsler and Stanford-Binet intelligence tests. This study analyzes data from the Test Session Observation Checklist (TSOC), a measure developed by post hoc rational analysis, from a portion of the Woodcock Johnson Psychoeducational Battery-Third Edition standardization sample (N = 5,769). Results indicate (a) most participants are rated as displaying minimal negative test session behaviors, (b) the seven TSOC items are organized into two components (General Impressions and Attention To Task) that explain roughly 54% of the variance in TSOC scores, and (c) race, sex, and age differences in component scores examined with and without covariates are consistent with results from prior TSB research.
Achenbach, T. M., & Rescorla, L. A. (2001). Manual for the ASEBA school-age forms & profiles. Burlington: University of Vermont, Research Center for Children, Youth, and Families.
2.
Aylward, G. P., & MacGruder, R. W. (1986). Test Behavior Checklist. Brandon, VT: Clinical Psychology Publishing.
3.
Bracken, B. (Ed.). (2000). The psychoeducational assessment of preschool children. Boston: Allyn & Bacon.
4.
Caldwell, B. M. (1951). Test Behavior Observation guide. In R. Watson (Ed.), The clinical method in psychology (pp. 67-71). New York: Harper and Brothers.
5.
Carroll, J. B. (1993). Human cognitive abilities: A survey of factor-analytic studies. New York: Cambridge University Press.
6.
Cattell, R. B. (1943). The measurement of adult intelligence. Psychological Bulletin, 40, 153-193.
7.
Cattell, R. B. (1950). Personality: A systematic theoretical and factorial study. New York: McGraw-Hill.
8.
Culbertson, J. L., & Willis, D. J. (Eds.). (1993). Testing young children reference guide for developmental, psychoeducational, and psychosocial assessments. Austin, TX: PRO-ED.
9.
Ford, L., Floyd, R. G., Keith, T. Z., Fields, C., & Schrank, F. A. (2003). Using the Woodcock-Johnson III Tests of Cognitive Abilities with students with attention deficit/hyperactivity disorder. In F. A. Schrank & D. P. Flanagan (Eds.), WJ-III clinical use and interpretation (pp. 319-344). San Diego, CA: Academic Press.
10.
Frisby, C. (1999). Culture and test session behavior: Part I. School Psychology Quarterly, 14, 263-280.
11.
Glutting, J. J., & McDermott, P. A. (1988). Generality of test-session observations to kindergartners’ classroom behavior. Journal of Abnormal Child Psychology, 16, 527-537.
12.
Glutting, J., & Oakland, T. (1993). Guide to the assessment of test session behavior for the WISC-III and the WIAT. San Antonio, TX: The Psychological Corporation.
13.
Glutting, J., Oakland, T., & Konold, T. R. (1994). Criterion-related bias with the Guide to the Assessment of Test-Session Behavior for the WISC-III and WIAT: Possible race/ethnicity, gender, and SES effects. Journal of School Psychology, 32, 355-369.
14.
Glutting, J. J., Oakland, T., & McDermott, P. A. (1989). Observing child behavior during testing: Constructs, validity, and situational generality. Journal of School Psychology, 27, 155-164.
15.
Glutting, J. J., Robins, P. M., & de Lancey, E. (1997). Discriminant validity of test observations for children with attention deficit/hyperactivity. Journal of School Psychology, 35, 391-401.
16.
Glutting, J. J., Youngstrom, E. A., Oakland, T., & Watkins, M. W. (1996). Situational specificity and generality of test behaviors for samples of normal and referred children. School Psychology Review, 25, 94-107.
17.
Horn, J. L. (1985). Remodeling old models of intelligence. In B. B. Wolman (Ed.), Handbook of intelligence: Theories, measurements, and applications (pp. 267-300). New York: John Wiley.
18.
Horn, J. L. (1988). Thinking about human abilities. In J. R. Nesselroade & R. B. Cattell (Eds.), Handbook of multivariate psychology (2nd ed., pp. 645-865). San Diego, CA: Academic Press.
19.
Horn, J. L., & Stankov, L. (1982). Auditory and visual factors of intelligence. Intelligence, 6, 165-185.
20.
Kamphaus, R. W. (2001). Clinical assessment of child and adolescent intelligence (2nd ed.). Boston: Allyn & Bacon.
21.
Lerner, J., & Yasutake, D. (2001). School-age AD/HD sample. In K. S. McGrew & R. W. Woodcock (Eds.), Technical manual: Woodcock Johnson III (p. 77-77). Itasca, IL: Riverside Publishing.
22.
Martin, R. (1988). Assessment of personality and behavior problems. New York: Guilford.
23.
McConaughy, S. H., & Achenbach, T. M. (2004). Manual for the Test Observation Form for ages 2-18. Burlington: University of Vermont, Research Center for Children, Youth, and Families.
24.
McGrew, K., & Woodcock, R. (2001). Woodcock-Johnson III technical manual. Itasca, IL: Riverside Publishing.
25.
Nagle, R. J. (2000). Issues in preschool assessment. In B. Bracken (Ed.), The psychoeducational assessment of preschool children (pp. 19-32). Boston: Allyn & Bacon.
26.
Nandakumar, R., Glutting, J. J., & Oakland, T. (1993). Mantel-Haenszel methodology for detecting item bias: An introduction and example using the Guide to the Assessment of Test Session Behavior. Journal of Psychoeducational Assessment, 11, 108-119.
27.
Oakland, T., & Glutting, J. J. (1990). Examiner observations of children’s WISC-R test-related behaviors: Possible socioeconomic status, race, and gender effects. Psychological Assessment: A Journal of Consulting and Clinical Psychology, 2, 86-90.
28.
Oakland, T., Glutting, J., & Watkins, M. W. (2005). Assessment of test behaviors with the WISC-IV. In A. Prifitera, D. H. Sklofske, & L. G. Weiss (Eds.), WISC-IV clinical use and interpretation (pp. 435-463). Amsterdam: Elsevier.
29.
Osterlind, S. (2005). Modern measurement: Theories, principles, and application of mental appraisal. Englewood Cliffs, NJ: Prentice Hall.
30.
Reid, R., Riccio, C. A., Kessler, C. A., DuPaul, G. J., Power, T. J., Anastopoulos, A. D., et al. (2000). Gender and ethnic differences in ADHD as assessed by behavior ratings. Journal of Emotional and Behavioral Disorders, 8, 38-48.
31.
Sattler, J. M. (1988). Behavior and Attitude Checklist. In J. M. Sattler (Ed.), Assessment of children (3rd ed., p. 92-92). San Diego, CA: Author.
32.
Shephard, L., Kagan, S. L., & Wurtz, E. (Eds.). (1998). Principles and recommendations for early childhood assessments. Washington, DC: National Education Goals Panel.
33.
SPSS, Inc. (2005). SPSS 13.0 for Windows [Computer software]. Chicago: Author.
34.
Tabachnick, B., & Fidell, L. (2002). Using multivariate statistics (4th ed.). Boston: Allyn & Bacon.
35.
Terman, L. M., & Merrill, M. A. (1960). Stanford-Binet Intelligence Scale: Form L-M. Boston: Houghton Mifflin.
36.
Thorndike, R. L., Hagen, E. P., & Sattler, J. J. (1986a). Stanford-Binet Intelligence Scale: Fourth edition. Itasca, IL: Riverside Publishing.
37.
Thorndike, R. L., Hagen, E. P., & Sattler, J. J. (1986b). Stanford-Binet Observation Schedule. Itasca, IL: Riverside Publishing.
38.
Vesley, B. (2001). Grades 1 through 6 normal, LD, AD/HD sample. In K. S. McGrew & R. W. Woodcock (Eds.), Technical manual: Woodcock-Johnson III (pp. 76-77). Itasca, IL: Riverside Publishing.
39.
Wechsler, D. (1997). WAIS-III manual. San Antonio, TX: The Psychological Corporation.
40.
Wilson, M. S., & Reschly, D. J. (1996). Assessment in school psychology training and practice. School Psychology Review, 25, 9-23.
41.
Woodcock, R., McGrew, K. S., & Mather, N. (2001). Woodcock-Johnson III. Itasca, IL: Riverside Publishing.
42.
Zentall, S. S., & Smith, Y. S. (1993). Mathematical performance and behavior of children with hyperactivity with and without coexisting aggression. Behavior Research and Therapy, 31, 701-710.
