WISC-III Factor Invariance Across Samples of Children Exhibiting Appropriate and Inappropriate Test-Session Behaviors

Abstract

Test-taking behaviors, such as a lack of attention, poor cooperation, and avoidance, can have an adverse impact on intelligence test scores. The Guide to the Assessment of Test Session Behavior for the WISC-III and WIAT(GATSB) provides a standardized measure of test-taking behavior. Whether the measurement of intelligence when using the Wechsler Intelligence Scale for Children-Third Edition (WISC-I1) actually differs for children who exhibit inappropriate test-session behavior was evaluated empirically. To test the invariance of factor structures, a multi sample confirmatory factor analysis, using LISREL 8, was conducted on samples of children displaying appropriate versus inappropriate behaviors, as measured by their total GATSB scores. Factor coefficients and error variances were generally invariant. However, some factor variances and covariances were not invariant, suggesting that factor index and Full Scale IQs may have different meanings across groups of children who display appropriate versus inappropriate test-session behavior.

Get full access to this article

View all access options for this article.

References

Aylward, G. P. , & MacGruder, R. W. (1986). Test Behavior Checklist. Brandon, VT: Clinical Psychology Publishing.

Bentler, P. M. (1990). Comparative fit indexes in structural models. Psychological Bulletin, 107, 238-246.

Bentler, P. M. (1992). On the fit of models to covariances and methodology in the bulletin. Psychological Bulletin, 112, 400-404.

Bollen, K. A. (1989). Structural equations with latent variables. New York: John Wiley.

Browne, M. W. , & Cudeck, R. (1993). Alternative ways of assessing fit. In K. A. Bollen & J. S. Long (Eds.), Testing structural equations models (pp. 136-162). Newbury Park, CA: Sage.

Dahlstrom, W. G. (1993). Tests: Small samples. Large consequences. American Psychologist, 48, 393-399.

Glutting, J. J. , & McDermott, P. A. (1988). Generality of test-session observations of to kindergartners' classroom behavior. Journal of Abnormal Child Psychology, 16, 527-537.

Glutting, J. J. , & Oakland, T. D. (1993). Guide to the assessment of test-session behavior for the WISC-III and WIAT. San Antonio, TX: Psychological Corporation.

Glutting, J. J. , Oakland, T. D. , & Konold, T. R. (1994). Criterion-related bias with the guide to the assessment of test session behavior for the WISC-III and WIAT: Possible race, gender, and SES effects. Journal of School Psychology, 32, 355-369.

10.

Glutting, J. J. , Oakland, T. D. , & McDermott, P. A. (1989). Observing child behavior during testing: Constructs, validity, and situational generality. Journal of School Psychology, 27, 155-164.

11.

Hutton, J. B. , Dubes, R. , & Muir, S. (1992). Assessment practices of school psychologists: Ten years later. School Psychology Review, 21, 271-284.

12.

Jöreskog, K. G. , & Sörbom, D. (1989). LISREL 7: A guide to the program and applications (2nd ed.). Chicago: SPSS.

13.

Jöreskog, K. G. , & Sörbom, D. (1993). LISREL8 for Windows (Version 8.12) [Computer software]. Chicago: Scientific Software International.

14.

Kaufman, A. S. , Kaufman, N. L. , Dougherty, E. H. , & Tuttle, K. S. C. (1994). Kaufman WISC-III Integrated Interpretive System Checklist for Behaviors Observed During Administration of WISC-III Subtests. Odessa, FL: Psychological Assessment Resources.

15.

Kaufman, A. S. , & Reynolds, C. R. (1984). Intellectual and academic achievement tests. In T. H. Ollendick & M. Hersen (Eds.), Child behavioral assessment: Principles and procedures (pp.195-220). New York: Pergamon.

16.

Konold, T. R. , Glutting, J. J. , Oakland, T. A. & O'Donnell, L. (1995). Congruence of test-session behavior dimensions among child groups that vary in gender, race-ethnicity, and SES. Journal of Psychoeducational Assessment, 13, 111-119.

17.

Rigdon, E. E. (1996). CFI versus RMSEA: A comparison of two fit indexes for structural equation modeling. Structural Equation Modeling, 3, 369-379.

18.

Sattler, J. M. (1988). Behavior and Attitude Checklist. In J. M. Sattler (Ed.), Assessment of children (3rd ed., p. 92). San Diego, CA: Author.

19.

Stinnett, T A. , Havey, J. M. , & Oehler-Stinnett, J. (1994). Current test usage by practicing school psychologists: A national survey. Journal of Psychoeducational Assessment, 12, 331-350.

20.

Terman, L. M. , & Merrill, M. A. (1960). Stanford-Binet Intelligence Scale: Form L-M. Boston: Houghton Mifflin.

21.

Thorndike, R. L. , Hagen, E. P. , & Sattler, J. M. (1986). Stanford-Binet Intelligence Scale: Fourth Edition. Chicago: Riverside.

22.

Watson, R. (1951). Test Behavior Observation Guide. In R. Watson (Ed .), The clinical method in psychology. New York: Harper.

23.

Wechsler, D. (1991). Wechsler Intelligence Scale for Children—Third Edition. San Antonio, TX: Psychological Corporation.

24.

Wechsler, D. (1992). Wechsler Individual Achievement Test. San Antonio, TX: Psychological Corporation.