Past literature has largely ignored the population frequency of multivariate factor and subtest score discrepancies. Another limitation has been that statistical models imperfectly model the clinical assessment process, whereby significant discrepancies between both factors and subtests are included in predictions about an individual’s academic achievement. The present study examined these issues using a nationally representative sample (N = 1,185) completing the Differential Ability Scales. Results indicate that approximately 80% of children in a nonreferred sample show at least one statistically significant ability discrepancy. In addition, the global estimate of cognitive ability was the most parsimonious predictor of academic achievement, whereas information about ability discrepancies did not significantly improve prediction. Findings suggest that when predicting academic achievement, there is little value in interpreting cognitive scores beyond the global ability estimate.
Aiken, L. S.
, & West, S. G. (1991). Multiple regression: Testing and interpreting interactions. Newbury Park: Sage.
2.
Alfonso, V. C.
, Oakland, T. D., LaRocca, R., & Spanakos, A. (2000). The course on individual cognitive assessment. School Psychology Review, 29, 52-64.
3.
Beebe, D. W.
, Pfiffner, L. J., & McBurnett, K. (2000). Evaluation of the validity of the Wechsler Intelligence Scale for Children-Third Edition Comprehension and Picture Arrangement subtests as measures of social intelligence. Psychological Assessment, 12, 97-101.
4.
Buchner, A.
, Faul, F., & Erdfelder, E. (1996). G—Power: A priori, posthoc, and compromise power analyses for the Macintosh (Version 2.1.1). Trier, Germany: University of Trier.
5.
Cahan, S.
(1986). Significance testing of subtest score differences: The rules of the game. Journal of Psychoeducational Assessment, 4, 273280.
6.
Camara, W.
, Nathan, J., & Puente, A. (1998). Psychological test usage in professional psychology: Report of the APA practice and science directorates. Washington, DC: American Psychological Assocation.
7.
Camara, W. J.
, Nathan, J. S., & Puente, A. E. (2000). Psychological test usage: Implications in professional psychology. Professional Psychology: Research and Practice, 31, 141-154.
8.
Carroll, J. B.
(2000). Commentary on profile analysis. School Psychology Quarterly, 15, 449-456.
9.
Caruso, J. C.
(2001). Increasing the reliability of the fluid/crystallized difference score from the Kaufman Adolescent and Adult Intelligence Test with reliable component analysis. Assessment, 8, 155166.
10.
Ceci, S. J.
, & Williams, W. M. (1997). Schooling, intelligence, and income. American Psychologist, 52, 1051-1058.
11.
Cohen, J.
, & Cohen, P. (1983). Applied multiple regression/correlation analysis for the behavioral sciences (3rd ed.). Hillsdale, NJ: Lawrence Erlbaum.
12.
Cronbach, L. J.
, & Snow, R. E. (1977). Aptitudes and instructional methods: A handbook for research on interactions. New York: Irvington.
13.
Donders, J.
(1996). Factor subtypes in the WISC-III standardization sample: Analysis of factor index scores. Psychological Assessment, 8, 312-318.
14.
Eisman, E. J.
, Dies, R. R., Finn, S. E., Eyde, L. D., Kay, G. G., Kubiszyn, T. W., et al. (1998). Problems and limitations in the use of psychological assessment in contemporary health care delivery: Report of the Board of Professional Affairs Psychological Assessment Workgroup, part II. Washington, DC: American Psychological Association.
15.
Elliot, C. D.
(1990a). Differential Ability Scales: Introductory and technical handbook. San Antonio, TX: Psychological Corporation.
16.
Elliot, C. D.
(1990b). The nature and structure of children’s abilities: Evidence from the Differential Ability Scales. Conference on Intelligence: Theories and practice (1990, Memphis, Tennessee). Journal of Psychoeducational Assessment, 8, 376-390.
17.
Elliot, C. D.
(1990c). The nature and structure of the DAS: Questioning the test’s organizing model and use. Journal of Psychoeducational Assessment, 8, 406-411.
18.
Glutting, J. J.
, Adams, W., & Sheslow, D. (2000). Wide Range Intelligence Test manual. Wilmington, DE: Wide Range.
19.
Glutting, J. J.
, McGrath, E. A., Kamphaus, R. W., & McDermott, P. A. (1992). Taxonomy and validity of subtest profiles on the Kaufman Assessment Battery for Children. Journal of Special Education, 26, 85-115.
20.
Glutting, J. J.
, Watkins, M., & Youngstrom, E. A. (in press). Multifactored and cross-battery assessments: Are they worth the effort? In C. R. Reynolds & R. Kamphaus (Eds.), Handbook of psychological and educational assessment of children (2nd ed.). New York: Guilford.
21.
Glutting, J. J.
, Youngstrom, E. A., Ward, T., Ward, S., & Hale, R. L. (1997). Incremental efficacy of WISC-III factor scores in predicting achievement: What do they tell us?Psychological Assessment, 9, 295-301.
22.
Gough, H.
(1971). Some reflections on the meaning of psychodiagnosis. American Psychologist, 26, 106-187.
23.
Gregory, R. J.
(1999). Foundations of intellectual assessment: The WAIS-III and other tests in clinical practice. Boston: Allyn & Bacon.
24.
Grossman, F. M.
, & Johnson, K. M. (1982). WISC-R factor scores as predictors of WRAT performance: A multivariate analysis. Psychology in the Schools, 19, 465-468.
25.
Groth-Marnat, G.
(1999). Financial efficacy of clinical assessment: Rational guidelines and issues for future research. Journal of Clinical Psychology, 55, 813-824.
26.
Hanna, G. S.
, Bradley, F. O., & Holen, M. C. (1981). Estimating major sources of measurement error in individual intelligence scales: Taking our heads out of the sand. Journal of School Psychology, 19, 370-376.
27.
Jensen, A. R.
(1998). The g factor: The science of mental ability. Westport, CT: Praeger.
28.
Kamphaus, R. W.
(1993). Clinical assessment of children’s intelligence. Boston: Allyn & Bacon.
29.
Kaufman, A. S.
(1979). Intelligent testing with the WISC-R. New York: John Wiley.
30.
Kaufman, A. S.
(1994). Intelligent testing with the WISC-III. New York: John Wiley.
31.
Kaufman, A. S.
, & Lichtenberger, E. O. (1999). Essentials of WAIS-III assessment. New York: John Wiley.
32.
Keith, T. Z.
(1990). Confirmatory and hierarchical confirmatory analysis of the Differential Ability Scales. Journal of Psychoeducational Assessment, 8, 391-405.
33.
Kleinmuntz, B.
(1990). Why we still use our heads instead of formulas: Toward an integrative approach. Psychological Bulletin, 107, 296310.
34.
Lipsitz, J. D.
, Dworkin, R. H., & Erlenmeyer-Kimling, L. (1993). Wechsler Comprehension and Picture Arrangement subtests and social adjustment. Psychological Assessment, 5, 430-437.
35.
Lubinski, D.
, & Benbow, C. P. (2000). States of excellence. American Psychologist, 55, 137-150.
36.
McDermott, P. A.
(1994). National profiles in youth psychopathology: Manual of Adjustment Scales for Children and Adolescents. Philadelphia, PA: Edumetric and Clinical Science.
37.
McDermott, P. A.
, & Glutting, J. J. (1997). Informing stylistic learning behavior, disposition, and achievement through ability subtests—or more illusions of meaning?School Psychology Review, 26, 163-175.
38.
McGrew, K.
S., & Flanagan, D. P. (1998). The intelligence test desk reference(ITDR):Gf-Gccross-batteryassessment.Boston:Allyn&Bacon.
39.
Mishra, S. P.
(1983). Validity of WISC-R IQs and factor scores in predicting achievement for Mexican-American children. Psychology in the Schools, 20, 150-154.
40.
Moffitt, T. E.
, Caspi, A., Harkness, A. R., & Silva, P. A. (1993). The natural history of change in intellectual performance: Who changes? How much? Is it meaningful?Journal of Child Psychology and Psychiatry, 14, 455-506.
41.
Naglieri, J. A.
(1993). Pairwise and ipsative comparisons of WISC-III IQ and index scores. Psychological Assessment, 5, 113-116.
42.
Naglieri, J. A.
(2000). Can profile analysis of ability tests work? An illustration using the PASS theory and CAS with an unselected cohort. School Psychology Quarterly, 15, 419-433.
43.
Neisser, U.
, Boodoo, G., Bouchard, T. J., Boykin, A. W., Brody, N., Ceci, S. J., et al. (1996). Intelligence: Knowns and unknowns. American Psychologist, 51, 77-101.
44.
Pfeiffer, S. I.
, Reddy, L. A., Kletzel, J. E., Schmelzer, E. R., & Boyer, L. A. (2000). The practitioner’s view of IQ testing and profile analysis. School Psychology Quarterly, 15, 376-385.
45.
Prifitera, A.
, Weiss, L. G., & Saklofske, D. H. (1998). The WISC-III in context. In A. Prifitera & D. H. Saklofske (Eds.), WISC-III clinical use and interpretation: Scientist-practitioner perspectives (pp. 1-39). New York: Academic Press.
46.
Pritchard, D. A.
, Livingston, R. B., Reynolds, C. R., & Moses, J. A., Jr. (2000). Modal profiles for the WISC-III. School Psychology Quarterly, 15, 400-418.
47.
Psychological Corporation
. (1992). Wechsler Individual Achievement Test manual. San Antonio, TX: Author.
48.
Psychological Corporation
. (1999). Wechsler Abbreviated Scale of Intelligence manual. San Antonio, TX: Author.
49.
Riccio, C. A.
, Cohen, M. J., Hall, J., & Ross, C. M. (1997). The third and fourth factors of the WISC-III: What they don’t measure. Journal of Psychoeducational Assessment, 15, 27-39.
50.
Riccio, C. A.
, & Hynd, G. W. (2000). Measurable biological substrates to verbal-performance differences in Wechsler scores. School Psychology Quarterly, 15, 386-399.
51.
Sattler, J.
(1992). Assessment of children (3rd ed.). San Diego, CA: Author.
52.
Sattler, J.
(2001). Assessment of children: Cognitive applications (4th ed.). San Diego, CA: Author.
53.
Schwean, V. L.
, Saklofske, D. H., Yackulic, R. A., & Quinn, D. (1993). WISC-III performance of ADHD children. In B. A. Bracken & R. S. McCallum (Eds.), Wechsler Intelligence Scale for Children (3rd ed., pp. 56-70). Brandon, VT: Clinical Psychology Publishing.
54.
Silverstein, A. B.
(1993). Type I, Type II, and other types of errors in pattern analysis. Psychological Assessment, 5, 72-74.
55.
Stanton, H. C.
, & Reynolds, C. R. (2000). Configural frequency analysis as a method of determining Wechsler profile types. School Psychology Quarterly, 15, 434-448.
56.
Thorndike, R. L.
, Hagen, E. P., & Sattler, J. M. (1986). Stanford-Binet Intelligence Scale—Fourth Edition. Chicago: Riverside.
57.
U.S. Department of Commerce
. (2000). Profile of general demographic characteristics for the United States (Current Population Reports). Washington, DC: Bureau of the Census.
58.
Watkins, M. W.
(2000). Cognitive profile analysis: A shared professional myth. School Psychology Quarterly, 15, 465-479.
59.
Wechsler, D.
(1974). Wechsler Intelligence Scale for Children—Revised Edition. San Antonio, TX: Psychological Corporation.
60.
Wechsler, D.
(1991). Manual for the Wechsler Intelligence Scale for Children—Third Edition. San Antonio,TX: Psychological Corporation.
61.
Woodcock, R. W.
(1987). Woodcock Reading Mastery Tests—Revised: Examiner’s manual. Circle Pines, MN: American Guidance Service.
62.
Youngstrom, E.
, & Frazier, T. W. (2000, December). Evidence and implications of over-factoring on commercial tests of cognitive ability.Paper presented at the Annual Meeting of the International Society for Intelligence Research, Cleveland, OH.
63.
Youngstrom, E. A., & Glutting, J. J. (2001). Individual strengths and weaknesses on factor scores from the Differential Ability Scales: Validity in predicting concurrent achievement and behavioral criteria. Manuscript submitted for publication.
64.
Youngstrom, E. A.
, Kogos, J. L., & Glutting, J. (1999). Incremental efficacy of Differential Ability Scales factor scores in predicting individual achievement criteria. School Psychology Quarterly, 14, 26-39.
