In this commentary, we reviewed two clinical validation studies on the Wechsler Scales conducted by Weiss and colleagues. These researchers used a rigorous within-battery model-fitting approach that demonstrated the factorial invariance of the Wechsler Intelligence Scale for Children–Fourth Edition (WISC-IV) and Wechsler Adult Intelligence Scale–Fourth Edition (WAIS-IV) across populations. Beyond the important finding of invariance across populations, however, these studies did not provide much additional clarification about exactly what is and what is not measured by the WISC-IV and WAIS-IV vis-à-vis an overarching empirically validated theory of the structure of cognitive abilities. To that end, we argued that a better understanding of the cognitive constructs (both broad and narrow) measured by the Wechsler scales or invariance across selection of variables is necessary and will require theory-driven joint or cross-battery confirmatory factor analysis. Recommendations for conducting this type of research were offered within the context of the Cattell-Horn-Carroll theory of cognitive abilities.
AndersonT.DixonW. E.Jr. (1995). Confirmatory factor analysis of the Wechsler Intelligence Scale for Children–revised with normal and psychiatric adolescents. Journal of Research on Adolescence, 5, 319-332.
2.
AtkinsonL.CyrJ. J. (1984). Factor analysis of the WAIS-R: Psychiatric and standardization samples. Journal of Consulting and Clinical Psychology, 52, 714-716.
3.
BensonN.HulacD. M.KranzlerJ. H. (2010). Independent examination of Wechsler Adult Intelligence Scale–Fourth Edition (WAIS-IV): What does the WIAS-IV measure?Psychological Assessment, 22, 121-130.
4.
BerningerV. W. (1990). Multiple orthographic codes: Key to alternative instructional methodologies for developing the orthographic-phonological connections underlying word identification. School Psychology Review, 19, 518-533.
5.
BlahaJ.WallbrownF. H. (1996). Hierarchical factor structure of the Wechsler Intelligence Scale-III. Psychological Assessment, 8, 214-218.
6.
BurtonD. B.SepehriA.HechtF.VandenBrockA.RyanJ. J.DrabmanR. (2001). Confirmatory factor analysis of the WISC-III in a clinical sample with cross-validation in the standardization sample. Child Neuropsychology, 7, 104-116.
7.
CarrollJ. B. (1993). Human cognitive abilities: A survey of factor-analytic studies. New York, NY: Cambridge University Press.
8.
CanivezG. L.WatkinsM. W. (2010). Investigation of the factor structure of the Wechsler Adult Intelligence Scale–Fourth Edition (WAIS-IV): Exploratory and higher order factor analyses. Psychological Assessment, 22, 827-836.
9.
ChenH.KeithT.ChenY.ChangB. (2009). What does the WISC-IV measure?: Validation of the scoring and CHC-based interpretive approaches. Journal of Research in Education Sciences, 54, 85-108.
10.
CohenJ. (1959). The factorial structure of the WISC at ages 7-6, 10-6, and 13-16. Journal of Consulting Psychology, 23, 285-299.
11.
DeckerS. L.HillS. K.DeanR. S. (2007). Evidence of the construct similarity in executive functions and fluid reasoning abilities. International Journal of Neuroscience, 117, 735-748.
12.
DelisD. C.KaplanE.KramerJ. H. (2001). Delis Kaplan Executive Function System. San Antonio, TX: The Psychological Corporation.
13.
DondersJ. (1993). Factor structure of the WISC-R in children with traumatic brain injury. Journal of Clinical Psychology, 49, 256-260.
14.
ElliottC. D. (2007). Differential Ability Scales–second edition. San Antonio, TX: Harcourt Assessment.
15.
FlanaganD. P.AlfonsoV. C.OrtizS. O.DyndaA. M. (2010). Best practices in cognitive assessment for school neuropsychological evaluations. In MillerD. C. (Ed.), Best practices in school neuropsychology: Guidelines for effective practice, assessment, and evidence-based intervention (pp. 101-140). New York, NY: John Wiley and Sons.
16.
FlanaganD. P.KaufmanA. S. (2009). Essentials of WISC-IV assessment (2nd ed.). New York, NY: John Wiley.
17.
FlanaganD. P.McGrewK. S. (1998). Interpreting intelligence tests from contemporary Gf-Gc theory: Joint confirmatory factor analyses of the WJ-R and KAIT in a non-White sample. Journal of School Psychology, 36, 151-182.
18.
FlanaganD. P.McGrewK. S.OrtizS. O. (2000). The Wechsler intelligence scales and Gf- Gc theory: A contemporary approach to interpretation. Needham Heights, MA: Allyn and Bacon.
19.
FlanaganD. P.OrtizS. O. (2001). Essentials of cross-battery assessment. New York, NY: Wiley.
20.
FlanaganD. P.OrtizS. O.AlfonsoV. C. (2007). Essentials of cross-battery assessment, second edition. Hoboken, NJ: Wiley.
21.
FlanaganD. P.OrtizS. O.AlfonsoV. C. (2013). Essentials of cross-battery assessment, Third Edition. Hoboken, NJ: Wiley.
22.
FlanaganD. P.OrtizS. O.AlfonsoV. C.MascoloJ. (2006). The achievement test desk reference (ATDR)—second edition: A guide to learning disability identification. New York, NY: Wiley.
23.
FletcherJ. M.LyonG. R.FuchsL. S.BarnesM. A. (2007). Learning disabilities: From identification to intervention. New York, NY: Guilford Press.
24.
FloydR. G.McGrewK. S.EvansJ. J. (2008). The relative contributions of the Cattell-Horn-Carroll cognitive abilities in explaining writing achievement during childhood and adolescence. Psychology in the Schools, 45, 132-144.
25.
FloydR. G.BergeronR.HamiltonG.ParraG. R.McGrewK. S. (2010). How do executive functions fit with the Cattell - Horn - Carroll model? Some evidence from a joint factor analysis of the Delis - Kaplan Executive Function System and the Woodcock - Johnson III Tests of Cognitive Abilities. Psychology in the Schools, 47, 721-738.
26.
GolayP.ReverteI.RossierJ.FavezN.LecerfT. (2012). Further insights on the French WISC-IV factor structure through Bayesian structural equation modeling. Psychological Assessment, 20, 1-13.
27.
HaleJ. B.FiorelloC. A. (2004). School neuropsychology: A practitioner’s handbook. New York, NY: Guilford Press.
28.
HammillD. D. (1998). Detroit Tests of Learning Aptitude - Fourth Edition. Austin, TX: PRO-ED.
29.
HoldnackJ. A.ZhouX.LarrabeeG. J.MillisS. R.SalthouseT. A. (2011). Confirmatory factor analysis of the WAIS-IV/WMS-IV. Assessment, 18, 178-191.
30.
HuntM. S. (2007). A joint confirmatory factor analysis of the Kaufman Assessment Battery for Children, Second Edition, and the Woodcock-Johnson Tests of Cognitive Abilities, Third Edition, with preschool children. Unpublished Dissertation, Ball State University, Muncie, Indiana.
31.
JuarezB.M. (2012). Effects of general and specific cognitive abilities on reading achievement in a referred sample (Dissertation abstracts). St. John’s University, New York.
32.
KaufmanA. S.KaufmanN. L. (1993). Kaufman Adolescent and Adult Intelligence Test. Circle Pines, MN: American Guidance Service.
33.
KaufmanA. S.KaufmanN. L. (2004). Kaufman Assessment Battery for Children–second edition. Circle Pines, MN: American Guidance Service.
34.
KeithT. Z. (1997). Using confirmatory factor analyis to aid in understanding the constructs measured by intelligence tests. In FlanaganD. P.GenshaftJ. L.HarrisonP. L. (Eds.), Contemporary intellectual assessment: Theories, tests, and issues (pp. 373-402). New York: Guilford.
35.
KeithT. Z. (2005). Using confirmatory factor analysis to aid in understanding the constructs measured by intelligence tests. In FlanaganD. P.HarrisonP. L. (Eds.), Contemporary intellectual assessment: Theories, tests, and issues (2nd ed., pp. 581-614). New York, NY: Guilford.
36.
KeithT. Z.FineJ. G.TaubG.ReynoldsM. R.KranzlerJ. H. (2006). Higher order, multisample, confirmatory factor analysis of the Wechsler Intelligence Scale for Children–Fourth Edition: What does it measure?School Psychology Review, 35, 108-127.
37.
KeithT. Z.KranzlerJ. H.FlanaganD. P. (2001). What does the cognitive assessment system (CAS) measure? Conjoint confirmatory factor analysis of the CAS and the Woodcock-Johnson tests of cognitive ability (3rd ed.). School Psychology Review, 30, 89-119.
38.
KeithT. Z.NovakC. G. (1987). Joint facture structure of the WISC-R and K-ABC for referred school children. Journal of Psychoeducational Assessment, 5, 370-386.
39.
KeithT. Z.ReynoldsM. R. (2010). CHC and cognitive abilities: What we’ve learned from 20 years of research. Psychology in the Schools, 47, 635-650.
40.
KeithT. Z.ReynoldsM. R. (2012). Using confirmatory factor analysis to aid in understanding the constructs measured by intelligence tests. In FlanaganD. P.HarrisonP. L. (Eds.), Contemporary intellectual assessment: Theories, tests, and issues (3rd ed.) (pp. 758-799). New York, NY: Guilford.
41.
KeithT. Z.WittaE. L. (1997). Hierarchical and cross-age confirmatory factor analysis of the WISC-III: What does it measure?School Psychology Quarterly, 12, 89-107.
42.
KorkmanM.KirkU.KempS. L. (2007). NEPSY II. San Antonio, TX: PsychCorp.
43.
LichtenbergerE. O.KaufmanA. S. (2013). Essentials of WAIS-IV assessment, second edition. Hoboken, NJ: Wiley.
44.
McArdleJ. J. (1994). Structural factor analysis experiments with incomplete data. Multivariate Behavioral Research, 29, 409-454.
45.
McCloskeyG.PerkinsL. A.Van DivnerB. (2009). Assessment and intervention for executive function difficulties. New York, NY: Routledge.
46.
McCloskeyG.WhitakerJ.MurphyR.RogersJ. (2012) Intellectual, cognitive, and neuro-psychological assessment in three-tier service delivery system in schools. In FlanaganD. P.HarrisonP. L. (Eds.), Contemporary intellectual assessment: Theories, tests, and issues (3rd ed., pp. 852-882). New York, NY: Guilford Press.
47.
McGheeR. (1993). Fluid and crystallized intelligence: Confirmatory factor analysis of the Differential Abilities Scale, Detroit Tests of Learning Aptitudes 3, and Woodcock - Johnson Psycho-Educational battery - Revised. Journal of Psychoeducational Assessment [Monograph Series: Woodcock Johnson PsychoEducational Bettery - Revised.], 20-38.
48.
McGrewK. S. (1993). The relationship between the WJ-R Gf-Gc cognitive clusters and reading achievement across the lifespan. Journal of Psychoeducational Assessment, Monograph Series: WJ-R Monograph, 39-53.
49.
McGrewK. S. (1997). Analysis of the major intelligence batteries according to a proposed comprehensive Gf-Gc framework. In FlanaganD. P.GenshaftJ. L.HarrisonP. L. (Eds.), Contemporary intellectual assessment: Theories, tests, and issues (pp. 151-179). New York: Guilford.
50.
McGrewK. S.FlanaganD. P. (1998). The intelligence test desk reference (ITDR): Gf-Gc cross-battery assessment. Boston, MA: Allyn & Bacon.
51.
McGrewK. S.FlanaganD. P.KeithT. Z.VanderwoodM. (1997). Beyond g: The impact of Gf-Gc specific cognitive abilities research on the future use and interpretation of intelligence tests in the schools. School Psychology Review, 26, 177-189.
52.
McGrewK. S.WendlingB. J. (2010). Cattell-Horn-Carroll cognitive-achievement relations: What we have learned from the past 20 years of research. Psychology in the Schools, 47, 651-675.
NaglieriJ. A.WechslerD. (2009). Wechsler Nonverbal Scale of Ability. San Antonio, TX: Pearson.
58.
NesselroadeJ. R.ThompsonW. W. (1995). Selection and related threats to group comparisons: An example comparing factorial structures of higher and lower ability groups. Psychological Bulletin, 117, 271-284.
59.
NiilekselaC. R.ReynoldsM. R.KaufmanA. S. (2012). An alternative Cattell-Horn-Carroll (CHC) factor structure of the WAIS-IV: Age invariance of an alternative model for ages 70-90. Manuscript submitted for publication.
60.
O’GradyK. E. (1983). A confirmatory maximum likelihood factor analysis of the WAIS-R. Journal of Consulting and Clinical Psychology, 51, 826-831.
61.
PearsonN. C. S. (2009). Wechsler Individual Achievement Test–Third Edition. San Antonio, TX: Author.
62.
PearsonN. C. S. (2009). Wechsler Memory Scale–Fourth Edition. San Antonio, TX: Author.
63.
PhelpsL.McGrewK. S.KnopikS. N.FordL. (2005). The general (g), broad, and narrow CHC stratum characteristics of the WJ III and WISC-IV tests: A confirmatory cross-battery investigation. School Psychology Quarterly, 20, 66-88.
64.
ReynoldsM. R.KeithT. Z.FlanaganD. P.AlfonsoV. C. (in press). A cross-battery, reference variable, confirmatory factor analytic investigation of the CHC taxonomy. Journal of School Psychology.
SandersS.McIntoshD. E.DunhamM.RothlisbergB. A.FinchH. (2007). Joint confirmatory factor analysis of the Differential Ability Scales and the Woodcock-Johnson Tests of Cognitive Abilities - Third Edition. Psychology in the Schools, 44, 119-138.
67.
SattlerJ. (2008). Assessment of children: Cognitive foundations (5th ed.). San Diego, CA: Author.
68.
SilversteinA. B. (1982). Factor structure of the Wechsler Adult Intelligence Scale–revised. Journal of Consulting and Clinical Psychology, 50, 661-664.
69.
StoneB. J. (1992). Joint confirmatory analyses of the DAS and WISC-R. Journal of School Psychology, 30, 185-195.
70.
TaubG. E.McGrewK. S.WittaE. L. (2004). A confirmatory analysis of the factor structure and cross-age invariance of the Wechsler Adult Intelligence Scale–Third Edition. Psychological Assessment, 16, 85-89.
71.
ThurstoneL. L. (1947). Multiple-factor analysis: A development and expansion of the vectors of the mind. Chicago, IL: University of Chicago Press.
72.
TupaD. J.O’Dougherty WrightM.FristadM. A. (1997). Confirmatory factor analysis of the WISC-III with child psychiatric inpatients. Psychological Assessment, 9, 302-306.
73.
TusingM. E.FordL. (2004). Examining preschool cognitive abilities using a CHC framework. International Journal of Testing, 4, 91-114.
74.
ValenciaR. R.RankinR. J.OaklandT. (1997). WISC-R factor structures among White, Mexican American, and African American children: A research note. Psychology in the Schools, 34, 11-16.
75.
VanderwoodM. L.McGrewK. S.FlanaganD. P.KiethT. Z. (2002). The contribution of general and specific cognitive abilities to reading achievement. Le arning and Individual Differences, 13, 159-188.
76.
WallerN. G.WaldmanI. D. (1990). A reexamination of the WAIS-R factor structure. Psychological Assessment: A Journal of Consulting and Clinical Psychology, 2, 139-144.
77.
WardL. C.RyanJ. J.AxelrodB. N. (2000). Confirmatory factor analyses of the WAIS-III standardization data. Psychological Assessment, 12, 341-345.
78.
WardL. C.BergmanM. A.HebertK. R. (2012). WAIS-IV subtest covariance structure: Conceptual and statistical considerations. Psychological Assessment, 24, 328-340.
79.
WatkinsM. W. (2006). Orthogonal higher order structure of the Wechsler Intelligence Scale for children–Fourth Edition. Psychological Assessment, 18, 123-125.
80.
WatkinsM. W. (2010). Structure of the Wechsler Intelligence Scale for children–Fourth Edition among a national sample of referred students. Psychological Assessment, 22, 782-787.
81.
WatkinsM. W.WilsonS. M.KotzK. M.CarboneM. C.BabulaT. (2006). Factor structure of the Wechsler Intelligence Scale for children–Fourth Edition among referred students. Educational and Psychological Measurement, 66, 975-983.
82.
WechslerD. (1981). Wechsler Adult Intelligence Scale–revised. San Antontio, TX: The Psychological Corporation.
83.
WechslerD. (1991). Wechsler Intelligence Scale for Children–Third Edition. San Antonio, TX: The Psychological Corporation.
84.
WechslerD. (1997). Wechsler Adult Intelligence Scale–Third Edition. San Antonio, TX: The Psychological Corporation.
85.
WechslerD. (2002). Wechsler Preschool and Primary Scale of Intelligence–Third Edition. San Antonio, TX: The Psychological Corporation.
86.
WechslerD. (2003). Wechsler Intelligence Scale for Children–Fourth Edition. San Antonio, TX: The Psychological Corporation.
WechslerD. (2003). Wechsler Intelligence Scale for Children–fourth edition technical and interpretive manual. San Antonio, TX: Psychological Corporation.
89.
WechslerD. (2008). Wechsler Adult Intelligence Scale–fourth edition technical and interpretive manual. San Antonio, TX: Pearson.
90.
WechslerD.NaglieriJ. A. (2006). Wechsler Nonverbal Scale of Ability. San Antonio, TX: Harcourt Assessment.
91.
WeissL. G.KeithT.ZhuJ.ChenH. (2013a). WAIS-IV and Clinical Validation of the Four- and Five-Factor Interpretative Approaches. Journal of Psychoeducational Assessment, 31, 94-113.
92.
WeissL. G.KeithT.ZhuJ.ChenH. (2013b). WISC-IV and Clinical Validation of the Four- and Five-Factor Interpretative Approaches. Journal of Psychoeducational Assessment, 31, 114-131.
WoodcockR. W. (1990). Theoretical Foundations of the WJ-R Measures of Cognitive Ability. Journal of Psychoeducational Assessment, 8, 231-258.
95.
WoodcockR. W.McGrewK. S.MatherN. (2001, 2007). Woodcock-Johnson III normative update tests of achievement. Rolling Meadows, IL: Riverside Publishing.
96.
WoodcockR. W.McGrewK. S.MatherN. (2001, 2007). Woodcock-Johnson III Normative Updatetests of Cognitive Abilities. Itasca, IL: Riverside.
97.
WoodcockR. W. (2012, September). Cognitive/Educational Assessment: Past, Present, Future. Paper presented at the Richard Woodcock Institute for Advancement of Contemporary Cognitive Assessment, Tufts University, Medford, MA.
