Weiss, Keith, Zhu, and Chen (2013a) and Weiss, Keith, Zhu, and Chen (2013b), this issue, report examinations of the factor structure of the Wechsler Adult Intelligence Scale–Fourth Edition (WAIS-IV) and Wechsler Intelligence Scale for Children–Fourth Edition (WISC-IV), respectively; comparing Wechsler Hierarchical Model (W-HM) and Cattell–Horn–Carroll Hierarchical Model (CHC-HM), subtest cross-loadings, and factorial invariance between clinical and normative groups from the respective standardizations. Both studies suffer from a number of theoretical, methodological, and practical problems that significantly limit conclusions and recommendations for practitioner interpretations of these instruments. Additional analyses and research are required to better inform practitioners for WAIS-IV and WISC-IV use.
BensonN.HulacD. M.KranzlerJ. H. (2010). Independent examination of the Wechsler Adult Intelligence Scale–Fourth Edition (WAIS-IV): What does the WAIS-IV measure?Psychological Assessment, 22, 121-130.
2.
BodinD.PardiniD. A.BurnsT. G.StevensA. B. (2009). Higher order factor structure of the WISC-IV in a clinical neuropsychological sample. Child Neuropsychology, 15, 417-424.
3.
CanivezG. L. (2013). Psychometric versus actuarial interpretation of intelligence and related aptitude batteries. In SaklofskeD. H.SchweanV. L.ReynoldsC. R. (Eds.), The Oxford Handbook of Child Psychological Assessments (pp. 84–112). New York: Oxford University Press.
4.
CanivezG. L.WatkinsM. W. (2010a). Investigation of the factor structure of the Wechsler Adult Intelligence Scale–Fourth Edition (WAIS-IV): Exploratory and higher order factor analyses. Psychological Assessment, 22, 827-836.
5.
CanivezG. L.WatkinsM. W. (2010b). Exploratory and higher-order factor analyses of the Wechsler Adult Intelligence Scale–Fourth Edition (WAIS-IV) adolescent subsample. School Psychology Quarterly, 25, 223-235.
6.
ChenF. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling, 14, 464-504.
7.
ChenH. -Y.KeithT. Z.ChenY. -H.ChangB. -S. (2009). What does the WISC-IV measure? Validation of the scoring and CHC-based interpretive approaches. Journal of Research in Education Sciences, 54, 85-108.
8.
ChenH.KeithT. Z.WeissL.ZhuJ.LiY. (2010, November). Testing for multigroup invariance of second-order WISC-IV structure across China, Hong Kong, Macau, and Taiwan. Personality and Individual Differences, 49, 677-682. doi:10.1016/j.paid.2010.06.004
9.
ChenH.ZhuJ. (2012). Measurement invariance of WISC-IV across normative and clinical samples. Personality and Individual Differences, 52, 161-166.
10.
CheungG. W.RensvoldR. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9, 233-255.
11.
CarrettaT. R.ReeJ. J. (2001). Pitfalls of ability research. International Journal of Selection and Assessment, 9, 325-335.
12.
CarrollJ. B. (1993). Human cognitive abilities abilities. Cambridge, UK: Cambridge University Press.
13.
CarrollJ. B. (1995). On methodology in the study of cognitive abilities. Multivariate Behavioral Research, 30, 429-452.
14.
CarrollJ. B. (1997a). Theoretical and technical issues in identifying a factor of general intelligence. In DevlinB.FienbergS. E.ResnickD. P.RoederK. (Eds.), Intelligence, genes, and success: Scientists respond to the bell curve (pp. 125-156). New York, NY: Springer-Verlag.
15.
CarrollJ. B. (1997b). The three-stratum theory of cognitive abilities. In FlanaganD. P.GenshaftJ. L.HarrisonP. L. (Eds.), Contemporary intellectual assessment: Theories, tests, and issues (pp. 183-208). New York, NY: Guilford.
16.
CarrollJ. B. (2003). The higher-stratum structure of cognitive abilities: Current evidence supports g and about ten broad factors. In NyborgH. (Ed.), The scientific study of general intelligence: Tribute to Arthur R. Jensen (pp. 5-21). New York, NY: Pergamon Press.
17.
DanielM. H. (2007). “Scatter” and the construct validity of FSIQ: Comment on Fiorello et al. (2007). Applied Neuropsychology, 14, 291-295.
18.
FrebergM. E.VandiverB. J.WatkinsM. W.CanivezG. L. (2008). Significant factor score variability and the validity of the WISC–III Full Scale IQ in predicting later academic achievement. Applied Neuropsychology, 15, 131-139.
19.
GignacG. E. (2005). Revisiting the factor structure of the WAIS-R: Insights through nested factor modeling. Assessment, 12, 320-329.
20.
GignacG. E. (2006). The WAIS-III as a nested factors model: A useful alternative to the more conventional oblique and higher-order models. Journal of Individual Differences, 27, 73-86.
21.
GignacG. E. (2008). Higher-order models versus direct hierarchical models: g as superordinate or breadth factor?Psychology Science Quarterly, 50, 21-43.
22.
GluttingJ. J.WatkinsM. W.KonoldT. R.McDermottP. A. (2006). Distinctions without a difference: The utility of observed versus latent factors from the WISC-IV in estimating reading and math achievement on the WIAT-II. Journal of Special Education, 40, 103-114.
23.
GolayP.ReverteI.RossierJ.FavezN.LecerfT. (2012, November12). Further insights on the French WISC–IV factor structure through Bayesian structural equation modeling (BSEM). Psychological Assessment. Advance online publication. doi:10.1037/a0030676
24.
GorsuchR. L. (1983). Factor analysis (2nd ed.). Hillsdale, NJ: Erlbaum.
25.
GorsuchR. L. (1988). Exploratory factor analysis. In NesselroadeJ. R.CattellR. B. (Eds.), Handbook of multivariate experimental psychology (2nd ed., pp. 231-258). New York, NY: Plenum.
26.
GustafssonJ. -E.SnowR. E. (1997). Ability profiles. In DillonR. F. (Ed.), Handbook on testing (pp. 107-135). Westport, CT: Greenwood Press.
27.
GustafssonJ.BalkeG. (1993). General and specific abilities as predictors of school achievement. Multivariate Behavioral Research, 28, 407-434.
28.
HolzingerK. J.SwinefordF. (1937). The bifactor method. Psychometrika, 46(1), 41-45.
29.
HornJ. L. (1988). Thinking about human abilities. In NesselroadeR.CattellR. B. (Eds.), Handbook of multivariate experimental psychology (2nd ed., pp. 645–685). New York: Plenum Press.
30.
HornJ. L.CattellR. B. (1966). Refinement and test of the theory of fluid and crystallized general intelligences. Journal of Educational Psychology, 57, 253-270.
31.
HuL.-T.BentlerP. M. (1998). Fit indices in covariance structure modeling: Sensitivity to underparameterized model misspecification. Psychological Methods, 3, 424-453.
32.
HuL.BentlerP. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1-55.
33.
KaufmanA. S. (1994). Intelligent testing with the WISC-III. New York, NY: Wiley.
34.
KeithT. Z. (1997). What does the WISC-III measure? A reply to Carroll and Kranzler. School Psychology Quarterly, 12, 117-118.
35.
KeithT. Z. (2005). Using confirmatory factor analysis to aid in understanding the constructs measured by intelligence tests. In FlanaganD. P.HarrisonP. L. (Eds.), Contemporary intellectual assessment: Theories, tests, and issues (2nd ed., pp. 581-614). New York, NY: Guilford.
36.
KeithT. Z.FineJ. G.TaubG. E.ReynoldsM. R.KranzlerJ. H. (2006). Higher-order, multi-sample, confirmatory factor analysis of the Wechsler Intelligence Scale for Children–Fourth Edition: What does it measure. School Psychology Review, 35(1), 108-127.
37.
KeithT. Z.WittaE. L. (1997). Hierarchical and cross-age confirmatory factor analysis of the WISC-III: What does it measure?School Psychology Quarterly, 12, 89-107.
38.
KlineP. (1994). An easy guide to factor analysis. London, UK: Routledge.
39.
KlineR. B. (2005). Principles and practice of structural equation modeling (2nd ed.). New York, NY: Guilford.
40.
KlineR. B. (2010). Principles and practice of structural equation modeling (3rd ed.). New York, NY: Guilford.
41.
KranzlerJ. H. (1997). What does the WISC-III measure? Comments on the relationship between intelligence, working memory capacity, and information processing speed and efficiency. School Psychology Quarterly, 12, 110-116.
42.
LichtenbergerE. O.KaufmanA. S. (2009). Essentials of WAIS-IV assessment. New York, NY: Wiley.
43.
LubinskiD.DawisR. V. (1992). Aptitudes, skills, and proficiencies. In DunnetteM. D.HoughL. M. (Eds.), Handbook of industrial and organizational psychology (2nd ed., Vol. 3, pp. 1-59). Palo Alto, CA: Consulting Psychology Press.
44.
MacCallumR. C.RoznowskiM.NecowitzL. B. (1992). Model modification in covariance structure analysis: The problem of capitalization on chance. Psychological Bulletin, 111, 490-504.
45.
MarshH. W.HauK. -T.WenZ. (2004). In search of golden rules: Comment on hypothesis-testing approaches to setting cutoff values for fit indexes and dangers in overgeneralizing Hu and Bentler’s (1999) findings. Structural Equation Modeling, 11, 320-341.
46.
McClainA. L. (1996). Hierarchical analytic methods that yield different perspectives on dynamics: Aids to interpretation. Advances in Social Science Methodology, 4, 229-240.
47.
McGrewK. S. (1997). Analysis of the major intelligence batteries according to a proposed comprehensive Gf–Gc framework. In FlanaganD. P.GenshaftJ. L.HarrisonP. L. (Eds.), Contemporary intellectual assessment: Theories, tests, and issues (pp. 151-179). New York, NY: Guilford.
48.
McGrewK. S. (2005). The Cattell–Horn–Carroll theory of cognitive abilities: Past, present, and future. In FlanaganD. P.HarrisonP. L. (Eds.), Contemporary intellectual assessment: Theories, tests, and issues (2nd ed., pp. 136-181). New York, NY: Guilford.
49.
OhH. J.GluttingJ. J.WatkinsM. W.YoungstromE. A.McDermottP. A. (2004). Correct interpretation of latent versus observed abilities: Implications from structural equation modeling applied to the WISC-III and WIAT linking sample. Journal of Special Education, 38, 159-173.
50.
ReeM. J.CarrettaT. R.GreenM. T. (2003). The ubiquitous role of g in training. InNyborgH. (Ed.), The scientific study of general intelligence: Tribute to Arthur R. Jensen (pp. 262-274). New York, NY: Pergamon Press.
51.
SchmidJ.LeimanJ. M. (1957). The development of hierarchical factor solutions. Psychometrika, 22, 53-61.
52.
SchreiberJ. B.StageF. K.KingJ.NoraA.BarlowE. A. (2006). Reporting structural equation modeling and confirmatory factor analysis results: A review. Journal of Educational Research, 99, 323-337.
53.
ThompsonB. (2004). Exploratory and confirmatory factor analysis: Understanding concepts and applications. Washington, DC: American Psychological Association.
54.
UllmanJ. B. (2001). Structural equation modeling. In TabachnickB. G.FidellL. S. (Eds.), Using multivariate statistics (4th ed.). Needham Heights, MA: Allyn & Bacon.
55.
WardL. C.BergmanM. A.HebertK. R. (2012). WAIS-IV subtest covariance structure: Conceptual and statistical considerations. Psychological Assessment, 24, 328-340.
56.
WatkinsM. W. (2003). IQ subtest analysis: Clinical acumen or clinical illusion?The Scientific Review of Mental Health Practice, 2, 118-141.
57.
WatkinsM. W. (2006). Orthogonal higher order structure of the Wechsler Intelligence Scale for Children–Fourth Edition. Psychological Assessment, 18, 123-125.
58.
WatkinsM. W. (2010). Structure of the Wechsler Intelligence Scale for Children–Fourth Edition among a national sample of referred students. Psychological Assessment, 22, 782-787.
59.
WatkinsM. W.GluttingJ. J.LeiP. -W. (2007). Validity of the full-scale IQ when there is significant variability among WISC-III and WISC-IV factor scores. Applied Neuropsychology, 14, 13-20.
60.
WatkinsM. W.WilsonS. M.KotzK. M.CarboneM. C.BabulaT. (2006). Factor structure of the Wechsler Intelligence Scale for Children–Fourth Edition among referred students. Educational and Psychological Measurement, 66, 975-983.
61.
WechslerD. (1939). The measurement of adult intelligence. Baltimore, MD: Williams & Wilkins.
WechslerD. (2008b). Wechsler Adult Intelligence Scale–Fourth Edition Technical and Interpretive Manual. San Antonio, TX: Pearson.
68.
WeissL. G.KeithT. Z.ZhuJ.ChenH. (2013a). WAIS-IV and clinical validation of the four- and five-factor interpretative approaches. Journal of Psycheducational Assessment, 31, 94-113.
69.
WeissL. G.KeithT. Z.ZhuJ.ChenH. (2013b). WISC-IV and clinical validation of the four- and five-factor interpretative approaches. Journal of Psycheducational Assessment, 31, 114-131.
