The Woodcock–Johnson-III cognitive in the adult time period (age 20 to 90 plus) was analyzed using exploratory bifactor analysis via the Schmid–Leiman orthogonalization procedure. The results of this study suggested possible overfactoring, a different factor structure from that posited in the Technical Manual and a lack of invariance across both age ranges under study. Even when forcing the seven-factor fit, the structure was problematic. The results from the 20 to 39 age group displayed patterns of convergence with and divergence from the Technical Manual’s structure. The results from the 40 and above age group were generally consistent with the Technical Manual’s structure except for retrieval fluency. This study is consistent with the body of exploratory factor analysis structural validity evidence suggesting that contemporary tests of cognitive ability, particularly those based on Cattell–Horn–Carroll theory, are overfactored and lack alignment with their respective Technical Manual’s presented structure.
BartlettM. S. (1950). Tests of significance in factor analysis. British Journal of Psychology, 3, 71-85.
2.
BartlettM. S. (1954). A further note on the multiplying factors for various X2 approximations in factor analysis. Journal of the Royal Statistical Society, 16, 296-298.
3.
CanivezG. L. (2008). Orthogonal higher-order factor structure of the Stanford-Binet Intelligence Scales for children and adolescents. School Psychology Quarterly, 23, 533-541.
4.
CanivezG. L. (2011). Hierarchical factor structure of the Cognitive Assessment System: Variance partitions from the Schmid–Leiman (1957) procedure. School Psychology Quarterly, 26, 305-317. doi:10.1037/a0025973
5.
CanivezG. L. (2013). Psychometric versus actuarial interpretation of intelligence and related aptitude batteries. In SaklofskeD. H.ReynoldsC. R.SchweanV. L. (Eds.), The Oxford handbook of child psychological assessment (pp. 84-112). New York, NY: Oxford University Press.
6.
CanivezG. L.WatkinsM. W. (2010a). Exploratory and higher-order factor analyses of the Wechsler Adult Intelligence Scale-Fourth edition (WAIS-IV) adolescent subsample. School Psychology Quarterly, 25, 223-235. doi:10.1037/a0022046
7.
CanivezG. L.WatkinsM. W. (2010b). Investigation of the factor structure of the Wechsler Adult Intelligence Scale-Fourth edition (WAIS-IV): Exploratory and higher-order factor analyses. Psychological Assessment, 22, 827-836. doi:10.1037/a0020429
8.
CarrollJ. B. (1993). Human cognitive abilities. Cambridge, UK: Cambridge University Press.
9.
CattellR. B. (1966). The scree test for the number of factors. Multivariate Behavioral Research, 1, 245-276.
10.
CudeckR. (2000). Exploratory factor analysis. In TinsleyH. E. A.BrownS. D. (Eds.), Handbook of multivariate statistics and mathematical modeling (pp. 265-296). New York, NY: Academic Press.
11.
DiStefanoC.DombrowskiS. C. (2006). Investigating the theoretical structure of the Stanford Binet-Fifth edition. Journal of Psychoeducational Assessment, 24, 123-136. doi:10.1177/0734282905285244
12.
DombrowskiS. C. (2013). Investigating the Structure of the WJ-III Cognitive at School Age. School Psychology Quarterly, 28, 154-169. doi:10.1037/spq0000010
13.
DombrowskiS. C.WatkinsM. W. (2013). Exploratory and higher-order factor analysis of the WJ-III full test battery: A school age analysis. Psychological Assessment, 25, 442-455. doi:10.1037/a0031335
14.
DombrowskiS. C.WatkinsM. W.BroganM. J. (2009). An exploratory investigation of the factor structure of the Reynolds Intellectual Assessment Scales (RIAS). Journal of Psychoeducational Assessment, 27, 494-507. doi:10.1177/0734282909333179
15.
FabrigarL. R.WegenerD. T.MacCallumR. C.StrahanE. J. (1999). Evaluating the use of exploratory factor analysis in psychological research. Psychological Methods, 4, 272-299. doi:10.1037/1082-989X.4.3.272
16.
FloydR. G.McGrewK. S.BarryA.RafaelF.RogersJ. (2009). General and specific effects on Cattell-Horn-Carroll broad ability composites: Analysis of the Woodcock–Johnson-III Normative Update Cattell–Horn–Carroll factor clusters across development. School Psychology Review, 38, 249-265.
17.
FrazierT. W.YoungstromE. A. (2007). Historical increase in the number of factors measured by commercial tests of cognitive ability: Are we overfactoring?Intelligence, 35, 169-182. doi:10.1016/j.intell.2006.07.002
18.
GluttingJ. J.WatkinsM. W.KonoldT. R.McDermottP. A. (2006). Distinctions without a difference: The utility of observed versus latent factors from the WISC-IV in estimating reading and math achievement on the WIAT-II. Journal of Special Education, 40, 103-114.
19.
GolayP.LecerfT. (2011). Orthogonal higher-order structure and confirmatory factor analysis of the French Wechsler Adult Intelligence Scale (WAIS-III). Psychological Assessment, 23, 143-152. doi:10.1037/a0021230
20.
GorsuchR. L. (1983). Factor analysis (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum.
21.
GreenwaldA. G.PratkanisA. R.LeippeM. R.BaumgardnerM. H. (1986). Under what conditions does theory obstruct research progress?Psychological Review, 93, 216-229.
22.
GustafssonJ. E.SnowR. E. (1997). Ability profiles. In DillonR. F. (Ed.), Handbook on testing (pp. 107-135). Westport, CT: Greenwood Press.
23.
HornJ. L. (1965). A rationale and test for the number of factors in factor analysis. Psychometrika, 30, 179-185. doi:10.1007/BF02289447
24.
HornJ. L.McArdleJ. J.MasonR. (1983). When is invariance not invariant: A practical Scientist’s look at the ethereal concept of factor invariance. The Southern Psychologist, 1, 179-188.
25.
KaiserH. F. (1974). An index of factorial simplicity. Psychometrika, 39, 31-36.
26.
KeithT. Z.ReynoldsM. (2010). Cattell-Horn-Carroll abilities and cognitive tests: What we’ve learned from 20 years of research. Psychology in the Schools, 47, 635-650. doi:10.1002/pits.20496
27.
KlineP. (1994). An easy guide to factor analysis. New York, NY: Routledge.
28.
LabouvieE.RuetschC. (1995). Testing for equivalence of measurement scales: Simple structure and metric invariance reconsidered. Multivariate Behavioral Research, 30, 63-76.
29.
McClainA. L. (1996). Hierarchical analytic methods that yield different perspectives on dynamics: Aids to interpretation. Advances in Social Science Methodology, 4, 229-240.
30.
McGrewK. S.WoodcockR. W. (2001). Technical manual: Woodcock-Johnson III. Itasca, IL: Riverside Publishing.
31.
NelsonJ. M.CanivezG. L. (2012). Examination of the structural, convergent, and incremental validity of the Reynolds Intellectual Assessment Scales (RIAS) with a clinical sample. Psychological Assessment, 24, 129-140. doi:10.1037/a0024878
32.
NiilekselaC. R.ReynoldsM. R.KaufmanA. S. (2012). An alternative Cattell–Horn–Carroll (CHC)factor structure of the WAIS-IV: Age invariance of an alternative model for ages70-90. Psychological Assessment. Advance online publication. doi:10.1037/a0031175
33.
OhH. J.GluttingJ. J.WatkinsM. W.YoungstromE. A.McDermottP. A. (2004). Correct interpretation of latent versus observed abilities: Implications from structural equation modeling applied to the WISC-III and WIAT linking sample. Journal of Special Education, 38, 159-173.
34.
ParkinJ. R.BeaujeanA. A. (2012). The effects of Wechsler Intelligence Scale for Children—Fourth Edition cognitive abilities on math achievement. Journal of School Psychology, 50, 113-128. doi:10.1016/j.jsp.2011.08.003
35.
ReiseS. P. (2012). The rediscovery of bifactor measurement models. Multivariate Behavioral Research, 47, 667-696. doi:10.1080/00273171.2012.715555
36.
ReiseS. P.WidamanK. F.PughR. H. (1993). Confirmatory factor analysis and item response theory: Two approaches for exploring measurement invariance. Psychological Bulletin, 114, 552-566.
37.
SchmidJ.LeimanJ. M. (1957). The development of hierarchical factor solutions. Psychometrika, 22, 53-61. doi:10.1007/BF02289209
38.
TabachnickB. G.FidellL. S. (2007). Using multivariate statistics (5th ed.). Boston, MA: Pearson Education.
39.
TaubG. E.McGrewK. S. (2004). A confirmatory factor analysis of Cattell-Horn-Carroll theory and cross-age invariance of the Woodcock-Johnson Tests of Cognitive Abilities III. School Psychology Quarterly, 19, 72-87.
40.
ThompsonB. (2004). Exploratory and confirmatory factor analysis: Understanding concepts and applications. Washington, DC: American Psychological Association.
41.
VelicerW. F. (1976). Determining the number of components form the matrix of partial correlations. Psychometrika, 31, 321-327. doi:10.1007/BF02293557
42.
WatkinsM. W. (2010). Structure of the Wechsler Intelligence Scale for Children—Fourth edition among a national sample of referred students. Psychological Assessment, 22, 782-787. doi:10.1037/a0020043
43.
WoodcockR. W.McGrewK. S.MatherN. (2001). Woodcock-Johnson III Tests of Cognitive Abilities. Itasca, IL: Riverside Publishing.
