The present study examined the structure of the Comprehensive Test of Nonverbal Intelligence–Second Edition (CTONI-2) normative sample using exploratory factor analysis, multiple factor extraction criteria, and higher-order exploratory factor analytic techniques that were not reported in the in the CTONI-2 Examiner’s Manual. Results indicated that retention of the hypothesized CTONI-2 measurement model resulted in several theoretically inconsistent factor loadings, low factor loadings, and the retention of impermissible factors (e.g., factors with no salient loadings). Hierarchical exploratory analyses with the Schmid and Leiman procedure found that the second-order g factor accounted for large portions of total and common variance, in contrast to the two first-order factors that accounted for small portions of dimensional variance. Results suggest that the CTONI-2 provides a strong measure of general intelligence and clinical interpretation should be limited to that level of the measurement instrument.
American Educational Research Association, American Psychological Association, & National Council on Measurement on Education. (2014). Standards for educational and psychological testing. Washington, DC: American Educational Research Association.
2.
BeaujeanA. A.FirminM. W.AttaiS.JohnsonC. B.FirminR. L.MenaK. E. (2011). Using personality and cognitive ability to predict academic achievement in a young adult sample. Personality and Individual Differences, 51, 709-714. doi:10.1016/j.paid.2011.06.023
3.
BentlerP. M.KanoY. (1990). On the equivalence of factors and components. Multivariate Behavioral Research, 25, 67-74. doi:10.1207/s15327906mbr2501_8
4.
CanivezG. L. (2011). Hierarchical factor structure of the cognitive assessment system: Variance partitions from the Schmid-Leiman (1957) procedure. School Psychology Quarterly, 26, 305-317. doi:10.1037/a0025973
5.
CanivezG. L. (2013). Psychometric versus actuarial interpretation of intelligence and related aptitude batteries. In SaklofskeD. H.ReynoldsC. R.SchweanV. L. (Eds.), The oxford handbook of child psychological assessment (pp. 84-112). New York, NY: Oxford University Press.
6.
CarrollJ. B. (1993). Human cognitive abilities: A survey of factor-analytic studies. New York, NY: Cambridge University Press.
7.
CarrollJ. B. (1995). On methodology in the study of cognitive abilities. Multivariate Behavioral Research, 30, 429-452. doi:10.1207/s15327906mbr3003_6
8.
CattellR. B. (1966). The scree test for the number of factors. Multivariate Behavioral Research, 1, 245-276. doi:10.1207/s15327906mbr0102_10
9.
ChenF. F.HayesA.CarverC. S.LaurenceauJ.-P.ZhangZ. (2012). Modeling general and specific variance in multifaceted constructs: A comparison of the bifactor model to other approaches. Journal of Personality, 80, 219-251. doi:10.1111/j.1467–6494.2011.00739.x
CostelloA. B.OsborneJ. W. (2005). Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Practical Assessment, Research & Evaluation, 10, 1-9. Retrieved from http://pareonline.net/pdf/v10n7.pdf
12.
CronbachL. J.MeehlP. E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52, 281-302. doi:10.1037/h0040957
13.
DelanE.KayaF.RitterN. L. (2012). Test review: Comprehensive Test of Nonverbal Intelligence-Second Edition (CTONI-2). Journal of Psychoeducational Assessment, 30, 209-213. doi:10.1177/0734282911415614
14.
DeThorneL. S.SchaeferB. A. (2004). A guide to child nonverbal IQ measures. American Journal of Speech-Language Pathology, 13, 275-290. doi:10.1044/1058-0360(2004/029)
15.
DombrowskiS. C.WatkinsM. W.BroganM. J. (2009). An exploratory investigation of the factor structure of the Reynolds Intellectual Assessment Scales (RIAS). Journal of Psychoeducational Assessment, 27, 497-507. doi:10.1177/0734282909333179
16.
FabrigarL. R.WegenerD. T. (2012). Exploratory factor analysis. New York, NY: Oxford University Press.
17.
FabrigarL. R.WegenerD. T.MacCallumR. C.StrahanE. J. (1999). Evaluating the use of exploratory factor analysis in psychological research. Psychological Methods, 4, 272-299. doi:10.1037/1082-989X.4.3.272
18.
FrazierT. W.YoungstromE. A. (2007). Historical increase in the number of factors measured by commercial tests of cognitive ability: Are we overfactoring?Intelligence, 35, 169-182. doi:10.1016/j.intell.2006.07.002
19.
GluttingJ. J.WatkinsM. W.KonoldT. R.McDermottP. A. (2006). Distinctions without a difference: The utility of observed versus latent factors from the WISC-IV in estimating reading and math achievement on the WIAT-II. Journal of Special Education, 40, 103-114. doi:10.1177/00224669060400020101
20.
GolayP.ReverteI.RossierJ.FavezN.LecerfT. (2013). Further insights on the French WISC-IV factor structure through Bayesian structural equation modeling. Psychological Assessment, 25, 496-508. doi:10.1037/a0030676
21.
GorsuchR. L. (1983). Factor analysis (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum.
22.
GorsuchR. L. (1997). Exploratory factor analysis: Its role in item analysis. Journal of Personality Assessment, 68, 532-560. doi:10.1207/s15327752jpa6803_5
23.
GorsuchR. L. (2003). Factor analysis. In SchinkaJ. A.VelicerF. F. (Eds.), Handbook of psychology: Vol. 2. Research methods in psychology (pp. 143-164). Hoboken, NJ: John Wiley.
24.
GuttmanL. (1954). Some necessary and sufficient conditions for common factor analysis. Psychometrika, 19, 149-161. doi:10.1007/BF02289162
25.
HammillD. D.PearsonN. A. (2009). Comprehensive Test of Nonverbal Intelligence-Second Edition. In NaglieriJ. A.GoldsteinS. (Eds.), Practitioner’s guide to assessing intelligence and achievement (pp. 233-264). Hoboken, NJ: John Wiley.
26.
HammillD. D.PearsonN. A.WiederholtJ. L. (1997). Comprehensive Test of Nonverbal Intelligence. Austin, TX: Pro-Ed.
27.
HammillD. D.PearsonN. A.WiederholtJ. L. (2009a). Comprehensive Test of Nonverbal Intelligence (2nd ed.). Austin, TX: Pro-Ed.
28.
HammillD. D.PearsonN. A.WiederholtJ. L. (2009b). Comprehensive Test of Nonverbal Intelligence examiner’s manual (2nd ed.). Austin, TX: Pro-Ed.
29.
HoR. (2014). Handbook of univariate and multivariate data analysis with IBM SPSS (2nd ed.). Boca Raton, FL: CRC Press.
30.
HornJ. L. (1965). A rationale and test for the number of factors in factor analysis. Psychomerika, 30, 179-185. doi:10.1007/BF02289447
31.
JensenA. R. (1980). Bias in mental testing. New York, NY: Free Press.
32.
JensenA. R. (1998). The g factor: The science of mental ability. Westport, CT: Praeger.
LakinJ. M. (2012). Multidimensional ability tests and culturally and linguistically diverse students: Evidence of measurement invariance. Learning and Individual Differences, 22, 397-403. doi:10.1016/j.lindif.2011.12.003
35.
LakinJ. M.GambrellJ. L. (2012). Distinguishing verbal, quantitative, and figural facets of fluid intelligence n young students. Intelligence, 40, 560-570. doi:10.1016/j.intell.2012.07.005
36.
LassiterK. S.HarrisonT. K.MatthewsT. D.BellN. L. (2001). The validity of the Comprehensive Test of Nonverbal Intelligence as a measure of fluid intelligence. Assessment, 8, 95-103. doi:10.1177/107319110100800109
37.
LassiterK. S.MatthewsT. D.FeebackG. (2007). An examination of the CTONI utilizing Gc-Gf theory: A comparison of the CTONI and WJ-III. Psychology in the Schools, 44, 567-577. doi:10.1002/pits.20248
38.
MacCallumR. C.RoznowskiM.NecowitzL. B. (1992). Model modifications in covariance structure analysis: The problem of capitalization on chance. Psychological Bulletin, 111, 490-504. doi:10.1037/0033-2909.111.3.490
39.
McArdleJ. J. (1990). Principles versus principals of structural factor analysis. Multivariate Behavioral Research, 25, 81-87. doi:10.1207/s15327906mbr2501_10
40.
McCallumS.BrackenB.WassermanJ. (2001). Essentials of nonverbal assessment. New York, NY: John Wiley.
41.
McDonaldR. P. (1999). Test theory: A unified treatment. Mahwah, NJ: Lawrence Erlbaum.
42.
NelsonJ. M.CanivezG. L.LindstromW.HattC. V. (2007). Higher-order exploratory analysis of the Reynolds Intellectual Assessment Scales with a referred sample. Journal of School Psychology, 45, 439-456. doi:10.1016/j.jsp.2007.03.003
43.
O’ConnorB. P. (2000). SPSS and SAS programs for determining the number of components using parallel analysis and Velicer’s MAP test. Behavioral Research Methods, 32, 396-402. doi:10.3758/BF03200807
44.
OrtizS. O.OchoaS. H.DyndaA. M. (2012). Testing with culturally and linguistically diverse populations: Moving beyond the verbal-performance dichotomy into evidence-based practice. In FlanganD. P.HarrisonP. L. (Eds.), Contemporary intellectual assessment: Theories, tests, and issues (3rd ed., pp. 526-552). New York, NY: Guilford Press.
45.
PearsonN. (2003). Comprehensive Test of Nonverbal Intelligence. In McCallumR. S. (Ed.), Handbook of nonverbal assessment (pp. 141-162). New York, NY: Plenum.
46.
PreacherK. J.MacCallumR. C. (2003). Repairing Tom Swift’s electric factor analysis machine. Understanding Statistics, 2, 13-43. doi:10.1207/S15328031US0201_02
ReiseS. P. (2012). The rediscovery of bifactor measurement models. Multivariate Behavioral Research, 47, 667-696. doi:10.1080/00273171.2012.715555
49.
ReiseS. P.BonifayW. E.HavilandM. G. (2013). Scoring and modeling psychological measures in the presence of multidimensionality. Journal of Personality Assessment, 95, 129-140. doi:10.1080/00223891.2012.725437
50.
RossenE. A.ShearerD. K.PenfieldR. D.KranzlerJ. H. (2005). Validity of the Comprehensive Test of Nonverbal Intelligence (CTONI). Journal of Psychoeducational Assessment, 23, 161-172. doi:10.1177/073428290502300205
51.
SchmidJ.LeimanJ. M. (1957). The development of hierarchical factor solutions. Psychometrika, 22, 53-61. doi:10.1007/BF02289209
52.
SpearmanC. (1904). “General intelligence,” objectively determined and measured. American Journal of Psychology, 15, 201-293. Retrieved from http://psychclassics.yorku.ca/Spearman
53.
TabachnickB. G.FiddellL. S. (2007). Using multivariate statistics (5th ed.). Boston, MA: Pearson.
54.
VelicerW. F. (1976). Determining the number of components from the matrix of partial correlations. Psychometrika, 31, 321-327. doi:10.1007/BF02293557
55.
VelicerW. F.JacksonD. N. (1990). Component analysis versus common factor analysis: Some further observations. Multivariate Behavioral Research, 25, 89-95. doi:10.1207/s15327906mbr2501_12
56.
WatkinsM. W. (2000). Monte Carlo PCA for parallel analysis [Computer software]. State College, PA: Ed & Psych Associates.
57.
WatkinsM. W. (2004). MacOrtho [Computer software]. State College, PA: Ed & Psych Associates.
58.
WatkinsM. W. (2007). SEscree [Computer software]. Phoenix, AZ: Ed & Psych Associates.
59.
WatkinsM. W. (2013). Omega [Computer software]. Phoenix, AZ: Ed & Psych Associates.
60.
WeissL. G.KeithT. Z.ZhuJ.ChenH. (2013a). WAIS-IV and clinical validation of the four- and five-factor interpretative approaches. Journal of Psychoeducational Assessment, 31, 93-113. doi:10.1177/0734282913478030
61.
WeissL. G.KeithT. Z.ZhuJ.ChenH. (2013b). WISC-IV and clinical validation of the four- and five-factor interpretative approaches. Journal of Psychoeducational Assessment, 31, 114-131. doi:10.1177/0734282913478032
62.
WidamanK. F. (1993). Common factor analysis versus principal component analysis: Differential bias in representing model parameters?Multivariate Behavioral Research, 28, 263-311. doi:10.1207/s15327906mbr2803_1
63.
ZoskiK. W.JursS. (1996). An objective counterpart to the visual scree test for factor analysis: The standard error scree. Educational and Psychological Measurement, 56, 443-451. doi:10.1177/0013164496056003006
64.
ZwickW. R.VelicerW. F. (1986). Comparison of five rules for determining the number of components to retain. Psychological Bulletin, 99, 432-442. doi:10.1037/0033-2909.99.3.432
