This study assessed trait validity of the Reynolds Intellectual Assessment Scales’ (RIAS) Verbal Index (VIX) and Nonverbal Index (NIX) scores in a group of college students. Using both observation of patterns and latent variable modeling of a multitrait—multimethod correlation/covariance matrix, the results indicate that the RIAS VIX scores behaved in a manner predicted from the theory behind their construction; namely, they related strongly to other measures of crystallized intelligence (Gc) and, together, they formed a salient Gc factor. The NIX scores, however, did not behave as predicted—showing as strong, or stronger, associations with measures of Gc than measures of fluid intelligence. Although more studies of this type are needed across different samples before making broad generalizations, the results from the present study support the use and interpretation of the RIAS VIX score, but not the NIX score.
Andrews, J.J.W. ( 2007). Review of RIAS: Reynolds Intellectual Assessment Scales . Journal of Psychoeducational Assessment, 25, 402-408.
3.
Asparouhov, T., & Muthen, B. ( 2005, November). Multivariate statistical modeling with survey data. Paper presented at the Federal Committee on Statistical Methodology Research Conference, Arlington, VA. Retrieved November 19, 2009, from http://www.fcsm.gov/05papers/Asparouhov_Muthen_IIA.pdf
4.
Barrett, P.T. ( 2007). Structural equation modeling: Adjudging model fit. Personality and Individual Differences, 42, 812-824.
5.
Beaujean, A.A., Firmin, M.W., Knoop, A., Michonski, J.D., Berry, T.P., & Lowrie, R.E. ( 2006). Validation of the Frey and Detterman (2004) IQ prediction equations using the Reynolds Intellectual Assessment Scales. Personality and Individual Differences, 6, 353-357.
6.
Borgatta, E., & Corsini, R. ( 1964). Manual for the Quick Word Test. New York: Harcourt, Brace & World.
7.
Bracken, B.A. ( 2005). Review of Reynolds Intellectual Assessment Scales and the Reynolds Intellectual Screening Test. In B. S. Plake & R. A. Spies (Eds.), The sixteenth mental measurements yearbook. Retrieved November 27, 2006, from EBSCO Mental Measurements Yearbook database.
8.
Brown, T.A. ( 2006). Confirmatory factor analysis for applied research . New York: Guilford.
9.
Browne, M.W., & Arminger, G. ( 1995). Specification and estimation of mean- and covariance-structure models. In G. Arminger, C. C. Clogg, & M. E. Sobel (Eds.), Handbook of statistical modeling for the social and behavioral sciences (pp. 185-241). New York: Plenum.
10.
Burt, C.L. ( 1940). The factors of the mind: An introduction to factor analysis in psychology. London: University of London.
11.
Campbell, D.T. ( 1960). Recommendations for APA test standards regarding construct, trait, or discriminant validity. American Psychologist , 15, 546-553.
12.
Campbell, D.T., & Fiske, D.W. ( 1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56, 81-105.
13.
Carroll, J.B. ( 1993). Human cognitive abilities: A survey of factor-analytic studies. New York: Cambridge University Press.
14.
Cattell, R.B. ( 1971). Abilities: Their structure, growth, and action . New York: Houghton Mifflin.
15.
D’Agostino R.B., & Pearson, E.S. ( 1973). Tests for departure from normality. Biometrika, 60, 613-22.
16.
DeCarlo, L.T. ( 1997). On the meaning and use of kurtosis. Psychological Methods, 2, 292-307.
17.
Edwards, O.W., & Paulin, R.V. ( 2007). Referred students’ performance on the Reynolds Intellectual Assessment Scales and the Wechsler Intelligence Scale for Children- Fourth Edition. Journal of Psychoeducational Assessment , 25, 334-340.
Firmin, M., McGlaughlin, S.M., Beaujean, A.A., Margulies, A., Cole, A., Davis, K., et al. (2008, August). Predictive ability of the Reynolds Intellectual Assessment Scales index scores. Poster session presented at the annual meeting of the American Psychological Association , Boston.
20.
Flanagan, D.P., McGrew, K.S., & Ortiz, S.O. ( 2000). The Wechsler intelligence scales and Gf-Gc theory: A contemporary approach to interpretation. Boston: Allyn & Bacon.
21.
Flanagan, D.P., Ortiz, S.O., & Alfonso, V.C. ( 2007). Essentials of cross-battery assessment (2nd ed.). New York: John Wiley.
22.
Flanagan, D.P., Ortiz, S.O., Alfonso, V., & Mascolo, J. ( 2006). The achievement test desk reference: A guide to learning disability identification (2nd ed.). Hoboken, NJ: John Wiley.
23.
Frey, M., & Detterman, D. ( 2004). Scholastic assessment or g? The relationship between the Scholastic Assessment Test and general cognitive ability. Psychological Science, 15, 373-378.
24.
Grotelueschen, A., & Lyons, T.J. ( 1967). Quick Word Test validity with adults. Psychological Reports, 20, 488-490.
25.
Grotelueschen, A., & McQuarrie, D. ( 1970). Cross-validation of the Quick Word Test as an estimator of adult mental ability. Adult Education, 21, 14-19.
26.
Hancock, G.R., & Mueller, R.O. ( 2001). Rethinking construct reliability within latent variable systems. In R. Cudeck, S. du Toit, & D. Sörbom (Eds.), Structural equation modeling: Present and future: A festschrift in honor of Karl Jöreskog (pp. 195-216). Lincolnwood, IL: Scientific Software International .
27.
Horn, J.L., & Noll, J. ( 1997). Human cognitive capabilities: Gf-Gc theory. In D. P. Flanagan, J. L. Genshaft , & P. L. Harrison (Eds.), Contemporary intellectual assessment: Theories, tests and issues (pp. 53-91). New York: Guilford .
28.
Hu, L.-T., & Bentler, P. ( 1995). Evaluating model fit. In R. H. Hoyle (Ed.), Structural equation modeling: Concepts, issues, and applications (pp. 76-99). London: Sage.
29.
Jensen, A.R. ( 1998). The g factor: The science of mental ability. Westport, CT: Praeger.
30.
Jensen, A.R. ( 2003). Do age-group differences on mental tests imitate racial differences? Intelligence, 31, 107-121.
31.
Jensen, A.R. ( 2006). Clocking the mind: Mental chronometry and individual differences. Amsterdam: Elsevier .
32.
Jensen, A.R., & Osborne, R.T. ( 1979). Forward and backward digit span interaction with race and IQ: A longitudinal developmental comparison. Indian Journal of Psychology, 54, 75-87.
33.
Kamphaus, R.W. ( 2001). Clinical assessment of child and adolescent intelligence (2nd ed.). Boston: Allyn & Bacon.
34.
Kane, M.T. ( 2006). Validation. In R. L. Brennan (Ed.), Educational measurement (4th ed., pp.18-64). Westport, CT: Praeger .
35.
Keith, T.Z., Fine, J.G., Reynolds, M.R., Taub, G.E., & Kranzler, J.H. (2006). Higher order, multi-sample, confirmatory factor analysis of the Wechsler Intelligence Scale for Children- Fourth edition: What does it measure?School Psychology Review , 35, 108-127.
36.
Keith, T.Z., Kranzler, J.H., & Flanagan, D.P. (2001). What does the Cognitive Assessment System (CAS) measure? Joint confirmatory factor analysis of the CAS and the Woodcock-Johnson Tests of Cognitive Ability-III. School Psychology Review, 30, 89-119.
37.
Kenny, D.A., & Kashy, D.A. ( 1992). Analysis of the multitrait- multimethod matrix by confirmatory factor analysis. Psychological Bulletin, 112, 165-172.
38.
Klein, A., & Herzberg, D. (in press). Quick Picture Reading Test. Los Angeles : Western Psychological Services.
39.
Kline, R.B. ( 2004). Principles and practice of structural equation modeling (2nd ed.). New York : Guilford.
40.
Krach, S.K., Loe, S.A., Rager, R., Jones, H.M., & Speer, J.M. ( 2006, August). Validity study of the RIAS using the WJ-III Cognitive . Poster session presented at the annual convention of the American Psychological Association Convention, New Orleans, LA.
41.
Kyllonen, P.C., & Christal, R.E. (1990). Reasoning ability is (little more than) working memory capacity? Intelligence, 14, 389-433.
42.
Little, R.J.A., & Rubin, D.B. ( 1987). Statistical analysis with missing data. New York: John Wiley.
43.
Lohman, D.F. ( 2000). Complex information processing and intelligence . In R. J. Sternberg (Ed.), Handbook of intelligence (pp. 285-340). New York: Cambridge University Press.
44.
Marsh, H.W. ( 1989). Confirmatory factor analyses of multitrait-multimethod data: Many problems and a few solutions. Applied Psychological Measurement, 13, 335-361.
45.
Marsh, H.W., Byrne, B.M., & Craven, R. ( 1992). Overcoming problems in confirmatory factor analyses of MTMM data: The correlated uniqueness model and factorial invariance. Multivariate Behavioral Research, 27, 489-507.
46.
Marsh, H.W., & Grayson, D. ( 1995). Latent variable models of multitrait-multimethod data . In R. H. Hoyle (Ed.), Structural equation modeling: Concepts, issues, and applications (pp. 177-198). Thousand Oaks, CA: Sage.
47.
Marsh, H.W., Hau, K.-T., & Grayson, D. ( 2005). Goodness of fit in structural equation models . In A. Maydeu-Olivares & J. J. McArdle (Eds.), Contemporary psychometrics: A festschrift for Roderick P. McDonald (pp. 275-340). Mahwah, NJ : Lawrence Erlbaum.
48.
McGrew, K.S. ( 2005). The Cattell-Horn-Carroll (CHC) theory of cognitive abilities: Past, present and future. In D. Flanagan, & Harrison (Eds.), Contemporary intellectual assessment: Theories, tests, and issues (2nd. ed., pp.136-202). New York: Guilford .
49.
Merwin, J.C. ( 1965). Test reviews. Journal of Counseling Psychology , 12, 435-437.
50.
Messick, S. ( 1989). Validity. In R. L. Linn (Ed.), Educational measurement (3rd ed., pp. 13-103). New York: American Council on Education & Macmillan.
51.
Muthen, L.K., & Muthen, B.O. ( 2002). How to use a Monte Carlo study to decide on sample size and determine power. Structural Equation Modeling, 4, 599-620.
52.
Muthen, L.K., & Muthen, B.O. ( 2007). Mplus Version 5 [Computer software]. Los Angeles: Author.
53.
Nelson, J.M., Canivez, G.L., Lindstrom, W., & Hatt, C.V. ( 2007). Higher-order exploratory factor analysis of the Reynolds Intellectual Assessment Scales with a referred sample. Journal of School Psychology, 45, 439-456.
54.
Phelps, L., McGrew, K.S., Knopik, S.N., & Ford, L. ( 2005). The general (g), broad, and narrow CHC stratum characteristics of the WJ-III and WISC-III tests: A confirmatory cross-battery investigation . School Psychology Quarterly, 20, 66-88.
55.
The Psychological Corporation. (1997). Wechsler Adult Intelligence Scale-Third Edition and Wechsler Memory Scale-Third Edition technical manual. San Antonio, TX: Author.
Reynolds, C.R., & Kamphaus, R.W. (2005). Introduction to Reynolds Intellectual Assessment Scales and the Reynolds Intellectual Screening Test . In D. P. Flanagan & P. L. Harrison (Eds.), Contemporary intellectual assessment (2nd ed., pp. 461-483). New York: Guilford.
58.
Satorra, A., & Bentler, P.M. ( 2001). A scaled difference chi-square test statistic for moment structure analysis. Psychometrika, 66, 507-514.
59.
Savalei, V. ( 2008). Is the ML chi-square ever robust to nonnormality? A cautionary note with missing data. Structural Equation Modeling , 15, 1-22.
60.
Schraw, G. ( 2005). Review of Reynolds Intellectual Assessment Scales and the Reynolds Intellectual Screening Test. In B. S. Plake & R. A. Spies (Eds.), The sixteenth mental measurements yearbook. Retrieved November 27, 2006, from EBSCO Mental Measurements Yearbook database.
61.
Shipley, W.C. ( 1940). A self-administered scale for measuring intellectual impairment and deterioration. Journal of Psychology, 9, 371-377.
62.
Shipley, W., Gruber, C., Martin, T., & Klein, A. (in press). Shipley Institute of Living Scale-2. Los Angeles: Western Psychological Services.
63.
Small, N.J.H. ( 1980). Marginal skewness and kurtosis in testing multivariate normality. Applied Statistics, 29, 85-87.
64.
Spearman, C.E. ( 1904). "General intelligence," objectively determined and measured . American Journal of Psychology, 15, 201-293.
65.
Stuart, A., Ord, J.K., & Arnold, S. ( 1999). Kendall’s advanced theory of statistics: Vol. 2A. Classical inference and the linear model (6th ed.). London: Hodder Arnold.
66.
Tomas, J.M., Hontangas, P.M., & Oliver, A. ( 2000). Linear confirmatory factor models to evaluate multitrait-multimethod matrices: The effects of number of indicators and correlation among methods . Multivariate Behavioral Research, 35, 469-499.
67.
Wechsler, D. ( 1997). Wechsler Memory Scale (3rd ed). San Antonio, TX: Harcourt Assessment .
68.
Westbrook, B.W., & Sellers, J.R. ( 1967). Critical thinking, intelligence, and vocabulary . Educational and Psychological Measurement, 27, 443-446.
Wilkinson, G. ( 1993). Wide Range Achievement Test (3rd ed.). Wilmington, DE: Wide Range .
71.
Wothke, W. ( 1998). Longitudinal and multi-group modeling with missing data . In T. Little, K. U. Schnabel, & J. Baumert (Eds.), Modeling longitudinal and multiple group data: Practical issues, applied approaches and specific examples (pp. 219-240). Mahwah, NJ: Lawrence Erlbaum.
72.
Yuan, K.-H., & Bentler, P.M. ( 2000). Three likelihood-based methods for mean and covariance structure analysis with non-normal missing data. In M. E. Sobel & M. P. Becker (Eds.), Sociological methodology 2000 (pp. 165-200). Washington, DC : American Sociological Association.
