What Does the Shipley-2 Measure for Children and Adolescents? Integrated and Conjoint Confirmatory Factor Analysis With the WISC-IV

Abstract

We used integrated and conjoint confirmatory factor analysis of Shipley-2 and Wechsler Intelligence Scale for Children–Fourth Edition (WISC-IV) data to investigate constructs measured in the Shipley-2 for children and adolescents. We also estimated Shipley-2 composite reliability at the subtest level rather than the item level. The three Shipley-2 subtests for the most part measured what was described in the manual, although Block Patterns measured visual spatial ability in addition to fluid ability and Abstraction was best considered a measure of psychometric g. The g factors derived from the WISC-IV and Shipley-2 were similar but not identical. Internal reliability estimates for Shipley-2 composites that were based on correlations between the subtests were substantially lower than those based on the items. Last, based on WISC-IV derived g factors, 37% to 53% of the variance in Shipley-2 composites was explained by g. Some of the reliable variance in the Shipley-2 composites was due to something specific that the subtests had in common not explained by psychometric g.

Keywords

Shipley-2 IQ construct validity WISC-IV internal reliability

Get full access to this article

View all access options for this article.

References

Adcock

C. J.

(1964). Higher-order factors. British Journal of Statistical Psychology, 17, 153-160.

Bouchard

T. J.

Jr. (2014). Genes, evolution and intelligence. Behavior Genetics, 44, 549-577.

Canivez

G. L.

Kush

J. C.

(2013). WAIS-IV and WISC-IV structural validity: Alternate methods, alternate results. Commentary on Weiss et al. (2013a) and Weiss et al. (2013b). Journal of Psychoeducational Assessment, 31, 157-169.

Carlstedt

Gustafsson

J. E.

(2005). Construct validation of the Swedish scholastic aptitude test by means of the Swedish enlistment battery. Scandinavian Journal of Psychology, 46, 31-42.

Carroll

J. B.

(1993). Human cognitive abilities: A survey of factor-analytic studies. New York, NY: Cambridge University Press.

Cattell

R. B.

(1971). Abilities: Their structure, growth, and action. Oxford, England: Houghton Mifflin.

Cheung

G. W.

Rensvold

R. B.

(2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9, 233-255.

Cronbach

L. J.

(1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16, 297-334.

Curran

P. J.

West

S. G.

Finch

J. F.

(1996). The robustness of test statistics to nonnormality and specification error in confirmatory factor analysis. Psychological Methods, 1, 16-29.

10.

Eisinga

Grotenhuis

M. T.

Pelzer

(2013). The reliability of a two-item scale: Pearson, Cronbach, or Spearman-Brown? International Journal of Public Health, 58, 1-6.

11.

Farmer

R. L.

Floyd

R. G.

Reynolds

M. R.

Kranzler

J. H.

(2014). IQs are very strong but imperfect indicators of psychometric g: Results from joint confirmatory factor analysis. Psychology in the Schools, 51, 801-813.

12.

Floyd

R. G.

Reynolds

M. R.

Farmer

R. L.

Kranzler

J. H.

(2013). Are the general factors from different child and adolescent intelligence tests the same? Results from a five-sample, six-test analysis. School Psychology Review, 42, 383-401.

13.

Gignac

G. E.

(2005). Revisiting the factor structure of the WAIS-R insights through nested factor modeling. Assessment, 12, 320-329.

14.

Gignac

G. E.

(2014). On the inappropriateness of using items to calculate total scale score reliability via coefficient alpha for multidimensional scales. European Journal of Psychological Assessment, 30, 130-139.

15.

Gignac

G. E.

Watkins

M. W.

(2013). Bifactor modeling and the estimation of model-based reliability in the WAIS-IV. Multivariate Behavioral Research, 48, 639-662.

16.

Gustafsson

J. E.

(1984). A unifying model for the structure of intellectual abilities. Intelligence, 8, 179-203.

17.

Gustafsson

J. E.

Åberg-Bengtsson

(2010). Unidimensionality and interpretability of psychological instruments. In Embretson

(Ed.), Measuring psychological constructs: Advances in model-based approaches (pp. 97-121). Washington, DC: American Psychological Association.

18.

Gustafsson

J. E.

Balke

(1993). General and specific abilities as predictors of school achievement. Multivariate Behavioral Research, 28, 407-434.

19.

Hoogland

J. J.

Boomsma

(1998). Robustness studies in covariance structure modeling: An overview and a meta-analysis. Sociological Methods & Research, 26, 329-367.

20.

Jensen

A. R.

(1998). The g factor: The science of mental ability. Westport, CT: Praeger.

21.

Jensen

A. R.

Weng

L. J.

(1994). What is a good g? Intelligence, 18, 231-258.

22.

Johnson

Bouchard

T. J.

Krueger

R. F.

McGue

Gottesman

I. I.

(2004). Just one g: Consistent results from three test batteries. Intelligence, 32, 95-107.

23.

Johnson

Nijenhuis

J. T.

Bouchard

T. J.

Jr. (2008). Still just 1 g Consistent results from five test batteries. Intelligence, 36, 81-95.

24.

Kaufman

S. B.

Reynolds

M. R.

Liu

Kaufman

A. S.

McGrew

K. S.

(2012). Are cognitive g and academic achievement g one and the same g? An exploration on the Woodcock-Johnson and Kaufman tests. Intelligence, 40, 123-138.

25.

Kaya

Bulut

(2012). Test review: Shipley-2 manual. Journal of Psychoeducatioal Assessment, 30, 593-597.

26.

Keith

T. Z.

(2005). Using confirmatory factor analysis to aid in understanding the constructs measured by intelligence tests. In Flanagan

D. P.

Harrison

P. L.

(Eds.), Contemporary intellectual assessment: Theories, tests, and issues (2nd ed., pp. 581-614). New York, NY: Guilford Press.

27.

Keith

T. Z.

Fine

J. G.

Taub

G. E.

Reynolds

M. R.

Kranzler

J. H.

(2006). Higher order, multisample, confirmatory factor analysis of the Wechsler Intelligence Scale for Children—Fourth Edition: What does it measure? School Psychology Review, 35, 108-127.

28.

Keith

T. Z.

Kranzler

J. H.

Flanagan

D. P.

(2001). What does the Cognitive Assessment System (CAS) measure? Joint confirmatory factor analysis of the CAS and the Woodcock Johnson Tests of Cognitive Ability (3rd edition). School Psychology Review, 30, 89-119.

29.

Keith

T. Z.

Reynolds

M. R.

(2010). Cattell-Horn-Carroll abilities and cognitive tests: What we’ve learned from 20 years of research. Psychology in the Schools, 47, 635-650.

30.

Marshalek

Lohman

D. F.

Snow

R. E.

(1983). The complexity continuum in the radex and hierarchical models of intelligence. Intelligence, 7, 107-127.

31.

McDonald

R. P.

(1999). Test theory: A unified treatment. Mahwah, NJ: Erlbaum.

32.

Meredith

(1993). Measurement invariance, factor analysis, and factorial invariance. Psychometrika, 58, 525-543.

33.

Mulaik

S. A.

Quartetti

D. A.

(1997). First order or higher order general factor? Structural Equation Modeling, 4, 193-211.

34.

Murray

A. L.

Johnson

(2013). The limitations of model fit in comparing the bi-factor versus higher-order models of human cognitive ability structure. Intelligence, 41, 407-422.

35.

Muthén

L. K.

Muthén

B. O.

(2002). How to use a Monte Carlo study to decide on sample size and determine power. Structural Equation Modeling, 9, 599-620.

36.

Panizzon

M. S.

Vuoksimaa

Spoon

K. M.

Jacobson

K. C.

Lyons

M. J.

Franz

C. E.

Kremen

W. S.

(2014). Genetic and environmental influences on general cognitive ability: Is g a valid latent construct? Intelligence, 43, 65-76.

37.

Reise

S. P.

(2012). The rediscovery of bifactor measurement models. Multivariate Behavioral Research, 47, 667-696.

38.

Reynolds

M. R.

Floyd

R. F.

Niileksela

C. R.

(2013). How well is psychometric g indexed by global composites? Evidence from three popular intelligence tests. Psychological Assessment, 25, 1314-1321.

39.

Reynolds

M. R.

Keith

T. Z.

(2013). Measurement and statistical issues in child assessment research. In Soklofske

D. H.

Reynolds

C. R.

Schwean

(Eds.), Oxford handbook of child and adolescent assessment (pp. 48-83). New York, NY: Oxford University Press.

40.

Reynolds

M. R.

Keith

T. Z.

Flanagan

D. P.

Alfonso

V. C.

(2013). A cross-battery, reference variable, confirmatory factor analytic investigation of the CHC taxonomy. Journal of School Psychology, 51, 535-555.

41.

Salthouse

T. A.

(2005). Relations between cognitive abilities and measures of executive functioning. Neuropsychology, 19, 532-545.

42.

Salthouse

T. A.

(2014). Evaluating the correspondence of different cognitive batteries. Assessment, 21, 131-142.

43.

Schermelleh-Engel

Moosbrugger

Müller

(2003). Evaluating the fit of structural equation models: Tests of significance and descriptive goodness-of-fit measures. Methods of Psychological Research Online, 8, 23-74.

44.

Schmid

Leiman

J. M.

(1957). The development of hierarchical factor solutions. Psychometrika, 22, 53-61.

45.

Schneider

W. J.

McGrew

K. S.

(2012). The Cattell–Horn–Carroll model of intelligence. In Flanagan

D. P.

Harrison

P. L.

(Eds.), Contemporary intellectual assessment: Theories, tests, and issues (3rd ed., pp. 91-144). New York, NY: Guilford.

46.

Shipley

W. C.

(1940). A self-administering scale for measuring intellectual impairment and deterioration. Journal of Psychology, 9, 371-377.

47.

Shipley

W. C.

(1946). Institute of living scale. Los Angeles, CA: Western Psychological Services.

48.

Shipley

W. C.

Gruber

C. P.

Martin

T. A.

Klein

A. M.

(2009). Shipley-2. Los Angeles, CA: Western Psychological Services.

49.

Tellegen

Briggs

P. F.

(1967). Old wine in new skins: Grouping Wechsler subtests into new scales. Journal of Consulting Psychology, 31, 499-506.

50.

Wahlstrom

Breaux

K. C.

Zhu

Weiss

(2012). The Wechsler Preschool and Primary Scale of Intelligence–Third Edition, The Wechsler Intelligence Scale for Children–Fourth Edition, and the Wechsler Individual Achievement Test–Third Edition. In Flanagan

D. P.

Harrison

P. L.

(Eds.), Contemporary intellectual assessment: Theories, tests, and issues (3rd ed., pp. 224-248). New York, NY: Guilford.

51.

Watkins

M. W.

(2006). Orthogonal higher order structure of the Wechsler Intelligence Scale for Children—Fourth Edition. Psychological Assessment, 18, 123-125.

52.

Wechsler

(1997). Wechsler Adult Intelligence Scale—Third Edition. San Antonio, TX: Psychological Corporation.

53.

Wechsler

(2003). The WISC-IV technical manual. San Antonio, TX: Pearson.

54.

Wechsler

(2008). Wechsler Adult Intelligence Scale—Fourth Edition. San Antonio, TX: Pearson.

55.

Weiss

L. G.

Keith

T. Z.

Zhu

Chen

(2013). WISC-IV and clinical validation of the four- and five-factor interpretative approaches. Journal of Psychoeducational Assessment, 31, 114-131.

56.

Woodcock

R. W.

(1990). Theoretical foundations of the WJ-R measures of cognitive ability. Journal of Psychoeducational Assessment, 8, 231-258.

57.

Zachary

R. A.

(1986). Shipley Institute of Living Scale manual. Los Angeles, CA: Western Psychological Services.

58.

Zachary

R. A.

Crumpton

Spiegel

D. E.

(1985). Estimating WAIS-R IQ from the Shipley Institute of Living Scale. Journal of Clinical Psychology, 41, 532-540.

59.

Zinbarg

R. E.

Yovel

Revelle

McDonald

R. P.

(2006). Estimating generalizability to a latent variable common to all of a scale’s indicators: A comparison of estimators for ωh. Applied Psychological Measurement, 30, 121-144.