This paper complements recent discussions about the reliability of observed change scores (Collins, 1996a; Humphreys, 1996; Williams & Zimmerman, 1996a, 1996b). It is argued that modeling change on the latent dimension of interest is a better approach to measuring change than focusing on observed change scores and their properties. It is proposed that research be directed toward correlates and predictors of ability change (Rogosa & Willett, 1985b) and away from recorded change scores and their reliability. A latent variable modeling approach is discussed that focuses on ability change scores. It permits estimation of both individual latent change scores and the relationship of ability change scores to other variables.
Get full access to this article
View all access options for this article.
References
1.
Burr, J. A. , & Nesselroade, J. R. (1990). Change measurement. In A. von Eye (Ed.), Statistical methods in longitudinal research (pp. 3–34). New York: Academic Press.
2.
Cole, D. A. , Maxwell, S. E., Arvey, R., & Salas, E.(1993). Multivariate group comparisons of variable systems: MANOVA and structural equation modeling. Psychological Bulletin, 114, 174–184.
3.
Collins, L. M. (1996a). Is reliability obsolete? A commentary on “Are simple gain scores obsolete?”. Applied Psychological Measurement, 20, 289–292.
4.
Collins, L. M. (1996b). Measurement of change in research on aging: Old and new issues from an individual growth perspective. In J. E. Birren & K. W. Schaie (Eds.), Handbook of the psychology of aging (pp. 38–56). San Diego CA: Academic Press.
5.
Crocker, L. ,& Algina, J. (1986). Introduction to classical and modern test theory. Orlando FL: Holt, Rinehart, & Winston.
6.
Cronbach, L. J. , & Furby, L. (1970). How should we measure change—or should we?Psychological Bulletin, 74, 68–80.
7.
Gorsuch, R. L. (1988). Exploratory factor analysis. In R. B. Cattell & J. R. Nesselroade (Eds.), Handbook of multivariate experimental psychology (pp. 231–258). New York: Plenum.
8.
Horn, J. L. , & McArdle, J. J. (1980). Perspectives on mathematical/statistical model building (MASMOB) in research on aging. In L. W. Poon (Ed.), Aging in the 1980s: Selected contemporary issues in the psychology of aging (pp. 503–541). Washington DC: American Psychological Association.
9.
Horn, J. L. , McArdle, J. J.,& Mason, R. (1983). When is invariance not invariant: A practical scientist’s look at the ethereal concept of factor invariance. Southern Psychologist, 4, 179–188.
10.
Humphreys, L. G. (1996). Linear dependence of gain scores on their components imposes constraints on their use and interpretation: Comment on “Are simple gain scores obsolete?”. Applied Psychological Measurement, 20, 293–294.
11.
Jöreskog, K. G. , & Sörbom, D. (1993). LISREL 8: User’s reference guide. Chicago: Scientific Software International.
12.
Lord, F. M. , & Novick, R. (1968). Statistical theories of mental test scores. Reading MA: Addison-Wesley.
13.
McArdle, J. J. (1989). Structural modeling experiments using multiple growth functions. In P. Ackerman, R. Kanfer, & R. Cudeck (Eds.), Learning and individual differences: Abilities, motivation, and methodology (pp. 71–117). Hillsdale NJ: Erlbaum.
14.
McArdle, J. J. , & Anderson, E. (1990). Latent variable growth models for research on aging. In J. E. Birren & K. W. Schaie (Eds.), Handbook of the psychology of aging (3rd ed.) (pp. 21–44). New York: Academic Press.
15.
McArdle, J. J. & Epstein, D. (1987). Latent growth curves within developmental structural equation models. Child Development, 58, pp. 110–133.
16.
McArdle, J. J. ,& Hamagami, E. (1992). Modeling incomplete longitudinal and cross-sectional data using latent growth structural models. Experimental Aging Research, 18, 145–166.
17.
McArdle, J. J. , & Nesselroade, J. R. (1993). Structuring data to study development and change. In S. H. Cohen & H. W. Reese (Eds.), Life-span developmental psychology: Methodological innovations (pp. 223–267). Hillsdale NJ: Erlbaum.
18.
McArdle, J. J. , & Woodcock, J. R. (1997). Expanding test-retest designs to include developmental time-lag components. Psychological Methods, 2, 403–435.
19.
Meredith, W. (1964). Notes on factorial invariance. Psychometrika, 29, 177–185.
20.
Meredith, W. , & Tisak, J. (1990). Latent curve analysis. Psychometrika, 55, 107–122.
21.
Nesselroade, J. R. , & Cable, D. G. (1974). “ Sometimes it’s okay to factor difference scores”—the separation of state and trait anxiety. Multivariate Behavioral Research, 9, 273–282.
22.
Raykov, T. (1992). Structural models for studying correlates of change. Australian Journal of Psychology, 44, 102–115.
23.
Raykov, T. (1994). Studying correlates and predictors of longitudinal change using structural equation modeling. Applied Psychological Measurement, 18, 63–77.
24.
Raykov, T. (1995). Multivariate structural modeling of plasticity in fluid intelligence of aged adults. Multivariate Behavioral Research, 30, 255–287.
25.
Raykov, T. (1996). Plasticity in fluid intelligence of older adults: An individual latent growth curve modeling application. Structural Equation Modeling, 3, 248–265.
26.
Rogosa, D. R. (1996). Myths and methods: “Myths about longitudinal research” plus supplemental questions. In J. M. Gottman (Ed.), The analysis of change. Mahwah NJ: Erlbaum.
27.
Rogosa, D. , Brandt, D., & Zimowski, M. (1982). A growth curve approach to the measurement of change. Psychological Bulletin, 92, 726–748.
28.
Rogosa, D. R. , & Ghandour, G. A. (1989). TIMEPATH: Statistical analysis of individual trajectories. Stanford CA: Stanford University, Graduate School of Education.
29.
Rogosa, D. R. , & Ghandour, G. A. (1991). Statistical models for behavioral observations. Journal of Educational Statistics, 16, 157–252.
30.
Rogosa, D. R. , & Willett, J. B. (1985a). Satisfying a simplex structure is simpler than it should be. Journal of Educational Statistics, 10, 99–107.
31.
Rogosa, D. R. , & Willett, J. B. (1985b). Understanding correlates of change by modeling individual differences in growth. Psychometrika, 50, 203–228.
32.
Steyer, R. , Eid, M., & Schwenkmezger, P. (1997). Modeling true intraindividual change: True change as a latent variable. Methods of Psychological Research—Online, 2, 21–33. Available at www.hsp.de/MPR/.
33.
Thurstone, L. L. (1947). Multiple factor analysis. Chicago: University of Chicago Press.
34.
Willett, J. B. ,& Sayer, A. G. (1994). Using covariance structure analysis to detect correlates and predictors of individual change over time. Psychological Bulletin, 116, 363–381.
35.
Williams, R. H. , & Zimmerman, D. W. (1996a). Are simple gain scores obsolete?Applied Psychological Measurement, 20, 59–69.
36.
Williams, R. H. , & Zimmerman, D. W. (1996b). Commentary on the commentaries of Collins and Humphreys. Applied Psychological Measurement, 20, 295–297.
37.
Zimmerman, D. W. (1975). Probability spaces, Hilbert spaces, and the axioms of test theory. Psychometrika, 40, 395–412.
38.
Zimmerman, D. W. , & Williams, R. H. (1982). Gain scores in research can be highly reliable. Journal of Educational Measurement, 19, 149–154.
