The Conceptualization and Analysis of Change Over Time: An Integrative Approach Incorporating Longitudinal Mean and Covariance Structures Analysis (LMACS) and Multiple Indicator Latent Growth Modeling (MLGM)
Restricted accessResearch articleFirst published online October, 1998
The Conceptualization and Analysis of Change Over Time: An Integrative Approach Incorporating Longitudinal Mean and Covariance Structures Analysis (LMACS) and Multiple Indicator Latent Growth Modeling (MLGM)
The concept of change over time is fundamental to many phenomena investigated in organizational research. This didactically oriented article proposes an integrative approach incorporating longitudinal mean and covariance structures analysis and multiple indicator latent growth modeling to aid organizational researchers in directly addressing fundamental questions concerning the conceptualization and analysis of change over time. The approach is illustrated using a numerical example involving several organizationally relevant variables. Advantages, limitations, and extensions of the approach are discussed.
Get full access to this article
View all access options for this article.
References
1.
Allport, G. W.
(1937). Personality. New York: Holt.
2.
Alwin, D. F.
, & Jackson, D. J. (1981). Application of simultaneous factor analysis to issues of factor invariance. In D. J. Jackson & E. F. Borgatta (Eds.), Factor analysis and measurement in sociological research (pp. 249-279). Beverly Hills, CA: Sage.
3.
Anderson, J. C.
, & Gerbing, D. W. (1984). The effect of sampling error on convergence, improper solutions, and goodness-of-fit indices for maximum likelihood confirmatory factor analysis. Psychometrika, 49, 155-173.
4.
Arvey, R. D.
, & Cole, D. A. (1989). Evaluating change due to training. In I. Goldstein (Ed.), Training and development in organizations (pp. 89-117). San Francisco: Jossey-Bass.
5.
Austin, J. T.
, Humphreys, L. G., & Hulin, C. L. (1989). Another view of dynamic criteria: A critical reanalysis of Barett, Caldwell, and Alexander. Personnel Psychology, 42, 597-612.
6.
Baltagi, B. H.
(1995). Econometric analysis of panel data. Chichester, UK: Wiley.
7.
Barrett, G. V.
, Caldwell, M. S., & Alexander, R. A. (1985). The concept of dynamic criteria: A critical reanalysis. Personnel Psychology, 38, 41-56.
8.
Bentler, P. M.
(1990). Comparative fit indexes in structural models. Psychological Bulletin, 107, 238-246.
9.
Bentler, P. M.
(1993). EQS: Structural equations program manual. Los Angeles: BMDP Statistical Software.
10.
Bentler, P. M.
, & Bonett, D. G. (1980). Significance tests and goodness of fit in the analysis of covariance structures. Psychological Bulletin, 88, 588-606.
11.
Bentler, P. M.
, & Chou, C. P. (1988). Practical issues in structural modeling. In J. S. Long (Ed.), Common problems/proper solutions: Avoiding error in quantitative research (pp. 161-192). Newbury Park, CA: Sage.
12.
Bereiter, C.
(1963). Some persisting dilemmas in the measurement of change. In C. W. Harris (Ed.), Problems in the assessment of change. Madison: University of Wisconsin Press.
13.
Bergh, D. D.
(1993a). Watch the time carefully: The use and misuse of time effects in management research. Journal of Management, 19, 683-705.
14.
Bergh, D. D.
(1993b). Don't "waste" your time! The effects of time series errors in management research: The case of ownership concentration and research and development spending. Journal of Management, 19, 897-914.
15.
Bergh, D. D.
(1995). Problems with repeated measures analysis: Demonstration with a study of the diversification and performance relationship. Academy of Management Journal, 38, 1692-1708.
16.
Bollen, K. A.
(1989). Structural equations with latent variables. New York: John Wiley.
17.
Box, G.E.P.
(1954). Some theorems on quadratic forms applied in the study of analysis of variance problems: Vol. 1. Effect of inequality of variance in the one-way classification. Annals of Mathematical Statistics, 25, 290-302.
18.
Browne, M. W.
, & Arminger, G. (1995). Specification and estimation of mean-and-covariance structure models. In G. Arminger, C. C. Clogg, & M. E. Sobal (Eds.), Handbook of statistical modeling for the social and behavioral sciences. New York: Plenum.
19.
Browne, M. W.
, & Cudeck, R. (1993). Alternative ways of assessing model fit. In K. A. Bollen & J. S. Long (Eds.), Testing structural equation models (pp. 136-162). Newbury Park, CA: Sage.
20.
Bryk, A. S.
, & Raudenbush, S. W. (1987). Application of hierarchical linear models to assessing change. Psychological Bulletin, 101, 147-158.
21.
Bryk, A. S.
, & Raudenbush, S. W. (1992). Hierarchical linear models. Newbury Park, CA: Sage.
22.
Bryk, A. S.
, & Weisberg, H. I. (1977). Use of the nonequivalent control group design when subjects are growing. Psychological Bulletin, 85, 950-962.
23.
Campbell, D. T.
, & Stanley, J. C. (1963). Experimental and quasi-experimental designs for research. Chicago: Rand McNally.
24.
Chan, D.
(1998). Functional relations among constructs in the same content domain at different levels of analysis: A typology of composition models. Journal of Applied Psychology, 83, 234-246.
25.
Chan, D.
, & Schmitt, N. (1997). Video-based versus paper-and-pencil method of assessment in situational judgment tests: Subgroup differences in performance and face validity perceptions. Journal of Applied Psychology, 82, 143-159.
26.
Cohen, P.
(1991). A source of bias in longitudinal investigations of change. In L. M. Collins & J. L. Horn (Eds.), Best methods for the analysis of change (pp. 18-25). Washington, DC: American Psychological Association.
27.
Collins, L. M.
(1991). Measurement in longitudinal research. In L. M. Collins & J. L. Horn (Eds.), Best methods for the analysis of change (pp. 137-148). Washington, DC: American Psychological Association.
28.
Collins, L. M.
, & Graham, J. W. (1991). Comments on "A source of bias in longitudinal investigations of change." In L. M. Collins & J. L. Horn (Eds.), Best methods for the analysis of change (pp. 26-30). Washington, DC: American Psychological Association.
29.
Cook, T. D.
, & Campbell, D. T. (1979). Quasi-experimentation: Design and analysis issues for field settings. Boston: Houghton Mifflin.
30.
Cook, T. D.
, Campbell, D. T. & Peracchio, L. (1990). Quasi experimentation. In M. D. Dunnette & L. M. Hough (Eds.), Handbook of industrial and organizational psychology, (Vol. 1, pp. 491-576). Palo Alto, CA: Consulting Psychologists Press.
31.
Cronbach, L. J.
, & Furby, L. (1970). How we should measure "change"-or should we? Psychological Bulletin, 74, 68-80.
32.
Deadrick, D.
, Bennett, N., & Russell, C. (1997). Using hierarchical linear modeling to examine dynamic performance criteria over time. Journal of Management, 23, 745-757.
33.
Drasgow, F.
(1984). Scrutinizing psychological tests: Measurement equivalence and equivalent relations with external variables are central issues. Psychological Bulletin, 95, 134-135.
34.
Drasgow, F.
(1987). Study of measurement bias of two standardized psychological tests. Journal of Applied Psychology, 72, 19-29.
35.
Duncan, S. C.
, & Duncan, T. E. (1994). Modeling incomplete longitudinal substance use data using latent variable growth curve methodology. Multivariate Behavioral Research, 29, 313-338.
36.
Duncan, S. C.
, & Duncan, T. E. (1996). A multivariate growth curve analysis of adolescent substance use. Structural Equation Modeling, 3, 323-347.
37.
Duncan, T. E.
, Duncan, S. C., Alpert, A., Hops, H., Stoolmiller, M., & Muthen, B. (1997). Latent variable modeling of longitudinal and multilevel substance use data. Multivariate Behavioral Research, 32, 275-318.
38.
Duncan, T. E.
, Duncan, S. C., & Hops, H. (1994). The effects of family cohesiveness and peer encouragement on the development of adolescent alcohol use: A cohort-sequential approach to the analysis of longitudinal data. Journal of Studies on Alcohol, 55, 588-599.
39.
Duncan, T. E.
, Duncan, S. C., & Stoolmiller, M. (1994). Modeling developmental processes using latent growth structural equation methodology. Applied Psychological Measurement, 18, 343-354.
40.
Edwards, J. R.
(1994). Regression analysis as an alternative to difference scores. Journal of Management, 20, 683-689.
41.
Fichman, M.
(1988). Motivational consequences of absence and attendance: Proportional hazard estimation of a dynamic motivation model. Journal of Applied Psychology, 73, 119-134.
42.
Golembiewski, R. T.
, Billingsley, K., & Yeager, S. (1976). Measuring change and persistence in human affairs: `Types of change generated by OD designs. Journal of Applied Behavioral Science, 12, 133-157.
43.
Gollob, H. F.
, & Reichardt, C. S. (1991). Interpreting and estimating indirect effects assuming time lags really matter. In L. M. Collins & J. L. Horn (Eds.), Best methods for the analysis of change (pp. 243-259). Washington, DC: American Psychological Association.
44.
Hanges, P. J.
, Schneider, B., & Niles, K. (1990). Stability of performance: An interactionist perspective. Journal of Applied Psychology, 75, 658-667.
45.
Harrison, D.
, & Hulin, C. (1989). Investigation of absenteeism: Using event history models to study the absence-taking process. Journal of Applied Psychology, 74, 300-316.
46.
Henry, R. A.
, & Hulin, C. L. (1987). Stability of skilled performance across time: Some generalizations and limitations on utilities. Journal of Applied Psychology, 72, 457-462.
47.
Hofmann, D. A.
(1997). An overview of the logic and rationale of hierarchical linear models. Journal of Management, 23, 723-744.
48.
Hofmann, D. A.
, Jacobs, R., & Baratta, J. (1993). Dynamic criteria and the measurement of change. Journal of Applied Psychology, 78, 194-204.
49.
Hofmann, D. A.
, Jacobs, R., & Gerras, S. J. (1992). Mapping individual performance over time. Journal of Applied Psychology, 77, 185-195.
50.
Hsiao, C.
(1986). Analysis of panel data. Cambridge, UK: Press Syndicate of the University of Cambridge.
51.
Huynh, H.
, & Mandeville, G. K. (1979). Validity conditions in repeated measures designs. Psychological Bulletin, 86, 964-973.
52.
James, L. R.
, Mulaik, S. A., & Brett, J. M. (1982). Causal analysis: Assumptions, models, and data. Beverly Hills, CA: Sage.
53.
Johns, G.
(1981). Difference score measures of organizational behaviors: A critique. Organizational Behavior and Human Performance, 27, 443-463.
54.
Jöreskog, K.
, & Sörbom, D. (1989). LISREL 7: A guide to the program and applications (2nd ed.). Chicago: SPSS.
55.
Jöreskog, K.
, & Sörbom, D. (1993). LISREL 8 user's reference guide. Chicago: Scientific Software.
56.
Kanfer, R.
, & Ackerman, P. L. (1989). Motivational and cognitive abilities: An integrative/ aptitude-treatment interaction approach to skill acquisition. Journal of Applied Psychology, 74, 657-690.
57.
Laird, N. M.
, & Ware, J. H. (1982). Random-effects models for longitudinal data. Biometrics, 38, 963-974.
58.
Linn, R. L.
, & Slinde, J. A. (1977). The determination of the significance of change between pre-and posttesting periods. Review of Educational Research, 47, 121-150.
59.
Little, T.
(1997). Mean and covariance structures (MACS) analyses of cross-cultural data: Practical and theoretical issues. Multivariate Behavioral Research, 32, 53-76.
60.
MacCallum, R. C.
, Browne, M. W., & Sugawara, H. M. (1996). Power analysis and determination of sample size for covariance structure modeling. Psychological Methods, 1, 130-149.
61.
MacCallum, R. C.
, Kim, C., Malarkey, W. B., & Kiecolt-Glaser, J. K. (1997). Studying multivariate change using multilevel models and latent curve models. Multivariate Behavioral Research, 32, 215-254.
62.
MacCallum, R. C.
, & Tucker, L. R. (1991). Representing sources of error in the common-factor model: Implications for theory and practice. Psychological Bulletin, 109, 501-511.
63.
McArdle, J. J.
(1988). Dynamic but structural equation modeling of repeated measures data. In R. B. Catell & J. Nesselroade (Eds.), Handbook of multivariate experimental psychology (2nd ed., pp. 561-614). New York: Plenum.
64.
McArdle, J. J.
(1996). Current directions in structural factor analysis. Current Directions, 5, 11-18.
65.
McArdle, J. J.
, & Epstein, D. (1987). Latent growth curves within developmental structural equation models. Child Development, 58, 110-133.
66.
McArdle, J. J.
, & Hamagami, F. (1991). Modeling incomplete longitudinal and cross-sectional data using latent growth structural models. In L. M. Collins & J. L. Horn (Eds.), Best methods for the analysis of change (pp. 276-304). Washington, DC: American Psychological Association.
67.
McArdle, J. J.
, & McDonald, R. P. (1984). Some algebraic properties of the reticular action model for moment structures. British Journal of Mathematical and Statistical Psychology, 37, 234-251.
68.
Meredith, W.
, & Tisak, J. (1990). Latent curve analysis. Psychometrika, 55, 107-122.
69.
Meyer, J. P.
, Allen, N. J., & Gelatly, I. R. (1990). Affective and continuance commitment to the organization: Evaluation of measures and analysis of concurrent and time-lagged relations. Journal of Applied Psychology, 75, 710-720.
70.
Millsap, R. E.
, & Hartog, S. B. (1988). Alpha, beta, and gamma change in evaluation research: A structural equation approach. Journal of Applied Psychology, 73, 574-584.
71.
Morita, J. G.
, Lee, T. W., & Mowday, R. T. (1989). Introducing survival analysis to organizational researchers: A selected application to turnover research. Journal of Applied Psychology, 74, 280-292.
72.
Muthen, B. O.
(1984). A general structural equation model with dichotomous, ordered categorical, and continuous latent variable indicators. Psychometrika, 49, 115-132.
73.
Muthen, B. O.
(1991). Analysis of longitudinal data using latent variable models with varying parameters. In L. M. Collins & J. L. Horn (Eds.), Best methods for the analysis of change (pp. 1-17). Washington, DC: American Psychological Association.
74.
Muthen, B. O.
(1996). Growth modeling with binary responses. In A. V. Eye & C. Clogg (Eds.), Categorical variables in developmental research: Methods of analysis (pp. 37-54). San Diego: Academic Press.
75.
Muthen, B. O.
(1997). Latent variable modeling of longitudinal and multilevel data. In A. E. Raftery (Ed.), Sociological methodology (pp. 453-480). Washington, DC: Blackwell.
76.
Muthen, B. O.
, & Curran, P. J. (1997). General longitudinal modeling of individual differences in experimental designs: A latent variable framework for analysis and power estimation. Psychological Methods, 2, 371-402.
77.
Nesselroade, J. R.
(1991). Interindividual differences in intraindividual change. In L. M. Collins & J. L. Horn (Eds.), Best methods for the analysis of change (pp. 92-105). Washington, DC: American Psychological Association.
78.
Raykov, T.
, & Widaman, K. F. (1995). Issues in applied structural equation modeling. Structural equation modeling, 2, 289-318.
79.
Reise, S. P.
, Widaman, K. F., & Pugh, R. H. (1993). Confirmatory factor analysis and item response theory: Two approaches for exploring measurement invariance. Psychological Bulletin, 114, 552-566.
80.
Rindskopf, F.
(1984). Using phantom and imaginary latent variables to parameterize constraints in linear structural models. Psychometrika, 49, 37-47.
81.
Rogosa, D. R.
(1995). Myths and methods: "Myths about longitudinal research" plus supplemental questions. In J. M. Gottman (Ed.), The analysis of change (pp. 3-66). Hillsdale, NJ: Lawrence Erlbaum.
82.
Rogosa, D. R.
, Brandt, D., & Zimowski, M. (1982). A growth curve approach to the measurement of change. Psychological Bulletin, 92, 726-748.
83.
Rogosa, D. R.
, & Willett, J. B. (1983). Demonstrating the reliability of the difference score in the measurement of change. Journal of Educational Measurement, 20, 335-343.
84.
Rogosa, D. R.
, & Willett, J. B. (1985). Understanding correlates of change by modeling individual differences in growth. Psychometrika, 50, 203-228.
85.
Rousseau, D. M.
(1985). Issues of level in organizational research: Multi-level and cross-level perspectives. In B. M. Staw & L. L. Cummings (Eds.), Research in organizational behavior (pp. 1-37). Greenwich, CT: JAI.
86.
Satorra, A.
, & Saris, W. E. (1985). Power of the likelihood ratio test in covariance structure analysis. Psychometrika, 50, 83-90.
87.
Schaubroeck, J.
, & Green, S. G. (1989). Confirmatory factor analytic procedures for assessing change during organizational entry. Journal of Applied Psychology, 74, 892-900.
88.
Schmitt, N.
(1982). The use of analysis of covariance structures to assess beta and gamma change. Multivariate Behavioral Research, 17, 343-358.
89.
Snow, R. E.
, & Lohman, D. L. (1984). Toward a theory of cognitive aptitude for learning from instruction. Journal of Educational Psychology, 76, 347-376.
90.
Sörbom, D.
(1974). A general method for studying differences in factor means and factor structures between groups. British Journal of Mathematical and Statistical Psychology, 27, 229-239.
91.
Steiger, J. H.
(1990). Structural model evaluation and modification: An interval estimation approach. Multivariate Behavioral Research, 25, 173-180.
92.
Stoolmiller, M.
(1994). Antisocial behavior, delinquent peer association and unsupervised wandering for boys: Growth and change from childhood to early adolescence. Multivariate Behavioral Research, 29, 263-288.
93.
Stoolmiller, M.
(1995). Using latent growth curve models to study developmental processes. In J. M. Gottman (Ed.), The analysis of change (pp. 103-138). Hillsdale, NJ: Lawrence Erlbaum.
94.
Stoolmiller, M.
, Duncan, T., Bank, L., & Patterson, G. R. (1993). Some problems and solutions in the study of change: Significant patterns in client resistance. Journal of Consulting and Clinical Psychology, 61, 920-928.
95.
Thompson, R. C.
, & Hunt, J. G. (1996). Inside the black box of alpha, beta, and gamma change: Using a cognitive-processing model to assess attitude structure. Academy of Management Review, 21, 655-690.
96.
Tisak, J.
, & Smith, C. S. (1994a). Defending and extending difference score methods. Journal of Management, 20, 675-682.
97.
Tisak, J.
, & Smith, C. S. (1994b). Rejoinder to Edward's comments. Journal of Management, 20, 675-682.
98.
Vandenberg, R. J.
, & Self, R. M. (1993). Assessing newcomers' changing commitments to the organization during the first 6 months of work. Journal of Applied Psychology, 75, 557-568.
99.
Werts, C. E.
, & Linn, R. L. (1970). A general linear model for studying growth. Psychological Bulletin, 73, 17-22.
100.
Willett, J. B.
(1989). Some results on reliability for the longitudinal measurement of change: Implications for the design of studies of individual growth. Educational and Psychological Measurement, 49, 587-602.
101.
Willett, J. B.
, & Sayer, A. G. (1994). Using covariance structure analysis to detect correlates and predictors of individual change over time. Psychological Bulletin, 116, 363-381.
102.
Willett, J. B.
, & Sayer, A. G. (1996). Cross-domain analyses of change over time: Combining growth modeling and covariance structure analysis. In G. A. Marcoulides & R. E. Schumacker (Eds.), Advanced structural equation modeling: Issues and techniques. Hillsdale, NJ: Lawrence Erlbaum.
103.
Williams, L. J.
(1995). Covariance structure modeling in organizational research: problems with the method versus applications of the method. Journal of Organizational Behavior, 16, 225-233.
104.
Williams, L. J.
, & Podsakoff, P. M. (1989). Longitudinal field methods for studying reciprocal relationships in organizational behavior: Toward improved causal analysis. In B. M. Staw & L. L. Cummings (Eds.), Research in organizational behavior (Vol. 2, pp. 247-292). Greenwich, CT: JAI.
105.
Zimmerman, D. W.
, & Williams, R. H. (1982). Gain scores in research can be highly reliable. Journal of Educational Measurement, 19, 149-154.
