A taxonomy of covariance structure models for rep resenting multitrait-multimethod data is presented. Us ing this taxonomy, it is possible to formulate alternate series of hierarchically ordered, or nested, models for such data. By specifying hierarchically nested models, significance tests of differences between competing models are available. Within the proposed framework, specific model comparisons may be formulated to test the significance of the convergent and the discriminant validity shown by a set of measures as well as the ex tent of method variance. Application of the proposed framework to three multitrait-multimethod matrices al lowed resolution of contradictory conclusions drawn in previously published work, demonstrating the utility of the present approach.
Get full access to this article
View all access options for this article.
References
1.
Althauser, R.P. (1974). Inferring validity from the multitrait-multimethod matrix: Another assessment. In H. L. Costner (Ed.), Sociological methodology 1973-1974 (pp. 106-127). San Francisco: Jossey-Bass.
2.
Althauser, R.P., & Heberlein, T.A. (1970). Validity and the multitralt-multimethod matrix. In E. F. Borgatta & G. W. Bohrnstedt (Eds.), Sociological methodology 1970 (pp. 151-169). San Francisco: Jossey-Bass .
3.
Althauser, R.P., Heberlein, T.A., & Scott, R.A. (1971). A causal assessment of validity: The augmented multitrait-multimethod matrix. In H. M. Blalock, Jr. (Ed.), Causal models in the social sciences (pp. 374-399). Chicago: Aldine.
4.
Alwin, D.F. (1974). Approaches to the interpretation of relationships in the multitrait-multimethod matrix. In H. L. Costner(Ed.), Sociological methodology 1973-1974 (pp. 79-105). San Francisco: Jossey-Bass.
5.
Bagozzi, R.P. (1978). The construct validity of the affective, behavioral, and cognitive components of attitude by analysis of covariance structures . Multivariate Behavioral Research, 13, 9-31.
6.
Bagozzi, R.P. (1980). Causal models in marketing. New York: Wiley.
7.
Bentler, P.M. (1980). Multivariate analysis with latent variables: Causal modeling. Annual Review of Psychology, 31, 419-456.
8.
Bentler, P.M., & Bonett, D.G. (1980). Significance tests and goodness of fit in the analysis of covariance structures. Psychological Bulletin,88, 588-606.
9.
Bentler, P.M., & Lee, S.Y. (1979). A statistical development of three-mode factor analysis. British Journal of Mathematical and Statistical Psychology, 32, 87-104.
10.
Boruch, R.F., & Wolins, L. (1970). A procedure for estimation of trait, method, and error variance attributable to a measure. Educational and Psychological Measurement, 30, 547-574.
11.
Browne, M.W. (1984). The decomposition of multitrait-multimethod matrices . British Journal of Mathematical and Statistical Psychology , 37, 1-21.
12.
Campbell, D.T., & Fiske, D.W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin,56, 81-105.
13.
Cliff, N. (1983). Some cautions concerning the application of causal modeling methods. Multivariate Behavioral Research, 18, 115-126.
Duncan, O.D. (1975). Introduction to structural equation models. New York: Academic Press.
17.
Golding, S.L. (1977). Method variance, inadequate constructs, or things that go bump in the night?Multivariate Behavioral Research , 12, 89-98.
18.
Golding, S.L., & Seidman, E. (1974). Analyses of multitrait-multimethod matrices: A two step principal components procedure. Multivariate Behavioral Research, 9, 479-496.
Hubert, L.J., & Baker, F.B. (1979). A note on analyzing the multitrait-multimethod matrix: An application of a generalized proximity function comparison. British Journal of Mathematical and Statistical Psychology, 32, 179-184.
21.
Jackson, D.N. (1969). Multimethod factor analysis in the evaluation of convergent and discriminant validity. Psychological Bulletin,72, 30-49.
22.
Jackson, D.N. (1971). Comments on "Evaluation of multimethod factor analysis." Psychological Bulletin,75, 421-423.
Jackson, D.N. (1977). Distinguishing trait and method variance in multitrait-multimethod matrices: A reply to Golding. Multivariate Behavioral Research , 12, 99-110.
25.
Jöreskog, K.G. (1969). A general approach to confirmatory maximum likelihood factor analysis. Psychometrika, 34, 183-202.
26.
Jöreskog, K.G. (1971). Statistical analysis of sets of congeneric tests . Psychometrika, 36, 109-133.
27.
Jöreskog, K.G. (1974). Analyzing psychological data by structural analysis of covariance matrices. In R. C. Atkinson , D. H. Krantz, R. D. Luce, & P. Suppes (Eds.), Contemporary developments in mathematical psychology (Vol. 2, pp. 1-56). San Francisco: W. H. Freeman.
28.
Jöreskog, K.G., & Sörbom, D. (1981). LISREL V: Analysis of linear structural relations by maximum likelihood and least squares methods (user's guide). Chicago: International Educational Resources.
29.
Kalleberg, A.L., & Kluegel, J.R. (1975). Analysis of the multitrait-multimethod matrix: Some limitations and an alternative. Journal of Applied Psychology , 60, 1-9.
30.
Kenny, D.A. (1976). An empirical application of confirmatory factor analysis to the multitrait-multimethod matrix. Journal of Experimental Social Psychology, 12, 247-252.
31.
Kenny, D.A. (1979). Correlation and causality. New York: Wiley.
32.
Kothandapani, V. (1971). Validation of feeling, belief, and intention to act as three components of attitude and their contributions to prediction of contraceptive behavior. Journal of Personality and Social Psychology, 19, 321-333.
33.
Lawler, E.E., III. (1967). The multitrait-multirater approach to measuring managerial job performance. Journal of Applied Psychology , 51, 369-381.
34.
Lee, S.Y. (1980). Estimation of covariance structure models with parameters subject to functional restraints. Psychometrika , 45, 309-324.
35.
Marsh, H.W., & Hocevar, D. (1983). Confirmatory factor analysis of multitrait-multimethod matrices. Journal of Educational Measurement, 20, 231-248.
36.
Ostrom, T.M. (1969). The relationship between the affective, behavioral, and cognitive components of attitude. Journal of Experimental Social Psychology, 5, 12-30.
37.
Rindskopf, D. (1983). Parameterizing inequality constraints on unique variances in linear structural models. Psychometrika, 48, 73-83.
38.
Schmitt, N. (1978). Path analysis of multitrait-multimethod matrices . Applied Psychological Measurement, 2, 157-173.
39.
Schmitt, N., Coyle, B.W., & Saari, B.B. (1977). A review and critique of analyses of multitrait-multimethod matrices. Multivariate Behavioral Research, 12, 447-478.
40.
Schmitt, N., & Saari, B.B. (1978). Behavior, situation, and rater variance in descriptions of leader behaviors. Multivariate Behavioral Research, 13, 483-495.
41.
Schwarzer, R. (1982). Convergent and discriminant validation in personality assessment: Techniques for distinguishing trait and method variance. Paper presented at the meeting of the American Educational Research Association, New York.
42.
Tucker, L.R., & Lewis, C. (1973). A reliability coefficient for maximum likelihood factor analysis. Psychometrika, 38, 1-10.
