The direct product model is a new analysis tool for modeling multitrait-multimethod data. This model may avoid some of the problems associated with conventional analysis of multitrait-multimethod data by allowing for the possibility of multiplicative trait-method interactions. Based on the work of Browne (1984; 1990), we suggest several refinements in testing this model, including use of confirmatory procedures for testing model fit and implementation of a hierarchical approach to model comparisons. We provide an illustration of the refined direct product approach using a study of three types of organizational citizenship behavior. The results supply evidence for convergent and discriminant validity of the three constructs, and suggest that job incumbents, supervisors, and peers have significantly different perspectives of organizational citizenship behavior.
Get full access to this article
View all access options for this article.
References
1.
Bagozzi, R. P. (1993). Assessing construct validity in personality research: Applications to measures of self-esteem. Journal of Research in Personality, 27: 49-87.
2.
Bagozzi, R. P. & Yi, Y. (1990). Assessing method variance in multitrait-multimethod matrices: The case of self-reported affect and perceptions at work. Journal of Applied Psychology, 75: 547-560.
3.
Bagozzi, R. P. & Yi, Y. (1991). Multitrait-multimethod matrices in consumer research. Journal of Consumer Research, 17: 426-439.
4.
Bagozzi, R. P., Yi, Y., & Phillips, L. W. (1991). Assessing construct validity in organizational research. Administrative Science Quarterly, 36: 421-458.
5.
Bateman, T. S. & Organ, D. W. (1983). Job satisfaction and the good soldier: The relationship between affect and employee citizenship. Academy of Management Journal, 26: 587-595.
6.
Bentler. P. M. (1989). EQS structural equations program manual. Los Angeles: BMDP Statistical Software, Inc.
7.
Brannick, M. T. & Spector, P. E. (1990). Estimation problems in the block-diagonal model of the multitrait-multimethod matrix. Applied Psychological Measurement, 14: 325-339.
8.
Brief, A. P. & Motowidlo, S. J. (1986). Prosocial organizational behaviors. Academy of Management Review, 11: 710-725.
9.
Browne, M. W. (1984). The decomposition of multitrait-multimethod matrices. British Journal of Mathematical and Statistical Psychology, 37: 1-21
10.
Browne, M. W. (1990). MUTMUM PC user’s guide. Unpublished manuscript, The Ohio State University.
11.
Browne, M. W. & Cudeck, R. (1989). Single sample cross-validation indices for covariance structures. Multivariate Behavioral Research, 24: 445-455.
12.
Browne, M. W. & Cudeck, R. (1992). Alternative ways of assessing model fit. Sociological Methods and Research, 21: 230-258.
13.
Campbell, D. T. & Fiske, D. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56: 81-105.
14.
Campbell, D. T. & O’Connell, E. J. (1967). Method factors in multitrait-multimethod matrices: Multiplicative rather than additive?Multivariate Behavioral Research, 2: 409-426.
15.
Campbell, J. T., Dunnette, M. D., Lawler, E. E., III, & Weick, K. E., Jr. (1970). Managerial behavior. performance, and effectiveness. New York: McGraw-Hill.
16.
Coovert, M. D., Craiger, J. P., & Teachout, M. S. (1992). A comparison of additive versus multiplicative models/or multitrait-multimethod data. Paper presented at the annual meeting of the Society for Industrial and Organizational Psychology, Montreal, Quebec.
17.
Cudeck, R. (1988). Multiplicative models and MTMM matrices. Journal of Educational Statistics, 13: 131-147.
18.
Cudeck, R. & Browne, M. W. (1983). Cross-validation of covariance structures. Multivariate Behavioral Research, 18: 147-167.
19.
Dalton, D. R. & Cosier, R. A. (1988). Psychometric properties of the organizational citizenship scale. Educational and Psychological Measurement, 48: 479-482.
20.
Dillon, W. R., Kumar, A., & Mulani, N. (1987). Offending estimates in covariance structure analysis: Comments on the causes of and solutions to Heywood cases. Psychological Bulletin, 101: 126-135.
21.
Farh, J., Podsakoff, P. M., & Organ, D. W. (1988). Organizational citizenship behavior in the Pacific Rim: A constructive replication and extension of U.S. studies. Paper presented at the annual meeting of the Academy of Management Meeting, Anaheim, CA.
22.
Farh, J., Werbel, J. D., & Bedeian, A. G. (1988). An empirical investigation of self-appraisal-based performance evaluation. Personnel Psychology, 41: 141-156.
23.
George, J. M. (1990). Personality, affect, and behavior in groups. Journal of Applied Psychology, 75: 107-116.
24.
Graham, J. W. (1986). Organizational citizenship behavior informed by political theory. Paper presented at the annual meeting of the Academy of Management, Chicago, IL.
25.
Harris, M. M. & Schaubroeck, J. (1988). A meta-analysis of self-supervisor, self-peer, and peer-supervisor ratings. Personnel Psychology, 41: 43-62.
26.
James, L. R. (1973). Criterion models and construct validity for criteria. Psychological Bulletin, 80: 75-83.
27.
Joreskog, K. G. (1974). Analyzing psychological data by structural analysis of covariance matrices. Pp. 1-56 in R.C. Atkinson, D.H. Krantz, R.D. Lute, & P. Suppes (Eds.), Contemporary developments in mathematical psychology, Vol. 2. San Francisco: W.H.Freeman.
28.
Joreskog, K. G. & Sorbom, D. (1989). LISREL 7 user's reference guide. 1st ed.Mooresville, IN: Scientific Software.
29.
Kumar, A. & Dillon, W. R. (1992). An integrative look at the use of additive and multiplicative covariance structure models in the analysis of MTMM data. Journal of Marketing Research, 29: 51-64.
30.
Latham, G. P. & Wexley, K. N. (1981). Increasing productivity through performance appraisal. Reading, MA: Addison-Wesley.
31.
MacKenzie, S. B., Podsakoff, P. M., & Fetter, R. (1991). Organizational citizenship behavior and objective productivity as determinants of managerial evaluations of salespersons’ performance, Organizational Behavior and Human Decision Processes, 50: 123-150.
32.
Marsh, H. W. (1989). Confirmatory factor analyses of multitrait-multimethod data: Many problems and a few solutions. Applied Psychological Measurement, 13: 335-361.
33.
Marsh, H. W., Balla, J. R., & McDonald, R. P. (1988). Goodness-of-fit indexes in confirmatory factor analysis: The effect of sample size. Psychological Bulletin, 103: 391-410.
34.
Marsh, H. W. & Hocevar, D. (1988). A new, more powerful approach to multitrait-multimethod analyses: Application of second-order confirmatory factor analysis. Journal of Applied Psychology, 73: 107-117.
35.
Moorman, R. H. (1991). Relationship between organizational justice and organizational citizenship behaviors: Do fairness perceptions influence employee citizenship?Journal of Applied Psychology, 76: 845-855.
36.
Motowidlo, S. J., Packard, J. S., & Manning, M. R. (1986). Occupational stress: Its causes and consequences for job performance. Journal of Applied Psychology, 71: 618-629.
37.
O’Reilly, C. A., III & Chatman, J. (1986). Organizational commitment and psychological attachment: The effects of compliance, identification, and internalization on prosocial behavior. Journal of Applied Psychology, 71: 492-499.
38.
Organ, D. W. (1988a). Organizational citizenship behavior. Lexington, MA: Lexington Books.
39.
Organ, D. W. (1988b). A restatement of the satisfaction-performance hypothesis. Journal OS Management, 14: 547-557.
40.
Organ, D. W. (1990). The motivational basis of organizational citizenship behavior. Pp. 43-72 in B.M. Staw & L.L Cummings (Eds.), Research in organizational behavior, Vol. 12. Greenwich, CT: JAI.
41.
Organ, D. W. & Konovsky, M. (1989). Cognitive versus affective determinants of organizational citizenship behavior. Journal of Applied Psychology, 74: 157-164.
42.
Orr, I. M., Sackett. P. R., & Mercer, M. (1989). The role of prescribed and nonprescribed behaviors in estimating the dollar value of performance. Journal of Applied Psychology, 74: 34-40.
43.
Puffer, S. M. (1987). Prosocial behavior, noncompliant behavior, and work performance among commission salespeople. Journal of Applied Psychology, 721615-621.
44.
Schmitt, N. & Stults, D. M. (1986). Methodology review: Analysis of multitrait-multimethod matrices. Applied Psychological Measurement, 10: 1-22.
45.
Scholl, R. W., Cooper, E. A., & McKenna, J. F. (1987). Referent selection in determining equity perceptions: Differential effects on behavioral and attitudinal outcomes. Personnel Psychology, 40: 113-124.
46.
Smith, C. A., Organ, D. W., & Near, J. P. (1983). Organizational citizenship behavior: Its nature and antecedents. Journal of Applied Psychology, 68: 653-663.
47.
Steiger, J. H. (1990). Structural model evaluation and modification: An interval estimation approach. Multivariate Behavioral Research, 25: 173-180.
48.
Steiger, J. H. & Lind, J. (1980). Statistically based tests for the number of common factors. Paper presented at the annual meeting of the Psychometric Society, Iowa City, IA.
49.
Swain, A. J. (1975). Analysis of parametric structures for variance matrices. Unpublished doctoral dissertation, University of Adelaide, Australia.
50.
Vance, R. J., Coovert, M. D., MacCallum, R. C., & Hedge, J. W. (1989). Construct models of task performance. Journal of Applied Psychology, 74: 447-455.
51.
Vance, R. J., MacCallum, R. C., Coovert, M. D., & Hedge, J. W. (1988). Construct validity of multiple job performance measures using confirmatory factor analysis. Journal of Applied Psychology, 73: 74-80.
52.
Wherry, R. J., Sr., & Bartlett, C. J. (1982). The control of bias in ratings: A theory of rating. Personal Psychology, 35: 521-551.
53.
Widaman, K. F. (1985). Hierarchically nested covariance structure models for multitrait-multimethod data. Applied Psychological Measurement, 9: 1-26.
54.
Williams, L. (1988). Affeec, rive and nonafl&tive components of job satisfaction and organizational commitment as determinants of’ organizational citizenship and in-role behaviors. Unpublished doctoral dissertation, Bloomington, In: Indiana University.
55.
Williams, L. J. & Anderson, S. E. (1991). Job satisfaction and organizational commitment as predictors of organizational citizenship and in-role behaviors. Journal of Management, 17: 601-617.
56.
Wothke. W. & Browne, M. W. (1990). The direct product model for the MTMM matrix parameterized as a second order factor analysis model. Psychometrika, 55: 255-262.
