Strategic management researchers have measured business economic performance (BEP) through either perceptual assessments of senior executives or secondary data sources, but few explicitly evaluate the degree of convergence across methods. In an effort to examine method convergence, we collected data on three dimensions-sales growth, net income growth, and profitability (ROI) using both methods. Although convergent and discriminant validity were achieved using Campbell and Fiske's Multi Trait, Multi Method (MTMM) and Confiratory Factor Analysis (CFA), the approaches yielded different insights. The advantages of CFA over MTMM is demonstrated with implications for strategy research.
Get full access to this article
View all access options for this article.
References
1.
Anderson, J.C. & Gerbing, D.W (1984). The effect of sampling error on convergence, improper solutions, and goodness-of-fit indices for maximum likelihood confirmatory factor analysis. Psychometrika, 49, 155-173.
2.
Bagozzi, R.P (1980). Causal models in marketing, N.Y: Wiley.
3.
Bagozzi, R.P. (1981). An examination of the validity of two models of attitude. Multivariate Behavioral Research, 16, 323-359.
4.
Bagozzi, R.P, & Phillips, L.W (1982). Representing and testing organizational theories: A holistic construal. Administrative Science Quarterly, 27, 459-489.
5.
Bearden, W O., Sharma, S., & Teel, J.H. (1982). Sample size effects on chi-square and other statistics used in evaluating causal models. Journal of Marketing Research, 19, 425-430.
6.
Bentler, P.M. & Bonett, D.G. (1980). Significance tests and goodness of fit in the analysis of covariance structures. Psychological Bulletin, 88, 588-606.
7.
Bouchard, T J., Jr. (1976). Unobtrusive measures: An inventory of uses. Sociological Methods and Research, 4, 267-300.
8.
Campbell, D.T., & Fiske, D. W (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56, 81-105.
9.
Campbell, J.P. (1977). On the nature of organizational effectiveness. In Goodman, P.S., Pennings, J.M. & Associates. New perspectives on organizational effectiveness (pp. 13-55). San Francisco: Jossey-Bass.
Denzin, N.K. (1978). The research act (2nd ed.). New York: McGraw-Hill.
12.
Dess, G.G., & Robinson, R.B. (1984). Measuring organizational performance in the absence of objective measures: The case of the privately-held firm and conglomerate business unit. Strategic Management Journal, 5, 265-273.
13.
Farh, J.L., Hoffman, R.C., & Hegarty, W.H. (1984). Assessing environmental scanning at the subunit level: A multitrait multimethod analysis. Decision Sciences, 15, 197-220.
14.
Ford, J.D., & Schellenberg, D.A. (1982). Conceptual issues of linkage in the assessment of organizational performance. Academy of Management Review, 7, 49-58.
15.
Fornell, C. (Ed.). (1982). A second generation of multivariate analysis. N.Y: Praeger.
16.
Fornell, C., & Larcker, D.F (1981). Evaluating structural equation models with unobservable variables and measurement error, Journal of Marketing Research, 18, 39-50.
17.
Fredrickson, J.W, & Mitchell, T.R. (1984). Strategic decision processes: Comprehensiveness and performance in an industry with an unstable environment. Academy of Management Journal, 27, 399-423.
18.
Hofer, C.W (1983). ROVA: A new measure for assessing organizational performance. In R. Lamb (Ed.), Advances in strategic management (Vol. 2, pp. 43-55). New York: JAI Press.
19.
Huber, G., & Power, D. (1985). Retrospective reports of strategic-level managers. Strategic Management Journal, 6, 171-180.
20.
Jick, T.D. (1979). Mixing qualitative and quantitative methods: Triangulation in action. Administrative Science Quarterly, 24, 602-611.
Joreskog, K.G. (1979). Author's addendum to: A general approach to confirmatory maximum likelihood factor analysis. In K.G. Joreskog and D. Sorbom (Eds.), Advances infactor analysis and structural equation models (pp. 40-43). Cambridge, Mass: Abt Books.
23.
Joreskog, K.G., & Sorbom, D. (1978). Analysis of linear structural relationships by method of maximum likelihood. Chiago, IL: National Educational Resources.
24.
Joreskog, K.G., & Sorbom, D. (1979). Advances in factor analysis and structural equation models. Mass.: Abt Books.
25.
Kanter, R.M., & Brinkerhoff, D. (1981). Organizational performance: Recent developments in measurement. Annual Review of Sociology, 7, 322-349.
26.
Kirchoff, B. (1977). Organization effectiveness measurement and policy research. Academy of Management Review, 2, 347-355.
27.
Lawley, D.N., & Maxwell, A.E. (1971). Factor analysis as a statistical method. London: Butterworth.
28.
Long, J.S. (1983). Confirmatory factor analysis. Sage University Paper Series on Quantitative Application in the Social Sciences, 07-033. Beverly Hills and London: Sage Publications.
29.
Phillips, L.W (1981). Assessing measurement error in key informant reports: A methodological note on organizational analysis in marketing. Journal of Marketing Research, 5, 395-415.
30.
Ramanujam, V., Venkatraman, N., & Camillus, J.C. (1986). Multi-objective assessment of the effectiveness of strategic planning: A discriminant analysis approach. Academy of Management Journal, 26, 347-372.
31.
Rindskopf, D. (1983). Parametrizing inequality constraints on unique variances in linear structural models. Psychometrika, 48, 73-83.
32.
Rohner, R.P. (1977). Advantages of the comparative method of anthropology. Behavioral Science Research, 12, 117-144.
33.
Rosenberg, B., & Houghlet, M. (1974). Error rates in CRSP and COMPUSTAT databases and their implications. Journal of Finance, 1303-1310.
34.
San Miguel, J.G. (1977). The reliability of R&D data in COMPUSTAT and 10-K reports. The Accounting Review, 52, 638-641.
35.
Schendel, D.E., & Hofer, C.W (eds.) (1979). Strategic management: A new view of business policy and planning. Boston: Little, Brown.
36.
Seashore, S.E., & Yuchtman, E. (1967). Factoral analysis of organizational performance. Administrative Science Quarterly, 12, 377-395.
37.
Sobel, M.E., & Bohrnstedt, G.W (1985). Use of null models in evaluating the fit of covariance structure models. In Nancy B. Tuma (Ed.), Sociological Methodology - 1985 (pp. 152-178). San Francisco: Jossey-Bass.
38.
Steers, R. (1975). Problems in measurement of organizational effectiveness. Administrative Science Quarterly, 20, 546-558.
39.
Steers, R. (1977). Organizational effectiveness: A behavioral view. The Goodyear series in management and organizations. Santa Monica, CA: Goodyear.
40.
Venkatraman, N. (1985). Strategic orientation of business enterprises: The construct and its measurement. Unpublished doctoral dissertation, University of Pittsburgh, Pittsburgh.
41.
Venkatraman, N., & Grant, J.H. (1986). Construct measurement in organizational strategy research: A critique and proposal. Academy of Management Review, 11, 71-87.
42.
Venkatraman, N., & Ramanujam, V. (1986). Measurement of business performance in strategy research: A comparison of approaches. Academy of Management Review, 11, 801-814.
43.
Venkatraman, N., & Ramanujam, V. (in press). Planning system success: A conceptualization and an operational model. Management Science.
44.
Werts, C.E., Linn, R.N., & Joreskog, K.G. (1974). Interclass reliability estimates: Testing structural assumptions. Educational and Psychological Measurement, 34, 25-33.
45.
Woo, C.Y., & Willard, G. (1983, August) Performance representation in strategic management research: Discussions and recommendations. Paper presented at the meeting of the Academy of Management, Dallas, TX.
