Despite the mounting number of criticisms of the use of a relatively restricted set of methodologies in the organizational sciences, few studies have attempted to empirically determine the extent of this restriction or the potential reasons why some methods are used so exclusively. For this review, the authors content-analyzed all of the articles from the 1985 volumes of the Academy of Management Journal, Administrative Science Quarterly, Journal of Applied Psychology, Journal of Management, and Organizational Behavior and Human Decision Processes to determine the range of strategies used in organizational research. Our analysis of the literature does, indeed, suggest that there is a relatively limited set of research strategies and analytical procedures that represent the "methods of choice" in the organizational sciences. Potential reasonsfor thesefindings, as well as some of their implications are provided.
Get full access to this article
View all access options for this article.
References
1.
Agar, M.H. (1986). Speaking of ethnography. Beverly Hills, CA: Sage Publications.
2.
Arkes, H.R., & Blumer, C. (1985). The psychology of sunk costs. Organizational Behavior and Human Decision Processes, 35, 124-140.
3.
Baggaley, A.R. (1981). Multivariate analysis: An introduction for consumers of behavioral research. Evaluation Review, 5, 123-131.
4.
Barley, S.R. (1986). Technology as an occasion for structuring: Evidence from observations of CT scanners and the social order of radiology departments. Administrative Science Quarterly, 31, 78-108.
5.
Boehm, V. (1980). Research in "The real world"-A conceptual model. Personnel Psychology, 33, 495-503.
6.
Bohrnstedt, G. (1975, October). Structural equations and the analysis of change. Presentation at the 28th annual meeting of the Gerontological Society, Louisville, Kentucky.
7.
Bray, J.H., & Maxwell, S.E. (1985). Multivariate analysis of variance. Beverly Hills, CA: Sage Publications.
8.
Campbell, J. R, Daft, R.L., & Hulin, C.L. (1982). What to study: Generating and developing research questions. Beverly Hills, CA: Sage Publications.
9.
Carlson, R. (1971). Where is the person in personality research?Psychological Bulletin, 75, 203-219.
10.
Coe, R., & Weinstock, I.1984. Evaluating the management journals: A second look. Academy of Management Journal, 27, 660-665.
11.
Cohen, J., & Cohen, P. (1983). Applied multiple regression/correlation analysisfor the behavioral sciences. Hillsdale, NJ: Lawrence Erlbaum Associates.
12.
Churchill, G.A. (1979). A paradigm for developing better measures of marketing constructs. Journal of Marketing Research, 16, 64-73.
13.
Christie, R. (1965). Some implications of research trends in social psychology. In O. Klineberg & R. Christie (Eds.), Perspectives in social psychology (pp. 141-152). New York: Holt, Rinehart & Winston.
14.
Cummings, L.L. (1978). Toward organizational behavior. Academy of Management Review, 3, 90-98.
15.
Daft, R.L.1980. The evolution of organization analysis in ASQ, 1959-1979. Administrative Science Quarterly, 25, 623-636.
16.
Dipboye, R.L., & Flanagan, M.E (1979). Research settings in industrial and organizational psychology: Are findings in the field more generalizable than in the laboratory?American Psychologist, 34, 141-150.
17.
Flanagan, M.E, & Dipboye, R.L. (1981). Research settings in industrial and organizational psychology: Facts, fallacies, and the future. Personnel Psychology, 34, 37-47.
18.
Fleishman, E.A. (1973). Twenty years of consideration and structure. In E.A. Fleishman & J.G. Hunt (Eds.), Current developments in the study of leadership (pp. 1-37). Carbondale, IL: Southern Illinois University Press.
19.
Ganster, D.C., Hennessey, H.W, & Luthans, F (1983). Social desirability responses effects: Three alternative models. Academy of Management Journal, 26, 321-331.
20.
Gieri, R.N. (in Press). A cognitive theory of science. Chicago: University of Chicago Press.
21.
Glass, G.., McGaw, B., & Smith, M.L. (1981). Meta-analysis in social research. Beverly Hills, CA: Sage Publications.
22.
Gordon, M., Kleiman, L., & Hanie, C. (1978). Industrial-organizational psychology: "Open thy ears, 0 house of Israel."American Psychologist, 32, 893-905.
23.
Gordon, M.E., Slade, L.A., & Schmitt, N. (1986). The "science of the sophomore" revisited: From conjecture to empiricism. Academy of Management Review, 11, 197-201.
24.
Gordon, M.E., Slade, L.A., & Schmitt, N. (1987). Student guinea pigs: Porcine predictors and particularistic phenomena. Academy of Management Review, 12, 160-163.
25.
Guba, E.G., & Lincoln, YS. (1982). Epistemological and methodological bases of naturalistic inquiry. Educational Communication and Technology Journal, 30, 233-252.
26.
Guzzo, R.S., Jackson, S.E., & Katzell, R.A. (in Press). Meta-analysis Analysis. In L.L. Cummings & B.M. Staw (Eds.), Research in Organizational Behavior (Vol. 9) Greenwich, CT: JAI Press.
27.
Hambrick, D.C. (1980). Operationalizing the concept of business-level strategy in research. Academy of Management Journal, 5, 567-575.
28.
Higbee, K.L., Lott, WJ., & Graves, PExperimentation and college students in social psychology research. Personality and Social Psychology Bulletin, 2, 239-241.
29.
Higbee, K.L., Millard, R.J., & Folkman, J.R. (1982). Social psychology research during the 1970's: Predominance of experimentation and college students. Personality and Social Psychology Bulletin, 8, 180-183.
30.
Higbee, K.I., & Wells, M.G. (1972). Some research trends in social psychology during the 1960's. American Psychologist, 27, 963-966.
31.
Howard, G.S., Maxwell, S.E., Berra, S.M., & Sternitzke, M.E. (1985). Institutional research productivity in industrial/organizational psychology. Journal of Applied Psychology, 70, 233-236.
32.
Hunter, J.E., Schmidt, EL., & Jackson, G.B. (1982). Meta-analysis: Cumulating researchfindings across studies. Beverly Hills, CA: Sage Publications.
33.
Jacoby, J. (1978). Consumer research: A state of the art review. Journal of Marketing, 42, 87-96.
34.
Kaplan, A. (1964). The conduct of inquiry. San Francisco: Chandler Publishing Co.
35.
Kerlinger, EN., & Pedhazur, E.J. (1973). Multiple regression in behavioral research. New York: Holt, Rinehart & Winston.
Kidder, L.H. (1981). Selltiz, Wrightsman and Cook's research methods in social relations. New York: Holt, Rinehart & Winston.
38.
Kilmann, R.H. (1979). On integrating knowledge utilization with knowledge development: The philosophy behind the MAPS design technology. Academy of Management Review, 4, 417-429.
39.
Kim, J., & Mueller, C.W (1978). Factor analysis: Statistical methods and practical issues. Beverly Hills, CA: Sage Publications.
40.
Kimberly, J.R. (1976). Issues in the design of longitudinal organizational research. Sociological Methods and Research, 4, 321-347.
41.
Kirk, J., & Miller, M.L. (1986). Reliability and validity in qualitative research. Beverly Hills, CA: Sage Publications.
42.
Knapp, T.R. (1978). Canonical correlation analysis: A general parametric significance-testing system. Psychological Bulletin, 85, 410-416.
43.
Kuhn, T.S. (1974). Second thoughts on paradigms. In F. Suppe (Ed.), The structure of scientific theories (pp. 459-482). Urbana, IL: University of Illinois Press.
44.
Lenz, R.T. (1981). Determinants of organizational performance: An interdisciplinary review. Strategic Management Journal, 2, 131-154.
45.
Levine, M.S. (1977). Canonical analysis andfactor comparison. Beverly Hills, CA: Sage Publications.
46.
Liker, J.K., Augustyniak, S., & Duncan, G.J. (1985). Panel data and models of change: A comparison of first difference and conventional two-wave models. Social Science Research, 14, 80-101.
47.
Lincoln, Y S., & Guba, E.G. (1985). Naturalistic Inquiry. Beverly Hills, CA: Sage.
48.
Locke, E.A. (1986). Generalizing from laboratory to field settings: Research findings from industrial-organizational psychology, organizational behavior, and human resources management. Lexington, MA: Lexington Books.
49.
Machiavelli, N. (1532/1952). The prince. New York: Mentor. (Original work published 1532) 1952.
50.
McGuire, J. B. (1986). Management and research methodology. Journal of Management, 12, 5-17.
51.
Mitchell, T.R. (1985). An evaluation of the validity of correlational research conducted in organizations. Academy of Management Review, 10, 192-205.
52.
Morgan, G., & Smircich, L. (1980). The case for qualitative research. Academy of Management Review, 5, 491-500.
53.
Muchinsky, PM. (1979). Some changes in the characteristics of articles published in the Journal of Applied Psychology over the past 20 years. Journal of Applied Psychology, 64, 455-459.
54.
Phillips, J.S., & Lord, R.G. (1986). Notes on the practical and theoretical consequences of implicit leadership theories for the future of leadership measurement. Journal of Management, 12, 21-42.
Price, R.L. (1985). A customer's view of organizational literature. In L.L. Cummings & PJ. Frost (Eds.), Publishing in the organizational sciences (pp. 125-132). Homewood, IL: Irwin.
57.
Rogers, E.M. (1983). Diffusion of innovations (3rd Ed.). New York: Free Press.
58.
Rosenthal, R. (1984). Meta-analytic procedures for social research. Beverly Hills, CA: Sage Publications.
59.
Rosnow, R.L. (1981). Paradigms in transition: The methodology of social inquiry. New York: Oxford University Press.
60.
Sackett, PR., Tenopyr, M.L., Schmitt, N., & Kehoe, J. (1985). Commentary on forty questions about validity generalization. Personnel Psychology, 38, 697-798.
61.
Sashkin, M., & Garland, H. (1979). Laboratory and field research on leadership: Integrating divergent streams. In J.G. Hunt & L.L. Larson (Eds.), Crosscurrents in leadership (pp. 64-87). Carbondale, IL: Southern Illinois University Press.
62.
Schneider, B. (1985). Organizational behavior. In M.R. Rosenzweig & L.W Porter (Eds.), Annual review of psychology (Vol. 36, pp. 573-611). Palo Alto, CA: Annual Reviews Inc.
63.
Schwab, D.P (1980). Construct validity in organizational behavior. In B.M. Staw & L.L. Cummings (Eds.), Research in organizational behavior (pp. 3-44). Greenwich, CT: JAI Press.
64.
Schmidt, EL., Pearlman, D., Hunter, J.E., & Hirsh, H.R. (1985). Forty questions about validity generalization and meta-analysis. Personnel Psychology, 38, 697-798.
65.
Schultz, D. R (1969). The human subject in psychological research. Psychological Bulletin, 72, 214-228.
66.
Sears, D.O. (1986). College sophomores in the laboratory: Influences of a narrow data base on social psychology's view of human nature. Journal of Personality and Social Psychology, 51, 515-530.
67.
Sims, H.P., Jr. (1979). Limitations and extensions to questionnaires in leadership research. In J.G. Hunt & L.L. Larson (Eds.), Crosscurrents in leadership (pp. 209-221). Carbondale, IL: Southern Illinois University Press.
68.
Smart, R.G. (1966). Subject selection bias in psychological research. The Canadian Psychologist, 7, 115-121.
69.
Strasser, S., & Bateman, T.S. (1984). What we should study, problems we should solve: Perspectives of two constituencies. Personnel Psychology, 37, 77-92.
70.
Susman, G.I., & Evered, R.D. (1978). An assessment of the scientific merits of action research. Administrative Science Quarterly, 23, 582-603.
71.
Tatsuoka, M.M. (1973). Multivariate analysis in educational research. In EN. Kerlinger (Ed.), Review of research in education (pp. 879-892). Itasca, IL: Peacock.
72.
Thomas, K.W, & Tymon, WG., Jr. (1982). Necessary properties of relevant research: Lessons from the recent criticisms of the organizational sciences. Academy of Management Review, 7, 345-352.
73.
Thompson, B. (1984). Canonical correlation analysis: Uses and interpretation. Beverly Hills, CA: Sage Publications.
74.
Thorndike, R.M. (1977). Canonical analysis and predictor selection. Journal of Multivariate Behavioral Research, 12, 75-87.
75.
Tosi, H. (1979). The need for theoretical development in organizational behavior: Or, if the past is prologue in organizational behavior, economics will be replaced as the dismal science. Exchange: The organizational behavior teaching journal, 4 (3), 5-7.
76.
Tversky, A., & Kahneman, D. (1974). Judgment under uncertainty: Heuristics and biases. Science, 183, 1124-1131.
77.
Van Maanen, J., Dabbs, J.M., Faulkner, R.R. (1982). Varieties of qualitative research. Beverly Hills, CA: Sage Publications.
78.
Venkatraman, N., & Grant, J.H. (1986). Construct measurement in organizational strategy research: A critique and proposal. Academy of Management Review, 11, 71-87.
