Hedges and Olkin’s meta-analytic procedures for fitting parametric fixed effect categorical models to effect sizes have been widely used in research in experimental, social, and educational psychology. However, to date, this meta-analytic approach has been largely absent from the management literature in general and organizational behavior literature in particular. This article summarizes Hedges and Olkin’s meta-analytic method by (a) outlining the specific step-by-step analytical procedures, (b) using a simplified notational system, and (c) providing methodological and conceptual rationale for each analysis. The use of this approach can add considerable methodological power and provide a relevant meta-analytic alternative to the study of organizational behavior and management.
Get full access to this article
View all access options for this article.
References
1.
Alliger, G. M.
(1995). The small sample performance of four tests of the difference between pairs of meta-analytically derived effect sizes. Journal of Management, 21, 789-799.
2.
Behrens, J. T.
(1997). Principles and procedures of exploratory data analysis. Psychological Methods, 2, 131-160.
3.
Bullock, R. J.
, & Svyantek, D. J. (1985). Analyzing meta-analysis: Potential problems, an unsuccessful replication, and evaluation criteria. Journal of Applied Psychology, 70, 108-115.
4.
Campbell, D. T.
, & Stanley, J. C. (1963). Experimental and quasi-experimental designs for research. Chicago, IL: Rand McNally.
5.
Cook, T. D.
, & Campbell, D. T. (1977). Quasi-experimentation. Boston, MA: Houghton Mifflin.
6.
Cooper, H.
, & Hedges, L. V. (1994). Handbook of research synthesis. New York: Russell Sage.
7.
Cooper, H. M.
(1984). The integrative research review: A systematic approach. Beverly Hills, CA: Sage.
8.
Davis, T.R.V.
, & Luthans, F. (1984). Defining and researching leadership as a behavioral construct: An idiographic approach. Journal of Applied Behavioral Science, 20, 237-251.
9.
Friske, R.
, & Treines, G. (1985). Einführung in die metaanalyse. Bern: Hans Huber.
10.
Glass, G. V.
(1976a). Primary, secondary, and meta-analysis of research. Educational Researcher, 5, 3-8.
11.
Glass, G. V.
(1976b). Presidential address. Annual meeting of the American Educational Research Association, San Francisco.
12.
Glass, G. V.
, McGaw, B., & Smith, M. L. (1981). Meta-analysis in social research. Beverly Hills, CA: Sage.
13.
Hedges, L. V.
(1981). Distribution theory for Glass’s estimator of effect size and related estimators. Journal of Educational Statistics, 6, 107-128.
14.
Hedges, L. V.
(1982a). Fitting categorical models to effect sizes from a series of experiments. Journal of Educational Statistics, 7, 119-137.
15.
Hedges, L. V.
(1982b). Estimating effect sizes from a series of independent experiments. Psychological Bulletin, 92, 490-499.
16.
Hedges, L. V.
(1986). Issues in meta-analysis. Review of Research in Education, 13, 353-398.
17.
Hedges, L. V.
, & Olkin, I. (1985). Statistical methods for meta-analysis. San Diego, CA: Academic Press.
18.
Huffcutt, A. I.
, & Arthur, W. (1995). Development of a new outlier statistic for meta-analytic data. Journal of Applied Psychology, 80, 327-334.
19.
Hunter, J. E.
, & Schmidt, F. L. (1990). Methods of meta-analysis. Newbury Park, CA: Sage.
20.
Hunter, J. E.
, & Schmidt, F. L. (1995). Methods of meta-analysis: Correcting error and bias in research findings. Newbury Park, CA: Sage.
21.
Hunter, J. E.
, Schmidt, F. L., & Jackson, G. B. (1982). Meta-analysis. Beverly Hills, CA: Sage.
22.
Johnson, B. T.
, Mullen, B., & Salas, E. (1995). Comparison of three major meta-analytic approaches. Journal of Applied Psychology, 80, 94-106.
23.
Keppel, G.
(1991). Design and analysis. Englewood Cliffs, NJ: Prentice Hall.
24.
Light, R. J.
(Ed.). (1983). Evaluation studies review annual (Vol. 8). Beverly Hills, CA: Sage.
25.
Light, R. J.
, & Pillemer, D. B. (1984). Summing up: The science of reviewing research. Cambridge, MA: Harvard University Press.
26.
Light, R. J.
, Singer, J. D., & Willett. (1994). The visual presentation and interpretation of meta-analysis. In H. Cooper & L. V. Hedges (Eds.), Handbook of research synthesis (pp. 439-453). New York: Russell Sage.
27.
Nouri, H.
, & Greenberg, R. H. (1995). Meta-analytic procedures for estimation of effect sizes in experiments using complex analysis of variance. Journal of Management, 21, 801-812.
28.
Okun, M. A.
, Olding, R. W., & Cohn, C. M. (1990). A meta-analysis of subjective well being interventions among elders. Psychological Bulletin, 103, 257-265.
29.
Osburn, H. G.
, & Callender, J. (1992). A note on the sampling variance of the mean uncorrected correlation in meta-analysis and validity generalization. Journal of Applied Psychology, 77, 115-122.
30.
Rosenthal, R.
(Ed.). (1980). New directions for methodology of social and behavioral science: Quantitative assessment of research domains (No. 5). San Francisco, CA: Jossey-Bass.
31.
Rosenthal, R.
(1991a). Meta-analytic procedures for social research. Newbury Park, CA: Sage.
32.
Rosenthal, R.
(1991b). Meta-analytic procedures for social research (2nd ed.). Newbury Park, CA: Sage.
33.
Rosenthal, R.
(1994). Parametric measures of effect sizes. In H. Cooper & L. V. Hedges (Eds.), Handbook of research synthesis (pp. 231-244). New York: Russell Sage.
34.
Rosenthal, R.
, & Rosnow, R. L. (1985). Contrast analysis: Focused comparisons in the analysis of variance. New York: Cambridge University Press.
35.
Rosenthal, R.
, & Rosnow, R. L. (1991). Essential of behavioral research: Methods and data analysis (2nd ed.). New York: McGraw-Hill.
36.
Rosenthal, R.
, & Rubin, D. (1978). Interpersonal expectancy effects: The first 345 studies. Behavioral and Brain Sciences, 3, 377-415.
37.
Rosenthal, R.
, & Rubin, D. (1988). Comment: Assumptions and procedures in the file drawer problem. Statistical Science, 3, 120-125.
38.
Russell, G. J.
, & Gilliand, S. W. (1995). Why meta-analysis doesn’t tell us what the data really mean: Distinguishing between moderator effects and moderator processes. Journal of Management, 21, 813-831.
39.
Sackett, P. R.
, Tenopyr, M. L., Schmitt, N., & Kehoe, J. (1985). Commentary on forty questions about validity generalizations and meta-analysis. Personnel Psychology, 38, 697-798.
40.
Siegel, S.
, & Castellan, N. J. (1988). Nonparametric statistics. New York: McGraw Hill.
41.
Stajkovic, A. D.
, & Luthans, F. (1997). A meta-analysis of the effects of organizational behavior modification on task performance, 1975-95. Academy of Management Journal, 40, 1122-1149.
42.
Stajkovic, A. D.
, & Luthans, F. (1998). Self-efficacy and work-related performance: A metaanalysis. Psychological Bulletin, 12(4), 240-261.
43.
Tukey, J. W.
(1977). Exploratory data analysis. Reading, MA: Addison-Wesley.
44.
Walker, H. M.
, & Lev, J. (1953). Statistical inference. New York: Holt, Rinehart, & Winston.
45.
Williams, C. R.
, & Livingstone, L. (1994). Another look at the relationship between performance and voluntary turnover. Academy of Management Journal, 37, 269-298.
46.
Yeaton, W. H.
, & Wortman, P. M. (Eds.). (1984). New directions in program evaluation: Issues in data synthesis (No. 24). San Francisco, CA: Jossey-Bass.
