In recent years, there has been an increase in the reporting of effect size information. This paper (a) provides a review of commonly used effect size indices, (b) highlights some common misconceptions about effect size estimates, and (c) introduces a number of infrequently used effect size measures which depending upon the research context and the audience may better communicate the importance of the relationship between two variables.
Get full access to this article
View all access options for this article.
References
1.
Abelson, R.P.1995. Statistics as principled argument. Hillsdale, NJ: Erlbaum.
2.
Anders, G.October 15, 1996. Who pays cost of cut-rate heart care?Wall Street Journal, B1–B1, B9–B9.
3.
Barrick, M. R., & Mount, M. K.1991. The big five personality dimensions and job performance: A meta-analysis. Personnel Psychology, 44: 1–26.
4.
Bobko, P.1995. Correlation and regression: Principles and applications for industrial/organizational psychology and management. New York: McGraw-Hill.
5.
Carroll, J. B.1961. The nature of the data, or how to choose a correlation coefficient. Psychometrika, 26: 347–372.
6.
Cohen, J.1988. Statistical power analysis for the behavioral sciences. Hillsdale, NJ: Erlbaum.
7.
Cortina, J. M. & Nouri, H.2000. Effect sizes for ANOVA designs. Thousand Oaks, CA: Sage.
8.
Darlington, R. B.1968. Multiple regression in psychological research and practice. Psychological Bulletin, 69: 161–182.
9.
Dunlap, W. P.1994. Generalizing the common language effect size indicator to bivariate normal correlations. Psychological Bulletin, 116: 509–511.
10.
Fichman, M.1999. Variance explained: Why size does not (always) matter. In B. M. Staw (Ed.). Research in Organizational Behavior, 21, 295–331.
11.
Fleiss, J. L.1994. Measures of effect size for categorical data. In H. Cooper & L. V. Hedges (Eds.). The handbook of research synthesis: 246–259. New York: Russell Sage Foundation.
12.
George, J. M.1992. The role of personality in organizational life: Issues and evidence. Journal of Management, 18: 185–213.
13.
Haddock, C. K., Rindskopf, D., & Shadish, W. R.1998. Using odds ratios as effect sizes for meta-analysis of dichotomous data: A primer on methods and issues. Psychological Methods, 3: 339–353.
14.
Hough, L. M. & Schneider, R. J.1996. Personality traits, taxonomies, and applications in organizations. In K. R. Murphy (Ed.), Individual differences and behavior in organizations: 31–88. San Francisco: Jossey-Bass.
15.
Hunter, J. E. & Schmidt, F. L.1990. Methods of meta-analysis. Newbury Park, CA: Sage.
16.
Judd, C. M., McClelland, G. H., & Culhane, S. E.1995. Data analysis: Continuing issues in the everyday analysis of psychological data. Annual Review of Psychology, 46: 433–465.
17.
Judge, T. A., Cable, D. M., Boudreau, J. W., & Bretz, R. D.1995. An empirical investigation of the predictors of executive career success. Personnel Psychology, 48: 485–519.
18.
Kirk, R.1996. Practical significance: A concept whose time has come. Educational and Psychological Measurement, 56: 746–759.
19.
Long, J. S.1997. Regression models for categorical and limited dependent variables. Thousand Oaks, CA: Sage.
20.
Lubinski, D., & Humphreys, L. G.1997. Incorporating general intelligence into epidemiology and social sciences. Intelligence, 24: 159–201.
21.
Martell, R. F., Lane, D. M., & Emrich, C.1996. Male–female differences: A computer simulation. American Psychologist, 51: 157–158.
22.
McDonald, R. P.1999. Test theory. Mahwah, NJ: Lawrence Erlbaum Associates.
23.
Maxwell, S. E., & Delaney, H. D.1990. Designing experiments and analyzing data. Belmont, CA: Wadsworth.
24.
McEvoy, G. M., & Cascio, W. F.1985. Strategies for reducing employee turnover: A meta-analysis. Journal of Applied Psychology, 70: 343–353.
25.
McGraw, K. O., & Wong, S. P.1992. A common language effect size statistic. Psychological Bulletin, 111: 361–365.
26.
Nunnally, J. C.1978. Psychometric theory. New York: McGraw-Hill.
27.
Oakes, M.1986. Statistical inference: A commentary for the social and behavioural sciences. Chichester, England: John Wiley and Sons.
28.
Pampel, F. C.2000. Logistic regression: A primer. Thousand Oaks, CA: Sage.
29.
Pedhazur, E. J.1997. Multiple regression in behavioral research. Fort Worth, TX: Harcourt Brace.
30.
Phillips, J. M.1998. Effects of realistic job previews on multiple organizational outcomes: A meta-analysis. Academy of Management Journal, 41: 673–690.
31.
Premack, S. L., & Wanous, J. P.1985. A meta-analysis of realistic job preview experiments. Journal of Applied Psychology, 70: 706–719.
32.
Prentice, D. A., & Miller, D. T.1992. When small effects are impressive. Psychological Bulletin, 112: 160–164.
33.
Psychology, Public Policy and Law. 1999, 5–5.
34.
Richardson, J. T.1996. Measures of effect size. Behavioral Research Methods, Instruments, & Computers, 28: 12–22.
35.
Rosenthal, R.1990. How are we doing in soft psychology?American Psychologist, 45: 775–777.
36.
Rosenthal, R.1994. Parametric measures of effect size. In H. Cooper & L. V. Hedges (Eds.). The handbook of research synthesis: 231–244. New York: Russell Sage.
37.
Rosenthal, R., Rosnow, R. L., & Rubin, D. B.2000. Contrasts and effect sizes in behavioral research. New York: Cambridge University Press.
38.
Rudas, T.1998. Odds ratios in the analysis of contingency tables. Thousand Oaks, CA: Sage.
39.
Tryon, W. W.2001. Evaluating statistical difference, equivalence, and indeterminancy using inferential confidence intervals: An integrated alternative method of conducting null hypothesis significance tests. Psychological Methods, 6: 371–386.