Depending on how one interprets what an effect size index is, it may be claimed that its history started around 1940, or about 100 years prior to that. An attempt is made in this article to trace histories of a variety of effect size indices. Effect size bases discussed pertain to (a) relationship, (b) group differences, and (c) group overlap. Multivariable as well as univariate indices are considered in reviewing the histories.
Get full access to this article
View all access options for this article.
References
1.
Alf, E. , & Abrahams, N. M. (1968). Relationship between percent overlap and measures of correlation. Educational and Psychological Measurement, 28, 779-792.
2.
American Psychological Association . (2001). Publication manual of the American Psychological Association (5th ed.). Washington, DC: Author.
3.
Anderson, D. R. , Burnham, K. P., & Thompson, W. L. (2000). Null hypothesis testing: Problems, prevalence, and an alternative. Journal of Wildlife Management, 64, 912-923.
4.
Berkson, J. (1942). Tests of significance considered as evidence. American Statistical Association Journal, 33, 325-335.
5.
Cohen, J. (1962). The statistical power of abnormal-social psychological research: A review. Journal of Abnormal and Social Psychology, 65, 145-153.
6.
Cohen, J. (1969). Statistical power analysis for the behavioral sciences. New York: Academic Press.
7.
Cohen, J. (1977). Statistical power analysis for the behavioral sciences. New York: Academic Press.
8.
Cooley, W. W. , & Lohnes, P. R. (1971). Multivariate data analysis. New York: Wiley.
9.
Cortina, J. M. , & Nouri, H. (2000). Effect size for ANOVA designs. Thousand Oaks, CA: Sage.
10.
Cowles, M. (1989). Statistics in psychology: An historical perspective. Hillsdale, NJ: Lawrence Erlbaum.
11.
Cramér, H. (1946). Mathematical methods of statistics. Princeton, NJ: Princeton University Press.
12.
Cramer, E. M. , & Nicewander, W. A. (1979). Some symmetric, invariant measures of multivariate association. Psychometrika, 44, 43-54.
13.
Diamond, S. (1959). Information and error. New York: Basic Books.
14.
Dunnette, M. D. (1966). Personnel selection and placement. Belmont, CA: Wadsworth.
15.
Edgeworth, F. W. (1892). Correlated averages. Philosophical Magazine (5th series), 34, 190-204.
16.
Elmore, F. (2001, April). A primer on basic effect size concepts. Paper presented at the annual meeting of the American Educational Research Association, Seattle, WA.
17.
Elster, R. S. , & Dunnette, M. D. (1971). The robustness of Tilton’s measure of overlap. Educational and Psychological Measurement, 31, 685-697.
18.
Eysenck, H. J. (1971). Race, intelligence and education. London: Temple Smith.
19.
Fern, E. F. , & Monroe, K. B. (1996). Effect-size estimates: Issues and problems in interpretation. Journal of Consumer Research, 23, 80-105.
20.
Fisher, R. A. (1924). On a distribution yielding the error functions of several well known statistics. Proceedings of the International Congress of Mathematics, 2, 805-813.
21.
Fisher, R. A. (1925). Statistical methods for research workers. Edinburgh, UK: Oliver and Boyd.
22.
Fisher, R. A. (1935). The design of experiments. Edinburgh, UK: Oliver and Boyd.
23.
Fleiss, J. L. (1994). Measures of effect size for categorical data. In H. Cooper & L. V. Hedges (Eds.), The handbook of research synthesis (pp. 245-260). New York: Russell Sage Foundation.
24.
Galton, F. (1988). Co-relations and their measurement. Proceedings of the Royal Society of London, 45, 135-145.
25.
Glass, G. V (1976). Primary, secondary, and meta-analysis of research. Educational Researcher, 5, 3-8.
26.
Glass, G. V , & Hakstian, A. R. (1969). Measures of association in comparative experiments: Their development and interpretation. American Educational Research Journal, 6, 403-414.
27.
Hald, A. (1998). A history of mathematical statistics from 1750 to 1930. New York: Wiley.
28.
Hays, W. L. (1963). Statistics for psychologists. New York: Holt, Rinehart & Winston.
29.
Hedges, L. V. (1981). Distribution theory for Glass’s estimator of effect size and related estimators. Journal of Educational Statistics, 6, 107-128.
30.
Hess, B. , Olejnik, S., & Huberty, C. J (2001). The efficacy of two improvement-over-chance effect sizes for two-group univariate comparisons under variance heterogeneity and nonnormality. Educational and Psychological Measurement, 61, 909-936.
31.
Hogarty, K. Y. , & Kromrey, J. D. (2001, April). We’ve been reporting some effect sizes: Can we guess what they mean? Paper presented at the annual meeting of the American Educational Research Association, Seattle, WA.
32.
Huberty, C. J (1994a). Applied discriminant analysis. New York: Wiley.
33.
Huberty, C. J (1994b). A note on interpreting an R2 value. Journal of Educational and Behavioral Statistics, 19, 351-356.
34.
Huberty, C. J , & Holmes, S. E. (1983). Two-group comparisons and univariate classification. Educational and Psychological Measurement, 43, 15-26.
35.
Huberty, C. J , & Lowman, L. L. (2000). Group overlap as a basis for effect size. Educational and Psychological Measurement, 60, 543-563.
36.
Johnson, N. L. , & Kotz, S. (Eds.). (1997). Leading personalities in statistical sciences. New York: Wiley.
37.
Kelley, T. L. (1920). Measurement of overlapping. Journal of Educational Psychology, 11, 458-461.
38.
Kelley, T. L. (1923). Statistical method. New York: Macmillan.
39.
Kelley, T. L. (1935). An unbiased correlation ratio. Proceedings of the National Academy of Sciences, 21, 554-559.
40.
Kirk, R. E. (1996). Practical significance: A concept whose time has come. Educational and Psychological Measurement, 56, 746-759.
41.
Kirk, R. E. (in press). The importance of effect magnitude. In S. F. Davis (Ed.), Handbook of research methods in experimental psychology. Oxford, UK: Blackwell.
42.
Kraemer, H. C. , & Andrews, G. (1982). A nonparametric technique for meta-analysis effect size calculation. Psychological Bulletin, 91, 404-412.
43.
Levy, P. (1967). Substantive significance of significant differences between two groups. Psychological Bulletin, 67, 37-40.
44.
MacKenzie, D. A. (1981). Statistics in Britain, 1865-1930. Edinburgh, UK: Edinburgh University Press.
45.
Maxwell, S. E. (2000). Sample size and multiple regression analysis. Psychological Methods, 5, 434-458.
46.
Moore, D. S. (2000). The basic practice of statistics. New York: Freeman.
47.
Morrison, D. E. , & Henkel, R. E. (Eds.). (1970). The significance test controversy. Chicago: Aldine.
48.
Oakes, M. (1986). Statistical inference: A commentary for the social and behavioral sciences. Chichester, UK: Wiley.
49.
Olejnik, S. , & Algina, J. (2000). Measures of effect size for comparative studies: Applications, interpretations, and limitations. Contemporary Educational Psychology, 25, 241-286.
50.
Pearson, K. (1905). Mathematical contributions to the theory of evolution, XIV: On the general theory of skew correlation and non-linear regression (Drapers’ Company Research Memoirs, Biometric Series II). London: Dulau.
51.
Pearson, K. (1910). On a new method of determining correlation, when one variable is given by alternative and the other by multiple categories. Biometrika, 7, 248-257.
52.
Pearson, K. (1914). On certain errors with regard to multiple correlation occasionally made by those who have not adequately studied this subject. Biometrika, 10, 181-187.
53.
Pearson, K. (1923). On the correction necessary for the correlation ratio, η. Biometrika, 14, 412-417.
54.
Pearson, K. , & Lee, A. (1897). On the distribution of frequency (variation and correlation) of the barometric height of divers stations. Philosophical Transactions of the Royal Society of London, 190, 423-469.
55.
Peters, C. C. , & Van Voorhis, W. R. (1940). Statistical procedures and their mathematical bases. New York: McGraw-Hill.
56.
Richardson, J.T.E. (1996). Measures of effect size. Behavior Research Methods, Instruments, & Computers, 28, 12-22.
57.
Rosenthal, R. (1994). Parametric measures of effect size. In H. Cooper & L. V. Hedges (Eds.), The handbook of research synthesis (pp. 231-244). New York: Russell Sage Foundation.
58.
Rosenthal, R. , & Rubin, D. B. (1979). A note on percent variance explained as a measure of the importance of effects. Journal of Applied Social Psychology, 9, 395-396.
59.
Rosenthal, R. , & Rubin, D. B. (1982). A simple, general purpose display of magnitude of experimental effect. Journal of Educational Psychology, 74, 166-169.
60.
Serlin, R. C. (1982). A multivariate measure of association based on Pillai-Bartlett procedure. Psychological Bulletin, 91, 413-417.
61.
Snyder, P. , & Lawson, S. (1993). Evaluating results using corrected and uncorrected effect size estimates. Journal of Experimental Education, 61, 334-349.
62.
Stigler, S. M. (1986). The history of statistics. Cambridge, MA: Belknap.
63.
Stigler, S. M. (1999). Statistics on the table. Cambridge, MA: Harvard University Press.
64.
Tatsuoka, M. M. (1970). Discriminant analysis: The study of group differences. Champaign, IL: Institute for Personality and Ability Testing.
65.
Tatsuoka, M. M. (1973). An examination of the statistical properties of a multivariate measure of strength of association. Final Report to U.S. Office of Education on Contract No. OEG-5-72-0027.
66.
Tatsuoka, M. M. (1993). Effect size. In G. Keren & C. Lewis (Eds.), A handbook for data analysis in the behavioral sciences: Methodological issues (pp. 461-479). Hillsdale, NJ: Lawrence Erlbaum.
67.
Thompson, B. (2001). Significance, effect sizes, stepwise methods, and other issues: Strong arguments move the field. Journal of Experimental Education, 70, 80-93.
68.
Thompson, B. (2002). “Statistical,”“practical,” and “clinical”: How many kinds of significance do counselors need to consider?Journal of Counseling and Development, 80, 64-71.
69.
Tilton, J. W. (1937). The measurement of overlapping. Journal of Educational Psychology, 28, 656-662.
70.
Vaughan, G. M. , & Corballis, M. C. (1969). Beyond tests of significance: Estimated strength of effects in selected ANOVA designs. Psychological Bulletin, 72, 204-213.
71.
Wilkinson, L. , & American Psychological Association Task Force on Statistical Inference. (1999). Statistical methods in psychology journals: Guidelines and explanations. American Psychologist, 54, 594-604. [Reprint available from http://apa.org/journals/amp/amp548594.html]
72.
Wilks, S. S. (1932). Certain generalizations of the analysis of variance. Biometrika, 39, 471-494.
73.
Winer, B. J. (1962). Statistical principles in experimental design. New York: McGraw-Hill.
74.
Yates, F. (1951). The influence of Statistical Methods for Research Workers on the development of the science of statistics. American Statistical Association Journal, 46, 19-34.
75.
Yule, G. U. (1900). On the association of attributes in statistics. Philosophical Transactions of the Royal Society, A, 194, 257-319.
