The impressive 1997 edited volume What If There Were No Significance Tests? is reviewed. The book is applauded for its comprehensive consideration of the pros and cons of statistical hypothesis testing (and alternatives) in psychological and educational research. The highlights of each chapter are summarized along with each contributor's presumed stance on the focal to-test-or-not-to-test question. Also included is the reviewer's personal set of recommendations for transforming statistical hypothesis testing, as it is currently practiced, into an intelligent process that is capable of yielding more informative scientific retums.
Get full access to this article
View all access options for this article.
References
1.
Abelson, R. P. (1995). Statistics as principled argument. Mahwah, NJ: Lawrence Erlbaum.
2.
Abelson, R. P. (1997). The surprising longevity of flogged horses: Why there is a case for the significance test. Psychological Science, 8, 12-15.
3.
American Psychological Association. (1994). Publication manual of the American Psychological Association (4th ed.). Washington, DC: Author.
4.
Berkson, J. (1942). Tests of significance considered as evidence. Journal of the American Statistical Association, 37, 325-335.
5.
Cohen, J. (1988). Statistical power analysis for the behaviorial sciences (Rev. ed.). Hillsale, NJ: Lawrence Erlbaum.
6.
Cohen, J. (1994). The Earth is round (p .05). American Psychologist, 49, 997-1003.
7.
Frick, R. W. (1996). The appropriate use of null hypothesis testing. Psychological Methods, 4, 379-390.
8.
Greenwald, A. G. (1975). Consequences of prejudice against the null hypothesis. Psychological Bulletin, 82, 1-20.
9.
Greenwald, A. G. , Gonzalez, R., Harris, R. J., & Guthrie, D. (1996). Effect sizes andp values: What should be reported and what should be replicated? Psychophysiology, 33, 175-183.
10.
Harris, R. J. , & Quade, D. (1992). The Minimally Important Difference Significant criterion for sample size. Journal of Educational Statistics, 17, 27-49.
11.
Heermann, E. F. , & Braskamp, L. A. (Eds.). (1970). Readings in statistics for the behavioral sciences. Englewood Cliffs, NJ: Prentice Hall.
12.
Hunter, J. E. (1996, August). Needed: A ban on the significance test. Paper presented at the annual meeting of the American Psychological Association, Toronto.
13.
Kaiser, H. F. (1960). Directional statistical decisions. Psychological Review, 67, 160-167.
14.
Keselman, H. J. (1996, June). Data-analytic practices of educational researchers. Symposium conducted at the annual meeting of the Psychometric Society, Banff, Alberta.
15.
Kirk, R. E. (Ed.). (1972). Statistical issues: A reader for the behavioral sciences. Monterey, CA: Brooks/Cole.
16.
Kupfersmid, J. (1988). Improving what is published: A model in search of an editor. American Psychologist, 43, 635-642.
17.
Levin, J. R. (1985). Some methodological and statistical "bugs" in research on children's learning. In M. Pressley & C. J. Brainerd (Eds.), Cognitive learning and memory in children (pp. 205-233). New York: Springer-Verlag.
18.
Levin, J. R. (1992). Tips for publishing and professional writing. Mid-Western Educational Researcher, 5, 12-14.
19.
Levin, J. R. (1993). Statistical significance testing from three perspectives. Journal of Experimental Education, 61, 378-382.
20.
Levin, J. R. (1995, April). The consultant's manual of researchers' common stat-illogical disorders. Paper presented at the annual meeting of the American Educational Research Association, San Francisco.
21.
Levin, J. R. (1997). Overcoming feelings of powerlessness in "aging" researchers: A primer on statistical power in analysis of variance designs. Psychology and Aging, 12, 84-106.
22.
Levin, J. R. , & Neumann, E. (in press). Testing for predicted patterns: When interest in the whole is greater than in some of its parts. Psychological Methods.
23.
Lykken, D. T. (1968). Statistical significance in psychological research. Psychological Bulletin, 70, 151-159.
24.
Morrison, D. E. , & Henkel, R. E. (Eds.). (1970). The significance test controversy. Chicago: Aldine.
25.
Robinson, D. H. , & Levin, J. R. (1997). Reflections on statistical and substantive significance, with a slice of replication. Educational Researcher, 26, 21-26.
26.
Rossi, J. S. (1984). Statistical power of psychological research: The artifactual basis of controversial results. Unpublished doctoral dissertation, University of Rhode Island, Kingston.
27.
Rozeboom, W. W. (1960). The fallacy of the null-hypothesis significance test. Psychological Bulletin, 57, 416-428.
28.
Schmidt, F. L. (1996). Statistical significance testing and cumulative knowledge in psychology: Implications for the training of researchers. Psychological Methods, 1, 115-129.
29.
Serlin, R. C. , & Seaman, M. A. (1993, April). Two-sample good-enough tests of mean differences. Paper presented at the annual meeting of the American Educational Research Association, Atlanta.
30.
Serlin, R. C. , & Lapsley, D. K. (1993). Rational appraisal of psychological research and the good-enough principle. In G. Keren & C. Lewis (Eds.), A handbook for data analysis in the behavioral sciences: Statistical issues (pp. 199-228). Hillsdale, NJ: Lawrence Erlbaum.
31.
Shrout, P. E. (1996, August). Significance tests: Should they be banned from APA journals?Symposium conducted at the annual meeting of the American Psychological Association, Toronto.
32.
Slavin, R. E. (1985). Best-evidence synthesis: An alternative to meta-analytic and traditional reviews. Educational Researcher, 15(9), 5-11.
33.
Steiger, J. H. (1990). Structural model evaluation and modification: An interval estimation approach. Multivariate Behavioral Research, 25, 173-180.
34.
Thompson, B. (1987, April). The use (and misuse) of statistical significance testing: Some recommendations for improved editorial policy and practice. Paper presented at the annual meeting of the American Educational Research Association, Washington, DC.
35.
Thompson, B. (Ed.). (1993). Statistical significance testing in contemporary practice [Special issue]. Journal of Experimental Education, 61(4).
36.
Thompson, B. (1996). AERA editorial policies regarding statistical significance testing: Three suggested reforms. Educational Researcher, 25, 26-30.
37.
Walster, G. W. , & Cleary, T. A. (1970a). A proposal for a new editorial policy in the social sciences. American Statistician, 24, 16-19.
38.
Walster, G. W. , & Cleary, T. A. (1970b). Statistical significance as a decision-making rule. In E. F. Borgatta & G. W. Bohmstedt (Eds.), Sociological methodology (pp. 246-254). San Francisco: Jossey-Bass.
39.
Wilcox, R. R. (1997). Introduction to robust estimation and hypothesis testing. San Diego: Academic Press.
40.
Yates, F. (1951). The influence of statistical methods for research workers on the development of the science of statistics. Journal of the American Statistical Association, 46, 19-34.
