This is Chow's response to four comments on his critique of the view that research conclusions be based on multiple context-dependent criteria. Five themes could be identified in the comments. In reply, it is argued that care should be taken not to use the alpha level whimsically because the continuum similarity is being used as a dichotomy in theory corroboration. The superiority of effect-size estimates to statistical significance is more apparent than real. Chow's assessment of meta analysis is illustrated with the apples and oranges issue.
Get full access to this article
View all access options for this article.
References
1.
Anthony, T. , & Mullen, B. (1991). Conceptual rigor mortis, Or, why people are supporting pornography when they don't send money to televangelists. Theory & Psychology1(3),-361-367.
2.
Bernieri, F.J. (1991). Rigor is rigor: But rigor is not necessarily science. Theory & Psychology, 1(3), 369-373.
3.
Boring, E.G. (1954). The nature and history of experimental control. American Journal of Psychology, 67, 573-589.
4.
Boring, E.G. (1969). Perspective: Artifact and control. In R. Rosenthal & R.L. Rosnow (Eds.), Artifact in behavioral research (pp. 1-11). New York: Academic Press.
Chow, S.L. (1991). Conceptual rigor versus practical impact. Theory & Psychology1(3), 337-360.
7.
Cohen, J. (1987). Statistical power analysis for the behavioral sciences (Rev. Ed.). Hillsdale, NJ: Erlbaum.
8.
Cohen, J. (1990). Things I have learned (so far). American Psychologist, 45, 1304-1312.
9.
Cohen, M.R. , & Nagel, E. (1934). An introduction to logic and scientific method. London: Routledge & Kegan Paul.
10.
Cook, T.D. , & Campbell, D.T. (1979). Quasi-experimention: Design and analysis issues for field settings. Chicago, IL: Rand McNally.
11.
Glass, V. (1978). Integrating findings: The meta-analysis of research. Review of Research in Education, 5, 351-379.
12.
Glass, V. , McGaw, B., & Smith, M.L. (1981). An apology for research integration in the study of psychotherapy. Journal of Consulting and Clinical Psychology, 51, 28-41.
13.
Harris, M.J. (1991). Significance tests are not enough: The role of effect-size estimation in theory corroboration. Theory & Psychology, 1(3), 375-382.
14.
Mill, J.S. (1973). A system of logic. Ratiocinative and inductive. Toronto: University of Toronto Press.
15.
Rosenthal, R. (1984). Meta-analytic procedures for social research. Beverly Hills, CA: Sage.
16.
Rosnow, R.L. , & Rosenthal, R. (1989). Statistical procedures and the justification of knowledge in psychological science. American Psychologist, 44, 1276-1284.
17.
Rozeboom, W.W. (1991). Conceptual rigor: Where is it?Theory & Psychology, 1(3), 383-388.
18.
Skinner, B.F. (1938). The behavior of organisms: An experimental analysis. New York: Appleton-Century.
19.
Sternberg, S. (1969). Memory scanning: Mental processes revealed by reaction-time experiments. American Scientist, 57, 421-457.
