A total of 236 Ph.D. and 1 M.A. faculty completed an e-mail survey regarding their opinions about publication of nonsignificant results. Tenured faculty were significantly less likely than nontenured faculty to write manuscripts for studies with nonsignificant results. Reasons for not writing a manuscript included a perceived inability to publish the manuscript, time concerns, flawed methods or design, inability to interpret results, and the belief that the results are unimportant. The presence of the file drawer problem is supported, and possible solutions are discussed.
Get full access to this article
View all access options for this article.
References
1.
AtkinsonD. R.FurlongM. J.WampoldB. E. (1982) Statistical significance, reviewer evaluations, and the scientific process: Is there a (statistically) significant relationship?Journal of Counseling Psychology, 29, 189–194.
2.
BakanD. (1967) Toward a reconstruction of psychological investigation. San Francisco, CA: Jossey-Bass.
3.
BeggC. B. (1994) Publication bias. In CooperH.HedgesL. V. (Eds.), The handbook of research synthesis. New York: Russell Sage Found. Pp. 399–409.
4.
CampbellJ. J.DunnetteM. D.LawlerE. E.WeickK. E. (1970) Managerial behavior, performance, and effectiveness. New York: McGraw-Hill.
5.
CampbellJ. P. (1982) Editorial: Some remarks from the outgoing editor. Journal of Applied Psychology, 67, 691–700.
6.
CohenJ. (1994) The earth is round (p<.05). American Psychologist, 49, 997–1003.
7.
DickersinK. (1990) The existence of publication bias and risk factors for its occurrence. Journal of the American Medical Association, 263, 1385–1389.
8.
DickersinK.MinY. I.MeinertC. L. (1992) Factors influencing publication of research results: Follow-up of applications submitted to two institutional review boards. Journal of the American Medical Association, 267, 374–378.
9.
EasterbrookP. J.BerlinJ. A.GopalanR.MathewsD. R. (1991) Publication bias in clinical research. Lancet, 337, 867–872.
10.
FidlerF. (2002) The fifth edition of the APA Publication Manual: Why its statistics recommendations are so controversial. Educational and Psychological Measurement, 62, 749–770.
11.
FidlerFThomasonN.CummingG.FinchS.LeemanJ. (2004) Editors can lead researchers to confidence intervals, but can't make them think: Statistical reform lessons from medicine. Psychological Science, 15, 119–126.
12.
GilbodyS. M.SongF.EastwoodA. J.SuttonA. (2000) The causes, consequences and detection of publication bias in psychiatry. Acta Psychiatrica Scandinavica, 102, 241–249.
13.
GreenwaldA. G. (1975) Consequences of prejudice against the null hypothesis. Psychological Bulletin, 82, 1–20.
14.
KupfersmidJ.FialaM. (1991) A survey of attitudes and behaviors of authors who publish in psychology and education journals. American Psychologist, 46, 249–250. [Comments]
15.
MahoneyM. J. (1987) Scientific publication and knowledge politics. Journal of Social Behavior and Personality, 2, 165–176.
16.
MeltonA. N. (1962) Editorial. Journal of Experimental Psychology, 64, 553–557.
17.
MooreD. S.McCabeG. P. (2003) Introduction to the practice of statistics. (4th ed.) New York: Freeman.
18.
OakesM. (1986) Statistical inference: A commentary for the social and behavioural sciences. Chichester, UK: Wiley.
19.
PedhazurE. J.SchmelkinL. P. (1991) Measurement, design, and analysis: An integrated approach. Hillsdale, NJ: Erlbaum.
20.
RosenthalR. (1979) The “File Drawer Problem” and tolerance for null results. Psychological Bulletin, 86, 638–641.
21.
RosenthalR.RubinD. B. (1988) Comment, assumptions and procedures in the file drawer problem. Statistical Science, 3, 120–125.
22.
RossiJ. S. (1997) A case study in the failure of psychology as a cumulative science: The spontaneous recovery of verbal learning. In HarlowL. L.MulaikS. A.SteigerJ. H. (Eds.), What if there were no significance tests?Hillsdale, NJ: Erlbaum. Pp. 175–197.
23.
RottonJ.FoosP. W.MeekL. V.LevittM. (1995) Publication practices and the file drawer problem: A survey of published authors. Journal of Social Behavior and Personality, 10, 1–13.
24.
SmithM. B. (1956) Editorial. Journal of Abnormal Social Psychology, 52, 1–4.
25.
SterlingT. D. (1959) Publication decisions and their possible effects on inferences drawn from tests of significance or vice versa. Journal of the American Statistical Association, 54, 30–34.
26.
Wilkinson, L., & APA Task Force on Statistical Inference. (1999) Statistical methods in pschyology journals: Guidelines and explanations. American Psychologist, 54, 594–604.
27.
ZannaM. P. (1992) My life as a dog (I mean editor). Personality and Social Psychology Bulletin, 18, 485–488.
