Cases of clear scientific misconduct have received significant media attention recently, but less flagrantly questionable research practices may be more prevalent and, ultimately, more damaging to the academic enterprise. Using an anonymous elicitation format supplemented by incentives for honest reporting, we surveyed over 2,000 psychologists about their involvement in questionable research practices. The impact of truth-telling incentives on self-admissions of questionable research practices was positive, and this impact was greater for practices that respondents judged to be less defensible. Combining three different estimation methods, we found that the percentage of respondents who have engaged in questionable practices was surprisingly high. This finding suggests that some questionable practices may constitute the prevailing research norm.
BowerG. H.MayerJ. D. (1985). Failure to replicate mood-dependent retrieval. Bulletin of the Psychonomic Society, 23, 39–42.
3.
BradburnN.SudmanS. (1979). Improving interview method and questionnaire design: Response effects to threatening questions in survey research. San Francisco, CA: Jossey-Bass.
4.
CrabbeJ. C.WahlstenD.DudekB. C. (1999). Genetics of mouse behavior: Interactions with laboratory environment. Science, 284, 1670–1672.
5.
CrockerJ. (2011). The road to fraud starts with a single step. Nature, 479, 151.
6.
DeerB. (2011). How the case against the MMR vaccine was fixed. British Medical Journal, 342, 77–82.
7.
de JongM. G.PietersR.FoxJ.-P. (2010). Reducing social desirability bias through item randomized response: An application to measure underreported desires. Journal of Marketing Research, 47, 14–27.
GardnerW.LidzC. W.HartwigK. C. (2005). Authors’ reports about research integrity problems in clinical trials. Contemporary Clinical Trials, 26, 244–251.
13.
GeggieD. (2001). A survey of newly appointed consultants’ attitudes towards research fraud. Journal of Medical Ethics, 27, 344–346.
14.
GuttmanL. L. (1974). The basis for scalogram analysis. In MaranellG. M. (Ed.), Scaling: A sourcebook for behavioral scientists (pp. 142–171). New Brunswick, NJ: Transaction.
15.
HenryD. A.KerridgeI. H.HillS. R.McNeillP. M.DoranE.NewbyD. A.. . . DayR. O. (2005). Medical specialists and pharmaceutical industry-sponsored research: A survey of the Australian experience. Medical Journal of Australia, 182, 557–560.
16.
IoannidisJ. P. A. (2005a). Contradicted and initially stronger effects in highly cited clinical research. Journal of the American Medical Association, 294, 218–228.
Lensvelt-MuldersG. J. L. M.HoxJ. J.van der HeijdenP. G. M.MaasC. J. M. (2005). Meta-analysis of randomized response research: Thirty-five years of validation. Sociological Methods & Research, 33, 319–348.
22.
ListJ.BaileyC.EuzentP.MartinT. (2001). Academic economists behaving badly? A survey on three areas of unethical behavior. Economic Inquiry, 39, 162–170.
23.
MarshallE. (2000). How prevalent is fraud? That’s a million-dollar question. Science, 290, 1662–1663.
PalmerA. R. (2000). Quasireplication and the contract of error: Lessons from sex ratios, heritabilities, and fluctuating asymmetry. Annual Review of Ecology and Systematics, 31, 441–480.
26.
PrelecD. (2004). A Bayesian truth serum for subjective data. Science, 306, 462–466.
SimmonsJ. P.NelsonL. D.SimonsohnU. (2011). False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychological Science, 22, 1359–1366.
29.
SovacoolB. (2008). Exploring scientific misconduct: Isolated individuals, impure institutions, or an inevitable idiom of modern science?Journal of Bioethical Inquiry, 5, 271–282.
30.
SteeleK. M.BassK. E.CrookM. D. (1999). The mystery of the Mozart effect: Failure to replicate. Psychological Science, 10, 366–369.
31.
SteneckN. H. (2002). Assessing the integrity of publicly supported research. In SteneckN. H.ScheetzM. D. (Eds.), Investigating Research Integrity: Proceedings of the First ORI Research Conference on Research Integrity (pp. 1–16). Washington, DC: Office of Research Integrity.
32.
SteneckN. H. (2006). Fostering integrity in research: Definitions, current knowledge, and future directions. Science and Engineering Ethics, 12, 53–74.
33.
SterbaS. K. (2006). Misconduct in the analysis and reporting of data: Bridging methodological and ethical agendas for change. Ethics & Behavior, 16, 305–318.
34.
SwazeyJ. P.AndersonM. S.LouisK. S. (1993). Ethical problems in academic research. American Scientist, 81, 542–553.
35.
TourangeauR.YanT. (2007). Sensitive questions in surveys. Psychological Bulletin, 133, 859–883.
36.
TurnerC. F.KuL.RogersS. M.LindbergL. D.PleckJ. H.SonensteinF. L. (1998). Adolescent sexual behavior, drug use, and violence: Increased reporting with computer survey technology. Science, 280, 867–873.
37.
WarnerS. L. (1965). Randomized response: A survey technique for eliminating evasive answer bias. Journal of the American Statistical Association, 60, 63–69.
38.
WichertsJ. (2011). Psychology must learn a lesson from fraud case. Nature, 480, 7.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
