In a recently published major article in the Journal of Personality and Social Psychology, Daryl Bem (2011) made a strong claim for the existence of a parapsychological phenomenon called retroactive causation. Across nine experiments, aspects of stimuli were shown to correlate with participants’ responses provided before the stimuli were generated by the computer’s random generator. Early critical debates of these provocative findings have been focused on issues of statistical significance testing. Going beyond these issues, we argue that Bem’s research has three crucial shortcomings: (a) a lack of a theoretical explanation, (b) the possibility of selective filtering of empirical results, and (c) the confusion of the explanans and the explanandum. We propose that all three methodological principles should be rigorously applied during the journal review process and the communication of empirical findings in general.
BemD. J. (1987). Writing the empirical journal article. In ZannaM. P.DarleyJ. M. (Eds.), The compleat academic: A career guide (pp. 171–201). Washington, DC: American Psychological Association.
2.
BemD. J. (2011). Feeling the future: Experimental evidence for anomalous retroactive influences on cognition and affect. Journal of Personality and Social Psychology, 100, 407–435. doi:10.1037/a0021524
3.
BogganA. L.BartlettJ. C.KrawczykD. C. (2012). Chess masters show a hallmark of face processing with chess. Journal of Experimental Psychology: General, 141, 37–42. doi:10.1037/a0024236
4.
CohenJ. (1992). A power primer. Psychological Bulletin, 112, 155–159. doi:10.1037/0033–2909.112.1.155
5.
FiedlerK. (2011). Voodoo correlations are everywhere—Not only in neuroscience. Perspectives on Psychological Science, 6, 163–171. doi:10.1177/1745691611400237
6.
FischerP.AydinN.FischerJ.FreyD.LeaS. E. G. (2012). The cognitive economy model of selective exposure: Integrating motivational and cognitive accounts of confirmatory information search. In KruegerJ. I. (Ed.), Social judgment and decision-making (pp. 21–39). New York, NY: Psychology Press.
7.
HempelC. G.OppenheimP. (1948). Studies in the logic of explanation. Philosophy of Science, 15, 135–175. doi:10.1086/286983.10.1086/286983
8.
HumeD. (2000). An enquiry concerning human understanding (BeauchampT. L., Ed.). New York, NY: Oxford University. (Original work published 1748)
9.
HumphreyN. (1996). Leaps of faith. New York, NY: Springer.
10.
JuddC. M.GawronskiB. (2011). Editorial comment. Journal of Personality and Social Psychology, 100, 406. doi:10.1037/0022789
11.
KruegerJ. (2001). Null hypothesis significance testing: On the survival of a flawed method. American Psychologist, 56, 16–26. doi:10.1037/0003–066X.56.1.16
12.
LakatosI. (1978). The methodology of scientific research programmes. Cambridge, UK: Cambridge University Press.
13.
LilienfeldS. (2012). Public skepticism of psychology: Why many people perceive the study of human behavior as unscientific. American Psychologist, 67(2), 111–129.
14.
NickersonR. S. (1998). Confirmation bias: A ubiquitous phenomenon in many guises. Review of General Psychology, 2, 175–220. doi: 10.1037/1089–2680.2.2.175
15.
NickersonR. S. (2000). Null hypothesis significance testing: A review of an old and continuing controversy. Psychological Methods, 5, 241–301. doi: 10.1037/1082–989X.5.2.241
16.
NisbettR. E.WilsonT. D. (1977). Telling more than we can know: Verbal reports on mental processes. Psychological Review, 84, 231–259. doi:10.1037/0033–295X.84.3.231
17.
PernerJ.LeekamS. (2008). The curious incident of the photo that was accused of being false: Issues of domain specificity in development, autism, and brain imaging. The Quarterly Journal of Experimental Psychology, 61, 76–89. doi:10.1080/17470210701508756
18.
ReichenbachH. (1951). The rise of scientific philosophy. Berkeley: University of California Press.
19.
RosenthalR.RubinD. B. (1978). Interpersonal expectancy effects: The first 345 studies. Behavioral and Brain Sciences, 1, 377–415. doi:10.1017/S0140525X00075506
20.
SchwarzN.CloreG. L. (1983). Mood, misattribution, and judgments of well-being: Informative and directive functions of affective states. Journal of Personality and Social Psychology, 45, 513–523. doi:10.1037/0022–3514.45.3.513
21.
VallacherR. R.ReadS. J.NowakA. (2002). The dynamical perspective in personality and social psychology. Personality and Social Psychology Review, 6, 264–273. doi: 10.1207/S15327957PSPR0604_01
22.
WagenmakersE.WetzelsR.BorsboomD.van der MaasH. J. (2011). Why psychologists must change the way they analyze their data: The case of psi: Comment on Bem (2011). Journal of Personality and Social Psychology, 100, 426–432. doi:10.1037/a0022790
23.
ZajoncR. B. (1968). Attitudinal effects of mere exposure. Journal of Personality and Social Psychology, 9(2, Pt. 2), 1–27. doi:10.1037/h0025848
24.
ZaniA.ProverbioA. M. (2003). The cognitive electrophysiology of mind and brain. New York, NY: Academic Press.
