Open Peer Commentary

Allport G. W. (1968). The historical background of modern social psychology. In Lindzey G. , & Aronson E. (Eds), The handbook of social psychology (Vol. 1, pp. 1–80). Reading, MA: Addison–Wesley.

Anisfeld M. (1991). Neonatal imitation. Developmental Review, 11, 60–97. doi: 10.1016/0273–2297.

Appley M. H. (1990). Time for reintegration? Science Agenda, 3, 12–13.

Augoustinos M. , Walker I. , & Donaghue N. (2006). Social cognition: An integrated introduction (2nd ed). London, UK: Sage Publications Ltd.

Bakker M. , van Dijk A. , & Wicherts J. M. (2012). The rules of the game called psychological science. Perspectives on Psychological Science, 7, 543–554.

Bangerter A. , & Heath C. (2004). The Mozart effect: Tracking the evolution of scientific legend. British Journal of Social Psychology, 43, 605–623.

Bargh J. A. , Chen M. , & Burrows L. (1996). Automaticity of social behavior: Direct effects of trait construct and stereotype activation on action. Journal of Personality and Social Psychology, 71, 230–244. doi: 10.1037/0022–3514.71.2.230

Bem D. J. (1987). Writing the empirical journal article. In Zanna M. , & Darley J. (Eds), The compleat academic: A practical guide for the beginning social scientist (pp. 171–201). New York: Random House.

Bem D. J. (2011). Feeling the future: Experimental evidence for anomalous retroactive influences on cognition and affect. Journal of Personality and Social Psychology, 100, 407–425. doi: 10.1037/a0021524.

Bensman S. J. (2008), Distributional differences of the impact factor in the sciences Versus the social sciences: An analysis of the probabilistic structure of the 2005 Journal Citation Reports. Journal of the American society for information science and technology, 59, 1366–1382.

Berk L. E. (2013). Child development (9th ed). Boston: Pearson.

Bless H. , Fiedler K. , & Strack F. (2004). Social cognition: How individuals construct reality. East Sussex, UK: Psychology Press.

Burton P. , Gurrin L. , & Campbell M. (1998). Clinical significance not statistical significance: A simple Bayesian alternative to p values. Journal of Epidemiology and Community Health, 52(5), 318–323. doi:10.1136/jech.52.5.318.

Cacioppo J. T. , & Berntson G. G. (1992). The principles of multiple, nonadditive, and reciprocal determinism: Implications for social psychological research and levels of analysis. In Ruble D. , Costanzo P. , & Oliveri M. (Eds), The social psychology of mental health: Basic mechanisms and applications (pp. 328–349). New York: Guilford Press.

Campbell D. (1997). In United States Patent and Trademark Office (Ed.), The Mozart effect. US Patent 75094728.

Campbell D. T. , & Fiske D. W. (1959). Convergent and discriminant validation by the multitrait–multimethod matrix. Psychological Bulletin, 56, 81–105.

Cesario J. , Plaks J. E. , & Higgins E. T. (2006). Automatic social behavior as motivated preparation to interact. Journal of Personality and Social Psychology, 90, 893. doi: 10.1037/0022–3514.90.6.893.

Cohen J. (1962). Statistical power of abnormal–social psychological research: A review. Journal of Abnormal and Social Psychology, 65, 145–153.

Cohen J. (1990). Things I have learned (so far). American Psychologist, 45(12), 1304–1312. doi:10.1037/0003–066X.45.12.1304.

Cohen J. (1994). The earth is round (p<. 05). American Psychologist, 49(12), 997–1003. doi:10.1037/0003–066X.49.12.997.

Cromie W. J. (1999). Mozart effect hits sour notes. Retrieved 12/10, 2012, from http://news.harvard.edu/gazette/1999/09.16/mozart.html

Cronbach L. J. , Gleser G. C. , Nanda H. , & Rajaratnam N. (1972). The dependability of behavioral measurements: Theory of generalizability for scores and profiles. New York: Wiley.

Cumming G. , & Finch S. (2005). Inference by eye: confidence intervals and how to read pictures of data. American Psychologist, 60(2), 170–80. doi:10.1037/0003–066X.60.2.170.

Doyen S. , Klein O. , Pichon C.–L. , & Cleeremans A. (2012). Behavioral priming: It's all in the mind, but whose mind? PLoS ONE, 7, e29081.

Eid M. , Geiser C. & Nussbeck F. W. (2009). Multitrait–multimethod analysis in psychotherapy research: New methodological approaches. Psychotherapy Research, 19, 390–396.

Eid M. , Nussbeck F. , Geiser C. , Cole D. , Gollwitzer M. & Lischetzke T. (2008). Structural equation modeling of multitrait–multimethod data: Different models for different types of methods. Psychological Methods, 13, 230–253.

Fanelli D. (2010). “Positive” Results Increase Down the Hierarchy of the Sciences. PLoS One, 5(3). doi: 10.1371/journal.pone.0010068.

Fanelli D. (2012a). Positive results receive more citations, but only in some disciplines. Scientometrics, 1–9. doi: 10.1007/s11192–012–0757–y.

Fanelli D. (2012b). Project for a Scientific System Based on Transparency. Paper presented at the EQUATOR Network Scientific Symposium Freiburg, Germany. http://www.equator–network.org/index.aspx?o=5605.

Fiedler K. , Kutzner F. , & Krueger J. I. (2012). The long way from α–error control to validity proper: Problems with a short–sighted false–positive debate. Perspectives on Psychological Science, 7, 661–669.

Fraley R. C. , Roisman G. I. , LaForce C. , Owen M. T. , & Holland A. S. (in press). Interpersonal and genetic origins of adult attachment styles: A longitudinal study from infancy to early adulthood. Journal of Personality and Social Psychology.

Frank M. C. , & Saxe R. (2012). Teaching replication. Perspectives on Psychological Science, 7, 600–604

Fuchs H. , Jenny M. , & Fiedler S. (2012). Psychologists are open to change, yet wary of rules. Perspectives on Psychological Science, 7, 639–642.

Galak J. , LeBoeuf R. A. , Nelson L. D. , & Simmons J. P. (2012). Correcting the past: Failures to replicate Psi. Journal of Personality and Social Psychology, 103, 933–948. doi: 10.1037/a0029709.

Goodman N. (1955). Fact, fiction, and forecast. Cambridge: Harvard University Press.

Hayes L. A. , & Watson J. S (1981). Neonatal imitation: Fact or artifact? Developmental Psychology, 17, 655–660. doi: 10.1037/0012-1649.17.5.655.

Henrich J. , Heine S. J. , & Norenzayan A. (2010). The weirdest people in the world? Behavioral and Brain Sciences, 33, 61–135.

Henry P. J. (2008). College sophomores in the laboratory redux: Influences of a narrow data base on social psychology's view of the nature of prejudice. Psychological Inquiry, 19, 49–71.

Hewstone M. , Stroebe W. , & Jonas K. (2012). An introduction to social psychology. West Sussex, UK: Wiley–Blackwell.

Hull J. G. , Slone L. B. , Meteyer K. B. , & Matthews A. R. (2002). The nonconsciousness of self–consciousness. Journal of Personality and Social Psychology, 83, 406. doi: 10.1037/0022–3514.83.2.406.

IJzerman H. , & Koole S. L. (2011). From perceptual rags to metaphoric riches: Bodily, social, and cultural constraints on socio–cognitive metaphors. Psychological Bulletin, 137, 355–361.

Ioannidis J. P. A. (2012). Why science is not necessarily self–correcting. Perspectives in Psychological Science, 7, 645–654.

John L. K. , Loewenstein G. , & Prelec D. (2012). Measuring the prevalence of questionable research practices with incentives for truth telling. Psychological Science, 23, 524–532. doi: 10.1177/0956797611430953.

Johnson R. W. (1964). Retain the original data! American Psychologist, 19, 350–351.

Kashy D. A. , Donnellan M. B. , Ackerman R. A. , & Russell D. W. (2009). Reporting and interpreting research in PSPB: Practices, principles, and pragmatics. Personality and Social Psychology Bulletin, 35, 1131–1142.

Kazdin A. E. (2010). Single case research designs: Methods for clinical and applied settings (2nd ed). New York: Oxford University Press.

Kerr N. L. (1998). HARKing: Hypothesizing after the results are known. Personality and Social Psychology Review, 2, 196–217.

Koepke J. E. , Hamm M. , Legerstee M. , & Russell M. (1983). Neonatal imitation: Two failures to replicate. Infant behavior and development, 6, 97–102. doi: 10.1016/S0163-6383(83)80012-5.

Koninklijke Nederlandse Academie voor de Wetenschappen (KNAW, 2012). Zorgvuldig en integer omgaan met wetenschappelijke onderzoeksgegevens [Handling scientific data with care and integrity]. Retrieved December 2012 from http://www.knaw.nl/Content/Internet_KNAW/publicaties/pdf/20121004.pdf.

Koole S. L. , & Lakens D. (2012). Rewarding Replications: A Sure and Simple Way to Improve Psychological Science. Perspectives on Psychological Science, 7(6), 608–614. doi:10.1177/1745691612462586.

Kruglanski A. W. (2001). That “vision thing”: The state of theory in social and personality psychology at the edge of the new millennium. Journal of Personality and Social Psychology, 80, 871–875.

Kruschke J. K. , Aguinis H. , & Joo H. (2012). The Time Has Come: Bayesian Methods for Data Analysis in the Organizational Sciences. Organizational Research Methods, 15(4), 722–752. doi:10.1177/1094428112457829.

LeBel E. P. , & Peters K. R. (2011). Fearing the Future of Empirical Psychology: Bem's (2011) Evidence of Psi as a Case Study of Deficiencies in Modal Research Practice. Review of General Psychology, 15(4), 371–379. doi: 10.1037/a0025172.

Ledgerwood A. , & Sherman J. (2012). Short, sweet, and problematic? The rise of the short report in psychological science. Perspectives on Psychological Science, 7(1), 60–66. doi:10.1177/1745691611427304.

Leman P. , Bremner A. , Parke R. D. , & Gauvain M. (2012). Developmental Psychology. London: McGraw Hill.

Levelt Committee, Noort Committee, & Drenth Committee. (2012). Flawed science: The fraudulent research practices of social psychologist Diederik Stapel.

Lykken D.T. (1968). Statistical significance in psychological research. Psychological Bulletin, 70, 151–159. Reprinted in Morrison & Henkel (1970, pp. 267–279).

Lykken D. T. (1991). What's wrong with psychology anyway? In Cichhetti D. , & Grove W. M. (Eds), Thinking Clearly about Psychology. Volume I: Matters of Public Interest (pp. 3–39). Minneapolis: MN: University of Minnesota Press.

Makel M. C. , Plucker J. A. , & Hegarty B. (2012). Replications in psychology research: How often do they really occur? Perspectives on Psychological Science, 7, 537–542. doi: 10.1177/1745691612460688.

Maxwell S. E. (2004). The persistence of underpowered studies in psychological research: Causes, consequences, and remedies. [Article]. Psychological Methods, 9(2), 147–163. doi:10.1037/1082–989X.9.2.147.

McCall R. B. , & Carriger M. S. (1993). A meta–analysis of infant habituation and recognition memory performance as predictors of later IQ. Child Development, 64, 57–79. doi: 10.1111/j.1467–8624.1993.tb02895.x.

Meltzoff A. N. , & Moore M. K. (1977). Imitation of facial and manual gestures by human neonates. Science, 198(4312), 75–78. Retrieved from http://www.jstor.org/stable/1744187

Morrison D.E. , & Henkel R.E. (Eds). (1970a). The significance test controversy – A reader. Chicago: Aldine.

Morrison D.E. , & Henkel R.E. (1970b). Significance tests in behavioral research: Skeptical conclusions and beyond. In Morrison D.E. & Henkel R.E. (Eds), The significance test controversy – A reader (pp. 305–311). Chicago: Aldine.

Newman J. , Rosenbach J. H. , Burns K. L. , Latimer B. C. , Matocha H. R. , & Rosenthal Vogt E. (1995). An experimental test of the Mozart effect': Does listening to his music improve spatial ability? Perceptual and Motor Skills, 81, 1379–1387. doi: 10.2466/pms.1995.81.3f.1379.

Nicholson J. M. , & Ioannidis J. P. A. (2012). Research grants: Confirm and be funded. Nature, 492, 34–36.

Nosek B. A. , Spies J. R. , & Motyl M. (2012). Scientific Utopia: II. Restructuring Incentives and Practices to Promote Truth Over Publishability. Perspectives on Psychological Science, 7(6), 615–631. doi:10.1177/1745691612459058.

Open Science Collaboration. (2012). An open, large–scale, collaborative effort to estimate the reproducibility of psychological science. Perspectives on Psychological Science, 7, 652–655.

Pashler H. , Harris C. , & Coburn N. Elderly–Related Words Prime Slow Walking. (2011, September 15). Retrieved 06:15, December 12, 2012 from http://www.PsychFileDrawer.org/replication.php?attempt=MTU%3D.

Petty R. E. , & Cacioppo J. T. (1981). Attitudes and persuasion: Classic and contemporary approaches. Dubuque, Iowa: Wm. C. Brown.

Petty R. E. , & Cacioppo J. T. (1986). Communication and persuasion: Central and peripheral routes to attitude change. New York: Springer–Verlag.

Pietschnig J. , Voracek M. , & Formann A. K. (2010). Mozart effect–Shmozart effect: A meta–analysis. Intelligence, 38, 314–323. doi:10.1016/j.intell.2010.03.001.

Rai T. S. , & Fiske A. P. (2010). Psychological research methods are ODD (observation and description deprived). Brain and Behavioral Science, 33, 106–107.

Rauscher F. H. , Shaw G. L. , & Ky C. N. (1993). Music and spatial task performance. Nature, 365, 611. doi: 10.1038/365611a0

Rosenthal R. (1979). The file drawer problem and tolerance for null results. Psychological Bulletin, 86, 638–641. doi: 10.1037/0033–2909.86.3.638.

Rossi J. S. (1990). Statistical power of psychological research: What have we gained in 20 years? Journal of Consulting and Clinical Psychology, 58, 646–656.

Rozeboom W. W. (1960). The fallacy of the null hypothesis significance test. Psychological Bulletin, 57, 416–428. Reprinted in Morrison & Henkel (1970, pp. 216–230).

Schachter S. , Christenfeld N. , Ravina B. , & Bilous F. (1991). Speech disfluency and the structure of knowledge. Journal of Personality and Social Psychology, 60, 362–367.

Schimmack U. (2012, August 27). The ironic effect of significant results on the credibility of multiple–study articles. Psychological Methods. Advance online publication. doi: 10.1037/a0029487.

Sechrest L. , Davis M. , Stickle T. , & McKnight P. (2000). Understanding “method” variance. In Bickman L. (Ed.), Research design: Donald Campbell's legacy (pp. 63–87). Thousand Oaks, CA: Sage.

Sidman M. (1960). Tactics of scientific research. Evaluating experimental data in psychology. New York: Basic Books.

Shaffer D. R. , & Kipp K. (2009). Developmental psychology: Childhood and adolescence (8th ed.). Belmont, CA: Wadsworth.

Siegler R. S. , DeLoache J. S. , & Eisenberg N. (2011). How children develop (3th ed.). New York: Worth publishers.

Simmons J. P. , Nelson L. D. , Simonsohn U. (2011). False–positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychological Science, 22, 1359–1366.

Simmons J. , Nelson L. , & Simonsohn U. (2012). A 21 Word Solution. Available at SSRN: http://ssrn.com/abstract=2160588.

Simonton D. K. (2004). Psychology's status as a scientific discipline: Its empirical placement within an implicit hierarchy of the sciences. Review of General Psychology, 8(1), 59–67. doi: 10.1037/1089–2680.8.1.59.

Simpson J. A. , & Rholes W. S. (2012). Adult attachment orientations, stress, and romantic relationships. In P. G. Devine, A. Plant, J. Olson, & M. Zanna (Eds.), Advances in Experimental Social Psychology, 45, 279–328. doi: 10.1016/B978–0–12–394286–9.00006–8.

Sinclair S. , Lowery B. S. , Hardin C. D. , & Colangelo A. (2005). Social tuning of automatic racial attitudes: the role of affiliative motivation. Journal of Personality and Social Psychology, 89, 583–592.

Smith N.C Jr. (1970). Replication studies: A neglected aspect of psychological research. American Psychologist, 25, 970–975.

Spellman B. A. (2012). Scientific utopia… or too much information? Comment on Nosek and Bar–Anan. Psychological Inquiry, 23, 303–304.

Staats A. W. (1989). Unificationism: Philosophy for the modern disunified science of psychology. Philosophical Psychology, 2, 143–164.

Sterling T. D. (1959). Publication decisions and their possible effects on inferences drawn from tests of significance: Or vice versa. Journal of the American Statistical Association, 54, 30–34. doi:10.2307/2282137.

Tabarrok A. (2012, Nov 2). A Bet is a Tax on Bullshit. Marginal Revolution. Retrieved from http://marginalrevolution.com/marginalrevolution/2012/11/a–bet–is–a–tax–on–bullshit.html.

Tilburg Data Sharing Committee (2012). Manual for data–sharing. Retrieved December 2012 from http://www.academia.edu/2233260/Manual_for_Data_Sharing_─Tilburg_University.

Tullock G. (1959). Publication decisions and tests of significance: A comment. Journal of the American Statistical Association, 54, 593. Reprinted in Morrison & Henkel (1970, pp. 301–302).

Wagenmakers E. , Wetzels R. , Borsboom D. , & Van der Maas H. (2011). Why psychologists must change the way they analyze their data: the case of psi: Comment on Bem (2011). Journal of Personality and Social Psychology, 100(3), 426–432. doi:10.1037/a0022790.

Wagenmakers E. J. , Wetzels R. , Borsboom D. , van der Maas H. L. J. , & Kievit R. A. (2012). An agenda for purely confirmatory research. Perspectives on Psychological Science, 7, 632–638. doi:10.1177/1745691612463078.

Weisburd D. , & Piquero A. R. (2008). How well do criminologists explain crime? Statistical modeling in published studies Crime and Justice: a Review of Research, (Vol. 37, pp. 453–502). Chicago: Univ Chicago Press.

Westmeyer H. (Ed.) (1989). Psychological theories from a structuralist point of view. New York: Springer–Verlag.

Westmeyer H. (Ed.) (1992). The structuralist program in psychology: Foundations and applications. Toronto: Hogrefe & Huber Publishers.

Wicherts J. M. , Borsboom D. , Kats J. , Molenaar D. (2006). The poor availability of psychological research data for reanalysis. American Psychologist, 61, 726–728.

Wicherts J. M. , Bakker M. , & Molenaar D. (2011). Willingness to share research data is related to the strength of the evidence and the quality of reporting of statistical results. PLoS One, 6, e26828.

Wollins L. (1962). Responsibility for raw data. American Psychologist, 17, 657–658.

Yong E. (2012). Nobel laureate challenges psychologists to clean up their act: Social–priming research needs “daisy chain” of replication. Nature, 485(7398), 298–300.