Evaluating Psychological Research Requires More Than Attention to the N

Anderson C. J. Barnett-Cowan M. Bosco F. A. Chandler J. Chartier C. R. , . . . Zuni K. (2016). Response to comment on “Estimating the reproducibility of psychological science.” Science, 351, 1037.

Bless H. Schwarz N. Wänke M. (2003). The size of context effects in social judgment. In Forgas J. P. Williams K. D. von Hippel W. (Eds.), Social judgments: Implicit and explicit processes (pp. 180–197). Cambridge, England: Cambridge University Press.

Ebersole C. R. Atherton O. E. Belanger A. L. Skulborstad H. M. Allen J. M. Banks J. B. , . . . Nosek B. A. (2015). Many Labs 3: Evaluating participant pool quality across the academic semester via replication. Retrieved from https://osf.io/csygd/

Fabrigar L. R. Wegener D. T. (2016). Conceptualizing and evaluating the replication of research results. Journal of Experimental Social Psychology, 66, 68–80. doi:10.1016/j.jesp.2015.07.009

Feddersen J. Metcalfe R. Wooden M. (2012). Subjective well-being: Weather matters; climate doesn’t (Melbourne Institute Working Paper Series, Working Paper No. 25/2012). Retrieved from http://web.archive.org/web/20150107020727/http://melbourneinstitute.com/downloads/working_paper_series/wp2012n25.pdf

Gilbert D. T. King G. Pettigrew S. Wilson T. D. (2016). Comment on “Estimating the reproducibility of psychological science.” Science, 351, 1037.

Klein R. A. Ratliff K. A. Vianello M. Adams R. B. Bahník Š. Bernstein M. J. , . . . Nosek B. A. (2014). Investigating variation in replicability: A ‘‘Many Labs’’ replication project. Social Psychology, 45, 142–152. doi:10.1027/1864-9335/a000178

Klein R. A. Vianello M. Hasselman F. Alper S. Aveyard M. Axt J. R. , . . . Nosek B. A. (2015). Many Labs 2: Investigating variation in replicability across sample and setting. Retrieved from http://projectimplicit.net/nosek/ML2protocol.pdf

Lucas R. E. Lawless N. M. (2013). Does life seem better on a sunny day? Examining the association between daily weather conditions and life satisfaction judgments. Journal of Personality and Social Psychology, 104, 872–884.

Open Science Center. (2016). Many Labs 5: Can conducting formal peer review in advance improve reproducibility? Retrieved from https://docs.google.com/document/d/1tnPqr2JSpODQjJ8yB-lC6sCwuWoJn0kWEfgg8mZH5nY/edit?pref=2&pli=1

Open Science Collaboration. (2015). Estimating the reproducibility of psychological science. Science, 349, 943. doi:10.1126/science.aac4716

Schwarz N. (1999). Self-reports: How the questions shape the answers. American Psychologist, 54, 93–105.

Schwarz N. Clore G. L. (1983). Mood, misattribution, and judgments of well-being: Informative and directive functions of affective states. Journal of Personality and Social Psychology, 45, 513–523.

Schwarz N. Clore G. L. (2003). Mood as information: 20 years later. Psychological Inquiry, 14, 296–303.

Schwarz N. Clore G. L. (2007). Feelings and phenomenal experiences. In Kruglanski A. Higgins E. T. (Eds.), Social psychology: Handbook of basic principles (2nd ed., pp. 385–407). New York, NY: Guilford Press.

Schwarz N. Strack F. (2014). Does merely going through the same moves make for a “direct” replication? Concepts, contexts, and operationalizations. Social Psychology, 45, 305–306. doi:10.1027/1864-9335/a000202

Schwarz N. Strack F. Mai H. P. (1991). Assimilation and contrast effects in part-whole question sequences: A conversational logic analysis. Public Opinion Quarterly, 55, 3–23.

Simonsohn U. (2015). Small telescopes: Detectability and the evaluation of replication results. Psychological Science, 26, 559–569.

Stroebe W. Strack F. (2014). The alleged crisis and the illusion of exact replication. Perspectives on Psychological Science, 9, 59–71.

Van Bavel J. J. Mede-Siedlecki P. Brady W. J. Reinero D. A . (2016). Contextual sensitivity in scientific reproducibility. Proceedings of the National Academy of Sciences, USA, 113, 6454–6459.