Sage Journals: Discover world-class research

Abstract

Over the past 10 years, crises surrounding replication, fraud, and best practices in research methods have dominated discussions in the field of psychology. However, no research exists examining how to communicate these issues to undergraduates and what effect this has on their attitudes toward the field. We developed and validated a 1-hr lecture communicating issues surrounding the replication crisis and current recommendations to increase reproducibility. Pre- and post-lecture surveys suggest that the lecture serves as an excellent pedagogical tool. Following the lecture, students trusted psychological studies slightly less but saw greater similarities between psychology and natural science fields. We discuss challenges for instructors taking the initiative to communicate these issues to undergraduates in an evenhanded way.

Keywords

replication undergraduate pedagogy open-source materials best practices questionable research practices

Get full access to this article

View all access options for this article.

References

Achenbach

(2015). Many scientific studies can’t be replicated. That’s a problem. The Washington Post. Retrieved from https://www.washingtonpost.com/news/speaking-of-science/wp/2015/08/27/trouble-in-science-massive-effort-to-reproduce-100-experimental-results-succeeds-only-36-times/

Asendorpf

J. B.

Conner

De Fruyt

De Houwer

Denissen

J. J. A.

Fiedler

… Wicherts

J. M

. (2013). Recommendations for increasing replicability in psychology. European Journal of Personality, 27, 108–119.

Carey

(2015). Many psychology findings not as strong as claimed, study says. New York Times. Retrieved from http://www.nytimes.com/2015/08/28/science/many-social-science-findings-not-as-strong-as-claimed-study-says.html

Carter

T. J.

Ferguson

M. J.

Hassin

R. R.

(2011). A single exposure to the American flag shifts support toward republicanism up to 8 months later. Psychological Science, 22, 1011–1018.

Charles

(2008). Study links warm hands, warm heart. All Things Considered. Retrieved from http://www.npr.org/templates/story/story.php?storyId=96041598

Diener

Biswas-Diener

(2016). The replication crisis in psychology. In Diener

(Ed.). NOBA Project, Psychology as a Science. Retrieved from http://nobaproject.com/modules/the-replication-crisis-in-psychology

Finkel

E. J.

Eastwick

P. W.

Reis

H. T.

(2015). Best research practices in psychology: Illustrating epistemological and pragmatic considerations with the case of relationship science. Journal of Personality and Social Psychology, 108, 275–297.

Frank

M. C.

Saxe

(2012). Teaching replication. Perspectives on Psychological Science, 7, 600–604.

Gelman

Loken

. (2013). The garden of forking paths: Why multiple comparisons can be a problem, even when there is no “fishing expedition” or “p-hacking” and the research hypothesis was posited ahead of time. Unpublished manuscript provided by Andrew Gelman.

10.

Grahe

J. E.

Reifman

Hermann

A. D.

Walker

Oleson

K. C.

Nario-Redmond

Wiebe

R. P.

(2012). Harnessing the undiscovered resource of student research projects. Perspectives on Psychological Science, 7, 605–607.

11.

Hochmuth

(2011). Study: U.S. flag “primes” voters toward republican viewpoints. Fox News Politics. Retrieved from http://www.foxnews.com/politics/2011/07/20/study-us-flag-primes-voters-toward-republican-viewpoints.html

12.

John

L. K.

Loewenstein

Prelec

(2012). Measuring the prevalence of questionable research practices with incentives for truth telling. Psychological Science, 23, 524–532.

13.

Jonas

K. J.

Cesario

(2016). How can preregistration contribute to research in our field? Comprehensive Results in Social Psychology, 1, 1–7.

14.

Klein

R. A.

Ratliff

K. A.

Vianello

Adams

R. B.

Jr Bahník

Š.

Bernstein

M. J.

… Nosek

B. A.

(2014). Investigating variation in replicability. Social Psychology, 45, 142–152.

15.

Lynott

Corker

K. S.

Wortman

Connell

Donnellan

M. B.

Lucas

R. E.

O’Brien

. (2014). Replication of “Experiencing physical warmth promotes interpersonal warmth” by Williams and Bargh (2008). Social Psychology, 45, 216–222.

16.

Nosek

B. A.

Bar-Anan

(2012). Scientific Utopia: I. Opening scientific communication. Psychological Inquiry, 23, 217–243.

17.

Nuijten

M. B.

Hartgerink

C. H. J.

van Assen

M. A. L. M.

Epskamp

Wicherts

J. M.

(2016). The prevalence of statistical reporting errors in psychology (1985–2013). Behavior Research Methods, 48, 1205–1226.

18.

Open Science Collaboration. (2015). Estimating the reproducibility of psychological science. Science, 349, aac4176.

19.

Pashler

Wagenmakers

E. J.

(2012). Editors’ introduction to the special section on replicability in psychological science: A crisis of confidence? Perspectives on Psychological Science, 7, 528–530.

20.

Roberts

B. W.

(2015). The perverse incentives that stand as a roadblock to scientific reform. In-Mind Magazine, 3. Retrieved from http://www.in-mind.org/article/the-perverse-incentives-that-stand-as-a-roadblock-to-scientific-reform

21.

Schnall

Johnson

D. J.

Cheung

Donnellan

M. B.

(2014). Commentary and rejoinder on Johnson, Cheung, and Donnellan (2014a). Social Psychology, 45, 315–320.

22.

Simmons

J. P.

Nelson

L. D.

Simonsohn

(2011). False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychological Science, 22, 1359–1366.

23.

Simmons

J. P.

Nelson

L. D.

Simonsohn

(2013). Life after P-hacking. Paper presented at the Meeting of the Society for Personality and Social Psychology, New Orleans, LA.

24.

Simonsohn

Nelson

L. D.

Simmons

J. P.

(2014). P-curve: A key to the file-drawer. Journal of Experimental Psychology: General, 143, 534–547.

25.

Smaldino

P. E.

McElreath

(2016). The natural selection of bad science. Royal Society Open Science, 3, 1–17.

26.

Spellman

B. A.

(2015). A short (personal) future history of revolution 2.0. Perspectives on Psychological Science, 10, 886–899.

27.

Wagenmakers

E. J.

(2015). A perfect storm: The record of a revolution. In-Mind Magazine, 3. Retrieved from http://www.in-mind.org/article/a-perfect-storm-the-record-of-a-revolution

28.

Williams

L. E.

Bargh

J. A.

(2008). Experiencing physical warmth promotes interpersonal warmth. Science, 322, 606–607.

29.

Yong

(2016). Psychology’s replication crisis can’t be wished away. The Atlantic. Retrieved from http://www.theatlantic.com/science/archive/2016/03/psychologys-replication-crisis-cant-be-wished-away/472272/

How (and Whether) to Teach Undergraduates About the Replication Crisis in Psychological Science

Abstract

Keywords

Get full access to this article

References