Sage Journals: Discover world-class research

Abstract

The Big Five personality traits have been linked to dozens of life outcomes. However, metascientific research has raised questions about the replicability of behavioral science. The Life Outcomes of Personality Replication (LOOPR) Project was therefore conducted to estimate the replicability of the personality-outcome literature. Specifically, I conducted preregistered, high-powered (median N = 1,504) replications of 78 previously published trait–outcome associations. Overall, 87% of the replication attempts were statistically significant in the expected direction. The replication effects were typically 77% as strong as the corresponding original effects, which represents a significant decline in effect size. The replicability of individual effects was predicted by the effect size and design of the original study, as well as the sample size and statistical power of the replication. These results indicate that the personality-outcome literature provides a reasonably accurate map of trait–outcome associations but also that it stands to benefit from efforts to improve replicability.

Keywords

Big Five life outcomes metascience personality traits replication open data open materials preregistered

Get full access to this article

View all access options for this article.

References

Allport

G. W.

(1961). Pattern and growth in personality. Oxford, England: Holt, Rinehart & Winston.

Almlund

Duckworth

A. L.

Heckman

Kautz

(2011). Personality psychology and economics. In Hanushek

E. A.

Machin

Woessmann

(Eds.), Handbook of the economics of education (Vol. 4, pp. 1–181). Amsterdam, The Netherlands: Elsevier.

Button

K. S.

Ioannidis

J. P.

Mokrysz

Nosek

B. A.

Flint

Robinson

E. S.

Munafò

M. R.

(2013). Power failure: Why small sample size undermines the reliability of neuroscience. Nature Reviews Neuroscience, 14, 365–376.

Camerer

C. F.

Dreber

Forsell

T.-H.

Huber

Johannesson

. . . Hang

(2016). Evaluating replicability of laboratory experiments in economics. Science, 351, 1433–1436.

Chernyshenko

O. S.

Kankaraš

Drasgow

(2018). Social and emotional skills for student success and well-being. Paris, France: OECD Publishing.

Cohen

(1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.

Cova

Strickland

Abatista

Allard

Andow

Attie

. . . Zhou

(2018). Estimating the reproducibility of experimental philosophy. Review of Philosophy and Psychology. Advance online publication. doi:10.1007/s13164-018-0400-9

De Raad

Perugini

Hrebícková

Szarota

. (1998). Lingua franca of personality: Taxonomies and structures based on the psycholexical approach. Journal of Cross-Cultural Psychology, 29, 212–232.

Ebersole

C. R.

Atherton

O. E.

Belanger

A. L.

Skulborstad

H. M.

Allen

J. M.

Banks

J. B.

. . . Boucher

(2016). Many Labs 3: Evaluating participant pool quality across the academic semester via replication. Journal of Experimental Social Psychology, 67, 68–82.

10.

Fraley

R. C.

Vazire

(2014). The N-pact factor: Evaluating the quality of empirical journals with respect to sample size and statistical power. PLOS ONE, 9(10), Article e109019. doi.org/10.1371/journal.pone.0109019

11.

Franco

Malhotra

Simonovits

(2014). Publication bias in the social sciences: Unlocking the file drawer. Science, 345, 1502–1505.

12.

Goldberg

L. R.

(1993). The structure of phenotypic personality traits. American Psychologist, 48, 26–34.

13.

Hagger

M. S.

Chatzisarantis

N. L.

Alberts

Anggono

C. O.

Batailler

Birt

A. R.

. . . Zwienenberg

(2016). A multilab preregistered replication of the ego-depletion effect. Perspectives on Psychological Science, 11, 546–573.

14.

John

O. P.

Naumann

L. P.

Soto

C. J.

(2008). Paradigm shift to the integrative Big Five trait taxonomy: History, measurement, and conceptual issues. In John

O. P.

Robins

R. W.

Pervin

L. A.

(Eds.), Handbook of personality: Theory and research (3rd ed., pp. 114–158). New York, NY: Guilford Press.

15.

Kautz

Heckman

J. J.

Diris

ter Weel

Borghans

(2014). Fostering and measuring skills: Improving cognitive and non-cognitive skills to promote lifetime success (National Bureau of Economic Research Working Paper 20749). doi:10.3386/w20749

16.

Klein

R. A.

Ratliff

K. A.

Vianello

Adams

R. B.

Jr. Bahník

Š.

Bernstein

M. J.

. . . Brumbaugh

C. C.

(2014). Investigating variation in replicability: A “many labs” replication project. Social Psychology, 45, 142–152.

17.

Lord

F. M.

Novick

M. R.

(1968). Statistical theories of mental test scores. Oxford, England: Addison-Wesley.

18.

McShane

B. B.

Tackett

J. L.

Bockenholt

Gelman

(2017). Large scale replication projects in contemporary psychological research. Retrieved from arXiv: https://arxiv.org/abs/1710.06031

19.

Nelson

L. D.

Simmons

Simonsohn

(2018). Psychology’s renaissance. Annual Review of Psychology, 69, 511–534.

20.

Open Science Collaboration. (2015). Estimating the reproducibility of psychological science. Science, 349, aac4716.

21.

Organisation for Economic Co-operation and Development. (2015). Skills for social progress: The power of social and emotional skills. Paris, France: OECD Publishing.

22.

Ozer

D. J.

Benet-Martinez

(2006). Personality and the prediction of consequential outcomes. Annual Review of Psychology, 57, 401–421.

23.

Primi

Santos

John

O. P.

De Fruyt

(2016). Development of an inventory assessing social and emotional skills in Brazilian youth. European Journal of Psychological Assessment, 32, 5–16.

24.

Roberts

B. W.

Kuncel

N. R.

Shiner

Caspi

Goldberg

L. R.

(2007). The power of personality: The comparative validity of personality traits, socioeconomic status, and cognitive ability for predicting important life outcomes. Perspectives on Psychological Science, 2, 313–345.

25.

Rossi

J. S.

(1990). Statistical power of psychological research: What have we gained in 20 years? Journal of Consulting and Clinical Psychology, 58, 646–656.

26.

Simmons

J. P.

Nelson

L. D.

Simonsohn

(2011). False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychological Science, 22, 1359–1366.

27.

Simonsohn

(2015). Small telescopes: Detectability and the evaluation of replication results. Psychological Science, 26, 559–569.

28.

Soto

C. J.

John

O. P.

(2017). The next Big Five Inventory (BFI-2): Developing and assessing a hierarchical model with 15 facets to enhance bandwidth, fidelity, and predictive power. Journal of Personality and Social Psychology, 113, 117–143.

29.

Sterling

T. D.

Rosenbaum

W. L.

Weinkam

J. J.

(1995). Publication decisions revisited: The effect of the outcome of statistical tests on the decision to publish and vice versa. The American Statistician, 49, 108–112.

30.

Stroebe

Strack

(2014). The alleged crisis and the illusion of exact replication. Perspectives on Psychological Science, 9, 59–71.

31.

Tversky

Kahneman

(1971). Belief in the law of small numbers. Psychological Bulletin, 76, 105–110.

32.

Vul

Harris

Winkielman

Pashler

(2009). Puzzlingly high correlations in fMRI studies of emotion, personality, and social cognition. Perspectives on Psychological Science, 4, 274–290.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.59 MB

0.58 MB

How Replicable Are Links Between Personality Traits and Consequential Life Outcomes? The Life Outcomes of Personality Replication Project

Abstract

Keywords

Get full access to this article

References

Supplementary Material