It is a widely held belief that bilinguals have an advantage over monolinguals in executive-control tasks, but is this what all studies actually demonstrate? The idea of a bilingual advantage may result from a publication bias favoring studies with positive results over studies with null or negative effects. To test this hypothesis, we looked at conference abstracts from 1999 to 2012 on the topic of bilingualism and executive control. We then determined which of the studies they reported were subsequently published. Studies with results fully supporting the bilingual-advantage theory were most likely to be published, followed by studies with mixed results. Studies challenging the bilingual advantage were published the least. This discrepancy was not due to differences in sample size, tests used, or statistical power. A test for funnel-plot asymmetry provided further evidence for the existence of a publication bias.
AdesopeO. O.LavinT.ThompsonT.UngerleiderC. (2010). A systematic review and meta-analysis of the cognitive correlates of bilingualism. Review of Educational Research, 80, 207–245.
BialystokE.BaracR. (2013). Cognitive effects. In GrosjeanF.LiP. (Eds.), The psycholinguistics of bilingualism (pp. 192–213). Chichester, England: Wiley-Blackwell.
5.
BialystokE.CraikF. I.KleinR.ViswanathanM. (2004). Bilingualism, aging, and cognitive control: Evidence from the Simon task. Psychology and Aging, 19, 290–303.
6.
BialystokE.CraikF.LukG. (2008). Cognitive control and lexical access in younger and older bilinguals. Journal of Experimental Psychology: Learning, Memory, and Cognition, 34, 859–873.
7.
BialystokE.MartinM. M. (2004). Attention and inhibition in bilingual children: Evidence from the dimensional change card sort task. Developmental Science, 7, 325–339.
8.
BobbS.WodnieckaZ.KrollJ. (Eds.). (2013). What bilinguals tell us about cognitive control [Special issue]. Journal of Cognitive Psychology, 25(5).
9.
ChambersC. D. (2013). Registered Reports: A new publishing initiative at Cortex. Cortex, 49, 609–610.
10.
CostaA.HernándezM.Costa-FaidellaJ.Sebastián-GallésN. (2009). On the bilingual advantage in conflict processing: Now you see it, now you don’t. Cognition, 113, 135–149.
11.
CostaA.HernándezM.Sebastián-GallésN. (2008). Bilingualism aids conflict resolution: Evidence from the ANT task. Cognition, 106, 59–86.
12.
CummingG. (2014). The new statistics: Why and how. Psychological Science, 25, 7–29. doi:10.1177/0956797613504966
13.
EasterbrookP. J.GopalanR.BerlinJ. A.MatthewsD. R. (1991). Publication bias in clinical research. The Lancet, 337, 867–872.
FaulF.ErdfelderE.LangA.-G.BuchnerA. (2007). G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior Research Methods, 39, 175–191.
16.
FergusonC. J.HeeneM. (2012). A vast graveyard of undead theories: Publication bias and psychological science’s aversion to the null. Perspectives on Psychological Science, 7, 555–561.
FrancisG. (2012). Too good to be true: Publication bias in two prominent studies from experimental psychology. Psychonomic Bulletin & Review, 19, 151–156.
19.
GathercoleV. C.ThomasE. M.KennedyI.PrysC.YoungN.Viñas GuaschN. . . . JonesL. (2014). Does language dominance affect cognitive performance in bilinguals? Lifespan evidence from preschoolers through older adults on card sorting, Simon, and metalinguistic tasks. Frontiers in Psychology, 5(11). Retrieved from http://journal.frontiersin.org/Journal/10.3389/fpsyg.2014.00011/full
20.
GoldB. T.KimC.JohnsonN. F.KryscioR. J.SmithC. D. (2013). Lifelong bilingualism maintains neural efficiency for cognitive control in aging. The Journal of Neuroscience, 33, 387–396.
21.
HilcheyM. D.KleinR. M. (2011). Are there bilingual advantages on nonlinguistic interference tasks? Implications for the plasticity of executive control processes. Psychonomic Bulletin & Review, 18, 625–658.
22.
JohnL. K.LoewensteinG.PrelecD. (2012). Measuring the prevalence of questionable research practices with incentives for truth telling. Psychological Science, 23, 524–532.
23.
KrollJ. F.BialystokE. (2013). Understanding the consequences of bilingualism for language processing and cognition. Journal of Cognitive Psychology, 25, 497–514.
LukG.AndersonJ.BialystokE.CraikF. I. M.GradyC. (2009, October). Distinct neural correlates for cognitive control and motor inhibition in bilinguals. Poster presented at the annual meeting of the Society for Neuroscience, Chicago, IL.
27.
LukG.AndersonJ. A.CraikF. I.GradyC.BialystokE. (2010). Distinct neural correlates for two types of inhibition in bilinguals: Response inhibition versus interference suppression. Brain and Cognition, 74, 347–357.
28.
MahoneyM. J. (1977). Publication prejudices: An experimental study of confirmatory bias in the peer review system. Cognitive Therapy and Research, 1, 161–175.
29.
PaapK. R. (2014). The role of componential analysis, categorical hypothesising, replicability and confirmation bias in testing for bilingual advantages in executive functioning. Journal of Cognitive Psychology, 26, 242–255. doi:10.1080/20445911.2014.891597
30.
PaapK. R.GreenbergZ. I. (2013). There is no coherent evidence for a bilingual advantage in executive processing. Cognitive Psychology, 66, 232–258.
31.
PaapK. R.GreenbergZ.GuerreroD.MejiaB. (2010, November). I left my bilingual advantage in San Francisco. Poster presented at the annual meeting of the Psychonomic Society, St. Louis, MO.
32.
PaapK. R.GreenbergZ. I.LiuY. (2012, November). Bilinguals show no enhanced executive control for linguistic processing involving conflict. Poster presented at the annual meeting of the Psychonomic Society, Minneapolis, MN.
33.
PaapK. R.LiuY. (2014). Conflict resolution in sentence processing is the same for bilinguals and monolinguals: The role of confirmation bias in testing for bilingual advantages. Journal of Neurolinguistics, 27, 50–74.
34.
PashlerH.HarrisC. R. (2012). Is the replicability crisis overblown? Three arguments examined. Perspectives on Psychological Science, 7, 531–536.
35.
PriorA.MacWhinneyB. (2010). A bilingual advantage in task switching. Bilingualism: Language and Cognition, 13, 253–262.
36.
SalvatierraJ. L.RosselliM. (2011). The effect of bilingualism and age on inhibitory control. International Journal of Bilingualism, 15, 26–37.
SpellmanB. A. (2012). Introduction to the special section: Data, data, everywhere . . . especially in my file drawer. Perspectives on Psychological Science, 7, 58–59.
39.
SterneJ. A. C.BeckerB. J.EggerM. (2005). The funnel plot. In RothsteinH.SuttonA.BorensteinM. (Eds.), Publication bias in meta-analysis: Prevention, assessment, and adjustments (pp. 75–98). West Sussex, England: John Wiley & Sons.
40.
TreccaniB.ArgyriE.SoraceA.Della SalaS. (2009). Spatial negative priming in bilingualism. Psychonomic Bulletin & Review, 16, 320–327.
41.
ViechtbauerW. (2010). Conducting meta-analyses in R with the metafor package. Journal of Statistical Software, 36(3), 1–48.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
