Stroop effects can be modulated by context-specific cues associated with different levels of proportion congruent, even for items that appear equally frequently in each context. This result has important theoretical implications, because it rules out frequency-driven learning explanations of context-specific proportion congruent (CSPC) effects and leaves open the possibility that a cue-driven retrieval process can reinstate attentional control settings in a rapid online fashion. The purpose of the present work was to address reproducibility concerns that have been raised about this finding. We conducted several reproductions and novel extensions using Amazon's mechanical Turk in both Stroop and flanker tasks. We successfully replicated the central finding that CSPC effects can be observed for frequency-unbiased items. We also provide new Monte Carlo simulation analyses to estimate reproducibility of the phenomena that show important limitations on these designs for measuring contextual control.
BarnhoornJ. S., HaasnootE., BocanegraB. R., & van SteenbergenH. (2015). QRTEngine: An easy solution for running online reaction time experiments using qualtrics. Behavior Research Methods, 47, 918–929.
2.
BrownS. D., & HeathcoteA. (2008). The simplest complete model of choice response time: linear ballistic accumulation. Cognitive Psychology, 57, 153–178.
3.
BuggJ. M. (2012). Dissociating levels of cognitive control the case of stroop interference. Current Directions in Psychological Science, 21, 302–309.
4.
BuggJ. M., & CrumpM. J. C. (2012). In support of a distinction between voluntary and stimulus-driven control: A review of the literature on proportion congruent effects. Frontiers in Psychology, 3, 1–16, Article no. 367.
5.
CañadasE., Rodríguez-BailónR., MillikenB., & LupiáñezJ. (2013). Social categories as a context for the allocation of attentional control. Journal of Experimental Psychology: General, 142, 934–943.
6.
ChunM. M., & Turk-BrowneN. B. (2007). Interactions between attention and memory. Current Opinion in Neurobiology, 17, 177–184.
7.
CorballisP. M., & GrattonG. (2003). Independent control of processing strategies for different locations in the visual field. Biological Psychology, 64, 191–209.
8.
CrumpM. J. C. (2016). Learning to selectively attend from context-specific attentional histories: A demonstration and some constraints. Canadian Journal of Experimental Psychology, 70, 59–77.
9.
CrumpM. J. C., GongZ., & MillikenB. (2006). The context-specific proportion congruent stroop effect: Location as a contextual cue. Psychonomic Bulletin & Review, 13, 316–321.
10.
CrumpM. J. C., & LoganG. D. (2010). Contextual control over task-set retrieval. Attention, Perception & Psychophysics, 72, 2047–2053.
11.
CrumpM. J. C., McDonnellJ. V., & GureckisT. M. (2013). Evaluating amazon's mechanical turk as a tool for experimental behavioral research. PLoS ONE, 8(3), Article no. e57410.
12.
CrumpM. J. C., & MillikenB. (2009). The flexibility of context-specific control: Evidence for context-driven generalization of item-specific control settings. The Quarterly Journal of Experimental Psychology, 62, 1523–1532.
13.
CrumpM. J. C., VaqueroJ. M. M., & MillikenB. (2008). Context-specific learning and control: The roles of awareness, task relevance, and relative salience. Consciousness and Cognition, 17, 22–36.
14.
EgnerT. (2008). Multiple conflict-driven control mechanisms in the human brain. Trends in Cognitive Sciences, 12, 374–380.
15.
EriksenB. A., & EriksenC. W. (1974). Effects of noise letters upon the identification of a target letter in a nonsearch task. Perception & Psychophysics, 16, 143–149.
16.
HeinemannA., KundeW., & KieselA. (2009). Context-specific prime-congruency effects: On the role of conscious stimulus representations for cognitive control. Consciousness and Cognition, 18, 966–976.
17.
HutcheonT., & SpielerD. (2016). Context-driven control does not generalize to frequency unbiased stimuli. Quarterly Journal of Experimental Psychology. Epub online. doi:10.1080/17470218.2016.1182193
18.
KingJ. A., DonkinC., KorbF. M., & EgnerT. (2012). Model-based analysis of context-specific cognitive control. Frontiers in Psychology, 3, 1–13, Article no. 358.
19.
KingJ. A., KorbF. M., & EgnerT. (2012). Priming of control: Implicit contextual cuing of top-down attentional set. The Journal of Neuroscience, 32, 8192–8200.
LoganG. D. (1988). Toward an instance theory of automatization. Psychological Review, 95, 492–527.
22.
LoganG. D., & ZbrodoffN. J. (1998). Stroop-type interference: Congruity effects in colour naming with typewritten responses. Journal of Experimental Psychology: Human Perception and Performance, 24, 978–992.
MaxwellS. E., KelleyK., & RauschJ. R. (2008). Sample size planning for statistical power and accuracy in parameter estimation. Annual Review of Psychology, 59, 537–563.
25.
Open Science Collaboration. (2015). Estimating the reproducibility of psychological science. Science, 349, 1–8, aac4716.
26.
ReimersS., & MaylorE. A. (2005). Task switching across the life span: effects of age on general and specific switch costs. Developmental Psychology, 41, 661–671.
27.
ReimersS., & StewartN. (2015). Presentation and response timing accuracy in Adobe Flash and HTML5/JavaScript web experiments. Behavior Research Methods, 47, 309–327.
28.
SchmidtJ. R., & BesnerD. (2008). The stroop effect: Why proportion congruent has nothing to do with congruency and everything to do with contingency. Journal of Experimental Psychology: Learning, Memory, and Cognition, 34, 514–523.
29.
SchmidtJ. R., CrumpM. J. C., CheesmanJ., & BesnerD. (2007). Contingency learning without awareness: Evidence for implicit control. Consciousness and Cognition, 16, 421–435.
30.
SchmidtJ. R., LemercierC., & De HouwerJ. (2014). Context-specific temporal learning with non-conflict stimuli: Proof-of-principle for a learning account of context-specific proportion congruent effects. Frontiers in Psychology, 5, 1–10, Article no. 1241.
31.
SchubertT. W., MurteiraC., CollinsE. C., & LopesD. (2013). ScriptingRT: A software library for collecting response latencies in online studies of cognition. PLoS ONE, 8, 1–12, e67769.
32.
SimcoxT., & FiezJ. A. (2014). Collecting response times using Amazon mechanical Turk and Adobe Flash. Behavior Research Methods, 1, 95–111.
33.
StroopJ. R. (1935). Studies of interference in serial verbal reactions. Journal of Experimental Psychology, 18, 643–662.
34.
Van SelstM., & JolicoeurP. (1994). A solution to the effect of sample size on outlier elimination. The Quarterly Journal of Experimental Psychology Section A, 47, 631–650.
35.
VeceraS. P., CosmanJ. D., VatterottD. B., & RoperZ. J. (2014). The control of visual attention: toward a unified account. In BrianR. H. (Ed.), Psychology of learning and motivation (Vol. 60, pp. 303–347). Burlington: Academic Press.
