Previous studies have separately found that exogenous orienting decreases multisensory integration (MSI), while endogenous orienting enhances MSI. It is currently unclear, however, why the two orientations have opposite effects on MSI. In the current study, we investigated the interaction between spatial attention and MSI in two experiments based on the cue–target paradigm. Experiment 1 separated exogenous and endogenous orienting to investigate the effect of spatial attention on MSI by varying the predictability of the cue. Experiment 2 further explored the effect of endogenous orienting on MSI. We found that exogenous orienting induced by the directionality of the cue decreased MSI, while endogenous orienting induced by the predictability of the cue enhanced MSI. The role of spatial orienting need and spatial attention bias in the modulation of MSI by exogenous and endogenous orienting was discussed. The present study sheds new light on how spatial attention modulates MSI processes.
AlportA.StylesE. A.HsiehS. (1994). Shifting intentional set: Exploring the dynamic control of tasks. Attention and Performance XV: Conscious and Nonconscious Information Processing, 15, 421.
2.
AlsiusA.NavarraJ.CampbellR.Soto-FaracoS. (2005). Audiovisual integration of speech falters under high attention demands. Current Biology, 15(9), 839–843. https://doi.org/10.1016/j.cub.2005.03.046
BaddeS.NavarroK. T.LandyM. S. (2020). Modality-specific attention attenuates visual-tactile integration and recalibration effects by reducing prior expectations of a common source for vision and touch. Cognition, 197, 104170. https://doi.org/10.1016/j.cognition.2019.104170
5.
BarutchuA.SpenceC. (2021). Top-down task-specific determinants of multisensory motor reaction time enhancements and sensory switch costs. Experimental Brain Research, 239(3), 1021–1034. https://doi.org/10.1007/s00221-020-06014-3
6.
BertelsonP.VroomenJ.de GelderB.DriverJ. (2000). The ventriloquist effect does not depend on the direction of deliberate visual attention. Perception & Psychophysics, 62(2), 321–332. https://doi.org/10.3758/bf03205552
7.
BizleyJ. K.Shinn-CunninghamB. G.LeeA. K. (2012). Nothing is irrelevant in a noisy world: Sensory illusions reveal obligatory within-and across-modality integration. Journal of Neuroscience, 32(39), 13402–13410. https://doi.org/10.1523/jneurosci.2495-12.2012
8.
BonatoM.LisiM.PegoraroS.PourtoisG. (2018). Cue-target contingencies modulate voluntary orienting of spatial attention: Dissociable effects for speed and accuracy. Psychological Research, 82(2), 272–283. https://doi.org/10.1007/s00426-016-0818-6
9.
BottaF.SantangeloV.RaffoneA.LupiáñezJ.BelardinelliM. O. (2010). Exogenous and endogenous spatial attention effects on visuospatial working memory. Quarterly Journal of Experimental Psychology, 63(8), 1590–1602. https://doi.org/10.1080/17470210903443836
10.
BrignaniD.GuzzonD.MarziC. A.MiniussiC. (2009). Attentional orienting induced by arrows and eye-gaze compared with an endogenous cue. Neuropsychologia, 47(2), 370–381. https://doi.org/10.1016/j.neuropsychologia.2008.09.011
11.
BurnettK. E.CloseA. C.d’AvossaG.SapirA. (2016). Spatial attention can be biased towards an expected dimension. Quarterly Journal of Experimental Psychology, 69(11), 2218–2232. https://doi.org/10.1080/17470218.2015.1111916
12.
CederbladA. M. H.VisokomogilskiA.AndersenS. K.MacLeodM. J.SahraieA. (2021). Conscious awareness modulates processing speed in the redundant signal effect. Experimental Brain Research, 239(6), 1877–1893. https://doi.org/10.1007/s00221-020-06008-1
13.
FairhallS. L.MacalusoE. (2009). Spatial attention can modulate audiovisual integration at multiple cortical and subcortical sites. European Journal of Neuroscience, 29(6), 1247–1257. https://doi.org/10.1111/j.1460-9568.2009.06688.x
14.
FanJ.McCandlissB. D.SommerT.RazA.PosnerM. I. (2002). Testing the efficiency and independence of attentional networks. Journal of Cognitive Neuroscience, 14(3), 340–347. https://doi.org/10.1162/089892902317361886
15.
FerrariA.NoppeneyU. (2021). Attention controls multisensory perception via two distinct mechanisms at different levels of the cortical hierarchy. PLOS Biology, 19(11), e3001465. https://doi.org/10.1371/journal.pbio.3001465
16.
GriceG. R.CanhamL.GwynneJ. W. (1984). Absence of a redundant-signals effect in a reaction time task with divided attention. Perception & Psychophysics, 36(6), 565–570. https://doi.org/10.3758/bf03207517
17.
HershensonM. (1962). Reaction time as a measure of intersensory facilitation. Journal of Experimental Psychology, 63, 289–293. https://doi.org/10.1037/h0039516
18.
JohnsonM. L.PalmerJ.MooreC. M.BoyntonG. M. (2020). Endogenous cueing effects for detection can be accounted for by a decision model of selective attention. Psychonomic Bulletin & Review, 27(2), 315–321. https://doi.org/10.3758/s13423-019-01698-3
19.
JonidesJ. (1981). Voluntary vs. Automatic control over the mind’s eye’s movement. In LongJ. B.BaddeleyA. D. (Eds.), Attention and performance (pp. 187–203). Lawrence Erlbaum Associates.
20.
LaCroixA. N.TullyM.RogalskyC. (2021). Assessment of alerting, orienting, and executive control in persons with aphasia using the Attention Network Test. Aphasiology, 35(10), 1318–1333. https://doi.org/10.1080/02687038.2020.1795077
21.
LaidlawK. E. W.KingstoneA. (2017). If not when, then where? Ignoring temporal information eliminates reflexive but not volitional spatial orienting. Vision, 1(2), 1020012. https://doi.org/10.3390/vision1020012
22.
LewaldJ.GuskiR. (2003). Cross-modal perceptual integration of spatially and temporally disparate auditory and visual stimuli. Cognitive Brain Research, 16(3), 468–478. https://doi.org/10.1016/s0926-6410(03)00074-0
23.
LiangG.ScolariM. (2020). Limited interactions between space- and feature-based attention in visually sparse displays. Journal of Vision, 20(4), 5. https://doi.org/10.1167/jov.20.4.5
24.
LoriaT.TanakaK.WatanabeK.TremblayL. (2020). Deploying attention to the target location of a pointing action modulates audiovisual processes at nontarget locations. Attention Perception & Psychophysics, 82(7), 3507–3520. https://doi.org/10.3758/s13414-020-02065-4
25.
LunnJ.SjoblomA.WardJ.Soto-FaracoS.ForsterS. (2019). Multisensory enhancement of attention depends on whether you are already paying attention. Cognition, 187, 38–49. https://doi.org/10.1016/j.cognition.2019.02.008
26.
MaddenD. J. (1992). Selective attention and visual search: Revision of an allocation model and application to age differences. Journal of Experimental Psychology: Human Perception and Performance, 18(3), 821–836. https://doi.org/10.1037//0096-1523.18.3.821
27.
MahadevanM. S.BedellH. E.StevensonS. B. (2018). The influence of endogenous attention on contrast perception, contrast discrimination, and saccadic reaction time. Vision Research, 143, 89–102. https://doi.org/10.1016/j.visres.2017.11.005
28.
MeyerK. N.DuF.ParksE.HopfingerJ. B. (2018). Exogenous vs. Endogenous attention: Shifting the balance of fronto-parietal activity. Neuropsychologia, 111, 307–316. https://doi.org/10.1016/j.neuropsychologia.2018.02.006
PosnerM. I.SnyderC. R.DavidsonB. J. (1980). Attention and the detection of signals. Journal of Experimental Psychology: General, 109(2), 160–174.
36.
PrasadS. G.MishraR. K.KleinR. M. (2021). Re-examining attention capture at irrelevant (ignored?) locations. Journal of Experimental Psychology: General, 150(12), e57–e65. https://doi.org/10.1037/xge0001061
37.
PrinzmetalW.ZvinyatskovskiyA.GutierrezP.DilemL. (2009). Voluntary and involuntary attention have different consequences: The effect of perceptual difficulty. Quarterly Journal of Experimental Psychology, 62(2), 352–369. https://doi.org/10.1080/17470210801954892
38.
QianQ.WangF.SongM.FengY.ShinomoriK. (2017). Sequence effects of the involuntary and the voluntary components of symbolic cueing. Attention Perception & Psychophysics, 80(3), 662–668. https://doi.org/10.3758/s13414-017-1472-9
39.
RisticJ.KingstoneA. (2006). Attention to arrows: Pointing to a new direction. Quarterly Journal of Experimental Psychology, 59(11), 1921–1930. https://doi.org/10.1080/17470210500416367
SantangeloV.FagioliS.MacalusoE. (2010). The costs of monitoring simultaneously two sensory modalities decrease when dividing attention in space. NeuroImage, 49(3), 2717–2727. https://doi.org/10.1016/j.neuroimage.2009.10.061
42.
SteinB. E.MeredithM. A. (1993). The merging of the senses. MIT Press.
43.
SteinB. E.StanfordT. R.RowlandB. A. (2014). Development of multisensory integration from the perspective of the individual neuron. Nature Reviews. Neuroscience, 15(8), 520–535. https://doi.org/10.1038/nrn3742
44.
TalsmaD.DotyT. J.WoldorffM. G. (2007). Selective attention and audiovisual integration: Is attending to both modalities a prerequisite for early integration?Cerebral Cortex, 17(3), 679–690. https://doi.org/10.1093/cercor/bhk016
45.
TalsmaD.SenkowskiD.Soto-FaracoS.WoldorffM. G. (2010). The multifaceted interplay between attention and multisensory integration. Trends in Cognitive Sciences, 14(9), 400–410. https://doi.org/10.1016/j.tics.2010.06.008
46.
TalsmaD.WoldorffM. G. (2005). Selective attention and multisensory integration: Multiple phases of effects on the evoked brain activity. Journal of Cognitive Neuroscience, 17(7), 1098–1114. https://doi.org/10.1162/0898929054475172
47.
TangX.WuJ.ShenY. (2016). The interactions of multisensory integration with endogenous and exogenous attention. Neuroscience & Biobehavioral Reviews, 61, 208–224. https://doi.org/10.1016/j.neubiorev.2015.11.002
TangX. Y.WangX. L.PengX.LiQ.ZhangC.WangA.ZhangM. (2021). Electrophysiological evidence of different neural processing between visual and audiovisual inhibition of return. Scientific Reports, 11(1), 8056. https://doi.org/10.1038/s41598-021-86999-1
50.
TangX. Y.WuY. N.PengX.WangA. J.LiQ. (2020). The influence of endogenous spatial cue validity on audiovisual integration. Acta Psychologica Sinica, 52(7), 835–846. https://doi.org/10.3724/sp.J.1041.2020.00835
51.
ThompsonC.PasquiniA.HillsP. J. (2021). Carry-over of attentional settings between distinct tasks: A transient effect independent of top-down contextual biases. Consciousness and Cognition, 90, 103104. https://doi.org/10.1016/j.concog.2021.103104
52.
TiippanaK.PuharinenH.MöttönenR.SamsM. (2011). Sound location can influence audiovisual speech perception when spatial attention is manipulated. Seeing Perceiving, 24(1), 67–90. https://doi.org/10.1163/187847511x557308
53.
UlrichR.MillerJ.SchröterH. (2007). Testing the race model inequality: An algorithm and computer programs. Behavior Research Methods, 39(2), 291–302. https://doi.org/10.3758/bf03193160
54.
Van der StoepN.Van der StigchelS.NijboerT. C. W. (2014). Exogenous spatial attention decreases audiovisual integration. Attention Perception & Psychophysics, 77(2), 464–482. https://doi.org/10.3758/s13414-014-0785-1
55.
Van der StoepN.Van der StigchelS.NijboerT. C. W.SpenceC. (2016). Visually induced inhibition of return affects the integration of auditory and visual information. Perception, 46(1), 6–17. https://doi.org/10.1177/0301006616661934
56.
VosselS.ThielC. M.FinkG. R. (2006). Cue validity modulates the neural correlates of covert endogenous orienting of attention in parietal and frontal cortex. NeuroImage, 32(3), 1257–1264. https://doi.org/10.1016/j.neuroimage.2006.05.019
57.
VroomenJ.BertelsonP.de GelderB. (2001a). Directing spatial attention towards the illusory location of a ventriloquized sound. Acta Psychologica, 108(1), 21–33. https://doi.org/10.1016/s0001-6918(00)00068-8
58.
VroomenJ.BertelsonP.de GelderB. (2001b). The ventriloquist effect does not depend on the direction of automatic visual attention. Perception & Psychophysics, 63(4), 651–659. https://doi.org/10.3758/bf03194427
59.
WendtM.KählerS. T.Luna-RodriguezA.JacobsenT. (2017). Adoption of task-specific sets of visual attention. Frontiers in Psychology, 8, 687. https://doi.org/10.3389/fpsyg.2017.00687
60.
YouW. K.MysoreS. P. (2020). Endogenous and exogenous control of visuospatial selective attention in freely behaving mice. Nature Communications, 11(1), 1986. https://doi.org/10.1038/s41467-020-15909-2
