Humans make frequent movements of the eyes (saccades) to explore the visual environment. Here, we argue that visuospatial working memory (VSWM) is a fundamental component of the eye movement system. Memory representations in VSWM are functionally integrated at all stages of orienting: (a) selection of the target; (b) maintenance of visual features across the saccade; (c) the computation of object correspondence after the saccade, supporting the experience of perceptual continuity; and (d) the correction of gaze when the eyes fail to land on the intended object. VSWM is finely tuned to meet the challenges of active vision.
AtsmaJ.MaijF.KoppenM.IrwinD. E.MedendorpW. P. (2016). Causal inference for spatial constancy across saccades. PLOS Computational Biology, 12(3), Article e1004766. doi:10.1371/journal.pcbi.1004766
2.
AwhE.JonidesJ. (2001). Overlapping mechanisms of attention and spatial working memory. Trends in Cognitive Sciences, 5, 119–126. doi:10.1016/S1364-6613(00)01593-X
3.
BahleB.MatsukuraM.HollingworthA. (2017). Contrasting gist-based and template-based guidance during real-world visual search. Journal of Experimental Psychology: Human Perception and Performance. Advance online publication. doi:10.1037/xhp0000468
4.
BaysP. M.HusainM. (2008). Dynamic shifts of limited working memory resources in human vision. Science, 321, 851–854. doi:10.1126/science.1158023
5.
BeckV. M.HollingworthA.LuckS. J. (2012). Simultaneous control of attention by multiple working memory representations. Psychological Science, 23, 887–898. doi:10.1177/0956797612439068
6.
BoonP. J.BelopolskyA. V.TheeuwesJ. (2016). The role of the oculomotor system in updating visual-spatial working memory across saccades. PLOS ONE, 11(9), Article e0161829. doi:10.1371/journal.pone.0161829
7.
BridgemanB.HendryD.StarkL. (1975). Failure to detect displacement of the visual world during saccadic eye movements. Vision Research, 15, 719–722. doi:10.1016/0042-6989(75)90290-4
8.
CurrieC. B.McConkieG. W.Carlson-RadvanskyL. A.IrwinD. E. (2000). The role of the saccade target object in the perception of a visually stable world. Perception & Psychophysics, 62, 673–683. doi:10.3758/BF03206914
9.
DeubelH.SchneiderW. X. (1996). Saccade target selection and object recognition: Evidence for a common attentional mechanism. Vision Research, 36, 1827–1837. doi:10.1016/0042-6989(95)00294-4
FabiusJ. H.FracassoA.Van der StigchelS. (2016). Spatiotopic updating facilitates perception immediately after saccades. Scientific Reports, 6, Article 34488. doi:10.1038/srep34488
12.
GanmorE.LandyM. S.SimoncelliE. P. (2015). Near-optimal integration of orientation information across saccades. Journal of Vision, 15(16), Article 8. doi:10.1167/15.16.8
13.
GayetS.GuggenmosM.ChristophelT. B.HaynesJ.-D.PaffenC. L. E.Van der StigchelS.SterzerP. (2017). Visual working memory enhances the neural response to matching visual input. The Journal of Neuroscience, 37, 6638–6647. doi:10.1523/jneurosci.3418-16.2017
14.
GolombJ. D.PulidoV. Z.AlbrechtA. R.ChunM. M.MazerJ. A. (2010). Robustness of the retinotopic attentional trace after eye movements. Journal of Vision, 10(3), Article 19. doi:10.1167/10.3.19
15.
HanningN. M.JonikaitisD.DeubelH.SzinteM. (2016). Oculomotor selection underlies feature retention in visual working memory. Journal of Neurophysiology, 115, 1071–1076. doi:10.1152/jn.00927.2015
16.
HerwigA.SchneiderW. X. (2014). Predicting object features across saccades: Evidence from object recognition and visual search. Journal of Experimental Psychology: General, 143, 1903–1922. doi:10.1037/a0036781
17.
HollingworthA.LuckS. J. (2009). The role of visual working memory (VWM) in the control of gaze during visual search. Attention, Perception, & Psychophysics, 71, 936–949. doi:10.3758/APP.71.4.936
18.
HollingworthA.MatsukuraM.LuckS. J. (2013). Visual working memory modulates rapid eye movements to simple onset targets. Psychological Science, 24, 790–796. doi:10.1177/0956797612459767
19.
HollingworthA.RichardA. M.LuckS. J. (2008). Understanding the function of visual short-term memory: Transsaccadic memory, object correspondence, and gaze correction. Journal of Experimental Psychology: General, 137, 163–181. doi:10.1037/0096-3445.137.1.163
20.
IrwinD. E. (1992a). Memory for position and identity across eye movements. Journal of Experimental Psychology: Learning, Memory, and Cognition, 18, 307–317. doi:10.1037/0278-7393.18.2.307
21.
IrwinD. E. (1992b). Visual memory within and across fixations. In RaynerK. (Ed.), Eye movements and visual cognition: Scene perception and reading (pp. 146–165). New York, NY: Springer-Verlag.
22.
IrwinD. E.McConkieG. W.Carlson-RadvanskyL. A.CurrieC. (1994). A localist evaluation solution for visual stability across saccades. Behavioral & Brain Sciences, 17, 265–266. doi:10.1017/S0140525X00034439
23.
LandM. F.HayhoeM. (2001). In what ways do eye movements contribute to everyday activities?Vision Research, 41, 3559–3565. doi:10.1016/S0042-6989(01)00102-X
24.
LuckS. J.VogelE. K. (2013). Visual working memory capacity: From psychophysics and neurobiology to individual differences. Trends in Cognitive Sciences, 17, 391–400. doi:10.1016/j.tics.2013.06.006
25.
MaW. J.HusainM.BaysP. M. (2014). Changing concepts of working memory. Nature Neuroscience, 17, 347–356. doi:10.1038/nn.3655
26.
OhlS.RolfsM. (2017). Saccadic eye movements impose a natural bottleneck on visual short-term memory. Journal of Experimental Psychology: Learning Memory and Cognition, 43, 736–748. doi:10.1037/xlm0000338
27.
OliversC. N. L.PetersJ.HoutkampR.RoelfsemaP. R. (2011). Different states in visual working memory: When it guides attention and when it does not. Trends in Cognitive Sciences, 15, 327–334. doi:10.1016/j.tics.2011.05.004
28.
Oostwoud WijdenesL.MarshallL.BaysP. M. (2015). Evidence for optimal integration of visual feature representations across saccades. The Journal of Neuroscience, 35, 10146–10153. doi:10.1523/jneurosci.1040-15.2015
29.
RolfsM.JonikaitisD.DeubelH.CavanaghP. (2011). Predictive remapping of attention across eye movements. Nature Neuroscience, 14, 252–256. doi:10.1038/nn.2711
30.
SchneegansS.SpencerJ. P.SchönerG.HwangS.HollingworthA. (2014). Dynamic interactions between visual working memory and saccade target selection. Journal of Vision, 14(11), Article 9. doi:10.1167/14.11.9
31.
SchutM. J.Van der StoepN.PostmaA.Van der StigchelS. (2017). The cost of making an eye movement: A direct link between visual working memory and saccade execution. Journal of Vision, 17(6), Article 15. doi:10.1167/17.6.15
32.
ShaoN.LiJ.ShuiR. D.ZhengX. J.LuJ. G.ShenM. W. (2010). Saccades elicit obligatory allocation of visual working memory. Memory & Cognition, 38, 629–640. doi:10.3758/mc.38.5.629
33.
SotoD.HumphreysG. W.HeinkeD. (2006). Working memory can guide pop-out search. Vision Research, 46, 1010–1018. doi:10.1016/j.visres.2005.09.008
34.
TasA. C.LuckS. J.HollingworthA. (2016). The relationship between visual attention and visual working memory encoding: A dissociation between covert and overt orienting. Journal of Experimental Psychology: Human Perception and Performance, 42, 1121–1138. doi:10.1037/xhp0000212
35.
TasA. C.MooreC. M.HollingworthA. (2012). An object-mediated updating account of insensitivity to transsaccadic change. Journal of Vision, 12(11), Article 18. doi:10.1167/12.11.18
36.
Van der StigchelS.de VriesJ. P. (2015). There is no attentional global effect: Attentional shifts are independent of the saccade endpoint. Journal of Vision, 15(15), Article 17. doi:10.1167/15.15.17
37.
WexlerM.GlennersterA.CavanaghP.ItoH.SenoT. (2013). Default perception of high-speed motion. Proceedings of the National Academy of Sciences, USA, 110, 7080–7085. doi:10.1073/pnas.1213997110
38.
WolfC.SchützA. C. (2015). Trans-saccadic integration of peripheral and foveal feature information is close to optimal. Journal of Vision, 15(16), Article 1. doi:10.1167/15.16.1
39.
WolfeJ. M.VõM. L.EvansK. K.GreeneM. R. (2011). Visual search in scenes involves selective and nonselective pathways. Trends in Cognitive Sciences, 15, 77–84. doi:10.1016/j.tics.2010.12.001
40.
ZirnsakM.SteinmetzN. A.NoudoostB.XuK. Z.MooreT. (2014). Visual space is compressed in prefrontal cortex before eye movements. Nature, 507, 504–507. doi:10.1038/nature13149
