Sage Journals: Discover world-class research

Abstract

Can what we imagine in our minds change how we perceive the world in the future? A continuous process of multisensory integration and recalibration is responsible for maintaining a correspondence between the senses (e.g., vision, touch, audition) and, ultimately, a stable and coherent perception of our environment. This process depends on the plasticity of our sensory systems. The so-called ventriloquism aftereffect—a shift in the perceived localization of sounds presented alone after repeated exposure to spatially mismatched auditory and visual stimuli—is a clear example of this type of plasticity in the audiovisual domain. In a series of six studies with 24 participants each, we investigated an imagery-induced ventriloquism aftereffect in which imagining a visual stimulus elicits the same frequency-specific auditory aftereffect as actually seeing one. These results demonstrate that mental imagery can recalibrate the senses and induce the same cross-modal sensory plasticity as real sensory stimuli.

Keywords

cross-modal plasticity auditory perception mental imagery multisensory integration open data

Get full access to this article

View all access options for this article.

References

Alais

Burr

(2004). The ventriloquist effect results from near-optimal bimodal integration. Current Biology, 14, 257–262.

Bavelier

Neville

H. J.

(2002). Cross-modal plasticity: Where and how? Nature Reviews. Neuroscience, 3, 443–452.

Berger

C. C.

Ehrsson

H. H.

(2013). Mental imagery changes multisensory perception. Current Biology, 23, 1367–1372.

Berger

C. C.

Ehrsson

H. H.

(2014). The fusion of mental imagery and sensation in the temporal association cortex. Journal of Neuroscience, 34, 13684–13692.

Berger

C. C.

Ehrsson

H. H.

(2017). The content of imagined sounds changes visual motion perception in the cross-bounce illusion. Scientific Reports, 7, Article 40123. doi:10.1038/srep40123.

Cicinelli

Marconi

Zaccagnini

Pasqualetti

Filippi

M. M.

Rossini

P. M.

(2006). Imagery-induced cortical excitability changes in stroke: A transcranial magnetic stimulation study. Cerebral Cortex, 16, 247–253.

Craver-Lemley

Reeves

(1987). Visual imagery selectively reduces vernier acuity. Perception, 16, 599–614.

de Vries

Mulder

. (2007). Motor imagery and stroke rehabilitation: A critical discussion. Journal of Rehabilitation Medicine, 39, 5–13.

Driskell

J. E.

Copper

Moran

(1994). Does mental practice enhance performance? Journal of Applied Psychology, 79, 481–492.

10.

Ehrsson

H. H.

Geyer

Naito

(2003). Imagery of voluntary movement of fingers, toes, and tongue activates corresponding body-part-specific motor representations. Journal of Neurophysiology, 90, 3304–3316.

11.

Farah

M. J.

(1985). Psychophysical evidence for a shared representational medium for mental images and percepts. Journal of Experimental Psychology: General, 114, 91–103.

12.

Farah

M. J.

(1989). Mechanisms of imagery-perception interaction. Journal of Experimental Psychology: Human Perception and Performance, 15, 203–211.

13.

Frissen

Vroomen

de Gelder

(2012). The aftereffects of ventriloquism: The time course of the visual recalibration of auditory localization. Seeing and Perceiving, 25, 1–14.

14.

Harris

C. S.

(1963). Adaptation to displaced vision: Visual, motor, or proprioceptive change? Science, 140, 812–813.

15.

Howard

I. P.

Templeton

W. B.

(1966). Human spatial orientation. London, England: Wiley.

16.

Ishai

Sagi

(1994). Visual imagery facilitates visual perception: Psychophysical evidence. Journal of Cognitive Neuroscience, 9, 476–489.

17.

Kopco

Lin

I.-F.

Shinn-Cunningham

B. G.

Groh

J. M.

(2009). Reference frame of the ventriloquism aftereffect. Journal of Neuroscience, 29, 13809–13814.

18.

Kosslyn

S. M.

(1994). Image and brain: The resolution of the imagery debate. Cambridge, MA: MIT Press.

19.

Kosslyn

S. M.

Ball

T. M.

Reiser

B. J.

(1978). Visual images preserve metric spatial information: Evidence from studies of image scanning. Journal of Experimental Psychology: Human Perception and Performance, 4, 47–60.

20.

Kosslyn

S. M.

Ganis

Thompson

W. L.

(2001). Neural foundations of imagery. Nature Reviews Neuroscience, 2, 635–642.

21.

Lacey

Flueckiger

Stilla

Lava

Sathian

(2010). Object familiarity modulates the relationship between visual object imagery and haptic shape perception. NeuroImage, 49, 1977–1990.

22.

Lewald

(2002). Rapid adaptation to auditory-visual spatial disparity. Learning & Memory, 9, 268–278.

23.

Page

S. J.

Szaflarski

J. P.

Eliassen

J. C.

Pan

Cramer

S. C.

(2009). Cortical plasticity following motor skill learning during mental practice in stroke. Neurorehabilitation and Neural Repair, 23, 382–388.

24.

Peirce

J. W.

(2007). PsychoPy–Psychophysics software in Python. Journal of Neuroscience Methods, 162, 8–13.

25.

Radeau

Bertelson

(1977). Adaptation to auditory-visual discordance and ventriloquism in semirealistic situations. Perception & Psychophysics, 22, 137–146.

26.

Recanzone

G. H.

(1998). Rapidly induced auditory plasticity: The ventriloquism aftereffect. Proceedings of the National Academy of Sciences, USA, 95, 869–875.

27.

Saenz

Langers

D. R. M.

(2014). Tonotopic mapping of human auditory cortex. Hearing Research, 307, 42–52.

28.

Schlegel

Kohler

P. J.

Fogelson

S. V.

Alexander

Konuthula

Tse

P. U.

(2013). Network structure and dynamics of the mental workspace. Proceedings of the National Academy of Sciences, USA, 2013, 1–6.

29.

Shimojo

Shams

(2001). Sensory modalities are not separate modalities: Plasticity and interactions. Current Opinion in Neurobiology, 11, 505–509.

30.

Shrem

Deouell

L. Y.

(2014). Frequency-dependent auditory space representation in the human planum temporale. Frontiers in Human Neuroscience, 8, Article 524. doi:10.3389/fnhum.2014.00524

31.

Stein

B. E.

Stanford

T. R.

(2008). Multisensory integration: Current issues from the perspective of the single neuron. Nature Reviews Neuroscience, 9, 255–266.

32.

Stein

B. E.

Stanford

T. R.

Rowland

B. A.

(2014). Development of multisensory integration from the perspective of the individual neuron. Nature Reviews Neuroscience, 15, 520–535.

33.

Stevens

S. S.

Newman

E. B.

(1936). The localization of actual sources of sound. The American Journal of Psychology, 48, 297–306.

34.

Striem-Amit

Cohen

Dehaene

Amedi

(2012). Reading with sounds: Sensory substitution selectively activates the visual word form area in the blind. Neuron, 76, 640–652.

35.

Wallace

M. T.

Roberson

G. E.

Hairston

W. D.

Stein

B. E.

Vaughan

J. W.

Schirillo

J. A.

(2004). Unifying multisensory signals across time and space. Experimental Brain Research, 158, 252–258.

36.

Woods

T. M.

Recanzone

G. H.

(2004). Visually induced plasticity of auditory spatial perception in macaques. Current Biology, 14, 1559–1564.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

1.09 MB

0.54 MB

Mental Imagery Induces Cross-Modal Sensory Plasticity and Changes Future Auditory Perception

Abstract

Keywords

Get full access to this article

References

Supplementary Material