A growing body of research suggests that comprehending verbal descriptions of actions relies on an internal simulation of the described action. To assess this motor resonance account of language comprehension, we first review recent developments in the literature on perception and action, with a view towards language processing. We then examine studies of language processing from an action simulation perspective. We conclude by discussing several criteria that might be helpful with regard to assessing the role of motor resonance during language comprehension.
AltmannG. T. M. (2004). Language-mediated eye movements in the absence of a visual world: The “blank screen paradigm”.Cognition93, B79–B87.
3.
AltmannG. T. M.KamideY. (2004). Now you see it, now you don't: Mediating the mapping between language and the visual world.The interface of language, vision, and action: Eye movements and the visual world. HendersonJ. M.FerreiraF.New York: Psychology Press.
4.
Aziz-ZadehL.WilsonS. M.RizzolattiG.IacoboniM. (2006). Congruent embodied representations for visually presented actions and linguistic phrases describing actions.Current Biology16, 1818–1823.
5.
BaldaufD.WolfM.DeubelH. (2006). Deployment of visual attention before sequences of goal-directed hand movements.Vision Research46, 4355–4374.
6.
BarsalouL. W. (1999). Perceptual symbol systems.Behavioral and Brain Sciences22, 577–660.
7.
BarsalouL. W. (2007). Situating concepts.Cambridge handbook of situated cognition. RobbinsP.AydedeM.New York: Cambridge University Press (chap. 17).
8.
BoulengerV.RoyA. C.PaulignanY.DeprezV.JeannerodM.NazirT. A. (2006). Cross-talk between language processes and overt motor behavior in the first 200 ms of processing.Journal of Cognitive Neuroscience18, 1607–1615.
9.
BowerG. H.MorrowD. G. (1990). Mental models in narrative comprehension.ScienceJanuary 5247, 44–48.
10.
BridgemanB.HooverM. (2008). Processing spatial layout by perception and sensorimotor interaction.Quarterly Journal of Experimental Psychology61, 851–859.
11.
BuccinoG.BinkofskiF.FinkG. R.FadigaL.FogassiL.GalleseV. (2001). Action observation activates premotor and parietal areas in a somatotopic manner: An fMRI study.European Journal of Neuroscience13, 400–404.
12.
BuccinoG.RiggioL.MelliG.BinkofskiF.GalleseV.RizzolattiG. (2005). Listening to action related sentences modulates the activity of the motor system: A combined TMS and behavioral study.Cognitive Brain Research24, 355–363.
13.
Calvo-MerinoB.GlaserD. E.GrèzesJ.PassinghamR. E.HaggardP. (2005). Action observation and acquired motor skills: An fMRI study with expert dancers.Cerebral Cortex15, 1243–1249.
14.
Calvo-MerinoB.GrèzesJ.GlaserD. E.PassinghamR. E.HaggardP. (2006). Seeing or doing? Influence of visual and motor familiarity in action observation.Current Biology16, 1905–1910.
15.
CasileA.GieseM. A. (2006). Nonvisual motor training influences biological motion perception.Current Biology16, 69–74.
16.
ChambersC. G.TanenhausM. K.MagnussonJ. S. (2004). Actions and affordances in syntactic ambiguity resolution.Journal of Experimental Psychology: Learning, Memory, and Cognition30, 687–696.
17.
CorinaD. P.KnappH. (2006). Sign language processing and the mirror neuron system.Cortex42, 529–539.
18.
CreemS. H.ProffittD. R. (2001). Grasping objects by their handles: A necessary interaction between cognition and action.Journal of Experimental Psychology: Human Perception and Performance27, 218–228.
19.
CrossE. S.HamiltonA. F.deC.GraftonS. T. (2007). Building a simulation de novo: Observation of dance by dancers.NeuroImage31, 1257–1267.
20.
DesmurgetM.PelissonD.RossettiY.PrablancC. (1998). From eye to hand: Planning goal-directed movements.Neuroscience and Biobehavioral Reviews22, 761–788.
21.
DeubelH.SchneiderW. X.PaprottaI. (1998). Selective dorsal and ventral processing: Evidence for a common attentional mechanism in reaching and perception.Visual Cognition5, 81–107.
22.
DiPellegrinoG.FadigaL.FogassiL.GalleseV.RizzolattiG. (1992). Understanding motor events: A neurophysiological study.Experimental Brain Research91, 176–180.
23.
EmmoryK.GrabowskyT.McCulloughS.PontoL. L. B.HichwaR. D.DamasioH. (2005). The neural correlates of spatial language in English and American Sign Language: A PET study with hearing bilinguals.NeuroImage24, 832–840.
24.
FadigaL.CraigheroL.BuccinoG.RizzolattiG. (2002). Speech listening specifically modulates the excitability of tongue muscles: A TMS study.European Journal of Neuroscience15, 399–402.
25.
FadigaL.CraigheroL.OlivierE. (2005). Human motor cortex excitability during the perception of others’ action.Current Opinion in Neurobiology15, 213–218.
26.
FadigaL.FogassiL.PavesiG.RizzolattiG. (1995). Motor facilitation during action observation: A magnetic stimulation study.Journal of Neurophysiology73, 2608–2611.
FerrariP. F.GalleseV.RizzolattiG.FogassiL. (2003). Mirror neurons responding to the observation of ingestive and communicative mouth actions in the monkey ventral premotor cortex.European Journal of Neuroscience17, 1703–1714.
29.
FischerM. H. (1997). Attention allocation during manual movement preparation and execution.European Journal of Cognitive Psychology9, 17–51.
30.
FischerM. H. (1999). An investigation of attention allocation during sequential eye movement tasks.Quarterly Journal of Experimental Psychology52A, 649–677.
31.
FischerM. H. (2005). Action simulation is not constrained by one's own postures.Neuropsychologia43, 28–34.
32.
FischerM. H.DahlC. (2007). The time course of visuo-motor affordances.Experimental Brain Research76, 519–524.
33.
FischerM. H.PrinzJ.LotzK. (2008). Grasp cueing shows obligatory attention to action goals.Quarterly Journal of Experimental Psychology61, 860–868.
34.
FischerM. H.SzymkowiakA. (2004). Joint attention for pointing but not grasping postures.Cortex40, 168–170.
35.
FlanaganJ. R.JohanssonR. S. (2003). Action plans used in action observation.Nature424, 769–770.
36.
FogassiL.FerrariP. F.GesierichB.RozziS.ChersiF.RizzolattiG. (2005). Parietal lobe: From action organization to intention understanding.Science308, 662–667.
37.
GalantucciB.FowlerC.TurveyM. T. (2006). The motor theory of speech perception reviewed.Pyschonomic Bulletin & Review13, 361–377.
38.
GalleseV.FadigaL.FogassiL.RizzolattiG. (1996). Action recognition in the premotor cortex.Brain119, 593–609.
39.
GalleseV.GoldmanA. (1998). Mirror neurons and the simulation theory of mind-reading.Trends in Cognitive Sciences20, 493–501.
40.
GangitanoM.MottaghyF. M.Pascual-LeoneA. (2004). Modulation of premotor mirror neuron activity during observation of unpredictable grasping movements.European Journal of Neuroscience20, 2193–2202.
41.
GazzolaV.Aziz-ZadehL.KeysersC. (2006). Empathy and the somatotopic auditory mirror system in humans.Current Biology16, 1824–1829.
42.
GentilucciM.BenuzziF.BertolaniL.DapratiE.GangitanoM. (2000). Language and motor control.Experimental Brain Research133, 468–490.
43.
GentilucciM.Dalla VoltaR. (2008). Spoken language and arm gestures are controlled by the same motor control system.Quarterly Journal of Experimental Psychology61, 944–957.
44.
GerschT.KowlerE.DosherB. (2004). Dynamic allocation of visual attention during the execution of sequences of saccades.Vision Research44, 1469–1483.
45.
GerschT. M.SchnitzerB. S.SanghviP. S.DosherB.KowlerE. (2006). Attentional enhancement along the path of a sequence of saccades.Visual Cognition14, 104–107.
46.
GlenbergA. M.KaschakM. P. (2002). Grounding language in action.Psychonomic Bulletin & Review9, 558–565.
47.
GlenbergA. M.SatoM.CattaneoL.RiggioL.PalumboD.BuccinoG. (2008). Processing abstract language modulates motor system activity.Quarterly Journal of Experimental Psychology61, 905–919.
48.
GloverS. (2004). Separate visual representations in the planning and control of action.Behavioral and Brain Sciences27, 3–78.
49.
GloverS.RosenbaumD. A.GrahamJ.DixonP. (2004). Gasping the meaning of words.Experimental Brain Research154, 103–108.
50.
GoodaleM.MilnerD. (2004). Sight unseenOxford, UK: Oxford University Press.
51.
GraesserA. C.MillisK. K.ZwaanR. A. (1997). Discourse comprehension.Annual Review of Psychology182, 163–189.
52.
GrèzesJ.ArmonyJ. L.RoweJ.PassinghamR. E. (2003). Activations related to “mirror” and “canonical” neurons in the human brain: An fMRI study.NeuroImage18, 928–937.
53.
GrèzesJ.DecetyJ. (2002). Does visual perception of object afford action? Evidence from a neuroimaging study.Neuropsychologia40, 212–222.
54.
HaggardP. (2005). Conscious intention and motor cognition.Trends in Cognitive Science9, 290–295.
55.
HandyT. C.BorgJ. S.TurkD. J.TipperC. M.GraftonS. T.GazzanigaM. S. (2005). Placing a tool in the spotlight: Spatial attention modulates visuomotor responses in cortex.NeuroImage26, 266–276.
56.
HandyT. C.GraftonS. T.ShroffN. M.KetayS.GazzanigaM. S. (2003). Graspable objects grasp attention when the potential for action is recognized.Nature Neuroscience6, 421–427.
57.
HaukO.JohnsrudeI.PulvermüllerF. (2004). Somatotopic representation of action words in human motor and premotor cortex.Neuron41, 301–307.
58.
HommelB. (2004). Event files: Feature binding in and across perception and action.Trends in Cognitive Sciences8, 494–500.
59.
HommelB.MüsselerJ. (2006). Action-feature integration blinds to feature-overlapping perceptual events: Evidence from manual and vocal actions.Quarterly Journal of Experimental Psychology59, 509–523.
60.
HommelB.MüsselerJ.AscherslebenG.PrinzW. (2001). The theory of event coding (TEC): A framework for perception and action.Behavioral and Brain Sciences24, 849–937.
61.
IversonJ. M.Goldin-MeadowS. (1998). Why people gesture as they speak.Nature396, 228.
62.
JeannerodM. (2001). Neural simulation of action: A unifying mechanism for motor cognition.NeuroImage14, S103–S109.
63.
JeannerodM. (2006). Motor cognition: What actions tell the selfOxford, UK: University Press.
64.
KaschakM. P.BorreggineK. L. (2008). Temporal dynamics of the action–sentence compatibility effect.Quarterly Journal of Experimental Psychology61, 883–895.
65.
KaupB.YaxleyR. H.MaddenC. J.ZwaanR. A.LüdtkeJ. (2007). Experiential simulations of negated text information.Quarterly Journal of Experimental Psychology60, 976–990.
66.
KaupB.ZwaanR. A. (2003). Effects of negation and situational presence on the accessibility of text information.Journal of Experimental Psychology: Learning, Memory, and Cognition29, 439–446.
67.
KemmererD. (2006). Action verbs, argument structure constructions, and the mirror neuron system.Action to language via the mirror neuron system. ArbibM.Cambridge, UK: Cambridge University Press.
68.
KennedyA. (1983). On looking into space.Eye movements in reading: Perceptual and language processes. RaynerK.London: Academic Press237–251.
KlatzkyR. L.PellegrinoJ. W.McCloskeyB. P. (1989). Can you squeeze a tomato? The role of motor representations in semantic sensibility judgments.Journal of Memory & Language28, 56–77.
71.
KnoblichG.PrinzW. (2005). Linking perception and action: An ideomotor approach.Higher-order motor disorders. FreundH.-J.JeannerodM.HallettM.LeiguardaR.Oxford, UK: Oxford University Press79–104.
KoskiL.WohlschlägerA.BekkeringH.WoodsR. P.DubeauM.-C.MazziottaJ. C. (2002). Modulation of motor and premotor activity during imitation of target-directed actions.Cerebral Cortex12, 847–855.
74.
KosslynS. M.MattA. M. C. (1977). If you speak slowly, do people read your prose slowly? Person-particular speech recoding during reading.Bulletin of the Psychonomic Society9, 250–252.
75.
LammC.FischerM. H.DecetyJ. (2007). Predicting the actions of others taps into one's own somatosensory representations: A functional MRI study. Neuropsychologia.45, 2480–2491.
76.
LaureysS.PellasF.Van EeckhoutP.GhorbelS.SchnakersC.PerrinF. (2005). The locked-in syndrome: What is it like to be conscious but paralyzed and voiceless?.Progress in Brain Research. LaureysS.Amsterdam: Elsevier/North Holland150, 495–511.
77.
LewisJ. W.PhinneyR. E.Brefczynski-LewisJ. A.DeYoeE. A. (2006). Lefties get it “right” when hearing tool sounds.Journal of Cognitive Neuroscience18, 1314.
78.
LibermanA. M.CooperF. S.ShankweilerD. P.Studdert-KennedyM. (1967). Perception of the speech code.Psychological Review74, 431–461.
79.
LibermanA. M.MattinglyI. G. (1985). The motor theory of speech perception revised.Cognition21, 1–36.
80.
LindemannO.StennekenP.Van SchieH. T.BekkeringH. (2006). Semantic activation in action planning.Journal of Experimental Psychology: Human Perception and Performance32, 633–643.
81.
LongcampM.TanskanenT.HariR. (2006). The imprint of action: Motor cortex involvement in visual perception of handwritten letters.NeuroImage33, 681–688.
82.
MartinA.WiggsC. L.UngerleiderL. G.HaxbyJ. V. (1996). Neural correlates of category-specific knowledge.Nature379, 649–652.
83.
MassonM. E. J.BubD. N.Newton-TaylorM. (2008). Language-based access to gestural components of conceptual knowledge.Quarterly Journal of Experimental Psychology61, 869–882.
84.
MilnerA. D.GoodaleM. A. (2006). The visual brain in actionOxford, UK: Oxford University Press (Original work published 1995).
85.
MüsselerJ.HommelB. (1997). Blindness to response-compatible stimuli.Journal of Experimental Psychology: Human Perception and Performance23, 861–872.
86.
MyungJ.BlumsteinS. E.SedivyJ. C. (2006). Playing on the typewriter, typing on the piano: Manipulation knowledge of objects.Cognition98, 223–243.
87.
NazirT. A.BoulengerV.RoyA.SilberB.JeannerodM.PaulignanY. (2008). Language-induced motor perturbations during the execution of a reaching movement.Quarterly Journal of Experimental Psychology61, 933–943.
NukuP.LindemannO.BekkeringH.FischerM. H. (2007). Joint attention in action observation: Inferring another's action intentions modulates visual attention Manuscript submitted for publication.
90.
PhillipsJ. C.WardR. (2002). S–R correspondence effects of irrelevant visual affordance: Time course and specificity of response activation.Visual Cognition9, 540–558.
91.
PickeringM. J.GarrodS. (2007). Do people use language production to make predictions during comprehension?.Trends in Cognitive Sciences11, 105–110.
92.
PisellaL.GreaH.TiliketeC.VighettoA.DesmurgetM.RodeG. (2000). An “automatic pilot” for the hand in human posterior parietal cortex: Toward reinterpreting optic ataxia.Nature Neuroscience3, 729–736.
93.
PoiznerH.KlimaE. S.BellugiU. (1987). What the hands reveal about the brainCambridge, MA: MIT Press.
94.
PrattJ.KingstoneA.KhoeW. (1997). Motor-based vs. attention-based theories of inhibition of return.Perception and Psychophysics59, 964–971.
95.
PreisslH.PulvermüllerF.LutzenbergerW.BirbaumerN. (1995). Evoked potentials distinguish between nouns and verbs.Neuroscience Letters197, 81–83.
96.
PulvermüllerF. (2005). Brain mechanisms linking language and action.Nature Reviews Neuroscience6, 576–582.
97.
PulvermüllerF.HaukO.NikulinV. V.IlmoniemiR. J. (2005a). Functional links between motor and language systems.European Journal of Neuroscience21, 793–797.
98.
PulvermüllerF.LutzenbergerW.PreisslH. (1999). Nouns and verbs in the intact brain: Evidence from event-related potentials and high-frequency cortical responses.Cerebral Cortex9, 498–508.
99.
PulvermüllerF.ShtyrovY.IlmoniemiR. (2005b). Brain signatures of meaning access in action word recognition.Journal of Cognitive Neuroscience17, 884–892.
100.
RaynerK. (1998). Eye movements in reading and information processing: 20 years of research.Psychological Bulletin124, 372–422.
101.
RichardsonD. C.SpiveyM. J.CheungJ.Motor representations in memory and mental models: The embodied zorkProceedings of the 23rd Annual Meeting of the Cognitive Science Society. MooreJ. D.StenningK.Lawrence Erlbaum AssociatesMahwah, NJ2001867–872.
102.
RizzolattiG.CraigheroL. (2004). The mirror-neuron system.Annual Reviews Neuroscience27, 169–192.
103.
RizzolattiG.FogassiL.GalleseV. (2001). Neurophysiological mechanisms underlying imitation and the understanding of action.Nature Reviews Neuroscience2, 661–670.
104.
RosenbaumD. A. (2005). The Cinderella of psychology: The neglect of motor control in the science of mental life and behavior.American Psychologist60, 308–317.
105.
RotmanG.TrojeN. F.JohanssonR. S.FlanaganJ. R. (2006). Eye movements when observing predictable and unpredictable actions.Journal of Neurophysiology96, 1358–1369.
106.
SayginA. P.WilsonS. M.DronkersN.BatesE. (2004). Action comprehension in aphasia: Linguistic and non-linguistic deficits and their lesion correlates.Neuropsychologia42, 1788–1804.
107.
SchenkT. (2006). An allocentric rather than perceptual deficit in patient DF.Nature Neuroscience9, 1369–1370.
108.
SchneiderG. (1969). Two visual systems: Brain mechanisms for localization and discrimination are dissociated by tectal and cortical lesions.Science163, 895–902.
109.
ShepardR. N. (1984). Ecological constraints in internal representation.Psychological Review91, 417–447.
110.
ShepardR. N. (1994). Perceptual-cognitive universals as reflections of the world.Psychonomic Bulletin & Review1, 2–28.
111.
ShintelH.NusbaumH.OkrentA. (2006). Analog acoustic expression in speech communication.Journal of Memory and Language55, 167–177.
112.
ShtyrovY.HaukO.PulvermüllerF. (2004). Distributed neuronal networks for encoding category-specific semantic information: The mismatch negativity to action words.European Journal of Neuroscience19, 1083–1092.
113.
SommervilleJ. A.DecetyJ. (2006). Weaving the fabric of social interaction: Articulating developmental psychology and cognitive neuroscience in the domain of motor cognition.Psychonomic Bulletin & Review13, 179–200.
114.
SpeerN. K.ZacksJ. M.ReynoldsJ. R.HeddenR. A.Neural activity during reading reflects changes in the situation described by the textPaper presented at the Society for Neuroscience Annual Meeting. Washington, DCNovember2005.
115.
SpiveyM. J.GengJ. J. (2001). Oculomotor mechanisms activated by imagery and memory: Eye movements to absent objects.Psychological Research65, 235–241.
116.
StockA.StockC. (2004). A short history of ideo-motor action.Psychological Research68, 176–188.
117.
TaylorL. J.ZwaanR. A. (2008). Motor resonance and linguistic focus.Quarterly Journal of Experimental Psychology61, 896–904.
118.
TomaselloM. (2003). Constructing a language: A usage-based theory of language acquisitionCambridge, MA: Harvard University Press.
119.
TuckerM.EllisR. (2001). The potentiation of grasp types during visual object categorization.Visual Cognition8, 769–800.
120.
TuckerR.EllisM. (2004). Action priming by briefly presented objects.Acta Psychologica116, 185–203.
121.
UmiltàM. A.KohlerE.GalleseV.FogassiL.FadigaL.KeysersC. (2001). I know what you are doing: A neurophysiological study.Neuron31, 155–165.
122.
UngerleiderL. G.MishkinM. (1982). Two cortical visual systems.Analysis of visual behavior. IngleM.GoodaleM.MansfieldR.Cambridge, MA: MIT Press549–586.
123.
UrgesiC.MoroV.CandidiM.AgliotiM. S. (2006). Mapping implied body actions in the human motor system.The Journal of Neuroscience26, 7942–7949.
124.
WolpertD. M.DoyaK.KawatoM. (2003). A unifying computational framework for motor control and social interaction.Philosophical Transactions of the Royal Society358, 593–602.
125.
ZwaanR. A. (1996). Processing narrative time shifts.Journal of Experimental Psychology: Learning, Memory, and Cognition22, 1196–1207.
126.
ZwaanR. A. (2004). The immersed experiencer: Toward an embodied theory of language comprehension.The psychology of learning and motivation. RossB. H.New York: Academic Press44, 35–62.
127.
ZwaanR. A.KaschakM. P. (in press). Language comprehension as a means of “re-situating” oneself.The Cambridge handbook of situated cognition. RobbinsP.AydedeM.Cambridge, UK: Cambridge University Press.
128.
ZwaanR. A.LangstonM. C.GraesserA. C. (1995). The construction of situation models in narrative comprehension: An event-indexing model.Psychological Science6, 292–297.
129.
ZwaanR. A.MaglianoJ. P.GraesserA. C. (1995). Dimensions of situation-model construction in narrative comprehension.Journal of Experimental Psychology: Learning, Memory, and Cognition21, 386–397.
130.
ZwaanR. A.RadvanskyG. A. (1998). Situation models in language comprehension and memory.Psychological Bulletin123, 162–185.
131.
ZwaanR. A.RappD. N. (2006). Discourse comprehension.Handbook of psycholinguistics. GernsbacherM. A.TraxlerM. J.San Diego, CA: Elsevier725–764.
132.
ZwaanR. A.TaylorL. J. (2006). Seeing, acting, understanding: Motor resonance in language comprehension.Journal of Experimental Psychology: General135, 1–11.