Gesture during speech can promote or diminish recall for conversation content. We explored effects of cognitive load on this relationship, manipulating it at two scales: individual-word abstractness and social constraints to prohibit gestures. Prohibited gestures can diminish recall but more so for abstract-word recall. Insofar as movement planning adds to cognitive load, movement amplitude may moderate gesture effects on memory, with greater permitted- and prohibited-gesture movements reducing abstract-word recall and concrete-word recall, respectively. We tested these effects in a dyadic game in which 39 adult participants described words to confederates without naming the word or five related words. Results supported our expectations and indicated that memory effects of gesturing depend on social, cognitive, and motoric aspects of discourse.
BarsalouL. W., BreazealC., & SmithL. B. (2007). Cognition as coordinated non-cognition. Cognitive Processing, 8, 79–91. doi: 10.1007/s10339-007-0163-1
2.
ByrdC., McNeilN., D'MelloS. K., & CookS. (2014). Gesturing may not always make learning last. In BellowP., GuariniM., McShaneM., & ScassellatiB. (Eds.), Proceedings of the 36th annual conference of the cognitive science society (pp. 1982–1987). Austin, TX: Cognitive Science Society.
3.
CookS. W., YipT. K.-Y., & Goldin-MeadowS. (2010). Gesturing makes memories that last. Journal of Memory & Language, 63, 465–475. doi: 10.1016/j.jml.2010.07.002
4.
EngelkampJ., & KrumnackerH. (1980). Imaginale und motorische Prozesse beim Behalten verbalen Materials. Zeitschrift für experimentelle und angewandte Psychologie, 27, 511–533.
5.
Frick-HorburyD., & GuttentagR. E. (1998). The effects of restricting hand gesture production on lexical retrieval and free recall. American Journal of Psychology, 111, 43–62. doi: 10.2307/1423536
6.
FristonK., BreakspearM., & DecoG. (2012). Perception and self-organized instability. Frontiers in Computational Neuroscience, 6. Article no. 44. doi: 10.3389/fncom.2012.00044
7.
GalantucciB., FowlerC. A., & TurveyM. T. (2006). The motor theory of speech perception reviewed. Psychonomic Bulletin & Review, 13, 361–377. doi: 10.3758/BF03193857
8.
Goldin-MeadowS. (2010). When gesture does and does not promote learning. Language & Cognition, 2, 1–19. doi: 10.1515/langcog.2010.001
9.
IngberD. E. (2006). Cellular mechanotransduction: Putting all the pieces together again. FASEB Journal, 20, 811–827. doi: 10.1096/fj.05-5424rev
10.
KelsoJ. A. S., TullerB., Vatikiotis-BatesonE., FowlerC. A. (1984). Functionally specific articulatory cooperation following jaw perturbations during speech: Evidence for coordinative structures. Journal of Experimental Psychology: Human Perception & Performance, 10, 812–832.
11.
Kelty-StephenD. G., & DixonJ. A. (2014). Interwoven fluctuations in intermodal perception: Fractality in head-sway supports the use of visual feedback in haptic perceptual judgments by manual wielding. Journal of Experimental Psychology: Human Perception & Performance, 40, 2289–2309.
12.
NagelsA., KircherT., SteinesM., GrosvaldM., & StraubeB. (2015). A brief self-rating scale for the assessment of individual differences in gesture perception and production. Learning & Individual Differences, 39, 73–80. doi: 10.1016/j.lindif.2015.03.008
13.
NelsonD. L., McEvoyC. L., & SchreiberT. A. (1998). The University of South Florida word association, rhyme, and word fragment norms. Retrieved from http://www.usf.edu/FreeAssociation/
14.
RollsE. T. (2015). Limbic systems for emotion and for memory, but no single limbic system. Cortex, 62, 119–157. doi: 10.1016/j.cortex.2013.12.005
15.
RussM. O., MackW., GramaC. R., LanfermannH., & KnopfM. (2003). Enactment effect in memory: Evidence concerning the function of the supramarginal gyrus. Experimental Brain Research, 149, 497–504. doi: 10.1007/s00221-003-1398-4
16.
StevanoniE., & SalmonK. (2005). Giving memory a hand: Instructing children to gesture enhances their event recall. Journal of Nonverbal Behavior, 29, 217–233. doi: 10.1007/s10919-005-7721-y
17.
StraubeB., GreenA., BrombergerB., & KircherT. (2011). The differentiation of iconic and metaphoric gestures: Common and unique integration processes. Human Brain Mapping, 32, 520–533. doi: 10.1002/hbm.21041
18.
StraubeB., MeyerL., GreenA., & KircherT. (2014). Semantic relation vs. surprise: The differential effects of related and unrelated co-verbal gestures on neural encoding and subsequent recognition. Brain Research, 1567, 42–56. doi: 10.1016/j.brainres.2014.04.012
19.
TengD. W., EddyC. L., & Kelty-StephenD. G. (2016). Non-visually-guided distance perception depends on matching torso fluctuations between training and test. Attention, Perception, & Psychophysics, 78, 2320–2328. doi: 10.3758/s13414-016-1213-5
20.
WilsonS. M., SayginA. P., SerenoM. I., & IacoboniM. (2004). Listening to speech activates motor areas involved in speech production. Nature Neuroscience, 7, 701–702. doi: 10.1038/nn1263
