Emotion perception research has largely been dominated by work on facial expressions, but emotion is also strongly conveyed from the body. Research exploring emotion recognition from the body tends to refer to “the body” as a whole entity. However, the body is made up of different components (hands, arms, trunk, etc.), all of which could be differentially contributing to emotion recognition. We know that the hands can help to convey actions and, in particular, are important for social communication through gestures, but we currently do not know to what extent the hands influence emotion recognition from the body. Here, 93 adults viewed static emotional body stimuli with either the hands, arms, or both components removed and completed a forced-choice emotion recognition task. Removing the hands significantly reduced recognition accuracy for fear and anger but made no significant difference to the recognition of happiness and sadness. Removing the arms had no effect on emotion recognition accuracy compared with the full-body stimuli. These results suggest the hands may play a key role in the recognition of emotions from the body.
AtkinsonA. P.DittrichW. H.GemmellA. J.YoungA. W. (2004).
Emotion perception from dynamic and static body expressions in point-light and full-light displays. Perception,
33, 717–746.
2.
BooneR. T.CunninghamJ. G. (1998).
Children’s decoding of emotion in expressive body movement: The development of cue attunement. Developmental Psychology,
34, 1007–1016.
3.
BracciS.IetswaartM.PeelenM. V.Cavina-PratesiC. (2010).
Dissociable neural responses to hands and non-hand body parts in human left extrastriate visual cortex. Journal of Neurophysiology,
103, 3389–3397.
4.
BrainardD. H. (1997).
The psychophysics toolbox. Spatial Vision,
10, 433–436.
5.
BrewerR.BiottiF.BirdG.CookR. (2017).
Typical integration of emotion cues from bodies and faces in Autism Spectrum Disorder. Cognition,
165, 82–87.
6.
CartmillE. A.BeilockS.Goldin-MeadowS. (2012).
A word in the hand: Action, gesture and mental representation in humans and non-human primates. Philosophical Transactions of the Royal Society B: Biological Sciences,
367, 129–143.
7.
DaelN.MortillaroM.SchererK. R. (2012).
Emotion expression in body action and posture. Emotion,
12, 1085–1101.
8.
de GelderB. (2009).
Why bodies? Twelve reasons for including bodily expressions in affective neuroscience. Philosophical Transactions of the Royal Society B: Biological Sciences,
364, 3475–3484.
9.
de GelderB.SnyderJ.GreveD.GerardG.HadjikhaniN. (2004).
Fear fosters flight: A mechanism for fear contagion when perceiving emotion expressed by a whole body. Proceedings of the National Academy of Sciences of the United States of America,
101, 16701–16706.
10.
de GelderB.Van den StockJ. (2011).
The bodily expressive action stimulus test (BEAST). Construction and validation of a stimulus basis for measuring perception of whole body expression of emotions. Frontiers in Psychology,
2, 181.
11.
de GelderB.Van den StockJ.MeerenH. K. M.SinkeC. B. A.KretM. E.TamiettoM. (2010).
Standing up for the body. Recent progress in uncovering the networks involved in the perception of bodies and bodily expressions. Neuroscience and Biobehavioral Reviews,
34, 513–527.
12.
DowningP. E.JiangY.ShumanM.KanwisherN. (2001).
A cortical area selective for visual processing of the human body. Science (New York, N.Y.),
293, 2470–2473.
13.
EkmanP. (1992).
An argument for basic emotions. Cognition & Emotion,
6, 169–200.
14.
FridinM.BarliyaA.SchechtmanE.de GelderB.FlashT. (2009, January). Computational model and human perception of emotional body language (EBL). Paper presented at the Proceeding of the Symposium on Mental States, Emotions and their Embodiment, Edinburgh, Scotland.
15.
GivensD. B. (2002). The nonverbal dictionary of gestures, signs and body language cues: Adam Apple-Jam to Zygomatic.
Spokane, WA:
Center for Nonverbal Studies Press.
16.
Goldin-MeadowS. (1999).
The role of gesture in communication and thinking. Trends in Cognitive Sciences,
3, 419–429.
17.
GosselinF.SchynsP. G. (2001).
Bubbles: A technique to reveal the use of information in recognition tasks. Vision Research,
41, 2261–2271.
18.
GrèzesJ.PichonS.de GelderB. (2007).
Perceiving fear in dynamic body expressions. NeuroImage,
35, 959–967.
19.
GrosbrasM.-H.BeatonS.EickhoffS. B. (2012).
Brain regions involved in human movement perception: A quantitative voxel-based meta-analysis. Human Brain Mapping,
33, 431–454.
20.
GrossM. M.CraneE. A.FredricksonB. L. (2012).
Effort-shape and kinematic assessment of bodily expression of emotion during gait. Human Movement Science,
31, 202–221.
21.
HietanenJ. K.LeppänenJ. M.LehtonenU. (2004).
Perception of emotions in the hand movement quality of Finnish sign language. Journal of Nonverbal Behavior,
28, 53–64.
22.
KangS.TverskyB. (2016).
From hands to minds: Gestures promote understanding. Cognitive Research: Principles and Implications,
1, 4.
23.
KippM.MartinJ.-C. (2009, September). Gesture and emotion: Can basic gestural form features discriminate emotions? Paper presented at the Affective Computing and Intelligent Interaction and Workshops, 2009, ACII 2009, 3rd International Conference on, IEEE, Amsterdam, Netherlands.
24.
KraussR. M.ChenY.ChawlaP. (1996). Nonverbal behavior and nonverbal communication: What do conversational hand gestures tell us? In M. P. Zanna (Ed.), Advances in experimental social psychology (Vol. 28
, pp. 389–450).
Cambridge, MA:
Academic Press.
25.
KretM. E.de GelderB. (2010).
Social context influences recognition of bodily expressions. Experimental Brain Research. Experimentelle Hirnforschung. Expérimentation Cérébrale,
203, 169–180.
26.
KretM. E.PichonS.GrèzesJ.de GelderB. (2011).
Similarities and differences in perceiving threat from dynamic faces and bodies. An fMRI study. NeuroImage,
54, 1755–1762.
27.
KretM. E.StekelenburgJ. J.de GelderB.RoelofsK. (2017).
From face to hand: Attentional bias towards expressive hands in social anxiety. Biological Psychology,
122, 42–50.
28.
LagerlofI.DjerfM. (2009).
Children’s understanding of emotion in dance. European Journal of Developmental Psychology,
6, 409–431.
29.
LopezL. D.ReschkeP. J.KnotheJ. M.WalleE. A. (2017).
Postural communication of emotion: Perception of distinct poses of five discrete emotions. Frontiers in Psychology,
8, 710.
30.
MeijerM. (1989).
The contribution of general features of body movement to the attribution of emotions. Journal of Nonverbal Behavior,
13, 247–268.
31.
MurthyG.JadonR. (2009).
A review of vision based hand gestures recognition. International Journal of Information Technology and Knowledge Management,
2, 405–410.
32.
ObermeierC.DolkT.GunterT. C. (2012).
The benefit of gestures during communication: Evidence from hearing and hearing-impaired individuals. Cortex,
48, 857–870.
33.
OrlovT.PoratY.MakinT. R.ZoharyE. (2014).
Hands in motion: An upper-limb-selective area in the occipitotemporal cortex shows sensitivity to viewed hand kinematics. Journal of Neuroscience,
34, 4882–4895.
34.
PeelenM. V.AtkinsonA. P.AnderssonF.VuilleumierP. (2007).
Emotional modulation of body-selective visual areas. Social Cognitive and Affective Neuroscience,
2, 274–283.
35.
PeelenM. V.DowningP. E. (2005).
Selectivity for the human body in the fusiform gyrus. Journal of Neurophysiology,
93, 603–608.
36.
PeriniF.CaramazzaA.PeelenM. V. (2014).
Left occipitotemporal cortex contributes to the discrimination of tool-associated hand actions: FMRI and TMS evidence. Frontiers in Human Neuroscience,
8, 591.
37.
PichonS.de GelderB.GrezesJ. (2008).
Emotional modulation of visual and motor areas by dynamic body expressions of anger. Social Neuroscience,
3, 199–212.
38.
ReaderA. T.HolmesN. P. (2016).
Examining ecological validity in social interaction: Problems of visual fidelity, gaze, and social potential. Culture and Brain,
4, 134–146.
39.
ReillyJ. S.McIntireM. L.SeagoH. (1992).
Affective prosody in American sign language. Sign Language Studies,
75, 113–128.
40.
RhodesG. (1988).
Looking at faces: First-order and second-order features as determinants of facial appearance. Perception,
17, 43–63.
41.
RossP.de GelderB.CrabbeF.GrosbrasM.-H. (2014).
Body-selective areas in the visual cortex are less active in children than in adults. Frontiers in Human Neuroscience,
8, 941.
42.
RossP.de GelderB.CrabbeF.GrosbrasM.-H. (2019).
Emotion modulation of the body-selective areas in the developing brain. Developmental Cognitive Neuroscience,
38, 100660.
43.
RossP. D.PolsonL.GrosbrasM. H. (2012).
Developmental changes in emotion recognition from full-light and point-light displays of body movement. PLoS One,
7, e44815.
44.
ShaverP.SchwartzJ.KirsonD.O’ConnorC. (1987).
Emotion knowledge: Further exploration of a prototype approach. Journal of Personality and Social Psychology,
52, 1061–1086.
45.
SmithM. L.CottrellG. W.GosselinF.SchynsP. G. (2005).
Transmitting and decoding facial expressions. Psychological Science,
16, 184–189.
46.
TaylorJ. C.WiggettA. J.DowningP. E. (2007).
Functional MRI analysis of body and body part representations in the extrastriate and fusiform body areas. Journal of Neurophysiology,
98, 1626–1633.
47.
van de RietW. A.GrezesJ.de GelderB. (2009).
Specific and common brain regions involved in the perception of faces and bodies and the representation of their emotional expressions. Social Neuroscience,
4, 101–120.
48.
VicarioC.NewmanA. (2013).
Emotions affect the recognition of hand gestures. Frontiers in Human Neuroscience,
7, 906.
49.
WachsJ. P.KölschM.SternH.EdanY. (2011).
Vision-based hand-gesture applications. Communications of the ACM,
54, 60–71.
50.
WallbottH. G. (1998).
Bodily expression of emotion. European Journal of Social Psychology,
28, 879–896.
51.
WegrzynM.VogtM.KirecliogluB.SchneiderJ.KisslerJ. (2017).
Mapping the emotional face. How individual face parts contribute to successful emotion recognition. PLoS One,
12, e0177239.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
