A happy facial expression makes a person look (more) trustworthy. Do perceptions of happiness and trustworthiness rely on the same face regions and visual attention processes? In an eye-tracking study, eye movements and fixations were recorded while participants judged the un/happiness or the un/trustworthiness of dynamic facial expressions in which the eyes and/or the mouth unfolded from neutral to happy or vice versa. A smiling mouth and happy eyes enhanced perceived happiness and trustworthiness similarly, with a greater contribution of the smile relative to the eyes. This comparable judgement output for happiness and trustworthiness was reached through shared as well as distinct attentional mechanisms: (a) entry times and (b) initial fixation thresholds for each face region were equivalent for both judgements, thereby revealing the same attentional orienting in happiness and trustworthiness processing. However, (c) greater and (d) longer fixation density for the mouth region in the happiness task, and for the eye region in the trustworthiness task, demonstrated different selective attentional engagement. Relatedly, (e) mean fixation duration across face regions was longer in the trustworthiness task, thus showing increased attentional intensity or processing effort.
AdolphsR. (2002). Recognizing emotion from facial expressions: Psychological and neurological mechanisms. Behavioral and Cognitive Neuroscience Reviews, 1, 21–62.
2.
BartlettM.WhitehillJ. (2011). Automated facial expression measurement: Recent applications to basic research in human behavior, learning, and education. In CalderA.RhodesG.JohnsonM.HaxbyJ. (Eds.), Handbook of face perception (pp. 489–513). Oxford, UK: Oxford University Press.
3.
BeaudryO.Roy-CharlandA.PerronM.CormierI.TappR. (2014). Featural processing in recognition of emotional facial expressions. Cognition & Emotion, 28, 416–432.
4.
BeltránD.CalvoM. G. (2015). Brain signatures of perceiving a smile: Time course and source localization. Human Brain Mapping, 36, 4287–4303.
5.
BindemannM.ScheepersC.BurtonA. M. (2009). Viewpoint and center of gravity affect eye movements to human faces. Journal of Vision, 927, 1–16.
6.
BombariD.SchmidP. C.Schmid-MastM.BirriS.MastF. W.LobmaierJ. S. (2013). Emotion recognition: The role of featural and configural face information. The Quarterly Journal of Experimental Psychology, 66, 2426–2442.
7.
BrewerR.CollinsF.CookR.BirdG. (2015). Atypical trait inferences from facial cues in alexithymia. Emotion, 15, 637–643.
8.
CalderA. J.YoungA. W.KeaneJ.DeanM. (2000). Configural information in facial expression perception. Journal of Experimental Psychology: Human Perception and Performance, 26, 527–551.
9.
CalvoM. G.Álvarez-PlazaP.Fernández-MartínA. (2017). The contribution of facial regions to judgments of happiness and trustworthiness from dynamic expressions. Journal of Cognitive Psychology, 29, 618–625.
10.
CalvoM. G.AveroP.Fernández-MartínA.RecioG. (2016). Recognition thresholds for static and dynamic emotional faces. Emotion, 16, 1186–1200.
11.
CalvoM. G.BeltránD. (2014). Brain lateralization of holistic versus analytic processing of emotional facial expressions. Neuroimage, 92, 237–247.
12.
CalvoM. G.BeltránD.Fernández-MartínA. (2014). Early processing of happy facial expressions in peripheral vision: Neurophysiological evidence. Biological Psychology, 100, 60–70.
13.
CalvoM. G.Fernández-MartínA.NummenmaaL. (2012). Perceptual, categorical, and affective processing of ambiguous smiling facial expressions. Cognition, 125, 373–393.
14.
CalvoM. G.Fernández-MartínA.NummenmaaL. (2014). Facial expression recognition in peripheral versus central vision: Role of the eyes and the mouth. Psychological Research, 78, 180–195.
15.
CalvoM. G.Gutiérrez-GarcíaA.AveroP.LundqvistD. (2013). Attentional mechanisms in judging genuine and fake smiles: Eye-movement patterns. Emotion, 13, 792–802.
16.
CalvoM. G.Gutiérrez-GarcíaA.Fernández-MartínA.NummenmaaL. (2014). Recognition of facial expressions of emotion is related to their frequency in everyday life. Journal of Nonverbal Behavior, 38, 549–567.
17.
CalvoM. G.NummenmaaL. (2008). Detection of emotional faces: Salient physical features guide effective visual search. Journal of Experimental Psychology: General, 137, 471–494.
18.
CalvoM. G.NummenmaaL. (2016). Perceptual and affective mechanisms in facial expression recognition: An integrative review. Cognition & Emotion, 30, 1081–1106.
19.
CentorrinoS.DjemaiE.HopfensitzA.MilinskiM.SeabrightP. (2015). Honest signaling in trust interactions: Smiles rated as genuine induce trust and signal higher learning opportunities. Evolution and Human Behavior, 36, 8–16.
20.
CohnJ. F.De la TorreF. (2015). Automated face analysis for affective computing. In CalvoR.A.DiMelloS.GratchJ.KappasA. (Eds.), The Oxford handbook of affective computing (pp. 131–150). New York, NY: Oxford University Press.
21.
Del GiudiceM.ColleL. (2007). Differences between children and adults in the recognition of enjoyment smiles. Developmental Psychology, 43, 796–803.
22.
EisenbarthH.AlpersG. W. (2011). Happy mouth and sad eyes: Scanning emotional facial expressions. Emotion, 11, 860–865.
23.
EkmanP.FriesenW. V.HagerJ. C. (2002). Facial action coding system: Investigator’s guide. Salt Lake City, UT: Human Face.
24.
EngellA. D.TodorovA.HaxbyJ. V. (2010). Common neural mechanisms for the evaluation of facial trustworthiness and emotional expressions as revealed by behavioral adaptation. Perception, 39, 931–941.
25.
GuoK.SmithC.PowellK.NichollsK. (2012). Consistent left gaze bias in processing different facial cues. Psychological Research, 76, 263–269.
26.
HehmanE.FlakeJ. K.FreemanJ. B. (2015). Static and dynamic facial cues differentially affect the consistency of social evaluations. Personality and Social Psychology Bulletin, 41, 1123–1134.
27.
HendersonJ. M. (2003). Human gaze control during real-world scene perception. Trends in Cognitive Sciences, 7, 498–504.
28.
HoffmannH.TraueH. C.BachmayrF.KesslerH. (2010). Perceived realism of dynamic facial expressions of emotion: Optimal durations for the presentation of emotional onsets and offsets. Cognition & Emotion, 24, 1369–1378.
29.
HsiaoJ. H. W.CottrellG. (2008). Two fixations suffice in face recognition. Psychological Science, 19, 998–1006.
JohnstonL.MilesL.MacraeC. (2010). Why are you smiling at me? Social functions of enjoyment and non-enjoyment smiles. British Journal of Social Psychology, 49, 107–127.
32.
JohnstonP.MayesA.HughesM.YoungA. (2013). Brain networks subserving the evaluation of static and dynamic facial expressions. Cortex, 49, 2462–2472.
33.
KananC.BseisoD. N. F.RayN. A.HsiaoJ. H.CottrellG. W. (2015). Humans have idiosyncratic and task-specific scanpaths for judging faces. Vision Research, 108, 67–76.
34.
KrumhuberE. G.KappasA.MansteadA. S. R. (2013). Effects of dynamic aspects of facial expressions: A review. Emotion Review, 5, 41–46.
35.
KrumhuberE. G.LikowskiK. U.WeyersP. (2014). Facial mimicry of spontaneous and deliberate Duchenne and non-Duchenne smiles. Journal of Nonverbal Behavior, 38, 1–11.
36.
KrumhuberE. G.MansteadA. S. R.KappasA. (2007). Temporal aspects of facial displays in person and expression perception: The effects of smile dynamics, head-tilt and gender. Journal of Nonverbal Behavior, 31, 39–56.
37.
KrumhuberE. G.MansteadA. S. R.KappasA.CoskerD.MarshallD.RosinP. L. (2007). Facial dynamics as indicators of trustworthiness and cooperative behavior. Emotion, 7, 730–735.
38.
KrumhuberE. G.SchererK. R. (2016). The look of fear from the eyes varies with the dynamic sequence of facial actions. Swiss Journal of Psychology, 75, 5–14.
39.
LederH.TinioP. P. L.FuchsI. M.BohrnI. (2010). When attractiveness demands longer looks: The effects of situation and gender. The Quarterly Journal of Experimental Psychology, 63, 1858–1871.
40.
LeppänenJ.HietanenJ. K. (2007). Is there more in a happy face than just a big smile?Visual Cognition, 15, 468–490.
41.
LundqvistD.FlyktA.ÖhmanA. (1998). The Karolinska directed emotional faces–KDEF. Stockholm, Sweden: Department of Clinical Neuroscience, Psychology section, Karolinska Institutet (CD-ROM).
42.
ManssuerL. R.RobertsM. V.TipperS. P. (2015). The late positive potential indexes a role for emotion during learning of trust from eye-gaze cues. Social Neuroscience, 10, 635–650.
43.
McLellanT.JohnstonL.Dalrymple-AlfordJ.PorterR. (2010). Sensitivity to genuine vs. posed emotion specified in facial displays. Cognition & Emotion, 24, 1277–1292.
44.
MilesL. K. (2009). Who is approachable?Journal of Experimental Social Psychology, 45, 262–266.
45.
MillsM.HollingworthA.Van der StigchelS.HoffmanL.DoddM. D. (2011). Examining the influence of task set on eye movements and fixations. Journal of Vision, 11, 171–115. doi:10.1167/11.8.17
46.
NelsonN. L.RussellJ. A. (2013). Universality revisited. Emotion Review, 5, 8–15.
47.
NusseckM.CunninghamD. W.WallravenC.BülthoffH. H. (2008.). The contribution of different facial regions to the recognition of conversational expressions. Journal of Vision, 8, 1–23. doi:10.1167/8.8.1
48.
OosterhofN. N.TodorovA. (2008). The functional basis of face evaluation. Proceedings of the National Academy of Sciences of the United States of America, 105, 11087–11092. doi:10.1073/pnas.0805664105
49.
OosterhofN. N.TodorovA. (2009). Shared perceptual basis of emotional expressions and trustworthiness impressions from faces. Emotion, 9, 128–133.
50.
PetersonM. F.EcksteinM. P. (2012). Looking just below the eyes is optimal across face recognition tasks. Proceedings of the National Academy of Sciences of the United States of America, 109, 3314–3323. doi:10.1073/pnas.1214269109
51.
QuadfliegS.VermeulenN.RossionB. (2013). Differential reliance on the Duchenne marker during smile evaluations and person judgments. Journal of Nonverbal Behavior, 37, 69–77.
52.
RaynerK. (2009). The Thirty Fifth Sir Frederic Bartlett Lecture: Eye movements and attention in reading, scene perception, and visual search. The Quarterly Journal of Experimental Psychology, 62, 1457–1506.
53.
SaidC. P.HaxbyJ. V.TodorovA. (2011). Brain system for assessing the affective value of faces. Philosophical Transaction of the Royal Society, 366, 1660–1670.
54.
SchultzJ.PilzK. S. (2009). Natural facial motion enhances cortical responses to faces. Experimental Brain Research, 194, 465–475.
55.
SchurginM. W.NelsonJ.IidaS.OhiraH.ChiaoJ. Y.FranconeriS. L. (2014). Eye movements during emotion recognition in faces. Journal of Vision, 14, 1–16. doi:10.1167/14.13.14
56.
SmithM. L.CottrellG. W.GosselinF.SchynsP. G. (2005). Transmitting and decoding facial expressions. Psychological Science, 16, 184–189.
57.
StrachanJ. W. A.KirkhamA. J.ManssuerL. R.TipperS. P. (2016). Incidental learning of trust: Examining the role of emotion and visuomotor fluency. Journal of Experimental Psychology: Learning, Memory, and Cognition, 42, 1759–1773.
58.
SutherlandC. A. M.YoungA. W.RhodesG. (2017). Facial first impressions from another angle: How social judgements are influenced by changeable and invariant facial properties. British Journal of Psychology, 108, 397–415.
59.
TanakaJ. W.KaiserM.ButlerS.Le GrandR. (2012). Mixed emotions: Holistic and analytic perception of facial expressions. Cognition & Emotion, 26, 961–977.
60.
VaidyaA. R.JinC.FellowsL. K. (2014). Eye spy: The predictive value of fixation patterns in detecting subtle and extreme emotions from faces. Cognition, 133, 443–456.
61.
WellsL. J.GillespieS. M.RotshteinP. (2016). Identification of emotional facial expressions: Effects of expression, intensity, and sex on eye gaze. PLoS ONE, 11, e0168307. doi:10.1371/journal.pone.0168307
62.
WillisM. L.PalermoR.BurkeD. (2011). Social judgments are influenced by both facial expression and direction of eye gaze. Social Cognition, 29, 415–429.
63.
WingenbachT. S. H.AshwinC.BrosnanM. (2016). Validation of the Amsterdam Dynamic Facial Expression Set—Bath Intensity Variations (ADFES-BIV): A set of videos expressing low, intermediate, and high intensity emotions. PLoS ONE, 11, e0147112. doi:10.1371/journal.pone.0147112
64.
WinkielmanP.OlszanowskiM.GolaM. (2015). Faces in-between: Evaluations reflect the interplay of facial features and task-dependent fluency. Emotion, 15, 232–242.
65.
XiaoN. G.QuinnP. C.WheelerA.PascalisO.LeeK. (2014). Natural, but not artificial, facial movements elicit the left visual field bias in infant face scanning. Neuropsychologia, 62, 175–183.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
