The aim of this review is to show the fruitfulness of using images of facial expressions as experimental stimuli in order to study how neural systems support biologically relevant learning as it relates to social interactions. Here we consider facial expressions as naturally conditioned stimuli which, when presented in experimental paradigms, evoke activation in amygdala–prefrontal neural circuits that serve to decipher the predictive meaning of the expressions. Facial expressions offer a relatively innocuous strategy with which to investigate these normal variations in affective information processing, as well as the promise of elucidating what role the aberrance of such processing might play in emotional disorders.
AdolphsR.GosselinF.BuchananT. W.TranelD.SchynsP.DamasioA. R. (2005). A mechanism for impaired fear recognition after amygdala damage. Nature, 433(7021), 68–72.
2.
AdolphsR.TranelD.DamasioA. R. (1998). The human amygdala in social judgment. Nature, 393, 470–474.
3.
AdolphsR.TranelD.DamasioA. R.DamasioH. (1994). Impaired recognition of emotion in facial expressions following bilateral damage to the human amygdala. Nature, 372, 669–672.
4.
AlloyL. B.AbramsonL. Y. (1979). Judgment of contingency in depressed and nondepressed students: Sadder but wiser?Journal of Experimental Psychology General, 108, 441–485.
5.
AndersS.LotzeM.ErbM.GroddW.BirbaumerN. (2004). Brain activity underlying emotional valence and arousal: A response-related fMRI study. Human Brain Mapping, 23, 200–209.
6.
AndersonA. K.ChristoffK.PanitzD.De RosaE.GabrieliJ. D. (2003). Neural correlates of the automatic processing of threat facial signals. The Journal of Neuroscience, 23, 5627–5633.
7.
BishopS. J. (2007). Neurocognitive mechanisms of anxiety: An integrative account. Trends in Cognitive Sciences, 11, 307–316.
8.
BouhuysA. L.GeertsE.GordijnM. C. M. (1999). Depressed patients’ perceptions of facial emotions in depressed and remitted states are associated with relapse. The Journal of Nervous and Mental Disease, 187, 595–602.
9.
BreiterH. C.EtcoffN. L.WhalenP. J.KennedyW. A.RauchS. L.BucknerR. L.… RosenB. R. (1996). Response and habituation of the human amygdala during visual processing of facial expression. Neuron, 17, 875–887.
10.
CanliT.ZhaoZ.BrewerJ.GabrieliJ. D. E.CahillL. (2000). Event-related activation in the human amygdala associates with later memory for individual emotional experience. The Journal of Neuroscience, 20: RC99, 1–5.
11.
DavisF. C.JohnstoneT.MazzullaE. C.OlerJ. A.WhalenP. J. (2010). Regional response differences across the human amygdaloid complex during social conditioning. Cerebral Cortex, 20, 612–621.
12.
DavisF. C.SomervilleL. H.RuberryE. J.BerryA.ShinL. M.WhalenP. J. (2011). A tale of two negatives: Differential memory effects associated with fearful and angry facial expressions. Emotion, 11, 647–655.
13.
DemosK. E.KelleyW. M.RyanS. L.DavisF. C.WhalenP. J. (2008). Human amygdala sensitivity to the pupil size of others. Cerebral Cortex, 18, 2729–2734.
14.
EkmanP.LevensonR. W.FriesenW. V. (1983). Autonomic nervous system activity distinguishes among emotions. Science, 221, 1208–1210.
15.
EtkinA.KlemenhagenK. C.DudmanJ. T.RoganM. T.HenR.KandelE. R.HirshJ. (2004). Individual differences in trait anxiety predict the response of the basolateral amygdala to unconsciously processed fearful faces. Neuron, 44, 1043–1055.
16.
FitzgeraldD. A.AngstadtM.JelsoneL. M.NathanP. J.PhanK. L. (2006). Beyond threat: Amygdala reactivity across multiple expressions of facial affect. Neuroimage, 30, 1441–1448.
17.
FreeseJ.AmaralD. (2009). Neuroanatomy of the primate amygdala. In WhalenP. J.PhelpsE. A. (Eds.), The human amygdala (pp. 3–42). New York, NY: Guilford Press.
18.
GallagherM.HollandP. C. (1994). The amygdala complex: Multiple roles in associative learning and attention. Proceedings of the National Academy of Sciences, 91, 11771–11776.
19.
GhashghaeiH. T.HilgetagC. C.BarbasH. (2007). Sequence of information processing for emotions based on the anatomic dialogue between prefrontal cortex and amygdala. Neuroimage, 34, 905–923.
20.
HareT. A.TottenhamN.GalvanA.VossH. U.GloverG. H.CaseyB. J. (2008). Biological substrates of emotional reactivity and regulation in adolescence during an emotional go–nogo task. Biological Psychiatry, 14, 190–204.
21.
HaririA. R.BookheimerS. Y.MazziottaJ. C. (2000). Modulating emotional responses: Effects of a neocortical network on the limbic system. Neuroreport, 11, 43–48.
22.
HerryC.BachD. R.EspositoF.Di SalleF.PerrigW. J.SchefflerK. (2007). Processing of temporal unpredictability in human and animal amygdala. The Journal of Neuroscience, 27, 5958–5966.
23.
JohnsenB. H.ThayerJ. F.HugdahlK. (1995). Affective judgment of the Ekman faces: A dimensional approach. Journal of Psychophysiology, 9, 193–202.
24.
KappB. S.WhalenP. J.SuppleW. F.PascoeJ. P. (1992). Amygdaloid contributions to conditioned arousal and sensory information processing. In AggeltonJ. P. (Ed.), The amygdala: Neurobiological aspects of emotion, memory, and mental dysfunction (pp. 229–254). New York, NY: Wiley-Liss.
25.
KimH.SomervilleL. H.JohnstoneT.AlexanderA. L.WhalenP. J. (2003). Inverse amygdala and medial prefrontal cortex responses to surprised faces. Neuroreport, 14, 2317–2322.
26.
KimH.SomervilleL. H.JohnstoneT.PolisS.AlexanderA. L.ShinL. M. (2004). Contextual modulation of amygdala responsivity to surprised faces. Journal of Cognitive Neuroscience, 16, 1730–1745.
27.
KimM. J.GeeD. G.LoucksR. A.DavisF. C.WhalenP. J. (2011). Anxiety dissociates dorsal and ventral medial prefrontal cortex functional connectivity with the amygdala at rest. Cerebral Cortex, 21, 1667–1673.
28.
KimM. J.LoucksR. A.NetaM.DavisF. C.OlerJ. A.MazzullaE. C.WhalenP. J. (2010). Behind the mask: The influence of mask-type on amygdala response to fearful faces. Social Cognitive and Affective Neuroscience, 5, 363–368.
29.
KimM. J.WhalenP. J. (2009). The structural integrity of an amygdala–prefrontal pathway predicts trait anxiety. The Journal of Neuroscience, 29, 11614–11618.
30.
LeDouxJ. E. (1996). The emotional brain: The mysterious underpinnings of emotional life. New York, NY: Simon & Schuster.
31.
MorganM. A.RomanskiL. M.LeDouxJ. E. (1993). Extinction of emotional learning: Contribution of medial prefrontal cortex. Neuroscience Letters, 163, 109–113.
32.
MorrisJ. S.FrithC. D.PerrettD. I.RowlandD.YoungA. W.CalderA. J.DolanR. J. (1996). A differential neural response in the human amygdala to fearful and happy facial expressions. Nature, 383, 812–814.
33.
NetaM.DavisF. C.WhalenP. J. (2011). Valence resolution of ambiguous facial expressions using an emotional odd-ball task. Emotion, 11, 1425–1433.
34.
NetaM.NorrisC. J.WhalenP. J. (2009). Corrugator muscle responses are associated with individual differences in positivity–negativity bias. Emotion, 9, 640–648.
35.
NetaM.WhalenP. J. (2010). The primacy of negative interpretations when resolving the valence of ambiguous facial expressions. Psychological Science, 21, 901–907.
36.
OchsnerK. N.GrossJ. J. (2005). The cognitive control of emotion. Trends in Cognitive Sciences, 9, 242–249.
37.
PatonJ. J.BelovaM. A.MorrisonS. E.SalzmanC. D. (2006). The primate amygdala represents the positive and negative value of visual stimuli during learning. Nature, 439, 865–870.
38.
PelphreyK. A.SassonN. J.ReznickJ. S.PaulG.GoldmanB.PivenJ. (2002). Visual scanning of faces in autism. Journal of Autism and Developmental Disorders, 32, 249–261.
39.
PessoaL.PadmalaS.MorlanT. (2005). Fate of unattended fearful faces in the amygdala is determined by both attentional resources and cognitive modulation. Neuroimage, 28, 249–255.
40.
PezawasL.Meyer-LindenbergA.DrabantE. M.VerchinskiB. A.MunozK. E.KolachanaB. S.… WeinbergerD. R. (2005). 5-HTTLPR polymorphism impacts human cingulate–amygdala interactions: A genetic susceptibility mechanism for depression. Nature Neuroscience, 8, 828–834.
41.
PhillipsM. L.YoungA. W.SeniorC.BrammerM.AndrewC.CalderA. J. (1997). A specific neural substrate for perceiving facial expressions of disgust. Nature, 389, 495–498.
42.
QuirkG. J.BeerJ. S. (2006). Prefrontal involvement in the regulation of emotion: Convergence of rat and human studies. Current Opinion in Neurobiology, 16, 723–727.
43.
ShinL. M.WrightC. I.CannistraroP.WedigM.McMullinK.MartisB. (2005). A functional magnetic resonance imaging study of amygdala and medial prefrontal cortex responses to overtly presented fearful faces in posttraumatic stress disorder. Archives of General Psychiatry, 62, 273–281.
44.
SimpsonJ. R.Jr.DrevetsW. C.SnyderA. Z.GusnardD. A.RaichleM. E. (2001). Emotion-induced changes in human medial prefrontal cortex, II: During anticipatory anxiety. Proceedings of the National Academy of Sciences, USA, 98, 688–693.
45.
SomervilleL. H.KimH.JohnstoneT.AlexanderA.WhalenP. J. (2004). Human amygdala response during presentation of happy and neutral faces: Correlations with state anxiety. Biological Psychiatry, 55, 897–903.
46.
TomkinsS. S.McCarterR. (1964). What and where are the primary affects? Some evidence for a theory. Perceptual and Motor Skills, 18, 119–158.
47.
TottenhamN.HareT. A.MillnerA.GilhoolyT.ZevinJ. D.CaseyB. J. (2011). Elevated amygdala response to faces following early deprivation. Developmental Science, 14, 190–204.
48.
VuilleumierP.ArmonyJ. L.DriverJ.DolanR. J. (2003). Distinct spatial frequency sensitivities for processing faces and emotion expressions. Nature Neuroscience, 6, 624–631.
49.
WhalenP. J. (1998). Fear, vigilance, and ambiguity: Initial neuroimaging studies of the human amygdala. Current Directions in Psychological Science, 7, 177–188.
50.
WhalenP. J. (2007). The uncertainty of it all. Trends in Cognitive Science, 11, 499–500.
51.
WhalenP. J.DavisF. C.OlerJ. A.KimH.JustinM. J.NetaM. (2009). Human amygdala responses to facial expressions of emotion. In WhalenP. J.PhelpsE. A. (Eds.), The human amygdala (pp. 265–288). New York, NY: Guilford Press.
52.
WhalenP. J.JohnstoneT.SomervilleL. H.NitschkeJ. B.PolisS.AlexanderA.… KalinN. H. (2008). A functional MRI predictor of treatment response to venlafaxine in generalized anxiety disorder. Biological Psychiatry, 63, 858–863.
53.
WhalenP. J.KaganJ.CookR. G.DavisF. C.KimH.PolisS.… JohnstoneT. (2004). Human amygdala responsivity to masked fearful eye whites. Science, 306, 2061.
54.
WhalenP. J.KleckR. E. (2008). The shape of faces (to come). Nature Neuroscience, 11, 739–740.
55.
WhalenP. J.RauchS. L.EtcoffN. L.McInerneyS. C.LeeM. B.JenikeM. A. (1998). Masked presentations of emotional facial expressions modulate amygdala activity without explicit knowledge. The Journal of Neuroscience, 18, 411–418.
56.
WhalenP. J.ShinL. M.McInerneyS. C.FischerH. (2001). A functional MRI study of human amygdala responses to facial expressions of fear versus anger. Emotion, 1, 70–83.
57.
WilliamsM. A.MorrisA. P.McGloneF.AbbottD. F.MattinglyJ. B. (2004). Amygdala responses to fearful and happy expressions under conditions of binocular suppression. The Journal of Neuroscience, 24, 2898–2904.
58.
WinstonJ. S.GottfriedJ. A.KilnerJ. MDolanR. J. (2005). Integrated neural representations of odor intensity and affective valence in human amygdala. The Journal of Neuroscience, 25, 8903–8907.
59.
YangT. T.MenonV.EliezS.BlaseyC.WhiteC. D.ReidA. J.… ReissA. L. (2002). Amygdalar activation associated with positive and negative facial expressions. Neuroreport, 13, 1737–1741.
