Vocal expressions are thought to convey information about speakers' emotional states but may also reflect the antecedent cognitive appraisal processes that produced the emotions. We investigated the perception of emotion-eliciting situations on the basis of vocal expressions. Professional actors vocally portrayed different emotions by enacting emotion-eliciting situations. Judges then rated these expressions with respect to the emotion-eliciting situation described in terms of appraisal dimensions (i.e., novelty, intrinsic pleasantness, goal conduciveness, urgency, power, self- and other responsibility, and norm compatibility), achieving good agreement. The perceived appraisal profiles for the different emotions were generally in accord with predictions based on appraisal theory. The appraisal ratings also correlated with a variety of acoustic measures related to pitch, intensity, voice quality, and temporal characteristics. Results suggest that several aspects of emotion-eliciting situations can be inferred reliably and validly from vocal expressions which, thus, may carry information about the cognitive representation of events.
BanseR.SchererK. R. (1996). Acoustic profiles in vocal emotion expression. Journal of Personality and Social Psychology, 70, 614–636.
2.
BatlinerA.SteidlS.SchullerB.SeppiD.VogtT.WagnerJ.… AmirN. (2011). Whodunnit—Searching for the most important feature types signaling emotion-related user states in speech. Computer Speech and Language, 25, 4–28.
BühlerK. (1990). Theory of language. The representational function of language. (GoodwinD. F. Trans.). Amsterdam, The Netherlands: John Benjamins. (Original work published 1934).
5.
CowieR. (2009). Perceiving emotion: Towards a realistic understanding of the task. Philosophical Transactions of the Royal Society B: Biological Sciences, 364, 3515–3525.
6.
DevillersL.CowieR.MartinJ-C.Douglas-CowieE.AbrilianS.McRorieM. (2006). Real life emotions in French and English TV video clips: An integrated annotation protocol combining continuous and discrete approaches. In CalzolariN.ChoukriK.GangemiA.MaegaardB.MarianiJ.OdijkJ.TapiasD. (Eds.), Proceedings of the Fifth International Conference on Language Resources and Evaluation (pp. 1105–1110). Paris, France: European Language Resources Association
7.
ElfenbeinH. A.AmbadyN. (2002). On the universality and cultural specificity of emotion recognition: A meta-analysis. Psychological Bulletin, 128, 203–235.
8.
EllsworthP. C.SchererK. R. (2003). Appraisal processes in emotion. In DavidsonR. J.SchererK. R.GoldsmithH. H. (Eds.), Handbook of affective sciences (pp. 572–595). New York, NY: Oxford University Press.
9.
FontaineJ. R. J.SchererK. R.RoeschE. B.EllsworthP. C. (2007). The world of emotion is not two-dimensional. Psychological Science, 18, 1050–1057.
10.
HansonH. M. (1997). Glottal characteristics of female speakers: Acoustic correlates. Journal of the Acoustical Society of America, 101, 466–481.
11.
JohnstoneT.van ReekumC. M.SchererK. R. (2001). Vocal correlates of appraisal processes. In SchererK. R.SchorrA.JohnstoneT. (Eds.), Appraisal processes in emotion: Theory, methods, research (pp. 271–284). New York, NY: Oxford University Press.
12.
JuslinP. N.LaukkaP. (2001). Impact of intended emotion intensity on cue utilization and decoding accuracy in vocal expression of emotion. Emotion, 1, 381–412.
13.
JuslinP. N.LaukkaP. (2003). Communication of emotions in vocal expression and music performance: Different channels, same code?. Psychological Bulletin, 129, 770–814.
14.
LaukkaP.AudibertN.AubergéV (in press). Exploring the determinants of the graded structure of vocal emotion expressions. Cognition and Emotion, doi:10.1080/02699931.2011.602047
15.
LaukkaP.JuslinP.N.BresinR. (2005). A dimensional approach to vocal expression of emotion. Cognition and Emotion, 19, 633–653.
16.
LaukkaP.NeibergD.ForsellM.KarlssonI.EleniusK. (2011). Expression of affect in spontaneous speech: Acoustic correlates, perception, and automatic detection of irritation and resignation. Computer Speech and Language, 25, 84–104.
17.
LaukkaP.ElfenbeinH. A.ChuiW.ThingujamN. S.IrakiF. K.RockstuhlT.AlthoffJ. (2010). Presenting the VENEC corpus: Development of a cross-cultural corpus of vocal emotion expressions and a novel method of annotating emotion appraisals. In DevillersL.SchullerB.CowieR.Douglas-CowieE.BatlinerA. (Eds.), Proceedings of the LREC 2010 Workshop on Corpora for Research on Emotion and Affect (pp. 53–57). Paris, France: European Language Resources Association.
18.
LazarusR. S. (1991). Emotion and adaptation. New York: Oxford University Press.
19.
OrtonyA.CloreG. L.CollinsA. (1988). The cognitive structure of emotions. Cambridge, England: Cambridge University Press.
20.
RosenthalR.RosnowR. L. (1991). Essentials of behavioral research: Methods and data analysis. (2nd Ed.). New York, NY: McGraw-Hill.
21.
RussellJ. A.BachorowskiJ-A.Fernandez-DolsJ-M. (2003). Facial and vocal expressions of emotion. Annual Review of Psychology, 54, 329–349.
22.
SchererK. R. (1986). Vocal affect expression: A review and a model for future research. Psychological Bulletin, 99, 143–165.
23.
SchererK. R. (1988). On the symbolic functions of vocal affect expression. Journal of Language and Social Psychology, 7, 79–100.
24.
SchererK. R.GrandjeanD. (2008). Facial expressions allow inference of both emotions and their components. Cognition and Emotion, 22, 789–801.
25.
SchererK. R.SchorrA.JohnstoneT. (2001). Appraisal processes in emotion: Theory, methods, research. New York, NY: Oxford University Press.
26.
SchullerB.BatlinerA.SteidlS.SeppiD. (2011). Recognizing realistic emotions and affect in speech: State of the art and lessons learnt from the first challenge. Speech Communication, 53, 1062–1087.
27.
Simon-ThomasE. R.KeltnerD. J.SauterD.Sinicropi-YaoL.AbramsonA. (2009). The voice conveys specific emotions: Evidence from vocal burst displays. Emotion, 9, 838–846.
28.
SundbergJ.PatelS.BjörknerE.SchererK. R. (2011). Interdependencies among voice source parameters in emotional speech. IEEE Transactions on Affective Computing, 2, 162–174.
