Researchers currently seek to improve validity in speech and language studies by adopting naturalistic procedures In emotion-display research, validity is threatened by standard experimental controls which diminish the naturalism of stimuli and responseranges. Were port two experiments comparing the adequacy of naturalistic with standard procedures. Experiment 1 had 158 judges code 89 samples of naturally-occurring emotional speech with free- choice emotion labels, and later with labels from a standard set. When free-choice labels were similar across judges, they were consistent with standard labels, but showed a range of intensity and contextual relevance. We recommend that future studies include wider options for judges when coding emotions. Experiment 2 compared valency ratings of words when presented in, or out of, context. Standard procedures score lexical valencies using affective dictionaries, disregarding natural contexts. Experiment 2 compared 23 judges' valency ratings of words presented individually, and later in their original context. Between 30% and 44% of words were rated differently in context (depending on the statistical significance level adopted). We concluded from Experiment 2 that, where small corpora adequately model a domain, the improved accuracy of valency rating achieved by presenting words in their natural context justifies the extra procedures required.
Anderson, C.W., & McMaster, G.E. (1982). Computer assisted modeling of affective tone in written documents. Computers and the Humanities, 16, 1-9.
2.
Anderson, C.W., & McMaster, G.E. (1986). Modeling emotional tone in stories using tension levels and categorical states. Computers and the Humanities, 20, 3-9.
3.
Arnfield, S., Roach, P., Setter, J., Greasley, P., & Horton, D. (1995). Emotional stress and speech tempo variation. Proceedings of the ESCA-NATO Tutorial and Research Workshop on Speech under Stress. Lisbon.
4.
Bestgen, Y. (1994). Can emotional valence in stories be determined from words? Cognition and Emotion, 8, 21-36.
5.
Brown, B.L., & Bradshaw, J.M. (1985). Towards a social psychology of voice variations In H. Giles & R. N. St Clair (Eds.). Recent advances in language, communication and social psychology . London: Lawrence Erlbaum Associates .
6.
Davitz, J.R., & Davitz, L.J. (1959).The communication of feelings by content-free speech . Journal of Communication, 9, 6-13.
7.
Ekman, P. (1972). Universals and cultural differences in facial expressions of emotion. In J. Cole (Ed.), Nebraska Symposium on Motivation (Vol. 19). Lincoln: University of Nebraska Press.
8.
Ekman, P. (1980). The face of man: Expressions of universal emotions in a New Guinea village. New York: Garland STPM Press.
9.
Fairbanks, G. (1940). Recent experimental investigations of vocal pitch in speech. Journal of the Acoustical Society of America, 11, 457-466.
10.
Fairbanks, G., & Provonost, W. (1939). An experimental study of the pitch characteristics of the voice during the expression of emotion. Speech Monographs , 6, 87-104.
11.
Fairbanks, G., & Hoaglin, L.W. (1941). An experimental study of the durational characteristics of the voice during the expression of emotion. Speech Monographs , 8, 85-90.
12.
Fehr, B., & Russell, J.A. (1984). Concept of emotion viewed from a prototype perspective . Journal of Experimental Psychology: General, 113, 464-486.
13.
Greasley, P., Setter, J., Waterman, M., Sherrard, C., Roach, P., Arnfield, S., & Horton, D. (1995). Representation of prosodic and emotional features in a spoken language database. Proceedings of XIII International Congress of Phonetic Sciences, Stockholm .
14.
Heise, D.R. (1965). Semantic differential profiles for the 1000 most frequent English words. Psychological Monographs, 79, NO.601.
15.
Howell, D.C. (1997). Statistical methods for psychology. London: Duxbury Press.
16.
Johnson-Laird, P.N., & Oatley, K. (1989). The language of emotions: An analysis of a semantic field. Cognition and Emotion, 3, 81-123.
17.
Kramer, E. (1964). Elimination of verbal cues in judgments of emotion of voice. Journal of Abnormal and Social Psychology, 68, 390-396.
18.
Lieberman, P., & Michaels, S.B. (1962). Some aspects of fundamental frequency and envelope amplitude as related to the emotional content of speech . Journal of the Acoustical Society of America, 34, 922-927.
19.
Murray, I.R. , & Arnott, J.L. (1993). Toward the simulation of emotion in synthetic speech: A review of the literature on human vocal emotion . Journal of the Acoustical Society of America, 93, 1097-1108.
20.
Ortony, A., & Turner, A. (1990). What's basic about basic emotions? Psychological Review, 97, 315-331.
21.
Ortony, A., Clore, G., & Collins, A. (1988). The cognitive structure of emotions. Cambridge, U.K.: Cambridge University Press .
22.
Osgood, C.E., May, W.H., & Miron, M.S. (1975). Cross-cultural universals of affective meaning . Urbana, Illinois: University of Illinois Press.
23.
Osgood, C.E., Suci, G.J., & Tannenbaum, P.H. (1957). The measurement of meaning . Urbana: University of Illinois Press.
24.
Plutchik, R. (1994). The psychology and biology of emotion. New York: Harper Collins College Publishers .
25.
Rosenberg, E.L., & Ekman, P. (1995). Conceptual and methodological issues in the judgment of facial expressions of emotion. Motivation and Emotion, 19, 111-138.
26.
Russell, J.A. (1994). Is there universal recognition of emotion from facial expression? A review of the cross-cultural studies. Psychological Bulletin, 115, 102-141.
27.
Russell, J.A., & Bullock, M. (1986). Fuzzy concepts and the perception of emotion in facial expression. Social Cognition, 4, 309-341.
28.
Russell, J.A., Weiss, A., & Mendelsohn, G.A. (1989). Affect grid: A single-item scale of pleasure and arousal. Journal of Personality and Social Psychology, 57, 493-502.
29.
Scherer, K.R., Banse, R., Wallbott, H.G., & Goldbeck, T. (1991). Vocal cues in emotion encoding and decoding. Motivation and Emotion, 15, 123-148.
30.
Shaver, P., Schwartz, J., Kirson, D., & O'Connor, C. (1987). Emotion knowledge: Further explorations of a prototype approach. Journal of Personality and Social Psychology, 52, 1061-1086.
31.
Tomkins, S.S., & McCarter, R. (1964). What and where are the primary affects? Some evidence foratheory. Perceptual and Motor Skills, 18, 119-158.
32.
Vakoch, D.A., & Wurm, L.H. (1997). Emotional connotations in speech perception: Semantic associations in the general lexicon. Cognition and Emotion , 11, 337-349.
33.
Van Bezooijen, R.A.M.G. (1984). Characteristics and recognizability of vocal expressions of emotion. Dordrecht, The Netherlands: Foris.
34.
Whissell, C.M. (1989). The dictionary of affect. In R. Plutchik & H. Kellerman (Eds.), Emotion: Theory, research and experience, Volume 4. The measurement of emotions. New York: Academic Press.
35.
Whissell, C.M. (1994). A computer program for the objective analysis of style and emotional connotations of prose: Hemingway, Galsworthy, and Faulkner compared. Perceptual and Motor Skills, 79, 815-824.
36.
Williams, C.E., & Stevens, K.N. (1972). Emotions and speech: Some acoustical correlates . Journal of the Acoustical Society of America, 52, 1238-1250.
37.
Wurm, L.H., & Vakoch, D.A. (1996). Dimensions of speech perception: Semantic associations in the affective lexicon. Cognition and Emotion, 10, 409- 423.
