This article examines the prevalence and nature of negativity in news content. Using dictionary-based sentiment analysis, we examine roughly fifty-five thousand front-page news stories, comparing four different affect lexicons, one for general negativity, and three capturing different measures of fear and anger. We show that fear and anger are distinct measures that capture different sentiments. It may therefore be possible to separate out fear and anger in media content, as in psychology. We also find that negativity is more strongly related to anger than to fear for each measure. This result appears to be driven by a small number of foreign policy words in the anger dictionaries, rather than an indication that negativity in U.S. coverage reflects “anger.” We highlight the importance of tailoring lexicons to domains to improve construct validity when conducting dictionary-based automation. Finally, we connect these results to existing work on the impact of emotion on political preferences and reasoning.
AbelsonRobert P.KinderDonald R.PetersMark D.FiskeSusan T.1982. Affective and semantic components in political person perception. Journal of Personality and Social Psychology42 (4): 619–30.
2.
AlpersGeorg W.WinzelbergAndrew J.ClassenCatherineRobertsHeidiDevParvatiKoopmanCherylTaylorC. Barr. 2005. Evaluation of computerized text analysis in an internet breast cancer support group. Computers in Human Behavior21 (2): 361–76.
3.
AmanSaimaSzpakowiczStan. 2007. Identifying expressions of emotion in text. In Text, speech and dialogue, eds. MatoušekVáclavMautnerPavel, 196–205. Berlin: Springer.
4.
BackMitja D.KüfnerAlbrecht CPEgloffBoris. 2011. Automatic or the people? Anger on September 11, 2001, and lessons learned for the analysis of large digital data sets. Psychological Science22 (6): 837–38.
5.
BalmasMeital. 2014. Bad news: Affective coverage of national leaders in international news. Paper presented at the annual meeting of the International Communication Association, Seattle, WA.
6.
BlumlerJay G.GurevitchMichael. 1995. The crisis of public communication. London: Routledge.
7.
BraderTed. 2005. Striking a responsive chord: How political ads motivate and persuade voters by appealing to emotions. American Journal of Political Science49 (2): 388–405.
8.
CahillLucas. 1996. Neurobiology of memory for emotional events: Converging evidence from infra-human and human studies. Cold Spring Harbor Symposia on Quantitative Biology61:259–64.
9.
CappellaJoseph N.JamiesonKathleen Hall. 1997. Spiral of cynicism: The press and the public good. New York, NY: Oxford University Press.
10.
ChoJaehoBoyleMichael P.KeumHeejoShevyMark D.McLeodDouglas M.ShahDhavan V.PanZhongdang. 2003. Media, terrorism, and emotionality: Emotional differences in media content and public reactions to the September 11th terrorist attacks. Journal of Broadcasting & Electronic Media47 (3): 309–27.
11.
ChongDennisDruckmanJames N.2010. Dynamic public opinion: Communication effects over time. American Political Science Review104 (4): 663–80.
12.
ChongDennisDruckmanJames N.2013. Counterframing effects. The Journal of Politics75 (1): 1–16.
13.
ConoverPamela JohnstonFeldmanStanley. 1986. Emotional reactions to the economy: I’m mad as hell and I’m not going to take it anymore. American Journal of Political Science30 (1): 50–78.
14.
DamasioAntonio. 1994. Descartes’ error: Emotion, reason, and the human brain. New York, NY: Penguin.
15.
DruckmanJames N.HennessyCari LynnSt. CharlesKristiWebberJonathan. 2010. Competing rhetoric over time: Frames versus cues. The Journal of Politics72 (1): 136–48.
16.
DruckmanJames N.McDermottRose. 2008. Emotion and the framing of risky choice. Political Behavior30 (3): 297–321.
17.
ElsterJon. 1999. Alchemies of the mind: Rationality and the emotions. Cambridge: Cambridge University Press.
18.
ForgasJoseph P.1995. Mood and judgment: The affect infusion model (AIM). Psychological Bulletin117 (1): 39–66.
19.
FournierPatrickCutleraFredSorokaStuartStolleDietlindBélangerÉric. 2013. Riding the orange wave: Leadership, values, issues, and the 2011 Canadian election. Canadian Journal of Political Science46 (4): 863–97.
20.
GeerJohn G.2008. In defense of negativity: Attack ads in presidential campaigns. Chicago, IL: University of Chicago Press.
21.
GerbnerGeorge. 1970. Cultural indicators: The case of violence in television drama. The ANNALS of the American Academy of Political and Social Science388 (1): 69–81.
22.
GiassonThierry. 2012. As (not) seen on TV: News coverage of political marketing in Canadian federal elections. In Political marketing in Canada, eds, MarlandAlexGiassonThierryLees-MarshmanJennifer, 175–92. Vancouver, BC: UBC Press.
23.
GolemanDaniel. 2005. Emotional intelligence. New York, NY: Bantam Books.
24.
HuddyLeonieFeldmanStanleyCasseseErin. 2007. On the distinct political effects of anxiety and anger. In The affect effect: Dynamics of emotion in political thinking and behavior, eds. NeumanW. RussellMarcusGeorge E.CriglerAnn N.MacKuenMichael, 202–30. Chicago, IL: University of Chicago Press.
25.
HuddyLeonieFeldmanStanleyTaberCharlesLahavGallya. 2005. Threat, anxiety, and support of antiterrorism policies. American Journal of Political Science49 (3): 593–608.
26.
JustMarion R.CriglerAnn N.NeumanW. Russell. 1996. Cognitive and affective dimensions of political conceptualization. In The psychology of political communication, ed. CriglerAnn N., 133–48. Ann Arbor, MI: University of Michigan Press.
27.
KepplingerHans M.1998. Die Demontage der Politik in der Informationsgesellschaft [The disassembly of politics in the information society]. Freiburg: Alber.
28.
KepplingerHans M.2011. Realitätskonstruktionen [Constructions of reality]. Wiesbaden: VS Verlag.
29.
KinderDonald R.1978. Political person perception: The asymmetrical influence of sentiment and choice on perceptions of presidential candidates. Journal of Personality and Social Psychology36 (8): 859–71.
30.
KushalDaveLawrenceStevePennockDavid M.2003. Mining the peanut gallery: Opinion extraction and semantic classification of product reviews. In Proceedings of the Twelfth International World Wide Web Conference (WWW’03), 519–28. New York, NY: ACM.
31.
LangKurtLangGladys. 1968. Politics and television. Chicago, IL: Quadrangle.
32.
LengauerGünther. 2007. Postmoderne Nachrichtenlogik. Redaktionelle Politikvermittlung in medienzentrierten Demokratien [Postmodernism news logic. Editorial policy mediation in media-centered democracies], 224–34. Wiesbaden: VS Verlag.
33.
LengauerGüntherEsserFrankBerganzaRosa. 2011. Negativity in political news: A review of concepts, operationalizations, and key findings. Journalism13 (2): 1–24.
34.
LernerJennifer S.GonzalezRoxana M.SmallDeborah A.FischhoffBaruch. 2003. Effects of fear and anger on perceived risks of terrorism: A national field experiment. Psychological Science14 (2): 144–50.
35.
LernerJennifer S.KeltnerDacher. 2001. Fear, anger, and risk. Journal of Personality and Social Psychology81:146–59.
36.
LichterS. RobertNoyesRichard E.1996. Good intentions make bad news: Why Americans hate campaign journalism. Lanham, MD: Rowman & Littlefield.
37.
LiuBing. 2012. Sentiment analysis and opinion mining. Synthesis Lectures on Human Language Technologies5 (1): 1–167.
38.
LodgeMiltonTaberCharles S.2013. The rationalizing voter. New York, NY: Cambridge University Press.
39.
LodgeMiltonTaberCharles. 2000. Three steps toward a theory of motivated political reasoning. In Elements of reason: Cognition, choice, and the bounds of rationality, eds. LupiaArthurMcCubbinsMathew D.PopkinSamuel L., 183–213. New York, NY: Cambridge University Press.
40.
MarcusGeorge E.NeumanW. RussellMacKuenMichael. 2000. Affective intelligence and political judgment. Chicago, IL: University of Chicago Press.
41.
MarcusGeorge E.MacKuenMichael B.1993. Anxiety, enthusiasm, and the vote: The emotional underpinnings of learning and involvement during presidential campaigns. American Political Science Review87 (3): 672–85.
42.
MartindaleColin. 1975. Romantic progression: The psychology of literary history. Washington, DC: Hemisphere.
43.
McDermottRose. 2004. The feeling of rationality: The meaning of neuroscientific advances for political science. Perspectives on Politics2 (4): 691–706.
44.
MillerDaniel A.CroninTraceyGarciaAmber L.BranscombeNyla R.2009. The relative impact of anger and efficacy on collective action is affected by feelings of fear. Group Processes & Intergroup Relations12 (4): 445–62.
45.
NeumanW. Russell. 2007. The affect effect: Dynamics of emotion in political thinking and behavior. Chicago, IL: University of Chicago Press.
46.
OttatiVictor C.SteenbergenMarco R.RiggleEllen. 1992. The cognitive and affective components of political attitudes: Measuring the determinants of candidate evaluations. Political Behavior14 (4): 423–42.
47.
PangBoLeeLillian. 2008. Opinion mining and sentiment analysis. Foundations and Trends in Information Retrieval2 (1–2): 1–135.
48.
PangBoLeeLillianVaithyanathanShivakumar. 2002. Thumbs up? Sentiment classification using machine learning techniques. In Proceedings of the ACL-02 conference on empirical methods in natural language processing, vol. 10, 79–86. Stroudsburg, PA: Association for Computational Linguistics.
49.
PattersonThomas E.1994. Out of order. New York, NY: Vintage Books.
50.
PennebakerJames W.FrancisMartha E.BoothRoger J.2001. Linguistic inquiry and word count: LIWC 2001. Mahwah, NJ: Lawrence Erlbaum.
51.
RedlawskDavid P.2006. Feeling politics: Emotion in political information processing. London: Palgrave Macmillan.
52.
RobinsonMichael J.SheehanMargaret A.1983. Over the wire and on TV: CBS and UPI in campaign 80. New York, NY: Russell Sage Foundation.
53.
RudolphThomas J.GanglAmyStevensDan. 2000. The effects of efficacy and emotions on campaign involvement. Journal of Politics62 (4): 1189–97.
54.
SabatoLarry. 1991. Feeding frenzy: How attack journalism has transformed American politics. New York, NY: Free Press.
55.
SearsDavid O.FreedmanJonathan L.1967. Selective exposure to information: A critical review. Public Opinion Quarterly31 (2): 194–213.
56.
SinhaRajita. 1996. Multivariate response patterning of fear and anger. Cognition & Emotion10 (2): 173–98.
57.
SobierajSarahBerryJeffrey M.2011. From incivility to outrage: Political discourse in blogs, talk radio, and cable news. Political Communication28 (1): 19–41.
58.
SorokaStuart N.2006. Good news and bad news: Asymmetric responses to economic information. Journal of Politics68 (2): 372–85.
59.
SorokaStuart N.2012. The gatekeeping function: Distributions of information in media and the real world. Journal of Politics74 (2): 514–28.
60.
SorokaStuart N.2014a. Negativity in democratic politics: Causes and consequences. New York, NY: Cambridge University Press.
61.
SorokaStuart N.2014b. Reliability and validity in automated content analysis. In Communication and language analysis in the corporate world, ed. HartRoderick P., 352–63. Hershey, PA: CGI Global.
62.
SpanovicMarijaLickelBrianDensonThomas F.PetrovicNebojsa. 2010. Fear and anger as predictors of motivation for intergroup aggression: Evidence from Serbia and Republika Srpska. Group Processes & Intergroup Relations13 (6): 725–39.
63.
StonePhilip J.DumphyDexter C.SmithMarshall S.OgilvieDaniel M.1966. The General Inquirer: A computer approach to content analysis. Cambridge, MA: MIT Press.
64.
StrapparavaCarloMihalceaRada. 2008. Learning to identify emotions in text. In Proceedings of the 2008 ACM symposium on applied computing, 1556–60. New York, NY: ACM.
65.
TarnopolskyChristina H.2010. Prudes, perverts, and tyrants: Plato’s Gorgias and the politics of shame. Princeton, NJ: Princeton University Press.
66.
TrusslerMarcSorokaStuart. 2014. Consumer demand for cynical and negative news frames. International Journal of Press/Politics19 (3): 360–79.
67.
TumasjanAndranikSprengerTimm OliverSandnerPhilipp G.WelpeIsabell M.2010. Predicting elections with twitter: What 140 characters reveal about political sentiment. ICWSM10:178–85.
68.
ValentinoNicholas A.BraderTedGroenendykEric W.GregorowiczKryshaHutchingsVincent L.2011. Election night’s alright for fighting: The role of emotions in political participation. Journal of Politics73 (1): 156–70.
69.
WayBaldwin M.MastersRoger D.1996. Political attitudes: Interactions of cognition and affect. Motivation and Emotion20 (3): 205–36.
70.
YoungLoriSorokaStuart N.2012. Affective news: The automated coding of sentiment in political texts. Political Communication29:205–31.
71.
ZajoncRobert B.1980. Feeling and thinking: Preferences need no inferences. American Psychologist35 (2): 151–75.
