Restricted accessResearch articleFirst published online 2025-1
Do News Frames Really Have Some Influence in the Real World? A Computational Analysis of Cumulative Framing Effects on Emotions and Opinions About Immigration
This study examines how the news framing of immigration influences the public’s feelings toward immigrants and their preference for immigration policy in the United States. Unlike prior experimental research that documents the respondents’ immediate reactions to several hand-crafted news frames, this study provides strong empirical evidence for the association between the respondents’ real-world news exposure and their opinion change over time. Combining a computational media content analysis and a two-wave panel survey, the research demonstrates that while exposure to certain frames in the mainstream media would directly lead to public support for a stricter immigration policy, partisan media tend to affect public opinion indirectly by influencing their feelings toward immigrants in opposite directions.
AckermanE. F.2013. The rise of the ‘illegal alien’. Contexts, 12(3): 72–74.
2.
AhnH. M.KimS. A.HwangI. J.JeongJ. W.KimH. T.HamannS.KimS. H.2015. “The Effect of Cognitive Reappraisal on Long-Term Emotional Experience and Emotional Memory.”Journal of Neuropsychology9(1):64–76.
Al-RawiA.2017. “News Values on Social Media: News Organizations’ Facebook Use.”Journalism18(7):871–89.
6.
AlamilloR.HaynesC.MadridR.Jr.2019. “Framing and Immigration Through the Trump Era.”Sociology Compass13(5):e12676.
7.
BennettW. L.IyengarS.2008. “A New Era of Minimal Effects? The Changing Foundations of Political Communication.”Journal of Communication58(4):707–31.
8.
BensonR.2013. Shaping Immigration News: A French-American Comparison. Cambridge: Cambridge University Press.
9.
BosL.LechelerS.MewafiM.VliegenthartR.2016. “It’s the Frame that Matters: Immigrant Integration and Media Framing Effects in the Netherlands.”International Journal of Intercultural Relations55:97–108.
10.
BoydstunA. E.CardD.GrossJ.ResnickP.SmithN. A.2014. “Tracking the Development of Media Frames Within and Across Policy Issues.” Working Paper.
11.
CappellaJ. N.JamiesonK. H.1997. Spiral of Cynicism: The Press and the Public Good. Oxford: Oxford University Press.
12.
CardD.ChangS.BeckerC.MendelsohnJ.VoigtR.BoustanL.AbramitzkyR.JurafskyD.2022. “Computational Analysis of 140 Years of US Political Speeches Reveals More Positive But Increasingly Polarized Framing of Immigration.”Proceedings of the National Academy of Sciences of the United States of America119(31):e2120510119.
13.
ChenH. T.GuoL.SuC. C.2020. “Network Agenda Setting, Partisan Selective Exposure, and Opinion Repertoire: The Effects of Pro-and Counter-Attitudinal Media in Hong Kong. Journal of Communication70(1):35–59.
14.
ChenZ.SuC. C.ChenA.2019. Top-down or Bottom-up? A Network Agenda-Setting Study of Chinese Nationalism on Social Media. Journal of Broadcasting & Electronic Media63(3):512–33.
15.
ChongD.DruckmanJ. N.2010. “Dynamic Public Opinion: Communication Effects Over Time.”American Political Science Review104(4):663–680.
16.
D’angeloP.2002. News Framing as a Multiparadigmatic Research Program: A Response to Entman. Journal of Communication52(4):870–88.
17.
DavlinJ.ChangM. W.LeeK.ToutanovaK.2018. “Bert: Pre-training of Deep Bidirectional Transformers for Language Understanding.” arXiv preprint arXiv:1810.04805.
18.
de HoogN.VerboonP.2020. “Is the News Making Us Unhappy? The Influence of Daily News Exposure on Emotional States.”British Journal of Psychology111(2): 157–173.
19.
De VreeseC. H. 2005. “News Framing: Theory and Typology.”Information Design Journal+ Document Design13(1): 51–62.
20.
DruckmanJ. N.FeinJ.LeeperT. J.2012. “A Source of Bias in Public Opinion Stability.”American Political Science Review106(2): 430–454.
21.
DruckmanJ. N.PetersonE.SlothuusR.2013. “How Elite Partisan Polarization Affects Public Opinion Formation.”American Political Science Review107(1):57–79.
22.
EberlJ. M.MeltzerC. E.HeidenreichT.HerreroB.TheorinN.LindF.BerganzaR.BoomgaardenH. G.SchemerC.StrömbäckJ.2018. “The European Media Discourse on Immigration and Its Effects: A Literature Review.”Annals of the International Communication Association42(3):207–23.
23.
EdgerlyS.2015. “Red Media, Blue Media, and Purple Media: News Repertoires in the Colorful Media Landscape.”Journal of Broadcasting & Electronic Media59(1):1–21.
24.
EkmanP.2007. Emotions Revealed. New York: Owl Books.
25.
EntmanR. M.1993. “Framing—Toward Clarification of a Fractured Paradigm.”Journal of Communication43(4):51–8.
26.
FreedmanJ. L.SearsD. O.1965. “Selective Exposure.”Advances in Experimental Social Psychology2:57–97.
27.
FrybergS. A.StephensN. M.CovarrubiasR., et al. 2012. “How the Media Frames the Immigration Debate: The Critical Role of Location and Politics.”Analyses of Social Issues and Public Policy12(1): 96–112.
28.
GreussingE.BoomgaardenH. G.2017. “Shifting the Refugee Narrative? An Automated Frame Analysis of Europe’s 2015 Refugee Crisis. Journal of Ethnic and Migration Studies43(11):1749–74.
29.
GrimmJ.AndsagerJ. L.2011“Framing Immigration: Geo-ethnic Context in California Newspapers.”Journalism & Mass Communication Quarterly88(4): 771–88.
30.
GuntherA. C.McLaughlinB.GotliebM. R.WiseD.2017. “Who Says What to Whom: Content Versus Source in the Hostile Media Effect.”International Journal of Public Opinion Research29(3):363–83.
31.
GuoL.MaysK. K.Zhang YY.WijayaD.BetkeM.2021. “What Makes Gun Violence a (Less) Prominent Issue? A Computational Analysis of Compelling Arguments and Selective Agenda Setting.”Mass Communication & Society24(5): 651–75.
32.
HasellA.WeeksB. E.2016. “Partisan Provocation: The Role of Partisan News Use and Emotional Responses in Political Information Sharing in Social Media. Human Communication Research42(4): 641–661.
33.
HayesA. F.2022. Introduction to Mediation, Moderation, and Conditional Process Analysis: A Regression-Based Approach. 3rd Edition.New York, NY: Guilford Publications.
34.
HaynesC.MerollaJ.RamakrishnanS. K.2016. Framing Immigrants: News Coverage, Public Opinion, and Policy. New York: Russell Sage Foundation.
35.
IgartuaJ.-J.Moral-ToranzoF.FernándezI.2011. “Cognitive, Attitudinal, and Emotional Effects of News Frame and Group Cues, on Processing News About Immigration.”Journal of Media Psychology: Theories, Methods, and Applications23(4): 174.
36.
Knobloch-WesterwickS.MengJ.2011. “Reinforcement of the Political Self Through Selective Exposure to Political Messages.”Journal of Communication61(2):349–68.
37.
KühneR.SchemerC.2015. “The Emotional Effects of News Frames on Information Processing and Opinion Formation.”Communication Research42(3):387–407.
38.
LahavG.CourtemancheM.2012. “The Ideological Effects of Framing Threat on Immigration and Civil Liberties.”Political Behavior34(3):477–505.
39.
LangA.DhillonK.DongQ.1995. “The Effects of Emotional Arousal and Valence on Television Viewers’ Cognitive Capacity and Memory.”Journal of Broadcasting & Electronic Media39(3):313–27.
40.
LazarusR. S.1991a. “Cognition and Motivation in Emotion.”American Psychologist46(4):352.
41.
LazarusR. S.1991b. Emotion and Adaptation. Oxford: Oxford University Press.
42.
LazarusR. S.FolkmanS.1984. Stress, Appraisal, and Coping. New York: Springer Publishing Company.
43.
LechelerS.De VreeseC. H.2016. “How Long Do News Framing Effects Last? A Systematic Review of Longitudinal Studies. Annals of the International Communication Association40(1): 3–30.
44.
LechelerS.De VreeseC. H.2019. News Framing Effects: Theory and Practice. London: Taylor & Francis.
45.
LechelerS.BosL.VliegenthartR.2015. “The Mediating Role of Emotions: News Framing Effects on Opinions About Immigration.”Journalism & Mass Communication Quarterly92(4):812–38.
46.
LevenduskyM.2013. How Partisan Media Polarize America. Chicago: The University of Chicago Press.
47.
LiuS.GuoL.MaysK.BetkeM.WijayaD. T.2019. “Detecting Frames in News Headlines and Its Application to Analyzing News Framing Trends Surrounding US Gun Violence.” In Proceedings of the 23rd Conference on Computational Natural Language Learning (CoNLL), 504–514. Association for Computational Linguistics.
48.
MaussI. B.RobinsonM. D.2009. “Measures of Emotion: A Review.”Cognition and Emotion23(2):209–37.
49.
MendelsohnJ.BudakC.JurgensD.2021. “Modeling Framing in Immigration Discourse on Social Media.” In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2219–63. Association for Computational Linguistics.
50.
MerollaJ.RamakrishnanS. K.HaynesC.2013. “‘Illegal,’ ‘undocumented,’ or ‘unauthorized’: Equivalency Frames, Issue Frames, and Public Opinion on Immigration.”Perspectives on Politics11(3):789–807.
MutzD. C.2002. “Cross-cutting Social Networks: Testing Democratic Theory in Practice.”American Political Science Review96(1):111–26.
53.
MutzD. C.2006. Hearing the Other Side: Deliberative Versus Participatory Democracy. Cambridge: Cambridge University Press.
54.
NabiR. L.2009. “Emotion and Persuasion: A Social Cognitive Perspective.” In: Communication and Social Cognition, ed. NabiR. L., 389–410. London: Routledge.
PriceV.TewksburyD.1997. “News Values and Public Opinion: A Theoretical Account of Media Priming and Framing.” In Progress in Communication Sciences: Advances in Persuasion, eds. BarettG. A.BosterF. J., 173–212. Greenwich, CT: Ablex.
58.
QuinsaatS.2014. “Competing News Frames and Hegemonic Discourses in the Construction of Contemporary Immigration and Immigrants in the United States.”Mass Communication and Society17(4): 573–96.
59.
ReidS. A.2012. “A Self-Categorization Explanation for the Hostile Media Effect.”Journal of Communication62(3):381–99.
60.
RösslerP.1999. “The Individual Agenda-Designing Process: How Interpersonal Communication, Egocentric Networks, and Mass Media Shape the Perception of Political Issues by Individuals. Communication Research26(6):666–700.
61.
SchmittK. M.GuntherA. C.LiebhartJ. L.2004. “Why Partisans See Mass Media as Biased. Communication Research31(6):623–41.
62.
SemetkoH. A.ValkenburgP. M.2000. “Framing European Politics: A Content Analysis of Press and Television News.”Journal of Communication50(2):93–109.
63.
ShehataA.StrömbäckJ.2013. “Not (yet) a New Era of Minimal Effects: A Study of Agenda Setting at the Aggregate and Individual Levels. International Journal of Press/Politics18(2):234–55.
StroudN. J.2011. Niche News: The Politics of News Choice. Oxford: Oxford University Press on Demand.
66.
SunX.CheungY. L.2022. “Portrayal of China in Online News Headlines: A Framing and Syntactic Analysis.”Journalism Studies23:2015–2037.
67.
TaberC. S.LodgeM.2006. “Motivated Skepticism in the Evaluation of Political Beliefs.”American Journal of Political Science50(3): 755–69.
68.
TankardJ. W.HendricksonL.SilbermanJ.BlissK.GhanemS.1991. “Media Frames: Approaches to Conceptualization and Measurement.” In The Association for Education in Journalism and Mass Communication annual Conference, Boston, Massachusetts, Association for Education in Journalism and Mass Communication.
69.
TewksburyD.ScheufeleD. A.2019. “News Framing Theory and Research.” In Media Effects, eds. OliverM. B.RaneyA. A.BryantJ., 51–68. London: Routledge.
70.
TheorinN.MeltzerC. E.GalygaS.StrömbäckJ.SchemerC.EberlJ. M.LindF.HeidenreichT.BoomgaardenH. G. 2021. “Does News Frame Affect Free Movement Attitudes? A Comparative Analysis.”Journalism & Mass Communication Quarterly98(3): 725–48.
71.
TourniI.GuoL.DaryantoT. H.ZhafransyahF.HalimE. E.JalalM.ChenB.LaiS.HuH.BetkeM.IshwarP.WijayaD. T. 2021. “Detecting Frames in News Headlines and Lead Images in US Gun Violence Coverage.” In Findings of the Association for Computational Linguistics: EMNLP2021, 4037–50. Association for Computational Linguistics.
72.
Van GorpB. 2005. “Where Is the Frame? Victims and Intruders in the Belgian Press Coverage of the Asylum Issue.”European Journal of Communication20(4):484–507.
73.
WojcieszakM.BimberB.FeldmanL.StroudN. J.2016. Partisan news and political participation: Exploring mediated relationships. Political Communication33(2): 241–60.
74.
WojcieszakM. E.MutzD. C.2009. “Online Groups and Political Discourse: Do Online Discussion Spaces Facilitate Exposure to Political Disagreement?Journal of Communication59(1):40–56.
75.
ZhangY.2021. “‘What I Tweet is Not What I Think’: Towards a Comprehensive Multi-Version Two-way Agenda-setting Framework.” Doctoral dissertation, Boston University.
76.
ZhuQ.WeeksB. E.KwakN.2021. “Implications of Online Incidental and Selective Exposure for Political Emotions: Affective Polarization During Elections.”New Media & Society. Published online December 7. doi:10.1177/14614448211061336.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
