Despite the importance of news exposure to political outcomes, news consumption is notoriously difficult to measure, and misreporting news exposure is common. In this study, we compare participants’ news behaviors measured on a news aggregator website with their self-reported story selection immediately after exposure. We find that both individual and contextual characteristics—especially the presence of political cues in news headlines—influence reporting of news story selection. As a result, the news audience profiles differ using self-reported versus behavioral measures, creating two different pictures of news exposure. More attention is needed to improve news measurement strategies to address misreporting and to improve the accuracy of news audience profiles.
AjzenI. (1985). From intentions to actions: A theory of planned behavior. In KuhlJ.BeckmanJ. (Eds.), Action control (pp. 11–39). Berlin, Germany: Springer.
2.
AndersenK.de VreeseC. H.AlbækE. (2016). Measuring media diet in a high-choice environment—Testing the list-frequency technique. Communication Methods and Measures, 10, 81–98.
3.
AraujoT.WonnebergerA.NeijensP.de VreeseC. H. (2017). How much time do you spend online? Understanding and improving the accuracy of self-reported measures of internet use. Communication Methods and Measures, 11, 173–190.
4.
AustinE. W.MuldrowA.AustinB. W. (2016). Examining how media literacy and personality factors predict skepticism toward alcohol advertising. Journal of Health Communication, 21, 600–609.
5.
BakshyE.MessingS.AdamicL. A. (2015). Exposure to ideologically diverse news and opinion on Facebook. Science, 348, 1130–1132.
6.
BarbaI.CassidyR.De LeonE.WilliamsB. J. (2013). Web analytics reveal user behavior: TTU libraries’ experience with Google AnalyticsJournal of Web Librarianship7389–400
7.
BaumM. A. (2002). Sex, lies, and war: How soft news brings foreign policy to the inattentive public. American Political Science Review, 96, 91–109.
8.
BodeL. (2016). Political news in the news feed: Learning politics from social media. Mass Communication and Society, 19, 24–48.
9.
BulgerM.DavisonP. (2018). The promises, challenges, and futures of media literacy. Data & Society Research Institute. Retrieved fromdatasociety.net
10.
CacioppoJ. T.PettyR. E. (1982). The need for cognition. Journal of Personality and Social Psychology, 42, 116–131.
11.
ChongD.DruckmanJ. N. (2012). Dynamics in mass communication effects research. In SemetkoH. A.ScammellM. (Eds.), The Sage handbook of political communication (pp. 307–323). Thousand Oaks, CA: Sage.
12.
CraftS.AshleyS.MakslA. (2016). Elements of news literacy: A focus group study of how teenagers define news and why they consume it. Electronic News, 10, 143–160.
13.
de VreeseC. H.NeijensP. (2016). Measuring media exposure in a changing communications environment. Communication Methods and Measures, 10, 69–80.
14.
DilliplaneS.GoldmanS. K.MutzD. C. (2013). Televised exposure to politics: New measures for a fragmented media environment. American Journal of Political Science, 57, 236–248.
15.
Dvir-GvirsmanS.TsfatiY.Menchen-TrevinoE. (2016). The extent and nature of ideological selective exposure online: Combining survey responses with actual web log data from the 2013 Israeli Elections. New Media & Society, 18, 857–877.
16.
GarrettR. K. (2009). Politically motivated reinforcement seeking: Reframing the selective exposure debate. Journal of Communication, 59, 676–699.
17.
GreenD.PalmquistB.SchicklerE. (2002). Partisan hearts and minds: Political parties and the social identities of voters. Hartford, CT: Yale University Press.
18.
GuessA. M. (2015). Measure for measure: An experimental test of online political media exposure. Political Analysis, 23, 59–75.
GuilbeaultD.BeckerJ.CentolaD. (2018). Social learning and partisan bias in the interpretation of climate trends. Proceedings of the National Academy of Sciences, 115, 9714–9719. DOI: https://doi.org/10.1073/pnas.1722664115.
21.
HardyM. A. (1993). Regression with dummy variables. Newbury Park, CA: Sage.
22.
HargittaiE. (2010). Digital na(t)ives? Variation in internet skills and uses among members of the “net generation.” Sociological Inquiry, 80, 92–113.
23.
HobbsR. (2017). Measuring the digital and media literacy competencies of children and teens. In BlumbergF. C.BrooksP. J. (Eds.), Cognitive development in digital contexts (pp. 253–274). London, England: Academic Press.
24.
JeritJ.BarabasJ.PollockW.BanducciS.StevensD.SchoonveldeM. (2016). Manipulated vs. measured: Using an experimental benchmark to investigate the performance of self-reported media exposure. Communication Methods and Measures, 10, 99–114.
25.
KahnA. S.RatanR.WilliamsD. (2014). Why we distort in self-report: Predictors of self-report errors in video game play. Journal of Computer-Mediated Communication, 19, 1010–1023.
26.
KobayashiT.BoaseJ. (2012). No such effect? The implications of measurement error in self-report measures of mobile communication use. Communication Methods and Measures, 6, 126–143.
27.
MakslA.AshleyS.CraftS. (2015). Measuring news media literacy. Journal of Media Literacy Education, 6, 29–45.
28.
MessingS.WestwoodS. J. (2014). Selective exposure in the age of social media: Endorsements trump partisan source affiliation when selecting news online. Communication Research, 41, 1042–1063.
29.
MetzgerM. J. (2007). Making sense of credibility on the web: Models for evaluating online information and recommendations for future research. Journal of the American Society for Information Science and Technology, 58, 2078–2091.
30.
NelsonJ. L.WebsterJ. G. (2017). The myth of partisan selective exposure: A portrait of the online political news audience. Social Media & Society, 3. Retrieved fromhttps://doi.org/10.1177/2056305117729314
31.
ParkY. J. (2013). Digital literacy and privacy behavior online. Communication Research, 40, 215–236.
32.
PotterW. J. (2018). Media literacy (8th ed.). Thousand Oaks, CA: Sage.
33.
PriceV.ZallerJ. (1993). Who gets the news? Alternative measures of news reception and their implications for research. Public Opinion Quarterly, 57, 133–164.
34.
PriorM. (2003). Any good news in soft news? The impact of soft news preference on political knowledge. Political Communication, 20, 149–171.
35.
PriorM. (2009a). The immensely inflated news audience: Assessing bias in self-reported news. Public Opinion Quarterly, 73, 130–143.
36.
PriorM. (2009b). Improving media effects research through better measurement of news exposure. The Journal of Politics, 71, 893–908.
37.
PriorM. (2013a). The challenge of measuring media exposure: Reply to Dilliplane, Goldman, and Mutz. Political Communication, 30, 620–634.
38.
PriorM. (2013b). Media and political polarization. The Annual Review of Political Science, 16, 101–127.
39.
RevillaM.OchoaC.LoeweG. (2017). Using passive data from a meter to complement survey data in order to study online behavior. Social Science Computer Review, 35, 521–536.
40.
RodriguezC. G.MoskowitzJ. P.SalemR. M.DittoP. H. (2017). Partisan selective exposure: The role of party, ideology and ideological extremity over time. Translational Issues in Psychological Science, 3, 254–271.
41.
ScharkowM. (2016). The accuracy of self-reported Internet use—A validation study using client log data. Communication Methods and Measures, 10, 13–27.
42.
SchwarzN.OysermanD. (2001). Asking questions about behavior: Cognition, communication, and questionnaire construction. American Journal of Evaluation, 22, 127–160.
43.
StroudN. J. (2011). Niche news: The politics of news choice. Oxford, UK: Oxford University Press.
44.
TsfatiY. (2016). A new measure for the tendency to select ideologically congruent political information: Scale development and validation. International Journal of Communication, 10, 26.
45.
TullyM.VragaE. K. (2017). Effectiveness of a news media literacy advertisement in partisan versus nonpartisan online media contexts. Journal of Broadcasting and Electronic Media, 61, 144–162.
46.
VragaE. K.BodeL.SmithsonA. B.Troller-RenfreeS. (2016). Blurred lines: Defining social, news, and political posts on Facebook. Journal of Information Technology & Politics, 13, 272–294.
47.
VragaE. K.BodeL.Troller-RenfreeS. (2016). Beyond self-reports: Using eye-tracking to measure topic and style differences in attention to social media content. Communication Methods and Measures, 10, 149–164.
48.
VragaE. K.TullyM. (2015). Media literacy messages and hostile media perceptions: Processing of nonpartisan versus partisan political information. Mass Communication and Society, 18, 422–448.
49.
VragaE. K.TullyM. (2016). Effective messaging to communicate news media literacy concepts to diverse publics. Communication and the Public, 1, 305–322.
50.
VragaE. K.TullyM. (2017). Engaging with the other side: Using news media literacy messages to reduce selective exposure and avoidance. Paper presented to the National Association for Media Literacy Education, Chicago, IL.
51.
WebsterJ. G.KsiazekT. B. (2012). The dynamics of audience fragmentation: Public attention in an age of digital media. Journal of Communication, 62, 39–56.
52.
WellsC.ThorsonK. (2017). Combining big data and survey techniques to model effects of political content flows in Facebook. Social Science Computer Review, 35, 33–52.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
