Abstract
Given that approximately half of Internet users use Facebook to access news, it is no surprise that social media are increasingly seen as a viable source of political information. Despite the fact that the average social media user only clicks on a small fraction of political content available in their News Feed, social media use correlates with political knowledge. From where, then, does this knowledge come? We argue that Facebook’s News Feed itself, with its short article previews, provides enough political information for learning to occur. However, this learning comes with an additional consequence: audiences who only read article previews think they know more than they actually do, especially individuals who are motivated to seek emotions. While we are agnostic to the normative implications of such overconfidence, it is worth noting that similar behaviors are associated with political efficacy, knowledge, and participation.
Introduction
Decades of research shows that exposure to news makes people better informed. Yet these results come from an era when exposure to news meant long-form journalism on television or in newspapers. Today, though, 67% of Americans get their news from social media (Shearer and Gottfriend, 2017). We believe that this has important implications for how people learn about politics. Because most social media users only have a passing engagement with posted news, exposure to political information on social media may simply create the
To do so, we conducted an experiment where we randomly presented subjects with either a full news article, a Facebook News Feed including a preview of that article, or no information at all, and measured how much knowledge they gained about the highlighted issue, as well as how much knowledge they
We believe this disparity in perceived knowledge between high- and low-affective dispositions is important. With 68% of Facebook users using the site for news, Facebook has become an important source of political information (Shearer and Gottfried, 2017). However, much of that news exposure is in the form of headlines or previews: an average user only clicks 7% of the political news stories available in her Feed (Bakshy, Messing and Adamic, 2015). In other words, though social media are seen as a wealth of information, most users only have a passing engagement with posted news. This incongruity creates an opportunity for limited or biased information processing where the bite-sized presentation style of news contributes to affective audiences’ overconfidence in their knowledge of the issues.
Political knowledge, need for affect, and overconfidence
Knowledge about politics is essential to a well-functioning democracy. Citizens must have sufficient knowledge about issues, policies, and candidates in order to make informed decisions. It is no surprise, then, that scholars have studied the relationship between political knowledge and democratic discourse (Delli Carpini and Keeter, 1997), voting (Berelson, Lazarsfeld and McPhee, 1954; Lau and Redlawsk, 2006), political efficacy (Galston, 2001; Jung, Kim and Gil de Zúñiga, 2011; Kenski and Stroud, 2006), and policy preferences (Bartels, 1996; Converse, 1964; Gilens, 2001; Luskin, Fishkin and Jowell, 2002).
Overconfidence in knowledge is often situated in the context of the classic motivated reasoning framework. Here, scholars draw an important distinction between being
Given these different motivations, we do not expect everyone to be equally overconfident in their knowledge. Though we anticipate that individuals vary in the degree to which they are driven by accuracy goals, we want to stress that for some, the
Social media provide a relatively new avenue of research in political knowledge and overconfidence. Previous research has shown exposure to the mass media (Chaffee and Kanihan, 1997) and the Internet (Kenski and Stroud, 2006) can lead to significant gains in political knowledge, but social media differ from traditional media in significant ways. For example, social media facilitate inadvertent exposure to news. A user who logs onto Facebook for diversionary purposes may learn something from information encountered incidentally on her News Feed (Bode, 2016; Feezell, 2018; Kim, Hsu and Gil de Zúñiga, 2013; Mitchell et al., 2013; Karnowski et al., 2017; Oeldorf-Hirsch, 2018), thus mitigating the issue of self-selection associated with watching television or reading a newspaper (Arceneaux and Johnson, 2013). In addition to providing content to audiences who may habitually avoid such information, social networking sites also allow users to interact with posted content in a way not possible with television broadcasts or newspaper articles (see Eveland, 2003). This interaction, usually in the form of endorsements or comments, prompts audiences to read content that they may ignore in traditional media contexts (Anspach, 2017; Messing and Westwood, 2012). Inadvertent exposure and social influence combine to create an opportunity to inform audiences on a wide array of new issues. With this in mind, we hypothesize:
If article previews in the Facebook News Feed can inform users, it is important to understand the effects of these small increases in knowledge. Because individuals with a high need for affect (henceforth, NFA) are more likely to seek out strong emotions (Maio and Esses, 2001), they tend to form strong attitudes (Arceneaux and Vander Wielen, 2013, 2017) and exhibit certainty in the rightness of those attitudes (Britt et al., 2009). Furthermore, we have a similar prediction when we consider epistemic directional goals. We expect that individuals scoring high in NFA will be more overconfident in their knowledge, particularly when only given limited information, as is often the case in Facebook’s News Feed. When asked to consider gains in knowledge, we expect high-NFA individuals to go with their gut reaction, and to be likely to see themselves as knowledgeable even when they are not. Low-NFA individuals, on the other hand, should appreciate that they have only encountered a brief headline and, thus, should be less likely to form overconfident beliefs.
But how does NFA influence overconfidence in other informational situations? When no information is provided (as in a control group), we do not expect NFA to influence people’s perceptions of their own knowledge. Because individuals have no new knowledge gain to which they can react, there will be no gut reaction. We also expect NFA to have less influence when individuals read full news articles, though for different reasons. Providing more information makes it more difficult to overestimate one’s knowledge, as even people without strong accuracy goals learn the facts in information-rich environments (Kunda, 1990: 482–483). Moreover, people tend to adjust their beliefs in accordance with the available facts when they are “presented in a way that ‘hits them between the eyes’” (Kuklinski et al., 2000: 805). Consequently, we expect the differences in overconfidence between low- and high-NFA individuals to attenuate when people read the entire article connected to a post.
Research design
We deployed a survey experiment through Amazon’s Mechanical Turk platform (MTurk) in order to ascertain whether Facebook’s article previews inform audiences, and whether exposure to such posts leads to overconfidence in political knowledge. Because MTurk samples are recruited and surveyed online, they are especially useful for studying social media phenomena. Research from both political science (Berinsky, Huber and Lenz, 2012) and psychology (Buhrmester, Kwang and Gosling, 2011; Paolacci and Chandler, 2014) validate MTurk as a reliable source of data, featuring more diversity than college or other Internet samples (see Online Appendix for descriptive statistics). Any U.S. adult over the age of 18 was eligible for the study, and respondents were paid US$.50 for their participation.
The survey began by measuring subjects’ basic demographic information, including age, education, race, party identification, gender, and income. Embedded within these demographic questions was an attention-check question, and any subjects who failed the attention check (
Following the NFA measure, we then randomly assigned each subject to one of three experimental conditions. The first was the full article condition (Figure 1), in which subjects read an article from

Full article treatment.

GM food article preview used for News Feed treatment.
Our News Feed condition avoided the flaws associated with forced-exposure experimental designs (see Arceneaux and Johnson, 2013), where researchers require subjects to read information they might never encounter in real life. On Facebook, users have little control over the posts that appear in their News Feeds (Bode, 2016), meaning much of the information encountered on the site is done so incidentally (Mitchell et al., 2013). Similarly, our News Feed condition featured a mix of entertainment and informational posts, and drew no particular attention to the GM food post. In this condition, subjects were instructed to select the post they would most likely click if browsing Facebook. This was for informational purposes only, as regardless of choice, subjects did not view the corresponding articles. Of those receiving the News Feed treatment, 92 (28.8%) selected the GM food post, and there were no significant differences in the outcome variables between those who selected the treatment post and those who did not (see Online Appendix).
Following the experimental treatments, we measured subjects’ knowledge of GM foods using six factual questions (see Online Appendix). The answers to five of the six questions could be found in the full article, and three answers could be found in the article’s News Feed preview. To determine each subject’s level of overconfidence, we subtracted the number of correct answers by the number of questions the subject
Results
Figure 3 shows the differences in correct responses for each of the six GM food questions, based on experimental condition. Whether the answers to these questions were available to the subjects depended on the condition they were assigned to. The first set of bars represents the correct responses to the question of which state requires GM foods to be labeled. The answer to this question was not available in any condition, explaining the lack of any statistical difference between the experimental conditions. The answers to the second and third questions shown in Figure 3 were only featured in the full article condition. Roughly 70% of subjects assigned to this condition answered these questions correctly, as opposed to approximately 30% of the News Feed and control groups. Additionally, it should be noted that for these two questions, the difference in correct response rates for the News Feed and control groups was statistically insignificant.

Correct response rates by experimental conditions.
The third set of questions in Figure 3 allowed us to determine whether, as
Table 1 provides evidence that high-NFA individuals are most likely to exhibit such overconfidence (
OLS regressions of GM food knowledge and overconfidence.
Note: standard errors in parentheses; significant coefficients (
Just as interesting as NFA’s influence on the News Feed’s effect is the fact that NFA did not influence overconfidence in the other experimental conditions. In the control group, low- and high-NFA subjects displayed statistically indistinguishable levels of overconfidence. Without any new facts provided, even low-NFA individuals had trouble assessing their knowledge on an issue. Because of this, they were equally likely to overestimate their knowledge of the GM foods issue as high-NFA individuals in the same condition, providing evidence in support of
Finally, it is important to note that NFA is similarly inconsequential in information-rich environments, such as our full article condition. Given a bevy of undisputed facts, subjects

Minimum and maximum need for affect as predictors of overconfidence.
Conclusion
These findings provide evidence that Facebook’s article previews generate knowledge. However, there is a disparity in the effect of this knowledge, as evidenced by the rates of overconfidence. Those who are driven to seek and feel emotion learn something from the article previews, but are seemingly unaware of the limitations of their acquired knowledge. For these individuals, the positive feelings associated with being accurate are likely to be as important as actually being accurate. However, this NFA only influences overconfidence in a “middle ground” information environment; NFA effects do not exist when no information is provided, nor in an information-heavy context.
The motivated reasoning literature (Kunda, 1990) proposes that individuals vary in the degree to which they are motivated by accuracy goals. Those with a high NFA have strong gut reactions, or intuitions, and are not motivated to interrogate their intuitions, whereas those who are highly reflective are willing to second-guess and, if need be, override their intuitions (Stanovich, 2009; Stanovich and West, 2000). While theories of motivated reasoning have been used previously to predict reactions to partisan information, we have employed it here to predict differences in how subjects react to limited information in Facebook’s article previews. Those who are more driven by emotion allow the positive feelings associated with being right to override the need for actual accuracy, thus coming away from limited exposure to information falsely overconfident in their knowledge of the subject matter.
We see these findings as important for two reasons. First, as Facebook is relied upon more and more as a news source (Shearer and Gottfried, 2017), these findings speak to the potential to gain political knowledge from article previews. Facebook users can learn political information by simply scrolling through their News Feeds, and knowledge (or even the
Secondly, however, concern about the quality of information within these previews persists. In light of the recent “fake news” controversies surrounding the 2016 U.S. presidential election, Allcott and Gentzkow (2017) used a database of 156 fake news articles about either Clinton or Trump and found that those articles were shared nearly 40 million times on Facebook in the three months leading up to the election. Additional research indicates that misinformation is frequently found on social media, and Facebook audiences are easily misled by misinformation attached to article previews (Anspach and Carlson, 2018). We would expect this belief in misinformation to be particularly true if the audience exhibits a high NFA (Arceneaux and Vander Wielen, 2013, 2017). Future research should continue to investigate whether emotion can help us understand the spread and influence of fake news. As Facebook is increasingly relied on as a news source, audiences’ overconfidence could be potentially troublesome, especially if the perceived knowledge gain is based on misinformation.
Supplemental Material
Appendix_(resubmission) – Supplemental material for A little bit of knowledge: Facebook’s News Feed and self-perceptions of knowledge
Supplemental material, Appendix_(resubmission) for A little bit of knowledge: Facebook’s News Feed and self-perceptions of knowledge by Nicolas M. Anspach, Jay T. Jennings and Kevin Arceneaux in Research & Politics
Footnotes
Declaration of conflicting interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) received no financial support for the research, authorship, and/or publication of this article.
Supplemental materials
The supplemental files are available at http://journals.sagepub.com/doi/suppl/10.1177/2053168018816189. The replication files are available at ![]()
Notes
Carnegie Corporation of New York Grant
This publication was made possible (in part) by a grant from the Carnegie Corporation of New York. The statements made and views expressed are solely the responsibility of the author.
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
