Fact-Checking Effectiveness as a Function of Format and Tone: Evaluating FactCheck.org and FlackCheck.org

Abstract

This experiment explores the role of information format (print vs. video) and tone (humorous–nonhumorous) in shaping message interest and belief correction in the context of political fact-checking (N = 525). To understand the mechanisms by which audience misperceptions may be reduced, this experiment tests the belief-correcting effectiveness of a humorous fact-checking video produced by Flackcheck.org, a long-form FactCheck.org print article on the same topic, a nonhumorous video debunking the same set of claims, an unrelated humorous video, and a non-stimulus control group. Mediating psychological mechanisms (message interest, counterargumentation, message discounting) and message perceptions (message confusion) are explored. Results suggest video (humorous or nonhumorous) is an effective way to reduce audience misperceptions by increasing message attention and reducing confusion.

Keywords

fact-checking motivated reasoning belief correction political communication humor persuasion

Get full access to this article

View all access options for this article.

References

Amazeen

M. A.

(2013, October). Making a difference: A critical assessment of fact-checking in 2012 (New America Foundation Media Policy Initiative Research Paper). Retrieved from https://www.newamerica.org/new-america/making-a-difference/

Amazeen

M. A.

Thorson

Muddiman

Graves

(2016). Correcting political and consumer misperceptions: The effectiveness and effects of rating scale versus contextual correction formats. Journalism & Mass Communication Quarterly. Advance online publication. doi:10.1177/1077699016678186

Anderson

C. A.

Lepper

M. R.

Ross

(1980). Perseverance of social theories: The role of explanation in the persistence of discredited information. Journal of Personality and Social Psychology, 39, 1037-1049.

Baddeley

A. D.

(1999). Essentials of human memory. Hove, UK: Psychology Press.

Banas

J. A.

Dunbar

Rodriguez

Liu

S. J.

(2011). A review of humor in educational settings: Four decades of research. Communication Education, 60, 115-144.

Baum

M. A.

(2005). Talking the vote: Why presidential candidates hit the talk show circuit. American Journal of Political Science, 49, 213-234.

Boukes

Boomgaarden

H. G.

Moorman

de Vreese

C. H.

(2015). At odds: Laughing and thinking? The appreciation, processing, and persuasiveness of political satire. Journal of Communication, 65, 721-744.

Cappella

J. N.

Jamieson

K. H.

(1994). Broadcast adwatch effects a field experiment. Communication Research, 21, 342-365.

Delli Carpini

M. X. D.

Keeter

. (1997). What Americans know about politics and why it matters. New Haven, CT: Yale University Press.

10.

Ecker

U. K.

Lewandowsky

Tang

D. T.

(2010). Explicit warnings reduce but do not eliminate the continued influence of misinformation. Memory & Cognition, 38, 1087-1100.

11.

Elizabeth

(2016, July 7). The week in fact-checking: The fact is, fact-checking can get better. American Press Institute. Retrieved from https://www.americanpressinstitute.org/fact-checking-project/week-fact-checking-fact-fact-checking-can-better/

12.

Finley

(2012, March 12). Bogus bipartisan claims. FactCheck.org. Retrieved from http://www.factcheck.org/2012/03/bogus-bipartisan-claims/

13.

Fishkin

J. S.

(1991). Democracy and deliberation: New directions for democratic reform (Vol. 217). New Haven, CT: Yale University Press.

14.

Flynn

D. J.

Nyhan

Reifler

(2017). The nature and origins of misperceptions: Understanding false and unsupported beliefs about politics. Political Psychology, 38(S1), 127-150.

15.

Gaines

B. J.

Kuklinski

J. H.

Quirk

P. J.

Peyton

Verkuilen

(2007). Same facts, different interpretations: Partisan motivation and opinion on Iraq. Journal of Politics, 69, 957-974.

16.

Galston

W. A.

(2001). Political knowledge, political engagement, and civic education. Annual Review of Political Science, 4, 217-234.

17.

Garrett

R. K.

Nisbet

E. C.

Lynch

E. K.

(2013). Undermining the corrective effects of media-based political fact checking? The role of contextual cues and naïve theory. Journal of Communication, 63, 617-637.

18.

Garrett

R. K.

Weeks

B. E.

(2013, February). The promise and peril of real-time corrections to political misperceptions. In Proceedings of the 2013 Conference on Computer Supported Cooperative Work (pp. 1047-1058). San Antonia, TX: Association for Computing Machinery.

19.

Garrett

R. K.

Weeks

B. E.

Neo

R. L.

(2016). Driving a wedge between evidence and beliefs: How online ideological news exposure promotes political misperceptions. Journal of Computer-Mediated Communication, 21, 331-348.

20.

Graves

Glaisyer

(2012). The fact-checking universe in Spring 2012. Washington, DC: New America Foundation.

21.

Greitemeyer

(2014). Article retracted, but the message lives on. Psychonomic Bulletin & Review, 21, 557-561.

22.

Guenther

C. L.

Alicke

M. D.

(2008). Self-enhancement and belief perseverance. Journal of Experimental Social Psychology, 44, 706-712.

23.

Hart

P. S.

Nisbet

E. C.

(2011). Boomerang effects in science communication: How motivated reasoning and identity cues amplify opinion polarization about climate mitigation policies. Communication Research, 39, 701-723. doi:10.1177/0093650211416646

24.

Hayes

A. F.

Preacher

K. J.

(2014). Statistical mediation analysis with a multicategorical independent variable. British Journal of Mathematical and Statistical Psychology, 67, 451-470.

25.

Herron

York

Corrie

Cole

S. P.

(2006). A comparison study of the effects of a story-based video instructional package versus a text-based instructional package in the intermediate-level foreign language classroom. Calico Journal, 23, 281-307.

26.

Johnson

H. M.

Seifert

C. M.

(1994). Sources of the continued influence effect: When misinformation in memory affects later inferences. Journal of Experimental Psychology: Learning, Memory, and Cognition, 20, 1420-1436.

27.

Kuklinski

J. H.

Quirk

P. J.

Jerit

Schwieder

Rich

R. F.

(2000). Misinformation and the currency of democratic citizenship. Journal of Politics, 62, 790-816.

28.

Kunda

(1990). The case for motivated reasoning. Psychological Bulletin, 108, 480-498.

29.

LaMarre

H. L.

Landreville

K. D.

Young

Gilkerson

(2014). Humor works in funny ways: Examining satirical tone as a key determinant in political humor message processing. Mass Communication and Society, 17, 400-423.

30.

LaMarre

H. L.

Walther

(2013). Ability matters: Testing the differential effects of political news and late-night political comedy on cognitive responses and the role of ability in micro-level opinion formation. International Journal of Public Opinion Research, 25, 303-322.

31.

Lang

(2000). The limited capacity model of mediated message processing. Journal of Communication, 50, 46-70.

32.

Lewandowsky

Ecker

U. K.

Seifert

C. M.

Schwarz

Cook

(2012). Misinformation and its correction continued influence and successful debiasing. Psychological Science in the Public Interest, 13, 106-131.

33.

Mantzarlis

(2016, May 31). Can the worldwide boom in digital fact-checking make the leap to TV? Poynter.org. Retrieved from http://www.poynter.org/2016/can-the-worldwide-boom-in-digital-fact-checking-make-the-leap-to-tv/411668/

34.

Masson

M. E.

Miller

J. A.

(1983). Working memory and individual differences in comprehension and memory of text. Journal of Educational Psychology, 75, 314-318.

35.

Mayer

R. E.

Moreno

(2003). Nine ways to reduce cognitive load in multimedia learning. Educational Psychologist, 38, 43-52.

36.

Nabi

R. L.

Moyer-Gusé

Byrne

(2007). All joking aside: A serious investigation into the persuasive effect of funny social issue messages. Communication Monographs, 74, 29-54.

37.

Nyhan

Reifler

(2010). When corrections fail: The persistence of political misperceptions. Political Behavior, 32, 303-330.

38.

Page

B. I.

(1978). Choices and echoes in presidential elections: Rational man and electoral democracy. Chicago, IL: University of Chicago Press.

39.

Petty

R. E.

Cacioppo

J. T.

(1986). The elaboration likelihood model of persuasion. In Communication and persuasion (pp. 1-24). New York, NY: Springer.

40.

Prior

(2007). Post-broadcast democracy: How media choice increases inequality in political involvement and polarizes elections. Cambridge, UK: Cambridge University Press.

41.

Schmidt

S. R.

(1994). Effects of humor on sentence memory. Journal of Experimental Psychology: Learning, Memory, and Cognition, 20, 953-967.

42.

Stroud

N. J.

(2011). Niche news: The politics of news choice. Oxford, UK: Oxford University Press on Demand.

43.

Taber

C. S.

Lodge

(2006). Motivated skepticism in the evaluation of political beliefs. American Journal of Political Science, 50, 755-769.

44.

Tang

T. L. P.

Austin

M. J.

(2009). Students’ perceptions of teaching technologies, application of technologies, and academic performance. Computers & Education, 53, 1241-1255.

45.

Valentino

N. A.

Hutchings

V. L.

Banks

A. J.

Davis

A. K.

(2008). Is a worried citizen a good citizen? Emotions, political information seeking, and learning via the internet. Political Psychology, 29, 247-273.

46.

Walma van der Molen

J. H.

van der Voort

T. H

. (1997). Children’s recall of television and print news: A media comparison study. Journal of Educational Psychology, 89, 82-91.

47.

Xenos

M. A.

Becker

A. B.

(2009). Moments of zen: Effects of the daily show on information seeking and political learning. Political Communication, 26, 317-332.

48.

Young

D. G.

(2004). Late-night comedy in election 2000: Its influence on candidate trait ratings and the moderating effects of political knowledge and partisanship. Journal of Broadcasting & Electronic Media, 48, 1-22.

49.

Young

D. G.

(2006). Late-night comedy and the salience of the candidates’ caricatured traits in the 2000 election. Mass Communication & Society, 9, 339-366.

50.

Young

D. G.

(2008). The privileged role of the late-night joke: Exploring humor’s role in disrupting argument scrutiny. Media Psychology, 11, 119-142.

51.

Young

D. G.

Holbert

R. L.

Jamieson

K. H.

(2014). Successful practices for the strategic use of political parody and satire: Lessons from the P6 Symposium and the 2012 election campaign. American Behavioral Scientist, 58, 1111-1130.