Sensitivity to misinformation retractions in the continued influence paradigm: Evidence for stability

Abstract

Research has consistently shown that misinformation can continue to affect inferential reasoning after a correction. This phenomenon is known as the continued influence effect (CIE). Recent studies have demonstrated that CIE susceptibility can be predicted by individual differences in stable cognitive abilities. Based on this, it was reasoned that CIE susceptibility ought to have some degree of stability itself; however, this has never been tested. The current study aimed to investigate the temporal stability of retraction sensitivity, arguably a major determinant of CIE susceptibility. Participants were given parallel forms of a standard CIE task 4 weeks apart, and the association between testing points was assessed with an intra-class correlation coefficient and confirmatory factor analysis. Results suggested that retraction sensitivity is relatively stable and can be predicted as an individual-differences variable. These results encourage continued individual-differences research on the CIE and have implications for real-world CIE intervention.

Keywords

Misinformation continued influence susceptibility CFA individual differences

Get full access to this article

View all access options for this article.

References

Arbuckle

J. L.

(2019). IBM SPSS Amos 26 user’s guide. IBM.

Ayers

M. S.

Reder

L. M.

(1998). A theoretical review of the misinformation effect: Predictions from an activation-based memory model. Psychonomic Bulletin & Review, 5(1), 1–21. https://doi.org/10.3758/BF03209454

Baadte

Dutke

(2013). Learning about persons: The effects of text structure and executive capacity on conceptual change. European Journal of Psychology of Education, 28(3), 1045–1064. https://doi.org/10.1007/s10212-012-0153-2

Basol

Roozenbeek

van der Linden

(2020). Good news about bad news: Gamified inoculation boosts confidence and cognitive immunity against fake news. Journal of Cognition, 3(1), 2. https://doi.org/10.5334/joc.91

Bishara

A. J.

Hittner

J. B.

(2012). Testing the significance of a correlation with non-normal data: Comparison of Pearson, Spearman, transformation, and resampling approaches. Psychological Methods, 17(3), 399–417. https://doi.org/10.1037/a0028087

Blair

I. V.

Lenton

A. P.

Hastie

(2002). The reliability of the DRM paradigm as a measure of individual differences in false memories. Psychonomic Bulletin & Review, 9(3), 590–596. https://doi.org/10.3758/BF03196317

Bonetto

Troïan

Varet

Lo Monaco

Girandola

(2018). Priming resistance to persuasion decreases adherence to conspiracy theories. Social Influence, 13(3), 125–136. https://doi.org/10.1080/15534510.2018.1471415

Boomsma

Hoogland

J. J.

(2001). The robustness of LISREL modeling revisited. In Cudeck

du Toit

Sörbom

(Eds.), Structural equation modeling: Present and future. A Festschrift in honor of Karl Jöreskog (pp. 139–168). Scientific Software International. http://aboomsma.webhosting.rug.nl/csadata/boomsma_hoogland_2001.pdf

Brydges

C. R.

Gignac

G. E.

Ecker

U. K. H.

(2018). Working memory capacity, short-term memory capacity, and the continued influence effect: A latent-variable analysis. Intelligence, 69, 117–122. https://doi.org/10.1016/j.intell.2018.03.009

10.

Burnham

K. P.

Anderson

D. R.

(2002). Model selection and multimodel inference: A practical information-theoretic approach (2nd ed.). Springer.

11.

Caruso

J. C.

(2004). A comparison of the reliabilities of four types of difference scores for five cognitive assessment batteries. European Journal of Psychological Assessment, 20(3), 166–171. https://doi.org/10.1027/1015-5759.20.3.166

12.

Chan

M. P. S.

Jones

C. R.

Hall Jamieson

Albarracín

(2017). Debunking: A meta-analysis of the psychological efficacy of messages countering misinformation. Psychological Science, 28(11), 1531–1546. https://doi.org/10.1177/0956797617714579

13.

Chang

E. P.

Ecker

U. K. H.

Page

A. C.

(2019). Not wallowing in misery—Retractions of negative misinformation are effective in depressive rumination. Cognition and Emotion, 33(5), 991–1005. https://doi.org/10.1080/02699931.2018.1533808

14.

Clayton

Blair

Busam

J. A.

Forstner

Glance

Green

Kawata

Kovvuri

Martin

Morgan

Sandhu

Sang

Scholz-Bright

Welch

A. T.

Wolff

A. G.

Zhou

Nyhan

(2019). Real solutions for fake news? Measuring the effectiveness of general warnings and fact-check tags in reducing belief in false stories on social media. Political Behavior, 42, 1073–1095. https://doi.org/10.1007/s11109-019-09533-0

15.

Cook

(2017). Understanding and countering climate science denial. Journal & Proceedings of the Royal Society of New South Wales, 150(465–466), 207–219.

16.

Cook

Bedford

Mandia

(2014). Raising climate literacy through addressing misinformation: Case studies in agnotology-based learning. Journal of Geoscience Education, 62(3), 296–306. https://doi.org/10.5408/13-071.1

17.

Cook

Lewandowsky

Ecker

U. K. H.

(2017). Neutralizing misinformation through inoculation: Exposing misleading argumentation techniques reduces their influence. PLOS ONE, 12(5), Article e0175799. https://doi.org/10.1371/journal.pone.0175799

18.

Cronbach

L. J.

Furby

(1970). How we should measure “change”: Or should we? Psychological Bulletin, 74(1), 68–80. https://doi.org/10.1037/h0029382

19.

De keersmaecker

Roets

(2017). “Fake news”: Incorrect, but hard to correct. The role of cognitive ability on the impact of false information on social impressions. Intelligence, 65, 107–110. https://doi.org/10.1016/j.intell.2017.10.005

20.

Ecker

U. K. H.

Ang

L. C.

(2019). Political attitudes and the processing of misinformation corrections. Political Psychology, 40(2), 241–260. https://doi.org/10.1111/pops.12494

21.

Ecker

U. K. H.

Antonio

L. M.

(2020). Can you believe it? An investigation into the impact of retraction source credibility on the continued influence effect. PsyArXiv. https://doi.org/10.31234/osf.io/qt4w8

22.

Ecker

U. K. H.

Hogan

J. L.

Lewandowsky

(2017). Reminders and repetition of misinformation: Helping or hindering its retraction? Journal of Applied Research in Memory and Cognition, 6(2), 185–192. https://doi.org/10.1016/j.jarmac.2017.01.014

23.

Ecker

U. K. H.

Lewandowsky

Apai

(2011). Terrorists brought down the plane! No, actually it was a technical fault: Processing corrections of emotive information. Quarterly Journal of Experimental Psychology, 64(2), 283–310. https://doi.org/10.1080/17470218.2010.497927

24.

Ecker

U. K. H.

Lewandowsky

Chang

E. P.

Pillai

(2014). The effects of subtle misinformation in news headlines. Journal of Experimental Psychology: Applied, 20(4), 323–335. http://dx.doi.org/10.1037/xap0000028

25.

Ecker

U. K. H.

Lewandowsky

Fenton

Martin

(2014). Do people keep believing because they want to? Preexisting attitudes and the continued influence of misinformation. Memory & Cognition, 42(2), 292–304. https://doi.org/10.3758/s13421-013-0358-x

26.

Ecker

U. K. H.

Lewandowsky

Swire

Chang

(2011). Correcting false information in memory: Manipulating the strength of misinformation encoding and its retraction. Psychonomic Bulletin & Review, 18(3), 570–578. https://doi.org/10.3758/s13423-011-0065-1

27.

Ecker

U. K. H.

Lewandowsky

Tang

D. T. W.

(2010). Explicit warnings reduce but do not eliminate the continued influence of misinformation. Memory & Cognition, 38(8), 1087–1100. https://doi.org/10.3758/MC.38.8.1087

28.

Ecker

U. K. H.

Sze

B. K.

Andreotta

(2021). Corrections of political misinformation: No evidence for an effect of partisan worldview in a U.S. convenience sample. Philosophical Transactions of the Royal Society B, 376(1822), 20200145. https://doi.org/10.1098/rstb.2020.0145

29.

Enkavi

A. Z.

Eisenberg

I. W.

Bissett

P. G.

Mazza

G. L.

MacKinnon

D. P.

Marsch

L. A.

Poldrack

R. A.

(2019). Large-scale analysis of test–retest reliabilities of self-regulation measures. Proceedings of the National Academy of Sciences of the United States of America, 116(12), 5472–5477. https://doi.org/10.1073/pnas.1818430116

30.

Forgas

J. P.

East

(2008). On being happy and gullible: Mood effects on skepticism and the detection of deception. Journal of Experimental Social Psychology, 44(5), 1362–1367. https://doi.org/10.1016/j.jesp.2008.04.010

31.

Franco

Malhotra

Simonovits

(2014). Publication bias in the social sciences: Unlocking the file drawer. Science, 345(6203), 1502–1505. https://doi.org/10.1126/science.1255484

32.

Gignac

G. E.

(2007). Multi-factor modeling in individual differences research: Some recommendations and suggestions. Personality and Individual Differences, 42(1), 37–48. https://doi.org/10.1016/j.paid.2006.06.019

33.

Gignac

G. E.

(2014). On the inappropriateness of using items to calculate total scale score reliability via coefficient alpha for multidimensional scales. European Journal of Psychological Assessment, 30(2), 130–139. https://doi.org/10.1027/1015-5759/a000181

34.

Gordon

Brooks

J. C. W.

Quadflieg

Ecker

U. K. H.

Lewandowsky

(2017). Exploring the neural substrates of misinformation processing. Neuropsychologia, 106, 216–224. https://doi.org/10.1016/j.neuropsychologia.2017.10.003

35.

Gordon

Ecker

U. K. H.

Lewandowsky

(2019). Polarity and attitude effects in the continued-influence paradigm. Journal of Memory and Language, 108, 104028. https://doi.org/10.1016/j.jml.2019.104028

36.

Guillory

J. J.

Geraci

(2013). Correcting erroneous inferences in memory: The role of source credibility. Journal of Applied Research in Memory and Cognition, 2(4), 201–209. https://doi.org/10.1016/j.jarmac.2013.10.001

37.

Hedge

Powell

Sumner

(2018). The reliability paradox: Why robust cognitive tasks do not produce reliable individual differences. Behavior Research Methods, 50(3), 1166–1186. https://doi.org/10.3758/s13428-017-0935-1

38.

Heyman

Bruninx

Hutchison

K. A.

Storms

(2018). The (un) reliability of item-level semantic priming effects. Behavior Research Methods, 50(6), 2173–2183. https://doi.org/10.3758/s13428-018-1040-9

39.

Hinze

S. R.

Slaten

D. G.

Horton

W. S.

Jenkins

Rapp

D. N.

(2014). Pilgrims sailing the Titanic: Plausibility effects on memory for misinformation. Memory & Cognition, 42(2), 305–324. https://doi.org/10.3758/s13421-013-0359-9

40.

Hoaglin

D. C.

Iglewicz

(1987). Fine-tuning some resistant rules for outlier labeling. Journal of the American Statistical Association, 82(400), 1147–1149. https://doi.org/10.2307/2289392

41.

Hotez

P. J.

(2016). Texas and its measles epidemics. PLOS Medicine, 13(10), Article e1002153. https://doi.org/10.1371/journal.pmed.1002153

42.

Johnson

H. M.

Seifert

C. M.

(1994). Sources of the continued influence effect: When misinformation in memory affects later inferences. Journal of Experimental Psychology: Learning, Memory, and Cognition, 20(6), 1420–1436. http://dx.doi.org/10.1037/0278-7393.20.6.1420

43.

Kaiser

H. F.

Rice

(1974). Little Jiffy, mark IV. Educational and Psychological Measurement, 34(1), 111–117. https://doi.org/10.1177/001316447403400115

44.

Kendeou

Walsh

E. K.

Smith

E. R.

O’Brien

E. J.

(2014). Knowledge revision processes in refutation texts. Discourse Processes, 51(5–6), 374–397. https://doi.org/10.1080/0163853X.2014.913961

45.

Koo

T. K.

M. Y.

(2016). A guideline of selecting and reporting intraclass correlation coefficients for reliability research. Journal of Chiropractic Medicine, 15(2), 155–163. https://doi.org/10.1016/j.jcm.2016.02.012

46.

Lewandowsky

Cook

Ecker

U. K. H.

Albarracín

Amazeen

M. A.

Kendeou

Lombardi

Newman

E. J.

Pennycook

Porter

Rand

D. G.

Rapp

D. N.

Reifler

Roozenbeek

Schmid

Seifert

C. M.

Sinatra

G. M.

Swire-Thompson

van der Linden

Zaragoza

M. S.

(2020). The debunking handbook 2020. https://doi.org/10.17910/b7.1182

47.

Lewandowsky

Ecker

U. K. H.

Seifert

C. M.

Schwarz

Cook

(2012). Misinformation and its correction: Continued influence and successful debiasing. Psychological Science in the Public Interest, 13(3), 106–131. https://doi.org/10.1177/1529100612451018

48.

Lewandowsky

Stritzke

W. G. K.

Oberauer

Morales

(2005). Memory for fact, fiction, and misinformation: The Iraq War 2003. Psychological Science, 16(3), 190–195. https://doi.org/10.1111/j.0956-7976.2005.00802.x

49.

Litman

Robinson

Abberbock

(2017). TurkPrime.com: A versatile crowdsourcing data acquisition platform for the behavioral sciences. Behavior Research Methods, 49(2), 433–442. https://doi.org/10.3758/s13428-016-0727-z

50.

Lombardi

Danielson

R. W.

Young

(2016). A plausible connection: Models examining the relations between evaluation, plausibility, and the refutation text effect. Learning and Instruction, 44, 74–86. https://doi.org/10.1016/j.learninstruc.2016.03.003

51.

Maertens

Anseel

van der Linden

(2020). Combatting climate change misinformation: Evidence for longevity of inoculation and consensus messaging effects. Journal of Environmental Psychology, 70, 101455. https://doi.org/10.1016/j.jenvp.2020.101455

52.

Miyake

Friedman

N. P.

Emerson

M. J.

Witzki

A. H.

Howerter

Wager

T. D.

(2000). The unity and diversity of executive functions and their contributions to complex “frontal lobe” tasks: A latent variable analysis. Cognitive Psychology, 41(1), 49–100. https://doi.org/10.1006/cogp.1999.0734

53.

Nunnally

J. C.

(1970). Introduction to psychological measurement. McGraw-Hill.

54.

Nyhan

Reifler

(2010). When corrections fail: The persistence of political misperceptions. Political Behavior, 32(2), 303–330. https://doi.org/10.1007/s11109-010-9112-2

55.

Osborne

(2010). Arguing to learn in science: The role of collaborative, critical discourse. Science, 328(5977), 463–466. https://doi.org/10.1126/science.1183944

56.

Raftery

A. E.

(1995). Bayesian model selection in social research. Sociological Methodology, 25, 111–163. https://doi.org/10.2307/271063

57.

Rapp

D. N.

Hinze

S. R.

Kohlhepp

Ryskin

R. A.

(2014). Reducing reliance on inaccurate information. Memory & Cognition, 42(1), 11–26. https://doi.org/10.3758/s13421-013-0339-0

58.

Rapp

D. N.

Kendeou

(2007). Revising what readers know: Updating text representations during narrative comprehension. Memory & Cognition, 35(8), 2019–2032. https://doi.org/10.3758/BF03192934

59.

Rich

P. R.

Zaragoza

M. S.

(2016). The continued influence of implied and explicitly stated misinformation in news reports. Journal of Experimental Psychology: Learning, Memory, and Cognition, 42(1), 62–74. https://doi.org/10.1037/xlm0000155

60.

Roozenbeek

van der Linden

(2019). The fake news game: Actively inoculating against the risk of misinformation. Journal of Risk Research, 22(5), 570–580. https://doi.org/10.1080/13669877.2018.1443491

61.

Sanderson

J. A.

Gignac

G. E.

Ecker

U. K.

(2021). Working memory capacity, removal efficiency and event specific memory as predictors of misinformation reliance. Journal of Cognitive Psychology, 33, 518–532. https://doi.org/10.1080/20445911.2021.1931243

62.

Schweizer

(2010). Some guidelines concerning the modeling of traits and abilities in test construction. European Journal of Psychological Assessment, 26(1), 1–2. https://doi.org/10.1027/1015-5759/a000001

63.

Seifert

C. M.

(2002). The continued influence of misinformation in memory: What makes a correction effective? Psychology of Learning and Motivation, 41, 265–294. https://doi.org/10.1016/S0079-7421(02)80009-3

64.

Singh

K. A.

Gignac

G. E.

Brydges

C. R.

Ecker

U. K. H.

(2018). Working memory capacity mediates the relationship between removal and fluid intelligence. Journal of Memory and Language, 101, 18–36. https://doi.org/10.1016/j.jml.2018.03.002

65.

Swire

Berinsky

A. J.

Lewandowsky

Ecker

U. K. H.

(2017). Processing political misinformation: Comprehending the Trump phenomenon. Royal Society Open Science, 4(3), 160802. https://doi.org/10.1098/rsos.160802

66.

Swire

Ecker

U. K. H.

Lewandowsky

(2017). The role of familiarity in correcting inaccurate information. Journal of Experimental Psychology: Learning, Memory, and Cognition, 43(12), 1948–1961. https://doi.org/10.1037/xlm0000422

67.

Swire-Thompson

DeGutis

Lazer

(2020). Searching for the backfire effect: Measurement and design considerations. Journal of Applied Research in Memory and Cognition, 9(3), 286–299. https://doi.org/10.1016/j.jarmac.2020.06.006

68.

Swire-Thompson

Ecker

U. K. H.

Lewandowsky

Berinsky

A. J.

(2020). They might be a liar but they’re my liar: Source evaluation and the prevalence of misinformation. Political Psychology, 41(1), 21–34. https://doi.org/10.1111/pops.12586

69.

Taylor

L. E.

Swerdfeger

A. L.

Eslick

G. D.

(2014). Vaccines are not associated with autism: An evidence-based meta-analysis of case-control and cohort studies. Vaccine, 32(29), 3623–3629. https://doi.org/10.1016/j.vaccine.2014.04.085

70.

Thomas

D. R.

Zumbo

B. D.

(2012). Difference scores from the point of view of reliability and repeated-measures ANOVA: In defense of difference scores for data analysis. Educational and Psychological Measurement, 72(1), 37–43. https://doi.org/10.1177/0013164411409929

71.

Tomarken

A. J.

Waller

N. G.

(2003). Potential problems with “well fitting” models. Journal of Abnormal Psychology, 112(4), 578–598. https://doi.org/10.1037/0021-843X.112.4.578

72.

Trafimow

(2015). A defense against the alleged unreliability of difference scores. Cogent Mathematics, 2(1), 1064626. https://doi.org/10.1080/23311835.2015.1064626

73.

Trevors

Kendeou

(2020). The effects of positive and negative emotional text content on knowledge revision. Quarterly Journal of Experimental Psychology, 73(9), 1326–1339. https://doi.org/10.1177/1747021820913816

74.

Tsfati

Boomgaarden

H. G.

Strömbäck

Vliegenthart

Damstra

Lindgren

(2020). Causes and consequences of mainstream media dissemination of fake news: Literature review and synthesis. Annals of the International Communication Association, 44(2), 157–173. https://doi.org/10.1080/23808985.2020.1759443

75.

van der Linden

Leiserowitz

Rosenthal

Maibach

(2017). Inoculating the public against misinformation about climate change. Global Challenges, 1(2), 1600008. https://doi.org/10.1002/gch2.201600008

76.

Vosoughi

Roy

Aral

(2018). The spread of true and false news online. Science, 359(6380), 1146–1151. https://doi.org/10.1126/science.aap9559

77.

Walter

Murphy

S. T.

(2018). How to unring the bell: A meta-analytic approach to correction of misinformation. Communication Monographs, 85(3), 423–441. https://doi.org/10.1080/03637751.2018.1467564

78.

Walter

Tukachinsky

(2020). A meta-analytic examination of the continued influence of misinformation in the face of correction: How powerful is it, why does it happen, and how to stop it? Communication Research, 47(2), 155–177. https://doi.org/10.1177/0093650219854600

79.

Wang

McKee

Torbica

Stuckler

(2019). Systematic literature review on the spread of health-related misinformation on social media. Social Science & Medicine, 240, 112552. https://doi.org/10.1016/j.socscimed.2019.112552

80.

Wilkes

A. L.

Leatherbarrow

(1988). Editing episodic memory following the identification of error. Quarterly Journal of Experimental Psychology, 40(2), 361–387. https://doi.org/10.1080/02724988843000168

81.

Wood

Porter

(2019). The elusive backfire effect: Mass attitudes’ steadfast factual adherence. Political Behavior, 41(1), 135–163. https://doi.org/10.1007/s11109-018-9443-y

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.44 MB