A Theory-Driven Approach to Fake News/Information Disorder Analysis and Explanation via Target-Based Emotion–Stance Analysis (TESA) and Interpretive Graph Generation (IGG)

Abstract

Information disorder (IDO) presents a persistent challenge to society, necessitating innovative approaches to understanding its dynamics beyond just merely detecting it. This study introduces a theory-driven framework that integrates advanced natural language processing (NLP) with deep learning, utilizing the target-based emotion–stance analysis (TESA) approach to analyze emotion and stance dynamics within IDO content. Complementing TESA, interactive graph generation (IGG) is applied for scalable and interpretable qualitative analyses. Employing a mixed-methods approach, the study leverages TESA for target-centric emotion and stance analysis, evaluating target-based classifiers on both human-annotated and synthetic datasets. Additionally, the study explores synthetic data generation using generative AI to enrich the analysis, applying IGG to map complex data interactions. The study also found that integrating synthetic data developed from human annotations enhanced model performance, particularly for emotion classification tasks. Results demonstrate that IDO narratives significantly differ from non-IDO narratives, frequently leveraging negative emotions such as anger and disgust to manipulate public perception. TESA proved effective in capturing these nuanced variations, while IGG facilitated the triangulation of such findings via the scalable interpretation of emotional narratives, revealing that IDO content often amplifies polarizing and antagonistic perspectives. By combining TESA and IGG, this research emphasizes the importance of using NLP to extract and examine the emotional and stance nuances toward targets of interest within IDO context. This approach not only deepens theoretical insights into IDO’s persuasive mechanisms but also supports the development of practical tools for analyzing and managing the influence of IDO on public discourse.

Keywords

fake news information disorder sentiment analysis stance analysis Generative AI NLP aspect-based sentiment analysis

Get full access to this article

View all access options for this article.

References

Abdelminaam

D. S.

Ismail

F. H.

Taha

Houssein

E. H.

Nabil

(2021). CoAID-DEEP: An optimized intelligent framework for automated detecting COVID-19 misleading information on Twitter. IEEE Access: Practical Innovations, Open Solutions, 9(1), 27840–27867. https://doi.org/10.1109/ACCESS.2021.3058066

ALDayel

Magdy

(2021). Stance detection on social media: State of the art and trends. Information Processing & Management, 58(4), Article 102597. https://doi.org/10.1016/j.ipm.2021.102597

Arif

Stewart

L. G.

Starbird

(2018). Acting the part: Examining information operations within #BlackLivesMatter discourse. Proceedings of the ACM on Human-Computer Interaction, 2(CSCW), 20–27. https://doi.org/10.1145/3274289

Baele

S. J.

Boyd

Coan

T. G.

Naserian

(2023). Lethal words: An integrated model of violent extremists’ language. Studies in Conflict & Terrorism, 1–26. https://doi.org/10.1080/1057610X.2023.2213963

Berger

Milkman

K. L.

(2012). What makes online content viral? Journal of Marketing Research, 49(2), 192–205. https://doi.org/10.1509/jmr.10.0353

Biggiogera

Boateng

Hilpert

Vowels

Bodenmann

Neysari

Nussbeck

Kowatsch

(2021). BERT meets LIWC: Exploring state-of-the-art language models for predicting communication behavior in couples’ conflict interactions. In: Companion Publication of the 2021 International Conference on Multimodal Interaction (pp. 385–389). ACM. https://doi.org/10.1145/3461615.3485423

Boyd

R. L.

Schwartz

H. A.

(2021). Natural language analysis and the psychology of verbal behavior: The past, present, and future states of the field. Journal of Language and Social Psychology, 40(1), 21–41. https://doi.org/10.1177/0261927X20967028

Chau

Wong

Chow

Fung

C.-H. F.

(2014). Social judgment theory based model on opinion formation, polarization and evolution. Physica A: Statistical Mechanics and its Applications, 415(1), 133–140. https://doi.org/10.1016/j.physa.2014.07.082

Chen

X. K.

J.-C.

Tan

L. K.-W.

Chong

Choy

(2022). Exploring how online responses change in response to debunking messages about COVID-19 on WhatsApp. Online Information Review, 46(6), 1184–1204. https://doi.org/10.1108/OIR-08-2021-0422

10.

Chen

X. K.

Neo

L. S.

Ang

Lee

J. Y.

Ong

Khader

(2022). The nexus between information disorder and terrorism: A mix of machine learning approach and content analysis on 39 terror attacks. Dynamics of Asymmetric Conflict, 15(3), 1–20. https://doi.org/10.1080/17467586.2022.2055097

11.

Conforti

Pilehvar

M. T.

Collier

(2018). Towards automatic fake news detection: Cross-level stance detection in news articles. In Proceedings of the first Workshop on fact extraction and VERification (FEVER) (pp. 40–49). Association for Computational Linguistics. https://doi.org/10.18653/v1/W18-5507

12.

Cui

Wang

S.-B.

Cambria

(2023). Survey on sentiment analysis: Evolution of research methods and topics. Artificial Intelligence Review, 56(8), 8469–8510. https://doi.org/10.1007/s10462-022-10386-z

13.

Davoudi

Moosavi

M. R.

Hadi Sadreddini

(2022). DSS: A hybrid deep model for fake news detection using propagation tree and stance network. Expert Systems with Applications, 198(1), Article 116635. https://doi.org/10.1016/j.eswa.2022.116635

14.

de los Santos

T. M.

Nabi

R. L.

(2019). Emotionally charged: Exploring the role of emotion in online news information seeking and processing. Journal of Broadcasting & Electronic Media, 63(1), 39–58. https://doi.org/10.1080/08838151.2019.1566861

15.

H. H.

Prasad

Maag

Alsadoon

(2019). Deep learning for aspect-based sentiment analysis: A comparative review. Expert Systems with Applications, 118(2), 272–299. https://doi.org/10.1016/j.eswa.2018.10.003

16.

Ekman

(1992). An argument for basic emotions. Cognition & Emotion, 6(3-4), 169–200. https://doi.org/10.1080/02699939208411068

17.

Ellsworth

P. C.

Smith

C. A.

(1988). From appraisal to emotion: Differences among unpleasant feelings. Motivation and Emotion, 12(3), 271–302. https://doi.org/10.1007/BF00993115

18.

Ford

B. Q.

Tamir

Gagnon

S. A.

Taylor

H. A.

Brunyé

T. T.

(2012). The angry spotlight: Trait anger and selective visual attention to rewards. European Journal of Personality, 26(2), 90–98. https://doi.org/10.1002/per.1840

19.

Gaspar

Pedro

Panagiotopoulos

Seibt

(2016). Beyond positive or negative: Qualitative sentiment analysis of social media reactions to unexpected stressful events. Computers in Human Behavior, 56(1), 179–191. https://doi.org/10.1016/j.chb.2015.11.040

20.

Gasper

Spencer

L. A.

(2019). Does neutral affect exist? How challenging three beliefs about neutral affect can advance affective research. Frontiers in Psychology, 10(1), 2476. https://doi.org/10.3389/fpsyg.2019.02476

21.

Goodall

C. E.

Slater

M. D.

Myers

T. A.

(2013). Fear and anger responses to local news coverage of alcohol-related crimes, accidents, and injuries: Explaining news effects on policy support using a representative sample of messages and people. Journal of Communication, 63(2), 373–392. https://doi.org/10.1111/jcom.12020

22.

Guerini

Staiano

(2015). Deep feelings: A massive cross-lingual study on the relation between emotions and virality. In Proceedings of the 24th international conference on world wide web (pp. 299–305). ACM.

23.

Guo

Zeng

Tang

Zhao

(2023). Interpretable fake news detection with graph evidence. In Proceedings of the 32nd ACM international conference on information and knowledge management (pp. 659–668). ACM. https://doi.org/10.1145/3583780.3614936

24.

Hamed

S. K.

Ab Aziz

M. J.

Yaakub

M. R.

(2023). A review of fake news detection approaches: A critical analysis of relevant studies and highlighting key challenges associated with the dataset, feature representation, and data fusion. Heliyon, 9(10), Article e20382. https://doi.org/10.1016/j.heliyon.2023.e20382

25.

Hardalov

Arora

Nakov

Augenstein

(2021). A survey on stance detection for Mis- and disinformation identification. arXiv:2103.00242 [Cs] . https://arxiv.org/abs/2103.00242

26.

Henrickson

Meroño-Peñuela

(2023). Prompting meaning: A hermeneutic approach to optimising prompt engineering with ChatGPT. AI & SOCIETY. https://doi.org/10.1007/s00146-023-01752-8

27.

Horner

C. G.

Galletta

Crawford

Shirsat

(2021). Emotions: The unexplored fuel of fake news on social media. Journal of Management Information Systems, 38(4), 1039–1066. https://doi.org/10.1080/07421222.2021.1990610

28.

Mao

Zhang

(2024). An overview of fake news detection: From a new perspective. Fundamental Research, 5(1), 332–346. https://doi.org/10.1016/j.fmre.2024.01.017

29.

E. J.

Shen

Wallis

Allen-Zhu

Wang

Chen

(2021). LoRA: Low-rank adaptation of large language models. (arXiv:2106.09685). arXiv. https://doi.org/10.48550/arXiv.2106.09685

30.

Wei

Zhao

(2022). Deep learning for fake news detection: A comprehensive survey. AI Open, 3(1), 133–155. https://doi.org/10.1016/j.aiopen.2022.09.001

31.

Innes

(2020). Techniques of disinformation: Constructing and communicating “soft facts” after terrorism. British Journal of Sociology, 71(2), 284–299. https://doi.org/10.1111/1468-4446.12735

32.

International Fact-Checking Network . (2023). State of the fact-checkers report. https://www.poynter.org/wp-content/uploads/2024/04/State-of-Fact-Checkers-2023.pdf

33.

Iwendi

Mohan

khan

Ibeke

Ahmadian

Ciano

(2022). Covid-19 fake news sentiment analysis. Computers & Electrical Engineering: An International Journal, 101(1), Article 107967. https://doi.org/10.1016/j.compeleceng.2022.107967

34.

Jowett

G. S.

O’Donnell

(2019). Propaganda & persuasion (7th ed.). Sage.

35.

Khaldarova

Pantti

(2016). Fake News: The narrative battle over the Ukrainian conflict. Journalism Practice, 10(7), 891–901. https://doi.org/10.1080/17512786.2016.1163237

36.

Kirkwood

Minas

(2020). Approaching fake news at the expense of truth: A psychophysiological study of news on social media. In Proceedings of the 53rd Hawaii international conference on system sciences. https://hdl.handle.net/10125/64486

37.

Köhler

Shahi

G. K.

Struß

J. M.

Wiegand

Siegel

Mandl

Schütz

(2022). Overview of the CLEF-2022 CheckThat! Lab: Task 3 on fake news detection. In CLEF (Working Notes) (pp. 404–421). CEUR.

38.

Küçük

Can

(2020). Stance detection: A survey. ACM Computing Surveys (CSUR). https://doi.org/10.1145/3369026

39.

Lang

(2009). The limited capacity model of motivated mediated message processing (pp. 193–204). The Sage Handbook of Media Processes and Effects.

40.

Lang

Borse

Wise

David

(2002). Captured by the world wide web: Orienting to structural and content features of computer-presented information. Communication Research, 29(3), 215–245. https://doi.org/10.1177/0093650202029003001

41.

Lerner

J. S.

Valdesolo

Kassam

K. S.

(2015). Emotion and decision making. Annual Review of Psychology, 66(1), 799–823. https://doi.org/10.1146/annurev-psych-010213-115043

42.

Wang

Pan

(2023). How does ChatGPT affect fake news detection systems? In Yang

Suhartanto

Wang

Jiang

Zhu

Cui

(Eds.), Advanced data mining and applications (pp. 565–580). Springer. https://doi.org/10.1007/978-3-031-46664-9_38

43.

Liu

(2020). Improving fake product detection with aspect-based sentiment analysis. In Yang

Zhang

L.-J.

(Eds.), Cognitive computing – ICCC 2020 (pp. 39–49). Springer International Publishing. https://doi.org/10.1007/978-3-030-59585-2_4

44.

Lin

S.-Y.

Kung

Y.-C.

Leu

F.-Y.

(2022). Predictive intelligence in harmful news identification by BERT-based ensemble learning model with text sentiment analysis. Information Processing & Management, 59(2), Article 102872. https://doi.org/10.1016/j.ipm.2022.102872

45.

Liu

Zhang

Yang

Thompson

Ananiadou

(2024). Emotion detection for misinformation: A review. Information Fusion, 107(2), Article 102300. https://doi.org/10.1016/j.inffus.2024.102300

46.

Lotto

Jorge

O. S.

Menezes

T. S.

Ramalho

A. M.

Oliveira

T. M.

Bevilacqua

Cruvinel

(2022). Psychophysiological reactions of internet users exposed to fluoride information and disinformation: Protocol for a randomized controlled trial. JMIR Research Protocols, 11(6), Article e39133. https://doi.org/10.2196/39133

47.

Mangrulkar

Gugger

Debut

Belkada

Paul

Bossan

(2022). PEFT: State-of-the-art parameter-efficient fine-tuning methods. https://github.com/huggingface/peft

48.

Manzoor

S. I.

Singla

Nikita (2019). Fake news detection using machine learning approaches: A systematic review. In 2019 3rd international conference on trends in electronics and informatics (ICOEI) (pp. 230–234). ICOEL. https://doi.org/10.1109/ICOEI.2019.8862770

49.

Martel

Pennycook

Rand

D. G.

(2020). Reliance on emotion promotes belief in fake news. Cognitive Research: Principles and Implications, 5(1), 47. https://doi.org/10.1186/s41235-020-00252-3

50.

McDonnell

Owen

J. E.

Bantum

E. O.

(2020). Identification of emotional expression with cancer survivors: Validation of linguistic inquiry and word count. JMIR Formative Research, 4(10), Article e18246. https://doi.org/10.2196/18246

51.

McHugh

M. L.

(2012). Interrater reliability: The kappa statistic. Biochemia Medica, 22(3), 276–282. https://doi.org/10.11613/BM.2012.031

52.

Miles

(2020). Rhetorical methods and metaphor in viral propaganda. In Baines

O’Shaughnessy

Snow

(Eds.), The Sage handbook of propaganda (pp. 155–170). Sage.

53.

Molina

M. D.

Sundar

S. S.

Lee

(2021). “Fake news” is not simply false information: A concept explication and taxonomy of online content. American Behavioral Scientist, 65(2), 180–212. https://doi.org/10.1177/0002764219878224

54.

Moura

Sousa-Silva

Lopes Cardoso

(2021). Automated fake news detection using computational forensic linguistics. In Lecture Notes in Computer Science (pp. 788–800). Springer. https://doi.org/10.1007/978-3-030-86230-5_62

55.

Mridha

M. F.

Keya

A. J.

Hamid

Md. A.

Monowar

M. M.

Rahman

Md. S.

(2021). A comprehensive review on fake news detection with deep learning. IEEE Access, 9(1), 156151–156170. https://doi.org/10.1109/ACCESS.2021.3129329

56.

Musi

Carmi

Reed

Yates

O’Halloran

(2023). Developing misinformation immunity: How to reason-check fallacious news in a human–computer interaction environment. Social Media + Society, 9(1), Article 20563051221150407. https://doi.org/10.1177/20563051221150407

57.

Nabi

R. L.

(2003). Exploring the framing effects of emotion: Do discrete emotions differentially influence information accessibility, information seeking, and policy preference? Communication Research, 30(2), 224–247. https://doi.org/10.1177/0093650202250881

58.

Nirav Shah

Ganatra

(2022). A systematic literature review and existing challenges toward fake news detection models. Social Network Analysis and Mining, 12(1), 168. https://doi.org/10.1007/s13278-022-00995-5

59.

Nowottny

(2025). Multitasking, AI tools and 22,785 words of preparation: How we ‘live fact check.’ Full fact. https://fullfact.org/blog/2025/apr/multitasking-ai-tools-and-22785-words-of-preparation-how-we-live-fact-check/

60.

Osmundsen

Bor

Vahlstrup

P. B.

Bechmann

Petersen

M. B.

(2021). Partisan polarization is the primary psychological motivation behind political fake news sharing on Twitter. American Political Science Review, 115(3), 999–1015. https://doi.org/10.1017/S0003055421000290

61.

Park

H. S.

Levine

T. R.

Kingsley Westerman

C. Y.

Orfgen

Foregger

(2007). The effects of argument quality and involvement type on attitude formation and attitude change: A test of dual-process and social judgment predictions. Human Communication Research, 33(1), 81–102. https://doi.org/10.1111/j.1468-2958.2007.00290.x

62.

Pomerleau

Rao

(2017). FNC-I. Fake News Challenge. https://www.fakenewschallenge.org/

63.

Raisio

Puustinen

Lindell

(2022). #StrongTogether? Qualitative sentiment analysis of social media reactions to disaster volunteering during a forest fire in Finland. Sustainability, 14(7), 3983. https://doi.org/10.3390/su14073983

64.

Saquete

Tomás

Moreda

Martínez-Barco

Palomar

(2020). Fighting post-truth using natural language processing: A review and open challenges. Expert Systems with Applications, 141(1), Article 112943. https://doi.org/10.1016/j.eswa.2019.112943

65.

Schnall

Haidt

Clore

G. L.

Jordan

A. H.

(2008). Disgust as embodied moral judgment. Personality and Social Psychology Bulletin, 34(8), 1096–1109. https://doi.org/10.1177/0146167208317771

66.

Schuff

Barnes

Mohme

Padó

Klinger

(2017). Annotation, modelling and analysis of fine-grained emotions on a stance and sentiment detection corpus. In Proceedings of the 8th Workshop on computational approaches to subjectivity, sentiment and social media analysis (pp. 13–23). Association for Computational Linguistics. https://doi.org/10.18653/v1/W17-5203

67.

Seiter

J. S.

(2009). Social judgment theory. In Littlejohn

Foss

(Eds.), Encyclopedia of communication theory. Sage Publications, Inc. https://doi.org/10.4135/9781412959384.n349

68.

Sharma

Chen

(2024). Curbing falsehoods on WhatsApp and Telegram. In RSIS commentary. https://rsis.edu.sg/wp-content/uploads/2024/06/CO24078.pdf

69.

Shen

Bigsby

(2010). Behavioral activation/inhibition systems and emotions: A test of valence vs. action tendency hypotheses. Communication Monographs, 77(1), 1–26. https://doi.org/10.1080/03637750903514268

70.

Shu

Wang

Lee

Liu

(2020). Mining disinformation and fake news: Concepts, methods, and recent advancements. In Shu

Wang

Lee

Liu

(Eds.), Disinformation, misinformation, and fake news in social media: Emerging research challenges and opportunities (pp. 1–19). Springer International Publishing. https://doi.org/10.1007/978-3-030-42699-6_1

71.

Shushkevich

Alexandrov

Cardiff

(2023). Improving multiclass classification of fake news using BERT-based models and ChatGPT-augmented data. Inventions, 8(5), 5. https://doi.org/10.3390/inventions8050112

72.

Singh

V. K.

Ghosh

Sonagara

(2021). Detecting fake news stories via multimodal analysis. Journal of the Association for Information Science and Technology, 72(1), 3–17. https://doi.org/10.1002/asi.24359

73.

Subho . (2020). Fake news detection challenge KDD 2020. Kaggle. https://kaggle.com/competitions/fakenewskdd2020

74.

Vosoughi

Roy

Aral

(2018). The spread of true and false news online. Science, 359(6380), 1146–1151. https://doi.org/10.1126/science.aap9559

75.

Wardle

Derakhshan

(2017). Information Disorder: Toward an interdisciplinary framework for research and policy making. Council of Europe Report, DGI, 9 .

76.

Xie

Liu

Zhang

Zhu

(2021). SERN: Stance extraction and reasoning network for fake news detection. In ICASSP 2021 - 2021 IEEE international conference on acoustics, speech and signal processing (ICASSP) (pp. 2520–2524). IEEE. https://doi.org/10.1109/ICASSP39728.2021.9414787

77.

Yang

Pentyala

S. K.

Mohseni

Yuan

Linder

Ragan

E. D.

X. (Ben)

(2019). XFake: Explainable fake news detector with visualizations. In The World Wide Web conference, (pp. 3600–3604). ACM. https://doi.org/10.1145/3308558.3314119

78.

Yin

Nan

Wakslak

C. J.

, et al. (2024). AI can help people feel heard, but an AI label diminishes this impact. Proceedings of the National Academy of Sciences, 121(14).

79.

Jiang

Khoo

L. M. S.

Chieu

H. L.

Xia

(2020). Coupled hierarchical transformer for stance-aware rumor verification in social media conversations. In Proceedings of the 2020 conference on empirical methods in Natural Language Processing (EMNLP) (pp. 1392–1401). Association for Computational Linguistics. https://doi.org/10.18653/v1/2020.emnlp-main.108

80.

Zaeem

R. N.

Barber

K. S.

(2020). On sentiment of online fake news. In 2020 IEEE/ACM international conference on advances in social networks analysis and mining (ASONAM) (pp. 760–767). IEEE. https://doi.org/10.1109/ASONAM49781.2020.9381323

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.53 MB