As fake news and disinformation continue to proliferate in digital journalism, the development of artificial intelligence (AI) analytics to identify synthetic content inconsistencies is increasingly important. This study explores trained AI analytics’ struggle to detect semantic gaps within AI-generated media. Findings reinforce human semantic capabilities and a direction for detection tools. AI analytics designed for semantic detection-related tasks are evaluated through the application of the Theory of Content Consistency, with insights for combatting social media news truth erosion.
AgarwalA.MittalM.PathakA.GoyalL. M. (2020). Fake news detection using a blend of neural networks: An application of deep learning. SN Computer Science, 1(3), 1–9. https://doi.org/10.1007/s42979-020-00165-4
2.
AhmedS. (2023). Navigating the maze: Deepfakes, cognitive ability, and social media news skepticism. New Media & Society, 25(5), 1108–1129. https://doi.org/10.1177/14614448211019198
3.
AïmeurE.AmriS.BrassardG. (2023). Fake news, disinformation and misinformation in social media: A review. Social Network Analysis & Mining, 13, 30. https://doi.org/10.1007/s13278-023-01028-5
4.
AljabriM.ZagroubaR.ShaahidA., et al. (2023). Machine learning-based social media bot detection: A comprehensive literature review. Social Network Analysis & Mining, 13, 20. https://doi.org/10.1007/s13278-022-01020-5
5.
AsatianiA.MaloPNagbølP.R.PenttinenE.Rinta-KahilaT.SalovaaraA. (2020). Challenges of explaining the behavior of black-box AI systems. MIS Quarterly Executive. 19(4), 7. https://aisel.aisnet.org/misqe/vol19/iss4/7
6.
BuolamwiniJ. (2023). Unmasking AI: my mission to protect what is human in a world of machines. Random House.
7.
CaoY.LiS.LiuY.YanZ.DaiY.YuP.SunL. (2018, August). A comprehensive survey of AI-generated content (AIGC): A history of generative AI from GAN to ChatGPT. Journal of the ACM, 37(4), 111. https://doi.org/10.48550/arXiv.2303.04226
ComitoC.CaropreseL.ZumpanoE. (2023). Multimodal fake news detection on social media: A survey of deep learning techniques. Social Network Analysis & Mining, 13, 101.https://doi.org/10.1007/s13278-023-01104-w
DiakopoulosN. (2019). The algorithms beat: Angles and methods for investigation. In BounegruL.GrayJ. (Eds.), The data journalism handbook: Towards a critical data practice (pp. 219–229). Amsterdam University Press. https://doi.org/10.5117/9789462989511_ch31
12.
DiakopoulosN.KoliskaM. (2017). Algorithmic transparency in the news media. Digital journalism, 5(7), 809-828. https://doi.org/10.1080/21670811.2016.1208053
13.
FahadM.MoallaN.BourasA. (2012). Detection and resolution of semantic inconsistency and redundancy in an automatic ontology merging system. Journal of Intelligent Information Systems, 39, 535–557. https://doi.org/10.1007/s10844-012-0202-y
14.
FletcherR.SchifferesS.ThurmanN. (2020). Building the ‘truthmeter’: Training algorithms to help journalists assess the credibility of social media sources. Convergence, 26(1), 19–34. https://doi.org/10.1177/1354856517714955
GoyanesM. (2020). Antecedents of incidental news exposure: The role of media preference, use and trust. Journalism Practice, 14(6), 714–729. https://doi.org/10.1080/17512786.2019.1631710
17.
GuerreroJ.AlsmadiI. (2022). Synthetic text detection: Systemic literature review. arXiv preprint arXiv:2210.06336.
HeimK.CraftS. (2020). Transparency in journalism. In WilkinsL.ChristiansC.G (Eds.), The Routledge Handbook of Mass Media Ethics (2nd ed., pp. 308–320). Routledge. https://doi-org.libezproxy2.syr.edu/10.4324/9781315545929
20.
HilalM. V.YannawarP.GaikwadA. T. (2017). Image inconsistency detection using histogram of orientated gradient (HOG). 2017 1st International Conference on Intelligent Systems and Information Management (ICISIM), Aurangabad, India (pp. 22–25), https://doi.org/10.1109/ICISIM.2017.8122141
21.
HollensteinN.SchneiderN.WebberB. (2016, May). Inconsistency detection in semantic annotation. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16), pp. 3986–3990.
22.
HuhM.LiuA.OwensA.EfrosA. A. (2018). Fighting fake news: Image splice detection via learned self-consistency. In Proceedings of the European conference on computer vision (ECCV) (pp. 101–117), https://arxiv.org/pdf/1805.04096.pdf
KruegerL. E. (1975). Familiarity effects in visual information processing. Psychological Bulletin (0033-2909), 82(6), 949. https://doi.org/.libezproxy2.syr.edu/10.1037/0033-2909.82.6.949
25.
LiJ. (2023). Not all skepticism is “healthy” skepticism: Theorizing accuracy- and identity-motivated skepticism toward social media misinformation. New Media & Society, 27(1), 522–544. https://doi.org/10.1177/14614448231179941
26.
LinardatosP.PapastefanopoulosV.KotsiantisS. (2020). Explainable ai: A review of machine learning interpretability methods. Entropy, 23(1), 18. https://doi.org/10.3390/e23010018
27.
LuttrellR.DavisJ.WelchC. (2025). Applying Excellence Theory to the Critical Study of Gender and Socioeconomic Bias in Stable Diffusion Models: Toward Responsible AI in Public Relations. International Journal of Strategic Communication, 1–19. https://doi.org/10.1080/1553118X.2025.2483675
28.
MahaleV.AliM.YannawarP.GaikwadA. (2017). Image inconsistency detection using local binary pattern (LBP). Procedia Computer Science, 115, 501–508. https://doi.org/10.1016/j.procs.2017.09.097
29.
MahaleV.AliM.M.H.YannawarP.L.GaikwadA. (2019). Analysis of Image Inconsistency Based on Discrete Cosine Transform (DCT). In: SatapathyS.JoshiA (Eds.), Information and Communication Technology for Intelligent Systems. Smart Innovation, Systems and Technologies (Vol. 106, pp. 563–571). Springer. https://doi.org/10.1007/978-981-13-1742-2_56
30.
MasiclatS.LuttrellR. (2020). Toward a Theory of Content Consistency. Unpublished manuscript. Syracuse University.
31.
MasoodM.NawazM.MalikK. M.JavedA.IrtazaA.MalikH. (2023). Deepfakes generation and detection: State-of-the-art, open challenges, countermeasures, and way forward. Applied Intelligence, 53(4), 3974–4026. https://doi.org/10.1007/s10489-022-03766-z
32.
McCraeS.WangK.ZakhorA. (2022, March). Multi-modal semantic inconsistency detection in social media news posts. In International Conference on Multimedia Modeling (pp. 331–343). Cham: Springer International Publishing. https://arxiv.org/pdf/2105.12855.pdf
33.
MetzgerM.FlanaginA. A.EyalK.LemusD.MccannR. (2003). Credibility for the 21st century: Integrating perspectives on source, message, and Media credibility in the contemporary Media environment. Annals of the International Communication Association, 27(1), 293–335. https://doi.org/10.1080/23808985.2003.11679029
34.
MirskyY.LeeW. (2021). The creation and detection of deepfakes: A survey. ACM Computing Surveys (CSUR), 54(1), 1–41. https://doi.org/10.1145/3425780
35.
MoonY. E.LewisS. C. (2024). Social Media as commodifier or homogenizer? Journalists’ social media use in individualistic and collectivist cultures and its implications for epistemologies of news production. Digital Journalism, 13(3), 584–603. https://doi.org/10.1080/21670811.2024.2303988.
36.
Mosqueira-ReyE.Hernández-PereiraE.Alonso-RíosD.Bobes-BascaránJ.Fernández-LealÁ (2023). Human-in-the-loop machine learning: A state of the art. Artificial Intelligence Review, 56(4), 3005–3054. https://doi.org/10.1007/s10462-022-10246-w
NgV.LiS. (2023). Multimodal Propaganda Processing. Association for the Advancement of Artificial Intelligence. Human Language Technology Research Institute. Retrieved from https://arxiv.org/pdf/2302.08709.pdf
39.
ParekhZ.BaldridgeJ.CerD.WatersA.YangY. (2021). Crisscrossed captions: Extended intramodal and intermodal semantic similarity judgments for MS-COCO. In Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume (pp. 2855–2870), Online. Association for Computational Linguistics.
40.
PoonA.SungJ. (2021, March 11). Opening the black box of AI-Medicine. Journal of Gastroenterology and Heptalogy, 36(3), 581–584. https://doi.org/10.1111/jgh.15384
41.
ReeseS. D.ShoemakerP. J. (2018). A media sociology for the networked public sphere: The hierarchy of influences model. In Advances in foundational mass communication theories (pp. 96–117). Routledge.
42.
RhodesS. (2022). Filter bubbles, Echo chambers, and fake news: How social Media conditions individuals to be less critical of political misinformation. Political Communication, 39(1), 1–22. https://doi.org/10.1080/10584609.2021.1910887
43.
RudinC.RadinJ. (2019). Why are we using black box models in AI when we don’t need to? A Lesson from an explainable AI competition. Harvard Data Science Review, 1(2). https://doi.org/10.1162/99608f92.5a8a3a3d
ShekharR.PezzelleS.KlimovichY.HerbelotA.NabiM.SanginetoE.BernardiR. (2017). Foil it! find one mismatch between image and language caption. arXiv preprint arXiv:1705.01359
47.
SheuY. H. (2020). Illuminating the black box: interpreting deep neural network models for psychiatric research. Frontiers in Psychiatry, 11, 551299. https://doi.org/10.3389/fpsyt.2020.551299
48.
TanR.PlummerB.SaenkoK. (2020). Detecting cross-modal inconsistency to defend against neural fake news. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) (pp. 2081–2106), Online. Association for Computational Linguistics. https://aclanthology.org/2020.emnlp-main.163/
TandocE.JrYaoJ. L.WuS. (2020). Man vs. Machine? The impact of algorithm authorship on news credibility. Digital Journalism, 8(4), 548–562. https://doi.org/10.1080/21670811.2020.1762102
52.
TsfatiY. (2010). Online news exposure and trust in the mainstream Media: Exploring possible associations. The American Behavioral Scientist (Beverly Hills) (0002-7642), 54(1), 22. https://doi.org/10.1177/0002764210376
53.
TsfatiY.CappellaJ. N. (2003). Do people watch what they do not trust? Exploring the association between news media skepticism and exposure. Communication research, 30(5), 504–529. https://doi.org/10.1177/0093650203253371
54.
TurekM.. (2019). Semantic forensics (SemaFor). [PowerPoint Slides]. Google Drive. https://drive.google.com/file/d/10GRDGB3E-GvJDoo9dZOHtQtwTUn7yobd/view?usp=sharing
55.
VaccariC.ChadwickA. (2020). Deepfakes and disinformation: Exploring the impact of synthetic political video on deception, uncertainty, and trust in news. Social media society, 6(1), 2056305120903408.
56.
VragaE. K.TullyM. (2021). News literacy, social media behaviors, and skepticism toward information on social media. Information, Communication & Society, 24(2), 150–166. https://doi.org/10.1080/1369118X.2019.1637445
57.
WischmeyerT. (2020). Artificial Intelligence and Transparency: Opening the Black Box. In: WischmeyerT.RademacherT. (Eds.), Regulating Artificial Intelligence (pp. 75–101). Springerhttps://doi.org/10.1007/978-3-030-32361-5_4
58.
XueJ.WangY.TianY.LiY.ShiL.WeiL. (2021 May 3). Detecting fake news by exploring the consistency of multimodal data. National Library of Medicine, 58(5), 102610. https://doi.org/10.1016/j.ipm.2021.102610
59.
YangJ.LuttrellR. (2022). Digital misinformation & disinformation: The global war of words. In: J.H. Lipschultz, K. Freberg, and R. Luttrell (Eds.), The emerald handbook of computer-mediated communication and social media (pp. 511–529). Emerald Publishing Limited. https://doi.org/10.1108/978-1-80071-597-420221030
