AI-authored news articles are becoming increasingly relevant, but little is known about how recipients evaluate news credibility attributed to an AI (artificial intelligence) author compared to a human journalist author. Referring to the machine heuristic (Sundar, 2008) and Expectancy Violations Theory (Burgoon, 2015), this study compared articles with AI-author labels to articles with human-author labels and without author labels. It further included AI trust and attitudinal congruence as relevant aspects to impact credibility evaluations of a news article about cannabis legalization. Based on a 2 (direction of arguments: pro vs contra) x 3 (author label: AI vs human vs none) between-subjects experiment with 844 German respondents, a MANCOVA was conducted. While controlling for people’s attitudinal congruence with the article, we found AI-authored articles’ sources evaluated as less credible than the human-authored articles’ sources, but no significant differences compared to those without author labels. News author labels did not affect message credibility evaluations, and AI trust did not have the expected interaction effect with the author labels. However, it directly affected credibility evaluations of the message and source. Furthermore, attitudinal congruence strongly impacted credibility evaluations. Results are discussed and contextualized regarding theoretical and practical implications.
AmazeenMAMuddimanAR (2018) Saving media or trading on trust?Digital Journalism6(2): 176–195.
2.
AppelmanASundarSS (2016) Measuring message credibility. Journalism & Mass Communication Quarterly93(1): 59–79.
3.
BurgoonJK (2015) Expectancy violations theory. In: BergerCRRoloffMEWilsonSR, et al. (eds) The International Encyclopedia of Interpersonal Communication. Hoboken, NJ: Wiley, 1–9.
4.
CarlsonM (2015) The robotic reporter. Digital Journalism3(3): 416–431.
5.
ChaikenS (1980) Heuristic versus systematic information processing and the use of source versus message cues in persuasion. Journal of Personality and Social Psychology39(5): 752–766.
6.
ClerwallC (2014) Enter the robot journalist: users' perceptions of automated content. Journalism Practice8(5): 519–531.
FawziNSteindlNObermaierM, et al. (2021) Concepts, causes and consequences of trust in news media – a literature review and framework. Annals of the International Communication Association45(2): 154–174.
11.
FestingerL (1957) A Theory of Cognitive Dissonance. Redwood City: Stanford University Press.
12.
FlanaginAMetzgerMJ (2017) Digital media and perceptions of source credibility in political communication. In: KenskiKJamiesonKH (eds) The Oxford Handbook of Political Communication. Oxford: Oxford University Press, 417–435.
13.
FletcherRParkS (2017) The impact of trust in the news media on online news consumption and participation. Digital Journalism5(10): 1281–1299.
14.
GierlHStichAStrohmayrM (1997) Einfluß der Glaubwürdigkeit einer Informationsquelle auf die Glaubwürdigkeit der Information. Marketing: ZFP – Journal of Research and Management19(1): 27–31. [Influence of the credibility of an information source on the credibility of the information].
15.
GillespieNLockeySCurtisC, et al. (2023) Trust in Artificial Intelligence: A Global Study. Brisbane: The University of Queensland and KPMG Australia.
16.
GraefeABohlkenN (2020) Automated journalism: a meta-analysis of readers’ perceptions of human-written in comparison to automated news. Media and Communication8(3): 50–59.
17.
GraefeAHaimMHaarmannB, et al. (2018) Readers’ perception of computer-generated news: credibility, expertise, and readability. Journalism19(5): 595–610.
18.
HaimMGraefeA (2017) Automated news. Digital Journalism5(8): 1044–1059.
19.
HauptMFreidankJHaasA (2025) Consumer responses to human-AI collaboration at organizational frontlines: strategies to escape algorithm aversion in content creation. Review of Managerial Science19(2): 377–413.
20.
HenkeJLeissnerLMoehringW (2020) How can journalists promote news credibility? Effects of evidences on trust and credibility. Journalism Practice14(3): 299–318.
21.
HillygusDSLaChapelleT (2022) Diagnosing survey response quality. In: RudolphTJ (ed) Handbook on Politics and Public Opinion. Cheltenham: Edward Elgar Publishing, 10–25.
22.
HofeditzLMirbabaieMHolsteinJ, et al. (2021) Do you trust an AI-journalist? A credibility analysis of news content with AI-authorship. In: Proceedings of the 28th European conference on information systems. Marrakech, Morocco, 14–16 June 2021.
23.
HongJ-WChangH-CHTewksburyD (2024) Can AI become walter cronkite? Testing the machine heuristic, the hostile media effect, and political news written by artificial intelligence. Digital Journalism13: 1–24.
24.
HovlandCIWeissW (1951) The influence of source credibility on communication effectiveness. Public Opinion Quarterly15(4): 635–650.
25.
IyengarSHahnKS (2009) Red media, blue media: evidence of ideological selectivity in media use. Journal of Communication59(1): 19–39.
26.
JiaCJohnsonTJ (2021) Source credibility matters: does automated journalism inspire selective exposure?International Journal of Communication15: 3760–3781.
27.
JiaHAppelmanAWuM, et al. (2024) News bylines and perceived AI authorship: effects on source and message credibility. Computers in Human Behavior: Artificial Humans2(2): 100093.
28.
JungJSongHKimY, et al. (2017) Intrusion of software robots into journalism: the public’s and journalists’ perceptions of news written by algorithms and human journalists. Computers in Human Behavior71: 291–298.
29.
KaplanAHaenleinM (2019) Siri, Siri, in my hand: who’s the fairest in the land? On the interpretations, illustrations, and implications of artificial intelligence. Business Horizons62(1): 15–25.
30.
KiousisS (2001) Public trust or mistrust? Perceptions of media credibility in the information age. Mass Communication & Society4(4): 381–403.
31.
KohringMMatthesJ (2007) Trust in news media. Development and validation of a multidimensional scale. Communication Research34(2): 231–252.
32.
LeinerDJ (2019) Too fast, too straight, too weird: non-reactive indicators for meaningless data in internet surveys. Survey Research Methods13(3): 229–248.
33.
Lermann HenestrosaAKimmerleJ (2024) The effects of assumed AI vs. Human authorship on the perception of a GPT-generated text. Journalism and Media5(3): 1085–1097.
34.
Lermann HenestrosaAKimmerleJ (2025) “Always check important information!” - the role of disclaimers in the perception of AI-generated content. Computers in Human Behavior: Artificial Humans4: 100142.
35.
Lermann HenestrosaAGrevingHKimmerleJ (2023) Automated journalism: the effects of AI authorship and evaluative information on the perception of a science journalism article. Computers in Human Behavior138: 1–11.
36.
LeuppertRBrunsSRaheV, et al. (2024) What’s a news media brand worth? Investigating the effect of cognitive brand representations on recipients’ quality assessment of news articles. Journalism120. Advance online publication. DOI: 10.1177/14648849241285497.
37.
LiuBWeiL (2019) Machine authorship in Situ. Digital Journalism7(5): 635–657.
38.
LongoniCFradkinACianL, et al. (2022) News from generative artificial intelligence is believed less. In: FAccT 22 (ed) 2022 ACM conference on fairness, accountability, and transparency, Seoul Republic of Korea, 21 – 24 June 2022. New York, NY, USA: ACM, 97–106.
39.
MetzgerMJ (2007) Making sense of credibility on the Web: models for evaluating online information and recommendations for future research. Journal of the American Society for Information Science and Technology58(13): 2078–2091.
40.
MetzgerMJFlanaginAJMeddersRB (2010) Social and heuristic approaches to credibility evaluation online. Journal of Communication60(3): 413–439.
41.
MetzgerMJHartsellEHFlanaginAJ (2020) Cognitive dissonance or credibility? A comparison of two theoretical explanations for selective exposure to partisan news. Communication Research47(1): 3–28.
42.
MetzgerLMillerLBaumannM, et al. (2024) Empowering calibrated (Dis-)Trust in conversational agents: a user study on the persuasive power of limitation disclaimers vs. authoritative style. In: Proceedings of the CHI conference on human factors in computing systems, Honolulu HI USA, 11 – 16 May 2024, 1–19.
43.
MontalTReichZ (2017) I, Robot. You, Journalist. Who is the Author? Authorship, bylines and full disclosure in automated journalism. Digital Journalism5(7): 829–849.
NeyaziTAKhai EeTNadafA, et al. (2023) The effect of information seeking behaviour on trust in AI in Asia: the moderating role of misinformation concern. New Media & Society27: 2414–2433.
46.
NgJHRiceKKAnanthCV, et al. (2022) Attitudes about marijuana use, potential risks, and legalization: a single-center survey of pregnant women. Journal of Maternal-Fetal and Neonatal Medicine35(24): 4635–4643.
47.
PettyRECacioppoJT (1986) The elaboration likelihood model of persuasion. Advances in Experimental Social Psychology19(12): 123–205.
48.
SchneiderFMWeinmannC (2023) In need of the devil’s advocate? The impact of cross-cutting exposure on political discussion. Political Behavior45(1): 373–394.
49.
SchneiderFMWeinmannC (2024) Effects of cross-cutting exposure on political discussion. Available at:https://osf.io/cpnzy/(accessed 13 July 2025)
50.
ShinD (2022) How do people judge the credibility of algorithmic sources?AI & Society37(1): 81–96.
51.
SteppatDCastro HerreroLEsserF (2022) Selective exposure in different political information environments - how media fragmentation and polarization shape congruent news use. European Journal of Communication37(1): 82–102.
52.
SundarSS (2008) The main model: a heuristic approach to understanding technology effects on credibility. In: MetzgerMJFlanaginA (eds) Digital Media, Youth, and Credibility. Cambridge: MIT Press, 72–100.
53.
SundarSS (2020) Rise of machine agency: a framework for studying the psychology of human–AI interaction (haii). Journal of Computer-Mediated Communication25(1): 74–88.
54.
SundarSSKimJ (2019) Machine heuristic: when we trust computers more than humans with our personal information. In: Proceedings of the 2019 conference on human factors in computing systems, Glasgow, Scotland, 4–9 May 2019. Paper No, 538.
55.
SundarSSNassC (2001) Conceptualizing sources in online news. Journal of Communication51(1): 52–72.
56.
TandocECYaoLJWuS (2020) Man vs. Machine? The impact of algorithm authorship on news credibility. Digital Journalism8(4): 548–562.
57.
TewariSZabounidisRKothariA, et al. (2021) Perceptions of human and machine-generated articles. Digital Threats: Research and Practice2(2): 1–16.
58.
ToffBSimonFM (2025) Or they could just not use it?”: The dilemma of AI disclosure for audience trust in news. The International Journal of Press/Politics30(4): 881–903. doi: 10.1177/19401612241308697.
59.
TsfatiYCappellaJN (2003) Do people watch what they do not trust?Communication Research30(5): 504–529.
60.
Van DalenA (2012) The algorithms behind the deadlines: how machine-written news redefines the core skills of human journalists. Journalism Practice6(5-6): 648–658.
61.
Van der KaaHKrahmerE (2014) Journalist versus news consumer: The perceived credibility of machine written news. In: Proceedings from the computation + journalism conference, New York NY, USA, 24 - 25 October 2014. Available at:https://pure.uvt.nl/ws/files/4314960/cj2014_session4_paper2.pdf(accessed 13 July 2025).
62.
WaddellTF (2018) A Robot Wrote This? How perceived machine authorship affects news credibility. Digital Journalism6(2): 236–255.
63.
WaddellTF (2019a) Attribution practices for the man-machine marriage: how perceived human intervention, automation metaphors, and byline location affect the perceived bias and credibility of purportedly automated content. Journalism Practice13(10): 1255–1272.
64.
WaddellTF (2019b) Can an algorithm reduce the perceived bias of news? Testing the effect of machine attribution on news readers’ evaluations of bias, anthropomorphism, and credibility. Journalism & Mass Communication Quarterly96(1): 82–100.
65.
WangSHuangG (2024) The impact of machine authorship on news audience perceptions: a meta-analysis of experimental studies. Communication Research51: 1–28.
66.
WangROphirY (2024) Behind the black box: the moderating role of the machine heuristic on the effect of transparency information about automated journalism on hostile media bias perception. Journalism1–19.
67.
WoelkerAPowellTE (2021) Algorithms in the newsroom? News readers’ perceived credibility and selection of automated journalism. Journalism22(1): 86–103.
68.
WojcieszakMThakurAFerreira GonçalvesJF, et al. (2021) Can AI enhance people’s support for online moderation and their openness to dissimilar political views?Journal of Computer-Mediated Communication26(4): 223–243.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
