Sage Journals: Discover world-class research

Abstract

System transparency plays a critical role in user trust and perceived reliability in human-AI decision making scenarios. However, there is no clear consensus on the optimal level of transparency needed for adequately calibrated trust in the system, influenced by the user’s perceived reliability of the AI, confidence in the AI, and ease of understanding of AI output. Participants (n = 216) engaged in a decision-making task across four AI-assisted decision-making scenarios. Each participant was randomly assigned to one of three transparency levels: low, medium, and high. Results show that higher transparency levels improved trust (β = .667, p < .001), perceived reliability (β = .595, p < .001), confidence in the AI accuracy (β = .553, p < .001), and ease of understanding (β = 1.161, p < .001). These findings indicate that increasing the amount of information presented to the user increases understanding, trust, perceived reliability, and confidence.

Keywords

XAI transparency explainability trust reliability AI

Get full access to this article

View all access options for this article.

References

Abdul

von der Weth

Kankanhalli

Lim

B. Y.

(2020). COGAM: Measuring and moderating cognitive load in machine learning model explanations. In Proceedings of the 2020 CHI conference on human factors in computing systems (pp. 1–14). Association for Computing Machinery.

Auguie

(2017). gridExtra: Miscellaneous functions for “grid” graphics (Version 2(1)) [Computer software]. https://CRAN.R-project.org/package=gridExtra

Druce

Harradon

Tittle

(2021). Explainable artificial intelligence (XAI) for increasing user trust in deep reinforcement learning driven autonomous systems. arXiv. arXiv:2106.03775. https://doi.org/10.48550/arXiv.2106.03775

Fox

Weisberg

(2018). An R companion to applied regression. Sage Publications.

Ghai

Liao

Q. V.

Zhang

Bellamy

Mueller

(2021). Explainable Active Learning (XAL): Toward AI explanations as interfaces for machine teachers. Proceedings of the ACM on Human-Computer Interaction, 4(CSCW3), 1–28. https://doi.org/10.1145/3432934

Gunning

Aha

D. W.

(2019). DARPA’s explainable artificial intelligence program. AI Magazine, 40(2), 44–58. https://doi.org/10.1609/aimag.v40i2.2850

Merritt

S. M.

Heimbaugh

LaChapell

Lee

. (2013). I Trust It, but I Don’t Know Why: Effects of Implicit Attitudes Toward Automation on Trust in an Automated System. Human Factors, 55(3), 520–534. https://doi.org/10.1177/0018720812465081

Ngo

V. M.

(2025). The AI transparency dilemma: When more is less for trust and adoption. Information Discovery and Delivery. https://doi.org/10.1108/IDD-03-2025-0056

Othman

(2025). Explainable AI (XAI): Enhancing transparency and trust in artificial intelligence. https://doi.org/10.13140/RG.2.2.36654.83524

10.

R Core Team (2021). R: A language and environment for statistical computing. R Foundation for Statistical Computing. https://www.R-project.org

11.

Robinson

Hayes

Couch

(2021). broom: Convert statistical objects into tidy tibbles [Computer software]. https://CRAN.R-project.org/package=broom

12.

Solt

(2024). dotwhisker: Dot-and-whisker plots of regression results [Computer software]. https://CRAN.R-project.org/package=dotwhisker

13.

Walmsley

(2021). Artificial intelligence and the value of transparency. AI & Society, 36(2), 585–595. https://doi.org/10.1007/s00146-020-01066-z

14.

Waltl

Vogl

(2018). Increasing transparency in algorithmic-decision-making with explainable AI. Datenschutz Und Datensicherheit - DuD, 42(10), 613–617. https://doi.org/10.1007/s11623-018-1011-4

15.

Wickham

Averick

Bryan

Chang

McGowan

François

Grolemund

Hayes

Henry

Hester

Kuhn

Pedersen

Miller

Bache

Müller

Ooms

Robinson

Seidel

Spinu

, . . . Yutani

(2019). Welcome to the Tidyverse. Journal of Open Source Software, 4(43), Article 1686. https://doi.org/10.21105/joss.01686

Transparency and Explainability in AI-Assisted Decision Making: Effects on Trust,Perceived Reliability,Confidence,and Ease of Understanding

Abstract

Keywords

Get full access to this article

References