Artificial Intelligence (AI) has the potential to shape the delivery of healthcare and address the quintuple aims of healthcare: improving population health outcomes, lowering costs, improving healthcare provider and patient experiences and advancing health equity. Patients’ and providers’ trust in AI and the trustworthiness of these systems are important factors in the adoption and integration of AI in healthcare. This paper presents an overview of determinants of trust and trustworthiness of AI applications within a healthcare context, based on preliminary themes emerging from a rapid review of 105 studies. These findings can inform appropriate and effective design, development, implementation and integration of AI in healthcare.
Get full access to this article
View all access options for this article.
References
1.
AbrahamJ.BartekB.MengA.Ryan KingC.XueB.LuC.AvidanM. S. (2023). Integrating machine learning predictions for perioperative risk management: Towards an empirical design of a flexible-standardized risk assessment tool. Journal of Biomedical Informatics, 137, 104270. https://doi.org/10.1016/j.jbi.2022.104270
2.
AdamsS. J.TangR.BabynP. (2020). Patient Perspectives and Priorities Regarding Artificial Intelligence in Radiology: Opportunities for Patient-Centered Radiology. Journal of the American College of Radiology, 17(8), 1034–1036. https://doi.org/10.1016/j.jacr.2020.01.007
3.
AlamL.MuellerS. (2021). Examining the effect of explanation on satisfaction and trust in AI diagnostic systems. BMC Medical Informatics and Decision Making, 21(1), 178. https://doi.org/10.1186/s12911-021-01542-6
4.
AlbrightK.RichardsonT.KempeK. L.WallaceK. (2014). Toward a Trustworthy Voice: Increasing the Effectiveness of Automated Outreach Calls to Promote Colorectal Cancer Screening among African Americans. The Permanente Journal, 18(2), 33–37. https://doi.org/10.7812/TPP/13-139
5.
AnkolekarA.van der HeijdenB.DekkerA.RoumenC.De RuysscherD.ReymenB.BerlangaA.OberijeC.FijtenR. (2022). Clinician perspectives on clinical decision support systems in lung cancer: Implications for shared decision-making. Health Expectations, 25(4), 1342–1351. https://doi.org/10.1111/hex.13457
6.
AsanO.BayrakA. E.ChoudhuryA. (2020). Artificial Intelligence and Human Trust in Healthcare: Focus on Clinicians. Journal of Medical Internet Research, 22(6), e15154. https://doi.org/10.2196/15154
BergquistM.RolandssonB.GryskaE.LaesserM.HoeflingN.HeckemannR.SchneidermanJ. F.Björkman-BurtscherI. M. (2023). Trust and stakeholder perspectives on the implementation of AI tools in clinical radiology. European Radiology, 34(1), 338–347. https://doi.org/10.1007/s00330-023-09967-5
9.
Committee on Implementing High-Quality Primary Care, Board on Health Care Services, Health and Medicine Division, & National Academies of Sciences, Engineering, and Medicine. (2021). Implementing High-Quality Primary Care: Rebuilding the Foundation of Health Care (McCauleyL.PhillipsR. L.MeisnereM.RobinsonS. K., Eds.; p. 25983). National Academies Press. https://doi.org/10.17226/25983
10.
DlugatchR.GeorgievaA.KerasidouA. (2023). Trustworthy artificial intelligence and ethical design: Public perceptions of trustworthiness of an AI-based decision-support tool in the context of intrapartum care. BMC Medical Ethics, 24(1), 42. https://doi.org/10.1186/s12910-023-00917-w
11.
HallowellN.BadgerS.SauerbreiA.NellåkerC.KerasidouA. (2022). “I don’t think people are ready to trust these algorithms at face value”: Trust and the use of machine learning algorithms in the diagnosis of rare disease. BMC Medical Ethics, 23(1), 112. https://doi.org/10.1186/s12910-022-00842-4
12.
HenryK. E.KornfieldR.SridharanA.LintonR. C.GrohC.WangT.WuA.MutluB.SariaS. (2022). Human–machine teaming is key to AI adoption: Clinicians’ experiences with a deployed machine learning system. Npj Digital Medicine, 5(1), 97. https://doi.org/10.1038/s41746-022-00597-7
KoechA.MusitiaP. M.MwashigadiG. M.KinshellaM.-L. W.VidlerM.TemmermanM.CraikR.Von DadelszenP.NobleJ. A.PapageorghiouA. T., & The PRECISE Network. (2022). Acceptability and Feasibility of a Low-Cost Device for Gestational Age Assessment in a Low-Resource Setting: Qualitative Study. JMIR Human Factors, 9(4), e34823. https://doi.org/10.2196/34823
15.
Kostick-QuenetK.LangB. H.SmithJ.HurleyM.Blumenthal-BarbyJ. (2023). Trust criteria for artificial intelligence in health: Normative and epistemic considerations. Journal of Medical Ethics, jme-2023-109338. https://doi.org/10.1136/jme-2023-109338
16.
LeungC. K.MadillE. W. R.SouzaJ.ZhangC. Y. (2022). Towards Trustworthy Artificial Intelligence in Healthcare. 2022 IEEE 10th International Conference on Healthcare Informatics (ICHI), 626–632. https://doi.org/10.1109/ICHI54592.2022.00127
17.
MarcotteL. M.LangevinR.HempsteadB. H.GangulyA.LyonA. R.WeinerB. J.AkinsotoN.HoustonP. L.FangV.HsiehG. (2024). Leveraging human-centered design and causal pathway diagramming toward enhanced specification and development of innovative implementation strategies: A case example of an outreach tool to address racial inequities in breast cancer screening. Implementation Science Communications, 5(1), 31. https://doi.org/10.1186/s43058-024-00569-w
18.
MarisM. T.KoçarA.WillemsD. L.PolsJ.TanH. L.LindingerG. L.BakM. A. R. (2024). Ethical use of artificial intelligence to prevent sudden cardiac death: An interview study of patient perspectives. BMC Medical Ethics, 25(1), 42. https://doi.org/10.1186/s12910-024-01042-y
19.
MasseyC. J.AsokanA.TietbohlC.MorrisM.RamakrishnanV. R. (2023). Otolaryngologist perceptions of AI-based sinus CT interpretation. American Journal of Otolaryngology, 44(5), 103932. https://doi.org/10.1016/j.amjoto.2023.103932
20.
MesselinkM. A.FadaeiS.VerhoefL. M.WelsingP.NijhofN. C.WestlandH. (2024). Rheumatoid arthritis patients’ perspective on the use of prediction models in clinical decision-making. Rheumatology, keae202. https://doi.org/10.1093/rheumatology/keae202
21.
MontagueE. N. H.KleinerB. M.WinchesterW. W. (2009). Empirically understanding trust in medical technology. International Journal of Industrial Ergonomics, 39(4), 628–634. https://doi.org/10.1016/j.ergon.2009.01.004
22.
NashD. M.ThorpeC.BrownJ. B.KueperJ. K.RaynerJ.LizotteD. J.TerryA. L.ZwarensteinM. (2023). Perceptions of Artificial Intelligence Use in Primary Care: A Qualitative Study with Providers and Staff of Ontario Community Health Centres. The Journal of the American Board of Family Medicine, 36(2), 221–228. https://doi.org/10.3122/jabfm.2022.220177R2
NundyS.CooperL. A.MateK. S. (2022). The Quintuple Aim for Health Care Improvement: A New Imperative to Advance Health Equity. JAMA, 327(6), 521. https://doi.org/10.1001/jama.2021.25181
27.
PellyM.FatehiF.LiewD.Verdejo-GarciaA. (2023). Artificial intelligence for secondary prevention of myocardial infarction: A qualitative study of patient and health professional perspectives. International Journal of Medical Informatics, 173, 105041. https://doi.org/10.1016/j.ijmedinf.2023.105041
28.
SandhuS.LinA. L.BrajerN.SperlingJ.RatliffW.BedoyaA. D.BaluS.O’BrienC.SendakM. P. (2020). Integrating a Machine Learning System Into Clinical Workflows: Qualitative Study. Journal of Medical Internet Research, 22(11), e22421. https://doi.org/10.2196/22421
29.
SangersT. E.WakkeeM.Kramer-NoelsE. C.NijstenT.LugtenbergM. (2021). Views on mobile health apps for skin cancer screening in the general population: An in-depth qualitative exploration of perceived barriers and facilitators*. British Journal of Dermatology, 185(5), 961–969. https://doi.org/10.1111/bjd.20441
30.
SchepartA.BurtonA.DurkinL.FullerA.CharapE.BhambriR.AhmadF. S. (2023). Artificial intelligence–enabled tools in cardiovascular medicine: A survey of current use, perceptions, and challenges. Cardiovascular Digital Health Journal, 4(3), 101–110. https://doi.org/10.1016/j.cvdhj.2023.04.003
31.
ShamszareH.ChoudhuryA. (2023). Clinicians’ Perceptions of Artificial Intelligence: Focus on Workload, Risk, Trust, Clinical Decision Making, and Clinical Integration. Healthcare, 11(16), 2308. https://doi.org/10.3390/healthcare11162308
32.
ShevtsovaD.AhmedA.BootI. W. A.SangesC.HudecekM.JacobsJ. J. L.HortS.VrijhoefH. J. M. (2024). Trust in and Acceptance of Artificial Intelligence Applications in Medicine: Mixed Methods Study. JMIR Human Factors, 11, e47031. https://doi.org/10.2196/47031
33.
SiderisK.WeirC. R.SchmalfussC.HansonH.PipkeM.TsengP.-H.LewisN.SallamK.BozkurtB.HanffT.SchofieldR.LarimerK.KyriakopoulosC. P.TalebI.BrinkerL.CurryT.KnechtC.ButlerJ. M.StehlikJ. (2024). Artificial intelligence predictive analytics in heart failure: Results of the pilot phase of a pragmatic randomized clinical trial. Journal of the American Medical Informatics Association, 31(4), 919–928. https://doi.org/10.1093/jamia/ocae017
34.
TownsendB. A.PlantK. L.HodgeV. J.AshaoluO.CalinescuR. (2023). Medical practitioner perspectives on AI in emergency triage. Frontiers in Digital Health, 5, 1297073. https://doi.org/10.3389/fdgth.2023.1297073
35.
TranB. X.VuG. T.HaG. H.VuongQ.-H.HoM.-T.VuongT.-T.LaV.-P.HoM.-T.NghiemK.-C. P.NguyenH. L. T.LatkinC. A.TamW. W. S.CheungN.-M.NguyenH.-K. T.HoC. S. H.HoR. C. M. (2019). Global Evolution of Research in Artificial Intelligence in Health and Medicine: A Bibliometric Study. Journal of Clinical Medicine, 8(3), 360. https://doi.org/10.3390/jcm8030360
36.
YakarD.OngenaY. P.KweeT. C.HaanM. (2022). Do People Favor Artificial Intelligence Over Physicians? A Survey Among the General Population and Their View on Artificial Intelligence in Medicine. Value in Health, 25(3), 374–381. https://doi.org/10.1016/j.jval.2021.09.004
37.
ZhangZ.CitardiD.WangD.GencY.ShanJ.FanX. (2021). Patients’ perceptions of using artificial intelligence (AI)-based technology to comprehend radiology imaging data. Health Informatics Journal, 27(2), 146045822110112. https://doi.org/10.1177/14604582211011215
