Artificial Intelligence has found applications in a wide range of fields, including conversational agents designed for healthcare services. The quality of healthcare services greatly depends on the quality of the information provided by the agents. Achieving quality-assured information from conversational agents to support effective decision-making remains as a significant challenge in healthcare. Although prior review studies have shown an interest in investigating the information quality (IQ) of conversational agents in healthcare, no systematic review has been performed to present IQ definitions, factors influencing IQ, and IQ impacts. We conducted a systematic review of 45 articles published up to 2021 to investigate IQ definitions, factors influencing IQ, and IQ impacts in the context of conversational agents applied in healthcare. The findings of this review are integrated into a conceptual framework for the IQ research program in the context of conversational agents in healthcare, which has not been received attention in the literature, guiding future research directions. The present study also discusses implications for both researchers and practitioners to enhance the agents’ IQ and improve the quality of health-related services.
Abd-AlrazaqASafiZAlajlaniM, et al. (2020) Technical metrics used to evaluate health care chatbots: Scoping review. Journal of Medical Internet Research22(6): e18301.
2.
AleneziHTarhiniASharmaSK (2015) Development of quantitative model to investigate the strategic relationship between information quality and e-government benefits. Transforming Government: People, Process and Policy,9(3), 324–351.
3.
BérubéCSchachnerTKellerR, et al. (2021) Voice-based conversational agents for the prevention and management of chronic and mental health conditions: Systematic literature review. Journal of Medical Internet Research23(3): e25933.
4.
BenbyaHPachidiSJarvenpaaS (2021) Special issue editorial: Artificial intelligence in organizations: Implications for information systems research. Journal of the Association for Information Systems22(2): 10.
5.
BendigEErbBSchulze-ThuesingL, et al. (2019) The next generation: chatbots in clinical psychology and psychotherapy to foster mental health – a scoping review. Verhaltenstherapie.
6.
BibaultJ-EChaixBNectouxP, et al. (2019) Healthcare ex machina: Are conversational agents ready for prime time in oncology?Clinical and Translational Radiation Oncology16: 55–59.
7.
Borges AF, Laurindo FJ, Spínola MM, et al. (2021) The strategic use of artificial intelligence in the digital era: Systematic literature review and future research directions. International Journal of Information Management 57: 102225.
8.
CarLTDhinagaranDAKyawBM, et al. (2020) Conversational agents in health care: Scoping review and conceptual analysis. Journal of Medical Internet Research22(8): e17158.
9.
DamijNBhattacharyaS (2022) The role of AI chatbots in mental health related public services in a (post) pandemic world: A review and future research agenda. In the proceedings of the 2022 IEEE technology and engineering management conference (temscon Europe), 152–159.
10.
DemoulinNTCoussementK (2020) Acceptance of text-mining systems: The signaling role of information quality. Information & Management57(1): 103120.
11.
GabarronELarbiDDeneckeK, et al. (2020) What do we know about the use of chatbots for public health?Studies in Health Technology and Informatics270: 796–800.
12.
GaffneyHMansellWTaiS (2020) Agents of change: Understanding the therapeutic processes associated with the helpfulness of therapy for mental health problems with relational agent MYLO. Digital Health6, 2055207620911580.
13.
GamboNPerryMKashefiA, et al. (2021) Harnessing social and collaborative tools in digital disaster response work: Implications for design and practice. Information Development37(3): 525–537.
14.
GharagozlouHMohammadzadehJBastanfardA, et al. (2022) RLAS-BIABC: A reinforcement learning-based answer selection using the bert model boosted by an improved ABC algorithm. Computational Intelligence and Neuroscience2022: 7839840.
HazenBTBooneCAEzellJD, et al. (2014) Data quality for data science, predictive analytics, and big data in supply chain management: An introduction to the problem and suggestions for research and applications. International Journal of Production Economics154: 72–80.
17.
HuhmannBAMothersbaughDLFrankeGR (2002) Rhetorical figures in headings and their effect on text processing: The moderating role of information relevance and text length. IEEE Transactions on Professional Communication45(3): 157–169.
18.
JadhavKPThoratSA (2020) Towards designing conversational agent systems. In the proceedings of international conference on communication engineering and technology, 533–542.
LaranjoLDunnAGTongHL, et al. (2018) Conversational agents in healthcare: A systematic review. Journal of the American Medical Informatics Association25(9): 1248–1258.
21.
LeeYWStrongDMKahnBK, et al. (2002) AIMQ: A methodology for information quality assessment. Information & Management40(2): 133–146.
22.
LevisMHelfertMBradyM (2007) Information quality management: Review of an evolving research area. In the proceedings of the 12th international conference on information quality, 12872, 1–15.
23.
LiuCNitschkePWilliamsSP, et al. (2020) Data quality and the internet of things. Computing102(2): 573–599.
24.
Liu C, Zhang B and Peng G (2021) A systematic review of information quality of artificial intelligence based conversational agents in healthcare. In the proceedings of the 23rd international conference on human-computer Interaction, 331–347.
25.
KahnBKStrongDMWangRY (2002) Information quality benchmarks: Product and service performance. Communications of the ACM45(4ve): 184–192.
26.
KhanAQayyumAMahonyL (2022) An exploratory prioritisation of supervision styles in library and information science experiential learning programmes in Pakistan. Information Development. 02666669221076389.
27.
MensahIKMwakapesaDS (2023) The impact of e-government information quality (EGIQ) dimensions on the adoption of electronic government services. Information Development02666669231155164.
28.
Milne-IvesMde CockCLimE, et al. ((2020).The) Effectiveness of artificial intelligence conversational agents in health care: Systematic review. Journal of Medical Internet Research22(10): e20346.
29.
MithasSRamasubbuNSambamurthyV (2011) How information management capability influences firm performance. MIS Quarterly: 237–256.
30.
MontenegroJLZda CostaCAda Rosa RighiR (2019) Survey of conversational agents in health. Expert Systems with Applications129: 56–67.
31.
MuhyidinASetiawanMAF (2021) Developing UNYSA chatbot as information services about yogyakarta state university. Journal of Physics: Conference Series1737(1): 012038.
32.
NadarzynskiTMilesOCowieA, et al. (2019) Acceptability of artificial intelligence (AI)-led chatbot services in healthcare: A mixed-methods study. Digital Health,5, 2055207619871808.
33.
NajjarMSDahabiyehLNawaysehM (2019) Share if you care: The impact of information sharing and information quality on humanitarian supply chain performance-a social capital perspective. Information Development35(3): 467–481.
34.
NelekarSAbdulrahmanAGuptaM, et al. (2022) Effectiveness of embodied conversational agents for managing academic stress at an Indian university (ARU) during COVID-19. British Journal of Educational Technology53(3): 491–511.
35.
NdabaroraEChippsJAUysL (2014) Systematic review of health data quality management and best practices at community and district levels in LMIC. Information Development30(2): 103–120.
36.
ÖlçerDTaşkaya TemizelT (2022) Quality assessment of web-based information on type 2 diabetes. Online Information Review46(4): 715–732.
37.
PalanicaAFlaschnerPThommandramA, et al. (2019) Physicians’ perceptions of chatbots in health care: Cross-sectional web-based survey. Journal of Medical Internet Research21(4): e12887.
38.
PereiraJDíazÓ (2019) Using health chatbots for behavior change: A mapping study. Journal of Medical Systems43: 135.
39.
SafiZAbd-AlrazaqAKhalifaM, et al. ((2020) Technical aspects of developing chatbots for medical applications: Scoping review. Journal of Medical Internet Research22(12): e19127.
40.
SavargivMBastanfardA (2015) Persian Speech emotion recognition. In the proceedings of the 7th conference on information and knowledge technology, 1–5.
41.
SchachnerTKellerRvon WangenheimF (2020) Artificial intelligence-based conversational agents for chronic conditions: Systematic literature review. Journal of Medical Internet Research22(9): e20701.
42.
SetiaPSetiaPVenkateshV, et al. (2013) Leveraging digital technologies: How information quality leads to localized capabilities and customer service performance. MIS Quarterly: 565–590.
43.
SicariSRizzardiAMiorandiD, et al. (2016) A secure and quality-aware prototypical architecture for the internet of things. Information Systems58: 43–55.
44.
SunYZhangYGwizdkaJ, et al. (2019) Consumer evaluation of the quality of online health information: Systematic literature review of relevant criteria and indicators. Journal of Medical Internet Research21(5): e12522.
45.
ter StalSKramerLLTabakM, et al. (2020) Design features of embodied conversational agents in eHealth: A literature review. International Journal of Human-Computer Studies138: 102409.
46.
TohidastSAMansuriBBagheriR, et al. (2021) Determining pain in patients with voice disorders: A qualitative study. Logopedics Phoniatrics Vocology46(4): 155–162.
47.
TillyRPoseggaOFischbachK, et al. (2017) Towards a conceptualization of data and information quality in social information systems. Business & Information Systems Engineering59(1): 3–21.
48.
VaidyamANWisniewskiHHalamkaJD, et al. (2019) Chatbots and conversational agents in mental health: A review of the psychiatric landscape. The Canadian Journal of Psychiatry64(7): 456–464.
49.
WeizenbaumJ (1966) Eliza - a computer program for the study of natural language communication between man and machine. Communications of the ACM9(1): 36–45.
50.
Wrigley KellyNEMurrayKEMcCarthyC, et al. (2021) An objective analysis of quality and readability of online information on COVID-19. Health and Technology11(5): 1093–1099.
51.
ZhangZLiBLiuL (2023) The impact of AI-based conversational agent on the firms’ operational performance: Empirical evidence from a call center. Applied Artificial Intelligence37(1): 2157592.
