The objective of this study was to assess the performance of an artificial intelligence (AI) algorithm in detecting intracranial haemorrhages (ICHs) on non-contrast CT scans (NCCT). Another objective was to gauge the department’s acceptance of said algorithm. Surveys conducted at three and nine months post-implementation revealed an increase in radiologists’ acceptance of the AI tool with an increasing performance. However, a significant portion still preferred an additional physician given comparable cost. Our findings emphasize the importance of careful software implementation into a robust IT architecture.
GreenbergJCSMAndersonCSBeckerK, et al.Guidelines for the management of spontaneous intracerebral hemorrhage. Stroke2015; 46(7): 2032–2060. DOI: 10.1161/STR.0000000000000069.
2.
van AschCJLuitseMJRinkelGJ, et al.Incidence, case fatality, and functional outcome of intracerebral haemorrhage over time, according to age, sex, and ethnic origin: a systematic review and meta-analysis. Lancet Neurol2010; 9(2): 167–176. DOI: 10.1016/S1474-4422(09)70340-0.
SunTYuanYWuK, et al.Trends and patterns in the global burden of intracerebral hemorrhage: a comprehensive analysis from 1990 to 2019. Front Neurol2023; 14: 1241158. DOI: 10.3389/fneur.2023.1241158.
5.
NätynkiAMHuhtakangasJBodeM, et al.Long‐term survival after primary intracerebral hemorrhage: a population‐based case-control study spanning a quarter of a century. Eur J Neurol2021; 28(11): 3663–3669. DOI: 10.1111/ene.14988.
6.
QureshiSMDTalaricoRTanuseputroP, et al.Intracerebral hemorrhage incidence, mortality, and association with oral anticoagulation use. Stroke2021; 52(5): 1673–1681. DOI: 10.1161/STROKEAHA.120.032550.
7.
BroderickJPBrottTGDuldnerJE, et al.Volume of intracerebral hemorrhage. A powerful and easy-to-use predictor of 30-day mortality. Stroke1993; 24(7): 987–993. DOI: 10.1161/01.STR.24.7.987.
8.
HaverbuschMLMSekarPKisselaB, et al.Long-term mortality after intracerebral hemorrhage. Neurology2006; 66(8): 1182–1186. DOI: 10.1212/01.wnl.0000208400.08722.7c.
9.
WeisbergEMChuLCFishmanEK. The first use of artificial intelligence (AI) in the ER: triage not diagnosis. Emerg Radiol2020; 27(4): 361–366. DOI: 10.1007/s10140-020-01773-6.
10.
ChoiCKJWJiaoZWangD, et al.An automated COVID-19 triage pipeline using artificial intelligence based on chest radiographs and clinical data. npj Digit Med2022; 5(1): 5. DOI: 10.1038/s41746-021-00546-w.
11.
ChowJEDSNagamineMTakhtawalaRS, et al.Artificial intelligence and acute stroke imaging. Am J Neuroradiol2021; 42(1): 2–11. DOI: 10.3174/ajnr.A6883.
12.
GinatDT. Analysis of head CT scans flagged by deep learning software for acute intracranial hemorrhage. Neuroradiology2020; 62(3): 335–340. DOI: 10.1007/s00234-019-02330-w.
13.
SeifiAASeifiA. Diagnostic accuracy of deep learning for intracranial hemorrhage detection in non-contrast brain CT scans: a systematic review and meta-analysis. J Clin Med2025; 14(7): 2377. DOI: 10.3390/jcm14072377.
14.
VoterAFMeramEGarrettJW, et al.Diagnostic accuracy and failure mode analysis of a deep learning algorithm for the detection of intracranial hemorrhage. J Am Coll Radiol JACR2021; 18(8): 1143–1152. DOI: 10.1016/j.jacr.2021.03.005.
15.
SeyamMWeikertTSauterA, et al.Utilization of artificial intelligence-based intracranial hemorrhage detection on emergent noncontrast CT images in clinical workflow. Radiol Artif Intell2022; 4(2): e210168. DOI: 10.1148/ryai.210168.
16.
FletcherACBigwoodSRatnakanthanP, et al.Retrospective analysis and prospective validation of an AI-based software for intracranial haemorrhage detection at a high-volume trauma centre. Sci Rep2022; 12(1): 19885. DOI: 10.1038/s41598-022-24504-y.
17.
OjedaPZawaidehMMossa-BashaM, et al.The utility of deep learning: evaluation of a convolutional neural network for detection of intracranial bleeds on non-contrast head computed tomography studies. In: AngeliniEDLandmanBA (eds). Medical Imaging 2019: Image Processing. San Diego, United States: SPIE, 2019, p. 128. DOI: 10.1117/12.2513167.
18.
TanwarCHMElkassemAASturdivantA, et al.Prospective evaluation of artificial intelligence triage of intracranial hemorrhage on noncontrast head CT examinations. Am J Roentgenol2024; 223(5): e2431639. DOI: 10.2214/AJR.24.31639.
ChodakiewitzYMayaMPressmanB. Abstract WP63: AI-Augmented review of CT brain exams to determine rate of missed diagnoses of intracranial hemorrhage by practicing neuroradiologists. Stroke. 2020; 51(Suppl_1). DOI: 10.1161/str.51.suppl_1.WP63.
21.
RaoBZohrabianVCedenoP, et al.Utility of artificial intelligence tool as a prospective radiology peer reviewer - detection of unreported intracranial hemorrhage. Acad Radiol2021; 28(1): 85–93. DOI: 10.1016/j.acra.2020.01.035.
22.
XiTJYStehelEBrowningT, et al.Active reprioritization of the reading worklist using artificial intelligence has a beneficial effect on the turnaround time for interpretation of head CT with intracranial hemorrhage. Radiol. Artif. Intell2021; 3(2): e200024. DOI: 10.1148/ryai.2020200024.
23.
HillalAUllbergTRamgrenB, et al.Computed tomography in acute intracerebral hemorrhage: neuroimaging predictors of hematoma expansion and outcome. Insights Imaging2022; 13(1): 180. DOI: 10.1186/s13244-022-01309-1.
24.
PanchalHNShahMSShahDS. Intracerebral hemorrhage score and volume as an independent predictor of mortality in primary intracerebral hemorrhage patients. Indian J Surg2015; 77(S2): 302–304. DOI: 10.1007/s12262-012-0803-2.
25.
FornwaltMRBKMongelluzzoGJSueverJD, et al.Advanced machine learning in action: identification of intracranial hemorrhage on computed tomography scans of the head with clinical workflow integration. npj Digit Med2018; 1(1): 9. DOI: 10.1038/s41746-017-0015-z.
26.
BroderickSMJHennericiMBrunNC, et al.Hematoma growth is a determinant of mortality and poor outcome after intracerebral hemorrhage. Neurology2006; 66(8): 1175–1181. DOI: 10.1212/01.wnl.0000208408.98482.99.
27.
KazuiSNaritomiHYamamotoH, et al.Enlargement of spontaneous intracerebral hemorrhage. Stroke1996; 27(10): 1783–1787. DOI: 10.1161/01.STR.27.10.1783.
28.
QureshiAPaleschYInvestigatorsATACH II. Expansion of recruitment time window in antihypertensive treatment of acute cerebral hemorrhage (ATACH) II trial. J. Vasc. Interv. Neurol2012; 5(supp): 6–9.
29.
DelshadSDontarajuVSChengatV. Artificial intelligence-based application provides accurate medical triage advice when compared to consensus decisions of healthcare providers. Cureus2021. DOI: 10.7759/cureus.16956.
30.
HaSNTBulsaraMKDoustJ, et al.Increasing use of CT requested by emergency department physicians in tertiary hospitals in Western Australia 2003-2015: an analysis of linked administrative data. BMJ Open2021; 11(3): e043315. DOI: 10.1136/bmjopen-2020-043315.
31.
KweeRJMRMKweeRM. Workload for radiologists during on-call hours: dramatic increase in the past 15 years. Insights Imaging2020; 11(1): 121. DOI: 10.1186/s13244-020-00925-z.
32.
HuangTHKHuangHK. Effect of a computer-aided diagnosis system on clinicians' performance in detection of small acute intracranial hemorrhage on computed tomography. Acad Radiol2008; 15(3): 290–299. DOI: 10.1016/j.acra.2007.09.022.
33.
LalNRMurrayUMEldevikOP, et al.Clinical consequences of misinterpretations of neuroradiologic CT scans by on-call radiology residents. AJNR Am. J. Neuroradiol2000; 21(1): 124–129.
34.
WysokiMGNassarCJKoenigsbergRA, et al.Head trauma: CT scan interpretation by radiology residents versus staff radiologists. Radiology1998; 208(1): 125–128. DOI: 10.1148/radiology.208.1.9646802.
35.
GeijerHMGeijerM. Added value of double reading in diagnostic radiology,a systematic review. Insights Imaging2018; 9(3): 287–301. DOI: 10.1007/s13244-018-0599-0.
36.
GhoshSRTanamalaSBivijiM, et al.Deep learning algorithms for detection of critical findings in head CT scans: a retrospective study. Lancet2018; 392(10162): 2388–2396. DOI: 10.1016/S0140-6736(18)31645-3.
37.
SanderZZMSRaiBTitahongCN, et al.Using artificial intelligence to read chest radiographs for tuberculosis detection: a multi-site evaluation of the diagnostic accuracy of three deep learning systems. Sci Rep2019; 9(1): 15000. DOI: 10.1038/s41598-019-51503-3.
38.
Rodriguez-RuizALångKGubern-MeridaA, et al.Stand-alone artificial intelligence for breast cancer detection in mammography: comparison with 101 radiologists. JNCI J. Natl. Cancer Inst2019; 111(9): 916–922. DOI: 10.1093/jnci/djy222.
39.
BuistTDSMLeeCINikulinY, et al.Evaluation of combined artificial intelligence and radiologist assessment to interpret screening mammograms. JAMA Netw Open2020; 3(3): e200265. DOI: 10.1001/jamanetworkopen.2020.0265.
