The influence of artificial intelligence assistance on the diagnostic performance of CCTA for coronary stenosis for radiologists with different levels of experience

Abstract

Background

The interpretation of coronary computed tomography angiography (CCTA) stenosis may be difficult among radiologists of different experience levels. Artificial intelligence (AI) may improve the diagnostic performance.

Purpose

To investigate whether the diagnostic performance and time efficiency of radiologists with different levels of experience in interpreting CCTA images could be improved by using CCTA with AI assistance (CCTA-AI).

Material and Methods

This analysis included 200 patients with complete CCTA and invasive coronary angiography (ICA) data, using ICA results as the reference. Eighteen radiologists were divided into three levels based on experience (Levels I, II, and III), and the three levels were divided into groups without (Groups 1, 2, and 3) and with (Groups 4, 5, and 6) AI assistance, totaling six groups (to avoid reader recall bias). The average sensitivity, specificity, NPV, PPV, and AUC were reported for the six groups and CCTA-AI at the patient, vessel, and segment levels. The interpretation time in the groups with and without CCTA-AI was recorded.

Results

Compared to the corresponding group without CCTA-AI, the Level I group with CCTA-AI had improved sensitivity (75.0% vs. 83.0% on patient-based; P = 0.003). At Level III, the specificity was better with CCTA-AI. The median interpretation times for the groups with and without CCTA-AI were 413 and 615 s, respectively (P < 0.001).

Conclusion

CCTA-AI could assist with and improve the diagnostic performance of radiologists with different experience levels, with Level I radiologists exhibiting improved sensitivity and Level III radiologists exhibiting improved specificity. The use of CCTA-AI could shorten the training time for radiologists.