Evaluation of multiple deep neural networks for detection of intracranial dural arteriovenous fistula on susceptibility weighted angiography imaging

Abstract

Background

The natural history of intracranial dural arteriovenous fistula (DAVF) is variable and early diagnosis is crucial in order to positively impact the clinical course of aggressive DAVF. Artificial intelligence (AI) based techniques can be promising in this regard, and in this study, we used various deep neural network (DNN) architectures to determine whether DAVF could be reliably identified on susceptibility-weighted angiography images (SWAN).

Materials and Methods

A total of 3965 SWAN image slices from 30 digital subtraction angiographically proven DAVF patients and 4380 SWAN image slices from 40 age-matched patients with normal MRI findings as control group were included. The images were categorized as either DAVF or normal and the data was trained using various DNN such as VGG-16, EfficientNet-B0, and ResNet-50.

Results

Various DNN architectures showed the accuracy of 95.96% (VGG-16), 91.75% (EfficientNet-B0), and 86.23% (ResNet-50) on the SWAN image dataset. ROC analysis yielded an area under the curve of 0.796 (p < .001), best for VGG-16 model. Criterion of seven consecutive positive slices for DAVF diagnosis yielded a sensitivity of 74.68% with a specificity of 69.15%, while setting eight slices improved the sensitivity to above 80.38%, with a decrease of specificity up to 56.38%. Based on seven consecutive positive slices criteria, EfficientNet-B0 yielded a sensitivity of 73.21% with a specificity of 45.92% and ResNet-50 yielded a sensitivity of 72.39% with a specificity of 67.42%.

Conclusion

This study shows that DNN can extract discriminative features of SWAN for the classification of DAVF from normal with good accuracy, reasonably good sensitivity and specificity.