Validation of an automated ASPECTS method on non-contrast computed tomography scans of acute ischemic stroke patients

Abstract

Background

The Alberta Stroke Program Early CT Score (ASPECTS) is a systematic method of assessing the extent of early ischemic change on non-contrast computed tomography in patients with acute ischemic stroke. Our objective was to validate an automated ASPECTS scoring method we recently developed on a large data set.

Materials and methods

We retrospectively collected 602 acute ischemic stroke patients’ non-contrast computed tomography scans. Expert ASPECTS readings on non-contrast computed tomography were compared to automated ASPECTS. Statistical analyses on the total ASPECTS, region level ASPECTS, and dichotomized ASPECTS (≤4 vs. >4) score were conducted.

Results

In total, 602 scans were evaluated and 6020 (602 × 10) ASPECTS regions were scored. Median time from stroke onset to computed tomography was 114 min (interquartile range: 73–183 min). Total ASPECTS for the 602 patients generated by the automated method agreed well with expert readings (intraclass correlation coefficient): 0.65 (95% confidence interval (CI): 0.60–0.69). Region level analysis showed that the automated method yielded accuracy of 81.25%, sensitivity of 61.13% (95% CI: 58.4%–63.8%), specificity of 86.56% (95% CI: 85.6%–87.5%), and area under curve of 0.74 (95% CI: 0.73–0.75). For dichotomized ASPECTS (≤4 vs. >4), the automated method demonstrated sensitivity 97.21% (95% CI: 95.4%–98.4%), specificity 57.81% (95% CI: 44.8%–70.1%), accuracy 93.02%, and area under the curve of 0.78 (95% CI: 0.74–0.81). For each individual region (M1–6, lentiform, insula, and caudate), the automated method demonstrated acceptable performance.

Conclusion

The automated system we developed approached the stroke expert in performance when scoring ASPECTS on non-contrast computed tomography scans of acute ischemic stroke patients.

Keywords

Alberta Stroke Program Early CT score non-contrast computed tomography ischemic stroke machine learning automated ASPECTS scoring

Get full access to this article

View all access options for this article.

References

Kunst

Schaefer

. Ischemic stroke. Radiol Clin North Am 2011; 49: 1–26.

Wardlaw

Von Kummer

Farrall

Chappel

Hill

Perry

. A large web-based observer reliability study of early ischaemic signs on computed tomography. The Acute Cerebral CT Evaluation of Stroke Study (ACCESS). PLoS One 2010; 5: e15757.

Barber

Demchuk

Zhang

, et al. Validity and reliability of a quantitative computed tomography score in predicting outcome of hyperacute stroke before thrombolytic therapy. Lancet 2000; 355: 1670–1674.

Goyal

Menon

Van Zwam

, et al. Endovascular thrombectomy after large-vessel ischaemic stroke: a meta-analysis of individual patient data from five randomised trials. Lancet 2016; 387: 1723–1731.

Goyal

Demchuk

Menon

, et al. Randomized assessment of rapid endovascular treatment of ischemic stroke. N Engl J Med 2015; 372: 1019–1030.

Menon

Smith

Modi

, et al. Regional leptomeningeal score on CT angiography predicts clinical and imaging outcomes in patients with acute anterior circulation occlusions. Am J Neuroradiol 2011; 32: 1640–1645.

Nagel

Sinha

Day

, et al. e-ASPECTS software is non-inferior to neuroradiologists in applying the ASPECT score to computed tomography scans of acute ischemic stroke patients. Int J Stroke 2017; 12: 615–622.

Herweh

Ringleb

Rauch

, et al. Performance of e-ASPECTS software in comparison to that of stroke physicians on assessing CT scans of acute ischemic stroke patients. Int J Stroke 2016; 11: 438–445.

Shieh

Chang

C-H

Shieh

, et al. Computer-aided diagnosis of hyperacute stroke with thrombolysis decision support using a contralateral comparative method of CT image analysis. J Digit Imaging 2014; 27: 392–406.

10.

Su J-L, Chan L and Huang S. Development of computer aids ASPECTS system for acute ischemic stroke patient: a preliminary study. In: International Conference for Innovation in Biomedical Engineering and Life Sciences. Berlin: Springer, 2017, pp. 203–207.

11.

Kuang

Najm

Chakraborty

, et al. Automated ASPECTS on noncontrast CT scans in patients with acute ischemic stroke using machine learning. Am J Neuroradiol 2018; 40: 33–38.

12.

Goebel

Stenzel

Guberina

, et al. Automated ASPECT rating: comparison between the Frontier ASPECT Score software and the Brainomix software. Neuroradiology 2018; 60: 1267–1272.

13.

Maegerlein

Fischer

Mönch

, et al. Automated calculation of the alberta stroke program early CT score: feasibility and reliability. Radiology 2019; 291: 141–148.

14.

Pfaff

Herweh

Schieber

, et al. e-ASPECTS correlates with and is predictive of outcome after mechanical thrombectomy. Am J Neuroradiol 2017; 38: 1594–1599.

15.

Austein

Wodarg

Jürgensen

, et al. Automated versus manual imaging assessment of early ischemic changes in acute stroke: comparison of two software packages and expert consensus. Eur Radiol 2019; 29(11): 6285–6292.

16.

Olive-Gadea

Martins

Boned

, et al. Baseline ASPECTS and e-ASPECTS correlation with infarct volume and functional outcome in patients undergoing mechanical thrombectomy. J Neuroimaging 2019; 29: 198–202.

17.

Seker

Pfaff

Nagel

, et al. CT reconstruction levels affect automated and reader-based ASPECTS ratings in acute ischemic stroke. J Neuroimaging 2019; 29: 62–64.

18.

Demeestere

Scheldeman

Cornelissen

, et al. Alberta stroke program early CT score versus computed tomographic perfusion to predict functional outcome after successful reperfusion in acute ischemic stroke. Stroke 2018; 49: 2361–2367.

19.

Nagel

Wang

Carcel

, et al. Clinical utility of electronic Alberta Stroke Program early computed tomography score software in the ENCHANTED Trial Database. Stroke 2018; 49: 1407–1411.

20.

Menon

Al-Ajlan

Najm

, et al. Association of clinical, imaging, and thrombus characteristics with recanalization of visible intracranial occlusion in patients with acute ischemic stroke. JAMA 2018; 320: 1017–1026.

21.

Menon

d’Esterre

Qazi

, et al. Multiphase CT angiography: a new tool for the imaging triage of patients with acute ischemic stroke. Radiology 2015; 275: 510–520.

22.

Obuchowski

. Nonparametric analysis of clustered ROC curve data. Biometrics 1997; 53(2): 567–578.

23.

Inoue

Olivot

J-M

Labreuche

, et al. Impact of diffusion-weighted imaging Alberta stroke program early computed tomography score on the success of endovascular reperfusion therapy. Stroke 2014; 45: 1992–1998.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.25 MB