Performance of e-ASPECTS software in comparison to that of stroke physicians on assessing CT scans of acute ischemic stroke patients

Abstract

Background

The Alberta Stroke Program Early CT score (ASPECTS) is an established 10-point quantitative topographic computed tomography scan score to assess early ischemic changes. We compared the performance of the e-ASPECTS software with those of stroke physicians at different professional levels.

Methods

The baseline computed tomography scans of acute stroke patients, in whom computed tomography and diffusion-weighted imaging scans were obtained less than two hours apart, were retrospectively scored by e-ASPECTS as well as by three stroke experts and three neurology trainees blinded to any clinical information. The ground truth was defined as the ASPECTS on diffusion-weighted imaging scored by another two non-blinded independent experts on consensus basis. Sensitivity and specificity in an ASPECTS region-based and an ASPECTS score-based analysis as well as receiver-operating characteristic curves, Bland–Altman plots with mean score error, and Matthews correlation coefficients were calculated. Comparisons were made between the human scorers and e-ASPECTS with diffusion-weighted imaging being the ground truth. Two methods for clustered data were used to estimate sensitivity and specificity in the region-based analysis.

Results

In total, 34 patients were included and 680 (34 × 20) ASPECTS regions were scored. Mean time from onset to computed tomography was 172 ± 135 min and mean time difference between computed tomographyand magnetic resonance imaging was 41 ± 31 min. The region-based sensitivity (46.46% [CI: 30.8;62.1]) of e-ASPECTS was better than three trainees and one expert (p ≤ 0.01) and not statistically different from another two experts. Specificity (94.15% [CI: 91.7;96.6]) was lower than one expert and one trainee (p < 0.01) and not statistically different to the other four physicians. e-ASPECTS had the best Matthews correlation coefficient of 0.44 (experts: 0.38 ± 0.08 and trainees: 0.19 ± 0.05) and the lowest mean score error of 0.56 (experts: 1.44 ± 1.79 and trainees: 1.97 ± 2.12).

Conclusion

e-ASPECTS showed a similar performance to that of stroke experts in the assessment of brain computed tomographys of acute ischemic stroke patients with the Alberta Stroke Program Early CT score method.

Keywords

Alberta Stroke Program Early CT score computed tomography ischemic stroke machine learning

Get full access to this article

View all access options for this article.

References

Barber

Demchuk

Zhang

Buchan

. Validity and reliability of a quantitative computed tomography score in predicting outcome of hyperacute stroke before thrombolytic therapy. ASPECTS study group. Alberta Stroke programme early CT score. Lancet 2000; 355: 1670–1674.

Hill

Rowley

Adler

. Selection of acute ischemic stroke patients for intra-arterial thrombolysis with pro-urokinase by using ASPECTS. Stroke 2003; 34: 1925–1931.

Okazaki

Moriwaki

Minematsu

Naritomi

. Extremely early computed tomography signs in hyperacute ischemic stroke as a predictor of parenchymal hematoma. Cerebrovasc Dis 2008; 25: 241–246.

Menon

Puetz

Kochar

Demchuk

. ASPECTS and other neuroimaging scores in the triage and prediction of outcome in acute stroke patients. Neuroimaging Clin N Am 2011; 21: 407–423, xii.

Aoki

Kimura

Shibazaki

Sakamoto

. DWI-ASPECTS as a predictor of dramatic recovery after intravenous recombinant tissue plasminogen activator administration in patients with middle cerebral artery occlusion. Stroke 2013; 44: 534–537.

Nezu

Koga

Kimura

. Pretreatment ASPECTS on DWI predicts 3-month outcome following rt-PA: SAMURAI rt-PA Registry. Neurology 2010; 75: 555–561.

Brazzelli

Sandercock

Chappell

. Magnetic resonance imaging versus computed tomography for detection of acute vascular lesions in patients presenting with stroke symptoms. Cochrane Database Syst Rev 2009; 4: CD007424.

Bentley

Ganesalingam

Carlton Jones

. Prediction of stroke thrombolysis outcome using CT brain machine learning. Neuroimage Clin 2014; 4: 635–640.

Przelaskowski

Sklinda

Bargiel

Walecki

Biesiadko-Matuszewska

Kazubek

. Improved early stroke detection: wavelet-based perception enhancement of computerized tomography exams. Comput Biol Med 2007; 37: 524–533.

10.

Tang

Chow

. An image feature approach for computer-aided detection of ischemic stroke. Comput Biol Med 2011; 41: 529–536.

11.

Goyal

Demchuk

Menon

. Randomized assessment of rapid endovascular treatment of ischemic stroke. N Engl J Med 2015; 372: 1019–1030.

12.

Genders

Spronk

Stijnen

Steyerberg

Lesaffre

Hunink

. Methods for calculating sensitivity and specificity of clustered data: a tutorial. Radiology 2012; 265: 910–916.

13.

Mitomi

Kimura

Aoki

Iguchi

. Comparison of CT and DWI findings in ischemic stroke patients within 3 hours of onset. J Stroke Cerebrovasc Dis 2014; 23: 37–42.

14.

Nezu

Koga

Nakagawara

. Early ischemic change on CT versus diffusion-weighted imaging for patients with stroke receiving intravenous recombinant tissue-type plasminogen activator therapy: stroke acute management with urgent risk-factor assessment and improvement (SAMURAI) rt-PA registry. Stroke 2011; 42: 2196–2200.

15.

Kosior

Lauzon

Steffenhagen

Kosior

Demchuk

Frayne

. Atlas-based topographical scoring for magnetic resonance imaging of acute stroke. Stroke 2010; 41: 455–460.

16.

Hema Rajini

NBR

. Computer aided detection of ischemic stroke using segmentation and texture features. Measurement 2013; 46: 1865–1874.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.17 MB

0.50 MB