Advancing lung cancer diagnosis: Combining 3D auto-encoders and attention mechanisms for CT scan analysis

Abstract

Objective

The goal of this study is to assess the effectiveness of a hybrid deep learning model that combines 3D Auto-encoders with attention mechanisms to detect lung cancer early from CT scan images. The study aims to improve diagnostic accuracy, sensitivity, and specificity by focusing on key features in the scans.

Materials and methods

A hybrid model was developed that combines feature extraction using 3D Auto-encoder networks with attention mechanisms. First, the 3D Auto-encoder model was tested without attention, using feature selection techniques such as RFE, LASSO, and ANOVA. This was followed by evaluation using several classifiers: SVM, RF, GBM, MLP, LightGBM, XGBoost, Stacking, and Voting. The model's performance was evaluated based on accuracy, sensitivity, F1-Score, and AUC-ROC. After that, attention mechanisms were added to help the model focus on important areas in the CT scans, and the performance was re-assessed.

Results

The 3D Auto-encoder model without attention achieved an accuracy of 93% and sensitivity of 89%. When attention mechanisms were added, the performance improved across all metrics. For example, the accuracy of SVM increased to 94%, sensitivity to 91%, and AUC-ROC to 0.96. Random Forest (RF) also showed improvements, with accuracy rising to 94% and AUC-ROC to 0.93. The final model with attention improved the overall accuracy to 93.4%, sensitivity to 90.2%, and AUC-ROC to 94.1%. These results highlight the important role of attention in identifying the most relevant features for accurate classification.

Conclusions

The proposed hybrid deep learning model, especially with the addition of attention mechanisms, significantly improves the early detection of lung cancer. By focusing on key features in the CT scans, the attention mechanism helps reduce false negatives and boosts overall diagnostic accuracy. This approach has great potential for use in clinical applications, particularly in the early-stage detection of lung cancer.

Keywords

lung cancer CT scan machine learning 3D auto-encoders CNN medical imaging

Get full access to this article

View all access options for this article.

References

Adams

Stone

Baldwin

, et al. Lung cancer screening. Lancet 2023; 401: 390–408.

Thandra

Barsouk

Saginala

, et al. Epidemiology of lung cancer. Contemp Oncol Onkol 2021; 25: 45–52.

Yang

Wang

, et al. 2D CNN versus 3D CNN for false-positive reduction in lung cancer screening. J Med Imaging 2020; 7: 51202.

de Koning

van Der Aalst

de Jong

, et al. Reduced lung-cancer mortality with volume CT screening in a randomized trial. N Engl J Med 2020; 382: 503–513.

Hoffman

Atallah

Struble

, et al. Lung cancer screening with low-dose CT: a meta-analysis. J Gen Intern Med 2020; 35: 3015–3025.

Hunger

Wanka-Pail

Brix

, et al. Lung cancer screening with low-dose CT in smokers: a systematic review and meta-analysis. Diagnostics 2021; 11: 1040.

Avanzo

Wei

Stancanello

, et al. Machine and deep learning methods for radiomics. Med Phys 2020; 47: e185–e202.

Wang

De Man

. Deep learning for tomographic image reconstruction. Nat Mach Intell 2020; 2: 737–748.

Chugh

Kumar

Singh

. Survey on machine learning and deep learning applications in breast cancer diagnosis. Cognit Comput 2021; 13: 1451–1470.

10.

Khan

Sohail

Zahoora

, et al. A survey of the recent architectures of deep convolutional neural networks. Artif Intell Rev 2020; 53: 5455–5516.

11.

Ghavami

Gibson

, et al. Automatic segmentation of prostate MRI using convolutional neural networks: investigating the impact of network architecture on the accuracy of volume measurement and MRI-ultrasound registration. Med Image Anal 2019; 58: 101558.

12.

Basha

SHS

Dubey

Pulabaigari

, et al. Impact of fully connected layers on performance of convolutional neural networks for image classification. Neurocomputing 2020; 378: 112–119.

13.

AkbarnezhadSany

EntezariZarch

AlipoorKermani

, et al. YOLOv8 outperforms traditional CNN models in mammography classification: insights from a multi-institutional dataset. *International Journal of Imaging Systems and Technology* 2024; 35: 70008.

14.

Clark

Zhang

Baig

, et al. Fully automated segmentation of prostate whole gland and transition zone in diffusion-weighted MRI using convolutional neural networks. J Med Imaging 2017; 4: 41307.

15.

Ypsilantis

Siddique

Sohn

, et al. Predicting response to neoadjuvant chemotherapy with PET imaging using convolutional neural networks. PLoS One 2015; 10: e0137036.

16.

Aloysius

Geetha

. A review on deep convolutional neural networks. In: 2017 International conference on communication and signal processing (ICCSP). Chennai, India: IEEE, 2017, pp.588–592.

17.

Yoo

Gujrathi

Haider

, et al. Prostate cancer detection using deep convolutional neural networks. Sci Rep 2019; 9: 19518.

18.

Park

Kwak

. Analysis on the dropout effect in convolutional neural networks. In: Asian conference on computer vision. Switzerland: Springer, 2016, pp.189–204.

19.

Wang

Chen

, et al. Mixed pooling for convolutional neural networks. In: International conference on rough sets and knowledge technology. Switzerland: Springer, 2014, pp.364–375.

20.

Mahboubisarighieh

Shahverdi

Jafarpoor Nesheli

, et al. Assessing the efficacy of 3D dual-CycleGAN model for multi-contrast MRI synthesis. Egypt J Radiol Nucl Med 2024; 55: 1–12.

21.

Bijari

Sayfollahi

Mardokh-Rouhani

, et al. Radiomics and deep features: robust classification of brain hemorrhages and reproducibility analysis using a 3D autoencoder neural network. Bioengineering 2024; 11: 643.

22.

Joshua

ESN

Chakkravarthy

Bhattacharyya

. Lung cancer detection using improvised grad-cam++ with 3D CNN class activation. In: Smart technologies in data science and communication: proceedings of SMART-DSC 2021. Singapore: Springer, 2021, pp.55–69.

23.

Eldho

Nithyanandh

. Lung cancer detection and severity analysis with a 3D deep learning CNN model using CT-DICOM clinical dataset. Indian J Sci Technol 2024; 17: 899–910.

24.

Huang

Xie

, et al. Joint-phase attention network for breast cancer segmentation in DCE-MRI. Expert Syst Appl 2023; 224: 119962.

25.

Ren

, et al. IHA-Net: an automatic segmentation framework for computer-tomography of tiny intracerebral hemorrhage based on improved attention U-net. Biomed Signal Process Control 2023; 80: 104320.

26.

Lou

Qian

, et al. Mammogram classification based on a novel convolutional neural network with efficient channel attention. Comput Biol Med 2022; 150: 106082.

27.

Liang

, et al. Self-supervised transfer learning framework driven by visual attention for benign–malignant lung nodule classification on chest CT. Expert Syst Appl 2023; 215: 119339.

28.

Bobowicz

Rygusik

Buler

, et al. Attention-based deep learning system for classification of breast lesions—multimodal, weakly supervised approach. Cancers (Basel) 2023; 15: 2704.

29.

Gao

Zhong

, et al. Attention-based deep learning for the preoperative differentiation of axillary lymph node metastasis in breast cancer on DCE-MRI. J Magn Reson Imaging 2023; 57: 1842–1853.

30.

Wang

Farooq

Zhuang

, et al. Segmentation of intracranial hemorrhage using semi-supervised multi-task attention-based U-net. Appl Sci 2020; 10: 3297.

31.

Ullah

Usman

Latif

, et al. Densely attention mechanism based network for COVID-19 detection in chest X-rays. Sci Rep 2023; 13: 261.

32.

Nasir

Alrasheedi

Alreshidi

. MFAN: multi-feature attention network for breast cancer classification. Mathematics 2024; 12: 3639.

33.

Dong

Liao

Liu

, et al. A review of the autoencoder and its variants: a comparative perspective from target recognition in synthetic-aperture radar images. IEEE Geosci Remote Sens Mag 2018; 6: 44–68.

34.

Wankhade

Vigneshwari

. A novel hybrid deep learning method for early detection of lung cancer using neural networks. Healthc Anal 2023; 3: 100195.

35.

Ahmed

Parvin

Haque

, et al. Lung cancer detection using CT image based on 3D convolutional neural network. J Comput Commun 2020; 8: 35.

36.

Saravanaprasad

Karuppusamy

. Advanced lung tumor diagnosis using a 3D deep neural network based CAD system. Biomed Signal Process Control 2024; 89: 105650.

37.

Pradhan

Sarma

Dey

. Lung cancer detection using 3D convolutional neural networks. In: 2020 International conference on computational performance evaluation (ComPE). Shillong, India: IEEE, 2020, pp.765–770.