The diagnosis performance of convolutional neural network in the detection of pulmonary nodules: a systematic review and meta-analysis

Abstract

Background

Pulmonary nodules are an early imaging indication of lung cancer, and early detection of pulmonary nodules can improve the prognosis of lung cancer. As one of the applications of machine learning, the convolutional neural network (CNN) applied to computed tomography (CT) imaging data improves the accuracy of diagnosis, but the results could be more consistent.

Purpose

To evaluate the diagnostic performance of CNN in assisting in detecting pulmonary nodules in CT images.

Material and Methods

PubMed, Cochrane Library, Web of Science, Elsevier, CNKI and Wanfang databases were systematically retrieved before 30 April 2023. Two reviewers searched and checked the full text of articles that might meet the criteria. The reference criteria are joint diagnoses by experienced physicians. The pooled sensitivity, specificity and the area under the summary receiver operating characteristic curve (AUC) were calculated by a random-effects model. Meta-regression analysis was performed to explore potential sources of heterogeneity.

Results

Twenty-six studies were included in this meta-analysis, involving 2,391,702 regions of interest, comprising segmented images with a few wide pixels. The combined sensitivity and specificity values of the CNN model in detecting pulmonary nodules were 0.93 and 0.95, respectively. The pooled diagnostic odds ratio was 291. The AUC was 0.98. There was heterogeneity in sensitivity and specificity among the studies. The results suggested that data sources, pretreatment methods, reconstruction slice thickness, population source and locality might contribute to the heterogeneity of these eligible studies.

Conclusion

The CNN model can be a valuable diagnostic tool with high accuracy in detecting pulmonary nodules.

Keywords

Pulmonary nodules deep learning convolutional neural network diagnosis subgroup analysis

Get full access to this article

View all access options for this article.

References

Hansell

Bankier

MacMahon

, et al. Fleischner society: glossary of terms tor thoracic imaging. Radiology 2008;246:697–722.

Callister

Baldwin

Akram

, et al. British thoracic society guidelines for the investigation and management of pulmonary nodules. Thorax 2015;70:ii1–ii54.

Ost

Fein

. Evaluation and management of the solitary pulmonary nodule. Am J Respir Crit Care Med 2000;162:782–787.

Gould

Tang

Liu

, et al. Recent trends in the identification of incidental pulmonary nodules. Am J Respir Crit Care Med 2015;192:1208–1214.

Gould

Fletcher

Iannettoni

, et al. Evaluation of patients with pulmonary nodules: when is it lung cancer: ACCP evidence-based clinical practice guidelines. Chest 2007;132:108S–130S.

National Lung Screening Trial Research Team, Aberle

Adams

, et al. Reduced lung-cancer mortality with low-dose computed tomographic screening. N Engl J Med 2011;365:395–409.

Armato

III Roberts

Kocherginsky

, et al. Assessment of radiologist performance in the detection of lung nodules: dependence on the definition of “truth”. Acad Radiol 2009;16:28–38.

Zhao

Wang

, et al. Identification of gastric cancer with convolutional neural networks: a systematic review. Multimed Tools Appl 2022;18:1–20.

Setio

Ciompi

Litjens

, et al. Pulmonary nodule detection in CT images: false positive reduction using multi-view convolutional networks. IEEE Trans Med Imaging 2016;35:1160–1169.

10.

Hamidian

Sahiner

Petrick

, et al. 3D Convolutional neural network for automatic detection of lung nodules in chest CT. Proc SPIE Int Soc Opt Eng 2017;10134:1013409.

11.

Zhang

Peng

Guo

. Pulmonary nodules detection based on multi-scale attention networks. Sci Rep 2022;12:1466.

12.

Yang

Gang

Yao

, et al. The diagnostic accuracy of artificial intelligence in thoracic diseases: a protocol for systematic review and meta-analysis. Medicine (Baltimore) 2020;99:e19114.

13.

Whiting

Rutjes

Westwood

, et al. QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Ann Intern Med 2011;155:529–536.

14.

Higgins

Thompson

. Quantifying heterogeneity in a meta-analysis. Stat Med 2002;21:1539–1558.

15.

Dinnes

Deeks

Kirby

, et al. A methodological review of howheterogeneity has been examined in systematic reviews of diagnostic test accuracy. Health Technol Assess 2005;9:1–iii.

16.

Moses

Shapiro

Littenberg

. Combining independent studies of a diagnostic test into a summary ROC curve: data-analytic approaches and some additional considerations. Stat Med 1993;12:1293–1316.

17.

Deeks

Macaskill

Irwig

. The performance of tests of publication bias and other sample size effects in systematic reviews of diagnostic test accuracy was assessed. J Clin Epidemiol 2005;58:882–893.

18.

Caraguel

CGB

Vanderstichel

. The two-step Fagan’s nomogram: ad hoc interpretation of a diagnostic test result without calculation. Evidence Based Medicine 2013;18:125–128.

19.

. Computer-aided diagnosis of pulmonary nodules based on CT images . Master Thesis, Dalian University of Technology, Dalian, Shandong, China, 2017.

20.

Feng

Jiang

. Deep learning-based chest CT image features in diagnosis of lung cancer. Comput Math Methods Med 2022:4153211.

21.

Jin

Wang

. Application of intelligent auxiliary diagnostic system for chest CT based on artificial intelligence in LDCT data set. Chin J Med Imaging 2018;24:373–377.

22.

Meng

Gao

Guo

, et al. Application of computer aided diagnosis system based on multi-stage three-dimensional deep convolutional neural network in lung cancer screening. Chin J Radiol 2020;54:552–556.

23.

Perl

Grimmer

Hepp

, et al. Can a novel deep neural network improve the computer-aided detection of solid pulmonary nodules and the rate of false-positive findings in comparison to an established machine learning computer-aided detection. Invest Radiol 2021;56:103–108.

24.

Chen

Liu

. Application of intelligent auxiliary diagnostic system for chest CT based on artificial intelligence in LDCT data set. Mod Med Imaging 2020;29:72–73.

25.

Chen

. Deep learning based lung nodules recognition method in CT images . Master Thesis, Hebei University of Geosciences, Shijiazhuang, Hebei, China, 2018.

26.

Liu

Hou

, et al. A convolutional neural network based detection method for pulmonary nodules. J Biomed Eng 2019;36:969–977. 985.

27.

Yang

Jiang

Ling

, et al. A pulmonary nodule detection algorithm based on low dose CT images. In: 3rd International symposium on image computing and digital medicine (ISICDM), Xi’an, China, 2019, pp.239–243.

28.

Peng

. A serialized classification method for pulmonary nodules based on lightweight cascaded convolutional neural network-long short-term memory. Int J Imaging Syst Technol 2020;30:950–962.

29.

Chen

Jiao

. Detection of pulmonary nodules based on improved faster R-CNN and 3D DCNN. Comput Appl Res 2019;4:3511–3515.

30.

Wang

. Study on the detection method of pulmonary nodules based on integrated convolutional neural network . Master Thesis, Beijing University of Chemical Industry, Beijing, China, 2019.

31.

. Convolutional self-coding neural network for pulmonary nodules detection . Master Thesis, Huazhong University of Science and Technology, Wuhan, Hubei, China, 2017.

32.

Zhu

Xiao

. Research on the automatic detection method of pulmonary nodules based on deep learning. IOP Conf Ser Mater Sci Eng 2020;790:012114.

33.

Sun

Huang

, et al. Automatic lung nodule graph cuts segmentation with deep learning false positive reduction. Proc SPIE 2017;10134:101343M.

34.

da Silva

GLF

Valente

TLA

Silva

, et al. Convolutional neural network-based PSO for lung nodule false positive reduction on CT images. Comput Methods Programs Biomed 2018;162:109–118.

35.

Cao

Xing

Pang

, et al. Detection of pulmonary nodules based on improved vgg-16 convolutional neural network. Chin J Med Physics 2020;37:940–944.

36.

Naqi

Sharif

Jaffar

. Lung nodule detection and classification based on geometric fit in parametric form and deep learning. Neural Comput & Applic 2020;32:4629–4647.

37.

Abadia

Yacoub

Stringer

, et al. Diagnostic accuracy and performance of artificial intelligence in detecting lung nodules in patients with complex lung disease: a noninferiority study. J Thorac Imaging 2022;37:154–161.

38.

Agnes

Anitha

Solomon

. Two-stage lung nodule detection framework using enhanced UNet and convolutional LSTM networks in CT images. Comput Biol Med 2022;149:106059.

39.

Gao

Jiang

Zhou

, et al. Lung nodule detection using convolutional neural networks with transfer learning on CT images. Comb Chem High Throughput Screen 2021;24:814–824.

40.

Zuo

Zhou

, et al. Multi-resolution CNN and knowledge transfer for candidate classification in lung nodule detection. IEEE Access 2019;7:32510–32521.

41.

Tran

Nghiem

Nguyen

, et al. Improving accuracy of lung nodule classification using deep learning with focal loss. J Healthc Eng 2019;2019:5156416.

42.

Manickavasagam

Selvan

. CAD System for lung nodule detection using deep learning with CNN. Med Biol Eng Comput 2022;60:221–228.

43.

Yuan

Cheng

, et al. Pulmonary nodule detection using 3-D residual U-net oriented context-guided attention and multi-branch classification network. IEEE Access 2022;10:82–98.

44.

Yang

Wang

, et al. 2D CNN versus 3D CNN for false-positive reduction in lung cancer screening. J Med Imaging (Bellingham) 2020;7:051202.

45.

Cao

Yang

. Application of deep learning in the diagnosis of pulmonary nodules. Prog Laser Optoelectron 2021;58:104–117.

46.

Hansen

Zhao

Yerebakan

, et al. False positive reduction of vasculature for pulmonary nodule detection. Med Imaging 2020;11314:113–142.

47.

Ather

Kadir

Gleeson

. Artificial intelligence and radiomics in pulmonary nodule management: current status and future applications. Clin Radiol 2020;75:13–19.

48.

Armato

McLennan

Bidaut

, et al. The lung image database consortium (LIDC) and image database resource initiative (IDRI): a completed reference database of lung nodules on CT scans. Med Phys 2011;38:915–931.

49.

Huang

, et al. Effects of contrast-enhancement, reconstruction slice thickness and convolution kernel on the diagnostic performance of radiomics signature in solitary pulmonary nodule. Sci Rep 2016;6:34921.

50.

Bai

Choi

Chu

, et al. Evaluation of pulmonary nodules: clinical practice consensus guidelines for Asia. Chest 2016;150:877–893.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.13 MB