The Central Nervous System (CNS) is one of the most crucial parts of the human body. Brain tumor is one of the deadliest diseases that affect CNS and they should be detected earlier to avoid serious health implications. As it is one of the most dangerous types of cancer, its diagnosis is a crucial part of the healthcare sector. A brain tumor can be malignant or benign and its grade recognition is a tedious task for the radiologist. In the recent past, researchers have proposed various automatic detection and classification techniques that use different imaging modalities focusing on increased accuracy. In this paper, we have done an in-depth study of 19 different trained deep learning models like Alexnet, VGGnet, DarkNet, DenseNet, ResNet, InceptionNet, ShuffleNet, NasNet and their variants for the detection of brain tumors using deep transfer learning. The performance parameters show that NASNet-Large is outperforming others with an accuracy of 98.03% for detection and 97.87% for classification. The thresholding algorithm is used for segmenting out the tumor region if the detected output is other than normal.
XingF.XieY.SuH.LiuF. and YangL., Deep learning in microscopy image analysis: A survey, IEEE Transactions on Neural Network Learning System10(29) (2017), 4550–4568.
2.
MaC.LuoG. and WangK., Concatenated and connected random forests with multiscale patch driven active contour model for automated brain tumor segmentation of MR images, IEEE Transactions on Neural Medical Imaging8(10) (2018), 1943–1954.
3.
LiaoF.LiangM.LiZ.HuX. and SongS., Evaluate the malignancy of pulmonary nodules using the 3-D deep leaky noisy-OR network, IEEE Transactions on Neural Network Learning System11(30) (2019), 3484–3495.
4.
TangZ.AhmadS.YapP.T. and ShenD., Multi-atlas segmentation of MR tumor brain images using low-rank based image recovery, IEEE Transactions on Neural Medical Imaging10(37) (2018), 2224–2235.
5.
NieD.WangL.GaoY.LianJ. and ShenD., STRAINet: Spatially varying stochastic residual AdversarIal networks for MRI pelvic organ segmentation, IEEE Transactions on Neural Network Learning System5(30) (2019), 1552–1564.
6.
ZhaoZ.-Q.ZhengP.XuS.-t. and WuX., Object Detection with Deep Learning: A Review, IEEE Transactions on Neural Networks and Learning Systems, 2018, 1–21.
7.
ThomasD. and RaviT., The potential for artificial intelligence in healthcare, Future Healthcare Journal2(6) (2019), 94–98.
8.
KhanM.SalmanK.JavierD.S. and Victor HugoC., Deep learning for multigrade brain tumor classification in smart healthcare systems: A prospective survey, IEEE Transactions on Neural Networks and Learning Systems2(32) (2021), 507–522.
9.
LotlikarV.S.SatputeN. and GuptaA., Brain tumor detection using machine learning and deep learning: A review, Curr Med Imaging18(6) (2021), 604–622.
10.
IanJ.T. and JorgeC., Principal component analysis: A review and recent developments, Philosophical Transactions of the Royal Society2065(374) (2016).
11.
LaurensM.V.EricP. and Jaap Van DenH., Dimensionality Reduction: A Comparative Review, Journal of Machine Learning Research, 2007, 44–58.
12.
SorzanoC.O.S.VargasJ. and Pascual MontanoA., A survey of dimensionality reduction techniques, In book: Recent Advances in Computer Based Systems, Processes and Applications, 2020.
13.
ShortenC. and KhoshgoftaarT.M., A survey on Image Data Augmentation for Deep Learning, Springer Journal of Big Data, 2019.
14.
OsokinA.ChesselA.SalasR.E.C. and VaggiF., GANs for Biological Image Synthesis, in: IEEE International Conference on Computer Vision (ICCV), 2017, pp. 2252–2261.
15.
AhmedE. et al., GP-GAN: Brain tumor growth prediction using stacked 3D generative adversarial networks from longitudinal MR Images, Elsevier – Neural Networks132 (2020), 321–332.
16.
ValverdeJ.M. et al., Transfer learning in magnetic resonance brain imaging: A systematic review, Journal of Imaging7 (2021).
17.
MariaN.SadiaS. and KhurramK., Role of deep learning in brain tumor detection and classification (2015 to 2020): A review, Computerized Medical Imaging and Graphics91 (2021).
18.
StefanB.RolandW.LutzN.P. and MauricioR., A survey of MRI-based medical image analysis for brain tumor studies, Physics in Medicine and Biology, 2013.
19.
Sanjeev KumarP.M. and SubarnaC., Computer Aided Diagnostic for cancer detection using MRI images of brain (Brain Tumor detection and classification system), in: IEEE Annual India Conference (INDICON), 2016.
20.
KimberlyD.M. et al., Brain and other central nervous system tumor statistics, CA: A Cancer Journal for Clinicians, 2021.
21.
NancyD.D., State of the art science in brain tumor classification, Seminars in Oncology Nursing20(4) (2004), 224–230.
22.
LarobinaM. and LoredanaM., Medical image file formats, PMC Journal of Digital Imaging27 (2014).
23.
KasbanH.El-BendaryM.A.M. and SalamaD.H., A comparative study of medical imaging techniques, International Journal of Information Science and Intelligent System4(2) (2015), 37–58.
24.
BercovichE. and MarciaJ.C., Medical imaging: From roentgen to the digital revolution, and beyond, Rambam Maimonides Medical Journal9 (2018).
25.
HanK.S.McLarenR.W. and LodwickG.S., The Application of an Image-Compression/Feature-Transgeneration Technique to the Computer-Aided Diagnosis of Brain Tumors, IEEE Transactions on Systems, Man and Cybernetics, 1973.
26.
Abd-EllahM.K.AwadA.I.KhalafA.A.M. and HamedH.F.A., Design and implementation of a computer-aided diagnosis system for brain tumor classification, in: 28th International Conference on Microelectronics (ICM), 2016, pp. 73–76.
27.
MatthewC.C.LawrenceH.O.DmitryG.B.RobertV.Reed MurtaghF. and MartinS.S., Automatic tumor segmentation using knowledge-based techniques, IEEE Transactions on Medical Imaging17(2) (1998).
28.
KausM.R.WarfieldS.K.NabaviA.BlackP.M.JoleszF.A. and KikinisR., Automated segmentation of MR images of brain tumors, Radiology218(2) (2001), 586–591.
29.
KleihuesP.LouisD.N.ScheithauerB.W.RorkeL.B.ReifenbergerG.BurgerP.C. and CaveneeW.K., The WHO Classification of tumors of the Nervous System, J. Neuropathol. Exp. Neurol., 2002, 215–225.
30.
KleihuesP. et al., World Health Organisation classification of tumours: Pathology and genetics of tumours of the nervous system, Lyon: IARC Press, 2000.
31.
ZülchK.J., Histologic typing of tumors of the central nervous system, Geneva, Switzerland: World Health Organization, 1979.
32.
KleihuesP. et al., Histological typing of tumors of the central nervous system, World Health Organization international histological classification of tumors, 2nd Ed. Berlin, Heidelberg, Springer Verlag, 1993.
33.
KleihuesP. et al., The new WHO classification of brain tumours, Brain Pathol, 1993.
34.
DavidL.N.HirokoO.OtmarW.D.WebsterC.K.PeterB.C.AnneJ.BerndS.W. and PaulK., The 2007 WHO Classification of Tumours of the Central Nervous System, Acta Neuropathol, 2007.
35.
ChunlinL.DmitryG.B. and LawrenceH.O., Knowledge-Based Classification and Tissue Labeling of MR Images of Human Brain, IEEE Transactions on Medical Imaging4(12) (1993).
36.
ChuanL.AndyD.JohanA.K.S.CarlesA. and SabineV.H., Bagging linear sparse bayesian learning models for variable selection in cancer diagnosis, IEEE Transactions on Information Technology in Biomedicine3(11) (2007).
37.
CarlosC.D. and Kwan-LiuM., The occlusion spectrum for volume classification and visualization, IEEE Transactions on Visualization and Computer Graphics6(15) (2009).
38.
SahaB.N.RayN.GreinerR.MurthaA. and ZhangH., Quick detection of brain tumors and edemas: a bounding box method using symmetry, Comput. Med. Imaging Graph., 2011.
39.
WeiW.AlbertC.Y.C.LiangZ. and JasonC.J., Brain tumor detection and segmentation in a CRF (conditional random fields) framework with pixel-pairwise affinity and superpixel-level features, International Journal of Computer Assisted Radiology and Surgery2 (2013).
40.
MuhammadN.AsimB. and AasiaK., Brain Tumor Classification in MRI Scans using Sparse Representation, Springer Journal: Lecture Notes in Computer Science Image and Signal Processing, 2014, 629–637.
41.
SyedR.M.S.RandallM. and KhanI.M., Multi-fractal Detrended Texture Feature for Brain Tumor Classification, Proceedings of SPIE – The International Society for Optical Engineering, 2015.
42.
AhmmedR.SwaksharA.S.HossainM.F. and RafiqM.A., Classification of tumors and its stages in brain MRI using support vector machine and artificial neural network, in: International Conference on Electrical, Computer and Communication Engineering (ECCE), 2017, pp. 229–234.
43.
NileshB.B.Arun KumarR. and Har PalT., Image Analysis for MRI Based Brain Tumor Detection and Feature Extraction Using Biologically Inspired BWT and SVM, Hindawi – International Journal of Biomedical Imaging, 2017.
44.
KhalidU. and KashifR., Brain tumor classification from multi-modality MRI using wavelets and machine learning, Pattern Analysis & Applications3(20) (2017), 871–881.
45.
JaveriaA.MuhammadS.MussaratY. and StevenF.L., A Distinctive Approach to Brain Tumor Detection and Classification using MRI, Elsevier Pattern Recognition Letters, 2017.
46.
SanjeevK.ChetnaD. and SunilaG., Classification of Brain MRI Tumor Images: A hybrid approach, Elsevier – Procedia Computer Science122 (2017), 510–517.
47.
JustinP.S.AndrewP.J.BennettL.A. and DanielF., Deep Learning for Brain Tumor Classification, Medical Imaging: Biomedical Applications in Molecular, Structural, and Functional Imaging10137 (2017).
48.
BerkanU., A Computerâ€Based Brain Tumor Detection Approach with Advanced Image Processing and Probabilistic Neural Network Methods, Journal of Medical and Biological Engineering, 2017.
49.
JaveriaA.MuhammadS.MussaratY. and StevenF.L., Big data analysis for brain tumor detection: Deep convolutional neural networks, Elsevier – Future Generation Computer Systems, 2018.
50.
HebaM.El-SayedE.A.El-SayedE.M. and Abdel-BadeehS.M., Classification using deep learning neural networks for brain tumors, Future Computing and Informatics Journal1(3) (2018), 68–71.
51.
Mohamed ShakeelP.TarekT.E.E.HaythamA.GunasekaranM. and BaskarS., Neural network based brain tumor detection using wireless infrared imaging sensor, IEEE Access7 (2019), 5577–5588.
52.
MuhammadS.SalmanK.KhanM.WanqingW.AminU. and Sung WookB., Multi-Grade Brain Tumor Classification using Deep CNN with Extensive Data Augmentation, Journal of Computational Science30 (2019), 174–182.
53.
Rupa Ezhil ArasiP. and SuganthiM., A Clinical Support System for Brain Tumor Classification Using Soft Computing Techniques, Springer Journal of Medical Systems, 2019.
54.
AminJ.SharifM.YasminM. et al., A New Approach for Brain Tumor Segmentation and Classification Based on Score Level Fusion Using Transfer Learning, Springer Journal of Medical Systems, 2019.
55.
NeelumN.SellappanP.AbdulQ.IftikharA.MuhammadI. and MuhammadS., A deep learning model based on concatenation approach for the diagnosis of brain tumor, IEEE Access8 (2020), 55135–55144.
56.
NavidG.AfshinS. and ModjtabaR., Deep neural network with generative adversarial networks pre-training for brain tumor classification based on MR images, Biomedical Signal Processing and Control57 (2020).
57.
JiaZ. and ChenD., Brain Tumor Identification and Classification of MRI images using deep learning techniques, IEEE Access, 2020.
58.
PeiL.VidyaratneL.RahmanM.M. et al., Context aware deep learning for brain tumor segmentation, subtype classification, and survival prediction using radiology images, Scientific Reports10 (2020), 19726.
59.
JeevananthamV. and Mohan BabuG., Detection and diagnosis of brain tumors-framework using extreme machine learning and CANFIS classification algorithms, International Journal of Imaging Systems and Technology, 2020.
60.
KumarR.L.KakarlaJ.IsunuriB.V. et al., Multi-class brain tumor classification using residual network and global average pooling, Springer Journal on Multimedia Tools and Applications, 2021, 13429–13438.
61.
DeepakS. and AmeerP.M., Automated Categorization of Brain Tumor from MRI Using CNN features and SVM, Springer Journal Ambient Intell Human Comput, 2021, 8357–8369.
62.
SharifM.I.KhanM.A.AlhusseinM. et al., A decision support system for multimodal brain tumor classification using deep learning, Complex Intell. Syst., 2021.
63.
KokkallaS.KakarlaJ.VenkateswarluI.B. et al., Three-class brain tumor classification using deep dense inception residual network, Springer Journal of Soft Computing, 2021, 8721–8729.
64.
Bala VenkateswarluI.V. and JagadeeshK., Three-class brain tumor classification from magnetic resonance images using separable convolution based neural network, Online digital library, 2021.
65.
PallaviA.MadasuH. and ShardaV., Classification of brain tumor from magnetic resonance images using probabilistic features and possibilistic Hanman-Shannon transform classifier, International Journal of Imaging Systems and Technology, 2021.
66.
AbdulK.H.SagheerA.MuhammadK.A.UmerF.WasimK.H.ShahanS.Y. and AieshaA., Intelligent Model for Brain Tumor Identification Using Deep Learning, Hindawi Applied Computational Intelligence and Soft Computing, 2022.
67.
ArabahmadiM.FarahbakhshR. and RezazadehJ., Deep Learning for Smart Healthcare-A Survey on Brain Tumor Detection from Medical Imaging, Sensors (Basel), 2022.
68.
AyeshaY.LiQ.CharlesN.O.MohammedJ.A. and HalimaK.B., Brain Tumor Analysis Using Deep Learning and VGG-16 Ensembling Learning Approaches, Applied Sciences Journal14(12) (2022).
69.
LakshmiM.J. and RaoS.N., Brain tumor magnetic resonance image classification: A deep learning approach, Soft Computing13(26) (2022), 6245–6253.
70.
JunW. and LiyuanZ., Brain tumor classification based on attention guided deep learning model, Int. J. Comput. Intell. Syst.1(15) (2022), 35.
71.
ShubhangiS.UdayS.P.SiddharthC.S. and SanjeevJ., Brain Tumor Detection and Classification Using Intelligence Techniques: An Overview, IEEE Access, 2023.
72.
OlgaR.JiaD.HaoS.JonathanK.SanjeevS.SeanM.ZhihengH.AndrejK.AdityaK.MichaelB.AlexanderB.C. and LiF.F., ImageNet Large Scale Visual Recognition Challenge, IJCV, 2015.
73.
AlexK.IlyaS. and GeoffreyH.E., ImageNet Classification with Deep Convolutional Neural Networks, Part of Advances in Neural Information Processing Systems25 (2012).
74.
ChristianS.WeiL.YangqingJ.PierreS.ScottR.DragomirA.DumitruE.VincentV. and AndrewR., Going Deeper with Convolutions, in: International Conference on Computer Vision and Pattern Recognition, 2014.
75.
KarenS. and AndrewZ., Very Deep Convolutional Networks for Large-Scale Image Recognition, in: International Conference on Computer Vision and Pattern Recognition, 2014.
76.
XiangyuZ.XinyuZ.MengxiaoL. and JianS., ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices, in: International Conference on Computer Vision and Pattern Recognition, 2017.
77.
ForrestI.N.SongH.MatthewM.W.KhalidA.WilliamD.J. and KurtK., SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and 0.5MB model size, in: International Conference on Computer Vision and Pattern Recognition, 2016.
78.
AndrewH.G.MenglongZ.BoC.DmitryK.WeijunW.TobiasW.MarcoA. and HartwigA., MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications, in: International Conference on Computer Vision and Pattern Recognition, 2017.
79.
JosephR. and AliF., YOLO9000: Better, Faster, Stronger, in: International Conference on Computer Vision and Pattern Recognition, 2016.
80.
JosephR. and AliF., YOLOv3: An Incremental Improvement, in: International Conference on Computer Vision and Pattern Recognition, 2018.
81.
KaimingH.XiangyuZ.ShaoqingR. and JianS., Deep Residual Learning for Image Recognition, in: International Conference on Computer Vision and Pattern Recognition, 2015.
82.
SergeyI. and ChristianS., Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift, in: International Conference on Computer Vision and Pattern Recognition, 2015.
83.
ChristianS.VincentV.SergeyI.JonathonS. and ZbigniewW., Rethinking the Inception Architecture for Computer Vision, in: International Conference on Computer Vision and Pattern Recognition, 2015.
84.
ChristianS.SergeyI.VincentV. and AlexA., Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning, in: International Conference on Computer Vision and Pattern Recognition, 2016.
85.
FrançoisC., Xception: Deep Learning with Depthwise Separable Convolutions, in: International Conference on Computer Vision and Pattern Recognition, 2016.
86.
BarretZ.VijayV.JonathonS. and QuocL.V., Learning Transferable Architectures for Scalable Image Recognition, in: International Conference on Computer Vision and Pattern Recognition, 2018.
87.
ChawlaN.V.BowyerK.W.HallL.O. and KegelmeyerW.P., SMOTE: Synthetic Minority Over-sampling Technique, in: International Conference on Computer Vision and Pattern Recognition, 2011.
88.
HaiboH.YangB.EdwardoG.A. and ShutaoL., ADASYN: Adaptive synthetic sampling approach for imbalanced learning, in: IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence), 2008.
89.
HyominC. and IvanB.V., Affine Transformation-Based Deep Frame Prediction, Image and Video Processing (eess.IV), 2020.
90.
Anaya-IsazaA. and Mera-JiménezL., Data augmentation and transfer learning for brain tumor detection in magnetic resonance imaging, IEEE Access10 (2022), 23217–23233.
91.
AsifS.YiW.AinQ.U.HouJ.YiT. and SiJ., Improving effectiveness of different deep transfer learning-based models for detecting brain tumors from MR images, IEEE Access10 (2022), 34716–34730.
MenzeB.H. et al., The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS), IEEE Transactions on Medical Imaging10(34) (2015).
94.
MariusL.G.TomV.MauricioR.A.MiguelA.MiguelA.G.B.NicholasA. and MauricioR., Segmentation Propagation from Deformable Atlases for Brain Mapping and Analysis, Brain Research Journal, 2007.
95.
et al.MRBrainS Challenge: Online Evaluation Framework for Brain Image Segmentation in 3T MRI Scans, Computational Intelligence and Neuroscience, 2015.
96.
OlgaR.JiaD.HaoS.JonathanK.SanjeevS.SeanM.ZhihengH.AndrejK.AdityaK.MichaelB.AlexanderC.B. and LiF.F., ImageNet Large Scale Visual Recognition Challenge, IJCV, 2015.
97.
ClarkK.VendtB.SmithK.FreymannJ.KirbyJ.KoppelP.MooreS.PhillipsS.MaffittD.PringleM.TarboxL. and PriorF., The Cancer Imaging Archive (TCIA): Maintaining and operating a public information repository, Journal of Digital Imaging6(26) (2013), 1045–1057.
98.
KatarzynaT.PatrycjaC. and MaciejW., The Cancer Genome Atlas (TCGA): An immeasurable source of knowledge, Contemp Oncol (Pozn)19(1A) (2015), A68–A77.
ZahangirA.M.TarekT.M.ChristopherY.StefanW.PahedingS.Mst ShamimaN.Brian VanE.C.AbdulA.A.S. and VijayanK.A., The History Began from AlexNet: A Comprehensive Survey on Deep Learning Approaches, Computer Vision and Pattern Recognition, 2021.
101.
SofiaV.BrianR.AncaR. and Esther van derK., Confusion Matrix-based Feature Selection, in: Midwest International Conference on Artificial Intelligence and Cognitive Science, 2011.
