GoogleNet transfer learning with improved gorilla optimized kernel extreme learning machine for accurate detection of asphalt pavement cracks

Abstract

Asphalt cracks are the initial indication and major pavement structural distress in the field of civil engineering because it might potentially intimidate road traffic and highway safety. Managing and maintaining pavement structures are the two crucial issues faced eventually by road administrators. It is essential to take immediate action regarding pavement structural damages to prevent its severity. In recent times, there established numerous deep learning-based image processing methods to detect pavement cracks, but due to the presence of interference factors such as noises and road markings in the images, those methods failed to provide high accuracy and efficiency. Therefore, with the aim to yield high accuracy of crack detection, this article designs a novel asphalt pavement crack identification system “GoogleNet transfer learning with improved gorilla optimized kernel extreme learning machine” (GNet TL with IGT-KELM). The road crack images used for perusal are acquired from NHA12D dataset, in which it consists of 40 asphalt pavement images with two different viewpoints. For the purpose of data balancing, some non-crack images are gathered by field survey. The images with large noise distortions and unwanted background information influence crack detection performance so that the preprocessing steps are executed before applying it to the prediction system. The most significant crack and non-crack features from the images are extracted using GNet TL model. With the extracted features, the KELM is well-trained to detect cracks and non-cracks separately. To increase crack detection performance of the classifier, an improved gorilla troop optimizer is introduced to optimize the KELM parameters. The experimental finding reveals that the proposed detection mechanism achieves crack recognition accuracy of about 98.93%, which is considerably greater than compared baseline approaches.

Keywords

Crack detection asphalt pavement GoogleNet transfer learning gorilla troop optimizer crossover kernel extreme learning machine

Get full access to this article

View all access options for this article.

References

Chen

Yao

, et al. The classification and localization of crack using lightweight convolutional neural network with CBAM. Eng Struct 2023; 275: 115–291.

Que

Dai

, et al. Automatic classification of asphalt pavement cracks using a novel integrated generative adversarial networks and improved VGG model. Eng Struct 2023; 277: 115–406.

Zhang

Wang

Mullins

, et al. Integrated APC-GAN and AttuNet framework for automated pavement crack pixel-level segmentation: a new solution to small training datasets. IEEE Trans Intell Transp Syst 2023; 24: 4474–4481.

Shang

Zhang

, et al. Automatic pixel-level pavement sealed crack detection using multi-fusion U-net network. Measurement 2023; 112–475.

Zhong

Fang

, et al. Modeling automatic pavement crack object detection and pixel-level segmentation. Autom Constr 2023; 150: 104–840.

Liu

Wang

Deep learning and infrared thermography for asphalt pavement crack severity classification. Autom Constr 2022; 140: 104–383.

Liu

Wang

, et al. Automated asphalt pavement damage rate detection based on optimized GA-CNN. Autom Constr 2022; 136: 104–180.

Yang

Zhou

Wang

, et al. Application of signal processing and support vector machine to transverse cracking detection in asphalt pavement. J Cent South Univer 2021; 28: 2451–2462.

Han

Deng

Dong

, et al. An advanced Otsu method integrated with edge detection and decision tree for crack detection in highway transportation infrastructure. Adv Mater Sci Eng 2021; 2021: 9205509.

10.

Safaei

Smadi

Masoud

, et al. An automatic image processing algorithm based on crack pixel density for pavement crack detection and classification. Int J Pav Res Technol 2022; 15(1): 159–172.

11.

Hoang

Huynh

Tran

, et al. A novel approach for detection of pavement crack and sealed crack using image processing and salp swarm algorithm optimized machine learning. Adv Civ Eng 2022.

12.

Cao

Chang

Nguyen

, et al. Image processing-based automatic detection of asphalt pavement rutting using a novel metaheuristic optimized machine learning approach. Soft Comput 2021; 25(20): 12839–12855.

13.

Han

Chen

Liu

, et al. Vision-based crack detection of asphalt pavement using deep convolutional neural network. Iran J Sci Technol Trans Civ Eng 2021; 45: 2047–2055.

14.

Tran

Lee

, et al. One stage detector (RetinaNet)-based crack detection for asphalt pavements considering pavement distresses and surface objects. J Civ Struct Health Monit 2021; 11: 205–222.

15.

Yan

Zhang

Automated Asphalt highway pavement crack detection based on deformable single shot multi-box detector under a complex environment. IEEE Access 2021; 9: 150925–150938.

16.

Liu

Ren

, et al. Automatic recognition and analysis system of asphalt pavement cracks using interleaved low-rank group convolution hybrid deep network and SegNet fusing dense condition random field. Measurement 2021; 170: 108–693.

17.

Ahmadi

Khalesi

Golroo

An integrated machine learning model for automatic road crack detection and classification in urban areas. Int J Pavement Eng 2022; 23(10): 3536–3552.

18.

Ranjbar

Nejad

Zakeri

An image-based system for pavement crack evaluation using transfer learning and wavelet transform. Int J Pavement Res Technol 2021; 14: 437–449.

19.

Abdollahzadeh

Soleimanian Gharehchopogh

Mirjalili

Artificial gorilla troops optimizer: a new nature-inspired metaheuristic algorithm for global optimization problems. Int J Intell Syst 2021; 36(10): 5887–5958.

20.

Yue

An improved whale optimization algorithm based on multilevel threshold image segmentation using the Otsu method. Eng Appl Artif Intell 2022; 113: 104–960.

21.

Huang

Chen

Al-Tabbaa

, et al. NHA12D: a new pavement crack dataset and a comparison study of crack detection algorithms. arXiv preprint arXiv 2022; 2205-01198.

22.

Cubero-Fernandez

Rodriguez-Lozano

Villatoro

, et al. Efficient pavement crack detection and classification. EURASIP J Image Video Process 2017; 2017: 1–11

23.

Zhou

Wang

Meghanathan

, et al. Seed-based approach for automated crack detection from pavement images. Transp Res Rec 2016; 2589(1): 162–171.

24.

Wang

Zeng

Liu

, et al. Deep belief network integrating improved kernel-based extreme learning machine for network intrusion detection. IEEE Access 2021; 9: 16062–16091.

25.

Hammouch

Chouiekh

Khaissidi

, et al. Crack detection and classification in Moroccan Pavement using convolutional neural network. Infrastructures 2022; 7(11): 152.

26.

Sharma

Dhir

Rani

Crack detection in concrete using transfer learning. Adv Math Sci 2020; J 9(6): 3895–3906.

27.

Islam

Hossain

Akhtar

, et al. CNN based on transfer learning models using data augmentation and transformation for detection of concrete crack. Algorithms 2022; 15(8): 287.

28.

Liu

Wang

Asphalt pavement fatigue crack severity classification by infrared thermography and deep learning. Autom Constr 2022; 143: 104–575.