Deep-learning-based crack detection with applications for the structural health monitoring of gas turbines

Abstract

Gas turbine maintenance requires consistent inspections of cracks and other structural anomalies. The inspections provide information regarding the overall condition of the structures and yield information for estimating structural health and repair costs. Various image processing techniques have been used in the past to address the problem of automated visual crack detection with varying degrees of success. In this work, we propose a novel crack detection framework that utilizes techniques from both classical image processing and deep learning methodologies. The main contribution of this work is demonstrating that applying filters to image data in the pre-processing phase can significantly boost the classification performance of a convolutional neural network–based model. The developed architecture outperforms compared works by yielding a 96.26% classification accuracy on a data set of cracked surface images collected from gas turbines.

Keywords

Convolutional neural network CNN image processing crack detection gas turbine machine learning deep learning classification computer vision structural health monitoring

Get full access to this article

View all access options for this article.

References

Wang

, et al. Research on crack detection method of airport runway based on twice-threshold segmentation. In: Proceedings of 5th international conference on instrumentation and measurement, computer, communication, and control (IMCCC 2015), Qinhuangdao, China, 18–20 September 2015, pp. 1716–1720. New York: IEEE.

Zou

Cao

, et al. CrackTree: Automatic crack detection from pavement images. Pattern Recogn Lett 2012; 33: 3227–3238.

Oliveira

Correia

. Automatic road crack segmentation using entropy and image dynamic thresholding. In: European signal processing conference (Eusipco), Glasgow, 24–28 August 2009, pp. 622–626. New York: IEEE.

Fan

, et al. Automatic pavement crack detection based on structured prediction with the convolutional neural network. arXiv preprint, arXiv:1802.02208, 2018.

Stentoumis

Protopapadakis

Doulamis

, et al. A holistic approach for inspection of civil infrastructures based on computer vision techniques. Int Arch Photogramm 2016; 41: 131–138.

Cha

Y-J

Choi

Büyüköztürk

. Deep learning-based crack damage detection using convolutional neural networks. Comput-Aided Civ Inf 2017; 32: 5361–5378.

Krizhevsky

Sutskever

Hinton

GE.

ImageNet classification with deep convolutional neural networks. In: Advances in neural information processing systems, Lake Tahoe, NV, 3–6 December 2012, pp. 1097–1105. Red Hook, NY: Curran Associates.

Zhang

Yang

Zhang

, et al. Road crack detection using deep convolutional neural network. In: 2016 IEEE international conference on image processing (ICIP), Phoenix, AZ, 25–28 September 2016, pp. 3708–3712. New York: IEEE.

Yeum

Dyke

. Vision-based automated crack detection for bridge inspection. Comput-Aided Civ Inf 2015; 30: 10759–10770.

10.

Yang

, et al. Automatic pixel-level crack detection and measurement using fully convolutional network. Comput-Aided Civ Inf 2018; 33: 1090–1109.

11.

Zhang

. Pixel-level crack delineation in images with convolutional feature fusion. Struct Control Hlth 2018; 26: e2286.

12.

Ronneberger

Fischer

Brox

. U-net: convolutional networks for biomedical image segmentation. In: International Conference on Medical image computing and computer-assisted intervention, Munich, 5–9 October 2015, pp. 234–241. Cham: Springer.

13.

Maeda

Sekimoto

Seto

, et al. Road damage detection using deep neural networks with images captured through a smartphone. arXiv preprint, arXiv:1801.09454, 2018.

14.

Makantasis

Protopapadakis

Doulamis

, et al. Deep convolutional neural networks for efficient vision based tunnel inspection. In: Proceedings of the 2015 IEEE 11th international conference on intelligent computer communication and processing (ICCP 2015), Cluj-Napoca, 3–5 September 2015, pp. 335–342. New York: IEEE.

15.

Chollet

F. Keras

, 2015, https://github.com/fchollet/keras

16.

Chan

C-W

Nikolova

. Salt-and-pepper noise removal by median-type noise detectors and detail-preserving regularization. IEEE T Image Process 2005; 14(10): 1479–1485.

17.

Tomasi

Manduchi

. Bilateral filtering for gray and color images. In: Sixth international conference on computer vision (IEEE Cat. No.98CH36271), Bombay, India, 7 January 1998, pp. 839–846. New York: IEEE.

18.

Perona

Malik

. Scale-space and edge detection using anisotropic diffusion. IEEE T Pattern Anal 1990; 12(7): 629–639.

19.

Eisenbach

Stricker

Seichter

, et al. How to get pavement distress detection ready for deep learning? A systematic approach. In: Proceedings of the IEEE international joint conference on neural networks, Anchorage, AK, 14–19 May 2017.

20.

Pauly

Hogg

Fuentes

, et al. Deeper networks for pavement crack detection. In: Proceedings of the 34th ISARC, Taipei, Taiwan, 28 June–1 July 2017, pp. 479–485. Slovakia: IAARC.

21.

Shi

Cui

, et al. Automatic road crack detection using random structured forests. IEEE T Intell Transp 2016; 17(12): 3434–3445.