The automatic segmentation of road cracks is pivotal for detecting engineering road defects. This paper proposes a crack segmentation method based on the DeepLabV3+ model, which integrates the attention mechanism and dynamic snake convolution. The attention module enhances both channel and spatial attention. The dynamic snake convolution is employed to precisely capture features of linear structures, with adaptability to focus on elongated and tortuous local structures. The module’s design ensures effective preservation of crucial information across different global morphologies, and significantly improves the extraction of detailed features, leading to more accurate segmentation outcomes. The proposed method demonstrates state-of-the-art results on two benchmark datasets, DeepCrack and Crack500. On DeepCrack, it achieves an accuracy, recall, , and MIoU scores of 94.1%, 93.6%, 89.4%, and 89.4%, respectively. On Crack500, the recall, , and MIoU scores are 89.4%, 83.9%, and 82.9%, respectively.
Al-HudaZ.PengB.AlgburiR. N. A., et al. (2023). A hybrid deep learning pavement crack semantic segmentation. Engineering Applications of Artificial Intelligence, 122, 106142.
2.
BadrinarayananV.KendallA.CipollaR. (2017). Segnet: A deep convolutional encoder-decoder architecture for image segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 39(12), 2481–2495.
3.
ChenL. C.PapandreouG.KokkinosI., et al. (2017). Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs. IEEE Transactions on Pattern Analysis and Machine Intelligence, 40(4), 834–848.
4.
ChenL. C.ZhuY.PapandreouG., et al. (2018). Encoder-decoder with atrous separable convolution for semantic image segmentation. In Proceedings of the European conference on computer vision (ECCV) (pp. 801–818).
5.
ChoiW.ChaY. J. (2019). SDDNet: Real-time crack segmentation. IEEE Transactions on Industrial Electronics, 67(9), 8016–8025.
6.
DungC. V. (2019). Autonomous concrete crack detection using deep fully convolutional neural network. Automation in Construction, 99, 52–58.
7.
EscalonaU.ArceF.ZamoraE., et al. (2019). Fully convolutional networks for automatic pavement crack segmentation. Computación y Sistemas, 23(2), 451–460.
8.
FanZ.WuY.LuJ., et al. (2018). Automatic pavement crack detection based on structured prediction with the convolutional neural network. arXiv preprint arXiv:1802.02208.
9.
FuH.MengD.LiW., et al. (2021). Bridge crack semantic segmentation based on improved deeplabv3+. Journal of Marine Science and Engineering, 9(6), 671.
10.
GuoJ. M.MarkoniH.LeeJ. D. (2021). BARNet: Boundary aware refinement network for crack detection. IEEE Transactions on Intelligent Transportation Systems, 23(7), 7343–7358.
11.
JiA.XueX.WangY., et al. (2020). An integrated approach to automatic pixel-level crack detection and quantification of asphalt pavement. Automation in Construction, 114, 103176.
12.
LiuY.ChengM. M.HuX., et al. (2017). Richer convolutional features for edge detection. Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 3000–3009).
13.
LiuY.YaoJ.LuX., et al. (2019). DeepCrack: A deep hierarchical feature learning architecture for crack segmentation. Neurocomputing, 338, 139–153.
14.
PolovnikovV.AlekseevD.VinogradovI., et al. (2021). DAUNet: Deep augmented neural network for pavement crack segmentation. IEEE Access, 9, 125714.
15.
QiY.HeY.QiX., et al. (2023). Dynamic snake convolution based on topological geometric constraints for tubular structure segmentation. In Proceedings of the IEEE/CVF international conference on computer vision (pp. 6070–6079).
16.
SalmanM.MathavanS.KamalK., et al. (2013). Pavement crack detection using the Gabor filter. In 16th international IEEE conference on intelligent transportation systems (ITSC 2013) (pp. 2039–2044). IEEE.
17.
SandlerM.HowardA.ZhuM., et al. (2018). Mobilenetv2: Inverted residuals and linear bottlenecks. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 4510–4520).
18.
SelvarajJ.JayanthyA. K. (2023). Automatic polyp semantic segmentation using wireless capsule endoscopy images with various convolutional neural network and optimization techniques: A comparison and performance evaluation. Biomedical Engineering: Applications, Basis and Communications, 35(06), 2350026.
19.
SelvarajJ.UmapathyS. (2023). CRPU-NET: A deep learning model based semantic segmentation for the detection of colorectal polyp in lower gastrointestinal tract. Biomedical Physics Engineering Express, 10(1), 015018.
20.
SongW.JiaG.JiaD., et al. (2019). Automatic pavement crack detection and classification using multiscale feature attention network. IEEE Access, 7, 171001.
21.
SongW.JiaG.ZhuH., et al. (2020). Automated pavement crack damage detection using deep multiscale convolutional features. Journal of Advanced Transportation, 2020, 6412562.
22.
SunX.XieY.JiangL., et al. (2022). DMA-net: DeepLab with multi-scale attention for pavement crack segmentation. IEEE Transactions on Intelligent Transportation Systems, 23(10), 18392–18403.
23.
TanakaN.UematsuK. (1998). A crack detection method in road surface images using morphology. MVA, 98, 17–19.
24.
TsaiY. C.ChatterjeeA. (2017). Comprehensive, quantitative crack detection algorithm performance evaluation system. Journal of Computing in Civil Engineering, 31(5), 04017047.
25.
WooS.ParkJ.LeeJ. Y., et al. (2018). Cbam: Convolutional block attention module. In Proceedings of the European conference on computer vision (ECCV) (pp. 3–19).
26.
XieS.TuZ. (2015). Holistically-nested edge detection. In Proceedings of the IEEE international conference on computer vision (pp. 1395–1403).
27.
YangF.ZhangL.YuS., et al. (2019). Feature pyramid and hierarchical boosting network for pavement crack detection. IEEE Transactions on Intelligent Transportation Systems, 21(4), 1525–1535.
28.
YuQ.TangH.ZhuL., et al. (2023). A method of cotton root segmentation based on edge devices. Frontiers in Plant Science, 14, 1122833.
29.
ZhuG.FanZ.LiuJ., et al. (2022). RHA-Net: An Encoder-decoder network with residual blocks and hybrid attention mechanisms for pavement crack segmentation. arXiv preprint arXiv:2207.14166.
30.
ZouQ.ZhangZ.LiQ., et al. (2018). Deepcrack: Learning hierarchical convolutional features for crack detection. IEEE Transactions on Image Processing, 28(3), 1498–1512.
