The rapid advancement of Artificial Intelligence (AI) is transforming the construction sector, particularly in site monitoring and safety management. Real-time monitoring enables the automatic detection of work progress issues, anomalies, and hazardous situations. However, no existing Deep Learning (DL)-based system is specifically designed to utilize Unmanned Aerial Vehicles (UAVs) for excavation area monitoring. This study presents an automated workflow that integrates UAV imagery with DL architectures, featuring a 1D Convolutional Neural Network (1D-CNN) for classifying excavation work phases and a VGG16 network for detecting safety fences. These technologies are incorporated into a Decision Support System (DSS), which automates report generation and enhances decision-making by providing structured, data-driven insights. The system was validated in a real-world case study involving an oil and gas construction company, demonstrating its ability to streamline site management tasks and improve safety oversight. Compared to traditional monitoring methods, our approach leverages UAV technology and DL methodologies to provide higher accuracy, efficiency, and scalability in excavation site monitoring. This contribution supports the digital transformation of construction management, offering a practical and innovative solution for real-time progress tracking and compliance verification.
ShanCWangJZhuY. The evolution of artificial intelligence in the digital economy: an application of the potential dirichlet allocation model. Sustainability2023; 15: 1360.
2.
ChoiHWKimHJKimSK, et al.An overview of drone applications in the construction industry. Drones2023; 7: 515.
3.
HuDMinnerJ. Uavs and 3D city modeling to aid urban planning and historic preservation: a systematic review. Remote Sens (Basel)2023; 15: 5507.
4.
AlRushoodMARahbarFSelimSZ, et al.Accelerating use of drones and robotics in post-pandemic project supply chain. Drones2023; 7: 313.
5.
Guerrero-RodriguezBGarcia-RodriguezJSalvadorJ, et al.Improving landslide prediction by computer vision and deep learning. Integr Comput Aided Eng2023; 31: 77–94.
6.
LiuLOuyangWWangX, et al.Deep learning for generic object detection: a survey. Int J Comput Vis2020; 128: 261–318.
7.
AndújarDMorenoHBengochea-GuevaraJM, et al.Aerial imagery or on-ground detection? an economic analysis for vineyard crops. Comput Electr Agricul2019; 157: 351–358.
8.
ZhongHWangHWuZ, et al.A survey of lidar and camera fusion enhancement. Procedia Comput Sci2021; 183: 579–588.
9.
ThrowerNJJensenJR. The orthophoto and orthophotomap: characteristics, development and application. Am Cartogr1976; 3: 39–56.
10.
KiranyazSAvciOAbdeljaberO, et al.1D convolutional neural networks and applications: a survey. Mech Syst Signal Process2021; 151: 107398.
11.
SimonyanKZissermanA. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556, 2014.
QadirZUllahFMunawarHS, et al.Addressing disasters in smart cities through uavs path planning and 5G communications: a systematic review. Comput Commun2021; 168: 114–135.
14.
YuanCZhangYLiuZ. A survey on technologies for automatic forest fire monitoring, detection, and fighting using unmanned aerial vehicles and remote sensing techniques. Cana J Forest Res2015; 45: 783–792.
15.
LiXPanYZhangL, et al.Dynamic and explainable deep learning-based risk prediction on adjacent building induced by deep excavation. Tunn Underground Space Technol2023; 140: 105243.
16.
RogersSRManningILivingstoneW. Comparing the spatial accuracy of digital surface models from four unoccupied aerial systems: Photogrammetry versus lidar. Remote Sens (Basel)2020; 12: 2806.
17.
VargheseAGubbiJRamaswamyA, et al.Changenet: a deep learning architecture for visual change detection. In: Proceedings of the European conference on computer vision (ECCV) workshops, 2018, pp.0–0.
18.
ZhuCZhuJBuT, et al.Monitoring and identification of road construction safety factors via uav. Sensors2022; 22: 8797.
19.
ChenXLiZYangY, et al.High-resolution vehicle trajectory extraction and denoising from aerial videos. IEEE Trans Intell Transp Syst2020; 22: 3190–3202.
20.
KeRLiZTangJ, et al.Real-time traffic flow parameter estimation from uav video based on ensemble classifier and optical flow. IEEE Trans Intell Transp Syst2018; 20: 54–64.
21.
HoskereVNarazakiYHoangTA, et al.Madnet: multi-task semantic segmentation of multiple types of structural materials and damage in images of civil infrastructure. J Civil Struct Heal Monit2020; 10: 757–773.
22.
ZhaoZQZhengPXuSt, et al.Object detection with deep learning: a review. IEEE Trans Neural Netw Learn Syst2019; 30: 3212–3232.
23.
CaiZVasconcelosN. Cascade r-Cnn: high quality object detection and instance segmentation. IEEE Trans Pattern Anal Mach Intell2019; 43: 1483–1498.
24.
ChengGHanJZhouP, et al.Learning rotation-invariant and fisher discriminative convolutional neural networks for object detection. IEEE Trans Image Process2018; 28: 265–278.
25.
MaYZhenZLiF, et al.An innovative lightweight 1D-CNN model for efficient monitoring of large-scale forest composition: a case study of heilongjiang province, china. GIsci Remote Sens2023; 60: 2271246.
26.
SonySDunphyKSadhuA, et al.A systematic review of convolutional neural network-based structural condition assessment techniques. Eng Struct2021; 226: 111347.
27.
KimJChiS. Graph neural network-based propagation effects modeling for detecting visual relationships among construction resources. Autom Const2022; 141: 104443.
28.
XinZCuiXZhangJ, et al.Real-time visual place recognition based on analyzing distribution of multi-scale cnn landmarks. J Intell Robot Syst2019; 94: 777–792.
29.
RaoASRadanovicMLiuY, et al.Real-time monitoring of construction sites: sensors, methods, and applications. Autom Const2022; 136: 104099.
30.
GuJWangZKuenJ, et al.Recent advances in convolutional neural networks. Pattern Recognit2018; 77: 354–377.
31.
ZhouZShinJYGuruduSR, et al.Active, continual fine tuning of convolutional neural networks for reducing annotation efforts. Med Image Anal2021; 71: 101997.
32.
KumarAWangSShaikhAM, et al.Building on prior lightweight CNN model combined with lstm-am framework to guide fault detection in fixed-wing uavs. Int J Mach Learn Cybernet2024; 15: 4175–4191.
33.
PanYQinJZhangL, et al.A probabilistic deep reinforcement learning approach for optimal monitoring of a building adjacent to deep excavation. Comput Aid Civil Infrast Eng2024; 39: 656–678.
34.
GhelmaniAHammadA. Improving single-stage activity recognition of excavators using knowledge distillation of temporal gradient data. Comput Aid Civil Infrast Eng2024; 39: 2028–2053.
35.
PanYLiLQinJ, et al.Unmanned aerial vehicle–human collaboration route planning for intelligent infrastructure inspection. Comput Aid Civil Infrast Eng2024; 39: 2074–2104.
36.
JiangTFrøsethGTRønnquistA, et al.A visual inspection and diagnosis system for bridge rivets based on a convolutional neural network. Comput Aid Civil Infrast Eng2024; 39: 3786–3804.
37.
QgisDT. Qgis geographic information system, open source geospatial foundation, 2009.
38.
ChaikinGM. An algorithm for high-speed curve generation. Comput Graph Image Process1974; 3: 346–349.
39.
IdeHKuritaT. Improvement of learning for CNN with relu activation by sparse regularization. In: 2017 international joint conference on neural networks (IJCNN), 2017, pp.2684–2691. IEEE.
40.
KingmaDPBaJ. Adam: a method for stochastic optimization. arXiv preprint arXiv:1412.6980, 2014.
KrizhevskyASutskeverIHintonGE. Imagenet classification with deep convolutional neural networks. Adv Neural Inf Process Syst2012; 25: 1–9.
43.
HeKZhangXRenS, et al.Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, 2016, pp.770–778.
44.
LiuZLinYCaoY, et al.Swin transformer: hierarchical vision transformer using shifted windows. In: Proceedings of the IEEE/CVF international conference on computer vision, 2021, pp.10012–10022.
45.
DengJDongWSocherR, et al.Imagenet: a large-scale hierarchical image database. In: 2009 IEEE conference on computer vision and pattern recognition, 2009, pp.248–255. Ieee.
46.
SelvarajuRRCogswellMDasA, et al.Grad-Cam: visual explanations from deep networks via gradient-based localization. In: Proceedings of the IEEE international conference on computer vision, 2017, pp.618–626.
47.
AlamKMRSiddiqueNAdeliH. A dynamic ensemble learning algorithm for neural networks. Neural Comput Appl2020; 32: 8675–8690.
48.
PereiraDRPiteriMASouzaAN, et al.Fema: a finite element machine for fast learning. Neural Comput Appl2020; 32: 6393–6404.
