Object detection plays an important role in underground intelligent vehicles and intelligent transportation systems. Due to the uneven light in underground mining scenarios, infrared cameras are one of the typical onboard sensors for environmental perception. Although object detection has been studied for decades, it still confronts the challenge of detecting infrared objects in underground mines. The contributing factors include weak and small objects in infrared images and similar environments in mining scenarios. In this paper, a Feature Enhancement and Guided Network (FEGNet) is proposed to address these problems. Based on the characteristics of infrared images, the feature enhancement module (FEM) preserves the image details from global and local perspectives to improve the discrimination of weak and small objects. To tackle the problem of overfitting caused by similar environments, a receptive-field-guided (RFG) backbone is proposed to learn multi-scale context and spatial information. The experimental results on the underground mining (UM) dataset demonstrate that the mAP of the proposed FEGNet achieves 86.1%, which is 4.6% higher than the state-of-the-art CNN-based network YOLOv7.
LiYLiZTengS, et al. Automine: an unmanned mine dataset. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), New Orleans, LA, USA, 18–24June2022, pp.21276–21285. New York, NY: IEEE
2.
LeiYWangYWuS, et al. A fuzzy logic-based adaptive dynamic window approach for path planning of automated driving mining truck. In: Proceedings of the IEEE international conference on mechatronics (ICM), Kashiwa, Japan, 7–9 March 2021, pp.1–6. New York, NY: IEEE.
3.
TangRDe DonatoLBesinovićN, et al. A literature review of artificial intelligence applications in railway systems. Transp Res Part C Emerg Technol2022; 140: 103679.
4.
RouariAMoussaouiAChahirY, et al. Deep CNN-based autonomous system for safety measures in logistics transportation. Soft Comput2021; 25(18): 12357–12370.
5.
LöschRGrehlSDonnerM, et al. Design of an autonomous robot for mapping, navigation, and manipulation in underground mines. In: Proceedings of the IEEE international conference on intelligent robots and systems (IROS), Madrid, Spain, 1–5 October 2018; pp.1407–1412. New York, NY: IEEE.
6.
SzrekJZimrozRWodeckiJ, et al. Application of the infrared thermography and unmanned ground vehicle for rescue action support in underground Mine—The AMICOS Project. Remote Sens2020; 13(1): 69.
7.
DongLSunDHanG, et al. Velocity-free localization of autonomous driverless vehicles in underground intelligent mines. IEEE Trans Vehicular Technol2020; 69(9): 9292–9303.
8.
KristoMIvasic-KosMPobarM. Thermal object detection in difficult weather conditions using yolo. IEEE Access2020; 8: 125459–125476.
9.
AltayFVelipasalarS. The use of thermal cameras for pedestrian detection. IEEE Sens J2022; 22(12): 11489–11498.
10.
RenSHeKGirshickR, et al. Faster R-CNN: towards real-time object detection with region proposal networks. IEEE Trans Pattern Anal Mach Intell2017; 39(6): 1137–1149.
11.
RedmonJDivvalaSGirshickR, et al. You only look once: unified, real-time object detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), Las Vegas, NV, USA, 2016, pp.779–788.New York, NY: IEEE.
12.
RedmonJFarhadiA. YOLO9000: better, faster, stronger. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), Honolulu, HI, USA, 21–26July2017; pp.6517–6525. New York, NY: IEEE.
13.
RedmonJFarhadiA. Yolov3: An incremental improvement. arXiv preprint 2018, arXiv: 1804.02767.
14.
BochkovskiyAWangCYLiaoHYM. YOLOv4: optimal speed and accuracy of object detection. arXiv Preprint 2020, arXiv: 2004.10934.
15.
GeZLiuSWangF, et al. YOLOX: Exceeding yolo series in 2021. arXiv Preprint 2021, arXiv: 2107.08430.
16.
WangCYBochkovskiyALiaoHYM. YOLOv7: trainable bag-of-freebies sets new state-of-the-art for real-time object detectors. arXiv preprint 2022, arXiv: 2207.02696.
17.
TanMPangRLeQV. Efficientdet: scalable and efficient object detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), Seattle, WA, USA, 13–19 June 2020, pp.10778–10787.New York, NY: IEEE.
18.
DöpperVGränzigTKleinschmitB, et al. Challenges in UAS-based TIR imagery processing: image alignment and uncertainty quantification. Remote Sens2020; 12(10): 1552.
19.
ChenJLiuZJinD, et al. Light transport induced domain adaptation for semantic segmentation in thermal infrared urban scenes. IEEE Trans Intell Transp Syst2022; 23(12): 23194–23211.
20.
GirshickRDonahueJDarrellT, et al. Rich feature hierarchies for accurate object detection and semantic segmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), Columbus, OH, USA, 23–28 June 2014, pp.580–587.New York, NY: IEEE.
21.
HeKGkioxariGDollárP, et al. Mask R-CNN. In: Proceedings of the IEEE international conference on computer vision (ICCV), Venice, Italy, 22–29October2017, pp.2980–2988.New York, NY:IEEE.
22.
JuMLuoJLiuG, et al. ISTDet: an efficient end-to-end neural network for infrared small target detection. Infrared Phys Technol2021; 114: 103659.
23.
LiSLiYLiY, et al. YOLO-FIRI: improved YOLOv5 for infrared image object detection. IEEE Access2021; 9: 141861–141875.
24.
WangKDuSLiuC, et al. Interior attention-aware network for infrared small target detection. IEEE Trans Geosci Remote Sens2022; 60: 1–13.
25.
VaswaniAShazeerNParmarN, et al. Attention is all you need. In: Proceedings of the 31st International Conference on Neural Information Processing Systems, Long Beach, CA, USA, 4–9 December 2017, pp. 6000–6010. Cambridge, MA: MITPress.
26.
HeKZhangXRenS, et al. Spatial pyramid pooling in deep convolutional networks for visual recognition. IEEE Trans Pattern Anal Mach Intell2015; 37(9): 1904–1916.
27.
LiuSQiLQinH, et al. Path aggregation network for instance segmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), Salt Lake City, UT, USA, 18–23 June 2018, pp.8759–8768. New York, NY: IEEE.
28.
ZhengZWangPLiuW, et al. Distance-IoU loss: faster and better learning for bounding box regression. In: Proceedings of the AAAI conference on artificial intelligence, New York, USA, 7–12 February 2020, pp.12993–13000. Menlo Park, CA: AAAI.
29.
IslamMAJiaSBruceNDB. How much position information do onvolutional neural networks encode. arXiv preprint 2020, arXiv: 2001.08248.
30.
WangCLiaoHMWuY, et al. CSPNet: a new backbone that can enhance learning capability of CNN. In: Proceedings of IEEE computer society conference on computer vision and pattern recognition workshops (CVPRW), Seattle, WA, USA, 14–19 June 2020, pp.1571–1580. New York, NY: IEEE.
