Vehicle detection in severe weather has always been a difficult task in the environmental perception of intelligent vehicles. This paper proposes a vehicle detection method based on pseudo-visual search and the histogram of oriented gradients (HOG)–local binary pattern (LBP) feature fusion. Using radar detection information, this method can directly extract the region of interest (ROI) of vehicles from infrared images by imitating human vision. Unlike traditional methods, the pseudo-visual search mechanism is independent of complex image processing and environmental interferences, thereby significantly improving the speed and accuracy of ROI extraction. More notably, the ROI extraction process based on pseudo-visual search can reduce image processing by 40%–80%, with an ROI extraction time of only 4 ms, which is far lower than the traditional algorithms. In addition, we used the HOG–LBP fusion feature to train the vehicle classifier, which improves the extraction ability of local and global features of vehicles. The HOG–LBP fusion feature can improve vehicle detection accuracy by 6%–9%, compared to a single feature. Experimental results show that the accuracy of vehicle detection is 92.7%, and the detection speed is 31 fps, which validates the feasibility of the proposed method and effectively improve the vehicle detection performance in severe weather
GengKZouWYinG, et al. Low-observable targets detection for autonomous vehicles based on dual-modal sensor fusion with deep learning approach. Proc IMechE, Part D: J Automobile Engineering2019; 233(9): 2270–2283.
2.
MukhtarAXiaLTangTB. Vehicle detection techniques for collision avoidance systems: a review. IEEE Trans Intell Transp Syst2015; 16(5): 2318–2338.
3.
SongHLiangHLiH, et al. Vision-based vehicle detection and counting system using deep learning in highway scenes. Eur Transp Res Rev2019; 11(1): 51.
4.
YiCZhangKPengN. A multi-sensor fusion and object tracking algorithm for self-driving vehicles. Proc IMechE, Part D: J Automobile Engineering2019; 233(9): 2293–2300.
5.
BanksVAPlantKLStantonNA. Driver error or designer error: using the perceptual cycle model to explore the circumstances surrounding the fatal Tesla crash on 7th May 2016. Saf Sci2018; 108: 278–285.
6.
Oviedo-TrespalaciosOTrueloveVWatsonB, et al. The impact of road advertising signs on driver behaviour and implications for road safety: a critical systematic review. Transp Res Part A Policy Pract2019, 122: 85–98.
7.
YangZPun-ChengLSC. Vehicle detection in intelligent transportation systems and its applications under varying environments: a review. Image Vision Comput2018; 69: 143–154.
8.
AndreoneLAntonelloPCBertozziM, et al. Vehicle detection and localization in infra-red images. In: Proceedings of the IEEE 5th international conference on intelligent transportation systems, Singapore, 6 September 2002, pp.141–146. New York, NY: IEEE.
9.
IwasakiYMisumiMNakamiyaT. Robust vehicle detection under various environments to realize road traffic flow surveillance using an infrared thermal camera. Sci World J2015; 2015: 94727.
10.
SangnoreeAChamnongthaiK. Robust method for analyzing the various speeds of multitudinous vehicles in nighttime traffic based on thermal images. In: 2009, 4th International conference on computer sciences and convergence information technology, Seoul, Korea, 24–26 November 2009, pp.467–472. New York, NY: IEEE.
11.
IwasakiYMisumiMNakamiyaT. Robust vehicle detection under various environmental conditions using an infrared thermal camera and its application to road traffic flow monitoring. Sensors2013; 13(6): 7756–7773.
12.
TaoHLuX. Automatic smoky vehicle detection from traffic surveillance video based on vehicle rear detection and multi-feature fusion. IET Intell Transp Syst2019; 13(2): 252–259.
13.
BesbesBApateanARogozanA, et al. Combining SURF-based local and global features for road obstacle recognition in far infrared images. In: 13th International IEEE conference on intelligent transportation systems, Madeira Island, Portugal, 19–22 September 2010, pp.1869–1874. New York, NY: IEEE.
14.
ChenDJinGLuL, et al. Infrared image vehicle detection based on Haar-like feature. In: 2018 IEEE 3rd Advanced Information Technology, Electronic and Automation Control Conference (IAEAC), Chongqing, China, 12–14 October 2018, pp.662–667. New York, NY: IEEE.
15.
GaszczakABreckonTPHanJ. Real-time people and vehicle detection from UAV imagery. In: Intelligent robots and computer vision XXVIII: algorithms and techniques, International Society for Optics and Photonics, San Francisco, CA, 24–25January2011, p.7878.
16.
IwasakiYKawataSNakamiyaT. Robust vehicle detection even in poor visibility conditions using infrared thermal images and its application to road traffic flow monitoring. Meas Sci Technol2011; 22(8): 085501.
17.
LiuXYangTLiJ. Real-time ground vehicle detection in aerial infrared imagery based on convolutional neural network. Electronics2018; 7(6): 78.
18.
MoateCPHaywardSDEllisJS, et al. Vehicle detection in infrared imagery using neural networks with synthetic training data. In: International conference image analysis and recognition. Cham: Springer, 2018, pp.453–461.
19.
ZhangXXZhuX. Moving vehicle detection in aerial infrared image sequences via fast image registration and improved YOLOv3 network. Int J Remote Sens2020; 41(11): 4312–4335.
20.
SheenyMWallaceAEmambakhshM, et al. POL-LWIR Vehicle detection: convolutional neural networks meet polarised infrared sensors. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops, Salt Lake City, UT, 18–22 June 2018, pp.1247–1253.
21.
LiHYuanJLiuH, et al. Incremental learning of infrared vehicle detection method based on SSD. In: 2020 IEEE 20th International Conference on Communication Technology (ICCT), Nanning, China, 28–31 October 2020, pp.1423–1426. New York, NY: IEEE.
22.
ZhangXZhuX. Vehicle Detection in the aerial infrared images via an improved YOLOv3 network. In: 2019 IEEE 4th International Conference on Signal and Image Processing (ICSIP), Wuxi, China, 19–21 July 2019, pp.372–376. New York, NY: IEEE.
23.
GongJZhaoJLiF, et al. Vehicle detection in thermal images with an improved yolov3-tiny. In: 2020 IEEE International Conference on Power, Intelligent Computing and Systems (ICPICS), Shenyang, China, 28–30 July 2020, pp.253–256. New York, NY: IEEE.
24.
DuSZhangPZhangB, et al. Weak and occluded vehicle detection in complex infrared environment based on improved YOLOv4. IEEE Access2021; 9: 25671–25680.
25.
CaiYSunXWangH, et al. Night-time vehicle detection algorithm based on visual saliency and deep learning. J Sens2016; 2016: 1–7.
26.
WangHCaiYChenX, et al. Night-time vehicle sensing in far infrared image with deep learning. J Sens2016; 2016: 1–8.
27.
SivrikayaFYenerB. Time synchronization in sensor networks: a survey. IEEE Netw2004; 18(4): 45–50.
28.
TenneyJABurdERZhangH, et al. Calibration and transformation of a camera system’s coordinate system. Patent 9188973, USA, 2015.
29.
ChoiJVaVGonzalez-PrelcicN, et al. Millimeter-wave vehicular communication to support massive automotive sensing. IEEE Commun Mag2016; 54(12): 160–167.
DalalNTriggsB. Histograms of oriented gradients for human detection. In: 2005 IEEE computer society conference on computer vision and pattern recognition (CVPR’05), San Diego, CA, 20–25 June 2005, vol. 1, pp.886–893. New York, NY: IEEE.
36.
OjalaTPietikainenMMaenpaaT. Multiresolution Gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans Pattern Anal Mach Intell2002; 24(7): 971–998.
