On account of the limitations of single sensor in obstacle detection, the paper investigates an obstacle detection method based on the fusion of 3D LiDAR and monocular visual. The spatial data fusion of the two sensors is realized according to their calibration results, and the time data fusion is realized by using double buffer technology. Considering the aspect ratio of vehicles, the image region of interest is determined based on the obstacle clustering of 3D LiDAR data. By using Haar-like features as effective characteristic of the front vehicle, integral figure is applied to extract Haar-like features of vehicle samples and non-vehicle samples. AdaBoost algorithm is used to choose weak classifiers to constitute strong classifiers, which combine into the cascade classifier. The cascade classifier has been trained to identify the vehicle target in the image region of interest. The relevant experimental results verify the effectiveness and real-time performance of the detection method.
LeeC., KimJ., ParkE., et al. Multi-feature Vehicle Detection Using Feature Selection, 2013 IEEE International Conference on Systems, Man, and Cybernetics (2013), 234–23.
2.
SajibM.S.R. and TareeqS.M., A feature based method for real time vehicle detection and classification from on-road videos, 2017 20th International Conference of Computer and Information Technology, (2017), 1–11.
3.
NeumannD., LangnerT., UlbrichF., et al. Online vehicle detection using Haar-like, LBP and HOG feature based image classifiers with stereo vision preselection, 2017 IEEE Intelligent Vehicles Symposium (IV) (2017), 773–778.
4.
BaoH., GuanX., JiaX., et al. A study on maneuvering obstacle motion state estimation for intelligent vehicle using adaptive kalman filter based on current statistical model, Mathematical Problems in Engineering2015 (2015), 1–14.
5.
AlexanderS., FrankS. and MichaelH., Robust obstacle detection from stereoscopic image sequences using Kalman filtering, 23rd German Association for Pattern Recognition Symposium (2001), 385–391.
6.
WuC.H., HongW.Z. and PanS.T., Performance evaluation of extended Kalman filtering for obstacle avoidance of mobile robots, International MultiConference of Engineers and Computer Scientists, 2015, 263–267.
7.
ZhaoX., YuQ., MaJ., et al. Development of a representative EV urban driving cycle based on a k-means and SVM hybrid clustering algorithm, Journal Advanced Transportation5 (2018), 1–20. (DOI: 10.1155/2018/1890753))
8.
ZhaoX., WangS., MaJ., et al. Identification of driver’s braking intention based on a hybrid model of GHMM and GGAP-RBFNN, Neural Computing & Applications, 31(1) (2018), 161–174. (DOI: 10.1007/s00521-018-3672-1)
9.
VidhyaK., MalaDr. and PatilC., Survey on various 3D brain image reconstruction methods based on MRI, International Journal of Innovative Research in Computer and Communication EngineeringV6 (2018), I5.
10.
HarshithaR. and ManikandanJ., Design of a real-time pedestrian detection system for autonomous vehicles, 2017 IEEE Region 10 Symposium, 2017, 1–4.
11.
DuX.X., MarceloH., AngJ., et al. Car Detection for Autonomous Vehicle: LIDAR and Vision Fusion Approach Through Deep Learning Framework, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems2017, 749–754.
12.
DairiA., HarrouF., SenouciM. and SunY., Unsupervised obstacle detection in driving environments using deep-learning-based stereovision, Robotics and Autonomous Systems100 (2017), 287–301.
13.
JagtapRutuja
and
UplaonkarDeepak,
Efficient keyword search on large scale graph in a distributed system using different searching techniques, International Journal of Innovative Research in Computer and Communication Engineering (IJIRCCE), V-6, I-7, July, 2018.
14.
KimS., KimH., YooW. and HuhK., Sensor fusion algorithm design in detecting vehicles using laser scanner and stereo vision, IEEE Transactions on Intelligent Transportation Systems17(4) (2016), 1072–1084.
15.
LiuW., ZuoL.Y., YuH.F., et al. Obstacle detection based on multiple cues fusion from monocular camera, International IEEE Conference on Intelligent Transportation Systems2013, 640–645.
16.
HäneC., HengL., LeeG.H., FraundorferF., FurgaleaP., SattlerT., et al. 3D visual perception for self-driving cars using a multi-camera system: calibration, mapping, localization, and obstacle detection, Image and Vision Computing68 (2017), 14–27.
17.
ZhaoX., MaJ., WangS., et al. Developing an electric vehicle urban driving cycle to study differences in energy consumption, Environmental Science and Pollution Research, (2018). (DOI: 10.1007/s11356-018-3541-6)
18.
JajooAmita,
KapasiAkarsh,
KalyanshettiAnup
and
NiketB.,
Autonomous RC Car Using Neural Network and Deep Learning, International Journal of Innovative Research in Computer and Communication Engineering (IJIRCCE), V-6, I-6, June, 2018.
19.
ZhaoX., YuQ., YuM., et al. Research on an equal power allocation electronic differential system for electric vehicle with dual-wheeled-motor front drive based on a wavelet controller, Advances Mechanical Engineering10(2) (2018), 1–24. (DOI: 10.1177/1687814018760039)
20.
HaselhoffA., KummertA. and SchneiderG., Radar-vision fusion with an application to car-following using an improved AdaBoost detection algorithm, IEEE Intelligent Transportation Systems Conference, 2007, 854–858.
21.
PereiraM., SilvaD., SantosV. and DiasP., Self calibration of multiple lidars and cameras on autonomous vehicles, Robotics and Autonomous Systems83 (2016), 326–337.
22.
ZhaoG.Q., XiaoX.H., YuanJ.S. and NgG.W., Fusion of 3d-lidar and camera data for scene parsing, Journal of Visual Communication and Image Representation25(1) (2014), 165–183.
23.
AsvadiA., GarroteL., PremebidaC., et al. Multimodal vehicle detection: fusing 3D-LIDAR and color camera data, Pattern Recognition Letters115 (2017), 20–29.
24.
XieY.F., ShaoR., GuliP.P., et al. Infrastructure Based Calibration of a Multi-Camera and Multi-LiDAR System Using Apriltags, IEEE Intelligent Vehicles Symposium (IV), 2018, 605–610.
25.
PaulA., DanielA., AhmadA. and RhoS., “Cooperative cognitive intelligence for internet of vehicles”, IEEE Systems Journal11(3) (2017), 01249–1258.
26.
WangX.Z., LiJ., LiH.J. and ShangB.X., Obstacle detection based on 3d laser scanner and range image for intelligent vehicle, Journal of Jilin University (Engineering and Technology Edition)46(2) (2016), 360–365.
