In this paper, based on the fusion of Lidar and Radar measurement data, a real-time road-Object Detection and Tracking (LR_ODT) method for autonomous driving is proposed. The lidar and radar devices are installed on the ego car, and a customized Unscented Kalman Filter (UKF) is used for their data fusion. Lidars are accurate in determining objects’ positions but significantly less accurate on measuring their velocities. However, Radars are more accurate on measuring objects velocities but less accurate on determining their positions as they have a lower spatial resolution. Therefore, the merits of both sensors are combined using the proposed fusion approach to provide both pose and velocity data for objects moving in roads precisely. The Grid-Based Density-Based Spatial Clustering of Applications with Noise (GB-DBSCAN) clustering algorithm is used to detect objects and estimate their centroids from the lidar and radar raw data. Then, the estimation of the object’s velocity as well as determining its corresponding geometrical shape is performed by the RANdom SAmple Consensus (RANSAC) algorithm. The proposed technique is implemented using the high-performance language C and utilizes highly optimized math and optimization libraries for best real-time performance. The performance of the UKF fusion is compared to that of the Extended Kalman Filter fusion (EKF) showing its superiority. Simulation studies have been carried out to evaluate the performance of the LR_ODT for tracking bicycles, cars, and pedestrians.
FaragW. Traffic signs classification by deep learning for advanced driving assistance systems. Intelligent Decision Technologies, IOS Press. 2019; 13(3): 215-231.
2.
FaragWSalehZ. Road lane-lines detection in real-time for advanced driving assistance systems. Intern Conf on Innovation and Intelligence for Informatics, Computing, and Technologies (3ICT’18), Bahrain. 2018; 18-20.
3.
FaragW. A comprehensive real-time road-lanes tracking technique for autonomous driving. International Journal of Computing and Digital Systems (IJCDS). 2020; 9(3): 349-362.
4.
FaragWSalehZ. Behavior cloning for autonomous driving using convolutional neural networks. Intern Conf on Innovation and Intelligence for Informatics, Computing, and Technologies (3ICT’18), Bahrain. 2018; 18-20.
5.
FaragW. Recognition of traffic signs by convolutional neural nets for self-driving vehicles. International Journal of Knowledge-based and Intelligent Engineering Systems, IOS Press. 2018; 22(3): 205-214.
6.
FaragWSalehZ. Tuning of PID track followers for autonomous driving. Intern Conf on Innovation and Intelligence for Informatics, Computing, and Technologies (3ICT’18), Bahrain. 2018; 18-20.
7.
FaragW. Complex trajectory tracking using pid control for autonomous driving. International Journal of Intelligent Transportation Systems Research, Springer. 2020; 18(5): 356-366.
8.
FaragW. Complex-track following in real-time using model-based predictive control. International Journal of Intelligent Transportation Systems Research, Springer. 2021; 19(4): 112-127.
9.
FaragWSalehZ. An advanced road-lanes finding scheme for self-driving cars. 2nd Smart Cities Symposium (SCS’19), IET Digital Library, Bahrain. 2019; 24-26.
10.
FaragW. Safe-driving cloning by deep learning for autonomous cars. International Journal of Advanced Mechatronic Systems, Inderscience Publishers. 2019; 7(6): 390-397.
11.
FaragW. Cloning safe driving behavior for self-driving cars using convolutional neural networks. Recent Patents on Computer Science, Bentham Science Publishers, The Netherlands. 2019; 12(2): 120-127.
12.
FaragWSalehZ. An advanced vehicle detection and tracking scheme for self-driving cars. 2nd Smart Cities Symposium (SCS’19), IET Digital Library, Bahrain. 2019; 24-26.
13.
YurtseverELambertJCarballoATakedaK. A survey of autonomous driving: Common practices and emerging technologies. arXiv: 1906.05113v2; 2020.
14.
CheEJungJOlsenMJ. Object recognition, segmentation, and classification of mobile laser scanning point Clouds: A state of the art review. 2019; 19: 810; doi: 10.3390/s19040810.
15.
XieYTianJZhuX. A review of point cloud semantic segmentation. arXiv: 1908.08854v2; 2019.
16.
LidmanPLuuS. Clustering, shape extraction and velocity estimation applied to radar detections. M.Sc. thesis, Dept of Elect Eng, Chalmers University of Technology, Gothenburg, Sweden; 2018.
17.
FaragW. Real-time detection of road lane-lines for autonomous driving. Recent Advances in Computer Science and Communications, Betham Science. 2020; 13(2): 265-274.
18.
DietmayerKKellnerDKlappsteinJ. Grid-based dbscan for clustering extended objects in radar data. IEEE Intelligent Vehicles Symposium, Alcala de Henares, Spain; 2012.
19.
FischlerMBollesR. Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. Comm ACM. 1981; 24(6): 381-395.
20.
GohringDWangMSchnurmacherMGanjinehT. Radar/ lidar sensor fusion for car-following on highways. IEEE Int Conf Autom Robot Appl. 2011; 407-412.
21.
KaempchenNFuerstenbergKCSkibickiAGDietmayerKCJ. Sensor fusion for multiple automotive active safety and comfort applications. in: Advanced Microsystems for Automotive Applications. ValldorfJGessnerW, eds, 2004; 2: 137-163.
22.
ZarchanPMusoffH. Fundamentals of kalman filtering: A practical approach. American Institute of Aeronautics and Astronautics, Incorporated, 4 Ed., 2013. ISBN 978-1-62410-276-9.
23.
Chavez-GarciaROAycardO. Multiple sensor fusion and classification for moving object detection and tracking. IEEE Transactions on Intelligent Transportation Systems. 2015; 17(2): 252-534.
24.
RangeshATrivediMM. No blind spots: Full-surround multi-object tracking for autonomous vehicles using cameras and LiDARs. IEEE Transactions on Intelligent Vehicles. 2019; 4(4).
25.
HajriHRahalMC. Real-time lidar and radar high-level fusion for obstacle detection and tracking with evaluation on a ground truth. arXiv: 1807.11264v2; 2019.
26.
JahromiBSTulabandhulaTCetinS. Real-time hybrid multi-sensor fusion framework for perception in autonomous vehicles. Sensors. 2019; 19(20). 4357, doi: 10.3390/s19204357.
27.
WanEAVan Der MerweR. The unscented Kalman filter for nonlinear estimation. IEEE Adaptive Sys for Signal Processing, Comm, and Control Symposium, Alberta, Canada; 2000.
28.
JulierSJUhlmannJK. Unscented filtering and nonlinear estimation. Proceedings of the IEEE. 2004; 92(3): 401-422.
29.
EinickeGAWhiteLB. Robust extended kalman filtering. IEEE Trans Signal Process. 1999; 47(9): 2596-2599.
30.
BestMCBogdanskiK. Extending the Kalman filter for structured identification of linear and nonlinear systems. Int J Modelling, Identification, and Control. 2017; 27(2).
31.
SchubertRRichterEWanielikG. Comparison and evaluation of advanced motion models for vehicle tracking. 11th Inter Conf on Information Fusion, Cologne, Germany; 2008.
32.
SanderJXuXEsterMKriegelHP. A density-based algorithm for discovering clusters in large spatial databases with noise. Proc of the 2nd Inter Conf on Knowledge Discovery and Data Mining. 1996; 226-231.
33.
GCC C [homepage on the Internet]. https://gcc.gnu.org/, accessed on 11; 2020.
34.
Ubuntu Linux [homepage on the Internet]. https://www.ubuntu.com/, accessed on 11; 2020.
35.
NagiubMFaragW. Automatic selection of compiler options using genetic techniques for embedded software design. IEEE 14th Inter. Symposium on Comp. Intelligence and Informatics (CINTI), Budapest, Hungary; 2013.
36.
Eigen [homepage on the Internet]. http://eigen.tuxfamily.org/index.php?title=Main_Page, accessed on 11; 2020.
37.
PichéR. Online tests of Kalman filter consistency. International Journal of Adaptive Control and Signal Processing. 2016; 30(1): 115-124.
38.
ZhaoSHuangB. On Initialization of the kalman filter. 6th Inter Symposium on Adv Control of Ind Processes (AdCONIP), Taipei, Taiwan. 2017; 28-31.
39.
SahoK. Kalman filter for moving object tracking: Performance analysis and filter design. Intech Open, Rijeka; 2018. doi: 10.5772/intechopen.71731.
40.
FaragW. Synthesis of intelligent hybrid systems for modeling and control. Ph.D. Thesis. University of Waterloo. Canada. 1998.
