Restricted accessResearch articleFirst published online 2018-8-26
Design and implementation of a novel obstacle avoidance scheme based on combination of CNN-based deep learning method and liDAR-based image processing approach
Contrasted with common obstacle avoidance mode based on single sensor or solo algorithm, this article put forward an intelligent pattern based on Combination from CNN-based Deep Learning Method and liDAR-based Image Processing approach. As for Deep Learning method, a 10-layer Convolutional Neural Network (CNN) is designed which comes to a high recognition accuracy of 97 percent in Tensorflow and success rate of obstacle avoidance is over 90 percent. With regard to liDAR-based Image Processing approach, decision is made by a special method of counting the number of Point Cloud Data (PCD) which is generated by 2D liDAR and a success rate over 90 percent is achieved as well. When two kinds of methods work together, a robust success rate of 100 percent is realized. Meanwhile, Inertial Measurement Unit (IMU) and Xbox360 are taken into consideration for Pose Estimation and Data Collection. Finally, all functions are integrated in Robot Operation System (ROS) on platform of nVidia Jetson TX1.
SreekumarM., A robot manipulator with adaptive fuzzy controller in obstacle avoidance, Journal of the Institution of Engineers97(3) (2016), 469–478.
2.
SchaubA., BaumgartnerD. and BurschkaD., Reactive obstacle avoidance for highly maneuverable vehicles based on a two-stage optical flow clustering, IEEE Transactions on Intelligent Transportation Systems99 (2017), 1–16.
3.
LinC.H. and SongK.T., Robust ground plane region detection using multiple visual cues for obstacle avoidance of a mobile robot, Robotica33(2) (2015), 436–450.
4.
YenC.T. and ChengM.F., A study of fuzzy control with ant colony algorithm used in mobile robot for shortest path planning and obstacle avoidance, Microsystem Technologies (2016), 1–11.
5.
ChiangS.Y., Vision-based obstacle avoidance system with fuzzy logic for humanoid robots, Knowledge Engineering Review (2016), 1–11.
6.
WangY., GoilaA., ShettyR., HeydariM., DesaiA. and YangH., Obstacle avoidance strategy and implementation for unmanned ground vehicle using LIDAR, Sae International Journal of Commercial Vehicles10(1) (2017).
7.
LiuJ., JayakumarP., SteinJ. and ErsalT., Combined speed and steering control in high speed autonomous ground vehicles for obstacle avoidance using model predictive control, IEEE Transactions on Vehicular Technology99 (2017), 1–1.
8.
FranzèG. and LuciaW., An obstacle avoidance model predictive control scheme for mobile robots subject to nonholonomic constraints: A sum-of-squares approach, Journal of the Franklin Institute352(6) (2015), 2358–2380.
9.
ChenY., PengH. and GrizzleJ., Obstacle avoidance for low-speed autonomous vehicles with barrier function, IEEE Transactions on Control Systems Technology99 (2017), 1–13.
10.
SrikanthakumarS. and ChenW.H., Worst-case analysis of moving obstacle avoidance systems for unmanned vehicles, Robotica33(4) (2015), 807–827.
11.
KimC.J. and ChwaD., Obstacle avoidance method for wheeled mobile robots using interval type-2 fuzzy neural network, IEEE Transactions on Fuzzy Systems23(3) (2015), 677–687.
12.
GeC., KasabovN., LiuZ. and YangJ., A spiking neural network model for obstacle avoidance in simulated prosthetic vision, Information Sciences399 (2017), 30–42.
13.
DuguleanaM. and MoganG., Neural networks based reinforcement learning for mobile robots obstacle avoidance, Expert Systems with Applications62 (2016), 104–115.
14.
LimaD.A.D. and VictorinoA.C., A hybrid controller for vision-based navigation of autonomous vehicles in urban environments, IEEE Transactions on Intelligent Transportation Systems17(8) (2016), 2310–2323.
15.
RosoliaU., BruyneS.D. and AlleyneA.G., Autonomous vehicle control: A Nonconvex approach for obstacle avoidance, IEEE Transactions on Control Systems Technology99 (2016), 1–16.
16.
WangM., LuoJ. and WalterU., A non-linear model predictive controller with obstacle avoidance for a space robot, Advances in Space Research57(8) (2016), 1737–1746.
17.
ChangK., XiaY. and HuangK., Coordinated formation control design with obstacle avoidance in three-dimensional space, Journal of the Franklin Institute352(12) (2015), 5779–5795.
18.
YangH., FanX., ShiP. and HuaC., Nonlinear control for tracking and obstacle avoidance of a wheeled mobile robot with nonholonomic constraint, IEEE Transactions on Control Systems Technology24(2) (2016), 741–746.
19.
NonakaR., YamashitaY. and TsubakinoD., Multiple obstacle avoidance of four-wheeled vehicle with steering limitation using nondifferentiable control lyapunov function, Advanced Robotics30(1) (2015), 15–28.
20.
WuF., MaréchalL., VibhuteA., FoongS., SohG.S. and WoodK.L., A compact magnetic directional proximity sensor for spherical robots, IEEE International Conference on Advanced Intelligent Mechatronics2016, 1258–1264.
21.
GuoJ., HuP. and WangR., Nonlinear coordinated steering and braking control of vision-based autonomous vehicles in emergency obstacle avoidance, IEEE Transactions on Intelligent Transportation Systems17(11) (2016), 3230–3240.
22.
RenH.G., YinR., ShiT. and LiF.J., Application of two modified autonomous development algorithms in robot obstacle avoidance, Journal of Computers (Taiwan)28(3) (2017), 235–250.
23.
PengA., Obstacle avoidance strategy of mobile robot based on wireless sensor networks, International Journal of Online Engineering12(11) (2016), 10.
24.
ManD.W., KiH.S. and KimH.S., Collaborative obstacle avoidance method of surface and aerial drones based on acoustic information and optical image, Transactions of the Korean Institute of Electrical Engineers64(7) (2015), 1081–1087.
25.
WuP., XieS., LiuH., LiM., LiH., PengY., LiX. and LuoJ., Autonomous obstacle avoidance of an unmanned surface vehicle based on cooperative manoeuvring, Industrial Robot44(1) (2017), 64–74.
26.
FernandesL.C., SouzaJ.R., PessinG., ShinzatoP.Y., SalesD., MendesC., PradoM., KlaserR., MagalhãesA.C. and HataA., CaRINA intelligent robotic car: Architectural design and applications, Journal of Systems Architecture60(4) (2014), 372–392.
27.
ErlienS.M., FujitaS. and GerdesJ.C., Shared steering control using safe envelopes for obstacle avoidance and vehicle stability, IEEE Transactions on Intelligent Transportation Systems17(2) (2016), 441–451.
28.
Mur-ArtalR., MontielJ.M.M. and TardósJ.D., ORB-SLAM: A versatile and accurate monocular SLAM system, IEEE Transactions on Robotics31(5) (2017), 1147–1163.
29.
Galvez-LópezD. and TardosJ.D., Bags of binary words for fast place recognition in image sequences, IEEE Transactions on Robotics28(5) (2012), 1188–1197.
