In this paper, we propose and validate a framework for visual navigation with collision avoidance for a wheeled mobile robot. Visual navigation consists of following a path, represented as an ordered set of key images, which have been acquired by an on-board camera in a teaching phase. While following such a path, the robot is able to avoid obstacles which were not present during teaching, and which are sensed by an on-board range scanner. Our control scheme guarantees that obstacle avoidance and navigation are achieved simultaneously. In fact, in the presence of obstacles, the camera pan angle is actuated to maintain scene visibility while the robot circumnavigates the obstacle. The risk of collision and the eventual avoiding behaviour are determined using a tentacle-based approach. The framework can also deal with unavoidable obstacles, which make the robot decelerate and eventually stop. Simulated and real experiments show that with our method, the vehicle can navigate along a visual path while avoiding collisions.
AllibertGCourtialETouréY (2008) Real-time visual predictive controller for image-based trajectory tracking of a mobile robot. In International Federation of Automatic Control World Congress, Seoul, Korea.
2.
BecerraHMCourbonJMezouarYSagüésC (2010) Wheeled mobile robots navigation from a visual memory using wide field of view cameras. IEEE/RSJ International Conference on Intelligent Robots and Systems, Taipei, Taiwan.
3.
BecerraHMLópez-NicolásGSagüésC (2011) A sliding-mode-control law for mobile robots based on epipolar visual servoing from three views. IEEE Transactions on Robotics27: 175–183.
4.
Bonin-FontFOrtizAOliverG (2008) Visual navigation for mobile robots: a survey. Journal of Intelligent and Robotic Systems53: 263–296.
5.
BonnafousDLacroixSSiméonT (2001) Motion generation for a rover on rough terrains. In IEEE/RSJ International Conference on Intelligent Robots and Systems, Maui, HI.
6.
BooijOTerwijnBZivkovicZKröseB (2007) Navigation using an appearance based topological map. In IEEE International Conference on Robotics and Automation, Rome, Italy.
7.
BroggiABombiniLCattaniSCerriPFedrigaRI (2010) Sensing requirements for a 13000 km intercontinental autonomous drive. In IEEE Intelligent Vehicles Symposium, San Diego, CA.
8.
BuehlerMLagnemmaKSinghS (eds) (2008) Special Issue on the 2007 DARPA Urban Challenge, Parts I–III. Journal of Field Robotics25(8–10): 423–860.
9.
ChaumetteFHutchinsonS (2006) Visual servo control, Part I: Basic approaches. IEEE Robotics and Automation Magazine13(4): 82–90.
10.
ChaumetteFHutchinsonS (2007) Visual servo control, Part II: Advanced approaches. IEEE Robotics and Automation Magazine14(1): 109–118.
11.
CherubiniAChaumetteF (2011) Visual navigation with obstacle avoidance. In IEEE/RSJ International Conference on Intelligent Robots and Systems, San Francisco, CA.
12.
CherubiniAColafrancescoMOrioloGFredaLChaumetteF (2009) Comparing appearance-based controllers for nonholonomic navigation from a visual memory. In ICRA Workshop on safe navigation in open and dynamic environments, Kobe, Japan.
13.
CherubiniASpindlerFChaumetteF (2012) A new tentacles-based technique for avoiding obstacles during visual navigation. In IEEE International Conference on Robotics and Automation, St. Paul, MN.
14.
CourbonJMezouarYMartinetP (2009) Autonomous navigation of vehicles from a visual memory using a generic camera model. IEEE Transactions on Intelligent Transportation Systems10: 392–402.
15.
DavisonAJReidIDMoltonNDStasseO (2007) MonoSLAM: real-time single camera SLAM. IEEE Transactions on Pattern Analysis and Machine Intelligence29: 1052–1067.
16.
De LucaAOrioloG (1994) Local incremental planning for nonholonomic mobile robots. In IEEE International Conference on Robotics and Automation, San Diego, CA.
17.
De LucaAOrioloGRobuffo GiordanoP (2008) Feature depth observation for image-based visual servoing: theory and experiments. The International Journal of Robotics Research27: 1093–1116.
18.
DiosiASegvicSRemazeillesAChaumetteF (2011) Experimental evaluation of autonomous driving based on visual memory and image based visual servoing. IEEE Transactions on Intelligent Transportation Systems12: 870–883.
19.
Durand PetitevilleACourdessesMCadenatV (2010) A new predictor/corrector pair to estimate the visual features depth during a vision-based navigation task in an unknown environment. In International Conference on Informatics in Control, Automation and Robotics, Rome, Italy.
20.
ElfesA (1989) Using occupancy grids for mobile robot perception and navigation. Computer22(6): 46–57.
21.
FolioDCadenatV (2006) A redundancy-based scheme to perform safe vision-based tasks amidst obstacles. In IEEE International Conference on Robotics and Biomimetics, Kunming, China.
22.
FontanelliDDanesiABeloFAWSalarisPBicchiA (2009) Visual servoing in the large. The International Journal of Robotics Research28: 802–814.
23.
GoedeméTNuttinMTuytelaarsTVan GoolL (2007) Omnidirectional vision based topological navigation. International Journal of Computer Vision74: 219–236.
24.
GuerreroJJMurilloACSagüésC (2008) Localization and Matching using the planar trifocal tensor with bearing-only data. IEEE Transactions on Robotics24: 494–501.
25.
HarrisCStephensM (1988) A combined corner and edge detector. In 4th Alvey Vision Conference.
26.
KatoTNinomiyaYMasakiI (2002) An obstacle detection method by fusion of radar and motion stereo. IEEE Transactions on Intelligent Transportation Systems3: 182–188.
27.
KhatibO (1985) Real-time obstacle avoidance for manipulators and mobile robots. In IEEE International Conference on Robotics and Automation, Durham, UK.
28.
LamirauxFBonnafousDLefebvreO (2004) Reactive path deformation for nonholonomic mobile robots. IEEE Transactions on Robotics20: 967–977.
29.
LapierreLZapataRLepinayP (2007) Simultaneous path following and obstacle avoidance control of a unicycle-type robot. In IEEE International Conference on Robotics and Automation, Rome, Italy.
LeeT-SEohG-HKimJLeeB-H (2010) Mobile robot navigation with reactive free space estimation. In IEEE/RSJ International Conference on Intelligent Robots and Systems, Taipei, Taiwan.
32.
López-NicolásGGansNRBhattacharyaSSagüésCGuerreroJJHutchinsonS (2010) An optimal homography-based control scheme for mobile robots with nonholonomic and field-of-view constraints. IEEE Transactions on Systems, Man, and Cybernetics, Part B40: 1115–1127.
33.
López-NicolásGSagüésC (2011) Vision-based exponential stabilization of mobile robots. Autonomous Robots30: 293–306.
34.
LoweDG (2004) Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision60: 91–110.
35.
MariottiniGLOrioloGPrattichizzoD (2007) Image-based visual servoing for nonholonomic mobile robots using epipolar geometry. IEEE Transactions on Robotics23: 87–100.
36.
MinguezJLamirauxFLaumondJP (2008) Motion planning and obstacle avoidance. In SicilianoBKhatibO (eds.), Springer Handbook of Robotics. Berlin: Springer, pp. 827–852.
37.
NunesULaugierCTrivediM (2009) Introducing perception, planning, and navigation for intelligent vehicles. IEEE Transactions on Intelligent Transportation Systems10: 375–379.
38.
OhyaAKosakaAKakA (1998) Vision-based navigation by a mobile robot with obstacle avoidance using a single-camera vision and ultrasonic sensing. IEEE Transactions on Robotics and Automation14: 969–978.
39.
QuinlanSKhatibO (1993) Elastic bands: connecting path planning and control. In IEEE International Conference on Robotics and Automation, Atlanta, GA.
40.
RoyerELhuillierMDhomeMLavestJ-M (2007) Monocular vision for mobile robot localization and autonomous navigation. International Journal of Computer Vision74: 237–260.
41.
ScaramuzzaDSiegwartR (2008) Appearance-guided monocular omnidirectional visual odometry for outdoor ground vehicles. IEEE Transactions on Robotics24: 1015–1026.
42.
SciaviccoLSicilianoB (2000) Modeling and Control of Robot Manipulators. New York: Springer.
43.
ŠegvićSRemazeillesADiosiAChaumetteF (2008) A mapping and localization framework for scalable appearance-based navigation. Computer Vision and Image Understanding113: 172–187.
44.
ShiJTomasiC (1994) Good features to track. In IEEE Conference on Computer Vision and Pattern Recognition, Seattle, WA.
45.
TahriOChaumetteF (2005) Point-based and region-based image moments for visual servoing of planar objects. IEEE Transactions on Robotics21: 1116–1127.
46.
Von HundelshausenFHimmelsbachMHeckerFMuellerAWuenscheH-J (2008) Driving with tentacles-Integral structures of sensing and motion. Journal of Field Robotics25: 640–673.
47.
WadaTDoiSHiraokaS (2009) A deceleration control method of automobile for collision avoidance based on driver’s perceptual risk. In IEEE/RSJ International Conference on Intelligent Robots and Systems.
48.
YanZXiaodongXXuejunPWeiW (2003) Mobile robot indoor navigation using laser range finder and monocular vision. In IEEE International Conference on Intelligent Systems and Signal Processing, Faro, Portugal.
49.
ZhangYLinWCChinY-KS (2008) Driving skill characterization: a feasibility study. In IEEE International Conference on Robotics and Automation, Pasadena, CA.
50.
ZhangAMKleemanL (2009) Robust appearance based visual route following for navigation in large-scale outdoor environments. The International Journal of Robotics Research28: 331–356.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
