Sage Journals: Discover world-class research

Abstract

While quadrotors are becoming more popular, control of these unmanned air vehicles should be improved. In this study, a new intelligent image-based visual servo control system is proposed for the flight guidance control of quadrotors. Features are essential for visual servoing and the proposed system utilizes the features of a shape that provide a clear sight of the landing site instead of point features. Furthermore, the system focuses on three problems of visual servo control: finding an appropriate gain value under velocity limits, keeping the shape features in the field of view and tracking a moving target. As a solution to the first problem, a fuzzy logic unit that uses feature error and error derivative norms as inputs are deployed to assign the gain, adaptively. The second problem is solved by defining safe and risky regions in the image plane to take precautions before field of view missing. Another fuzzy logic unit is activated when the shape passes through a risky region to provide counter velocity in x or y direction and to drag the shape through the safe region. As the last stage, Kalman filtering with Potter’s square root update is added to the proposed system to increase the feature tracking performance. This update also promises divergence avoidance. To show the performance of the proposed system, simulation results for fixed and moving targets under feature disturbance are presented for a quadrotor. The results verify that the proposed system is capable of handling visual servoing problems.

Keywords

Visual servoing quadrotor fuzzy logic Kalman filtering intelligent systems

Get full access to this article

View all access options for this article.

References

Abdessameud

Janabi-Sharifi

(2015) Image-based tracking control of VTOL unmanned aerial vehicles. Automatica 53: 111–119.

Altug

Ostrowski

Taylor

(2005) Control of a quadrotor helicopter using dual camera visual feedback. The International Journal of Robotics Research 24(5): 329–341.

Asl

Oriolo

Bolandi

(2014) An adaptive scheme for image-based visual servoing of an underactuated UAV. International Journal of Robotics and Automation 29(1): 1–30.

Ceren

Altug

(2012) Image based and hybrid visual servo control of an unmanned aerial vehicle. Journal of Intelligent & Robotic Systems 65(1–4): 325–344.

Chaumette

Hutchinson

(2006) Visual servo control. I. Basic approaches. IEEE Robotics and Automation Magazine 13(4): 82–90.

Chesi

et al . (2004) Keeping features in the field of view in eye-in-hand visual servoing: A switching approach. IEEE Transactions on Robotics 20(5): 908–913.

Chesi

Hung

(2007) Global path-planning for constrained and optimal visual servoing. IEEE Transactions on Robotics, 23(5), pp.1050–1060.

Collewet

Marchand

Chaumette

(2008) Visual servoing set free from image processing. In: Proceedings – IEEE International Conference on Robotics and Automation, pp. 81–86. Pasadena, California USA: IEEE.

Corke

(2011) Robotics, Vision & Control: Fundamental Algorithms in Matlab. USA: Springer US.

10.

Corke

Hutchinson

(2001) A new partitioned approach to image-based visual servo control. IEEE Transactions on Robotics and Automation 17(4): 507–515.

11.

Cunha

et al . (2011) Vision-based control for rigid body stabilization. Automatica 47(5): 1020–1027.

12.

De Plinval

Burlion

(2011) Advances in aerospace guidance, navigation and control. In Holzapfel

Florian

Theil

Stephan

(eds): Advances in Aerospace Guidance, Navigation and Control, pp. 287–301. USA: Springer.

13.

De Plinval

et al . (2014) Visual servoing for underactuated VTOL UAVs: A linear, homography-based framework. International Journal of Robust and Nonlinear Control 24(16): 2285–2308.

14.

Hamel

Mahony

(2002) Visual servoing of an under-actuated dynamic rigid-body system: An image-based approach. IEEE Transactions on Robotics and Automation 18(2): 187–198.

15.

Hamel

Mahony

(2007) Image based visual servo-control for a class of aerial robotic systems. Automatica 43(March): 1975–1983.

16.

Herissé

et al . (2012) Landing a VTOL unmanned aerial vehicle on a moving platform using optical flow. IEEE Transactions on Robotics 28(1): 77–89.

17.

Janabi-Sharifi

Deng

Wilson

(2011) Comparison of basic visual servoing methods. IEEE/ASME Transactions on Mechatronics 16(5): 967–983.

18.

Kallem

et al . (2007) Kernel-based visual servoing. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 1975–1980. San Diego, USA: IEEE.

19.

Kermorgant

Chaumette

(2014) Dealing with constraints in sensor-based robot control. IEEE Transactions on Robotics 30(1): 244–257.

20.

Lee

et al . (2012) Adaptive image-based visual servoing for an underactuated quadrotor system. Journal of Guidance, Control, and Dynamics 35(4): 1335–1353. Available at: http://arc.aiaa.org/doi/abs/10.2514/1.52169 (accessed on 1 November 2017).

21.

Mahony

Hamel

(2005) Image-based visual servo control of aerial robotic systems using linear image features. IEEE Transactions on Robotics 21(2): 227–239.

22.

Malis

Chaumette

Boudet

(1999) 2 1/2 D visual servoing. IEEE Transactions on Robotics and Automation 15(2): 238–250.

23.

McFadyen

Jabeur

Corke

(2017) Image-based visual servoing with unknown point feature correspondence. IEEE Robotics and Automation Letters 2(2): 601–607.

24.

Mebarki

Lippiello

Siciliano

(2015) Nonlinear visual control of unmanned aerial vehicles in GPS-denied environments. IEEE Transactions on Robotics 31(4): 1004–1017.

25.

Metni

Hamel

(2007) Visual Tracking control of aerial robotic systems with adaptive depth estimation. International Journal of Control, Automation, and Systems 5(1): 51–60.

26.

Odile

et al . (2007) Kinematic visual servo control of a quadrotor aerial vehicle. IEEE Transactions on Robotics 25(3): 833–838.

27.

Ozawa

Chaumette

(2011) Dynamic visual servoing with image moments for a quadrotor using a virtual spring approach. In: Proceedings – IEEE International Conference on Robotics and Automation, April, pp. 5670–5676. Shanghai, China: IEEE.

28.

Palm

Driankov

Hellendoorn

(1996) Model Based Fuzzy Control Fuzzy Gain Schedulers and Sliding Mode Fuzzy Controllers, Springer US.

29.

Pounds

PEI

(2007) Design, Construction and Control of a Large Quadrotor Micro Air Vehicle. The Australian National University. Available at: http://www.eng.yale.edu/pep5/P_Pounds_Thesis_2008.pdf%5Cnhttp://www.eng.yale.edu/pep5/publications.html (accessed 1 November 2017).

30.

Roy

DasGupta

Paul

(2013) Impact of space weather events on satellite-based navigation. Space Weather 11(12): 680–686.

31.

Santamaria-Navarro

Andrade-Cetto

(2013) Uncalibrated image-based visual servoing. In: Proceedings – IEEE International Conference on Robotics and Automation, pp. 5247–5252. Karlsruhe, Germany: IEEE.

32.

Shi

et al . (2016) Decoupled visual servoing with fuzzy Q-learning. IEEE Transactions on Industrial Informatics 3203(c), pp. 1–1. Available at: http://ieeexplore.ieee.org/document/7590013/ (accessed 1 November 2017).

33.

Shirzadeh

et al . (2015) An indirect adaptive neural control of a visual-based quadrotor robot for pursuing a moving target. ISA Transactions 59: 290–302.

34.

Simon

(2006) Optimal State Estimation. USA: Wiley Publishing.

35.

Tahri

Chaumette

(2005) Point-based and region-based image moments for visual servoing of planar objects. IEEE Transactions on Robotics 21(6): 1116–1127.

36.

Thomas

et al . (2016) Visual servoing of quadrotors for perching by hanging from cylindrical objects. IEEE Robotics and Automation Letters 1(1): 57–64.

37.

Xie

Lynch

(2017) Input saturated visual servoing for unmanned aerial vehicles 22(2): 952–960.

38.

Yin

Shi

Yang

(2016) Adaptive Fuzzy control of strict-feedback nonlinear time-delay systems with unmodeled dynamics. IEEE Transactions on Cybernetics 46(8): 1926–1938.

An intelligent visual servo control system for quadrotors

Abstract

Keywords

Get full access to this article

References