Sage Journals: Discover world-class research

Abstract

In the classical image-based visual servoing framework, error signals are directly computed from image feature parameters, allowing, in principle, control schemes to be obtained that need neither a complete three-dimensional (3D) model of the scene nor a perfect camera calibration. However, when the computation of control signals involves the interaction matrix, the current value of some 3D parameters is requiredfor each considered feature, and typically a rough approximation of this value is used. With reference to the case of a point feature, for which the relevant 3D parameter is the depth Z, we propose a visual servoing approach where Z is observed and made available for servoing. This is achieved by interpreting depth as an unmeasurable state with known dynamics, and by building a non-linear observer that asymptotically recovers the actual value of Z for the selected feature. A byproduct of our analysis is the rigorous characterization of camera motions that actually allow such observation. Moreover, in the case of a partially uncalibrated camera, it is possible to exploit complementary camera motions in order to preliminarily estimate the focal length without knowing Z. Simulations and experimental results are presented for a mobile robot with an on-board camera in order to illustrate the benefits of integrating the depth observation within classical visual servoing schemes.

Keywords

Image-Based Visual Servoing Nonlinear Observers Depth Observation Focal Length Observation Mobile Robots

Get full access to this article

View all access options for this article.

References

Benhimane, S. and Malis, E. (2006). Homography-based 2D visual servoing . Proceedings of the 2006 IEEE International Conference on Robotics and Automation, pp. 2397-2402.

Bouguet, J.-Y. (2007). Camera Calibration Toolbox for MATLAB. http://www.vision.caltech.edu/bouguetj/calib\_doc.

Chaumette, F. (1998). Potential problems of stability and convergence in image-based and position-based visual servoing. The Confluence of Vision and Control, Kriegman, D. , Hager, G. and Morse, A. (eds), Lecture Notes in Control and Information Science, Vol. 237. Berlin, Springer, pp. 66-78.

Chaumette, F. (2004). Image moments: A general and useful set of features for visual servoing . IEEE Transactions on Robotics and Automation , 20(4): 713-723.

Chaumette, F. , Boukir, S. , Bouthemy, P. and Juvin, D. (1996). Structure from controlled motion . IEEE Transactions on Pattern Analysis andMachine Intelligence, 18(5): 492-504.

Chaumette, F. and Hutchinson, S. (2006a). Visual servo control . I. Basic approaches. IEEE Robotics and Automation Magazine, 13(4): 82-90.

Chaumette, F. and Hutchinson, S. (2006b). Visual servo control. II. Advanced approaches . IEEE Robotics and Automation Magazine, 14(1): 109-118.

Conticelli, F. and Allotta, B. (2001). Nonlinear controllability and stability analysis of adaptive image-based systems . IEEE Transactions on Robotics and Automation, 17(2): 208-214.

Conticelli, F. , Allotta, B. and Khosla, P.K. (1999). Image-based visual servoing of nonholonomic mobile robots . Proceedings of the 38th IEEE Conference on Decision and Control, pp. 3496-3501.

10.

Corke, P.I. and Hutchinson, S.A. (2001). A new partitioned approach to image-based visual servo control . IEEE Transactions on Robotics and Automation, 17(4): 507-515.

11.

Cyberbotics (2007). Webots. http://www.cyberbotics.com.

12.

De Luca, A. , Oriolo, G. and Robuffo Giordano, P. (2007a). Image-based visual servoing schemes for nonholonomic mobile manipulators . Robotica, 25(2): 131-145.

13.

De Luca, A. , Oriolo, G. and Robuffo Giordano, P. (2006). Kinematic modeling and redundancy resolution for nonholonomic mobile robots . Proceedings of the 2006 IEEE International Conference on Robotics and Automation , pp. 1867-1873.

14.

De Luca, A. , Oriolo, G. , and Robuffo Giordano, P. (2007b). On-line estimation of feature depth for image-based visual servoing schemes . Proceedings of the 2007 IEEE International Conference on Robotics and Automation , pp. 2823-2828.

15.

Deguchi, K. (1998). Optimal motion control for image-based visual servoing by decoupling translation and rotation . Proceedings of the 1998 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 705-711.

16.

Espiau, B. (1993). Effect of camera calibration errors on visual servoing in robotics . Proceedings of the 3rd International Symposium on Experimental Robotics, pp. 182-192.

17.

Espiau, B. , Chaumette, F. and Rives, P. (1992). A new approach to visual servoing in robotics . IEEE Transactions on Robotics and Automation, 8(3): 313-326.

18.

Friedland, B. (1986). Control System Design: An Introduction to State-Space Methods. New York, McGraw-Hill.

19.

Hutchinson, S. , Hager, G.D. and Corke, P.I. (1996). A tutorial on visual servo control . IEEE Transactions on Robotics and Automation, 12(5): 651-670.

20.

Inaba, H. , Yoshida, A. , Abdursul, R. and Ghosh, B.K. (2000). Observability of perspective dynamical systems . Proceedings of the 39th IEEE Conference on Decision and Control, pp. 5157-5162.

21.

Khalil, H.K. (1996). Nonlinear Systems (2nd edn). Englewood Cliffs, NJ, Prentice-Hall.

22.

Ma, Y. , Soatto, S. , Kosecka, J. and Sastry, S.S. (2004). An Invitation to 3-D Vision. New York, Springer.

23.

Maciejewski, A.A. and Klein, C.A. (1989). The singular value decomposition: computation and applications to robotics . International Journal of Robotics Research, 8(6): 63-79.

24.

Malis, E. (2004). Visual servoing invariant to changes in camera-intrinsic parameters . IEEE Transactions on Robotics and Automation, 20(1): 72-81.

25.

Malis, E. and Chaumette, F. (2002). Theoretical improvements in the stability analysis of a new class of model-free visual servoing methods . IEEE Transactions on Robotics and Automation, 18(2): 176-186.

26.

Malis, E. , Chaumette, F. and Boudet, S. (1999). 2-1/2-D visual servoing . IEEE Transactions on Robotics and Automation, 15(2): 238-250.

27.

Malis, E. and Rives, P. (2003). Robustness of image-based visual servoing with respect to depth distribution errors . Proceedings of the 2003 IEEE International Conference on Robotics and Automation, pp. 1056-1061.

28.

Marino, R. and Tomei, P. (1995). Nonlinear Control Design: Geometric, Adaptive and Robust. London, Prentice-Hall .

29.

Mathworks (2007). MATLAB. http://www.mathworks.com/products/matlab/.

30.

Matthies, L. , Szelinski, R. and Kanade, T. (1989). Kalman filter-based algorithms for estimating depth from image sequences . International Journal of Computer Vision, 3: 209-236.

31.

Morel, G. , Liebezeit, T. , Szewczyk, J. , Boudet, S. and Pot, J. (2000). Explicit incorporation of 2D constraints in vision based control of robot manipulators. Experimental Robotics VI, Corke, P. and Trevelyan, J. (eds). Berlin, Springer.

32.

Murray, R.M. , Li, Z. and Sastry, S.S. (1994). A Mathematical Introduction to Robotic Manipulation . Boca Raton, FL, CRC Press.

33.

Robuffo Giordano, P. , De Luca, A. and Oriolo, G. (2008). 3D structure identification from image moments . Proceedings of the 2008 IEEE International Conference on Robotics and Automation, pp. 93-100.

34.

Sepp, W. , Fuchs, S. and Arbter, K. (2005). DLR Calibration Detection Toolbox (CalDe 0.99.0) . http://www.dlr.de/rm/callab.

35.

Smith, C.E. and Papanikolopoulos, N.P. (1994). Computation of shape through controlled active exploration . Proceedings of the 1994 IEEE International Conference on Robotics and Automation, pp. 2516-2521.

36.

Soatto, S. , Frezza, R. and Perona, P. (1996). Motion estimation via dynamic vision . IEEE Transactions on Automatic Control, 41(3): 393-413.

37.

Strobl, K.H. and Hirzinger, G. (2006). Optimal hand-eye calibration . Proceedings of the IEEE/RSJ International Conference on Robots and Intelligent Systems, pp. 4647-4653.

38.

Strobl, K.H. and Paredes, C. (2005). DLR Calibration Laboratory (CalLab 0.99.5). http://www.dlr.de/rm/callab.

39.

Tahri, O. and Chaumette, F. (2005). Point-based and region-based image moments for visual servoing of planar objects . IEEE Transactions on Robotics , 21(6): 1116-1127.

40.

Taylor, C. , Ostrowski, J. and Jung, S. (2000). Robust vision-based pose control . Proceedings of the 2000 IEEE International Conference on Robotics and Automation, pp. 2734-2740.

41.

Wilson, W.J. , Hulls, C.C.W. and Bell, G.S. (1996). Relative end-effector control using cartesian position based visual servoing . IEEE Transactions on Robotics and Automation, 12(5): 684-696.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB