Performance Tests for Visual Servo Control Systems,with Application to Partitioned Approaches to Visual Servo Control

Abstract

Visual servoing has been a viable method of robot manipulator control for more than a decade. Initial developments involved position-based visual servoing (PBVS), in which the control signal exists in Cartesian space. The younger method, image-based visual servoing (IBVS), has seen considerable development in recent years. PBVS and IBVS offer tradeoffs in performance, and neither can solve all tasks that may confront a robot. In response to these issues, several methods have been devised that partition the control scheme, allowing some motions to be performed in the manner of a PBVS system, while the remaining motions are performed using an IBVS approach.

To date, there has been little research that explores the relative strengths and weaknesses of these methods. In this paper we present such an evaluation. We have chosen three recent visual servo approaches for evaluation in addition to the traditional PBVS and IBVS approaches. We posit a set of performance metrics that mea sure quantitatively the performance of a visual servo controller for a specific task. We then evaluate each of the candidate visual servo methods for four canonical tasks with simulations and with experiments in a robotic work cell.

Keywords

visual servoing partitioned methods performance test comparison

Get full access to this article

View all access options for this article.

References

Chaumette, F. 1998. Potential problems of stability and convergence in image-based and position-based visual servoing . In D. Kriegman , G. Hager , and S. Morse , eds., The Confluence of Vision and Control, Lecture Notes in Control and Information Sciences, Vol. 237, Springer-Verlag, Berlin, pp. 66-78 .

Corke, P. 1993. Visual control of robot manipulators—A review. In K. Hashimoto , ed., Visual Servoing, Robotics and Automated Systems, Vol. 7. World Scientific, Singapore , pp. 1-31.

Corke, P. I. 1996. Robotics toolbox for MATLAB . IEEE Robotics and Automation Magazine 3(1): 24-32 .

Corke, P. I. , and Hutchinson, S. A. 1999. A new partitioned approach to image-based visual servo control . In Proceedings of the 31st International Symposium on Robotics and Automation.

Corke, P. I. , and Hutchinson, S. A. 2000. A new partitioned approach to image-based visual servo control . In Proceedings of the 39th Conference on Decision and Control, December, pp. 2521-2526 .

Deguchi, K. 1998. Optimal motion control for image-based visual servoing by decoupling translation and rotation . In Proceedings of the International Conference on Intelligent Robots and Systems, October, pp. 705-711 .

DeMenthon, D. , and Davis, L. S. 1992. Model-based object pose in 25 lines of code . In European Conference on Computer Vision, pp. 335-343 .

Espiau, B. , Chaumette, F. , and Rives, P. 1992. A new approach to visual servoing in robotics . IEEE Transactions on Robotics and Automation 8: 313-326 .

Faugeras, O. , and Lustman, F. 1988. Motion and structure from motion in a piecewise planar environment . International Journal of Pattern Recognition and Artificial Intelligence 2(3): 485-508 .

10.

Feddema, J. , and Mitchell, O. 1989. Vision-guided servoing with feature-based trajectory generation . IEEE Transactions on Robotics and Automation 5: 691-700 .

11.

Hutchinson, S. , Hager, G. , and Corke, P. 1996. A tutorial on visual servo control . IEEE Transactions on Robotics and Automation 12: 651-670 .

12.

Lenz, R. , and Tsai, R. 1989. A new technique for fully autonomous and efficient 3D robotics hand/eye calibration . IEEE Transactions on Robotics and Automation 5(3): 345-358 .

13.

Malis, E. , Chaumette, F. , and Boudet, S. 1999. 2 1/2 D visual servoing . IEEE Transactions on Robotics and Automation 15: 238-250 .

14.

Martinet, P. 1999. Comparison of visual servoing techniques: Experimental results . In Proceedings of the European Control Conference, ECC'99, August.

15.

Martinet, P. , Gallice, J. , and Khadraoui, D. 1996. Vision based control law using 3d visual features . In Proceedings of WAC `96, May, Montpellier, France, Vol. 3, pp. 497-502 .

16.

Sanderson, A. C. , and Weiss, L. E. 1980. Image-based visual servo control using relational graph error signals . In Proceedings of the IEEE International Conference on Robotics and Automation, pp. 1074-1077 .

17.

Shirai, Y. , and Inoue, H. 1973. Guiding a robot by visual feedback in assembling tasks . Pattern Recognition 5: 99-108 .

18.

Tsai, R. 1987. A versatile camera calibration technique for high accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses . IEEE Journal of Robotics and Automation 3(4): 323-344 .

19.

Weiss, L. E. , Sanderson, A. C. , and Neuman, C. P. 1987. Dynamic sensor-based control of robots with visual feedback . IEEE Journal of Robotics and Automation 3: 404-417 .

20.

Zhang, Z. , and Hanson, A. 1996. 3D reconstruction based on homography mapping. 1996 . In ARPA Image Understanding Workshop, Palm Springs, CA.