Sage Journals: Discover world-class research

Abstract

In this paper we present new uncalibrated control schemes for vision-guided robotic tracking of a moving target using a moving camera. These control methods are applied to an uncalibrated robotic system with eye-in-hand visual feedback. Without a priori knowledge of the robot's kinematic model or camera calibration, the system is able to track a moving object through a variety of motions and maintain the object's image features in a desired position in the image plane. These control schemes estimate the system Jacobian as well as changes in target features due to target motion. Four novel strategies are simulated and a variety of parameters are investigated with respect to performance. Simulation results suggest that a Gauss-Newton method utilizing a partitioned Broyden's method for model estimation provides the best steady-state tracking behavior.

Keywords

uncalibrated eye-in-hand visual servoing nonlinear least squares Jacobian estimation

Get full access to this article

View all access options for this article.

References

Allotta, B. , and Colombo, C. 1999. On the use of linear camera-object interaction models in visual servoing . IEEE Transactions on Robotics and Automation 15(2): 350-357 .

Baeten, J. , and De Schutter, J. 1999. Improving force controlled planar contour following using on-line eye-in-hand vision based feedforward . In International Conference on Advanced Intelligent Mechatronics, September, pp. 902-907 .

Chaumette, F. , Rives, P. , and Espiau, B. 1991. Positioning of a robot with respect to an object, tracking it, and estimating its velocity by visual servoing . In IEEE International Conference on Robotics and Automation, April, pp. 2248-2253 .

Corke, P. I. 1996. A robotics toolbox for MATLAB . IEEE Robotics and Automation Magazine 3(1): 24-32 .

Corke, P. I. , and Hutchinson, S. A. 2001. A new partitioned approach to image-based visual servo control . IEEE Transactions on Robotics and Automation 17(4): 507-515 .

Crétual, A. , Chaumette, F. , and Bouthemy, P. 1991. Complex object tracking by visual servoing based on 2d image motion . In 14th International Conference on Pattern Recognition, August, pp. 1251-1254 .

Dennis, J. E. , and Schnabel, R. B. 1983. Numerical Methods for Unconstrained Optimization and Nonlinear Equations. Prentice-Hall, Englewood Cliffs, NJ .

Flandin, G. , Chaumette, F. , and Marchand, E. 2000. Eyein-hand/eye-to-hand cooperation for visual servoing . In IEEE International Conference on Robotics and Automation, April, pp. 2741-2746 .

Franklin, G. F. , Powell, J. D. , and Workman, M. L. 1990. Digital Control of Dynamic Systems. Addison-Wesley, Reading, MA .

10.

Hashimoto, K. , and Noritsugu, T. 1999. Visual servoing with linearized observer . In International Conference on Robotics and Automation, May, pp. 263-268 .

11.

Haykin, S. 1991. Adaptive Filter Theory. Prentice-Hall, Englewood Cliffs, NJ .

12.

Hosoda, K. , and Asada, M. 1994. Versatile visual servoing without knowledge of true Jacobian . In IEEE/RSJ/GI International Conference on Intelligent Robots and Systems, September, Munich, Germany, pp. 186-193 .

13.

Hosoda, K. , Igarashi, K. , and Asada, M. 1998. Adaptive hybrid control for visual servoing and force servoing in an unknown environment . IEEE Robotics and Automation Magazine 5(4): 39-43 .

14.

Jagersand, M. , Fuentes, O. , and Nelson, R. 1997. Experimental evaluation of uncalibrated visual servoing for precision manipulation . In Proceedings of International Conference on Robotics and Automation, April, Albuquerque, NM, pp. 2874-2880 .

15.

Jang, W. , and Bien, Z. 1991. Feature-based visual servoing of an eye-in-hand robot with improved tracking performance . In IEEE International Conference on Robotics and Automation, April, pp. 2254-2260 .

16.

Malis, E. 2002. Vision-based control invariant to camera intrinsic parameters: Stability analysis and path tracking . In IEEE International Conference on Robotics and Automation, pp. 217-222 .

17.

Malis, E. , and Chaumette, F. 2002. Theoretical improvements in the stability analysis of a new class of model-free visual servoing methods . IEEE Transactions on Robotics and Automation 18(2): 176-186 .

18.

Oh, P. Y. , and Allen, P. K. 2001. Visual servoing by partitioning degrees of freedom . IEEE Transactions on Robotics and Automation 17(1): 1-17 .

19.

Papanikolopoulos, N. P. , Khosla, P. K. , and Kanade, T. 1993. Visual tracking of a moving target by a camera mounted on a robot: A combination of control and vision . IEEE Transactions on Robotics and Automation 9(1): 14-35 .

20.

Piepmeier, J. A. 1999. A Dynamic Quasi-Newton Method for Model Independent Visual Servoing. Ph.D. Thesis, Georgia Institute of Technology.

21.

Piepmeier, J. A. , McMurray, G. V. , and Lipkin, H. 1999a. A dynamic quasi-Newton method for uncalibrated visual servoing . In IEEE International Conference on Robotics and Automation, May, Detroit, MI, pp. 1595-1600 .

22.

Piepmeier, J. A. , McMurray, G. V. , and Lipkin, H. 1999b. Experimental results utilizing vision-based control for un-calibrated robotic systems . In SPIE International Symposium on Intelligent Systems and Advanced Manufacturing, September, Boston, MA.

23.

Yoshimi, B. H. , and Allen, P. K. 1994. Active, uncalibrated visual servoing . In Proceedings of the IEEE International Conference on Robotics and Automation, San Diego, CA, pp. 156-161 .

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

Uncalibrated Eye-in-Hand Visual Servoing

Abstract

Keywords

Get full access to this article

References

Supplementary Material