212D Visual Servoing with Respect to Planar Contours having Complex and Unknown Shapes

Abstract

In this paper we present a complete system for segmenting, matching, tracking, and visual servoing with respect to unknown planar contours. Our system can be used with arbitrary contours of any shape and without any prior knowledge of their models. The system is first shown the target view. A selected contour is automatically extracted and its image shape is stored. The robot and object are then moved and the system automatically identifies the target. The matching step is performed together with the estimation of the homography matrix between the two views of the contour. Then, a 2½D visual servoing technique is used to reposition the end-effector of a robot at the reference position relative to the planar contour. The system has been successfully tested on several contours with very complex shapes such as leaves, keys, and coastal outlines of islands. Experiments using a ship mock-up without any artificial marker proves that the system can be applied to the ship-building industry.

Keywords

visual servoing matching tracking planar contours unknown shapes

Get full access to this article

View all access options for this article.

References

Basri, R. , Rivlin, E. , and Shimshoni, I. 1998. Visual homing: Surfing on the epipoles . In IEEE International Conference on Computer Vision, Bombay, India, pp. 863-869 .

Canny, J. F. 1986. A computational approach to edge detection . IEEE Transactions on Pattern Analysis and Machine Intelligence 8(6): 679-698 .

Chesi, G. , Malis, E. , and Cipolla, R. 1999. Collineation estimation from two unmatched views of an unknown planar contour for visual servoing . In British Machine Vision Conference, September, Nottingham, UK, Vol. 1, pp. 224-233 .

Chesi, G. , Malis, E. , and Cipolla, R. 2000. Automatic segmentation and matching of planar contours for visual servoing . In International Conference on Robotics and Automation, April, San Francisco, CA, Vol. 3, pp. 2753-2758 .

Collewet, C. , and Chaumette, F. 2000. A contour approach for image-based control on objects with complex shape . In IEEE/RSJ International Conference on Intelligent Robots and Systems, Takamatsu, Japan, Vol. 1, pp. 751-756 .

Drummond, T. , and Cipolla, R. 2000. Application of Lie algebras to visual servoing . In International Journal of Computer Vision 37(1): 21-41 .

Espiau, B. , Chaumette, F. , and Rives, P. 1992. A new approach to visual servoing in robotics . IEEE Transactions on Robotics and Automation 8(3): 313-326 .

Faugeras, O. , and Lustman, F. 1988. Motion and structure from motion in a piecewise planar environment . International Journal of Pattern Recognition and Artificial Intelligence 2(3): 485-508 .

Hashimoto, K. 1993. Visual Servoing: Real-Time Control of Robot Manipulators Based on Visual Sensory Feedback, World Scientific Series in Robotics and Automated Systems, Vol. 7. World Scientific, Singapore .

10.

Hutchinson, S. , Hager, G. D. , and Corke, P.I. 1996. A tutorial on visual servo control . IEEE Transactions on Robotics and Automation 12(5): 651-670 .

11.

Malis, E. , and Chaumette, F. 2002. Theoretical improvements in the stability analysis of a new class of model-free visual servoing methods . IEEE Transaction on Robotics and Automation 18(2): 176-186 .

12.

Malis, E. , Chaumette, F. , and Boudet, S. 1999. 2 1/2 D visual servoing . IEEE Transactions on Robotics and Automation 15(2): 234-246 .

13.

Mezouar, Y. , and Chaumette, F. 2000. Path planning in image space for robust visual servoing . In IEEE International Conference on Robotics and Automation, San Francisco, CA, Vol. 3, pp. 2759-2764 .

14.

Reiss, T. 1993. Recognizing Planar Objects Using Invariant Image Features , Lecture Notes in Computer Science Vol. 676. Springer Verlag, Berlin.

15.

Rothwell, C. 1995. Object Recognition Through Invariant Indexing. Oxford Science Publications, Oxford .

16.

Sato, J. , and Cipolla, R. 1996. Affine integral invariants and matching of curves . In International Conference on Pattern Recognition, Vienna, Austria, Vol. 1, pp. 915-919 .

17.

Taubin, G. , and Cooper, D. 1992. Object recognition based on moment (or algebraic) invariants. In Geometric Invariance in Computer Vision. MIT Press, Cambridge, MA .

18.

Wilson, W. J. , Williams Hulls, C. C. , and Bell, G. S. 1996. Relative end-effector control using Cartesian position-based visual servoing . IEEE Transactions on Robotics and Automation 12(5): 684-696 .

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB