Sage Journals: Discover world-class research

Abstract

In this paper we present our constant curvature dynamic contours (snakes) and three applications of these: visual servoing and grasping, occluding contour depth extraction, and localization of miniature mobile robots. For the first application, a novel deformable contour model is implemented for the automatic determination of plausible grasp axes of unknown objects using an eye-in-hand robotic system. The system finds potential grasp point pairs, ranks them based upon measurements taken from the contour, and executes a vision-guided grasp using the highest ranked grasp point pair to determine the gripper alignment. Our method is based upon statistical active deformable models. We have developed a new snake model that is applicable to real-time vision problems. The grasping method is experimentally verified using both simple and complex unknown grasping targets. These experiments demonstrate the effectiveness of using the proposed snakes to grasp previously unknown objects in minimally structured environments. We also present a novel method for active monocular depth recovery (second application of our snakes). It combines new, highly stable active deformable models with a structured camera motion along the optical axis to produce depth estimates for all snake control points. The method has a simple formulation and is suitable for real-time, vision-based robotic applications. Experiments with a variety of objects and depths demonstrate the practicality of the method. Finally, we present a novel method for localizing miniature mobile robots (Scouts) using dynamic contours. The miniature robot is tracked as it moves and jumps in the environment. The proposed dynamic contours are very effective in tracking the fast accelerations and decelerations of this small robot. We show initial experimental results emphasizing the task of monitoring a Scout's jumps.

Keywords

real-time computer vision active deformable models snakes visual servoing and grasping

Get full access to this article

View all access options for this article.

References

Allen, P. , Timcenko, A. , Yoshimi, B. , and Michelman, P. 1993. Automated tracking and grasping of a moving object with a robotic hand-eye system . IEEE Transactions on Robotics and Automation 9(2): 152-165 .

Amini, A. , Tehrani, S. , and Weymouth, T. 1990. Using dynamic programming for minimizing the energy of active contours in the presence of hard constraints . In Proceedings of the 2nd International Conference on Computer Vision, pp. 95-99 .

Bendiksen, A. , and Hager, G. 1994. A vision-based grasping system for unfamiliar planar objects . In Proceedings of the IEEE International Conference on Robotics and Automation, pp. 2844-2849 .

Bicchi, A. , and Kumar, V. 2000. Robotic grasping and contact: A review . In Proceedings of the IEEE International Conference on Robotics and Automation, Vol. 1, pp. 348-353 .

Boyer, K. L. , and Kak, A. C. 1987. Color-encoded structured light for rapid active ranging . IEEE Transactions on Pattern Analysis and Machine Intelligence 9(1): 14-28 .

Bradly, M. , Grimson, W. , and Langridge, D. 1980. Shape encoding and subjective contours . In Proceedings of the American Association of Artificial Intelligence.

Brigger, P. , Hoeg, J. , and Unser, M. 2000. B-spline snakes: a flexible tool for parametric contour detection . IEEE Transactions of Image Processing 9(9): 1484-1496 .

Burr, D. 1986. Elastic matching of line drawings . IEEE Transactions on Pattern Analysis and Machine Intelligence 3(6): 708-713 .

Cohen, L. D. 1991. On active contour models and balloons . CVGIP: Image Understanding 53(2): 211-218 .

10.

Covell, M. , and Darrell, T. 1999. Dynamic occluding contours: a new external-energy term for snakes . In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition 2: 232-238 .

11.

Faugeras, O. 1993. Three-Dimensional Computer Vision. MIT Press, Cambridge, MA .

12.

Faverjon, B. , and Ponce, J. 1991. On computing two-finger force-closure grasps of curved 2D objects . In Proceedings of the IEEE International Conference on Robotics and Automation, pp. 424-429 .

13.

Horn, B. K. P. 1986. Robot Vision. MIT Press, Cambridge, MA .

14.

Ivins, J. , and Porrill, J. 1994. Active region models for segmenting medical images . In Proceedings of the IEEE International Conference on Image Processing, pp. 227-231 .

15.

Jain, R. , Kasturi, R. , and Schunck, B. 1995. Machine Vision. McGraw-Hill, New York .

16.

Kass, M. , Witkin, A. , and Terzopoulos, D. 1987. Snakes: active contour models . In Proceedings of the First International Conference on Computer Vision, pp. 259-268 .

17.

Marr, D. 1994. Vision: A computational investigation into the human representation and processing of the visual information. W. H. Freeman and Co., San Francisco, CA .

18.

Matthies, L. , Kanade, T. , and Szeliski, R. 1989. Kalman filter-based algorithms for estimating depth from image sequences . International Journal of Computer Vision 3(3): 209-238 .

19.

Osher, S. , and Sethian, J. A. 1988. Fronts propagating with curvature-dependent speed: Algorithms based on Hamilton-Jacobi formulations . Journal of Computational Physics 79: 12-49 .

20.

Perrin, D. , and Smith, C. 2001. Rethinking curvature for dynamic contours . In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Vol. 2, pp. 615-620 .

21.

Perrin, D. , Masoud, O. , Smith, C. E. , and Papanikolopoulos, N. P. 2000. Unknown object grasping using statistical pressure models . In Proceedings of the 2000 IEEE International Conference on Robotics and Automation, April, pp. 1054-1059 .

22.

Ronfard, R. 1994. Region-based strategies for active contour models . International Journal of Computer Vision 13(2): 229-251 .

23.

Rößler, P., Stoeter, S. A., Rybski, P. E., and Papanikolopoulos, N. 2002. Visual servoing of a miniature robot toward a marked target. Technical Report 02-005, University of Minnesota, Department of Computer Science and Engineering, Minneapolis, MN, USA.

24.

Rybski, P. E. , Papanikolopoulos, N. P. , Stoeter, S. A. , Krantz, D. G. , Yesin, K. B. , Gini, M. , Voyles, R. , Hougen, D. F. , Nelson, B. , and Erickson, M. D. 2000. Enlisting rangers and scouts for reconnaissance and surveillance . IEEE Robotics and Automation Magazine 7(4): 14-24 .

25.

Smith, C. E. , and Papanikolopoulos, N. P. 1994. Computation of shape through controlled active exploration . In Proceedings of the IEEE International Conference on Robotics and Automation, pp. 2516-2521 .

26.

Smith, C. , and Papanikolopoulos, N. 1997. Grasping of static and moving objects using a vision-based control approach . Journal of Intelligent and Robotic Systems: Theory and Applications 19: 237-270 .

27.

Stewart, D. , Schmitz, D. , and Khosla, P. 1989. Chimera ii: A real-time multi-processing environment for sensor-based robot control . In Proceedings of the 4th International Symposium on Intelligent Control, pp. 265-271 .

28.

Sullivan, M. , and Papanikolopoulos, N. 1996. Using active-deformable models to track deformable objects in robotic visual servoing experiments . In Proceedings of the IEEE International Conference on Robotics and Automation, pp. 2929-2934 .

29.

Taylor, M. , Blake, A. , and Cox, A. 1994. Visually guided grasping in 3D . In Proceedings of the IEEE International Conference on Robotics and Automation, pp. 761-766 .

30.

Tomasi, C. , and Kanade, T. 1992. Shape and motion from image streams under orthography: a factorization method . International Journal of Computer Vision 9(2): 137-154 .

31.

Williams, D. , and Shah, M. 1992. A fast algorithm for active contours and curvature estimation . CVGIP: Image Understanding 55(1): 14-26 .

32.

Xu, C. , and Prince, J. 1998. Snakes, shapes, and gradient vector flow . IEEE Transactions on Image Processing 7(3): 359-369 .

33.

Yoshimi, B. , and Allen, P. 1994. Visual control of grasping and manipulation tasks . In Proceedings of the IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems, pp. 575-582 .

34.

Yu, L.-Y. , and Dyer, C. 2001. Perception-based 2D shape modeling by curve shaping . In Proceedings of the 4th International Workshop on Visual Form, Lecture Notes in Computer Science. Springer-Verlag, Berlin.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB