Feature Detection for Haptic Exploration with Robotic Fingers

Abstract

The authors consider the detection of small surface features, such as cracks, bumps, and ridges, on the surface of an object during haptic exploration and dexterous manipulation. Surface feature definition and detection are essential for intelligent haptic exploration and modeling of unknown objects. First, the authors review the representation of object surface geometry and present definitions of features based on local surface curvature. These definitions depend on both the geometry of the robot fingertips and the object being explored. It is also shown that the trajectory traced by a round fingertip rolling or sliding over the object surface has some intrinsic properties that facilitate feature detection. Several algorithms for feature detection based on feature definitions are described and compared, and simulated and experimental results are presented for feature detection using a hemispherical fingertip equipped with a tactile sensor.

Get full access to this article

View all access options for this article.

References

Allen, P. K., and Michelman, P. 1990. Acquisition and interpretation of 3-D sensor data from touch . IEEE Transactions on Robotics and Automation 6(4): 397–404 .

Beckwith, T. G., Marangoni, R. D., and Lienhard, J. H. 1993. Mechanical Measurements. Reading, MA: Addison-Wesley .

Brown, K. N., McMahon, C. A., and Williams, J.H.S. 1995. Features: aka The semantics of a formal language of manufacturing . Research in Engineering Design 7(3): 151–172 .

Eberly, D., Gardner, R., Morse, B., Pizer, S., and Scharlach, C. 1994. Ridges for image analysis . Journal of Mathematical Imaging and Vision 4(4): 353–373 .

Ellis, R. E. 1984. Extraction of tactile features by passive and active sensing . Intelligent Robots and Computer Vision, Proceedings of SPIE 521: 289–295 .

Interrante, I. 1997. Illustrating surface shape in volume data via principal direction-driven 3D line integral convolution . Proceedings of 24th International Conference on Computer Graphics and Interactive Techniques, Los Angeles, pp. 109–116 .

Klatzky, R. L., and Lederman, S. 1990. Intelligent exploration by the human hand. In Dextrous Robot Hands, ed. S. T. Venkataraman and T. Iberall, 66–81. Berlin: Springer-Verlag .

Koenderink, J. J. 1990. Solid Shape. Cambridge, MA: MIT Press .

Kunii, T. L., Belyaev, A. G., Anoshkina, E. V., Takahashi, S., Huang, R., and Okunev, O. G. 1994. Hierarchic shape description via singularity and multiscaling . Proceedings of the 18th Annual International Computer Software and Applications Conference (COMPSAC 94), pp. 242–251 .

10.

Kweon, I. S., and Kanade, T. 1994. Extracting topographic terrain features from elevation maps . CVGIP: Image Understanding 59(2): 171–182 .

11.

Li, Z. X., Qin, Z., Jiang, S., and Han, L. 1998. Coordinated motion generation and real-time grasping force control for multifingered manipulation . Proceedings of the IEEE International Conference on Robotics and Automation, pp. 3631–3638 .

12.

Maekawa, H., Tanie, K., and Komoriya, K. 1993. A fingershaped tactile sensor using an optical waveguide . Proceedings of the IEEE International Conference on Systems, Man and Cybernetics, pp. 403–408 .

13.

Maekawa, H., Tanie, K., and Komoriya, K. 1995. Tactile sensor based manipulation of an unknown object by a multi-fingered hand with rolling contact . Proceedings of the IEEE International Conference on Robotics and Automation, pp. 743–750 .

14.

Maekawa, H., Yokoi, K., Tanie, K., Keneko, M., Kimura, N., and Imamura, N. 1992. Development of a three-fingered robot hand with stiffness control capability . Mechatronics 2(5): 483–494 .

15.

Maintz, J.B.A., van den Elsen, P. A., and Viergever, M. A. 1996. Evaluation of ridge seeking operators for multi-modality medical image matching . IEEE Transactions of Pattern Analysis and Machine Intelligence 18(4): 353–365 .

16.

Mendenhall, W., and Sincich, T. 1995. Statistics for Engineering and the Sciences. Englewood Cliffs, NJ: Prentice Hall .

17.

Monga, O., Benayoun, S., and Faugeras, O. D. 1992. From partial derivatives of 3D density images to ridge lines . IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 354–359 .

18.

Montana, D. J. 1988. The kinematics of contact and grasp . International Journal of Robotics Research 7(3): 17–32 .

19.

Okamura, A. M. 2000. Haptic exploration of unknown objects. Ph.D. thesis, Stanford University, Department of Mechanical Engineering.

20.

Okamura, A. M., and Cutkosky, M. R. 2001. Feature-guided exploration with a robotic finger . Proceedings of the 2001 IEEE International Conference on Robotics and Automation 1: 589–596 .

21.

Okamura, A. M., Turner, M. L., and Cutkosky, M. R. 1997. Haptic exploration of objects with rolling and sliding . Proceedings of the IEEE International Conference on Robotics and Automation 3: 2485–2490 .

22.

Pribadi, K., Bay, J. S., and Hemami, H. 1989. Exploration and dynamic shape estimation by a robotic probe . IEEE Transactions on Systems, Man, and Cybernetics 19(4): 840–846 .

23.

Rossignac, J. R., and Requicha, A.A.G. 1986. Offsetting operations in solid modeling . Computer Aided Geometric Design 3(2): 129–148 .

24.

Spivak, M. 1979. A Comprehensive Introduction to Differential Geometry. Vol. 3. Berkeley, CA: Publish or Perish, Inc.

25.

Stansfield, S. 1988. A robotic perceptual system utilizing passive vision and active touch . International Journal of Robotics Research 7(6): 138–161 .