Sage Journals: Discover world-class research

Abstract

In this paper we show how to use the task frame to easily model, implement and execute three-dimensional (3D) robotic tasks, which integrate force control and visual servoing, in an uncalibrated workspace.

In contrast to most hybrid vision/force research, this work uses eye-in-hand vision and force control. Mounting both sensors on the same end-effector gives rise to new constraints, control issues and advantages, which are discussed in this paper.

On the one hand, in this paper we emphasize shared control in which both vision and force simultaneously control a given task frame direction. Our work shows the usefulness and feasibility of a range of tasks which use shared control. Moreover, it offers a framework based on the task frame formalism (TFF) to distinguish between different basic forms of shared control. Each basic form is illustrated by a robotic task with shared control in only one direction. In addition, an extension to classify multi-dimensional shared control tasks is presented.

On the other hand, a new classification is presented which distinguishes between four meaningful tool/camera configurations, being parallel or non-parallel endpoint closed-loop and fixed or variable endpoint open-loop. Corresponding control strategies are discussed, resulting in either collocated or non-collocated vision/force control. Several task examples (in 3D space), specified in the TFF, illustrate the use of these four configurations. As shown by the presented experimental results, the tasks at hand benefit from the integrated control approach.

Keywords

vision/force integration hybrid control shared control visual servoing force control task frame robotic servoing

Get full access to this article

View all access options for this article.

References

Baeten, J. , and De Schutter, J. 1999. Improving force controlled planar contour following using on-line eye-in-hand vision based feedforward . In Proceedings of International Conference on Advanced Intelligent Mechatronics, September, Atlanta, GA, pp. 902-907 .

Baeten, J. , and De Schutter, J. 2002. Hybrid vision/force control at corners in planar robotic contour following . IEEE/ASME Transactions on Mechatronics 7(2): 143-151 .

Baeten, J. , Verdonck, W. , Bruyninckx, H. , and De Schutter, J. 2000. Combining force control and visual servoing for planar contour following . Machine Intelligence and Robotic Control 2(2): 69-75 .

Bruyninckx, H. , and De Schutter, J. 1996. Specification of force-controlled actions in the “task frame formalism”—A synthesis . IEEE Transactions on Robotics and Automation 12(4): 581-589 .

Corke, P. I. 1994. Visual control of robot manipulators—A review . In Workshop M-5, Visual Servoing: Achievements, Applications and Open Problems, IEEE International Conference on Robotics and Automation, San Diego, CA, pp. 1-31 .

Corke, P. I. 1996a. Dynamic issues in robot visual-servo systems . In G. Giralt and G. Hirzinger , eds., Robotics Research. The Seventh International Symposium. Springer-Verlag, Berlin, pp. 488-498 .

Corke, P. I. 1996b. Visual control of robots: high-performance visual servoing. In Mechatronics. Research Studies Press, Wiley, New York .

De Schutter, J. , and Van Brussel, H. 1988. Compliant robot motion. I. A formalism for specifying compliant motion tasks, II. A control approach based on external control loops . International Journal of Robotics Research 7(4): 3-33 .

Hirzinger, G. 1983. Direct digital control using a force-torque sensor . In Proceedings IFAC Symposium on Real Time Digital Control Applications.

10.

Hosoda, K. , Igarashi, K. , and Asada, M. 1998. Adaptive hybrid control for visual and force servoing in an unknown environment . IEEE Robotics and Automation Magazine 5(4): 39-43 .

11.

Hutchinson, S. , Hager, G. , and Corke, P. 1996. A tutorial on visual servo control . IEEE Transactions on Robotics and Automation 12(5): 651-670 .

12.

Jörg, S. , Langwald, J. , Stelter, J. , Hirzinger, G. , and Natale, C. 2000. Flexible robot-assembly using a multi-sensory approach . In IEEE International Conference on Robotics and Automation, San Francisco, CA, pp. 3687-3694 .

13.

Malis, E. , Morel, G. , and Chaumette, F. 2001. Robot control using disparate multiple sensors . International Journal of Robotics Research 20(5): 364-377 .

14.

Mendal, N. , and Payandeh, S. 1995. Control strategies for robotic contact tasks: An experimental study . Journal of Robotics Systems 12(1): 67-92 .

15.

Mason, M. 1981. Compliance and force control for computer controlled manipulators . IEEE Transactions on Systems, Man, and Cybernetics 11: 418-432 .

16.

Morel, G. , Malis, E. , and Boudet, S. 1998. Impedance based combination of visual and force control . In IEEE International Conference on Robotics and Automation, Leuven, Belgium, pp. 1743-1748 .

17.

Namiki, A. , Nakabo, Y. , Ishii, I. , and Ishikawa, M. 1999. High speed grasping using visual and force feedback . In IEEE International Conference on Robotics and Automation, Detroit, MI, pp. 3195-3200 .

18.

Nelson, B. J. , and Khosla, P. K. 1996. Force and vision resolvability for assimilating disparate sensory feedback . IEEE Transactions on Robotics and Automation 12(5): 714-731 .

19.

Nelson, B. J. , Morrow, J. , and Khosla, P. K. 1996. Robotic manipulation using high bandwidth force and vision feedback . Mathematical Computer Modelling 24(5/6): 11-29 .

20.

Pagilla, P. R. 2001. Control of contact problem in constrained Euler-Lagrangian systems . IEEE Transactions on Automatic Control 46: 1595-1599 .

21.

Pichler, A. , and Jägersand, M. 2000. Uncalibrated hybrid force-vision manipulation . In International Conference on Intelligent Robots and Systems, Takamatsu, Japan, pp. 1866-1871 .

22.

Raibert, M. , and Craig, J. J. 1981. Hybrid position/force control of manipulators . Transactions of the ASME: Journal of Dynamic Systems, Measurement and Control 102: 126-133 .

23.

Tsai, R. 1987. A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses . IEEE Journal of Robotics and Automation 3(4): 323-344 .

24.

Volpe, R. , and Khosla, P. 1993. A theoretical and experimental investigation of impact control for manipulators . International Journal of Robotics Research 12(4): 351-365 .

25.

Xiao, D. et al. 2000. Sensor-based hybrid position/force control of a robot manipulator in an uncalibrated environment . IEEE Transactions on Control Systems Technology 8(4): 635-645 .

26.

Zhu, W. H. , and De Schutter, J. 2002. Experimental verifications of virtual-decomposition-based motion/force control . IEEE Transactions on Robotics and Automation 18(3): 379-386 .

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB