A great many tasks in automated manufacturing and assem bly involve robot operations guided by vision systems. In such situations, linking of machine vision systems and robot manipu lators has relied on accurate camera-to-real world calibration processes and on highly accurate robot arms with well-known kinematics. This article describes a real-time vision-control strategy for "hand-to-eye coordination " that gives good per formance even in the presence of significant vision system miscalibrations and kinematic model parametric errors.
Get full access to this article
View all access options for this article.
References
1.
Anderson, J.N.1988. Specifications. In Dorf, R. C. (ed.): International Encyclopedia of Robotics. New York: Wiley-Interscience, pp. 1641-1657.
2.
Baird, H.S., and Lurie, M.1983. Precise assembly using vision in the hand. Proceedings of the Third International Conference on Robot Vision and Sensory Controls, pp. 533-539.
3.
Carlisle, B., Roth, S., Gleason, J., and McGhie, D.1981. The Puma/VS-100 robot vision system. Proceedings of the First International Conference on Robot Vision and Sensory Controls, pp. 149-160.
4.
Coulon, P.Y., and Cellard, D.1986. A dual-video tracking system. Proceedings of the Sixth International Conference on Robot Vtsion and Sensory Controls, pp. 179-186.
5.
Coulon, P.Y., and Nougaret, M.Use of a TV camera in closed-loop position control of mechanisms. In A. Pugh, (ed.): Robot Vision . Bedford, United Kingdom: IFS, pp. 117-127.
6.
Dickinson, M., and Morris, A.S.1988. Co-ordinate determination and performance analysis for robot manipulators and guided vehicles, Proceedings IEEE135(2):95-98.
7.
Feddema, J.T., and Mitchell, O.R.1989. Vision-guided servoing with feature-based trajectory generation . IEEE Trans. Robot. Automation5(5):691-700.
8.
Gerke, W., and Bolle, H.1987. Integration of vision and tactile sensors in a robot control system. Proceedings of the IFAC 10th Triennial World Congress, Munich, Germany, pp. 351-362.
9.
Gottwald, R.1988. KERN SPACE: An automated noncontact 3D measuring system for industrial applications. Proceedings of the Eighth International Conference on Robot Vision and Sensory Control, pp. 3-12.
10.
Hill, J., and Park, W.T.1979. Real-time control of a robot with a mobile camera. Proceedings of the 9th International Symposium on Industrial Robotics , Washington, DC, pp. 233-246.
11.
Hollerbach, J.M.1989. Kinematics and dynamics for control. In M. Brady, (ed.): Robotics Science. Cambridge, MA: MIT Press, pp. 379-431.
12.
Ishii, M., Sakane, S., and Kakikura, M.1984. A new 3D sensor for teaching robot paths and environments . Proceedings of the Fourth International Conference on Robot Vision and Sensory Controls, pp. 155-164.
13.
Khatib, O.1985. The operational space formulation in robot manipulator control. Fifteenth International Symposium on Industrial Robots.
14.
King, F.G., Puskorius, G.V., Yuan, F., Meier, R.C., Jeyabalan, V., and Feldkamp, L.A.1988. Vision-guided robots for automated assembly. Proceedings of the IEEE International Conference on Robotics andAutomation3:1611-1616.
15.
Luh, J.Y., Walker, M.W., and Paul, R.P.C.1980. Resolved acceleration control of mechanical manipulators . IEEE Trans. Auto. Control25(3):468-474.
16.
Mayer, R., and Parker, G.A.1986. Optical considerations in a 3D laser tracking instrument . Proceedings of the Sixth International Conference on Robot Vision and Sensory Controls, pp. 217-288.
17.
Rattan, K.S., Scarpelli, A.J., and Johnson, R.E.1989. A computer vision and robotic system for an intelligent workstation. Computers in Industry13:261-269.
18.
Saraga, P., and Jones, B.M.1983. Simple assembly under visual control. In A. Pugh, (ed.): Robot Vision. Bedford, United Kingdom: IFS, pp. 209-223.
19.
Shi, J., Monchaud, S., Prat, R., and Domey, J.1988. 3D object localisation and automatic tracking. Proceedings of the Eighth International Conference on Robot Vision and Sensory Control, pp. 197-207.
20.
Shuttleworth, P.1989. Visual feedback for manipulator arm control. Ph.D. thesis.Nottingham, United Kingdom: Trent Polytechnic.
21.
Taylor, P.M., Selke, K.K.W., and Taylor, G.E.1982. Closed-loop control of an industrial robot using visual feedback from a sensory gripper. Proceedings of the Twelfth International Symposium on Industrial Robots, pp. 79-86.
22.
Tsai, R.Y.1987. A versatile camera calibration technique for high accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses. IEEE J. Robot. Automation RA-3(4):323-344.
23.
VanderBrug, G.J., Albus, J.S., and Barkmeyer, E.1979. A vision system for real-time control of robots. Proceedings of the 9th International Symposium on Industrial Robots , Washington, DC, pp. 213-231.
24.
Ward, M.R., Rossol, L., Holland, S.W., and Dewar, R.1979. CONSIGHT: A practical vision-based robot guidance system . Proceedings of the 9th International Symposium on Industrial Robotics, Washington, DC, pp. 195-211.
25.
Weiss, L.E.1984. Dynamic visual servo control of robots: An adaptive, image-based approach. Ph.D. thesis. Carnegie Mellon University.
26.
Wijesoma, S.W.1990. Robot control using joint and end-effector sensing. Ph.D. thesis. Cambridge University.
27.
Wijesoma, S.W., and Richards, R.J.1990. Robust trajectory following of robots using computed torque structure with VSS. Int. J. Control52(4):935-962.
28.
Wilson, M.1987. Robot position sensing and performance testing. Measurement Control20:69-73.
29.
Wolfe, D.F.H.1991. Direct vision feedback for robot control: The potential, the problems, and a practical approach. Ph.D. thesis. Cambridge University.
