In this paper a control theoretical solution is presented for the direct adaptive visual dynamic control of planar manipulators using a fixed camera, when both camera calibration and robot dynamics are uncertain. The proposed scheme is developed for image-based look-and-move visual systems to allow tracking of a moving target. In order to solve the multivariable parameter adaptive problem, the recently proposed Immersion and Invariance (I&I) method is used. The scheme is then combined with an adaptive controller for the manipulator, taking into account its nonlinear dynamics. This leads to an overall stable adaptive visual servoing system. An extension of the I&I approach for 3D visual servoing is shown to be possible by a convenient control reparametrization associated with a proper image-based depth control scheme.
Astolfi, A. , Hsu, L. , Netto, M. , and Ortega, R.2002. Two solutions to the adaptive visual servoing problem , IEEE Transactions on Robotics and Automation18(3): 387-392 .
2.
Bishop, B. and Spong, M.1997. Adaptive calibration and control of 2d monocular visual servo systems , Syroco97.
3.
Corke, P. I. and Good, M. C.1996. Dynamic effects in visual closed-loop systems , IEEE Transactions on Robotics and Automation12(5): 671-683 .
4.
Espiau, B. , Chaumette, F. , and Rives, P.1992. A new approach to visual servoing in robotics , IEEE Transactions on Robotics and Automation8(3): 313-326 .
5.
Fang, Y. , Behal, A. , Dixon, W. E. , and Dawson, D. M. 2002. Adaptive 2.5d visual servoing of kinematically redundant robot manipulators , IEEE Conference on Decision and Control, Las Vegas, Nevada, pp. 2860-2865 .
6.
Flandin, G. , Chaumette, F. , and Marchand, E. 2000. Eye-inhand/eye-to-hand cooperation for visual servoing , IEEE International Conference on Robotics & Automation, San Francisco, CA, pp. 2741-2746 .
7.
Guenther, R. and Hsu, L. 1993. Variable structure adaptive cascade control of rigid-link electrically-driven robot manipulator , IEEE Conference on Decision and Control, San Antonio, CA, pp. 2137-2142 .
8.
Hsu, L. and Aquino, P. 1999. Adaptive visual tracking with uncertain manipulator dynamics and uncalibrated camera , IEEE Conference on Decision and Control, pp. 1248-1253 .
9.
Hsu, L. and Lizarralde, F. 2000. Robust adaptive visual tracking control: Analysis and experiments , Conference on Control and Applications, Anchorage, Alaska, pp. 823-829 .
10.
Hsu, L. , Zachi, A. R. L. , and Lizarralde, F. 2001. Adaptive visual tracking for motions on smooth surfaces , IEEE Conference on Decision and Control, Orlando, FL, pp. 1866-1871 .
11.
Hutchinson, S. , Hager, G. , and Corke, P.1996. A tutorial on visual servo control , IEEE Transactions on Robotics and Automation12(5): 651-670 .
12.
Ioannou, P. and Sun, K.1996. Robust Adaptive Control, Prentice Hall .
13.
Kelly, R.1996. Robust asymptotically stable visual servoing of planar robots , IEEE Transactions on Robotics and Automation12(5): 759-766 .
14.
Kelly, R. , Reyes, F. , Moreno, J. , and Hutchinson, S. 1999. Two loops direct visual control of direct-drive planar robots with moving target , IEEE International Conference on Robotics & Automation, pp. 599-604 .
15.
Koivo, A. and Houshangi, N.1991. Real-time vision feedback for servoing of a robotic manipulator with self-tuning controller , IEEE Transactions on Systems, Man and Cybernetics21: 134-142 .
16.
Nasisi, O. and Carelli, R.2003. Adaptive servo visual robot control , Robotics and Autonomous Systems43: 51-78 .
17.
Ortega, R. , Hsu, L. , and Astolfi, A.2003. Immersion and invariance adaptive control of linear multivariable systems , Systems and Control Letters49: 37-47 .
18.
Papanikolopoulos, N. and Khosla, P.1993. Adaptive robotic visual tracking: Theory and experiments , IEEE Transactions on Automatic Control38(3): 429-445 .
19.
Sciavicco, L. and Siciliano, B.2000. Modelling and Control of Robot Manipulators, Springer-Verlag .
20.
Slotine, J. J. and Li, W.1991. Applied Nonlinear Control, Prentice Hall .
21.
Xiao, D. , Ghosh, B. K. D. , Xi, N. , and Tarn, T. J.2000. Sensor-based hybrid position/force control of a robot manipulator in an uncalibrated environment , IEEE Transactions on Control Systems Technology8(4): 634-645 .
22.
Zachi, A. R. L. , Hsu, L. , and Lizarralde, F. 2004a. Performing stable 2D adaptive visual positioning/tracking control without explicit depth measurement , IEEE International Conference on Robotics & Automation, New Orleans.
23.
Zachi, A. R. L. , Hsu, L. , Lizarralde, F. , and Leite, A. C. 2004b. Adaptive control of nonlinear visual servoing systems for depth positioning and planar tracking , Proceedings of the 14th Brazilian Conference on Automatic Control, Gramado, RS, pp. 1510-1515 .
24.
Zachi, A. R. L. , Hsu, L. , Ortega, R. , and Lizarralde, F. 2004c. Cascade control of uncertain manipulator systems through immersion and invariance adaptive visual servoing , IEEE International Conference on Robotics & Automation, New Orleans, pp. 2860-2865 .
25.
Zachi, A. R. L. , Hsu, L. , Ortega, R. , and Lizarralde, F. 2004d. Immersion and invariance adaptive visual servoing of manipulators with uncertain dynamics , American Control Conference, Boston, MA, pp. 1510-1515 .
26.
Zergeroglu, E. , Dawson, D. , de Queiroz, M. , and Nagarkatti, S. 1999. Robust visual-servo control of robot manipulators in the presence of uncertainty , IEEE Conference on Decision and Control, pp. 4137-4142 .
