In this paper, the classical task of mobile target tracking using a pan-and-tilt camera is considered. The authors use recent results in motion-based visual servoing to deal with complex targets for which shape and texture are unknown. The first method consists of designing a control law directly from the estimated image motion. This leads to the computation of the pan-and-tilt acceleration necessary to reduce the tracking error. A second method, more efficient for target tracking, consists of retrieving the target position in the image from its estimated motion. This leads to classical image-based visual servoing. For both methods, experimental results obtained at video rate are presented and discussed.
Get full access to this article
View all access options for this article.
References
1.
Allen, P. K., Timcenko, A., Yoshimi, B., and Michelman, P. 1993. Automated tracking and grasping of a moving object with a robotic hand-eye system . IEEE Transactions on Robotics and Automation9(2): 152–165 .
2.
Bajcsy, R. 1988. Active perception. Research Report MS CIS-88-24, University of Pennsylvania, Philadelphia .
3.
Bartholomeus, M.G.P., Kröse, B.J.A., and Noest, A. J. 1993. A robust multi-resolution vision system for target tracking with a moving camera. In Computer Science in the Netherlands, ed. H. Wijshof, 52–63. Amsterdam: CWI .
4.
Bensalah, F., and Chaumette, F. 1995. Compensation of abrupt motion changes in target tracking by visual servoing . IEEE International Conference on Intelligent Robots and Systems, vol. 1, Pittsburgh, August, pp. 181–187 .
5.
Blackman, S. 1986. Multiple Target Tracking with Radar Application. Boston: Artech House .
6.
Brown, C. 1990. Gaze control cooperating through prediction . Image and Vision Computing8(1): 10–17 .
7.
Brown, C., Durrant-Whyte, H., Leonard, J., and Rao, B. 1989. Centralized and decentralized Kalman filter techniques for tracking, navigation, and control. Image Understanding Workshop, San Mateo, CA , May, pp. 651–675.
8.
Chaumette, F., and Santos, A. 1993. Tracking a moving object by visual servoing . 12th World Congress IFAC, vol. 9, Sydney, Australia, July, pp. 409–414 .
9.
Clark, J. J., and Ferrier, N. J. 1989. Control of visual attention in mobile robots . IEEE International Conference on Robotics and Automation, Scottsdale, AZ, May, pp. 826–831 .
10.
Corke, P. I., and Good, M. C. 1993. Controller design for high performance visual servoing . 12th World Congress IFAC, vol. 9, Sydney, Australia, July, pp. 395–398 .
11.
Crétual, A. 1998. Asservissement visuel à partir d’informations de mouvement dans l’image. Ph.D. thesis, Rennes 1 University.
12.
Crétual, A., and Chaumette, F. 2000. Dynamic stabilization of a pan and tilt camera for sub-marine image visualization . Computer Vision and Image Understanding79(1): 47–65 .
13.
Crétual, A., and Chaumette, F. 2001. Visual servoing based on image motion . International Journal of Robotics Research20(11): 857–877 .
14.
Crétual, A., Chaumette, F., and Bouthemy, P. 1998. Complex object tracking by visual servoing on 2D image motion . IAPR International Conference on Pattern Recognition, vol. 2, Brisbane, Australia, August, pp. 1251–1254 .
15.
Dzialo, K. A., and Schalkoff, R. J. 1986. Control implications in tracking moving objects using time-varying perspective-projective imagery . IEEE Transactions on Industrial Electronics33(3): 247–253 .
16.
Espiau, B., Chaumette, F., and Rives, P. 1992. A new approach to visual servoing in robotics . IEEE Transactions on Robotics and Automation8(3): 313–326 .
17.
Gilbert, A. L., Giles, K. G., Flachs, G. M., and Rogers, R. B. 1980. A real-time video tracking system . IEEE Transactionson Pattern Analysisand Machine Intelligence2(1): 47–56 .
18.
Hashimoto, K., Ebine, T., Sakamoto, K., and Kimura, H. 1993. Full 3D visual tracking with nonlinear model-based control . American Control Conference, San Francisco, June, pp. 3180–3185 .
19.
Hunt, A. H., and Sanderson, A. C. 1982. Vision-based predictive robotic tracking of a moving target. Pittsburgh, PA: Department of Electrical Engineering & The Robotics Institute, CMU . Technical Report CMU-RI-TR-82-15.
20.
Hutchinson, S., Hager, G., and Corke, P. I. 1996. A tutorial on visual servo control . IEEE Transactions on Robotics and Automation12(5): 651–670 .
21.
Milios, E., Jenkin, M., and Tsotsos, J. 1993. Design and performance of TRISH, a binocular robot head with torsional eye movements . International Journal of Pattern Recognition and Artificial Intelligence7(1): 51–68 .
22.
Murray, D., and Basu, A. 1994. Motion tracking with an active camera . IEEE Transactions on Pattern Analysis and Machine Intelligence16(5): 449–459 .
23.
Murray, D. W., Bradshaw, K. J., McLauchlan, P. F., Reid, I. D., and Sharkey, P. M. 1995. Driving saccade to pursuit using image motion . International Journal of Computer Vision16(3): 205–228 .
24.
Nordlund, P., and Uhlin, T. 1996. Closing the loop: Detection and pursuit of a moving object by a moving observer . Image and Vision Computing14(4): 265–275 .
25.
Odobez, J. M., and Bouthemy, P. 1995. Robust multiresolution estimation of parametric motion models . Journal of Visual Communication and Image Representation6(4): 348–365 .
26.
Papanikolopoulos, N. P., Nelson, B., and Khosla, P. K. 1995. Six degree-of-freedom hand/eye visual tracking with uncertain parameters . IEEE Transactions on Robotics and Automation11(5): 725–732 .
27.
Reid, I. D., and Murray, D. W. 1996. Active tracking of foveated feature clusters using affine structure . International Journal of Computer Vision18(1): 41–60 .
28.
Subarrao, M., and Waxman, A. 1986. Closed-form solutions to image equations for planar surface in motion . Computer Vision, Graphics, and Image Processings36(2): 208–228 .
29.
Yamane, T., Shirai, Y., and Miura, J. 1998. Person tracking by integrating optical flow and uniform brightness regions . IEEE International Conference on Robotics and Automation, Leuven, Belgium, May, pp. 3267–3272 .
