This paper introduces a port-Hamiltonian framework for the design of image-based visual servo control for dynamic mechanical systems. The approach taken introduces the concept of an image effort and provides an interpretation of energy exchange between the dynamics of the physical system and virtual potentials or ‘image Hamiltonians’ posed in the image space. The port-Hamiltonian framework leads to an elegant algorithm to estimate unknown image depth on-line even when the translational velocity of the camera is not measured.
BaldwinG (2009) Non-linear Deterministic Filters for Inertial Vision Pose Estimation. PhD Thesis, School of Engineering, College of Engineering and Computer Science, Australian National University.
2.
BerghuisHNijmeijerH (1993) Global regulation of robots using only position measurements. Systems and Control Letters21: 289–293.
3.
BishopBSpongM (1999) Adaptive calibration and control of 2d monocular visual servo systems. Control Engineering Practice7: 423–430.
4.
ChaumetteF (1998) Potential problems of stability and convergence in image based and position based visual servoing. In Conflux of Vision and Control (Lecture Notes in Control and Information Sciences, number 237). Berlin: Springer, pp. 66–78.
5.
ChaumetteFHutchinsonS (2006) Visual servo control. I. Basic approaches. IEEE Robotics and Automation Magazine13(4): 82–90.
6.
ChaumetteFHutchinsonS (2007) Visual servo control. II. Advanced approaches [tutorial]. IEEE Robotics and Automation Magazine14(1): 109–118.
7.
CowanNWeingartenJKoditschekD (2002) Visual servoing via navigation functions. IEEE Transactions on Robotics and Automation18: 521–533.
8.
De LucaAOrioloGGiordanoP (2008) Feature depth observation for image-based visual servoing: Theory and experiments. The International Journal of Robotics Research27: 1093–1116.
9.
DuindamVMacchelliAStramigioliSBryunickxH (eds) (2009) Modeling and Control of Complex Physical Systems. New York: Springer.
10.
EspiauBChaumetteFRivesP (1992) A new approach to visual servoing in robotics. IEEE Transactions on Robotics and Automation8: 313–326.
11.
FujitaMKawaiHSpongMW (2007) Passivity-based dynamic visual feedback control for three-dimensional target tracking: Stability and l2-gain performance analysis. IEEE Control Systems Technology15: 40–52.
12.
HamelTMahonyR (2002) Visual servoing of an under-actuated dynamic rigid-body system: An image based approach. IEEE Transactions on Robotics and Automation18: 187–198.
13.
HutchinsonSHagerGCorkeP (1996) A tutorial on visual servo control. IEEE Transactions on Robotics and Automation12: 651–670.
14.
KawaiHMuraoTFujitaM (2006) Image-based dynamic visual feedback control via passivity approach. In Proceedings IEEE Computer Aided Control System Design IEEE International Conference on Control Applications and IEEE International Symposium on Intelligent Control, pp. 740–745.
15.
KellyR (1996) Robust asymptotically stable visual servoing of planar robots. IEEE Transactions on Robotics and Automation12: 759–766.
16.
KellyRCarelliRNasisiOKuchenBReyesF (2000) Stable visual servoing of camera-in-hand robotic systems. IEEE/ASME Transactions on Mechatronics5: 39–48.
17.
KellyRMorenoJCampaR (2004) Visual servoing of planar robots via velocity fields. In 43rd IEEE Conference on Decision and Control, Atlantis, Paradise Island, Bahama, pp. 4028–4033.
18.
KhatibO (1993) The operational space framework. JSME International Journal Series C: Dynamics, Control, Robotics, Design and Manufacturing36: 277–287.
19.
LiuY-HWangHWangCLamP (2006) Uncalibrated visual servoing of robots using a depth-independent interaction matrix. IEEE Transactions on Robotics22: 804–817.
20.
LucasBDKanadeT (1981) An iterative image registration technique with an application to stereo vision. In Proceedings of the Imaging Understanding Workshop, pp. 121–130.
21.
MalisEChaumetteFBoudetS (1999) 2-1/2-d visual servoing. IEEE Transactions on Robotics and Automation15: 238–250.
22.
MaruyamaAFujitaM (1998) Robust control for planar manipulators with image feature parameter potential. Advanced Robotics12(14): 67–80.
23.
MaruyamaAKawaiHFujitaM (2001) Stability and tracking performance of dynamic visual feedback control for nonlinear mechanical systems. In Proceedings of the 40th IEEE Conference on Decision and Control, vol. 5, pp. 4415–4420.
24.
MaschkeBVan der SchaftABreedveldP (1992) An intrinsic Hamiltonian formulation of network dynamics: non-standard Poisson structures and gyrators. Journal of the Franklin Institute329: 923–966.
25.
MuraoTKawaiHFujitaM (2010) Visual motion observer-based stabilizing receding horizon control via image space navigation function. In IEEE International Conference on Control Applications, Yokohama, Japan.
26.
PapanikolopoulosNKhoslaPKKanadeT (1991) Adaptive robot visual tracking. In Proceedings of the American Control Conference, pp. 962–967.
27.
PiepmeierJA (1999) A Dynamic Quasi-Newton Method for Model Independent Visual Servoing. PhD Thesis, Georgia Institute of Technology, Atlanta, GA.
28.
Pissard-GibolletRRivesP (1995) Applying visual servoing techniques to control of a mobile hand-eye system. In Proceedings of the IEEE International Conference on Robotics and Automation, ICRA’95, Nagasaki, Japan, pp. 166–171.
29.
SamsonCLe BorgneMEspiauB (1991) Robot Control: The Task Function Approach (The Oxford Engineering Science Series). Oxford: Oxford University Press.
30.
SciaviccoLSicilianoB (2000) Modelling and Control of Robot Manipulators (Advanced Textbooks in Control and Signal Processing). London: Springer-Verlag.
31.
SrinivasanM (1994) An image-interpolation technique for the computation of optic flow and egomotion. Biological Cybernetics71: 401–415.
32.
WangHLiuY-HZhouD (2008) Adaptive visual servoing using point and line features with an uncalibrated eye-in-hand camera. IEEE Transactions on Robotics24: 843–857.
33.
ZergerogluEDawsonDde QueirozMBehalA (2001) Vision-based nonlinear tracking controllers with uncertain robot-camera parameters. IEEE/ASME Transactions on Mechatronics6: 322–337.
