Real-time Motion Stabilization with B-mode Ultrasound Using Image Speckle Information and Visual Servoing

Abstract

We develop visual servo control to stabilize the image of moving soft tissue in B-mode ultrasound (US) imaging. We define the target region in a B-mode US image, and automatically control a robot to manipulate a an US probe by minimizing the difference between the target and the most recently acquired US image. We exploit tissue speckle information to compute the relative pose between the probe and the target region. In-plane motion is handled by image region tracking and out-of-plane motion recovered by speckle tracking using speckle decorrelation. A visual servo control scheme is then applied to manipulate the US probe to stabilize the target region in the live US image. In a first experiment involving only translational motion, an US phan-In a first experiment involving only translational motion, an US phantom was moved by one robot while stabilizing the target with a second robot holding the US probe. In a second experiment, large six-degree-of-freedom (DOF) motions were manually applied to an US phantom while a six-DOF medical robot was controlled automatically to compensate for the probe displacement. The obtained results support the hypothesis that automated motion stabilization shows promise for a variety of US-guided medical procedures such as prostate cancer brachytherapy.

Keywords

medical robotics ultrasound speckle correlation visual servoing motion compensation

Get full access to this article

View all access options for this article.

References

Abolmaesumi, P. , Salcudean, S.E. , Zhu, W.H. , Sirouspour, M. and DiMaio, S. ( 2002). Image-guided control of a robot for medical ultrasound . IEEE Transactions on Robotics and Automation, 18(1): 11-23.

Bachta, W. and Krupa, A. ( 2006). Towards ultrasound image-based visual servoing . IEEE International Conference on Robotics and Automation (ICRA’2006) , Orlando, FL, pp. 4112-4117.

Baker, S. and Matthews, I. ( 2004). Lucas-kanade 20 years on: a unifying framework . International Journal of Computer Vision, 56(3): 221-255.

Benhimane, S. and Malis, E. (2004). Real-time image-based tracking of planes using efficient second-order minimization. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS’04), Sendai, Japan, pp. 943-948. Boctor, E., deOliveira, M., Choti, M., Ghanem, R., Taylor, R. H., Hager, G. D. and Fichtinger, G. (2006). Ultrasound monitoring of tissue ablation via deformation model and shape priors. 9th International Conference on Medical Image Computing and Computer-Assisted Intervention (MIC-CAI’2006), Copenhagen, Denmark, pp. 405-412.

Boctor, E. , Iordachita, I. , Fichtinger, G. and Hager, G.D. ( 2005). Real-time quality control of tracked ultrasound . 8th International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI’2005), Palm Springs, CA, pp. 621-630.

Bohs, L.N. , Geiman, B.J. , Anderson, M.E. , Gebhart, S.C. and Trahey, G.E. ( 2000). Speckle tracking for multidimensional flow estimation . Ultrasonics, 28(1): 369- 375.

Chang, R. F., Wu, W. J., Chen, D. R., Chen, W. M., Shu, W., Lee, J. H. and Jeng, L. B. (2003). 3-D US frame positioning using speckle decorrelation and image registration. Ultrasound in Medicine and Biology, 29(6): 801-812. Dementhon, D. and Davis, L. (1995). Model-based object pose in 25 lines of code. International Journal of Computer Vision, 15: 123-141.

Espiau, B. , Chaumette, F. and Rives, P. ( 1992). A new approach to visual servoing in robotics . IEEE Transactions on Robotics and Automation, 8(3): 313-326.

Fichtinger, G. , Fiene, J. , Kennedy, C. , Kronreif, G. , Iordachita, I. , Song, D. , Burdette, E. and Kazanzides, P. ( 2008). Robotic assistance for ultrasound-guided prostate brachytherapy . Medical Image Analysis, 12(5): 535-545.

10.

Gee, A. H., Housden, R. J., Hassenpflug, P., Treece, G. M. and Prager, R. W. (2006). Sensorless freehand 3d ultrasound in real tissues: speckle decorrelation without fully developed speckle. Medical Image Analysis, 10(2): 137-149. Ginhoux, R., Gangloff, J., de Mathelin, M., Soler, L., Sanchez, M. M. A. and Marescaux, J. (2005). Active filtering of physiological motion in robotized surgery using predictive control. IEEE Transactions on Robotics, 21(1): 67-79.

11.

Hager, G.D. and Belhumeur, P.N. ( 1998). Efficient region tracking with parametric models of geometry and illumination. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(10): 1025-1039.

12.

Hong, J. , Dohi, T. , Hashizume, M. , Konishi, K. and Hata, N. ( 2004). An ultrasound-driven needle insertion robot for percutaneous cholecystostomy. Physics in Medicine and Biology , 49(3): 441-455.

13.

Krupa, A. , Fichtinger, G. and Hager, G.D. ( 2007a). Full motion tracking in ultrasound using image speckle information and visual servoing. IEEE International Conference on Robotics and Automation (ICRA’2007), Rome, pp. 2458- 2464.

14.

Krupa, A. , Fichtinger, G. and Hager, G.D. ( 2007b). Real-time tissue tracking with B-mode ultrasound using speckle and visual servoing. 10th International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI’2007), Volume 2, Brisbane, Australia, pp. 1- 8.

15.

Laporte, C. and Arbel, T. ( 2007). Probabilistic speckle decorrelation for 3D ultrasound . 10th International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI’2007), Volume 1 , Brisbane, Australia, pp. 925-932.

16.

Malis, E. ( 2004). Improving vision-based control using efficient second-order minimization techniques. IEEE International Conference on Robotics and Automation (ICRA’2004), New Orleans, LA.

17.

Marchand, E. , Spindler, F. and Chaumette, F. ( 2005). ViSP for visual servoing: a generic software platform with a wide class of robot control skills. IEEE Robotics and Automation Magazine, 12(4): 40-52.

18.

Martinelli, T. , Bosson, J. , Bressollette, L. , Pelissier, F. , Boidard, E. , Troccaz, J. and Cinquin, P. ( 2007). Robot-based tele-echography; clinical evaluation of the TER system in abdominal aortic exploration. Journal of Ultrasound in Medicine, 26(11): 1611-1616.

19.

Pierrot, F. , Dombre, E. , Degoulange, E. , Urbain, L. , Caron, P. , Boudet, S. , Gariepy, J. and Megnien, J. ( 1999). Hippocrate: a safe robot arm for medical applications with force feedback. Medical Image Analysis (MedIA), 3(3): 285-300.

20.

Rivaz, H. , Boctor, E. and Fichtinger, G. ( 2006). Ultrasound speckle detection using low order moments . IEEE International Ultrasonics Symposium, Vancouver, Canada.

21.

Schroeder, W. , Martin, K. and Lorensen, B. ( 2003). The Visualization Toolkit: An Object-Oriented Approach to 3D Graphics, 3rd edition. Kitware.

22.

Smith, W.L. and Fenster, A. ( 2000). Optimum scan spacing for three-dimensional ultrasound by speckle statistics. Ultrasound in Medicine and Biology , 26(4): 551-562.

23.

Stoll, J. , Novotny, P. , Howe, R. and Dupont, P. ( 2006). Real-time 3D ultrasound-based servoing of a surgical instrument. IEEE International Conference on Robotics and Automation (ICRA’2006), Orlando, FL.

24.

Vitrani, M.A. , Morel, G. and Ortmaier, T. ( 2005). Automatic guidance of a surgical instrument with ultrasound based visual servoing. IEEE International Conference on Robotics and Automation (ICRA’2005), Barcelona , Spain, pp. 510- 515.

25.

Wallner, K. , Blasko, J. and Dattoli, M. ( 2001). Prostate Brachytherapy Made Complicated, 2nd edition. Smart-Medicine Press, Seattle, WA.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB