Sage Journals: Discover world-class research

Abstract

The tracking of surgical instruments o fers interesting possibilities for the development of high-level commands for robotic camera holders in laparoscopic surgery. We have developed a new method to detect instruments in laparoscopic images which uses information on the 3D position of the insertion point of an instrument into the abdominal cavity. This information strongly constrains the search for the instrument in each endoscopic image. Hence, the instrument can be detected in near real-time using shape considerations. Early results on laparoscopic images show that the method is rapid and robust in the presence of partial occlusion and smoke. Our first experiment on a cadaver validates our approach and shows encouraging results.

Keywords

medical robots and systems visual tracking

Get full access to this article

View all access options for this article.

References

Ballester, P. et al. (2001). Comparison of task performance of robotic camera holders EndoAssist and Aesop. Proceedings of the 15th International Congress and Exhipition on Computer Assisted Radiology and Surgery (CARS'01), 27—30 June, pp. 1100—1103.

Berkelman, P.J. et al. (2002). Development of a compact cable-driven laparoscopic endoscope manipulator. Proceedings of the 5th International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI'02), part I. London, Springer, pp. 17—24.

Burschka, D. et al. (2005). Navigating inner space: 3-D assistance for minimally invasive surgery. Robotics and Autonomous Systems 52(1): 5—26.

Casals, A. , Amat, J. and Laporte, E. (1996). Automatic guidance of an assistant robot in laparoscopic surgery. Proceedings 1996 IEEE International Conference on Robotics and Automation, vol. 1, April, pp. 895—900.

Climent, J. and Mares, P. (2004). Automatic instrument localization in laparoscopic surgery. Electronic Letters on Computer Vision and Image Analysis 4(1): 21—31.

Doignon, C. , Nageotte, F. and de Mathelin, M. (2004). Detection of grey regions in color images: application to the segmentation of a surgical instrument in robotized laparoscopy. Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, September.

Doignon, C. , Nageotte, F. and de Mathelin, M. (2006). Segmentation and guidance of multiple rigid objects for intraoperative endoscopic vision. Proceedings of the 2nd International Workshops on Dynamical Vision (WDV06), pp. 314—327.

Duda, R.O. and Hart, P.E. (1972). Use of the Hough transformation to detect lines and curves in pictures. Communications of the ACM 15(1): 11—15.

Faugeras, O. (1993). Three-dimensional Computer Vision: A Geometric Viewpoint. Cambridge, MA, MIT Press .

10.

Finlay, P.A. (1996). Clinical experience with a goniometric head-controlled laparoscope manipulator. Proceedings of the First IARP Symposium on Medical Robotics, October.

11.

Gröger, M. et al. (2001). Reconstruction of image structure in presence of specular reflections. Proceedings of the 23rd DAGM Symposium on Pattern Recognition. London, Springer, pp. 53—60.

12.

Kavoussi, L.R. et al. (1995). Comparison of robotic versus human laparoscopic camera control. Journal of Urology 154(6): 2134—2136.

13.

Krupa, A. et al. (2003). Autonomous 3-D positioning of surgical instruments in robotized laparoscopic surgery using visual servoing. IEEE Transactions on Robotics and Automation 19(5): 842—853.

14.

Makhoul, B. et al. (2004). Laparoscopic radical nephrectomy for T1 renal cancer: the gold standard? A comparison of laparoscopic vs open nephrectomy . BJU International 93(1): 67—70.

15.

Malis, E. , Chaumette, F. and Boudet, S. (1999). 2 1/2 D visual servoing. IEEE Transactions on Robotics and Automation 15(2): 238—250.

16.

Munoz, V.F. et al. (2006). Control movement scheme based on manipulability concept for a surgical robotic assistant. Proceedings of the 2000 IEEE International Conference on Robotics and Automation (ICRA'06) , Orlando, FL, 15—19 May. Piscataway, NJ, IEEE Press.

17.

Nishikawa, A. et al. (2001). Real-time visual tracking of the surgeon's face for laparoscopic surgery. Proceedings of the 4th International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI'01), 14—17 October.

18.

Otsu, N. (1979). A threshold selection method from grey-level histograms . IEEE Transactions Systems, Man and Cybernetics 9(1): 62—66.

19.

Tonet, O. et al. (2005). Image analysis-based approach for localization of endoscopic tools. Proceedings of the 2nd International Conference on Computer-Aided Medical Interventions: Tools and Applications (Surgetica'05), Chambery, France, pp. 60—65..

20.

Wang, Y.F. , Uecker, D.R. and Wang, Y. (1998). A new framework for vision-enabled and robotically assisted minimally invasive surgery. Computerized Medical Imaging and Graphics 22(6): 429—437.

21.

Wei, G.Q. , Arbter, K. and Hirzinger, G. (1997). Real-time visual servoing for laparoscopic surgery. Controlling robot motion with color image segmentation. IEEE Engineering in Medicine and Biology Magazine 16(1): 40—45.

22.

Zhang, Z. (2000). A flexible new technique for camera calibration . IEEE Transactions on Pattern Analysis and Machine Intelligence , 22(11): 1330—1334.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB