Sage Journals: Discover world-class research

Abstract

This paper presents a computer vision-based method for visually detecting the contact between an end-effector and a target surface under an optical microscope during microrobotic manipulation. Without using proximity or force/touch sensors, this method provides a submicrometer detection accuracy and possesses robustness. Fundamentally, after the establishment of contact in the world frame, further vertical motion of the end-effector (flexible or stiff) induces horizontal motion in the image plane. Contact between a micropipette tip and a glass slide in the scenario of microrobotic cell manipulation is used as an example to elaborate on the detection method. Experimental results demonstrate that the computer vision-based method is capable of achieving contact detection between the micropipette and the glass slide surface with an accuracy of 0.2 μm. Furthermore, 1000 experimental trials reveal that the presented method is robust to variations in illumination intensity, microscopy magnification, and microrobot motion speed.

Keywords

microrobotic manipulation contact detection computer vision microscopy

Get full access to this article

View all access options for this article.

References

Arai, F. , Motoo, K. , Kwon, P.G.R. , Fukuda, T. , Ichikawa, A. , and Katsuragi, T. (2003). Novel touch sensor with piezoelectric thin film for microbial separation, Proceedings of IEEE International Conference on Robotics and Automation, Taipei, September, pp. 306—311.

Castleman, K.R. (1996). Digital Image Processing. Prentice Hall, Englewod Cliffs, NJ, pp. 479—480.

Fukuda, T. , Sato, H. , Arai, F. , Iwata, H. , and Itoigawa, K. (1998). Parallel beam micro sensor/actuator unit using PZT thin films and application examples. Proceedings of IEEE International Conference on Robotics and Automation, Leuven, Belgium, May, pp. 1498—1503.

Geusebroek, J.M. , Cornelissen, F. , Smeulden, A.W.M. , and Gee, H. (2000). Robust autofocusing in microscopy, Cytometry, 36(1): 1—9.

Haitjema, H. , Pril, W. , and Schellekens, P.H.J. (2001). A silicon-etched probe for 3-D coordinate measurements with an uncertainty below 0.1 īm. IEEE Transactions on Instrumentation and Measurement, 50(6): 1519—1523.

Hatzivasiliou, F.V. and Tzafestas, S.G. (1994). Analysis and design of a new piezoresistive tactile sensor system for robotic applications. Journal of Intelligent and Robotic Systems, 10(3): 243—256.

Huber, P.J. (1981). Robust Statistics. Wiley, New York.

Junno, T. , Deppert, K. , Montelius, L. , and Samuelson, L. (1995). Controlled manipulation of nanoparticles with an atomic force microscopy. Applied Physics Letters, 66(26): 3627—3629.

Kanda, T. , Morita, T. , Kurosawa, M.K. , and Higuchi, T. (1999). A rod-shaped vibro touch sensor using PZT thin film IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control, 46(4): 875—882.

10.

Kim, T.H. , Moon, Y.S. , and Han, C.S. (1999). An efficient method of estimating edge locations with subpixel accuracy in noisy images, IEEE Region 10 Conference, TENCON, Cheju, Korea, September, pp. 589—592.

11.

Lee, H. , Purdon, A.M. , and Westervelt, R.M. (2004). Micromanipulation of biological systems with microelectromagnets. IEEE Transactions on Magnetism , 40(4): 2991— 2993.

12.

Li, Y.F. (1996). A sensor-based robot transition control strategy . International Journal of Robotics Research, 15(2): 128—136.

13.

Ramachandran, T.R. , Baur, C. , Bugacov, A. , Koel, B.E. , Requicha, A. , and Gazen, C. (1998). Direct and controlled manipulation of nanometer-sized particles using the noncontact atomic force microscope. Nanotechnology , 9(3): 237—245.

14.

Shen, Y.T. , Xi, N. , Lai, K.W.C. , and Li, W.J. (2004). A novel PVDF microforce/force rate sensor for practical applications in micromanipulation. Sensor Review , 24(3): 274— 283.

15.

Sitti, M. and Hashimoto, H. (2000). Two-dimensional fine particle positioning under optical microscope using a piezoresistive cantilever as a manipulator. Journal of Micromechatronics, 1(1): 25—48.

16.

Subbarao, M. and Tyan, J.K. (1998). Selecting the optimal focus measure for autofausing and depth-from-focus. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(8): 864—870.

17.

Sun, Y. and Nelson, B.J. (2002). Biological cell injection using an autonomous microrobotic system, International Journal of Robotics Research , 21(10—11): 861—868.

18.

Sun, Y. , Duthaler, S. , and Nelson, B.J. (2004). Autofocusing in computer microscopy: selecting the optimal focus algorithm. Microscopy Research and Technique , 65(3): 139— 149.

19.

Trummer, G. , Kurzals, C. , Gehring, R. , and Leistner, D. (2004). Next-generation proximity and position sensors . Sensors, 21(3): 14—21.

20.

Vikramaditya, B. and Nelson, B.J. (1999). Visually servoed micropositioning for robotic micromanipulation. Microcomputer Applications, 18(1): 23—31.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

Contact Detection in Microrobotic Manipulation

Abstract

Keywords

Get full access to this article

References

Supplementary Material