A wearable vibrotactile system for distributed guidance in teleoperation and virtual environments

Abstract

A novel wearable vibrotactile system is proposed in this article to enhance the performance of teleoperation robot systems. Using a wearable vibrotactile glove, the proposed system guides the operator in the master–slave control through a vibrotactile-visual guidance method. Based on sensory substitution, the vibrotactile-visual combined guidance method combines vibration stimuli and visual feedback to substitute the virtual guidance force. A vibrotactile potential field is constructed in the workspace of the master-operator to calculate the frequency of the vibration stimulus. To provide vibration stimuli, a novel vibrotactile glove is designed and manufactured based on the layout of the sensitive region of human hand. As the human hand is unable to discriminate vibration stimuli of all frequencies, the vibration stimulus is discretization according to the result of the vibration discriminability experiment. At last, two contrast experiments in obstacle-free and obstacle-existing environments are conducted to verify the feasibility and effectiveness of the wearable vibrotactile system. The results show that this wearable vibrotactile system is an effective solution for guiding the operators in teleoperation and virtual environments.

Keywords

Vibrotactile guidance sensory substitution master–slave control artificial potential field teleoperation

Get full access to this article

View all access options for this article.

References

Kapoor

Taylor

. Constrained control for surgical assistant robots. In: Proceedings of 2006 IEEE international conference on robotics and automation, Orlando, FL, 15–19 May 2006. New York: IEEE.

Bolopion

Régnier

A review of haptic feedback teleoperation systems for micromanipulation and microassembly. IEEE T Autom Sci Eng 2013; 10(3): 496–502.

Kosari

Rydén

Lendvay

et al . Forbidden region virtual fixtures from streaming point clouds. Adv Robotics 2014; 28(22): 1507–1518.

Seung

Choi

Jang

et al . Virtual wall-based haptic-guided teleoperated surgical robotic system for single-port brain tumor removal surgery. Proc IMechE, Part H: J Engineering in Medicine 2017; 231(1): 3–19

Zhang

et al . Vision-based virtual force guidance for tele-robotic system. Comput Electr Eng 2013; 39(7): 2135–2144.

Park

Choi

Park

et al . Haptic virtual fixture for robotic cardiac catheter navigation. Artif Organs 2011; 35(11): 1127–1131.

Vitrani

M-A

Poquet

Morel

Applying virtual fixtures to the distal end of a minimally invasive surgery instrument. IEEE T Robot 2017; 33(1): 114–123.

Xiong

Chng

Chui

et al . Shared control of a medical robot with haptic guidance. Int J Comput Assist Radiol Surg 2017; 12(1): 137–147.

Van Oosterhout

Wildenbeest

Boessenkool

et al . Haptic shared control in tele-manipulation: effects of inaccuracies in guidance on task execution. IEEE Trans Haptics 2015; 8(2): 164–175.

10.

Bolopion

Dahmen

Stolle

et al . Vision-based haptic feedback for remote micromanipulation in SEM environment. Int J Optomechatroni 2012; 6(3): 236–252.

11.

Hong

Rozenblit

. A haptic guidance system for computer-assisted surgical training using virtual fixtures. In: Proceedings of 2016 IEEE international conference on systems, man, and cybernetics (SMC), Budapest, 9–12 October 2016. New York: IEEE.

12.

Xia

Léonard

Kandaswamy

et al . Model-based telerobotic control with virtual fixtures for satellite servicing tasks. In: Proceedings of 2013 IEEE international conference on robotics and automation, Karlsruhe, 6–10 May 2013. New York: IEEE.

13.

Van Oosterhout

Abbink

Koning

et al . Haptic shared control improves hot cell remote handling despite controller inaccuracies. Fusion Eng Des 2013; 88(9–10): 2119–2122.

14.

Ang

Q-Z

Horan

Abdi

et al . Multipoint haptic guidance for micrograsping systems. IEEE Syst J 2015; 9(4): 1388–1395.

15.

Massimino

MJ.

Improved force perception through sensory substitution. Control Eng Pract 1995; 3(2): 215–222.

16.

Prattichizzo

Pacchierotti

Rosati

Cutaneous force feedback as a sensory subtraction technique in haptics. IEEE Trans Haptics 2012; 5(4): 289–300.

17.

Schoonmaker

Cao

CGL

. Vibrotactile force feedback system for minimally invasive surgical procedures. In: Proceedings of 2006 IEEE international conference on systems, man and cybernetics, Taipei, Taiwan, 8–11 October 2006, pp.2464–2469. New York: IEEE.

18.

Pacchierotti

Prattichizzo

Kuchenbecker

KJ.

Cutaneous feedback of fingertip deformation and vibration for palpation in robotic surgery. IEEE Trans Biomed Engineering 2016; 63(2): 278–287.

19.

Pacchierotti

Meli

Chinello

et al . Cutaneous haptic feedback to ensure the stability of robotic teleoperation systems. Int J Robot Res 2015; 34(14): 1773–1787.

20.

Meli

Pacchierotti

Prattichizzo

Sensory subtraction in robot-assisted surgery: fingertip skin deformation feedback to ensure safety and improve transparency in bimanual haptic interaction. IEEE Trans Biomed Engineering 2014; 61(4): 1318–1327.

21.

Cui

YJ.

Dynamic motion planning for mobile robots using potential field method. Auton Robots 2002; 13(3): 207–222.

22.

Koren

Borenstein

. Potential field methods and their inherent limitations for mobile robot navigation. In: Proceedings of 1991 IEEE international conference on robotics and automation, Sacramento, CA, 9–11 April 1991, pp.1398–1404. New York: IEEE.

23.

Pacchierotti

Sinclai

Solazzi

et al . Wearable haptic systems for the fingertip and the hand: taxonomy, review, and perspectives. IEEE Trans Haptics 2017; 10(4): 580–600.