A human can intuitively perceive and comprehend complicated tactile information because the cutaneous receptors distributed in the fingertip skin receive different tactile stimuli simultaneously and the tactile signals are immediately transmitted to the brain. Although many research groups have attempted to mimic the structure and function of human skin, it remains a challenge to implement human-like tactile perception process inside one system. In this study, we developed a real-time and multimodal tactile system that mimics the function of cutaneous receptors and the transduction of tactile stimuli from receptors to the brain, by using multiple sensors, a signal processing and transmission circuit module, and a signal analysis module. The proposed system is capable of simultaneously acquiring four types of decoupled tactile information with a compact system, thereby enabling differentiation between various tactile stimuli, texture characteristics, and consecutive complex motions. This skin-like three-dimensional integrated design provides further opportunities in multimodal tactile sensing systems.
Get full access to this article
View all access options for this article.
References
1.
LiuX.The more and less of electronic-skin sensors. Science, 2020; 370(6519):910–911; doi: 10.1126/science.abf1914
DrimusA, KootstraG, BilbergA, et al.Design of a flexible tactile sensor for classification of rigid and deformable objects. Rob Auton Syst, 2014; 62(1):3–15; doi: 10.1016/j.robot.2012.07.021
4.
WuY, LiuY, ZhouY, et al.A skin-inspired tactile sensor for smart prosthetics. Sci Robot, 2018; 3(22):1–8; doi: 10.1126/scirobotics.aat0429
5.
ZhaoH, O'BrienK, LiS, et al.Optoelectronically innervated soft prosthetic hand via stretchable optical waveguides. Sci Robot, 2016; 1(1):1–10; doi: 10.1126/scirobotics.aai7529
6.
YamadaD, MaenoT, YamadaY. Artificial finger skin having ridges and distributed tactile sensors used for grasp force control. IEEE Int Conf Intell Robot Syst, 2001; 2(2):686–691; doi: 10.1109/IROS.2001.976249
7.
D'AnnaE, ValleG, MazzoniA, et al.A closed-loop hand prosthesis with simultaneous intraneural tactile and position feedback. Sci Robot, 2019; 4(27)1–13; doi: 10.1126/scirobotics.aau8892
8.
LiG, LiuS, WangL, et al.Skin-inspired quadruple tactile sensors integrated on a robot hand enable object recognition. Sci Robot, 2020; 5(49):1–12; doi: 10.1126/scirobotics.abc8134
9.
SuZ, HausmanK, ChebotarY, et al.Force Estimation and Slip Detection/Classification for Grip Control Using a Biomimetic Tactile Sensor. In: IEEE-RAS International Conference on Humanoid Robots: Seoul, South Korea;, 2015; pp. 297–303; doi: 10.1109/HUMANOIDS.2015.7363558
10.
SankarS, BalamuruganD, BrownA, et al.Texture discrimination with a soft biomimetic finger using a flexible neuromorphic tactile sensor array that provides sensory feedback. Soft Robot, 2021; 8(5):577–587; doi: 10.1089/soro.2020.0016
11.
KimK, SimM, LimSH, et al.Tactile avatar: Tactile sensing system mimicking human tactile cognition. Adv Sci, 2021; 8(7):1–12; doi: 10.1002/advs.202002362
12.
PyoS, LeeJ, BaeK, et al.Recent progress in flexible tactile sensors for human-interactive systems: From sensors to advanced applications. Adv Mater, 2021; 33(47):1–26; doi: 10.1002/adma.202005902
13.
HughesJ, IidaF. Tactile sensing applied to the universal gripper using conductive thermoplastic elastomer. Soft Robot, 2018; 5(5):512–526; doi: 10.1089/soro.2017.0089
14.
LuN, KimDH. Flexible and stretchable electronics paving the way for soft robotics. Soft Robot, 2014; 1(1):53–62; doi: 10.1089/soro.2013.0005
15.
HuangYC, LiuY, MaC, et al.Sensitive pressure sensors based on conductive microstructured air-gap gates and two-dimensional semiconductor transistors. Nat Electron, 2020; 3(1):59–69; doi: 10.1038/s41928-019-0356-5
16.
LeeBY, KimJ, KimH, et al.Low-cost flexible pressure sensor based on dielectric elastomer film with micro-pores. Sens Actuators A Phys, 2016; 240:103–109; doi: 10.1016/j.sna.2016.01.037
17.
ZangY, ZhangF, DiCA, et al.Advances of flexible pressure sensors toward artificial intelligence and health care applications. Mater Horizons, 2015; 2(2):140–156; doi: 10.1039/c4mh00147h
18.
DagdevirenC, SuY, JoeP, et al.Conformable amplified lead zirconate titanate sensors with enhanced piezoelectric response for cutaneous pressure monitoring. Nat Commun, 2014; 5(4496):1–10; doi: 10.1038/ncomms5496
19.
KimH, KimG, KimT, et al.Transparent, flexible, conformal capacitive pressure sensors with nanoparticles. Small, 2018; 14(8):1–10; doi: 10.1002/smll.201703432
20.
SchwartzG, TeeBC, MeiJ, et al.Flexible Polymer transistors with high pressure sensitivity for application in electronic skin and health monitoring. Nat Commun, 2013; 4(1859):1–8; doi: 10.1038/ncomms2832
21.
MannsfeldSCB, TeeBCK, StoltenbergRM, et al.Highly sensitive flexible pressure sensors with microstructured rubber dielectric layers. Nat Mater, 2010; 9(10):859–864; doi: 10.1038/NMAT2834
22.
AhmedA, GuanYS, HassanI, et al.Multifunctional smart electronic skin fabricated from two-dimensional like polymer film. Nano Energy, 2020; 75:105044; doi: 10.1016/j.nanoen.2020.105044
23.
XuZ, WuC, ZhuY, et al.Bio-inspired smart electronic-skin based on inorganic perovskite nanoplates for application in photomemories and mechanoreceptors. Nanoscale, 2021; 13(1):253–260; doi: 10.1039/d0nr06550a
24.
HuaQ, SunJ, LiuH, et al.Skin-inspired highly stretchable and conformable matrix networks for multifunctional sensing. Nat Commun, 2018; 9(1):1–11; doi: 10.1038/s41467-017-02685-9
25.
ChoiD, JangS, KimJS, et al.A highly sensitive tactile sensor using a pyramid-plug structure for detecting pressure, shear force, and torsion. Adv Mater Technol, 2019; 4(3):1–10; doi: 10.1002/admt.201800284
26.
PangC, LeeGY, KimT, et al.A flexible and highly sensitive strain-gauge sensor using reversible interlocking of nanofibres. Nat Mater, 2012; 11(9):795–801; doi: 10.1038/NMAT3380
27.
ParkJ, LeeY, HongJ, et al.Tactile-direction-sensitive and stretchable electronic skins based on human-skin-inspired interlocked microstructures. ACS Nano, 2014; 8(12):12020–12029; doi: 10.1021/nn505953t
28.
SunQJ, ZhaoXH, ZhouY, et al.Fingertip-skin-inspired highly sensitive and multifunctional sensor with hierarchically structured conductive graphite/polydimethylsiloxane foams. Adv Funct Mater, 2019; 29(18):1–11; doi: 10.1002/adfm.201808829
29.
ChunS, SonW, KimH, et al.Self-powered pressure- and vibration-sensitive tactile sensors for learning technique-based neural finger skin. Nano Lett, 2019; 19(5):3305–3312; doi: 10.1021/acs.nanolett.9b00922
ParkJ, KimM, LeeY, et al.Fingertip skin-inspired microstructured ferroelectric skins discriminate static/dynamic pressure and temperature stimuli. Sci Adv, 2015; 1(9):e1500661; doi: 10.1126/sciadv.1500661
34.
YouI, MacKanicDG, MatsuhisaN, et al.Artificial multimodal receptors based on ion relaxation dynamics. Science, 2020; 370(6519):961–965; doi: 10.1126/science.aba5132
35.
BoutryCM, NegreM, JordaM, et al.A hierarchically patterned, bioinspired e-skin able to detect the direction of applied pressure for robotics. Sci Robot, 2018; 3(24):1–10; doi: 10.1126/scirobotics.aau6914
36.
KimT, LeeS, HongT, et al.Heterogeneous sensing in a multifunctional soft sensor for human-robot interfaces. Sci Robot, 2020; 5(49):1–14; doi: 10.1126/scirobotics.abc6878
37.
ChenH, SongY, GuoH, et al.Hybrid porous micro structured finger skin inspired self-powered electronic skin system for pressure sensing and sliding detection. Nano Energy, 2018; 51:496–503; doi: 10.1016/j.nanoen.2018.07.001
38.
Seok JoH, AnS, KwonHJ, et al.Transparent body-attachable multifunctional pressure, thermal, and proximity sensor and heater. Sci Rep, 2020; 10(1):1–12; doi: 10.1038/s41598-020-59450-0
39.
Del ValleME, CoboT, CoboJL, et al.Mechanosensory neurons, cutaneous mechanoreceptors, and putative mechanoproteins. Microsc Res Tech, 2012; 75(8):1033–1043; doi: 10.1002/jemt.22028
40.
VallboAB, JohanssonRS. Properties of cutaneous mechanoreceptors in the human hand related to touch sensation. Hum Neurobiol, 1984; 3(1):3–14.
KimSW, LeeY, ParkJ, et al.A triple-mode flexible e-skin sensor interface for multi-purpose wearable applications. Sensors (Switzerland). 2018; 18(1):1–11; doi: 10.3390/s18010078
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
