Human fingers are one of the most remarkable organs for handling complex tasks or manipulating unknown objects, not only due to its dexterous and powerful movement capabilities but also its rich kinematic sense at joints and tactile sensing at skins. Shape and tactile sensing are crucial for soft pneumatic fingers to achieve embodied intelligence. Reliable tactile sensing of soft pneumatic-driven robots is particularly challenging due to its large deformation and adaptability. Here, we propose a distributed local curvature sensing-based solution for simultaneous shape and tactile perceptions in real-time. Utilizing 4 seamlessly integrated bidirectional bending curvature sensing units, real-time shape curve, contact location, and contact force can be obtained. Experimental results indicate a maximum shape reconstruction error of 0.3 mm (when the reconstruction length is 90 mm) and a force estimation error of 0.02 N (RMSE, range 0–0.4 N). Moreover, a two-finger gripper was developed; shape and tactile sensing during grasping of diverse objects (varies in weight, size, stiffness) and force-controlled grasping are achieved. Utilizing the shape-sensing and contact-event detection capabilities, dimension of the grasped objects can be recognized in real-time. This work provides an effective, highly robust, easy-to-implement, and transformative perception solution for soft bionic fingers and beyond.
LaschiC, MazzolaiB, CianchettiM. Soft robotics: Technologies and systems pushing the boundaries of robot abilities. Sci Robot, 2016; 1(1):eaah3690; doi: 10.1126/scirobotics.aah3690
2.
RusD, TolleyMT. Design, fabrication and control of soft robots. Nature, 2015; 521(7553):467–475; doi: 10.1038/nature14543
JiangH, HawkesEW, FullerC, et al.A robotic device using gecko-inspired adhesives can grasp and manipulate large objects in microgravity. Sci Robot, 2017; 2(7):eaan4545; doi: 10.1126/scirobotics.aan4545
5.
AbondanceS, TeepleCB, WoodRJ. A dexterous soft robotic hand for delicate in-hand manipulation. IEEE Robot Autom Lett, 2020; 5(4):5502–5509; doi: 10.1109/Lra.2020.3007411
6.
BainesR, PatiballaSK, BoothJ, et al.Multi-environment robotic transitions through adaptive morphogenesis. Nature, 2022; 610(7931):283–289; doi: 10.1038/s41586-022-05188-w
7.
KimT, LeeS, HongT, et al.Heterogeneous sensing in a multifunctional soft sensor for human-robot interfaces. Sci Robot, 2020; 5(49):eabc6878; doi: 10.1126/scirobotics.abc6878
8.
LiuW, DuoY, LiuJ, et al.Touchless interactive teaching of soft robots through flexible bimodal sensory interfaces. Nat Commun, 2022; 13(1):5030; doi: 10.1038/s41467-022-32702-5
9.
PolygerinosP, CorrellN, MorinSA, et al.Soft robotics: Review of fluid‐driven intrinsically soft devices; manufacturing, sensing, control, and applications in human‐robot interaction. Adv Eng Mater, 2017; 19(12):1700016; doi: 10.1002/adem.201700016
10.
BeccaiL, LucarottiC, TotaroM, et al.Soft Robotics Mechanosensing. In: Soft Robotics: Trends, Applications and Challenges: Proceedings of the Soft Robotics Week, April 25–30, 2016, Livorno, Italy. Biosystems & Biorobotics (BIOSYSROB, volume 17). Springer International Publishing: Cham; 2016; pp. 11–21; doi: 10.1007/978-3-319-46460-2_3
11.
George ThuruthelT, AnsariY, FaloticoE, et al.Control strategies for soft robotic manipulators: A survey. Soft Robot, 2018; 5(2):149–163; doi: 10.1089/soro.2017.0007
12.
VicariA, ObayashiN, StellaF, et al.Proprioceptive sensing of soft tentacles with model based reconstruction for controller optimization. In: 2023 IEEE International Conference on Soft Robotics (RoboSoft). IEEE; 2023; pp. 1–6; doi:10.1109/RoboSoft55895.2023.10121999
HegdeC, SuJT, TanJMR, et al.Sensing in soft robotics. ACS Nano, 2023; 17(16):15277–15307; doi: 10.1021/acsnano.3c04089
15.
ChoeJK, KimJ, SongHYS, et al.A soft, self-sensing tensile valve for perceptive soft robots. Nat Commun, 2023; 14(1):3942; doi: 10.1038/s41467-023-39691-z
16.
AmjadiM, KyungKU, ParkI, et al.Stretchable, skin‐mountable, and wearable strain sensors and their potential applications: A review. Adv Funct Materials, 2016; 26(11):1678–1698; doi: 10.1002/adfm.201504755
17.
WangX, DongL, ZhangH, et al.Recent progress in electronic skin. Adv Sci (Weinh), 2015; 2(10):1500169; doi: 10.1002/advs.201500169
18.
LuN, KimDH. Flexible and stretchable electronics paving the way for soft robotics. Soft Robot, 2014; 1(1):53–62; doi: 10.1089/soro.2013.0005
19.
KimB, HaJ, ParkFC, et al.Optimizing curvature sensor placement for fast, accurate shape sensing of continuum robots. In: 2014 IEEE International Conference on Robotics and Automation (ICRA). IEEE; 2014; pp. 5374–5379; doi: 10.1109/ICRA.2014.6907649
20.
WangH, ZhangR, ChenW, et al.Shape detection algorithm for soft manipulator based on fiber Bragg gratings. IEEE/ASME Trans Mechatron, 2016; 21(6):2977–2982; doi: 10.1109/TMECH.2016.2606491
21.
LuX, XuW, LiX. A soft robotic tongue - Mechatronic design and surface reconstruction. IEEE/ASME Trans Mechatron, 2017; 22(5):2102–2110; doi: 10.1109/TMECH.2017.2748606
22.
HaoJ, ZhangZ, WangS, et al.2D shape estimation of a pneumatic‐driven soft finger with a large bending angle based on learning from two sensing modalities. Advanced Intelligent Systems, 2023; 5(10); doi: 10.1002/aisy.202370043
23.
HuDL, Giorgio-SerchiF, ZhangSM, et al.Stretchable e-skin and transformer enable high-resolution morphological reconstruction for soft robots. Nat Mach Intell, 2023; 5(3):261–272; doi: 10.1038/s42256-023-00622-8
24.
ShapiroY, KósaG, WolfA. Shape tracking of planar hyper-flexible beams via embedded PVDF deflection sensors. IEEE/ASME Trans Mechatron, 2014; 19(4):1260–1267; doi: 10.1109/TMECH.2013.2278251
25.
CianchettiM, RendaF, LicofonteA, et al.Sensorization of continuum soft robots for reconstructing their spatial configuration. In: 2012 4th IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob).IEEE; 2012; pp. 634–639; doi: 10.1109/BioRob.2012.6290788
26.
XieZ, YuanF, LiuZ, et al.A proprioceptive soft tentacle gripper based on crosswise stretchable sensors. IEEE/ASME Trans Mechatron, 2020; 25(4):1841–1850; doi: 10.1109/tmech.2020.2993258
27.
TrubyRL, Della SantinaC, RusD. Distributed proprioception of 3D configuration in soft, sensorized robots via deep learning. IEEE Robot Autom Lett, 2020; 5(2):3299–3306; doi: 10.1109/Lra.2020.2976320
28.
LuoM, SkorinaEH, TaoW, et al.Toward modular soft robotics: Proprioceptive curvature sensing and sliding-mode control of soft bidirectional bending modules. Soft Robot, 2017; 4(2):117–125; doi: 10.1089/soro.2016.0041
29.
FeltW, ChinKY, RemyCD. Smart braid feedback for the closed-loop control of soft robotic systems. Soft Robot, 2017; 4(3):261–273; doi: 10.1089/soro.2016.0056
30.
FeltW, ChinKY, RemyCD. Contraction sensing with smart braid Mckibben muscles. IEEE ASME Trans Mechatron, 2016; 21(3):1201–1209; doi: 10.1109/TMECH.2015.2493782
31.
WangHB, TotaroM, BlandinAA, et al.A wireless inductive sensing technology for soft pneumatic actuators using magnetorheological elastomers. In: 2019 2nd IEEE International Conference on Soft Robotics (RoboSoft). IEEE; 2019; pp. 242–248; doi:10.1109/robosoft.2019.8722800
32.
ZhaoH, O’BrienK, LiS, et al.Optoelectronically innervated soft prosthetic hand via stretchable optical waveguides. Sci Robot, 2016; 1(1):eaai7529; doi: 10.1126/scirobotics.aai7529
33.
ZhaoH, JalvingJ, HuangR, et al.A helping hand: Soft orthosis with integrated optical strain sensors and EMG control. IEEE Robot Automat Mag, 2016; 23(3):55–64; doi: 10.1109/MRA.2016.2582216
34.
ZhouZ, ZuoR, YingB, et al.A sensory soft robotic gripper capable of learning-based object recognition and force-controlled grasping. IEEE Trans Automat Sci Eng, 2024; 21(1):844–854; doi: 10.1109/tase.2022.3228255
35.
LiuW, DuoY, ChenX, et al.An intelligent robotic system capable of sensing and describing objects based on bimodal, self‐powered flexible sensors. Adv Funct Materials, 2023; 33(41):2306368; doi: 10.1002/adfm.202306368
36.
ShuS, WangZ, ChenP, et al.Machine‐learning assisted electronic skins capable of proprioception and exteroception in soft robotics. Adv Mater, 2023; 35(18):e2211385; doi: 10.1002/adma.202211385
37.
SongS, LiZ, YuH, et al.Electromagnetic positioning for tip tracking and shape sensing of flexible robots. IEEE Sensors J, 2015; 15(8):4565–4575; doi: 10.1109/JSEN.2015.2424228
38.
AnX, CuiY, DongX, et al.Shape reconstruction of soft continuum robots via the fusion of local strains and global poses. Cell Rep Phys Sci, 2024; 5(10):102224; doi: 10.1016/j.xcrp.2024.102224
39.
ShorthoseO, AlbiniA, HeL, et al.Design of a 3D-printed soft robotic hand with integrated distributed tactile sensing. IEEE Robot Autom Lett, 2022; 7(2):3945–3952; doi: 10.1109/LRA.2022.3149037
40.
PengY, WangZ, WuH, et al.Magnetic crack-based Piezoinductive mechanical sensors: Way to extreme robustness and ultra-sensitivity. Nat Commun, 2025; 16(1):6370; doi: 10.1038/s41467-025-61784-0
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
