This paper presents a novel robot grasping planning approach that extracts grasp strategies (grasp type, and thumb placement and direction) from human demonstration and integrates them into the grasp planning procedure to generate a feasible grasp concerning the target object geometry and manipulation task. Our study results show that the grasp strategies of grasp type and thumb placement not only represent important human grasp intentions, but also provide meaningful constraints on hand posture and wrist position, which highly reduce both the feasible workspace of a robotic hand and the search space of the grasp planning. This approach has been thoroughly evaluated both in simulation and with a real robotic system for multiple daily living representative objects. We have also demonstrated the robustness of our approach in the experiment with different levels of perception uncertainties.
AleottiJCaselliS (2006) Grasp recognition in virtual reality for robot pregrasp planning by demonstration. In: IEEE international conference on robotics and automation, pp. 2801–2806.
2.
BalasubramanianRLingXBrookPD. (2010) Human-guided grasp measures improve grasp robustness on physical robot. In: International conference on robotics and automation, pp. 2294–2301.
3.
BelkinMNiyogiP (2001) Laplacian eigenmaps and spectral techniques for embedding and clustering. In: NIPS, pp. 585–591.
4.
Ben AmorHKroemerOHillenbrandU. (2012) Generalization of human grasping for multi-fingered robot hands. In: IEEE/RSJ international conference on intelligent robots and systems, pp. 2043–2050.
5.
ButterfassJGrebensteinMLiuH. (2001) DLR-Hand II: Next generation of a dextrous robot hand. In: IEEE international conference on robotics and automation, pp. 109–114.
6.
CiocarlieMTAllenPK (2009) Hand posture subspaces for dexterous robotic grasping. The International Journal of Robotics Research28(7): 851–867.
7.
CutkoskyMR (1989) On grasp choice, grasp models, and the design of hands for manufacturing tasks. IEEE Transactions on Robotics and Automation5(3): 269–279.
8.
DaiWSunYQianX (2013) Functional analysis of grasping motion. In: IEEE/RSJ international conference on intelligent robots and systems.
9.
EkvallSKragicD (2005) Grasp recognition for programming by demonstration. In: IEEE international conference on robotics and automation, pp. 748–753.
10.
El-KhourySSahbaniA (2010) A new strategy combining empirical and analytical approaches for grasping unknown 3D objects. Robotics and Autonomous Systems58(5): 497–507.
11.
FerrariCCannyJ (1992) Planning optimal grasps. In: IEEE international conference on robotics and automation, pp. 2290–2295.
12.
FischerMvan der SmagtPHirzingerG (1998) Learning techniques in a dataglove based telemanipulation system for the DLR hand. In: IEEE international conference on robotics and automation, pp. 1603–1608.
13.
FisherRA (1936) The use of multiple measurements in taxonomic problems. Annals of Eugenics7(2): 179–188.
14.
GioiosoGSalviettiGMalvezziM. (2011) Mapping synergies from human to robotic hands with dissimilar kinematics: An object based approach. In: IEEE international conference on robotics and automation.
15.
HeumerGAmorHBWeberM. (2007) Grasp recognition with uncalibrated data gloves – A comparison of classification methods. In: IEEE virtual reality conference, pp. 19–26.
HotellingH (1933) Analysis of a complex of statistical variables into principal components. Journal of Educational Psychology24(6): 417.
18.
HsiaoKLozano-PerezT (2006) Imitation learning of whole-body grasps. In: IEEE/RSJ international conference on intelligent robots and systems, pp. 5657–5662.
19.
HueserMBaierTZhangJ (2006) Learning of demonstrated grasping skills by stereoscopic tracking of human head configuration. In: IEEE international conference on robotics and automation, pp. 2795–2800.
20.
JacobsenSCWoodJEKnuttiDF. (1984) The Utah/MIT dextrous hand: Work in progress. The International Journal of Robotics Research3(4): 21–50.
21.
KangSBIkeuchiK (1997) Toward automatic robot instruction from perception-mapping human grasps to manipulator grasps. IEEE Transactions on Robotics and Automation13(1): 81–95.
22.
KimJ (2007) Example-based grasp adaptation. PhD Thesis, Massachusetts Institute of Technology, MA.
23.
KimJIwamotoKKuffnerJ. (2013) Physically based grasp quality evaluation under pose uncertainty. IEEE Transactions on Robotics29(6): 1424–1439.
24.
KochanA (2005) Shadow delivers first hand. Industrial Robot: An International Journal32(1): 15–16.
25.
KootstraGPopovićMJørgensenJA. (2012) Enabling grasping of unknown objects through a synergistic use of edge and surface information. The International Journal of Robotics Research31(10): 1190–1213.
26.
LeQVKammDKaraAF. (2010) Learning to grasp objects with multiple contact points. In: IEEE international conference on robotics and automation, pp. 5062–5069.
27.
LinYSunY (2013a) Grasp mapping using locality preserving projections and kNN regression. In: International conference on robotics and automation.
28.
LinYSunY (2013b) Task-oriented grasp planning based on disturbance distribution. In: International symposium on robotics research (ISRR).
29.
LinYRenSClevengerM. (2012) Learning grasping force from demonstration. In: IEEE international conference on robotics and automation, pp. 1526–1531.
30.
LiuGXuJWangX. (2004) On quality functions for grasp synthesis, fixture planning, and coordinated manipulation. IEEE Transactions on Automation Science and Engineering1(2): 146–162.
31.
LiYFuJLPollardN (2007) Data-driven grasp synthesis using shape matching and task-based pruning. IEEE Transactions on Visualization and Computer Graphics13(4): 732–747.
32.
LovchikCSDiftlerMA (1999) The Robonaut hand: A dexterous robot hand for space. In: IEEE international conference on robotics and automation, pp. 907–912.
33.
MarzkeMWMarzkeRF (2000) Evolution of the human hand: Approaches to acquiring, analysing and interpreting the anatomical evidence. Journal of Anatomy197(1): 121–140.
34.
NapierJR (1960) Studies of the hands of living primates. In: Proceedings of the Zoological Society of London, pp. 647–657.
35.
NapierJR (1965) Evolution of the human hand. In: Proceedings of the Royal Institution of Great Britain, pp. 544–557.
36.
NguyenVD (1988) Constructing force-closure grasps. The International Journal of Robotics Research7(3): 3–16.
37.
OztopEArbibMA (2002) Schema design and implementation of the grasp-related mirror neuron system. Biological Cybernetics87(2): 116–140.
38.
PapazovCHaddadinSParuselS. (2012) Rigid 3D geometry matching for grasping of known objects in cluttered scenes. The International Journal of Robotics Research31(4): 538–553.
39.
PeerAEinenkelSBussM (2008) Multi-fingered telemanipulation-mapping of a human hand to a three finger gripper. In: The 17th IEEE international symposium on robot and human interactive communication, pp. 465–470.
40.
PollardNS (2004) Closure and quality equivalence for efficient synthesis of grasps from examples. The International Journal of Robotics Research23(6): 595–613.
41.
PonceJFaverjonB (1995) On computing three-finger force-closure grasps of polygonal objects. IEEE Transactions on Robotics and Automation11(6): 868–881.
RomeroJKjellstromHKragicD (2009) Modeling and evaluation of human-to-robot mapping of grasps. In: International conference on advanced robotics, pp. 1–6.
44.
RosalesCRosLPortaJM. (2011) Synthesizing grasp configurations with specified contact regions. The International Journal of Robotics Research30(4): 431–443.
45.
RoweisSTSaulLK (2000) Nonlinear dimensionality reduction by locally linear embedding. Science290(5500): 2323–2326.
46.
SahbaniAEl-KhourySBidaudP (2012) An overview of 3D object grasp synthesis algorithms. Robotics and Autonomous Systems60(3): 326–336.
47.
SantelloMFlandersMSoechtingJF (1998) Postural hand synergies for tool use. The Journal of Neuroscience18(23): 10,105–10,115.
48.
SaxenaADriemeyerJNgAY (2008) Robotic grasping of novel objects using vision. The International Journal of Robotics Research27(2): 157–173.
49.
SunY (2011) Fingertip force and contact position and orientation sensor. In: 2011 IEEE international conference on robotics and automation (ICRA), pp. 1114–1119.
50.
SusmanRL (1998) Hand function and tool behavior in early hominids. Journal of Human Evolution35(1): 23–46.
51.
TeginJEkvallSKragicD. (2009) Demonstration-based learning and control for automatic grasping. Intelligent Service Robotics2(1): 23–30.
52.
TenenbaumJB (1998) Mapping a manifold of perceptual observations. Advances in Neural Information Processing Systems 10: 682–688.
53.
YoungRW (2003) Evolution of the human hand: The role of throwing and clubbing. Journal of Anatomy202(1): 165–174.
54.
ZhuXWangJ (2003) Synthesis of force-closure grasps on 3-D objects based on the Q distance. IEEE Transactions on Robotics and Automation19(4): 669–679.
55.
ZöllnerRPardowitzMKnoopS. (2005) Towards cognitive robots: Building hierarchical task representations of manipulations from human demonstration. In: IEEE international conference on robotics and automation, pp. 1535–1540.
