Due to the multiple types of objects and the uncertainty of their geometric structures and scales in indoor scenes, the position and pose estimation of point clouds of indoor objects by mobile robots has the problems of domain gap, high learning cost, and high computing cost. In this paper, a lightweight 6D pose estimation method is proposed, which decomposes the pose estimation into a viewpoint and the in-plane rotation around the optical axis of the viewpoint, and the improved PointNet network structure and two lightweight modules are used to construct a codebook, and the 6d pose estimation of the point cloud of the indoor objects is completed by building and querying the codebook. The model was trained on the ShapeNetV2 dataset, and reports the ADD-S metric validation on the YCB-Video and LineMOD datasets, reaching 97.0% and 94.6% respectively. The experiment shows that the model can be trained to estimate the 6d position and pose of the unknown object point cloud with lower computation and storage cost, and the model with fewer parameters and better real-time performance is superior to other high-recision methods.
HuangR.MuF.LiW.LiuH.ChengH., Estimating 6d object poses with temporal motion reasoning for robot grasping in cluttered scenes, IEEE Robotics and Automation Letters, 2022.
2.
NguyenA.-T.VuC.-T., Obstacle Avoidance for Autonomous Mobile Robots Based on Mapping Method, in: Proceedings of the International Conference on Advanced Mechanical Engineering, Automation, and Sustainable Development 2021 (AMAS2021), Springer, 2022, pp. 810–816.
3.
WangJ.ChenK.DouQ., Category-Level 6D Object Pose Estimation via Cascaded Relation and Recurrent Reconstruction Networks, in: 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2021, pp. 4807–4814. doi: 10.1109/IROS51168.2021.9636212.
4.
HuangP.ZengL.ChenX.LuoK.ZhouZ.YuS., Edge robotics: Edge-computing-accelerated multirobot simultaneous localization and mapping, IEEE Internet of Things Journal9(15) (2022), 14087–14102.
5.
GorschlüterF.RojtbergP.PöllabauerT., A survey of 6d object detection based on 3d models for industrial applications, Journal of Imaging8(3) (2022), 53.
6.
SongC.SongJ.HuangQ., Hybridpose: 6d object pose estimation under hybrid representations, in: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2020, pp. 431–440.
7.
ShugurovI.ZakharovS.IlicS., Dpodv2: Dense correspondence-based 6 dof pose estimation, IEEE Transactions on Pattern Analysis and Machine Intelligence44(11) (2021), 7417–7435.
8.
HuangL.HodanT.MaL.ZhangL.TranL.TwiggC.WuP.-C.YuanJ.KeskinC.WangR., Neural correspondence field for object pose estimation, in: Computer Vision – ECCV 2022: 17th European Conference, Tel Aviv, Israel, October 23–27, 2022, Proceedings, Part X, Springer, 2022, pp. 585–603.
9.
AokiY.GoforthH.SrivatsanR.A.LuceyS., Pointnetlk: Robust & efficient point cloud registration using pointnet, in: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2019, pp. 7163–7172.
10.
GaoG.LauriM.WangY.HuX.ZhangJ.FrintropS., 6d object pose regression via supervised learning on point clouds, in: 2020 IEEE International Conference on Robotics and Automation (ICRA), IEEE, 2020, pp. 3643–3649.
11.
GaoG.LauriM.HuX.ZhangJ.FrintropS., Cloudaae: Learning 6d object pose regression with on-line data synthesis on point clouds, in: 2021 IEEE International Conference on Robotics and Automation (ICRA), IEEE, 2021, pp. 11081–11087.
12.
HuaW.ZhouZ.WuJ.HuangH.WangY.XiongR., Rede: End-to-end object 6d pose robust estimation using differentiable outliers elimination, IEEE Robotics and Automation Letters6(2) (2021), 2886–2893.
13.
WangC.XuD.ZhuY.Martín-MartínR.LuC.Fei-FeiL.SavareseS., Densefusion: 6d object pose estimation by iterative dense fusion, in: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2019, pp. 3343–3352.
14.
HeY.SunW.HuangH.LiuJ.FanH.SunJ., Pvn3d: A deep point-wise 3d keypoints voting network for 6dof pose estimation, in: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2020, pp. 11632–11641.
15.
HeY.HuangH.FanH.ChenQ.SunJ., Ffb6d: A full flow bidirectional fusion network for 6d pose estimation, in: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2021, pp. 3003–3013.
16.
QiC.R.SuH.MoK.GuibasL.J., Pointnet: Deep learning on point sets for 3d classification and segmentation, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2017, pp. 652–660.
17.
QiC.R.YiL.SuH.GuibasL.J., Pointnet++: Deep hierarchical feature learning on point sets in a metric space, Advances in Neural Information Processing Systems30 (2017).
18.
KangH.ZhouH.WangX.ChenC., Real-time fruit recognition and grasping estimation for robotic apple harvesting, Sensors20(19) (2020), 5670.
19.
ZhangY.MüllerS.StephanB.GrossH.-M.NotniG., Point cloud hand-object segmentation using multimodal imaging with thermal and color data for safe robotic object handover, Sensors21(16) (2021), 5676.
20.
NongX.BaiW.LiuG., Airborne LiDAR point cloud classification using PointNet++ network with full neighborhood features, Plos One18(2) (2023), e0280346.
21.
CaiD.HeikkiläJ.RahtuE., OVE6D: Object viewpoint encoding for depth-based 6D object pose estimation, in: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022, pp. 6803–6813.
22.
QianG.LiY.PengH.MaiJ.HammoudH.ElhoseinyM.GhanemB., Pointnext: Revisiting pointnet++ with improved training and scaling strategies, Advances in Neural Information Processing Systems35 (2022), 23192–23204.
23.
ChangA.X.FunkhouserT.GuibasL.HanrahanP.HuangQ.LiZ.SavareseS.SavvaM.SongS.SuH. et al., Shapenet: An information-rich 3d model repository, arXiv preprint arXiv:1512.03012, 2015.
24.
WuZ.SongS.KhoslaA.YuF.ZhangL.TangX.XiaoJ., 3d shapenets: A deep representation for volumetric shapes, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2015, pp. 1912–1920.
25.
XiangY.SchmidtT.NarayananV.FoxD., PoseCNN: A Convolutional Neural Network for 6D Object Pose Estimation in Cluttered Scenes, arXiv preprint arXiv:1711.00199, 2017.
26.
HinterstoisserS.HolzerS.CagniartC.IlicS.LepetitV., Multimodal templates for real-time detection of texture-less objects in heavily cluttered scenes, in: IEEE International Conference on Computer Vision, 2012.
27.
HinterstoisserS.LepetitV.IlicS.HolzerS.BradskiG.KonoligeK.NavabN., Model based training, detection and pose estimation of texture-less 3d objects in heavily cluttered scenes, in: Computer Vision – ACCV 2012: 11th Asian Conference on Computer Vision, Daejeon, Korea, November 5–9, 2012, Revised Selected Papers, Part I 11, Springer, 2013, pp. 548–562.
