A novel visual servoing method is proposed to synchronously capture a malfunctional satellite’s docking ring by two space manipulators. Due to the lack of conspicuous visual marks, structured light is implemented to estimate the ring’s pose. To ensure the capturing process’s security, two aspects are investigated. Spatially, capturing target points for two manipulators are planned together by considering the chaser’s orientation. As a consequence, collision risk between two manipulators is eliminated. Temporally, by adding duration parameters in trajectory generation algorithm, capturing synchronism for two manipulators is guaranteed. Experimental results show that, by the proposed method, a tumbling target was successfully captured by two space manipulators. Compared to existing methods, the collision risk between two manipulators is thoroughly eliminated and the capturing synchronism is improved remarkably.
ForshawJLAgliettiGSNavarathinamN, et al. RemoveDEBRIS: an in-orbit active debris removal demonstration mission. Acta Astronaut2016; 127: 448–463.
2.
MarkCPKamathS.Review of active space debris removal methods. Space Policy2019; 47: 194–206.
3.
Flores-AbadAMaOPhamK, et al. A review of space robotics technologies for on-orbit servicing. J Aerosp Sci2014; 68: 1–26.
4.
SvotinaVVCherkasovaMV.Space debris removal – review of technologies and techniques. Flexible or virtual connection between space debris and service spacecraft. Acta Astronaut2023; 204: 840–853.
5.
XuYBrownHBFriedmanM, et al. Control system of the self-mobile space manipulator. IEEE Trans Control Syst Technol1994; 2: 207–219.
6.
StieberMFTrudelCPHunterDG.Robotic systems for the International Space Station. In: Proc. Int. Conf. Robot. Autom., Albuquerque, NM, USA, 1997, pp.3068–3073. New York: IEEE.
7.
YoshidaKKurazumeRUmetaniY.Dual arm coordination in space free-flying robot. In: Proc. 1991 IEEE Int. Conf. Robot. Autom., Sacramento, CA, USA, 1991, pp.2516–2521. New York: IEEE.
8.
MiyataMShimodaTWakabayashiY.Study of capture and berthing experiment of ETS-VII. IFAC Proc Vol1998; 31: 195–202.
9.
FriendRB.Orbital Express program summary and mission overview. In: Proceedings of SPIE - The International Society for Optical Engineering, HowardRTMotaghediP (eds) Orlando, FL, 2008, pp.695803.
10.
DavisJPMayberryJPPennJP.On-orbit servicing: inspection, repair, refuel, upgrade, and assembly of satellites in space, 2019.
11.
TimmonsKKRingelbergJC.Approach and capture for autonomous rendezvous and docking. In: 2008 IEEE Aerosp. Conf., Big Sky, MT, 2008, pp.1–6. New York: IEEE.
12.
FelicettiLSabatiniMPisculliA, et al. Adaptive Thrust Vector Control during On-Orbit Servicing. In: AIAA SPACE 2014 Conf. Expo., American Institute of Aeronautics and Astronautics, San Diego, CA, 2014.
13.
XuR-NLuoJ-JWangM-M, et al. Optimal configuration for dual-arm space robot grasping a tumbling target based on task compatibility. Multibody Syst Dyn2022; 56: 29–48.
14.
LiangCWangRLiuX.A visual-based servo control method for space manipulator assisted docking. In: 2022 IEEE 6th Inf. Technol. Mechatron. Eng. Conf. ITOEC, Chongqing, China, 2022, pp.72–76. New York: IEEE.
15.
LaiNChenYLiangJ, et al. An onboard-eye-to-hand visual servo and task coordination control for aerial manipulator based on a spherical model. Mechatronics2022; 82: 102724.
16.
JinMYangGLiuY, et al. A motion planning method based vision servo for free-flying space robot capturing a tumbling satellite. In: 2018 IEEE 8th Annu. Int. Conf. CYBER Technol. Autom. Control Intell. Syst. CYBER, Tianjin, China, 2018, pp.883–888. New York: IEEE.
17.
MedinaATomassiniASuatoniM, et al. Towards a standardized grasping and refuelling on-orbit servicing for geo spacecraft. Acta Astronaut2017; 134: 1–10.
18.
SabatiniMGasbarriPPalmeriniGB.Coordinated control of a space manipulator tested by means of an air bearing free floating platform. Acta Astronaut2017; 139: 296–305.
19.
YangGLiuYJinM, et al. A robust and adaptive control method for flexible-joint manipulator capturing a tumbling satellite. IEEE Access2019; 7: 159971–159985.
20.
ChenGWangYWangY, et al. Detumbling strategy based on friction control of dual-arm space robot for capturing tumbling target. J Aeronaut2020; 33: 1093–1106.
21.
NocerinoAOpromollaRFasanoG, et al. LIDAR-based multi-step approach for relative state and inertia parameters determination of an uncooperative target. Acta Astronaut2021; 181: 662–678.
22.
LiYWangYXieY.Using consecutive point clouds for pose and motion estimation of tumbling non-cooperative target. Adv Space Res2019; 63: 1576–1587.
23.
RenNZhaoBLiuB, et al. Adaptive Doppler compensation method for coherent LIDAR based on optical phase-locked loop. Measurement2022; 187: 110313.
24.
XuXShenZZhaoJ, et al. Rotational motion estimation of non-cooperative target in space based on the 3D point cloud sequence. Adv Space Res2022; 69: 1528–1537.
25.
LuoHZhangKSuY, et al. Monocular vision pose determination-based large rigid-body docking method. Measurement2022; 204: 112049.
26.
YingyingGLiW.Fast-swirl space non-cooperative target spin state measurements based on a monocular camera. Acta Astronaut2020; 166: 156–161.
27.
LiXSuYLiuY, et al. Active target tracking: A simplified view aligning method for binocular camera model. Comput Vis Image Underst2018; 175: 11–23.
28.
LiJ.Relative pose measurement of binocular vision based on feature circle. Optik2019; 194: 163121.
29.
LiuYXieZZhangQ, et al. A new approach for the estimation of non-cooperative satellites based on circular feature extraction. Robot Auton Syst2020; 129: 103532.
30.
ZhangDYangGJiJ, et al. Pose measurement and motion estimation of non-cooperative satellite based on spatial circle feature. Adv Space Res2023; 71: 1721–1734.
31.
BaiWShiLXiaoX, et al. Pose Measurement and Tracking of Non-cooperative Satellite Based on Stereo Vision. In: 2021 40th Chin. Control Conf. CCC, Shanghai, China, 2021, pp.8234–8240. New York: IEEE.
32.
JiaoCZhangLSuX, et al. Predictive motion control for autonomous capture of a tumbling target with a space manipulator. J Franklin Inst2022; 359: 7913–7935.
33.
YazdkhastiSSasiadekJZ.Space Robot Relative Navigation for debris removal. IFAC-PapersOnLine2017; 50: 7929–7934.
34.
WangMLuoJZhengL, et al. Generate optimal grasping trajectories to the end-effector using an improved genetic algorithm. Adv Space Res2020; 66: 1803–1817.
35.
LuoJYuMWangM, et al. A fast trajectory planning framework with task-priority for space robot. Acta Astronaut2018; 152: 823–835.
36.
LiuYDuZWuZ, et al. Multiobjective preimpact trajectory planning of space manipulator for self-assembling a heavy payload. Int J Adv Robot Syst2021; 18: 172988142199028.
DongGZhuZH.Predictive visual servo kinematic control for autonomous robotic capture of non-cooperative space target. Acta Astronaut2018; 151: 173–181.
40.
AghiliF.A prediction and motion-Planning Scheme for visually guided robotic capturing of free-floating tumbling objects with uncertain dynamics. IEEE Trans Robot2012; 28: 634–649.
41.
WeiSLiuBYaoM, et al. Efficient online motion planning method for the robotic arm to pick-up moving objects smoothly with temporal constraints. Proc IMechE, Part C: J Mechanical Engineering Science2022; 236: 8650–8662.
42.
LiuBWeiSYaoM, et al. Dynamic grasping of manipulator based on realtime smooth trajectory generation. Proc IMechE, Part C: J Mechanical Engineering Science2023; 095440622311611. DOI: 10.1177/09544062231161147
43.
BhargavaRMithunPAnuragVV, et al. Image space based path planning for reactionless manipulation of redundant space robot. In: 2016 IEEERSJ Int. Conf. Intell. Robots Syst. IROS, Daejeon, South Korea, 2016, pp.4362–4368. New York: IEEE.
44.
KojimaHOkawaraTTrivailoPM.Ellipse detection-based visual servo control for capturing upper-stage rocket body. Acta Astronaut2021; 182: 295–309.
DoroshinAVKrikunovMM.The generalized method of phase trajectory curvature synthesis in spacecraft attitude dynamics tasks. Int J Non Linear Mech2022; 147: 104246.
47.
YoshidaKDimitrovDNakanishiH.On the capture of tumbling satellite by a space robot. In: 2006 IEEERSJ Int. Conf. Intell. Robots Syst., Beijing, China, 2006, pp.4127–4132. New York: IEEE.
48.
WangYSLiuJYZengQH, et al. Visual pose measurement based on structured light for MAVs in non-cooperative environments. Optik2015; 126: 5444–5451.
49.
SenDPalSK.Gradient histogram: Thresholding in a region of interest for edge detection. Image Vis Comput2010; 28: 677–695.
50.
AbdallaMNagyB.Dilation and erosion on the triangular tessellation: an independent approach. IEEE Access2018; 6: 23108–23119.
51.
ShimizuMMasatoshiO.Calibration and rectification for reflection stereo. In: 2008 IEEE Conf. Comput. Vis. Pattern Recognit., Anchorage, AK, USA, 2008, pp.1–8. New York: IEEE.
52.
BiladMRQingLFaneAG.Non-linear least-square fitting method for characterization of forward osmosis membrane. J Water Process Eng2018; 25: 70–80.
53.
XuWSheYXuY.Analytical and semi-analytical inverse kinematics of SSRMS-type manipulators with single joint locked failure. Acta Astronaut2014; 105: 201–217.
54.
YangGLiuYJinM.A new control method of flexible-joint manipulator with harmonic drive. Proc IMechE, Part C: J Mechanical Engineering Science2020; 234: 1868–1883.
55.
YangGLiuYJiJ, et al. A model-based PID-like motion control method for flexible-joint manipulator with harmonic drives. Proc IMechE, Part C: J Mechanical Engineering Science2021; 235: 7880–7893.
