There are a large number of flexible bodies in spacecraft, which belong to a multi-flexible body system. When the orbit of a spacecraft changes, it will excite persistent and significant vibrations. In order to suppress vibration of the multi-flexible body system, a three translational flexible beam (TTFB) system is constructed and its finite element model is established. A trajectory planning scheme based on bacterial foraging optimization (BFO) algorithm and multi-segment quintic spline interpolation trajectory function is proposed. The optimized three-beam vibration is studied, and the BFO trajectory of three-beam (BFO3B) is obtained. A reinforcement learning (RL) framework is built based on the probabilistic inference model for learning (PIL) and deterministic policy gradient (DPG) algorithm, and the PIL-DPG controller is trained. Experimental results indicate that BFO3B trajectory has better vibration suppression ability than trapezoidal trajectory and cycloidal trajectory. Because of the nonlinearity of the PIL-DPG controller, it has better vibration control ability than proportional–derivative (PD) control.
DwivedySKEberhardP. Dynamic analysis of flexible manipulators, a literature review. Mech Mach Theor2006; 41: 749–777.
2.
AmbrosioPCazzulaniGRestaF, et al.An optimal vibration control logic for minimising fatigue damage in flexible structures. J Sound Vib2014; 333: 1269–1280.
3.
KhairudinM. Vibration control using pole placement with proportional gain of a flexible manipulator incorporating payload. J Control Autom Electr Syst2021; 32: 1164–1176.
4.
ShangDYP LiXYinM, et al.Control method of flexible manipulator servo system based on a combination of RBF neural network and pole placement strategy. Mathematics2021; 9: 896.
5.
RodriguezJColletMChesnéS. Experimental modal identification of smart composite structure applied to active vibration control. Smart Mater Struct2021; 30: 115008.
6.
CuiLLWangHSChenWD. Trajectory planning of a spatial flexible manipulator for vibration suppression. Robot Autonom Syst2020; 123: 103316.
7.
WuMKMeJPZhaoYQ, et al.Vibration reduction of delta robot based on trajectory planning. Mech Mach Theor2020; 153: 104004.
8.
AbeA. An effective trajectory planning method for simultaneously suppressing residual vibration and energy consumption of flexible structures. Mech Syst Signal Process2016; 4: 19–27.
9.
ChengQXuWXLiuZF, et al.Optimal trajectory planning of the variable-stiffness flexible manipulator based on cade algorithm for vibration reduction control. Front Bioeng Biotechnol2021; 9: 766495.
10.
WangXMM WangEXingJ, et al.A novel vibration-reduction motion planning method for fast moving mass traveling along flexible structures. Nonlinear Dyn2023; 111: 19151–19170.
11.
GawronskiWWilliamsT. Model reduction for flexible space structures. J Guid Control Dynam1991; 14: 68–76.
12.
WilliamsTChengX. Degrees of controllability and observability for close modes of flexible space structures. IEEE Trans Automat Control1999; 44: 1791–1795.
13.
KusagurSMArunkumarGManjunathTC. Modelling of smart intelligent materials with PZT & PVDF sensors/actuators to control the active vibrations of flexible aluminum mechanical cantilever beams using proportional integral derivative (PID) techniques. Mater Today Proc2021; 37: 2075–2082.
14.
BendineKBoukhouldaFBHaddagB, et al.Active vibration control of composite plate with optimal placement of piezoelectric patches. Mech Adv Mater Struct2019; 26: 341–349.
15.
DubayRHassanMliCY, et al.Finite element based model predictive control for active vibration suppression of a one-link flexible manipulator. ISA Trans2014; 53: 1609–1619.
16.
FangYMFeiJTHuTY. Adaptive backstepping fuzzy sliding mode vibration control of flexible structure. J Low Freq Noise Vib Act Control2018; 37(4): 1079–1096.
17.
LuQFWangPLiuCC. An analytical and experimental study on adaptive active vibration control of sandwich beam. Int J Mech Sci2022; 232: 107634.
18.
IlmanMMYavuzSKaragülleH, et al.Hybrid vibration control of an industrial CFRP composite robot-manipulator system based on reduced order model. Simulat Model Pract Theor2022; 115: 102456.
19.
Tavakolpour-SalehARHaddadMA. A fuzzy robust control scheme for vibration suppression of a nonlinear electromagnetic-actuated flexible system. Mech Syst Signal Process2017; 86: 86–107.
20.
SongHNShanXBZhangLS, et al.Research on identification and active vibration control of cantilever structure based on NARX neural network. Mech Syst Signal Process2022; 171: 108872.
21.
ZhaoWLiuYYaoXQ. Adaptive fuzzy containment and vibration control for multiple flexible manipulators with model uncertainties. IEEE Trans Fuzzy Syst2023; 31(4): 1315–1326.
22.
FengYHLiuZ. Adaptive vibration iterative learning control of a euler–bernoulli beam system with input saturation. IEEE Trans Syst Man Cybern Syst2023; 53(4): 2469–2477.
23.
TipaldiMIervolinoRMassenioPR. Reinforcement learning in spacecraft control applications: advances, prospects, and challenges. Annu Rev Control2022; 54: 1–23.
24.
KhanSGHerrmannGLewisFL, et al.Reinforcement learning and optimal adaptive control: an overview and implementation examples. Annu Rev Control2012; 36: 42–59.
25.
SilverDLeverGHeessNMO, et al.Deterministic policy gradient algorithms. Proceedings of the 31st International Conference on Machine Learning2014; 32: 387–395.
26.
Mnih1VKavukcuoglu1KSilverD, et al.Human-level control through deep reinforcement learning. Nature2015; 518: 529–533.
27.
LillicrapTPHuntJJPritzelA, et al.Continuous control with deep reinforcement learning. arXiv: 1509.029712019. https://arxiv.org/abs/1509.02971
28.
SchulmanJWolskiFDhariwalP, et al.Proximal policy optimization algorithms. arXiv: 1707.063472017. https://arxiv.org/abs/1707.06347
29.
KumarJVKumarVEShivramS, et al.Deep reinforcement learning with reward shaping for tracking control and vibration suppression of flexible link manipulator. Appl Soft Comput2023; 152: 110756.
30.
WeiCSXiongYWChenQF, et al.On adaptive attitude tracking control of spacecraft: a reinforcement learning based gain tuning way with guaranteed performance. Adv Space Res2023; 71: 4534–4548.
31.
DeisenrothMPRasmussenCE. PILCO: a model-based and data-efficient approach to policy search. Proceedings of the 28th International Conference on Machine Learning, Washington, DC, USA, 2 July 2011.
32.
XuPJCuiYZShenYC, et al.Reinforcement learning compensated coordination control of multiple mobile manipulators for tight cooperation. Eng Appl Artif Intell2023; 123: 106281.
33.
BeaudoinMABouletB. Improving gearshift controllers for electric vehicles with reinforcement learning. Mech Mach Theor2022; 169: 104654.
34.
ChangCTsaiJLinJ, et al.Autonomous driving control using the DDPG and RDPG algorithms. Appl Sci2021; 11: 10659.
35.
CuiLLChenWDWangJC, et al.Control of flexible manipulator based on reinforcement learning. 2018 Chinese Automation Congress, Xi’an, China, 2 December 2018.
36.
HeWGaoHJZhouC, et al.Reinforcement learning control of a flexible two-link manipulator: an experimental investigation. IEEE Trans Syst Man Cybern Syst2021; 51: 7326–7336.
37.
ChandrashekharaKBhatiaK. Active buckling control of smart composite plates-finite-element analysis. Smart Mater Struct1993; 2: 31–39.
38.
PassinoKM. Biomimicry of bacterial foraging for distributed optimization and control. IEEE Control Sys Magazine2002; 22: 52–67.
