This paper proposes a data-driven learning guidance strategy to tackle the target interception problem with terminal time constraints. The developed guidance algorithm employs the prediction-correction concept to derive commands effectively. We first develop a two-branch neural network to predict time-to-go, assuming there is no constraints on target’s maneuvers. Using the predicted time-to-go, we then propose a biased proportional navigation guidance (PNG), where the the biased command is computed by a deep reinforcement learning (DRL) network, to correct the impact time. Results from intensive Monte-Carlo simulations validates the efficacy of the method.
YuJShiZDongX, et al. Impact time consensus cooperative guidance against the maneuvering target: theory and experiment. IEEE Trans Aero Electron Syst. 2023; 59(4): 4590–4603.
2.
KumarSRMukherjeeD. Terminal time-constrained nonlinear interception strategies against maneuvering targets. J Guid Control Dynam2021; 44(1): 200–209. DOI: 10.2514/1.G005455.
3.
HeSLinD. Three-dimensional optimal impact time guidance for antiship missiles. J Guid Control Dynam2019; 42(4): 941–948.
4.
MerkulovGWeissMShimaT. Minimum-effort impact-time control guidance using quadratic kinematics approximation. J Guid Control Dynam2022; 45: 348–361. DOI: 10.2514/1.G006190.
5.
LeeSChoNKimY. Impact-time-control guidance strategy with a composite structure considering the seeker's field-of-view constraint. J Guid Control Dynam2020; 43(8): 1566–1574. DOI: 10.2514/1.G005063.
6.
DongWWangCWangJ, et al.Varying-gain proportional navigation guidance for precise impact time control. J Guid Control Dynam2023; 46(3): 535–552. DOI: 10.2514/1.G007174.
7.
TahkMJShimSWHongSM, et al.Impact time control based on time-to-go prediction for sea-skimming antiship missiles. IEEE Trans Aero Electron Syst2018; 54(4): 2043–2052. DOI: 10.1109/taes.2018.2803538.
8.
KimMJungBHanB, et al.Lyapunov-based impact time control guidance laws against stationary targets. IEEE Trans Aero Electron Syst2015; 51(2): 1111–1122. DOI: 10.1109/taes.2014.130717.
9.
JeonISLeeJITahkMJ. Homing guidance law for cooperative attack of multiple missiles. J Guid Control Dynam2010; 33(1): 275–280. DOI: 10.2514/1.40136.
10.
LiKWangJLeeCH, et al.Distributed cooperative guidance for multivehicle simultaneous arrival without numerical singularities. J Guid Control Dynam2020; 43(7): 1365–1373. DOI: 10.2514/1.G005010.
11.
HeSWangWLinD, et al.Consensus-based two-stage salvo attack guidance. IEEE Trans Aero Electron Syst2017; 54(3): 1555–1566.
12.
In-Soo JeonJJin-Ik LeeLMin-Jea TahkT. Impact-time-control guidance law for anti-ship missiles. IEEE Trans Control Syst Technol2006; 14(2): 260–266. DOI: 10.1109/tcst.2005.863655.
13.
JeonISLeeJITahkMJ. Impact-time-control guidance with generalized proportional navigation based on nonlinear formulation. J Guid Control Dynam2016; 39(8): 1885–1890. DOI: 10.2514/1.G001681.
14.
NanavatiRVKumarSRMaityA. Three-dimensional suboptimal nonlinear impact time guidance against non-maneuvering target. Aero Sci Technol2021; 115: 106831. DOI: 10.1016/j.ast.2021.106831.
15.
KumarSRMukherjeeD. Deviated pursuit based interception at a priori fixed time. J Guid Control Dynam2019; 42(9): 2124–2131. DOI: 10.2514/1.G004284.
16.
GuoxinSQiuqiuWZhiqiangX, et al.Impact time control using biased proportional navigation for missiles with varying velocity. Chin J Aeronaut2020; 33(3): 956–964.
17.
HossainMAMadkourADahalKP, et al.A real-time dynamic optimal guidance scheme using a general regression neural network. Eng Appl Artif Intell2013; 26(4): 1230–1236.
18.
PengCZhangHHeY, et al.State-following-kernel-based online reinforcement learning guidance law against maneuvering target. IEEE Trans Aero Electron Syst2022; 58(6): 5784–5797. DOI: 10.1109/taes.2022.3178770.
19.
JinTHeS. Ensemble transfer learning midcourse guidance algorithm for velocity maximization. J Aero Inf Syst2023; 20(4): 204–215. DOI: 10.2514/1.I011070.
20.
IzzoDÖztürkE. Real-time guidance for low-thrust transfers using deep neural networks. J Guid Control Dynam2021; 44(2): 315–327. DOI: 10.2514/1.G005254.
21.
YouSWanCDaiR, et al.Learning-based onboard guidance for fuel-optimal powered descent. J Guid Control Dynam2021; 44(3): 601–613. DOI: 10.2514/1.G004928.
22.
ChengLJiangFWangZ, et al.Multiconstrained real-time entry guidance using deep neural networks. IEEE Trans Aero Electron Syst2021; 57(1): 325–340. DOI: 10.1109/TAES.2020.3015321.
23.
WuYLiLSuX, et al.Multi-phase trajectory optimization for an aerial-aquatic vehicle considering the influence of navigation error. Eng Appl Artif Intell2020; 89: 103404.
24.
JiangRYeDXiaoY, et al.Orbital interception pursuit strategy for random evasion using deep reinforcement learning. Space: Sci Technol2023; 3: 0086.
25.
WasalaAByrneDMiesbauerP, et al.Trajectory based lateral control: a reinforcement learning case study. Eng Appl Artif Intell2020; 94: 103799.
26.
QiuXGaoCJingW. Maneuvering penetration strategies of ballistic missiles based on deep reinforcement learning. Proc Inst Mech Eng G J Aerosp Eng2022; 236(16): 3494–3504. DOI: 10.1177/09544100221088361.
27.
HeSShinHSTsourdosA. Computational missile guidance: a deep reinforcement learning approach. J Aero Inf Syst2021; 18(8): 571–582. DOI: 10.2514/1.I010970.
28.
GaudetBFurfaroRLinaresR. Reinforcement learning for angle-only intercept guidance of maneuvering targets. Aero Sci Technol2020; 99: 105746. DOI: 10.1016/j.ast.2020.105746.
ShalumovV. Cooperative online guide-launch-guide policy in a target-missile-defender engagement using deep reinforcement learning. Aero Sci Technol2020; 104: 105996. DOI: 10.1016/j.ast.2020.105996.
31.
LiuZWangJHeS, et al.Learning prediction-correction guidance for impact time control. Aero Sci Technol2021; 119. DOI: 10.1016/j.ast.2021.107187.
32.
WangNWangXCuiN, et al.Deep reinforcement learning-based impact time control guidance law with constraints on the field-of-view. Aero Sci Technol2022; 128: 107765. DOI: 10.1016/j.ast.2022.107765.
33.
ZarchanP (2012) Tactical and strategic missile guidance. American Institute of Aeronautics and Astronautics, Inc.
34.
LuoHLeeCHLiC, et al. Generative adversarial imitation learning-based continuous learning computational guidance. IEEE Trans Aero Electron Syst. 2025.
35.
ChoNKimY. Modified pure proportional navigation guidance law for impact time control. J Guid Control Dynam2016; 39(4): 852–872.
36.
HeSLeeCH. Optimality of error dynamics in missile guidance problems. J Guid Control Dynam2018; 41(7): 1624–1633. DOI: 10.2514/1.G003343.
37.
SchulmanJLevineSAbbeelP, et al.Trust region policy optimization. In: International Conference on Machine Learning, 2015, pp. 1889–1897. DOI: 10.48550/arXiv.1502.05477.
HolzleitnerMGruberLArjona-MedinaJ, et al.Convergence proof for actor-critic methods applied to ppo and rudder. In: Transactions on Large-Scale Data-and Knowledge-Centered Systems XLVIII: Special Issue In Memory of Univ. Prof. Dr. Roland Wagner. Springer, 2021, pp. 105–130.
