This article develops a prediction and path planning system based on the graph neural network to navigate a robot in a complex dynamic environment. In particular, the core of this method is to predict those aspects of the future that are directly relevant for planning, including their value, state, and policy. A graph neural network-based method is introduced to encode the interaction between the robot and the surrounding environment. Then, the dynamic model of the environment is learned through the model-based reinforcement learning, and the path is planned using the Monte Carlo tree search method according to the learned model. Finally, simulation studies are given to evaluate the validity and advantage of the obtained algorithm compared with the most recent methods. It has been shown that the proposed method achieves a higher success rate within a less time. Meantime, the oscillatory and freezing problems caused by the short-sightedness of the robot are avoided.
VemulaAMuellingKOhJ. Modeling cooperative navigation in dense human crowds. In: 2017 IEEE international conference on robotics and automation, 2017, pp. 1685–1692, https://ieeexplore.ieee.org/document/7989199
2.
KimSGuySJLiuW. Predicting pedestrian trajectories using velocity-space reasoning. Int J Robot Res2015; 34(2): 201–217.
3.
UnhelkarVVD’ArpinoCPStirlingL, et al. Human-robot co-navigation using anticipatory indicators of human walking motion. In: 2015 IEEE international conference on robotics and automation, 2015, pp. 6183–6190, https://ieeexplore.ieee.org/document/7140067
4.
PhillipsMLikhachevM. SIPP: safe interval path planning for dynamic environments. In: 2011 IEEE international conference on robotics and automation, 2011, pp. 5628–5635, https://www.cs.cmu.edu/∼maxim/files/sipp_icra11.pdf
5.
Van Den BergJLinMManochaD. Reciprocal velocity obstacles for real-time multi-agent navigation. In: 2008 IEEE international conference on robotics and automation, 19–23 May 2008, pp. 1928–1935, https://ieeexplore.ieee.org/document/4543489
6.
FoxDBurgardWThrunS. The dynamic window approach to collision avoidance. IEEE Robot Autom Mag1997; 4(1): 23–33.
7.
GuptaAJohnsonJFei-FeiL, et al. Social GAN: socially acceptable tra-jectories with generative adversarial networks. In: 2018 IEEE conference on computer vision and pattern recognition, 2018, pp. 2255–2264, https://arxiv.org/abs/1803.10892
8.
SadeghianAKosarajuVSadeghianA, et al. SoPhie: an attentive GAN for predicting paths compliant to social and physical constraints. In: 2019 IEEE conference on computer vision and pattern recognition, 2019, pp. 1349–1358, https://arxiv.org/abs/1806.01482
9.
ChenYFLiuMEverettM, et al. Decentralized non-communicating multiagent collision avoidance with deep reinforcement learning. In: IEEE international conference on robotics and automation, 2017, pp. 285–292, https://ieeexplore.ieee.org/document/7989037
10.
EverettMChenYFHowJP. Motion planning among dynamic, decision-making agents with deep reinforcement learning. In: IEEE/RSJ international conference on intelligent robots and systems, 2018, pp. 3052–3059, https://arxiv.org/abs/1805.01956
11.
DengZVahdatAHuH, et al. Structure inference machines: recurrent neural networks for analyzing relations in group activity recognition. In: IEEE conference on computer vision and pattern recognition, 2016, pp. 4772–4781, https://arxiv.org/abs/1511.04196
12.
KipfTFetayaEWangK-C, et al. Neural relational inference for interacting systems. In: Proceedings of the 35th international conference on machine learning, 2018, https://proceedings.mlr.press/v80/kipf18a/kipf18a.pdf
13.
BattagliaPWPascanuRLaiM, et al. Interaction networks for learning about objects, relations and physics. arXiv preprint arXiv:1612.00222, 2017, https://arxiv.org/abs/1612.00222
LiCDongZChenG, et al. Data-driven planning of electric vehicle charging infrastructure: a case study of Sydney, Australia. IEEE Trans Smart Grid2021; 12(4): 3289–3304.
16.
WangXGirshickRGuptaA, et al. Non-local neural networks. In: 2018 IEEE/CVF conference on computer vision and pattern recognition, 2018, pp. 7794–7803, https://ieeexplore.ieee.org/document/8578911
FerrerGGarrellASanfeliuA. Robot companion: a social-force based approach with human awareness-navigation in crowded environments. In: 2013 IEEE/RSJ international conference on intelligent robots and systems, 2013, pp. 1688–1694, https://ieeexplore.ieee.org/document/6696576
19.
MehtaDFerrerGOlsonE. Autonomous navigation in dynamic social environments using multi-policy decision making. In: 2016 IEEE/RSJ international conference on intelligent robots and systems, 2016, pp. 1190–1197, https://ieeexplore.ieee.org/document/7759200
20.
SilverDHuangAMaddisonC, et al. Mastering the game of Go with deep neural networks and tree search. Nature2016; 529: 484–489.
21.
ChenYFEverettMLiuM, et al. Socially aware motion planning with deep reinforcement learning. In: IEEE/RSJ international conference on intelligent robots and systems, 2017, pp. 134–1350, https://arxiv.org/abs/1703.08862
22.
KudererMKretzschmarHSprunkC, et al. Feature-based prediction of trajectories for socially compliant navigation. In: Robotics: science and systems, 2012, https://ieeexplore.ieee.org/document/6577979
23.
LongPFanTLiaoX, et al. Towards optimally decentralized multi-robot collision avoidance via deep reinforcement learning. In: 2018 IEEE international conference on robotics and automation, 2018, pp. 6252–6259, https://ieeexplore.ieee.org/document/8461113
24.
ChenCLiuYKreissS, et al. Crowd-robot interaction: crowd-aware robot navigation with attention-based deep reinforcement learning. In: 2019 IEEE international conference on robotics and automation, 2019, pp. 6015–6022, https://core.ac.uk/download/pdf/211986118.pdf
25.
TrautmanPKrauseA. Unfreezing the robot: navigation in dense, interacting crowds. In: 2010 IEEE/RSJ international conference on intelligent robots and systems, 2010, pp. 797–803, https://ieeexplore.ieee.org/document/5654369
26.
BennewitzMBurgardWCielniakG, et al. Learning motion patterns of people for compliant robot motion. Int J Rob Res2005; 24(1): 31–48.
27.
AoudeGSLudersBDJosephJM, et al. Probabilistically safe motion planning to avoid dynamic obstacles with uncertain motion patterns. Auton Robots2013; 35(1): 51–76.
ChenMWeiZHuangZ, et al. Simple and deep graph convolutional networks. In: Proceedings of the 37th international conference on machine learning, 2020, pp. 1725–1735, https://proceedings.mlr.press/v119/chen20v.html
32.
SchrittwieserJAntonoglouIHubertT, et al. Mastering Atari, go, chess and shogi by planning with a learned model. Nature2020; 588: 604–609.
33.
ChenCHuSNikdelP, et al. Relational graph learning for crowd navigation. arXiv preprint arXiv:1909.13165, 2019, https://arxiv.org/abs/1909.13165
