We formulate a Nash-based feedback control law for an Euler–Lagrange system to yield a solution to noncooperative differential game. The robot manipulators are broadly used in industrial units on the account of their reliable, fast, and precise motions, while consuming a significant lumped amount of energy. Therefore, an optimal control strategy needs to be implemented in addressing efficiency issues, while delivering accuracy obligation. As a case study, we here focus on a 7-DOF robot manipulator through formulating a two-player feedback nonzero-sum differential game. First, coupled Euler–Lagrangian dynamic equations of the manipulator are briefly presented. Then, we formulate the feedback Nash equilibrium solution to achieve perfect trajectory tracking. Finally, the performance of the Nash-based feedback controller is analytically and experimentally examined. Simulation and experimental results reveal that the control law yields almost perfect tracking and achieves closed-loop stability.
ArslanGMardenJRShammaJS (2007) Autonomous vehicle-target assignment: a game-theoretical formulation. Journal of Dynamic Systems, Measurement, and Control129(5): 584–596.
2.
BaeD-SHaugEJ (1987) A recursive formulation for constrained mechanical system dynamics: part I. Open loop systems. Mechanics of Structures and Machines15(3): 359–382.
3.
BagheriM (2019) Adaptive and delay-compensating robot controllers. PhD Thesis, UC San Diego and SDSU.
4.
BagheriMNaseradinmousaviP (2017) Novel analytical and experimental trajectory optimization of a 7-dof baxter robot: global design sensitivity and step size analyses. The International Journal of Advanced Manufacturing Technology93(9–12): 4153–4167.
5.
BagheriMAjoudaniALeeJ, et al. (2015) Kinematic analysis and design considerations for optimal base frame arrangement of humanoid shoulders. In: 2015 IEEE international conference on robotics and automation (ICRA), WA, USA, 26–30 May 2015, pp. 2710–2715. IEEE.
6.
BagheriMNaseradinmousaviPMorsiR (2017) Experimental and novel analytical trajectory optimization of a 7-dof baxter robot: global design sensitivity and step size analyses. In: ASME 2017 dynamic systems and control conference, VA, USA, 13–11 October 2017. The American Society of Mechanical Engineers.
7.
BagheriMKrstićMNaseradinmousaviP (2018a) Analytical and experimental predictor-based time delay control of baxter robot. In: ASME 2018 dynamic systems and control conference, GA, USA, 30 September–3 October 2018. The American Society of Mechanical Engineers.
8.
BagheriMKrstićMNaseradinmousaviP (2018b) Joint-space trajectory optimization of a 7-dof baxter using multivariable extremum seeking. In: 2018 IEEE american control conference (ACC). WI, USA, 27–29 June 2018, pp. 2176–2181. IEEE
9.
BagheriMKrstićMNaseradinmousaviP (2018c) Multivariable extremum seeking for joint-space trajectory optimization of a high-degrees-of-freedom robot. Journal of Dynamic Systems, Measurement, and Control140(11): 111017.
10.
BagheriMNaseradinmousaviPKrstićM (2019a) Feedback linearization based predictor for time delay control of a high-dof robot manipulator. Automatica108: 108485.
11.
BagheriMNaseradinmousaviPKrstićM (2019b) Time delay control of a high-dof robot manipulator through feedback linearization based predictor. In: ASME 2019 dynamic systems and control conference, UT, USA, 8–11 October 2019. The American Society of Mechanical Engineers.
12.
BagheriMKarafyllisINaseradinmousaviP, et al. (2021) Adaptive control of a two-link robot using batch least-square identifier. IEEE/CAA Journal Automatica Sinica8(1): 86–93.
13.
BasarTOlsderGJ (1999) Dynamic Noncooperative Game Theory. Siam.
14.
BertinoABagheriMNaseradinmousaviP, et al. (2019) Experimental autonomous deep learning-based 3d path planning for a 7-dof robot manipulator. In: ASME 2019 dynamic systems and control conference, UT, USA, 8–11 October 2019. The American Society of Mechanical Engineers.
15.
BhattacharyaSHutchinsonS (2009) On the existence of nash equilibrium for a two player pursuit-evasion game with visibility constraints. In: ChirikjianGSChosetHMoralesM, et al. (eds). Algorithmic Foundation of Robotics VIII. Springer Tracts in Advanced Robotics. Springer, 251–265.
16.
BugnonFJMohlerRR (1988) Structural choices of 2 versus 1 pursuit-evasion differential games. Journal of Dynamic Systems, Measurement, and Control110(2): 160–167.
17.
ChengYLiCLiS, et al. (2020) Motion planning of redundant manipulator with variable joint velocity limit based on beetle antennae search algorithm. IEEE Access8: 138788–138799.
18.
DixonW (2014) Optimal Adaptive Control and Differential Games by Reinforcement Learning Principles. IEEE.
19.
DolezălJ (1979) Parameter optimization for two-player zero-sum differential games. Journal of Dynamic Systems, Measurement, and Control101(4): 345–349.
20.
EslamipoorRNobariANobariO (2019) Optimal point-to-point path planning of manipulator by using vibration damping optimization algorithm and game theory method. Journal of Testing and Evaluation47(4): 1–7.
21.
IsaacsR (1965) Differential Games: A Mathematical Theory with Applications to Warfare and Pursuit, Control and Optimization. John Wiley.
22.
JiXYangKNaX, et al. (2019) Feedback game-based shared control scheme design for emergency collision avoidance: a fuzzy-linear quadratic regulator approach. Journal of Dynamic Systems, Measurement, and Control141(8): 081005.
23.
JinLLiaoBLiuM, et al. (2017) Different-level simultaneous minimization scheme for fault tolerance of redundant manipulator aided with discrete-time recurrent neural network. Frontiers in Neurorobotics11: 50.
24.
JohnsonMA (2011) Differential Game-Based Control Methods for Uncertain Continuous-Time Nonlinear Systems. Citeseer.
25.
JohnsonMBhasinSDixonWE (2011) Nonlinear two-player zero-sum game approximate solution using a policy iteration algorithm. In: 2011 50th Decision and control and European control conference (CDC-ECC), FL, USA, 12–15 December 2011, pp. 142–147. IEEE.
26.
JumarieG (1977) Coordination concepts in multilevel hierarchical differential games. Journal of Dynamic Systems, Measurement, and Control99(3): 201–208.
27.
KamalapurkarRKlotzJDixonWE (2014a) Model-based reinforcement learning for on-line feedback-nash equilibrium solution of n-player nonzero-sum differential games. In: American control conference (ACC), OR, USA, 4–6 June 2014, pp. 3000–3005. IEEE.
28.
KamalapurkarRKlotzJRDixonWE (2014b) Concurrent learning-based approximate feedback-nash equilibrium solution of n-player nonzero-sum differential games. IEEE/CAA Journal of Automatica Sinica1(3): 239–247.
29.
KamalapurkarRKlotzJRWaltersP, et al. (2018) Model-based reinforcement learning in differential graphical games. IEEE Transactions on Control of Network Systems5(1): 423–433.
30.
KirkDE (2012) Optimal Control Theory: An Introduction. Courier Corporation.
31.
KorayemMHNohoojiHRNikoobinA (2011) Path planning of mobile elastic robotic arms by indirect approach of optimal control. International Journal of Advanced Robotic Systems8(1): 10.
32.
KorayemMHShafeiAMDehkordiSF (2013) Systematic modeling of a chain of n-flexible link manipulators connected by revolute–prismatic joints using recursive gibbs-appell formulation. Archive of Applied Mechanics84(2): 187–206.
33.
KorayemMHEsfandiarHDargahiR (2016) Determining load carrying capacity of a manipulator by game theory: closed-loop nonzero-sum differential game approach. Journal of Mechanical Science and Technology30(11): 5197–5205.
34.
LaValleSMHutchinsonSA (1994) Path selection and coordination for multiple robots via nash equilibria. In: Proceedings of the 1994 IEEE international conference on robotics and automation. San Diego, CA, May 8–13 1994, pp. 1847–1852. IEEE.
35.
LeeDPeriauxJGonzalezLF (2010) UAS mission path planning system (MPPS) using hybrid-game coupled to multi-objective optimizer. Journal of Dynamic Systems, Measurement, and Control132(4): 041005.
36.
LiSHeJLiY, et al. (2016a) Distributed recurrent neural networks for cooperative control of manipulators: a game-theoretic perspective. IEEE Transactions on Neural Networks and Learning Systems28(2): 415–426.
37.
LiYTeeKPYanR, et al. (2016b) A framework of human–robot coordination based on game theory and policy iteration. IEEE Transactions on Robotics32(6): 1408–1418.
38.
LiZLiCLiS, et al. (2020a) A fault-tolerant method for motion planning of industrial redundant manipulator. IEEE Transactions on Industrial Informatics16(12): 7469–7478.
39.
LiZZuoWLiS (2020b) Zeroing dynamics method for motion control of industrial upper-limb exoskeleton system with minimal potential energy modulation. Measurement163: 107964.
40.
LiuWChenDSteilJ (2016) Analytical inverse kinematics solver for anthropomorphic 7-DOF redundant manipulators with human-like configuration constraints. Journal of Intelligent & Robotic Systems86(1): 63–79.
41.
MaW-HPengH (1999) Solutions of continuous-time preview two-player differential games. Journal of Dynamic Systems, Measurement, and Control121(2): 326–331.
42.
MengY (2008) Multi-robot searching using game-theory based approach. International Journal of Advanced Robotic Systems5(4): 44.
43.
NammotoTKosugeK (2012) An analytical solution for a redundant manipulator with seven degrees of freedom. International Journal of Automation and Smart Technology2(4): 339–346.
44.
NashJ (1951) Non-cooperative games. Annals of Mathematics54: 286–295.
45.
NaudetJLefeberDDaerdenF, et al. (2003) Forward dynamics of open-loop multibody mechanism using a efficient recursive algorithm based on canonical momenta. Multibody System Dynamics10(1): 45–59.
46.
QuintanaRPatinoD (2018) A game-theoretical perspective for decentralized active noise control. Journal of Vibration and Control24(21): 5062–5071.
47.
SahaSKSchiehlenWO (2001) Recursive kinematics and dynamics for parallel structured closed-loop multibody system. Mechanics of Structures and Machines29(2): 143–175.
48.
ShafeiAMKorayemMH (2017) Theoretical and experimental study of dynamic load-carrying capacity for flexible robotic arms in point-to-point motion. Optimal Control Applications and Methods38(6): 963–972.
49.
ShafeiAShafeiH (2018) Dynamic modeling of planar closed-chain robotic manipulators in flight and impact phases. Mechanism and Machine Theory126: 141–154.
50.
SharmaR (2016) Lyapunov theory based stable Markov game fuzzy control for non-linear systems. Engineering Applications of Artificial Intelligence55: 119–127.
51.
SharmaRGopalM (2014) Fictitious play based markov game control for robotic arm manipulator. In: Proceedings of 3rd international conference on reliability, infocm technologies and optimization, Noida, India, 8−10 October 2014, pp. 1−6. IEEE.
52.
SmyrnakisMVeresSM (2014) Coordination of control in robot teams using game-theoretic learning. IFAC Proceedings Volumes47(3): 1194–1202.
53.
TijsS (2003) Introduction to Game Theory. Springer.
54.
WangXYazEESchneiderSC (2018) Coupled state-dependent riccati equation control for continuous time nonlinear mechatronics systems. Journal of Dynamic Systems, Measurement, and Control140(11): 111013.
55.
WeerenASchumacherJEngwerdaJC (1999) Asymptotic analysis of linear feedback nash equilibria in nonzero-sum linear-quadratic differential games. Journal of Optimization Theory and Applications101(3): 693–722.
56.
XieBZhaoJLiuY (2012) Fault tolerant motion planning of robotic manipulators based on a nested RRT algorithm. Industrial Robot: An International Journal39(1): 40–46.
57.
XuPGroffREBurgT (2012). Dynamics and control of the shoot-the-moon tabletop game. Journal of Dynamic Systems, Measurement, and Control134(5): 051006.
58.
ZhouDJiLZhangQ, et al. (2015) Practical analytical inverse kinematic approach for 7-DOF space manipulators with joint and attitude limits. Intelligent Service Robotics8(4): 215–224.
