In this paper, a stable reinforcement learning control approach using neural networks (NNs) is developed for the trajectory tracking of an n-link rigid robot manipulator. The considered systems are in discrete time form. The proposed controller design consists of two NNs. One is the critic network that is used to approximate the long-term cost function, whereas other is that the action NN is employed to generate the system input. Then, an optimal control input can be obtained compared with other robot manipulator systems. Using the Lyapunov approach, the tracking error and weight estimates are proven to be semi-global uniformly ultimately bounded. A simulation example is employed to illustrate the effectiveness of the proposed controller.
ChenCLPLeClairSRPaoYH (1998) An incremental adaptive implementation of functional-link processing for function approximation, time-series prediction, and system identification. Neurocomputing18: 11–31.
2.
ChenMGeSSRenBB (2010) Robust Adaptive neural network control for a class of uncertain MIMO nonlinear systems with input nonlinearities. IEEE Transactions on Neural Networks21: 796–812.
3.
ChenMGeSSRenBB (2011) Adaptive tracking control of uncertain MIMO nonlinear systems with input constraints. Automatica47: 452–465.
4.
GeSSLiGYLeeTH (2003) Adaptive NN control for a class of strict-feedback discrete-time nonlinear systems. Automatica39(5): 807–819.
5.
KatićDVukobratovićM (2003) Survey of intelligent control techniques for humanoid robots. Journal of Intelligent & Robotic Systems37: 117–141.
6.
LeeTLWuCJ (2003) Fuzzy motion planning of mobile robots in unknown environments. Journal of Intelligent & Robotic Systems37: 177–191.
7.
LiDJ (2012) Adaptive output feedback control of uncertain nonlinear chaotic systems based on dynamic surface control technique. Nonlinear Dynamics68(1–2): 235–243.
8.
LiHYuJHiltonCLiuH (2012) Adaptive sliding mode control for nonlinear active suspension systems using T-S fuzzy model. IEEE Transactions on Industrial Electronics. DOI: 10.1109/TIE.2012.2202354.
9.
LiTSWangDFengG (2010) A DSC Approach to robust adaptive NN tracking control for strict-feedback nonlinear systems. IEEE Transactions on System Man, and Cybernetics – Part B: Cybernetics40: 915–927.
10.
LiZJGeSSAdamsMWijesomaWS (2008a) Adaptive robust output-feedback motion/force control of electrically driven nonholonomic mobile manipulators. IEEE Transactions on Control Systems Technology16(6): 1308–1315.
11.
LiZJGeSSAdamsMWijesomaWS (2008b) Robust adaptive control of uncertain force/motion constrained nonholonomic mobile manipulators. Automatica44: 776–784.
12.
LinCK (2003) A reinforcement learning adaptive fuzzy controller for robots. Fuzzy Sets and Systems137: 339–352.
13.
LinCK (2009) H∞ reinforcement learning control of robot manipulators using fuzzy wavelet networks. Fuzzy Sets and Systems160: 1756–1786.
14.
LiuLLiDJLiuYJ (2012) Adaptive control for a class of nonlinear systems and application to hard disk drives with hysteresis friction nonlinearity. Journal of Vibration and Control. DOI: 10.1177/1077546312463755 [in press].
15.
LiuYJLiuLTongSC (2013) Adaptive neural network tracking design for a class of uncertain nonlinear discrete-time systems with dead-zone. Science China Information Sciences. DOI: 10.1007/s11432-012-4779-0 [in press].
16.
RenBBGeSSTeeKPLeeTH (2010) Adaptive neural control for output feedback nonlinear systems using a barrier Lyapunov function. IEEE Transactions on Neural Networks21(8): 1339–1344.
17.
SunFCSunZQWooPY (1998) Stable neural-network-based adaptive control for sampled-data nonlinear systems. IEEE Transactions on Neural Networks9(5): 956–968.
18.
SunFCLiLLiHXLiuHP (2007) Neuro-fuzzy dynamic-inversion-based adaptive control for robotic manipulators- discrete time case. IEEE Transactions on Industrial Electronics54(3): 1342–1351.
19.
TongSCHeXLZhangHG (2009) A combined backstepping and small-gain approach to robust adaptive fuzzy output feedback control. IEEE Transactions on Fuzzy Sets17(5): 1059–1069.
20.
TongSCLiuCLLiYM (2010) Fuzzy adaptive decentralized control for large-scale nonlinear systems with dynamical uncertainties. IEEE Transactions on Fuzzy Systems18: 845–861.
21.
YangCGGeSSXiangCChaiTLeeTH (2008) Output feedback NN control for two classes of discrete-time systems with unknown control directions in a unified approach. IEEE Transactions on Neural Networks19: 1873–1886.
22.
YangCGaneshGAlbu-SchaefferABurdetE (2011) Human like adaptation of force and impedance in stable and unstable tasks. IEEE Transactions on Robotics27: 918–930.
23.
YangQMJagannathanS (2012) Reinforcement learning controller design for affine nonlinear discrete-time systems using online approximators. IEEE Transactions on Systems, Man, and Cybernetics – Part B: Cybernetics42(2): 377–390.
24.
YangQMVanceJBJagannathanS (2008) Control of nonaffine nonlinear discrete-time systems using reinforcement learning-based linearly parameterized neural networks. IEEE Transactions on Systems, Man, and Cybernetics – Part B: Cybernetics38(4): 994–1001.
25.
YaoJJWangXCHuSH (2011) Adaptive neural network-based adaptive inverse control for an electro-hydraulic servo system. Journal of Vibration and Control17: 2007–2014.
26.
ZhangHGLuoYHLiuDR (2009) Neural network-based near-optimal control for a class of discrete-time affine nonlinear systems with control constraint. IEEE Transactions on Neural Networks20: 1490–1503.
27.
ZhouQShiPLuJJXuSY (2011) Adaptive output-feedback fuzzy tracking control for a class of nonlinear systems. IEEE Transactions on Fuzzy Systems19: 972–982.
28.
ZhouQShiPLiuHXuS (2012) Neural-network- based decentralized adaptive output-feedback control for large-scale stochastic nonlinear systems. IEEE Transactions on Systems, Man, and Cybernetics – Part B: Cybernetics42: 1608–1619.
29.
ZhouQShiPXuSLiH (2013) Observer-based adaptive neural network control for nonlinear stochastic systems with time delay. IEEE Transactions on Neural Networks and Learning Systems24: 71–80.
