Sage Journals: Discover world-class research

Abstract

Stabilization and learning are imperative to the high-performance feedback control of nonlinear systems. A dual adaptive robust control (DARC) scheme is proposed for nonlinear systems with model uncertainties to achieve a desired level of performance. Only the output of the nonlinear system is accessible in this work, all the states and parameters are learned online. Firstly, the DARC uses the prior physical bounds of systems to design a discontinuous projection with update rate limits which confines the bounds of parameter and state estimation. Then robustness of the nonlinear system can be guaranteed by the deterministic robust control (DRC) method. Secondly, a dual adaptive estimation mechanism (DAEM) is developed to learn the unknown parameters and states of systems. One part of the DAEM is the bounded gain forgetting (BGF) estimator, which is developed to handle inaccurate parameters and parametric variations. The other is the adaptive unscented Kalman filter (AUKF) synthesized for state estimation. The AUKF contains a statistic estimator based on the maximum a posterior (MAP) rule to estimate the unknown covariance matrix. Finally, simulation results illustrate the effectiveness of the suggested method.

Keywords

Adaptive control adaptive unscented Kalman filter nonlinear systems system identification

Introduction

Performant feedback control of nonlinear systems is impeded by inaccurate dynamical models. To improve the performance of nonlinear systems, the estimation of parameters and states are heavily studied by researchers.^1–4 Adaptive control is a well-known technique for the online estimation of parameters.^5–8 Also, many approaches have been developed for the state estimation of nonlinear systems, especially the nonlinear Kalman filter.^9–11 However, simultaneous estimating the parameters and states of nonlinear systems is still a challenging problem. The conventional approach, such as extended Kalman filter (EKF) and extended Luenberger observer, is simply linearizing the nonlinear model and building an augmented state system with parameters such that the traditional linear method can be applied to the estimation of the augmented states.^12–14 Nevertheless, these methods suffer from the drawbacks of heavy computation of the Jacobi matrix and limited precision of the first order.^15,16 With higher accuracy, the unscented Kalman filter (UKF) is implemented for parameter and state estimation of nonlinear systems.^17,18 Both the joint UKF and dual UKF methods are under the framework of Kalman, which needs exact knowledge of prior statistics. In practice, statistics are hard to know and often inaccurate. Thus the performance of estimation might be degraded or even diverge.¹⁹ To avoid performance degradation, many different types of adaptive unscented Kalman filter (AUKF) with statistic estimator are applied to industrial areas.^20,21 Though the adaptive mechanism of AUKF is effective, this method assumes that parameters are constants disturbed by small Gaussian noises which are usually not satisfied. The AUKF with Gaussian distribution assumptions also has a limited tracking capability of parameters, but the actual operating environment for nonlinear systems is complex and parameters are usually time-varying. This work integrates the bounded gain forgetting (BGF) estimator¹ and AUKF to form a dual adaptive estimation mechanism (DAEM). The bounded gain forgetting (BGF) estimator with parameter tracking ability while avoiding adaptation gain unboundedness is designed for parameter estimation. Simultaneously the AUKF method is used for state estimation based on the nonlinear model updated by BGF. The proposed DAEM can acquire a precise estimation of parameters and states even in presence of parametric variations.

Concurrent learning and stabilization is always a critical ability of nonlinear systems.^22–24 As a model learning methodology, the DAEM can improve the performance of control systems by adjusting the feedback control law. However, this will bring the same weaknesses as adaptive control, poor transient performance, and vulnerability to external disturbances. Therefore, a novel control policy that retains the learning ability and overcomes the non-robustness of DAEM must be developed. Deterministic robust control (DRC)^25,26 has been widely used in the control of nonlinear systems because of its capability to achieve not only robust stability but also robust performance. However, the design conservativeness of DRC suffers from poor steady-state accuracy. Both the DAEM and DRC method have their own benefits and limitations. An adaptive robust control (ARC) framework with learning ability while retaining the robustness of the system has been developed.²² This paper utilizes the ARC framework to construct a dual adaptive robust control (DARC) for nonlinear systems to bridge the gaps between DRC and DAEM. Unlike conventional ARC, both state and parameter are learned online. Moreover, the state estimation error has also been taken into account for the stability of the system. The poor transients and non-robust performance of DAEM are superseded by the guaranteed transients and robust performance due to leveraging the DRC philosophy. Owing to the learning power of DAEM, the poor steady-state performance of DRC is replaced by an excellent final tracking accuracy. The proposed DARC approach preserves the merits and overcomes the limitations of DAEM and DRC. Furthermore, the ARC framework utilizes the backstepping technique to ensure the stability of the closed-loop system. However, the derivate signals in backstepping increase the computation burden heavily.²⁷ For high-order nonlinear systems, the calculation of derivatives becomes prohibitive. Therefore, the proposed DARC employs the command filter technique²⁸ to relieve the calculation complexity. The computational complexity of DARC reduced significantly when compared to taditional ARC algorithm.

This work contributes to a new dual adaptive robust control scheme of nonlinear systems that achieves high-performance feedback control. This is achieved by:

A DAEM method, which intelligently integrates BGF estimator and AUKF, is proposed to estimate the unknown states and parameters simultaneously.

In conventional ARC control,^29,30 the states of the system have assumed known or the state estimation error has been ignored for proving the stability of the whole closed-loop system. This work has taken both state and parameter estimation errors into the consideration. The DAEM has been brought into the ARC framework to form a novel DARC method. The stability of the whole system has been proved by the Lyapunov method. In addition, asymptotic stability can be achieved under specific conditions.

The proposed DARC combine the command filter technique into the design procedure to avoid heavy computation of the partial derivatives of virtual control law in the backstepping design.

The rest of the work is organized as follows. Problem formulation is done carefully in section Problem formulation. In section Dual adaptive robust control, the DARC control law, which ensures stability while learning, and the learning mechanism DAEM are formulated. In section Simulation example, a second-order nonlinear system with uncertainties is simulated with different scenarios and the results show the effectiveness of the DARC method. Section Conclusion concludes this work.

Problem formulation

This work considers nonlinear systems that can be transformed to the form below.

{\begin{matrix} {\overset{\cdot}{x}}_{i} = Y_{i} {({\underline{x}}_{i}, t)}^{T} a + b_{i} x_{i + 1} + w_{i} i = 1, \dots, n - 1 \\ {\overset{\cdot}{x}}_{n} = Y_{n} {({\underline{x}}_{n}, t)}^{T} a + b_{n} u + w_{n} \\ y_{1} = x_{1} + v_{1} \end{matrix}

(1)

where ${\underline{x}}_{i} = [x_{1}, \dots, x_{i}]^{T} \in R^{i}$ is the vector of first $i$ states of the system, $x = {\underline{x}}_{n} \in R^{n}$ , $Y_{i} ({\underline{x}}_{i}, t) \in R^{p}, i = 1, \dots, n$ is known function vector represented the nonlinear features of the system, $a \in R^{p}$ and $b_{i}, i = 1, \dots, n$ are the unknown parameters for nonlinear features, $w = [w_{1}, \dots, w_{n}]^{T} \in R^{n}$ and $v_{1} \in R$ are non-parameteric uncertainties caused by modeling errors, disturbances, and noises, $y_{1} \in R$ is the output measurement. For notation simplicity, the unknown parameters can be written as $a_{b} = {[a^{T}, b^{T}]}^{T} \in R^{p + n}$ and $b = [b_{1}, \dots, b_{n}]^{T} \in R^{n}$ . The following nomenclature is used throughout this work: For a vector $♢$ , $\hat{♢}$ and $\tilde{♢}$ $= \hat{♢} - ♢$ are the estimation value and error of $♢$ , $♢_{\min}$ and $♢_{\max}$ represent the minimum and maximum value of $♢$ , and ${\underline{♢}}_{i}$ is a vector constituted by first $i$ elements of vector $♢$ , $♢_{i}$ is the $ith$ element of vector $♢$ , $♢_{i, \min}$ and $♢_{i, \max}$ represent the minimum and maximum value of $♢_{i}$ .

Let $x_{1 d}$ be the desired trajectory and the control targets of this work are: (1) Design a control law $u$ that guarantees a prescribed tracking accuracy. (2) A precise estimation of unknown parameters and states and the desired trajectory $x_{1 d}$ can be tracked exactly after the transient phase.

The following practice assumptions are presented:

Assumptions 1. The unknown parameter vector $a_{b}$ is bounded by a convex region $C_{a_{b}}$ . $b_{i}, i = 1, \dots, n$ are not equal to zero and with known sign. Without loss of generality, we suppose $a_{i, \min} \leq a_{i} \leq a_{i, \max}, i = 1, \dots, p$ and $0 < b_{i, \min} \leq b_{i} \leq b_{i, \max}, i = 1, \dots, n$ .

Assumptions 2. The non-parametric uncertainties of the nonlinear system $w_{i}, i = 1, \dots, n$ and $v_{1}$ are bounded. To be specific, $| w_{i} | \leq p_{i} (x, t), i \in 1, \dots, n$ and $| v_{1} | \leq ρ_{1} (x, t)$ where $p_{i} (x, t)$ and $ρ_{1} (x, t)$ are known functions²².

Assumptions 3. The reference trajectory $x_{1 d}$ , nonlinear function vector $Y_{i}, i = 1, \dots, n$ , and their derivatives are smooth and bounded.

Assumptions 4. The non-parametric uncertainties of the nonlinear system $w_{i}, i = 1, \dots, n$ and $v_{1}$ can be viewed as a truncated Gaussian distribution with zero-mean and unknown covariance matrices $W$ and $V$ .

Dual adaptive robust control

The dual adaptive robust control policy proposed in this work can be seen in Figure 1. The parameters and states are estimated by the dual adaptive learning mechanism consisting of the BGF estimator and the AUKF method. Then a discontinuous projection is designed for confining the parameter and state in a convex region which is constructed with the prior knowledge of the bounds of parametric and non-parametric uncertainties. With the projection-type adaption law for parameter and state estimation, the stability of the whole system can be ensured by leveraging the DRC philosophy.

Figure 1.

The schematic of proposed dual adaptive robust control policy.

A projection type adaptation law

To improve the robustness of the nonlinear system while retaining learning capability. A discontinuous projection $pro j_{\hat{α}} (ζ)$ , which keeps the estimated parameters $\hat{α}$ in a known bound,³⁰ is defined as

pro j_{\hat{α}} (ζ) = {\begin{matrix} 0, if {\begin{matrix} \hat{α} = α_{\max} and ζ \geq 0 \\ \hat{α} = α_{mim} and ζ \leq 0 \end{matrix} \\ \begin{matrix} ζ & otherwise \end{matrix} \end{matrix}

(2)

where $ζ \in R$ . Define a saturation function for $ζ$ to limit the upper bounds of estimation rate as below.

s a t_{{\dot{α}}_{m a x}} (ζ) = {\begin{matrix} ζ, & | ζ | \leq {\dot{α}}_{m a x} \\ {\dot{α}}_{m a x} \frac{ζ}{| ζ |}, & | ζ | \geq {\dot{α}}_{m a x} \end{matrix}

(3)

where ${\overset{\cdot}{α}}_{\max}$ is the preset limit of adaptation rate for parameter $ζ$ . With the projection-type adaptation law and saturation function above, the following lemma can be verified.

Lemma 1. Suppose that the parameter $a_{b, i}, i = 1, \dots, n + p$ or state $x_{i}, i = 1, \dots, n$ are updated by discontinuous projection-type adaptation law represented below.

\hat{α} = pro j_{\hat{α}} (sa t_{{\overset{\cdot}{α}}_{\max}} (ζ))

(4)

With the proposed projection-type adaptation law (4), the estimated value of $α$ is always in a bounded region. To be specific, $a_{i, \min} \leq {\hat{a}}_{i} \leq a_{i, \max}, i = 1, \dots, p$ , $0 < b_{i, \min} \leq {\hat{b}}_{i} \leq b_{i, \max}, i = 1, \dots, n$ , $x_{i, \min} \leq {\hat{x}}_{i} \leq x_{i, \max}, i = 1, \dots, n$ . $x_{i, \min}$ and $x_{i, \max}$ , which are the upper and lower bounds for ${\hat{x}}_{i}$ can be derived according to the bounds of $a_{b}$ , $w$ , $v_{i}$ , and dynamic model (1). In addition, the adaptation rate is uniformly bounded by the preset limit as $| \overset{\cdot}{\hat{α}} | \leq {\overset{\cdot}{α}}_{\max}$ .

Dual adaptive robust control law

The last subsection, a discontinuous projection that ensures the boundedness of parameter and state estimation is designed. The parameter and state estimation algorithm for $a_{b}$ and $x$ are described in the next subsection. Under the discontinuous projection, the DARC control law for nonlinear system (1), which maintains stability while learning, is constructed based on the backstepping design procedure as follows.

To avoid the complex computation of the differential of virtual control law in backstepping design, the command filter technique has been used. We define the intermediate virtual control function vector $u_{d} = [u_{2, d} ({\hat{\underline{x}}}_{1}, \hat{a}, \hat{b}, t), \dots, u_{n, d} ({\hat{\underline{x}}}_{n}, \hat{a}, \hat{b}, t)]^{T}$ . $u_{d}$ is the input for $n - 1$ command filters defined below.

{\overset{\cdot}{u}}_{i, r} + ω_{i, c} u_{i, r} = u_{i, d} ({\hat{\underline{x}}}_{i}, \hat{a}, \hat{b}, t), i = 2, \dots, n

(5)

where $ω_{i, c}$ is the cutoff frequency for the above command filter and the intermediate virtual control function vector $u_{d}$ is designed in the following steps.

Remark 1. $| u_{i, r} - u_{i, d} ({\hat{\underline{x}}}_{i}, \hat{a}, \hat{b}, t) |, i = 2, \dots, n$ is bounded and exponential converges to the neighborhood of positive real number $ϵ_{i, u}, i = 2, \dots, n$ in the initial phase $t \in [0, T_{1}]$ .²⁷ In the post-initial phase $t > T_{1}$ , $| u_{i, r} - u_{i, d} ({\hat{\underline{x}}}_{i}, \hat{a}, \hat{b}, t) | \leq ϵ_{i, u}$ . The positive real number $ϵ_{i, u}$ can be chosen arbitrarily small by selecting $ω_{i, c}, i = 2, \dots, n$ properly.

Step 1. Define $u_{1, r} = x_{1 d}$ and ${\overset{\cdot}{u}}_{1, r} = {\overset{\cdot}{x}}_{1 d}$ . Consider the first formula of equation (1)

{\overset{\cdot}{x}}_{1} = Y_{1} ({\underline{x}}_{1}, t)^{T} a + b_{1} x_{2} + w_{1}

(6)

In equation (6), let $x_{2}$ be the virtual input, and we synthesize a virtual control law $u_{2, r}$ for $x_{2}$ such that $x_{1}$ will track the desired trajectory $x_{1 d}$ . $u_{2, r}$ can be derived from the following command filter.

{\overset{\cdot}{u}}_{2, r} + ω_{2, c} u_{2, r} = u_{2, d} ({\hat{\underline{x}}}_{1}, \hat{a}, \hat{b}, t)

(7)

$u_{2, d} ({\hat{\underline{x}}}_{1}, \hat{a}, \hat{b}, t)$ , the input of command filter, is designed as follows.

\begin{matrix} u_{2, d} ({\hat{\underline{x}}}_{1}, \hat{a}, \hat{b}, t) = u_{2, m} ({\hat{\underline{x}}}_{1}, \hat{a}, \hat{b}, t) + u_{2, s 1} ({\hat{\underline{x}}}_{1}, t) + u_{2, s 2} ({\hat{\underline{x}}}_{1}, t) \\ u_{2, m} ({\hat{\underline{x}}}_{1}, \hat{a}, \hat{b}, t) = \frac{1}{{\hat{b}}_{1}} ({\overset{\cdot}{u}}_{1, r} - Y_{1} {({\hat{\underline{x}}}_{1}, t)}^{t} \hat{a}) \\ u_{2, s 1} ({\hat{\underline{x}}}_{1}, t) = - \frac{1}{b_{1, \min}} η_{1, s 1} {\hat{z}}_{1} \end{matrix}

(8)

where $u_{2, m} ({\hat{\underline{x}}}_{1}, \hat{a}, \hat{b}, t)$ is the adjustable model compensation, ${\hat{\underline{x}}}_{1}, \hat{a}, \hat{b}$ are estimated by the learning mechanism in the next subsection, $u_{2, s 1} ({\hat{\underline{x}}}_{1}, t)$ is the linear feedback, $u_{2, s 2} ({\hat{\underline{x}}}_{1}, t)$ is the nonlinear robust feedback, $z_{1} = x_{1} - u_{1, r}$ is the tracking error, ${\hat{z}}_{1} = {\hat{x}}_{1} - u_{1, r}$ is the tracking error estimated by ${\hat{x}}_{1}$ , $η_{1, s 1} \geq 0$ is a positive constant, and $u_{2, s 2} ({\hat{\underline{x}}}_{1}, t)$ can be chosen as any function satisfies the following robust performance conditions.

\begin{matrix} condition 1 . z_{1} (Re z_{1} + b_{1} u_{2, s 2}) \leq ε_{1, t} \\ condition 2 . z_{1} u_{2, s 2} \leq 0 \end{matrix}

(9)

where $Re z_{1} = - Y_{1} ({\underline{x}}_{1}, t)^{T} \tilde{a} - {\tilde{b}}_{1} u_{2, m} + w_{1} + b_{1} (u_{2, r} - u_{2, d})$ , $u_{2, s 1} = u_{2, s 1} ({\hat{\underline{x}}}_{1}, t) |_{{\hat{\underline{x}}}_{1} = {\underline{x}}_{1}}$ , $u_{2, s 2} = u_{2, s 2} ({\hat{\underline{x}}}_{1}, t) |_{{\hat{\underline{x}}}_{1} = {\underline{x}}_{1}}$ , $u_{2, m} = u_{2, m} ({\hat{\underline{x}}}_{1}, \hat{a}, \hat{b}, t) |_{{\hat{\underline{x}}}_{1} = {\underline{x}}_{1}}$ , $u_{2, d} = u_{2, d} ({\hat{\underline{x}}}_{1}, \hat{a}, \hat{b}, t) |_{{\hat{\underline{x}}}_{1} = {\underline{x}}_{1}}$ , and $ε_{1, t}$ is a positive real number.

Define $z_{2} = x_{2} - u_{2, r}$ and ${\hat{z}}_{2} = {\hat{x}}_{2} - u_{2, r}$ , the error dynamics of $z_{1}$ becomes

\begin{matrix} {\overset{\cdot}{z}}_{1} = - Y_{1} ({\underline{x}}_{1}, t)^{T} \tilde{a} - {\tilde{b}}_{1} u_{2, m} + w_{1} \\ + b_{1} (u_{2, r} - u_{2, d}) + b_{1} u_{2, s 1} + b_{1} u_{2, s 2} + b_{1} z_{2} \\ = Re z_{1} + b_{1} u_{2, s 1} + b_{1} u_{2, s 2} + b_{1} z_{2} \end{matrix}

(10)

In equation (10), $- Y_{1} ({\underline{x}}_{1}, t)^{T} \tilde{a} - {\tilde{b}}_{1} u_{2, m}$ is related to the parameter uncertainties and $w_{1} + b_{1} (u_{2, r} - u_{2, d})$ is the non-parametric uncertainties. We can derive the boundedness of $| u_{2, r} - u_{2, d} |$ since $| u_{2, r} - u_{2, d} | \leq | u_{2, r} - u_{2, d} ({\hat{\underline{x}}}_{1}, \hat{a}, \hat{b}, t) | + | u_{2, d} ({\hat{\underline{x}}}_{1}, \hat{a}, \hat{b}, t) - u_{2, d} |$ . The boundedness of $| u_{2, r} - u_{2, d} ({\hat{\underline{x}}}_{1}, \hat{a}, \hat{b}, t) |$ can be obtained directly from Remark 1 and the boundedness of $| u_{2, d} ({\hat{\underline{x}}}_{1}, \hat{a}, \hat{b}, t) - u_{2, d} |$ can be obtained from Assumption 3 and the boundedness of the state estimation $x_{1}$ .

Remark 2. One design of $u_{2, s 2} ({\hat{\underline{x}}}_{1}, t)$ that satisfies the conditions of equation (9) is as below.

u_{2, s 2} ({\hat{\underline{x}}}_{1}, t) = - \frac{1}{4 b_{1, \min}} (\frac{h_{1, f 1}^{2}}{ε_{1, f 1}} + \frac{h_{1, f 2}^{2}}{ε_{1, f 2}}) {\hat{z}}_{1} - \frac{1}{4} \frac{h_{1, f 3}^{2}}{ε_{1, f 3}} {\hat{z}}_{1}

(11)

where $h_{1, f 1} \geq max (‖ {\underline{Y}}_{1} ‖) ‖ a_{b, \max} - a_{b, \min} ‖$ , $h_{1, f 2} \geq p_{1} (\underline{x}, t)$ , $h_{1, f 3} \geq | u_{2, r} - u_{2, d} |$ , ${\underline{Y}}_{1} = [| Y_{1} ({\underline{x}}_{1}, t) |^{T}, | u_{2, m} |, 0, \dots, 0]^{T} \in R^{p + n}$ , and $ε_{1, f 1}$ , $ε_{1, f 2}$ , $ε_{1, f 3}$ are positive constants. With equations (10) and (11), it can be shown

\begin{matrix} z_{1} (Re z_{1} + b_{1} u_{1, s 2}) \\ = z_{1} {- Y_{1} {({\underline{x}}_{1}, t)}^{T} \tilde{a} - {\tilde{b}}_{1} u_{1, m} + w_{1} + b_{1} (u_{2, r} - u_{2, d}) - \\ b_{1} [\frac{1}{4 b_{1, \min}} (\frac{h_{1, f 1}^{2}}{ε_{1, f 1}} + \frac{h_{1, f 2}^{2}}{ε_{1, f 2}}) z_{1} + \frac{1}{4} \frac{h_{1, f 3}^{2}}{ε_{1, f 3}}] z_{1}} \\ \leq - {(\frac{h_{1, f 1} | z_{1} |}{2 \sqrt{ε_{1, f 1}}} - \sqrt{ε_{1, f 1}})}^{2} + ε_{1, f 1} \\ - {(\frac{h_{1, f 2} | z_{1} |}{2 \sqrt{ε_{1, f 2}}} - \sqrt{ε_{1, f 2}})}^{2} + ε_{1, f 2} \\ - b_{1} {(\frac{h_{1, f 3} | z_{1} |}{2 \sqrt{ε_{1, f 3}}} - \sqrt{ε_{1, f 3}})}^{2} + b_{1} ε_{1, f 3} \\ \leq ε_{1, t} \end{matrix}

(12)

where $ε_{1, t} = ε_{1, f 1} + ε_{1, f 2} + b_{1} ε_{1, f 3}$ .

Step i. We will design a virtual control law $u_{i + 1, r}$ for $x_{i + 1}$ such that $x_{i}$ will track the designed virtual control law $u_{i, r}$ in step $i - 1$ exactly. The same design procedure in step 1 will be used again to construct DARC virtual control law. Define $z_{i} = x_{i} - u_{i, r}$ and ${\hat{z}}_{i} = {\hat{x}}_{i} - u_{i, r}$ . Then, the error dynamics of $z_{i}$ becomes

{\overset{\cdot}{z}}_{i} = Y_{i} ({\underline{x}}_{i}, t)^{T} a + b_{i} x_{i + 1} + w_{i} - {\overset{\cdot}{u}}_{i, r}

(13)

To avoid the complex computation in conventional adaptive backstepping control, we can use the designed command filter in step $i - 1$ to acquire the ${\overset{\cdot}{u}}_{i, r}$ . Similar to step 1, we can acquire the virtual control law $u_{i + 1, r}$ for $x_{i + 1}$ through the following command filter.

{\overset{\cdot}{u}}_{i + 1, r} + ω_{i + 1, c} u_{i + 1, r} = u_{i + 1, d} ({\hat{\underline{x}}}_{i}, \hat{a}, \hat{b}, t)

(14)

where $u_{i + 1, d} ({\hat{\underline{x}}}_{i}, \hat{a}, \hat{b}, t)$ is the input for command filter (14) designed as below,

\begin{matrix} u_{i + 1, d} ({\hat{\underline{x}}}_{i}, \hat{a}, \hat{b}, t) = u_{i + 1, m} ({\hat{\underline{x}}}_{i}, \hat{a}, \hat{b}, t) + u_{i + 1, s 1} ({\hat{\underline{x}}}_{i}, t) \\ + u_{i + 1, s 2} ({\hat{\underline{x}}}_{i}, t) \\ u_{i + 1, m} ({\hat{\underline{x}}}_{i}, \hat{a}, \hat{b}, t) = \frac{1}{{\hat{b}}_{i}} [{\overset{\cdot}{u}}_{i, r} - Y_{i} ({\hat{\underline{x}}}_{i}, t)^{T} \hat{a} - {\hat{b}}_{i - 1} {\hat{z}}_{i - 1}] \\ u_{i + 1, s 1} ({\hat{\underline{x}}}_{i}, t) = - \frac{1}{b_{i, \min}} η_{i, s 1} {\hat{z}}_{i} \end{matrix}

(15)

where $u_{i + 1, m} ({\hat{\underline{x}}}_{i}, \hat{a}, \hat{b}, t)$ is the adjustable model compensation, ${\hat{\underline{x}}}_{i}$ can be estimated by the learning mechanism in next subsection, $u_{i + 1, s 1} ({\hat{\underline{x}}}_{i}, t)$ is the linear feedback, $u_{i + 1, s 2} ({\hat{\underline{x}}}_{i}, t)$ is the nonlinear robust feedback, $η_{i, s 1} \geq 0$ is a positive constant, and $u_{i + 1, s 2} ({\hat{\underline{x}}}_{i}, t)$ can be chosen as any function that satisfies the following robust performance conditions.

\begin{matrix} condition 1 . z_{i} (Re z_{i} + b_{i} u_{i + 1, s 2}) \leq ε_{i, t} \\ condition 2 . z_{i} u_{i + 1, s 2} \leq 0 \end{matrix}

(16)

where $ε_{i, t}$ is a positive constant, $Re z_{i} = - (Y_{i} ({\underline{x}}_{i}, t)^{T} \tilde{a} + {\tilde{b}}_{i} u_{i + 1, m} + {\tilde{b}}_{i - 1} z_{i - 1}) + w_{i} + b_{i} (u_{i + 1, r} - u_{i + 1, d})$ , $u_{i + 1, d} = u_{i + 1, m} + u_{i + 1, s 1} + u_{i + 1, s 2}$ , $u_{i + 1, s 1} = u_{i + 1, s 1} ({\hat{\underline{x}}}_{i}, t) |_{{\hat{\underline{x}}}_{i} = {\underline{x}}_{i}}$ , $u_{i + 1, s 2} = u_{i + 1, s 2} ({\hat{\underline{x}}}_{i}, t) |_{{\hat{\underline{x}}}_{i} = {\underline{x}}_{i}}$ , and $u_{i + 1, m} = \frac{1}{{\hat{b}}_{i}} [{\overset{\cdot}{u}}_{i, r} - Y_{i} ({\underline{x}}_{i}, t)^{T} \hat{a}$ $- {\hat{b}}_{i - 1} z_{i - 1}]$ .

Define $z_{i + 1} = x_{i + 1} - u_{i + 1, r}$ , the dynamics of $z_{i}$ becomes

{\overset{\cdot}{z}}_{i} = Re z_{i} + b_{i} u_{i, s 1} + b_{i} u_{i, s 2} + b_{i} z_{i + 1} - b_{i - 1} z_{i - 1}

(17)

In equation (17), $- (Y_{i} ({\underline{x}}_{i}, t)^{T} \tilde{a} + {\tilde{b}}_{i} u_{i + 1, m} + {\tilde{b}}_{i - 1} z_{i - 1})$ is related to parametric uncertainties and $w_{i} + b_{i} ({\hat{u}}_{i + 1, r} - u_{i + 1, d})$ is the non-parametric uncertainties. Then, $u_{i + 1, s 2} ({\hat{\underline{x}}}_{i}, t)$ can be designed as Remark 2.

u_{i + 1, s 2} ({\hat{\underline{x}}}_{i}, t) = - \frac{1}{4 b_{i, m i n}} (\frac{h_{i, f 1}^{2}}{ε_{i, f 1}} + \frac{h_{i, f 2}^{2}}{ε_{i, f 2}}) {\hat{z}}_{i} - \frac{1}{4} \frac{h_{i, f 3}^{2}}{ε_{i, f 3}} {\hat{z}}_{i}

(18)

where $ε_{i, f 1}, ε_{i, f 2}$ , $ε_{i, f 3}$ are positive real numbers and $ε_{i, t} = ε_{i, f 1} + ε_{i, f 2} + b_{i} ε_{i, f 3}$ . $h_{i, f 1} \geq max (‖ {\underline{Y}}_{i} ‖) ‖ a_{b, \max} - a_{b, \min} ‖$ , $h_{i, f 2} \geq p_{i} (\underline{x}, t)$ , $h_{i, f 3} \geq | u_{i + 1, r} - u_{i + 1, d} |$ , ${\underline{Y}}_{i} = [| Y_{i} ({\underline{x}}_{1}, t) |^{T}, z_{i - 1}, 0, \dots, 0$ $| u_{i + 1, m} |, 0, \dots, 0]^{T} \in R^{p + n}$ , $ε_{i, f 1}, ε_{i, f 2}$ , $ε_{i, f 3}$ are positive real numbers and $ε_{i, t} = ε_{i, f 1} + ε_{i, f 2} + b_{i} ε_{i, f 3}$ .

Step n. This is the last step. Let $u = u_{n + 1, d} ({\hat{\underline{x}}}_{n}, \hat{a}, \hat{b}, t)$ be designed the same way as $u_{i + 1, d} ({\hat{\underline{x}}}_{i}, \hat{a}, \hat{b}, t)$ with $i = n$ .

Theorem 1. Considering the DARC control law $u = u_{n + 1, d} ({\hat{\underline{x}}}_{n}, \hat{a}, \hat{b}, t)$ and discontinuous type adaptation projection (4), all the signals of close loop system are bounded. Furthermore, the tracking errors of closed loop system are bounded by

‖ z (t) ‖^{2} \leq ‖ z (0) ‖^{2} e^{- 2 η_{bn} t} + \frac{ε_{bn}}{η_{bn}} (1 - e^{- 2 η_{bn} t})

(19)

where $z = [z_{1}, z_{2}, \dots, z_{n}]^{T}$ , $ε_{bn} = \sum_{i = 1}^{n} ε_{i, t}$ , and $η_{bn} = min (η_{1, s 1}, \dots, η_{n, s 1})$ . Thus, a prescribed transient performance can be guaranteed.

Proof. Define the Lyapunov function as

V_{bn} = \sum_{i = 1}^{n} z_{i}^{2}

(20)

Considering equations (10) and (17), the derivative of $V_{bn}$ is given by

\begin{matrix} {\overset{\cdot}{V}}_{bn} = 2 \sum_{i = 1}^{n} z_{i} {\overset{\cdot}{z}}_{i} \\ = 2 \sum_{i = 1}^{n} z_{i} (Re z_{i} + b_{i} u_{i + 1, s 1} + b_{i} u_{i + 1, s 2} + b_{i} z_{i + 1} - b_{i - 1} z_{i - 1}) \\ = 2 \sum_{i = 1}^{n} [z_{i} (Re z_{i} + b_{i} u_{i + 1, s 2}) + b_{i} z_{i} u_{i + 1, s 1}] \\ + b_{n} z_{n} z_{n + 1} - b_{0} z_{0} z_{1} \end{matrix}

(21)

where $z_{0}$ , $b_{0}$ , and $z_{n + 1}$ are defined equals to zero. Taking condition 1 of equations (9) and (16), and $u_{i + 1, s 1}$ into ${\overset{\cdot}{V}}_{bn}$ .

\begin{matrix} {\overset{\cdot}{V}}_{bn} \leq 2 \sum_{i = 1}^{n} (ε_{i, t} - \frac{b_{i}}{b_{i, \min}} η_{i, s 1} z_{i}^{2}) \\ \leq 2 ε_{bn} - 2 η_{bn} V_{bn} \end{matrix}

(22)

which leads to (19). In addition, the output tracking error $z_{1}$ can be made arbitrarily small by increasing $η_{bn}$ or decreasing $ε_{bn}$ . Thus, a prescribed transient performance is guaranteed. From (19), we obtain that $z$ is bounded. Considering Assumptions 3 and discontinuous projection (4), it is easy to obtain that $x_{1 d}$ , $x_{1}$ , ${\hat{a}}_{b}$ , and ${\hat{x}}_{1}$ are bounded. Therefore, the intermediate virtual control function $u_{1, d} ({\hat{\underline{x}}}_{1}, \hat{a}, \hat{b}, t)$ is bounded. Then we can ensure the boundedness of $u_{1, r}$ and ${\overset{\cdot}{u}}_{1, r}$ since we derive them from a stable low pass filter with a bounded input. It is easy to ensure the boundedness of $u_{i, r}$ for $i = 1, \dots, n$ recursively. Thus, all the signals of closed loop system are bounded.

Dual adaptive estimation mechanism

In the above subsection, we synthesize the dual adaptive control law to obtain a guaranteed transient performance for nonlinear systems with model uncertainties. In the design procedure, only $y_{1}$ , the measurement of state $x_{1}$ , is assumed accessible and both the parameter and state estimation error have been taken into consideration. This subsection introduces the learning mechanism called DAEM to estimate the unknown parameters and states with the BGF estimator and AUKF, respectively. Therefore, an improved tracking performance can be achieved with the learning process.

Bounded gain forgetting estimator

The essence of parameter estimation is to extract useful information from measured empirical data. A model which represents the relation between the parameters and data is required. The model for parameter estimation is not necessarily the same as the control system model. Let us assume that the uncertain nonlinearities $w_{i}, i = 1, \dots, n$ and $v_{1}$ are ignored, and $x$ is accessible. A conventional model for parameter estimation has been used as follows.

\overset{\cdot}{x} = {Φ_{f}}^{T} a_{b}

(23)

where $\overset{\cdot}{x} = [{\overset{\cdot}{x}}_{1}, \dots, {\overset{\cdot}{x}}_{n}] \in R^{n}$ is a output vector, and $Φ_{f} \in R^{(p + n) \times n}$ is the signal matrix described as below.

{Φ_{f}}^{T} = (\begin{matrix} {Y_{1}}^{T} & x_{2} & 0 \dots & 0 & 0 \\ {Y_{2}}^{T} & 0 & x_{3} \dots & 0 & 0 \\ ⋮ & ⋱ \\ {Y_{n - 1}}^{T} & 0 \dots & 0 & x_{n} & 0 \\ {Y_{n}}^{T} & 0 \dots & 0 & 0 & u \end{matrix})

(24)

The derivative of $x$ appears in equation (23). To avoid acquiring $\overset{\cdot}{x}$ , we can filter both sides of (23) by a stable low pass filter $H_{lf}$ ³¹ and rearrange the formula.

o = Φ^{T} a_{b}

(25)

where $o \in R^{n}$ , and $Φ \in R^{(p + n) \times n}$ . The estimation of parameters is computed by minimizing the target function

J = \int_{0}^{t} e^{\int_{τ}^{t} - λ (l) dl} ‖ o (τ) - Φ (τ)^{T} {\hat{a}}_{b} (t)) ‖^{2} d τ

(26)

where $λ > 0$ is the forgetting factor. Solving equation (26), we can get

\begin{matrix} {\hat{a}}_{b} & = - P Φ e \\ \overset{\cdot}{P} & = λ P - P Φ^{T} Φ P \\ {\overset{\cdot}{P}}^{- 1} & = - λ P^{- 1} + Φ^{T} Φ \end{matrix}

(27)

where $P$ is the gain matrix, $e = Φ^{T} {\hat{a}}_{b} - o$ , and $P (0)$ can be chosen as a positive definite matrix. Exponential forgetting of data is a very effective way to handle time-varying parameters. However, if the matrix signal $Φ$ is not persistently exciting,³² $P^{- 1}$ will be diminishing and the gain matrix will go unbounded. In order to avoid the unboundedness of the gain matrix, a tuning technique is designed as

λ (t) = λ_{0} (1 - \frac{‖ P (t) ‖}{P_{0}})

(28)

where $λ_{0} > 0$ is the maximum value for $λ$ and $P_{0} > 0$ is upbound for the norm of the gain matrix $P$ . If the signal $Φ$ is strong persistently excitation which means $‖ P ‖$ will be small and $λ$ will be larger, then we will have a faster forgetting speed which means strong ability to track the time-varying parameters. If the signal $Φ$ is not persistently exciting and $‖ P ‖$ reaches the upbound of $P_{0}$ , then the forgetting process will suspend.

Remark 3. The gain matrix $P$ and estimation error ${\tilde{a}}_{b}$ in BGF are upper bounded.¹ Moreover, if $Φ$ is persistently exciting, $a_{b}$ converges to its true value exponentially.

Theorem 2. Suppose the non-parametric uncertainties $w_{i} = 0, i = 1, \dots, n$ , $v_{1} = 0$ , and all states $x$ can be accessible directly. If the regressor $Φ$ satisfies the persistently exciting condition, with control law $u = u_{n + 1, d} ({\hat{\underline{x}}}_{n}, \hat{a}, \hat{b}, t) |_{{\hat{\underline{x}}}_{n} = {\underline{x}}_{n}}$ , discontinuous projection (4), and BGF estimator (27), tracking error $z_{1}$ will asymptotically converge to zero after the initial phase in Remark 1.

Proof. Using the same Lyapunov function $V_{bn}$ and taking $v_{i} = 0$ , $w_{i} = 0$ , $\hat{x} = x$ , $u = u_{n + 1, d}$ into equation (21).

\begin{matrix} {\overset{\cdot}{V}}_{bn} = 2 \sum_{i = 1}^{n} [z_{i} (Re z_{i} + b_{i} u_{i + 1, s 2}) + b_{i} z_{i} u_{i + 1, s 1}] \\ = 2 \sum_{i = 1}^{n} {z_{i} [- ({Y_{i}}^{T} \tilde{a} + {\tilde{b}}_{i} u_{i + 1, m} + {\tilde{b}}_{i - 1} z_{i - 1})] \\ + b_{i} u_{i, s 2} z_{i} - \frac{b_{i}}{b_{i, \min}} η_{i, s 1} z_{i}^{2} + \\ b_{i} (u_{i + 1, r} - u_{i + 1, d}) z_{i}} \end{matrix}

(29)

Since the regressor $Φ$ satisfies the persistently exciting condition, we can derive that $\tilde{a} \to 0$ , ${\tilde{b}}_{i} \to 0, i = 1, \dots n$ as $t \to \infty$ . Consider Remark 1 and $\hat{x} = x$ , we know $| (u_{i + 1, r} - u_{i + 1, d}) | < ε_{i, u}$ for $\forall ε_{i, u}$ after initial phase. And we suppose $ϵ_{i, u} \leq η_{i, s 2} | z_{i} |$ . Taking condition 2 of (9)and (16) into (29).

\begin{matrix} {\overset{\cdot}{V}}_{bn} \leq 2 \sum_{i = 1}^{n} - b_{i} η_{i} z_{i}^{2} \\ \leq 0 \end{matrix}

(30)

where $η_{i} = \frac{η_{i, s 1}}{b_{i, \min}} - η_{i, s 2}$ , we can guarantee $η_{i} > 0$ by selecting $η_{i, s 1}$ properly. It is easy to verify that $\overset{\cdot}{\tilde{a}}$ , $\overset{\cdot}{{\tilde{b}}_{i}}$ , and ${\overset{\cdot}{z}}_{i}$ are bounded from Lemma 1 and Theorem 1 which leads to the boundedness of ${\overset{\cdot\cdot}{V}}_{bn}$ . Since ${\overset{\cdot}{V}}_{bn} \leq 0$ and ${\overset{\cdot\cdot}{V}}_{bn}$ is bounded, we can obtain ${\overset{\cdot}{V}}_{bn} \to 0$ as $t \to \infty$ with Barbalats Lemma. Therefore, the tracking error is asymptotically converging to zero.

Adaptive unscented Kalman filter

State estimation is an indispensable part of control engineering. UKF is a popular method to estimate states from noise measurements for nonlinear systems with higher accuracy and is easier to implement than EKF. However, the performance of the UKF method suffers from a lack of precise statistical information. To improve the estimation accuracy of UKF, the AUKF method with a statistics estimator based on the MAP rule is proposed. For simplicity, the dynamic system (1) can be written as the following form.

{\begin{matrix} \overset{\cdot}{x} = f (x, u, t) + w \\ Y (t) = h (x, t) + V \end{matrix}

(31)

where $f$ is the nonlinear dynamics with parameter $a_{b}$ and is assumed to be known in this subsection. The values of variables are taken at each discrete time $k T_{s}$ where $T_{s}$ is the sampling period. For convenience, the subscript $k$ represents the $kth$ sampling value of a variable. Let us consider the UKF method first.⁹

Initialization

The initial values of state expectation $\hat{x} (0 | 0) = E [x (0)]$ and covariance $Z_{xx} (0 | 0) = E [(x (0) - x (0 | 0)) (x (0) - x (0 | 0))^{T}]$ are supposed to be known.

Prior estimation

At step $k + 1$ , post estimation of state $\hat{x} (k | k) = E [x (k) | y (1), \dots, y (k)]$ and covariance $Z_{xx} (k | k) = E [(x (k) - \hat{x} (k | k)) (x (k) - \hat{x} (k | k))^{T}]$ are already calculated. The sigma points are generated by,

\begin{array}{l} χ (k | k) = [\hat{x} (k | k), \hat{x} (k | k) \\ - \sqrt{(n + γ) Z_{x x} (k | k)}, \hat{x} (k | k) \\ + \sqrt{(n + γ) Z_{x x} (k | k)}] \end{array}

(32)

where $χ (k | k) \in R^{n \times (2 n + 1)}$ , $χ^{i} (k | k)$ is the $ith$ column of $χ (k | k)$ which represents $ith$ sigma point, $\sqrt{(n + γ) Z_{xx} (k | k)}$ is the Cholesky fraction of $(n + γ) Z_{xx} (k | k)$ , and $γ = ζ^{2} (n + κ) - n$ is a scaling factor. The parameter $ζ$ , $0 < ζ < 1$ , determines the spread of sigma points and is usually set to a small number. $κ \geq 0$ is the other parameter which guarantees the positive semi-definite of covariance matrix. Then, each of these generated sigma points are updated by the nonlinear function $f$ .

χ^{i} (k + 1 | k) = f (χ^{i} (k | k)), i = 1, \dots, 2 n + 1

(33)

The prior estimation is given by

\begin{matrix} \hat{x} (k + 1 | k) = \sum_{i = 1}^{2 n + 1} w_{m}^{i} χ^{i} (k + 1 | k) \\ Z_{xx} (k + 1 | k) = \sum_{i = 1}^{2 n + 1} {w_{z}^{i} (χ^{i} (k + 1 | k) \\ - \hat{x} (k + 1 | k)) (χ^{i} (k + 1 | k) - \hat{x} (k + 1 | k))^{T}} + w (k) \end{matrix}

(34)

where $w_{m}^{i}$ , $w_{z}^{i}$ are defined as

\begin{matrix} w_{m}^{1} = \frac{γ}{γ + n} \\ w_{z}^{1} = \frac{γ}{γ + n} + (1 - ζ^{2} + μ) \\ w_{m}^{i} = w_{z}^{i} = \frac{1}{2 (γ + n)} i = 2, \dots, 2 n + 1 \end{matrix}

(35)

where $μ > 0$ is related to the prior knowledge of distribution of $x$ and $μ = 2$ is optimal for Gaussian distribution.¹⁵ Then, each sigma point of $χ (k + 1 | k)$ is propagated through the measurement function $h$ .

ϒ^{i} (k + 1 | k) = h (χ^{i} (k + 1 | k)), i = 1, \dots, 2 n + 1

(36)

The prior estimation of $y$ , covariance matrix $Z_{yy} (k + 1 | k)$ and $Z_{xy} (k + 1 | k)$ can be calculated as

\begin{matrix} \hat{y} (k + 1 | k) = \sum_{i = 1}^{2 n + 1} w_{m}^{i} ϒ^{i} (k + 1 | k) \\ Z_{yy} (k + 1 | k) = \sum_{i = 1}^{2 n + 1} {w_{z}^{i} (ϒ^{i} (k + 1 | k) - \hat{y} (k + 1 | k)) (ϒ^{i} (k + 1 | k) - \hat{y} (k + 1 | k))^{T}} + V (k) \\ Z_{xy} (k + 1 | k) = \sum_{i = 1}^{2 n + 1} {w_{z}^{i} (ϒ^{i} (k + 1 | k) - \hat{x} (k + 1 | k)) (ϒ^{i} (k + 1 | k) - \hat{y} (k + 1 | k))^{T}} \end{matrix}

(37)

Post estimation

With the prior estimation, the Kalman gain is acquired by

G (k + 1) = Z_{xy} (k + 1 | k) Z_{yy} (k + 1 | k)^{- 1}

(38)

Finally, the post estimation of $x$ and covariance matrix can be obtained.

\begin{matrix} \hat{x} (k + 1 | k + 1) = \hat{x} (k + 1 | k) + G (k + 1) (Y - \hat{y} (k + 1 | k)) \\ Z_{xx} (k + 1 | k + 1) = Z_{xx} (k + 1 | k) \\ - G (k + 1) Z_{yy} (k + 1 | k) G (k + 1)^{T} \end{matrix}

(39)

Since the UKF is a modified Kalman filter, some prior knowledge as $\hat{x} (0 | 0)$ , $Z_{xx} (0 | 0)$ , $W$ , $V$ should be known precisely. The influence of initial condition $\hat{x} (0 | 0)$ , $Z_{xx} (0 | 0)$ will decrease as more data get involved. The process covariance $W$ and measurement covariance $V$ will affect the precision of UKF as the state estimation is in progress. However, the accurate values of $W$ and $V$ are usually hard to acquire. Therefore, the AUKF with a statistic estimator for process and measurement covariance is proposed.

Suppose the values of $W$ and $V$ are unknown. The MAP estimator is aiming at finding the $\hat{W}$ , $\hat{V}$ and $\hat{x} (i | l), i = 1, \dots, l$ maximizing the objective function below.

J_{a} = p [\bar{x} (l), W, V | \bar{y} (l)]

(40)

where $p [\bar{x} (l), W, V | \bar{y} (l)]$ is the conditional density fuction, $\bar{x} (l) = [x (0), \dots, x (l)]$ , and $\bar{y} (l) = [y (0), \dots, y (l)]$ . Since $p (\bar{y} (l))$ is unrelated to $\underset{\hat{w}, \hat{V}, \hat{x} (i | l)}{\arg max} J_{a}$ , the estimator can be calculated by maximum the new objective function

\begin{matrix} J_{b} = p [\bar{x} (l), W, V, \bar{y} (l)] \\ = p [\bar{y} (l) | \bar{x} (l), W, V] p [\bar{x} (l) | W, V] p [W, V] \\ = C e^{{- \frac{1}{2} [\sum_{i = 1}^{l} ‖ x (i) - f (x (i - 1)) ‖_{W^{- 1}} + ‖ z (i) - h (x (i)) ‖_{V^{- 1}}]}} \end{matrix}

(41)

where $C = ‖ W ‖^{- \frac{l}{2}} ‖ V ‖^{- \frac{l}{2}} \frac{1}{{(2 π)}^{n (l + 1) / 2 + ml / 2}} ‖ Z_{xx} (0 | 0) ‖^{- \frac{1}{2}}$ $e^{- \frac{1}{2} ‖ x (0) - \hat{x} (0) ‖_{Z_{xx} {(0 | 0)}^{- 1}}} p [W, V]$ , $‖ V ‖_{M}^{2} = V^{T} Mv$ . For simplicity, we view $W$ and $V$ as Gaussian distributions above.

Note that the extreme points of $J_{b}$ are the same as $\ln (J_{b})$ , taking the derivative of $\ln (J_{b})$ .

\frac{\partial \ln (J_{b})}{\partial W} = 0, \frac{\partial \ln (J_{b})}{\partial V} = 0

(42)

Solving equation (42) based on Zhao et al.,³³ we obtain the MAP statistic estimator as

\begin{matrix} \hat{W} (l) = \frac{1}{l} \sum_{i = 1}^{l} [\hat{x} (i | l) - \hat{f} (\hat{x} (i - 1 | l))] [\hat{x} (i | l) - \hat{f} (\hat{x} (i - 1 | l))]^{T} \\ \hat{V} (l) = \frac{1}{l} \sum_{i = 1}^{l} [y (i) - \hat{h} (\hat{x} (i - 1 | l))] [y (i) - \hat{h} (\hat{x} (i - 1 | l))]^{T} \end{matrix}

(43)

To avoid the computation complexity of $x (i - 1 | l)$ , $x (i | l)$ , we use $x (i | i - 1)$ , $x (i | i)$ , $x (i - 1 | i - 1)$ instead.

\begin{matrix} \hat{W} (l) = \frac{1}{l} \sum_{i = 1}^{l} [\hat{x} (i | i) - \hat{f} (\hat{x} (i - 1 | i - 1))] [\hat{x} (i | i) - \hat{f} (\hat{x} (i - 1 | i - 1))]^{T} \\ \hat{V} (l) = \frac{1}{l} \sum_{i = 1}^{l} [y (i) - \hat{h} (\hat{x} (i | i - 1))] [y (i) - \hat{h} (\hat{x} (i | i - 1))]^{T} \end{matrix}

(44)

where $\hat{f} (\hat{x} (i - 1 | i - 1)$ is the posterior mean of $\hat{x} (i - 1 | i - 1)$ transformed by nonlinear function $f$ , can be calculated by the unscented transform as

\hat{f} (\hat{x} (i - 1 | i - 1)) = \sum_{j = 1}^{2 n + 1} w_{m}^{j} f (χ^{j} (i - 1 | i - 1))

(45)

Similarly,

\hat{h} (\hat{x} (i | i - 1)) = \sum_{j = 1}^{2 n + 1} w_{m}^{j} h (χ^{j} (i | i - 1))

(46)

For the purpose of easy implementation, the recursive formula of equation (44) can be written as

\begin{matrix} \hat{W} (l) = \frac{l - 1}{l} W (l - 1) \\ + \frac{1}{l} [\hat{x} (l | l) - \hat{x} (l | l - 1)] [\hat{x} (l | l) - \hat{x} (l | l - 1)]^{T} \\ \hat{V} (l) = \frac{l - 1}{l} V (l - 1) \\ + \frac{1}{l} [y (l) - \hat{y} (l | l - 1)] [y (l) - \hat{y} (l | l - 1)]^{T} \end{matrix}

(47)

Simulation example

Simulations of the following second-order nonlinear system with model uncertainties are carried out to evaluate the performance of the proposed DARC. The dynamic model of the system, which is often used to represent the servo motor,³⁴ is described as

{\begin{matrix} {\overset{\cdot}{x}}_{1} = x_{2} \\ {\overset{\cdot}{x}}_{2} = \frac{1}{b_{1}} u - a_{1} {\overset{\cdot}{x}}_{1} - a_{2} S ({\overset{\cdot}{x}}_{1}) + a_{3} + w_{1} \\ y = x_{1} + v_{1} \end{matrix}

(48)

where $x_{1}$ and $x_{2}$ represent unknown states, $a_{1}$ , $a_{2}$ , $a_{3}$ , and $b_{1}$ are unknown parameters, $w_{1}$ and $v_{1}$ are the uncertain nonlinearities which are set to truncated Gaussian noise, and $S ({\overset{\cdot}{x}}_{1}) = \tanh (1000 {\overset{\cdot}{x}}_{1})$ . $a_{1}$ , $a_{2}$ , $a_{3}$ , $b_{1}$ , $w_{1}$ , and $v_{1}$ are confined to a known region as below.

\begin{matrix} a_{1} \in [0.1, 0.35], a_{2} \in [0.05, 0.15], a_{3} \in [- 2, 2] \\ b_{1} \in [0.025, 0.085], w_{1} \in [- 0.35, 0.35] \\ v_{1} \in [0.0001, 0.0001] \end{matrix}

(49)

The desired trajectory is $x_{1 d} = 0.2 \sin (0.5 π t)$ . To verify the effectiveness of the proposed method, the indirect adaptive control with nonlinear tracking differentiator (IARC-NTD)^31,35 is regarded as the comparative object. The initial value and true value of the parameters in the simulation example are the same for referred two methods as Table 1 shown. All the design parameters have been tuned carefully for both methods. Simulations of three different scenarios have been carried out. In case 1, the unknown parameter $a_{3}$ is a constant. To observe the response of proposed methods to variation of parameters, the unknown parameter $a_{3}$ is supposed to change suddenly at $8 s$ and $16 s$ in case $2$ and change with slow time-varying signal $1 + 0.05 \sin (0.0625 π t)$ in case $3$ . Several error indexes are used to evaluate the results.

\begin{matrix} z_{1, rms} = \frac{1}{T_{f}} \int_{0}^{T_{f}} {(z_{1})}^{2} dt, z_{1, \max} = \max {| z_{1} |}_{0 < t < T_{f}} \\ ε_{2, rms} = \frac{1}{T_{f}} \int_{0}^{T_{f}} {(ε_{2})}^{2} dt, ε_{2, \max} = \max {| ε_{2} |}_{0 < t < T_{f}} \end{matrix}

(50)

where $z_{1} = x_{1} - x_{1 d}$ and $ε_{2} = {\hat{x}}_{2} - x_{2}$ , and $T_{f}$ is the total simulation running time.

Table 1.

Initial and true value of parameters.

Parameter	Initial value	True value
$b_{1}$	$0.055$	$0.025$
$a_{1}$	$0.1$	$0.1$
$a_{2}$	$0.05$	$0.15$
$a_{3}$	$0$	Case 1: 1 $1, t < 8$ Case 2: $1, t \geq 16$ $- 1, else$ Case 3: $1 + 0.05 \sin (0.0625 π t)$

Figure 2 and Table 2 show that DARC achieves a higher tracking accuracy. Figure 3 and Table 2 indicate that our method is more accurate and reliable for the estimation of $x_{2}$ , especially the transient phase of the system. As can be seen in Figure 4, all the estimation values of parameters converge to their true values fast. Figure 5 and Table 2 show that DARC achieves a higher tracking accuracy even sudden changes of $a_{3}$ occur. The superiority is more remarkable at the time the sudden variation of parameter $a_{3}$ happens. Figure 6 and Table 2 indicate that DARC obtains a higher accuracy for state estimation in case 2. Both Figures 5 and 6 indicate that DARC is more robust to the unpredictable change of parameters. We can see from Figure 7 that when sudden changes of $a_{3}$ occur, parameters can converge to their true values after a short period of the learning process. Figure 8 and Table 2 show the tracking performance of DARC is better when the parameter $a_{3}$ changes with the sinusoid signal. Figure 9 and Table 2 indicate that DARC achieves a better the state estimation accuracy of $x_{2}$ even the parameter of $a_{3}$ is changing continuously. Figure 10 shows that the parameter estimation accuracy of both methods is degraded slightly compared with case 1. In general, the DARC algorithm shows strong robustness in presence of unpredictable disturbances and time-varying parameters. Also, high tracking accuracy is achieved in different scenarios due to the precise estimation of parameters and unknown states.

Figure 2.

Reponse and tracking error of case 1: (a) System response, (b) Control input, and (c) Tracking error.

Table 2.

Performances of comparative experiments.

Case	Algorithm	$z_{1, rms}$	$z_{1, \max}$	$ε_{2, rms}$	$ε_{2, \max}$
1	IARC-NTD DARC	$8.8299 \times 10^{- 5}$	$1.0157 \times 10^{- 3}$	0.0475	0.3344
1	IARC-NTD DARC	$4.4429 \times 10^{- 5}$	$5.6668 \times 10^{- 4}$	0.0357	0.1538
2	IARC-NTD DARC	$3.6292 \times 10^{- 4}$	$2.3972 \times 10^{- 3}$	0.0693	0.3443
2	IARC-NTD DARC	$1.6838 \times 10^{- 4}$	$1.0192 \times 10^{- 3}$	0.0392	0.2522
3	IARC-NTD DARC	$8.8771 \times 10^{- 5}$	$1.0105 \times 10^{- 3}$	0.0464	0.3665
3	IARC-NTD DARC	$4.4530 \times 10^{- 5}$	$6.5007 \times 10^{- 4}$	0.0362	0.1620

Figure 3.

The estimation error of state $x_{2}$ of case 1.

Figure 4.

The estimation of parameters of case $1$ : (a) Estimation of b₁, (b) Estimation of a₁, (c) Estimation of a₂, and (d) Estimation of a₃.

Figure 5.

Reponse and tracking error of case 2: (a) System response, (b) Control input, and (c) Tracking error.

Figure 6.

The estimation error of state $x_{2}$ of case 2.

Figure 7.

The estimation of parameters of case 2: (a) Estimation of b₁, (b) Estimation of a₁, (c) Estimation of a₂, and (d) Estimation of a₃.

Figure 8.

Reponse and tracking error of case 3: (a) System respone, (b) Control input, and (c) Tracking error.

Figure 9.

The estimation error of state $x_{2}$ of case 3

Figure 10.

The estimation of parameters of case 3: (a) Estimation of b₁, (b) Estimation of a₁, (c) Estimation of a₂, and (d) Estimation of a₃.

Conclusions

This work proposes a dual adaptive robust control (DARC) design for nonlinear systems with unknown parameters and states. The DARC has intelligently integrated the deterministic robust control (DRC) philosophy and the dual adaptive estimation mechanism (DAEM) with a discontinuous projection. Then both stability of the whole system and a prescribed performance can be guaranteed. Also, the command filter technique is used to avoid the complex derivative calculation of virtual control law in the backstepping procedure. The DAEM consisted of the bounded gain forgetting (BGF) estimator and the adaptive unscented Kalman filter (AUKF) has been synthesized to improve the performance by accurately estimating parameters and states. The BGF estimator has a precise estimation of parameters even the parametric variation exists. The AUKF method with the MAP statistic estimator is developed to obtain a precise state estimation without knowing the covariance matrix. Therefore, not only good tracking accuracy but also precise parameter and state estimation can be achieved. Simulation results have been shown that the proposed method can achieve a desired level of performance in various complex working conditions.

Footnotes

Declaration of conflicting interests

The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Funding

The author(s) received no financial support for the research, authorship, and/or publication of this article.

ORCID iD

Ye Chen

Data availability statement

Data sharing not applicable to this article as no datasets were generated or analyzed during the current study.

References

Slotine

JJE

. Applied nonlinear control. Englewood Cliffs, NJ: Prentice Hall, 1991.

Simon

. Adaptive filter theory. Noida, NCR: Pearson Education India, 2008.

Chong

Nešić

Postoyan

, et al. Parameter and state estimation of nonlinear systems using a multi-observer under the supervisory framework. IEEE Trans Autom Control 2015; 60(9): 2336–2349.

Gong

Gao

Kou

. Parameter and state of charge estimation simultaneously for lithium-ion battery based on improved open circuit voltage estimation method. Energy Technol 2021; 9(9): 2100235.

Åström

Wittenmark

. Adaptive control. Mineola, NY: Courier Corporation, 2013.

Hou

Xiong

. On model-free adaptive control and its stability analysis. IEEE Trans Autom Control 2019; 64(11): 4555–4569.

Ortega

Nikiforov

Gerasimov

. On modified parameter estimators for identification and adaptive control. a unified framework and some new schemes. Ann Rev Control 2020; 50: 278–293.

Huang

. Indirect adaptive robust control of nonstrict feedback nonlinear systems by a fuzzy approximation strategy. ISA Trans 2021; 108: 10–17.

Julier

Uhlmann

. New extension of the kalman filter to nonlinear systems. In: Kadar

(ed.) Signal processing, sensor fusion, and target recognition VI, vol. 3068. Orlando, FL: International Society for Optics and Photonics,1997, pp. 182–193.

10.

Liu

Wang

Chen

, et al. Protocol-based unscented kalman filtering in the presence of stochastic uncertainties. IEEE Trans Autom Control 2019; 65(3): 1303–1309.

11.

Cui

Wang

, et al. A novel switching unscented kalman filter method for remaining useful life prediction of rolling bearing. Measurement 2019; 135: 678–684.

12.

Afri

Andrieu

Bako

, et al. State and parameter estimation: a nonlinear luenberger observer approach. IEEE Trans Autom Control 2016; 62(2): 973–980.

13.

Reina

Messina

. Vehicle dynamics estimation via augmented extended kalman filtering. Measurement 2019; 133: 383–395.

14.

Zerdali

. A comparative study on adaptive ekf observers for state and parameter estimation of induction motor. IEEE Trans Energy Convers 2020; 35(3): 1443–1452.

15.

Wan

Van Der Merwe

. The unscented kalman filter for nonlinear estimation. In: Proceedings of the IEEE 2000 Adaptive systems for signal processing, communications, and control symposium (Cat. No. 00EX373), Lake Louise, AB, Canada, 2000, pp. 153–158. IEEE.

16.

Gao

Zhong

, et al. Unscented kalman filter with process noise covariance estimation for vehicular ins/gps integration system. Inf Fusion 2020; 64: 194–204.

17.

Biswas

Kollmeyer

, et al. Simultaneous state and parameter estimation of li-ion battery with one state hysteresis model using augmented unscented kalman filter. In: 2018 IEEE transportation electrification conference and expo (ITEC), Long Beach, CA, USA, 2018, pp. 1065–1070. IEEE.

18.

Impraimakis

Smyth

. An unscented kalman filter method for real time input-parameter-state estimation. Mech Syst Signal Process 2022; 162: 108026.

19.

Partovibakhsh

Liu

. An adaptive unscented kalman filtering approach for online estimation of model parameters and state-of-charge of lithium-ion batteries for autonomous mobile robots. IEEE Trans Control Syst Technol 2014; 23(1): 357–363.

20.

Singh

Pal

Jain

. A novel adaptive ukf-based state estimation algorithm for spark-ignition engines. In: 2021 European control conference (ECC), Online, 2021, pp. 854–859. IEEE.

21.

Lin

Tang

Ren

, et al. State of charge estimation with the adaptive unscented kalman filter based on an accurate equivalent circuit model. J Energy Storage 2021; 41: 102840.

22.

Yao

Tomizuka

. Adaptive robust control of siso nonlinear systems in a semi-strict feedback form. Automatica 1997; 33(5): 893–900.

23.

Chen

Tao

Liu

. High precision adaptive robust neural network control of a servo pneumatic system. Appl Sci 2019; 9(17): 3472.

24.

Zhang

Wang

, et al. Adaptive sliding mode robust control of manipulator driven by tendon-sheath based on HJI theory. Meas Control 2022; 55: 684–702.

25.

Zinober

. Deterministic control of uncertain systems. In: Proceedings of the ICCON IEEE international conference on control and applications, Peter Peregrinus, London, UK, 1989, pp. 645–650. IEEE.

26.

, et al. Robust precision motion control of piezoelectric actuators using fast nonsingular terminal sliding mode with time delay estimation. Meas Control 2019; 52(1–2): 11–19.

27.

Dong

Farrell

Polycarpou

, et al. Command filtered adaptive backstepping. IEEE Trans Control Syst Technol 2011; 20(3): 566–580.

28.

Yang

Deng

Yao

. Disturbance-observer-based adaptive command filtered control for uncertain nonlinear systems. ISA Trans 2022; 130: 490–499.

29.

Chen

Zhao

Zhen

, et al. Adaptive robust control for a lower limbs rehabilitation robot running under passive training mode. IEEE/CAA J Autom Sin 2019; 6(2): 493–502.

30.

Chen

Zou

. Adaptive robust control of soft bending actuators: an empirical nonlinear model-based approach. J Zhejiang Univ Sci A 2021; 22(9): 681–694.

31.

Mohanty

Yao

. Indirect adaptive robust control of hydraulic manipulators with accurate parameter estimates. IEEE Trans Control Syst Technol 2010; 19(3): 567–575.

32.

Barabanov

Ortega

. On global asymptotic stability of

\overset{\cdot}{x}

- ϕ

(t)

ϕ^{T}

(t) x with

ϕ

not persistently exciting. Syst Control Lett 2017; 109: 24–29.

33.

Zhao

Wang

, et al. Design of adaptive robust square-root cubature kalman filter with noise statistic estimator. Appl Math Comput 2015; 256: 352–367.

34.

Zhao

. Indirect adaptive robust control of nonlinear systems with time-varying parameters in a strict feedback form. Int J Robust Nonlinear Control 2018; 28(13): 3835–3851.

35.

Chen

Zong

Tang

, et al. Design of rapid exponential integral nonlinear tracking differentiator. Int J Control 2022; 95(7): 1759–1766.

A dual adaptive robust control for nonlinear systems with parameter and state estimation

Abstract

Keywords

Introduction

Problem formulation

Dual adaptive robust control

A projection type adaptation law

Dual adaptive robust control law

Dual adaptive estimation mechanism

Bounded gain forgetting estimator

Adaptive unscented Kalman filter

Initialization

Prior estimation

Post estimation

Simulation example

Conclusions

Footnotes

Declaration of conflicting interests

Funding

ORCID iD

Data availability statement

References