For discrete-time multi-agent systems with random switching nonlinear linking and exogenous disturbances, the disturbance rejection problem is studied and a sufficient condition is presented using the Lyapunov function. In an example of five agents with pinning control, the condition is adopted to optimize disturbance rejection. A numerical simulation shows that the optimization is effective.
Multiagent (multi-robot) systems play an important role in formation control, flocking, and synchronization. For all kinds of multiagent systems, the consensus problem has received much attention1–6 in terms of designing neighbor-based feedback protocols (control rules) for all agents to achieve synchronization. In the last 15 years, most consensus research results have been obtained for linear multiagent systems.7 In recent years, however, consensus protocol designs have been developed for nonlinear multiagent systems using internal model methods. These designs include the local distributed regulator design,8 the semi-global consensus design,9,10 and the global consensus design.11,12
All the above works consider multiagent systems without disturbance. In fact, multiagent systems always suffer from exogenous disturbances. It is necessary to deal with both the consensus and the disturbance. For this reason, the disturbance rejection problem of multiagent systems has attracted interest from a number of researchers. For first-order multiagent systems with external disturbances on fixed and switching directed topologies, disturbance rejection conditions have been presented using control theory.13 For leader–follower multiagent systems consisting of first-order followers and a second-order leader subjected to measurement noise, a velocity decomposition technique has been addressed14 to design the neighbor-based tracking protocol together with distributed estimators. For high-order multiagent systems with external disturbances on switching undirected topologies, the Schur orthogonal transformation and common Lyapunov function method have been adopted15 to reject disturbances. By constructing a suitable Lyapunov–Krasovskii function and taking the reciprocally convex approach, the disturbance rejection problem of multiagent systems with a communication delay has been tackled.16 For time-varying multiagent systems subject to energy-bounded external disturbances, the disturbance rejection problem over a finite horizon has been considered and a constrained recursive Riccati difference equation approach has been proposed to codesign the time-varying controller and estimator parameters in the framework of an event-based scheme.17 The multiagent systems investigated in the cited studies13–17 can be seen to be linear. In the last few years, results have been obtained for the disturbance rejection of nonlinear multiagent systems as follows. A robust consensus tracking problem for an integrator-type multiagent system was addressed by Hu18 in the presence of disturbances and nonlinear unmodeled dynamics. For a class of Lipschitz multiagent systems subject to external disturbances, a two-step algorithm19 was presented to achieve global consensus with a guaranteed performance. Sufficient conditions were established for the disturbance rejection of nonlinear multiagent systems with intermittent information transmissions.20 A sliding mode control-based algorithm21 was proposed to solve the finite-time consensus tracking problem for nonlinear multiagent systems with external disturbances. Finally, the effect of inherent unmodeled disturbances has been considered for nonlinear multiagent systems, and a reduced-order observer-based consensus protocol has been developed.22 The disturbance rejection problem of nonlinear multiagent systems is also studied in the present article. Unlike the nonlinear multiagent systems whose uncertainties arise in the inherent dynamics of each agent in the above references,18–22 the model uncertainties in the present article arise in the linking topology of the multiagent system. In addition, the linking topologies are fixed in the above references,18–22 while the linking topology is assumed to be randomly varying in the present article.
The simplest way to make a multiagent system have the desired behavior is controlling each agent directly. However, for a multiagent system comprising many agents, the direct control of each agent is uneconomical and even impossible in practice. Because an agent is usually connected with other agents in a multiagent system, directly controlling agent A affects the behavior of each agent that has relations with agent A. By directly controlling for “key agents,” the desired behavior of a multiagent system can also be achieved under some conditions. This is the so-called pinning control.23 Pinning control is clearly easy to implement in engineering and has thus become an important control strategy for multiagent systems. Of course, in multiagent systems with pinning control, exogenous disturbances exist and divert each agent. For continuous-time multiagent systems with fixed linear couplings which have no uncertainties, disturbance rejection was studied24 in the framework of pinning control. Seeing that digital control and digital communication are used practically in multiagent systems, the discrete-time model is preferred. For discrete-time multiagent systems with pinning control, this article explores disturbance rejection with random switching nonlinear couplings that have uncertainties.
Let ℝ be the field of real numbers, ℤ the set of integers, and ℕ the set of nonnegative integers. denotes the identity matrix of appropriate dimensions. For a matrix , is the transpose of . For a square symmetric matrix , denotes the maximal eigenvalue of , and indicates that is a negative definite matrix. The floor function ⌊x⌋ maps to the greatest integer that is less than or equal to x. defines the expectation. The notation # within a symmetric matrix represents a symmetric term.
Lemma 1
Let be a square symmetric matrix. Then .
The remainder of the article is organized as follows. The second section describes multiagent systems with exogenous disturbances and presents sufficient conditions of disturbance rejection. Considering an example, the fourth section presents the optimization of disturbance rejection with pinning control. The article is concluded in the fifth section.
Disturbance rejection of multiagent systems
Consider a discrete-time multiagent system consisting of n agents of one dimension. Define . The model of the multiagent system without control inputs is
where is the state of agent i at time ; is the exogenous disturbance acting on agent i; is a known constant; and the nonlinear linking function from agent j to agent i is unknown but is assumed to satisfy
with two known positive numbers and . The above condition is illustrated by Figure 1; that is, the nonlinear linking lies entirely inside the sector formed by the straight lines and . It should be pointed out that is not required to be continuous. However, at time τ, the success of depends on a switching value ; implies the linking is successful at time , while implies is unsuccessful at τ. From the point of view of engineering, indicates whether there is data loss in the communication from agent j to agent i at τ. What we define as data loss is the event in which one or more packets of data traveling across a communication network fail to reach their destination. To transmit information among agents, wireless communication networks are usually used in mobile multiagent systems. Data losses in a wireless communication network commonly occur owing to diverse transmission errors, such as those relating to hardware limitations, software limitations, and channel congestion. We let
with
Graph of a nonlinear linking function.
In fact, represents the linking topology of the multiagent system at . Figure 2 shows a multiagent system without control and its three possible linking topologies. There are five agents in this system. The behavior of each agent is affected by a disturbance; that is, Agent i has disturbance input . As we mentioned earlier, the linking topology depends on the communication network. Because of the stochastic nature of the communication channel, for any , is randomly one of the three matrices , , and with
(a to c) A multiagent system without control and its three possible linking topologies.
Their linking topologies are respectively illustrated in Figure 2(a), (b), and (c). According to equation (1), the dynamics of Agent 1 in topology can be described in Figure 3, where only across the linking function can the state of Agent i affect Agent 1. Because Figure 2(a) shows that only Agent 5 imposes on Agent 1, and are the inputs of Agent 1 in Figure 3.
Diagram of Agent 1 without control in topology .
Given a fixed point that is the goal of each agent in the multiagent system (1), to instruct the agents to tend toward , control inputs
are added to system (1) with control gains . The multiagent system with control inputs is thus modeled as
After the control is added, the multiagent system in Figure 2 becomes that in Figure 4, and the block diagram in Figure 3 becomes that in Figure 5. Clearly, in the multiagent system with control, is included in the inputs of each agent. For system (6), we define the error , and system (6) can then be rewritten in terms of ei as
(a to c) Multiagent system with control and its three possible linking topologies
Diagram of Agent 1 with control in topology .
We have the error vector , disturbance vector , control matrix , and input matrix . Equation (7) can then be transformed equivalently into the simple vector form
where
is a nonlinear mapping from to . For any
with
Figure 4 shows that it is not necessary to exert on each agent. Exerting on one key agent can realize the goal with less control cost. For instance, is imposed on only Agent 1 in Figure 6. The linking among agents provides the information of to other agents, even if the linking is randomly time varying. Figure 6 is a case of pinning control. The pinning control strategy selects only nc agents to which control inputs are added. In other words, the number of nonzero elements of , nc, is as small as possible in pinning control. It is noted that a multiagent system with pinning control can still be described using equation (8). In pinning control, most diagonal elements of are zero.
(a to c) Multiagent system with pinning control and its three possible linking topologies.
Before investigating stochastic consensus and disturbance rejection of equation (8), we need to make assumptions on the randomly time-varying linking topology. In this article, for equation (8), m linking topologies are given and is requested to switch within the set randomly; that is
It is assumed that s are independently identically distributed -valued random variables. The probability of the mass function of is known as
and .
When , equation (8) is referred to as a disturbance-free multiagent system. The disturbance-free multiagent system is said to achieve stochastic consensus if
and for any according to (10). We let
with
Theorem 1
For multiagent system (8) stated above, suppose that there exist positive definite , positive definite diagonal , and positive definite diagonal such that
where
The disturbance-free multiagent system then achieves stochastic consensus.
Next, for system (8) with nonzero , we consider the disturbance rejection problem. Given a positive number , multiagent system (8) is said to be γ-disturbance rejective if
(i) its disturbance-free multiagent system achieves stochastic consensus and
(ii) when ,
Obviously, γ-disturbance rejection of system (8) can guarantee the stochastic consensus of system (8) without disturbances. For nonzero disturbances, under the zero initial condition, γ-disturbance rejection also guarantees
That is to say, the ratio between the expectation of the energy of error signals and the energy of the disturbance is less than γ. Therefore, equation (15) provides a measuring method for disturbance rejection and the performance of disturbance rejection improves with decreasing γ.
Theorem 2
For multiagent system (8) stated above, suppose that there exist positive definite , positive definite diagonal , and positive definite diagonal such that
Multiagent system (8) is then γ-disturbance rejective.
Optimal disturbance rejection with pinning control: An example
This section considers how to reach a consensus on the depth of a swarm of autonomous underwater vehicles (AUVs) experiencing exogenous disturbances. There are n AUVs, each of which can be modeled as
where xi is the depth of the ith AUV, η is a time constant, and the manipulated variable vi is the vertical velocity of the ith AUV. Each AUV collects information related to the depth differences between it and the other AUVs and uses the information to regulate its depth. Considering the complexity of underwater measure and underwater communication, the regulation law with uncertainties and disturbances is described as
where , , bi, and wi were explained in the previous section. It is easy to see that (1) can be viewed as a combination of (18) and (19). In other words, the swarm AUV system is a multiagent system studied in the previous section. In our example, the swarm AUV system is assumed to be the multiagent system shown in Figure 2 with , , ,, and . In addition, let ; the probabilities are given as , , and . For an unknown nonlinear linking function , coefficients of bounds are assigned as
The other and values are equal to zero. In many practical cases, it is required that the depth of each AUV converges in the mean square sense to the desired depth when there are no disturbances. After adding the information on to the swarm AUV system, the model of the system becomes (6). For the multiagent system (6) with disturbances and time-varying nonlinear uncertain couplings, the γ-disturbance rejection condition in Theorem 2 is useful. Our design has two objectives. The first objective is pinning control. The information on is added to only nc AUVs; we should determine the value of nc and determine which nc AUVs are selected. Because a smaller nc means less communication equipment, making nc as small as possible is the most important concern. For this reason, we first consider . When , there are only five cases of pinning control:
We let . Obviously, in this example, (8) is a pinning control system if and only if . To implement optimal disturbance rejection with pinning control, for , we define the objective function
From the definition of γ-disturbance rejection, we know that if cannot achieve stochastic consensus, it cannot achieve γ-disturbance rejection ((17) is infeasible) for any γ. These s that cannot achieve γ-disturbance rejection are excluded by setting their objective function value to ∞ in (20). If for any , we have to abandon and consider . Of course, if is bounded for some , we turn to the second objective, namely optimal disturbance rejection.
Because (17) is a linear matrix inequality when is known, it is convenient to compute using the mincx function in MATLAB. Figures 7 and 8 show the profiles of in Cases 1 and 5, respectively. In Cases 2, 3, and 4, the computing results of MATLAB show that (17) is infeasible and hence . Even if the control gain is changed, for those cases failing to reach consensus, the infeasibility remains. This can be explained by Figure 2. According to all channels of (a), (b), and (c) in Figure 2, three paths cannot be constituted: a path from Agent 2 to Agent 5, a path from Agent 3 to Agent 1, and a path from Agent 4 to Agent 5. The information of therefore cannot be received by every agent and consensus is never reached in Case 2, 3, or 4. Figure 2 also shows that from Agents 1 and 5 there exist paths to the other agents and hence both Cases 1 and 5 achieve disturbance rejection. To design the pinning controller, an optimal disturbance rejection problem can be addressed as
Profile of μ in Case 1 (where the minimum of μ, 74.7833, is achieved when ).
Profile of μ in Case 5 (where the minimum of μ, 73.4520, is achieved when ).
From the results of μ in Cases 1–5, it is easy to obtain and the corresponding control gain matrix .
To simulate the example, we set a nonlinear linking function from Agent j to Agent i as
where and . Figure 9 illustrates the graph of , with and . From (22), it is seen that when is an even number, while when is an odd number. is therefore discontinuous in Figure 9. It is also seen that and and hence lies inside a sector in Figure 9. Figure 10 shows random numbers generated using the probability distribution . Figure 11 shows the exogenous disturbances generated using a white Gaussian noise distribution by specifying that the noise power is 0 dBW. With the initial depth and the desired depth , the depth trajectories under and are displayed in Figures 12 and 13, respectively. Convergence times of the response are 40 and 100 in Figures 12 and 13, respectively. This means that the multiagent system with is less affected by the disturbances.
Graph of the linking function .
Random numbers in the simulation.
Exogenous disturbances in the simulation.
Depth trajectories under .
Depth trajectories under .
Conclusion
We studied the γ-disturbance rejection of multiagent systems with exogenous disturbance. A sufficient condition of achieving γ-disturbance rejection for random switching coupling topologies was addressed. The condition was conveniently applied in the pinning control of . A numerical example was given to verify the theoretical analysis. However, some limitations are worth noting. Although we consider the varying linking topology due to the random data loss in wireless communication, the independently identical distribution assumption is oversimple in the describing of wireless communication. Future work should therefore include follow-up work under a shadowing-pattern Markov chains25 assumption which is suitable for modeling wireless communication.
Footnotes
Declaration of conflicting interests
The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This work was supported in part by the National Key R&D Program of China (2017YFB1300400), and in part by the Science and Technology Project of Zhejiang Province (2019C01043).
ORCID iD
Jun Wu
Appendix 1
References
1.
Olfati-SaberRMurrayRM. Consensus problem in networks of agents with switching topology and time-delays. IEEE Trans Automatic Control2004; 49(9): 1520–1533.
2.
RenWBeardR. Consensus seeking in multi-agent systems under dynamically changing interaction topologies. IEEE Trans Automatic Control2005; 50(5): 655–661.
3.
HatanoYMesbahiM. Agreement over random networks. IEEE Trans Automatic Control2005; 50(11): 1867–1872.
4.
ZhangYTianY. Consentability and protocol design of multi-agent systems with stochastic switching topology. Automatica2009; 45(5): 1195–1201.
5.
ChenFChenZXiangL, et al.Reaching a consensus via pinning control. Automatica2009; 45(5): 1215–1220.
6.
ProskurnikovA. Consensus in switching networks with sectorial nonlinear couplings: absolute stability approach. Automatica2013; 49(2): 488–495.
7.
RenWBeardRW. Distributed consensus in multi-vehicle cooperative control. London: Springer-Verlag, 2008.
8.
LiuL. Robust cooperative output regulation problem for non-linear multiagent systems. IET Control TheorAppli2012; 6(13): 2142–2148.
9.
SuYHuangJ. Cooperative semi-global robust output regulation for a class of nonlinear uncertain multi-agent systems. Automatica2014; 50(4): 1053–1065.
10.
IsidoriAMarconiLCasadeiG. Robust output synchronization of a network of heterogeneous nonlinear agents via nonlinear regulation theory. IEEE Trans Automatic Control2014; 59(10): 2680–2691.
11.
DingZ. Consensus output regulation of a class of heterogeneous nonlinear systems. IEEE Trans Automatic Control2013; 58(10): 2648–2653.
12.
PersisCDJayawardhanaB. On the internal model principle in the coordination of nonlinear systems. IEEE Trans Control Network Syst2014; 1(3): 272–282.
13.
LinPJiaYLiL. Distributed robust H∞ consensus control in directed networks of agents with time-delay. Syst Control Lett2008; 57(8): 643–653.
14.
HuJFengG. Distributed tracking control of leader-follower multi-agent systems under noisy measurement. Automatica2010; 46(8): 1382–1387.
15.
GaoLTongCWangL. H∞ dynamic output feedback concensus control for discrete-time multi-agent systems with switching topology. Arabia J Sci Eng2014; 39(2): 1477–1487.
16.
ParkMJKwonOMParkJH, et al.H∞ consensus performance for discrete-time multi-agent systems with communication delay and multiple disturbances. Neurocomputing2014; 138: 199–208.
17.
LiuQWangZHeX, et al.Event-based H∞ consensus control of multi-agent systems with relative output feedback: the finite-horizon case. IEEE Trans Automatic Control2015; 60(9): 2553–2558.
18.
HuG. Robust consensus tracking for an integrator-type multi-agent system with disturbances and unmodelled dynamics. Int J Control2011; 84(1): 1–8.
19.
LiZLiuXFuM, et al.Global H∞ consensus of multi-agent systems with Lipschitz non-linear dynamics. IET Control Theor Appl2012; 6(13): 2041–2048.
20.
WenGDuanZLiZ, et al.Consensus and its L2-gain performance of multi-agent systems with intermittent information transmissions. Int J Control2012; 85(4): 384–396.
21.
ZhangYYangYZhaoY, et al.Distributed finite-time tracking control for nonlinear multi-agent systems subject to external disturbances. Int J Control2013; 86(1): 29–40.
22.
WangXXuDJiH. Robust almost output consensus in networks of nonlinear agents with external disturbances. Automatica2016; 70: 303–311.
23.
WangXSuH. Pinning control of complex networked systems: a decade after and beyond. Ann Rev Control2014; 38(1): 103–111.
24.
LiZDuanZHuangL. Disturbance rejection and H∞ pinning control of networked multi-agent systems. In: Proceedings of 27th Chinese control conference, Kunming, China, 16–18 July 2008, pp. 514–518. China: IEEE.
25.
DhoutautDRégisASpiesF. Impact of radio propagation models in vehicular ad hoc networks simulations. In: vANET’06 Proceedings of the 3rd international workshop on vehicular ad hoc networks, Los Angeles, USA, 29 September 2006, pp. 40–49. New York: ACM.