Fuzzy singular Lyapunov matrix equations have many applications, but feasible numerical methods to solve them are absent. In this paper, we propose an efficient numerical method for fuzzy singular Lyapunov matrix equations, where A is crisp and semi-stable. In our method, we transform fuzzy singular Lyapunov matrix equation into two crisp Lyapunov matrix equations. Then we solve the least squares solutions of the two crisp Lyapunov matrix equations, respectively. The existence of fuzzy solution is also considered. At last, two small examples are presented to illustrate the validate of the method and two large scale examples that the existing method fails to slove are presented to show the efficiency of the method.
The singular Lyapunov matrix equation is of the form
where A = (aij) ∈ Rn×n is semi-stable or Lyapunov stable. A matrix is called stable if the real parts of its eigenvalues are negative; It is called semi-stable if the real parts of most of its eigenvalues are negative with few semi-simple exceptions at zero; It is called Lyapunov stable if real parts of its eigenvalues are non-positive. The Lyapunov matrix equation is widely used in cybernetics, signal processing, dynamical systems and the hydrodynamic stability ([2, 26]). Semi-stable matrix has great effects on the analysis of autonomous systems, matrix second-order systems and switched systems ([4, 22]). With kronecker product, (1) is equivalent to (I ⊗ A + A ⊗ I) Vec (X) = Vec (C) , where Vec (X) is a vector obtained by stacking columns of X. So (1) is singular, if A is semi-stable or Lyapunov stable. Just like the connection between Lyapunov matrix equation with optimal stable control, semistable Lyapunov matrix equation arise from optimal semistable control theory for linear and nonlinear dynamical system ([19, 23]). Semistable Lyapunov matrix equations also appear in chemical reaction system, compartmental systems ([17]), isospectral matrix dynamical systems, and dynamical network systems. They cover a broad spectrum of applications including cooperative control of unmanned air vehicles, autonomous underwater vehicles, distributed sensor networks, air and ground transportation systems, swarms of air and space vehicle formations, and congestion control in communication networks ([16, 18]).
In practical applications, the information we received may fuzzy. So we may obtain fuzzy matrix equations when we use fuzzy numbers as a tool for modeling. With a fuzzy matrix replacing C in (1), we have a fuzzy singular Lyapunov matrix equation(FSLME):
where is an unknown fuzzy matrix. Solution of a fuzzy linear system is very different from the crisp one. If the solution method is based on the interval arithmetic, we obtain the classic solution. If the solution method is based on the extension principle, we obtain the extension solution ([5]). The classic solution may not exist, but extension solution always exists ([1]). In [13], an extended method for fuzzy linear equations is proposed, a 2n × 2n crisp linear equations is needed to solve in this method. In [29], Fourier transformation is applied to this method, so solving two n × n crisp linear equations instead of one 2n × 2n crisp linear equations is enough. This method makes solving large scale fuzzy linear system much eaiser. In [12], a different approach to solve fuzzy linear equations is proposed. In this method, three n × n crisp linear equations are needed to solve. In [24], an improvement is done to the method. This improvement need to solve the same two n × n crisp linear equations as ones in [29].
Some numerical methods of solving fuzzy matrix equation come from the methods of solving fuzzy linear equations. These methods ([15, 27]) are constructed by using Kronecker product to convert fuzzy linear matrix equations to fuzzy linear equations. And the fuzzy linear equations is solved by the methods in [12, 29-32]. We call this method as kronecker method in this paper. Kronecker method can solve nonsingular and singular fuzzy matrix equations, but it is infeasible to solve large scale equations because it enlarge the scale of equations very much. There are also some methods ([33, 34]) can deal with singular fuzzy matrix equation AX = B without enlarging the dimension of equations, where A is a crisp matrix, X and B are fuzzy matrices. But these methods can not be applied to solve singular fuzzy Lyapunov matrix eqution. Thus, the existing method to solve fuzzy singular matrix equations is the kronecker method. The other methods of solving fuzzy matrix equation come from the combination of numerical methods of crisp matrix equation and fuzzy arithmetic ([20]). This kind of methods can keep scale of equations unchanged, so they are more efficicent. But since there are very few literature about singular crisp Lyapunov matrix equations, as we known, there are not any efficient methods for singular fuzzy Lyapunov matrix equations. In [11], authors proposed a numerical method to solve large scale unstable crisp Lyapunov matrix equation. So the motivation of this paper is to propose an efficient numerical method for singular fuzzy Lyapunov matrix equation by combining the method in [11] with the idea in [20]. Moreover, conditions of fuzzy solution existence are also studied. As we will see in the part of numerical test, this method is efficient when solving large scale equations.
We assume throughout that the coefficient matrix is a crisp semi-stable or Lyapunov stable. Our technique path is as follows. Firstly, the fuzzy singular Lyapunov matrix equation is transformed into two crisp singular Lyapunov matrix equations without enlarging their scales by using the idea in [20]. Then we employ the approach in [11] to numerically solve the least squares solutions of two crisp singular Lyapunov matrix equations. Finally, the fuzzy solution of the original equation is composed. Moreover, both singular consistent and inconsistent cases are discussed. In the case of the consistent singular system, we only need to solve the least squares solutions of two crisp equations, respectively. In the case of inconsistent singular system, we need to do a projection to get rid of the inconsistent part first, and then to solve the projected equation.
The rest part of this paper is organized as follows. In Section 2, some useful preliminaries are presented. In Section 3, the extension method is derived. In Section 4, the implement details of the extension method are presented. In Section 5, several examples, including large scale examples, are presented.
Preliminaries
In this section, some preliminaries are presented. The further detail of these preliminaries can be found in [8, 27].
Definition 2.1. A fuzzy number can be defined by its membership function u : R ↦ [0, 1] which satisfies following requirements:
u is an upper semi-continuous function on R,
u (r) =0 outside some interval [a, d],
for a, b, c, d ∈ R with a ≤ b ≤ c ≤ d satisfies
u (r) is a monotonic increasing function on [a, b],
u (r) is a monotonic decreasing function on [c, d],
u (r) =1, ∀ x ∈ [b, c].
According to Definition 2.1, we can represent a fuzzy number in the following form:
where uL : [a, b] ↦ [0, 1] and uR : [c, d] ↦ [0, 1] are the left and right membership function of the fuzzy number u, respectively. All fuzzy numbers can be expressed by the formula (3), and an another way to define fuzzy numbers is introduced below.
Definition 2.2. A fuzzy number can be presented by a pair of functions , r ∈ [0, 1] which satisfy the following requirements:
is a bounded continuous non-decreasing function over [0, 1],
is a bounded continuous non-increasing function over [0, 1],
.
Moreover, we call (or ) the pair-left (or pair-right) function. When , the fuzzy number is a crisp number. For example, 2 can be writted as (2, 2). According to Definition 2.2, a trapezoidal fuzzy number can be presented with u (x0, y0, α, β) in the form which is similar to (3):
This form corresponds to and . When x0 = y0, it is a triangular fuzzy number.
The arithmetic operations of fuzzy numbers , and a real number k are the following:
if and only if and ;
;
.
(2) can be transformed into the following fuzzy linear equation by using Kronecker product ([25]):
where . When A is stable, the Lyapunov operator L (·) is nonsingular, the unique solution of a large scale stable Lyapunov matrix equation can be obtained on the basis of EXTALG algorithm in [20].
The extension method
Let and satisfy:
So (AT) + = (A+) T, (AT) - = (A-) T. Let where and According to [20], (2) can be transformed into a crisp Lyapunov matrix equation with the scale of (2n × 2n) as follow:
where , and
With several elementary transformations, we have
Let (λ, x) be an eigenpair of A. With the fact of |λ||X| = |AX| ≤ |A||X|, S is semi-stable or Lyapunov stable if A is semi-stable or Lyapunov stable, respectively. Thus, (5) is not a stable Lyapunov matrix equation.
Then we discuss the existence of the fuzzy solution of (2). By (5), we can easily find that
Let (7) minus (6), we have
Let , so (8) can be written as the following Lyaunov matrix equation:
Applying the Kronecker product to (9), we can obtain that
It is clear that the solution of (10) is unique if (In ⊗ |A| + |A| ⊗ In) is nonsingular. However, we should note that |A| may singular.
Proposition 3.1. For an arbitrary fuzzy matrix , the solution or the least squares solution of (2) is a fuzzy matrix if and only if A is a diagonal matrix.
Proof. Supposed that the matrix A is a semi-stable matrix with rank r, we know that the necessary and sufficient condition for the existence of the solution or the least squares solution of the matrix equations (2) is (I ⊗ |A| + |A| ⊗ I) + ≥ 0. Then we need to show that (I ⊗ |A| + |A| ⊗ I) + ≥ 0 if and only if A is a diagonal matrix.
Firstly supposed (I ⊗ |A| + |A| ⊗ I) + ≥ 0 holds, so that we can obtain the equation (I ⊗ |A| + |A| ⊗ I) + = P (I ⊗ |A| + |A| ⊗ I) T according to Theorem 1 in [9], where P is a diagonal matrix with positive diagonal elements.
we know
so the following equation can be obtained:
Then (11) can be transformed to
(12) also can be expressed in the following equation:
Obviously, A must be a diagonal matrix.
Next we prove (I ⊗ |A| + |A| ⊗ I) + ≥ 0 is established when A is a diagonal matrix.
Let so we have where . Therefore (In ⊗ |A| + |A| ⊗ In) + ≥ 0 holds.□
Let’s consider the extension method in singular case further.
We perform elementary matrix transformation to the both sides of (5) being
So we can obtain the following form:
We have the following equation by simplifying (13) further:
Let , and . So (14) has a equivalent form:
It indicates that we can solve (5) by solving following two crisp singular Lyapunov matrix equations whose scale is not enlarged:
Based on (16) and (17), we have the following theorem.
Theorem 3.2.Fuzzy matrix is the least squares fuzzy solution of (2) where X1 and X2 is the least squares solutions of (16) and (17), respectively.
Proof. The residual of Equation (15) is denoted by . According to (15), We can obtain that
Clearly, we have
Thus the corresponding norm is the residual norm of (15). So it is the residual of (2). Therefore, if X1 and X2 are the least squares solution of (16) and (17), respectively, and is a fuzzy matrix, is the least squares solution of FSLME.□
Implementation of extension method
Obviously, the key point of extension method is how to solve singular Lyapunov matrix equations effectively. The method in [11] can be applied here. Let
where P = [P1, P2] is an unitary matrix with the columns of P1 spanning the null space of A. Obviously, Ω is a matrix corresponding to the unstable eigenvalues of A.
Let and where X11, X22, H11, H22 are symmetrical.
Then pre- and post-multiply (1) by PT and P, respectively, we can obtain that
We extend (19) into the following consistent system of three equations:
We can obtain the least norm solution by solving (21), (20) and (19) in turn. We should note (19) is the only singular one.
When the equation is inconsistent, its inconsistent part as follow:
where Q is a unitary matrix generated by eigenvectors of zero eigenvalues or purely imaginary eigenvalues.
Therefore we can solve the consistent singular Lyapunov matrix equation to obtain the least squares solutions by using the following algorithm.
Algorithm 1 SLME Algorithm
1. Compute in (23).
2. Compute a matrix P1 is formed by a basis of null space of A.
3. Compute P = [P1, P2] with orthonormal columns.
4. Compute and .
5. Compute three equations according to the singular consistent Lyapunov matrix equation .
Based on the algorithm 1, we have the following numerical methods for FSLME.
Algorithm 2 MNLS Algorithm1. Compute and
2. Solve two crisp Lyapunov matrix equations AX1 + X1AT = C1 and |A|X2 + X2|A|T = C2 parallel by using SLME algorithm.
3. Compute and
The Fig. 1 presents the process of solving the fuzzy matrix equation.
The flow chart of solving the fuzzy singular Lyapunov matrix equation (2).
Examples
As a consequence of the discussion in the previous paragraph, we present four examples to illustrate the validate and the efficiency of our method. Two of them are small dimension examples. And one of them is singular consistent, the other one is singular inconsistent. The other two examples are large scale. All of the following examples are runned in the MATLAB (R2018b) environment. The hardware environment used in the experiment includes the system model of 90KSCTO1WW of Lenovo computer, the machine configuration is Intel(R) Core(TM) i5-10500 CPU@3.10GHz(12CPUs)
3.1GHz, 16GB memory.
Example 1. Considering a fuzzy singular consistent Lyapunov matrix equation where with eigenvalues 0, i, - i, and -1,
and , where
and
According to MNLS algorithm, we compute |A|, C1 and C2 as follows:
and
Solving the original fuzzy equation is equivalent to solve the following two Lyapunov matrix equations
where |A| is semi-stable with one zero eigenvalue.
According to algorithm 1, we have the solutions and the residual norm of the two equations as the following, respectively:
and
So the least norm fuzzy solution of the example is decided by
and
Obviously, it shows
Example 1 gives a specific process to solve a fuzzy singular consistent system with a zero eigenvalue and a pair of pure imaginary eigenvalues. It shows we can obtain its least norm fuzzy solution by using MNLS algorithm.
Example 2. Considering a fuzzy singular inconsistent Lyapunov matrix equation where its eigenvalues are 0, 4.5826i, - 4.5826i and -2, and , where
and
According to MNLS algorithm, we compute |A|, C1 and C2 as follows:
and
According to the extension method, we need to solve the following two equations
where |A| is non-singular.
According to algorithm 1, after minus the inconsistent part, we obtain the solution of the singular consistent Lyapunov matrix equation and the residual norm is 7.7499e - 14. Moreover, we also can obtain the result that both the norm of AX1 + X1AT - C1 and are 2.8829. So the numerical solutions of the two equations as the following, respectively:
and
So the least norm fuzzy solution of the example is decided by
and
Obviously, it shows
Example 2 presents a specific process to solve a fuzzy singular inconsistent Lyaunov matrix equation with a zero eigenvalue and a pair of pure imaginary eigenvalues. This example is more difficult than example 1 because it need to compute the inconsistent part.
Example 3. We consider a fuzzy singular Lyapunov matrix equation, where A and are construced by the following steps:
is a 5 × 5 matrix with eigenvalues 1.4495i, - 1.4495i, 3.4495i, - 3.4495i.
is a n × n tri-diagonal matrix whose diagonal entries are -4, whose entries above diagonal and below diagonal are both 1.
is a (n + 5) × (n + 5) square matrix.
Let and , where T1 and T2 is a random symmetric matrix with elements in [0, 5], T3 is a random symetric matrix with elements in [10, 20].
and .
C1 = AY1 + Y1AT and C2 = |A|Y2 + Y2|A|T.
and
Construt .
We present condition numbers of A and |A| in the Table 1. By the table, we can see A and |A| having almost the same condition numbers, and the condition numbers of A and |A| increase as n increases.
The condition numbers versus n
n
The condition
The condition
numbers of A
numbers of |A|
100
48.3742
48.3742
400
178.064
178.064
900
388.812
388.812
1600
680.617
680.617
2500
1053.48
1053.48
3600
1507.40
1507.40
Table 2 presents the residual norm and CPU running time of solving matrix equations (16), (17) when n takes different values. By this table, solving (16) costs more time, because more eigenvalues of A close to zero. Please see Figs. 2 and 3 . We also find the kronecker method fails to solve this example when n ≥ 100 .
The spectral distribution of A (n = 3600).
The spectral distribution of |A| (n = 3600).
Numerical results when n takes different values
n
||R1||F
||R2||F
(16) CPU time
(17) CPU time
The kronecker method
2
1.0380e-12
3.8878e-12
0.0037
0.0032
it costs 39 seconds and the residual norm is 3.3270e-11
3
2.4711e-12
6.3108e-12
0.0065
0.0067
it costs 1345 seconds and the residual norm is 7.4788e-10
100
5.4663e-11
7.2947e-11
0.3376
0.1861
it costs more than 1 hour and the residual norm is 5.7833e-09
400
3.6801e-10
4.1428e-10
4.6810
2.6938
out of memory
900
1.1522e-09
1.0449e-09
22.1239
12.4884
out of memory
1600
2.3946e-09
2.2830e-09
72.6816
41.7671
out of memory
2500
4.8409e-09
3.2166e-09
197.6176
145.3564
out of memory
3600
8.5196e-09
5.8851e-09
631.3729
346.6931
out of memory
The above numerical experiments can be implemented in parallel, so the total time for solving the fuzzy equation (2) is the CPU time for solving the equation (16).
Example 4. Considering a fuzzy singular inconsistent Lyapunov matrix equation , where A and are constructed according to following steps:
We discretize with Neumann boundary conditions to obtain the matrix A by using the finite element method with triangular elements and quadratic basis ([10]). It is well-known that A is semi-stable and dim=1. In this experiment, we chose A with n = 2601 and in 1D.
Construct , where
where T1 and T2 are random symmetric matrices with elements in [5, 10], T3 and T4 are random symetric matrices with their elements in [0, 5].
The condition numbers of A and |A| are 2108.03 and 430.812, respectively. Figure 4 and 5 are the spectral distributions of A and |A|, respectively.
The spectral distribution of A.
The spectral distribution of |A|.
According to the spectral distribution of |A| shown above, we know |A| is a non-singular matrix. Tables 3 and 4 presents the numerical results of (16) and (17), respectively. The condition numbers of A and |A| are 2108.03 and 430.812, respectively.
The numerical result of solving the matrix equation (16)
Number
||AX1 + X1AT - C||F
(16)CPU time
||AX1 + X1AT - C1||F
The kronecker method
1
2.5051e-09
248.7264
0.0010
0.0010
out of memory
2
2.5064e-09
206.1042
0.1089
0.1089
out of memory
3
2.5090e-09
207.7534
1.2563
1.2563
out of memory
4
4.0535e-09
224.9970
76.1134
76.1134
out of memory
5
6.0800e-09
208.7395
158.6147
158.6147
out of memory
6
1.4313e-08
215.7241
924.3292
924.3292
out of memory
The numerical result of solving the matrix equation (17)
Number
||R2||F
(17)CPU time
1
1.3315e-08
37.1101
2
1.3159e-08
36.5623
3
1.3159e-08
37.0265
4
1.3329e-08
36.4116
5
1.3387e-08
35.4866
6
1.3316e-08
40.2629
By these two tables, we find (17) is solved more easily than (16). The reason is the nonsingularity of |A|. Obviously, we implement algorithms parallel.
Example 4 solves a fuzzy singular inconsistent Lyapunov matrix equation with a zero eigenvalue. The fourth and fifth columns in Table 3 are almost equal illustrates that the result we obtained is the least squares solution of it. We also try to solve the fuzzy and singular inconsistent Lyapunov matrix equation by using Kronecker product directly. Clearly, we get the trouble of out of memory.
Conclusion
The main contribution of this paper is to propose an appropirate approach to solve FSLME which has never been solved efficiently. The approach combines the extension method in [20] with the method to solve singular crisp Lyapunov matrix equations in [11]. Examples in this paper show the validate and the efficiency of this approach.
References
1.
AllahviranlooT., GhanbariM., HosseinzadehA.A.et al. A note onFuzzy linear systems[J], Fuzzy Sets and Systems177(2011), 87–92.
BennerP., BreitenT. and DammT., Generalised tangentialinterpolation for model reduction of discrete-time MIMO bilinearsystems[J], International Journal of Control84(8) (2011), 1398–1407.
4.
BernsteinD.S.et al. Lyapunov Stability, Semistability, and Asymptotic Stability of Matrix Second-Order Systems[J], Journal of Mechanical Design (1995).
5.
BuckleyJ.J., EslamiE., FeuringT. Fuzzy mathematics in economics and engineering[M], Physica-Verlag HD (2002).
6.
CampbellS.L., Singular perturbation of autonomous linear systems,II[J], Journal of Differential Equations29(3) (1978), 362–373.
7.
DattaB.N., Linear and numerical linear algebra in control theory:Some research problems[J], Linear Algebra and Its Applications197-198(none) (1994), 755–790.
8.
DuboisD. Fuzzy Sets and Systems[M], Academic Press (1980).
9.
ElmanH.C., SilvesterD.J. and WathenA.J., The generalized inverseof a nonnegative matrix[J], Proceedings of the AmericanMathematical Society31(1) (1972), 46–50.
10.
ElmanH.C., SilvesterD.J. and WathenA.J., Finite elements and fast iterative solvers: with applications in incompressible fluid dynamics[J], Mathematics of Computation75(255) (2006), 1595–1596.
11.
Eric ChuK.W., SzyldD.B. and ZhouJ., Numerical solution ofsingular Lyapunov equations[J], Numerical Linear Algebra withApplications28(e2381) (2021).
12.
EzzatiR., Solving fuzzy linear systems, Soft Computing (2011), 193–197.
13.
FriedmanM., MingM. and KandelA., A fuzzy linear systems[J], Fuzzy Sets and Systems96 (1998), 201–209.
14.
GoetschelR., Elementary calculus[J], Fuzzy Sets and Systems18 (1986).
15.
GuoX.B. Approximate Solution of Fuzzy Sylvester Matrix Equations[C]. Seventh International Conference on Computational Intelligence and Security, IEEE Computer Society (2011).
16.
HaddadW.M., ChellaboinaV.S., NersesovS.G. Thermodynamics: A Dynamical Systems Approach[M]. Princeton, NJ: Princeton University Press, 2005.
17.
HaddadW.M., ChellaboinaV., BhatS.P. and BernsteinD.S., Modelingand analysis of massaction kinetics[J], IEEE Control Syet Mag29 (2009), 60–78.
18.
HaddadW.M., ChellaboinaV., HuiQ. Nonnegative and compartmental dynamical systems[J], Princeton, NJ: Princeton University Press (2010).
19.
HaddadW.M., HuiQ. and ChellaboinaV., H2 optimal semistablecontrol for linear dynamical systems: an lmi approach[J], Journal of the Franklin Institute348(10) (2007), 2898–2910.
20.
HeQ., HouL., ZhouJ. The solution of fuzzy Sylvester matrix equation[J], Soft Computing (2017).
21.
HuiQ., Optimal semistable control for continuous-time linearsystems[J], Systems and Control Letters60(4) (2011), 278–284.
22.
HuiQ., Semistability and Robustness Analysis for SwitchedSystems[J], European Journal of Control17(1) (2011), 73–88.
23.
L’AfflittoA., HaddadW.M. and HuiQ., Optimal control for linearand nonlinear semistabilization[J], Journal of the FranklinInstitute352 (2015), 851–8.
24.
NasserM., ZahraN., SamadN. and JuanJ.N., A novel technique tosolve the fuzzy system of equations, Mathematics8(5) (2020), 850.
25.
SalkuyehD.K., On the solution of the fuzzy Sylvester matrixequation[J], Soft Computing - A Fusion of Foundations,Methodologies and Applications15(5) (2011), 953–961.