Korean Institute of Information Technology

Journal Archive

The Journal of Korean Institute of Information Technology - Vol. 18 , No. 8

[ Article ]
The Journal of Korean Institute of Information Technology - Vol. 18, No. 7, pp. 63-71
Abbreviation: Journal of KIIT
ISSN: 1598-8619 (Print) 2093-7571 (Online)
Print publication date 31 Aug 2020
Received 04 Jul 2020 Revised 07 Aug 2020 Accepted 10 Aug 2020
DOI: https://doi.org/10.14801/jkiit.2020.18.8.63

Improved Bound Estimates for the Solution of the Discrete Lyapunov Equation
Dong-Gi Lee* ; Inha Hyun**
*Dept. of Biomedical Engineering, Konyang University
**Information & Communications Office, Air Force Headquarters

Correspondence to : Dong-Gi Lee Department of Biomedical Engineering, Konyang University, Korea, Tel.: +82-42-600-8521, Email: dglee1967@naver.com


Abstract

In this research, the work to discrete bounds is extended and improved without the assumption that the system is asymptotically stable. Because attaining the solution itself causes a very massive computational load in case that the dimension of the system matrices is raised, using reasonable bound estimates is fair enough to apply. Thus bounds for the trace and largest eigenvalues are presented and special attention is located on the upper bound estimates for the trace because of their usefulness in robust stability and performance investigation. For the discrete Lyapunov equation, we can achieve some improved upper and lower bound estimates of the solution using the majorization inequality. And the previous research results are improved and generalized with these bounds.

초록

이 연구에서는 이산 경계치들에 대한 작업이 시스템이 점근적으로 안정하다는 가정없이 확장되고 개선되었다. 솔루션 자체를 얻는 과정이 시스템 행렬들의 차수를 증가시킴에 따라 매우 큰 계산 부담을 발생시키기 때문에 적절한 경계 추정치들을 이용하는 것은 충분히 적용가능하다. 그러므로 트레이스와 최대 고유값에 대한 경계치들이 제시되었고 강인 안정성과 성능 해석에서의 중요성 때문에 특별한 주의가 트레이스의 상한 경계치에 주어졌다. 이산시간 리아푸노프 방정식에 대해 주요화 부등식을 이용하여 솔루션의 상한과 하한 경계 추정치들을 얻을 수 있다. 그리고 이전의 연구결과들을 이 경계치들로 일반화하고 개선하였다.


Keywords: bound estimates, discrete Lyapunov equation, similarity transformation, majorization inequality

Ⅰ. Introduction

The continuous and discrete Lyapunov equations have been generally employed in diverse fields of engineering and control theory. In many applications of signal processing and control system analysis, it is necessary to estimate bounds of the solutions for these equations [1]. As one of the research work for control system analysis, Y.-M. Kim and W.-B. Baek extended the research to adaptive sliding mode control for quadrotor with feedback linearization method [2]. Including this study, numerous jobs have been devoted to estimate the extent or size of the solutions for these equation during the past three decades [2]-[5]. However, the literature for this topic has had some deficiency. For the discrete Lyapunov equation, most of the upper bounds and lower estimates of the solution are established on the assumption of λ1(AAT) < 1 unfortunately [4]-[18]. By utilizing the similarity transformation [3], firstly provided some discrete upper bound estimates not having the presumption that the system is asymptotically stable, i.e., λ1(AAT) < 1. Lee et al. investigated some bounds for unified and continuous Lyapunov matrix equation [6][7]. Hyun et al. performed the bound estimates for stochastic unified system [8]. In this paper, by adopting the virtue of the similarity transformation of [3], new and fine bound estimates of the solution are developed without the assumption of λ1(AAT) < 1 for the discrete Lyapunov equation. These upper bounds are tighter than the results of [3]. Furthermore, we also obtain some new lower bounds. In addition, we give some numerical examples to demonstrate the merit of the proposed results.


Ⅱ. Main Results
2.1 Preliminary Results

In the next, Rn×n is represented for the set of n×n real matrices. For ARn×n, let tr(A) denote the trace of A. Suppose ARn×n be an random symmetric matrix, afterward we presume that the eigenvalues of A are organized so that λ1(A) ≥ λ2(A) ≥ ⋯ ≥ λn(A).

Lemma 1[19, p7-12]: If the components of x and y are nonnegative integers, then the following conditions are equivalent:

(i) x can be derived from y by a finite number of transfers.

(ii) the sum of the k largest components of x is less than or equal to the sum of the k largest components of y, k = 1, 2, ..., n, with equality when k = n.

(iii)

παπ1x1απ2x2απnxnππαπ1y1απ2y2απnyn(1) 

whenever each αi > 0. Here Σπ denotes summation over all permutations.

For x,yRn,

x<y if i=1kxii=1kyi, k=1,2, ,n(2) 

when x < y, x is said to be majorized by y. Then x is called weakly majorized by y and x is signaled by x < w y. This notation and terminology was introduced by Hardy, Littlewood, and Polya [20]. The next lemmas are employed to demonstrate the principal results.

Lemma 2[21, p49]: If A, BRn×n are symmetric matrices and 1 ≤ i1 < ⋯ < ikn, then for k = 1, 2, ⋯, n,

t=1kλitA+Bt=1kλitA+t=1kλitB(3) 

Especially, we have

i=1kλiA+Bi=1kλiA+λiB(4) 

with equality when k = n.

Lemma 3[21, p49]: If A, BRn×n are symmetric matrices and 1 ≤ i1 < ⋯ < ikn, then for k = 1, 2, ⋯, n,

t=1kλitA+Bt=1kλitA+t=1kλn-t+1B(5) 

Especially, we have

i=1kλn-i+1A+Bi=1kλn-i+1A+λn-i+1B(6) 

with equality when k = n.

Lemma 4[21, p48]: If A, BRn×n are symmetric positive semidefinite matrices and 1 ≤ i1 < ⋯ < ikn, then for k = 1, 2, ⋯, n,

t=1kλitAλn-t+1Bt=1kλitABt=1kλitAλtB(7) 

Especially, we have

i=1kλn-i+1Aλn-i+1Bi=1kλn-i+1ABi=1kλn-i+1AλiB(8) 

and

i=1kλiAλn-t+1Bi=1kλiABi=1kλiAλiB(9) 

with equality when k = n.

Lemma 5[19, p160, B.7 eq(9)]: If x1 ≥ ⋯ ≥ xn, y1 ≥ ⋯ ≥ yn and x < w y, then for any real array u1 ≥ ⋯ ≥ un ≥ 0,

i=1kxiuii=1kyiui,k=1,2,,n(10) 

Lemma 6[12]: Let ARn×n, and A = UTΛU where U is orthogonal and Λ is diagonal with 0 ≤ λi(Λ) < 1. Then

I-A-1=I+A+A2+(11) 
2.2 The upper bound estimates of the solution for Lyapunov equation

Consider the discrete Lyapunov equation

P-ATPA-Q=0(12) 

For making up for the example that λ1(AAT) is not within the circle of radius 1, we should establish the next alternation. Applying the similarity conversion [6 eq.(14)]-[21 p56], we set

P~=UTPU, Q~=UTQU, A~=U-1AU(13) 

Then the modified Lyapunov equation is obtained

P~-A~TP~A~-Q~=0(14) 

where λ1A~A~T<1.

Then the previous works for bound estimates is valid. Using equation (13) and the above lemmas, the next theorems can be attained.

Theorem 1: If the discrete Lyapunov equation (12) is applied and λ1A~A~T<1, then we attain the following inequality as

i=1kλiPi=1kλiE-1QλiEλn-i+1I-A~A~T(15) 

where E = U-TU-1 and U is the transformation matrix in equation (13).

<Proof> From Komaroff’s work [12], the solution to equation (14), using integer l, is

P~=l=0A~TlQ~A~l=Q~+A~TQ~A~+A~T2Q~A~2+(16) 

For notational convenience, set B~=A~A~T, then

λiA~TlQ~A~l=λiQ~B~l(17) 

Applying Lemma 2 to equation (16), in view of equation (17) and Lemma 4, we have

i=1kλiP~i=1kλiQ~+λiQ~B~2+i=1kλiQ~1+λiB~+λiB~2+(18) 

Considering λiB~<1, Lemma 6 can be employed in equation (18) to obtain

i=1kλiP~i=1kλiQ~1-λiA~A~T-1(19) 

From P~=UTPU and Q~=UTQU, it is easy to know that

λiP~=λiUTPU=λiUUTP=λiE-1P(20) 

and

λiQ~=λiUTQU=λiUUTQ=λiE-1Q(21) 

Then equation (19) can be rewritten as follows:

i=1kλiE-1Pi=1kλiE-1Q1-λiA~A~T-1(22) 

From

1-λ1A~A~T-11-λ2A~A~T-11-λnA~A~T-1(23) 

and

λ1E-1Qλ2E-1QλnE-1Q(24) 

we can obviously recognize that

λ1E-1Q1-λ1A~A~T-1λ2E-1Q1-λ2A~A~T-1λnE-1Q1-λnA~A~T-1(25) 

For notational convenience, set xi = λi(E-1P) and yi=λiE-1Q1-λiA~A~T-1. From equation (22) and (25), we know

x=x1,x2, ,xn<w y=y1,y2, ,yn(26) 

Since λ1(E) ≥ λ2(E) ≥ ⋯ ≥ λn(E) ≥0, in view of Lemma 5, we have

i=1kλiE-1PλiEi=1kλiE-1QλiE1-λiA~A~T(27) 

Applying Lemma 4 to equation (27), we have

i=1kλiP=i=1kλiPEE-1=i=1kλiE-1PEi=1kλiE-1PλiEi=1kλiE-1QλiE1-λiA~A~T(28) 

Note that 1-λiA~A~T=λn-i+1I-A~A~T. This completes the proof.

Corollary 1: For the discrete Lyapunov equation (12), if λ1A~A~T < 1, then we have

i=1kλiPλ1Ei=1kλiE-1Qλn-i+1I-A~A~Twhen k=n,trPλ1Ei=1nλiE-1Qλn-i+1I-A~A~T(29) 

Furthermore, we have

trPλ1E1-λ1A~A~Ti=1nλiE-1Q(30) 

<Remark> The bounds of equation (29) and (30) were presented in [3]. Therefore the result of [3] can be generalized by Theorem 1. And Theorem 1 also offers a improved bound estimate of the solution.

Theorem 2: For the discrete Lyapunov equation (11), we have

i=1kλiP1ki=1kλiE-1QλiEλn-i+1I-A~A~Tk(31) 

<Proof> Using the arithmetic-mean geometric-mean inequality [19, p125-126] on equation (15) leads directly to the above bound. If λi(P) > 0 for i = 1, ..., n, then

λiP1/nλiPn(32) 

equation (32) leads equation (15) to equation (31) as follows:

i=1kλiPi=1kλiP1ki=1kλiE-1QλiEλn-i+1I-A~A~Tk(33) 
2.3 The lower bound estimates of the solution for Lyapunov equation

In this section, by utilizing the majorization transformation, some lower bound estimates of the solution can be obtained for the discrete Lyapunov equation without the presumption of λ1(AAT) < 1.

Theorem 3: Let the positive definite matrix P be the solution to equation (12). If λ1(AAT) < 1, then we have

i=1kλn-i+1PλnEλ1I-A~A~Ti=1kλn-i+1E-1QtrPλnEλ1I-A~A~TtrE-1Q(34) 

<Proof> For P~=A~TP~A~+Q~, we have

i=1kλn-i+1P~=i=1kλn-i+1A~TP~A~+Q~(35) 

By Lemma 3, we obtain

i=1kλn-i+1P~i=1kλn-i+1A~TP~A~+i=1kλn-i+1Q~=i=1kλn-i+1A~A~TP~+i=1kλn-i+1Q~(36) 

Applying Lemma 4 to equation (36), we have

i=1kλn-i+1P~i=1kλn-i+1A~A~Tλn-i+1P~+i=1kλn-i+1Q~(37) 

From equation (37), we know

i=1kλn-i+1P~λnA~A~Ti=1kλn-i+1P~+i=1kλn-i+1Q~(38) 

Then

1-λnA~A~Ti=1kλn-i+1P~i=1kλn-i+1Q~(39) 

Considering λnA~A~T<1, from equation (20) and (21), equation (39) can be rewritten as follows:

i=1kλn-i+1E-1P11-λnA~A~Ti=1kλn-i+1E-1Q(40) 

In view of Lemma 4, we have

i=1kλn-i+1E-1Pi=1kλn-i+1PλiE-1λ1E-1i=1kλn-i+1P(41) 

Applying equation (41) to equation (40), we obtain

i=1kλn-i+1PλnE1-λnA~A~Ti=1kλn-i+1E-1Q(42) 

when k = n, we have

trPλnEλ1I-A~A~TtrE-1Q(43) 

Note that λ1E-1=λn-1E. This completes the proof.


Ⅲ. Numerical Examples
3.1 Example 1

Consider the discrete Lyapunov equation (12) with system matrix A in [6 eq.(42)]

A=0.75630.85640.3536-0.7856,Q=1001.

Then the eigenvalues of AAT are given by

λ1AAT=1.5174λ2AAT=0.5302(44) 

In order to overcome the difficulty that λ1(AAT) is unstable, we introduce the similarity transformation matrix U. For this example, we choose U=1.93590.20450.2312-1.1352. Afterward we can have the Jordan-converted matrix and its eigenvalues as

A~A~T=0.89150.06540.06540.9072λ1A~A~T=0.9653,λ2A~A~T=0.8335(45) 

Now, we eliminate the assumption of λ1A~A~T<1. Using Theorem 1, we have

λ1P82.9450,trP85.0316(46) 

Using Theorem 2, we obtain the following determinant bound

P84.0335(47) 

From Theorem 3, we have

λnP2.0867,trP8.0919(48) 

Using Theorem 1 of [3], we have

trP111.7665(49) 

Using Theorem 2 of [3], we have

trP88.9502(50) 

By comparison, we know equation (46) is better than equation (49) and (50).

3.2 Example 2

Consider the discrete Lyapunov equation (12) with

A=0.25390.581000.8958,Q=1001.

Then the eigenvalues of AAT are given by

λ1AAT=1.1599λ2AAT=0.0446(51) 

In order to overcome the difficulty that λ1(AAT) is unstable, we introduce the similarity transformation matrix U. For this example, we choose U=0.92320.07870.2141-0.2140. Afterward we can have the Jordan-converted matrix and its eigenvalues as

A~A~T=0.2141-0.3262-0.32620.7387λ1A~A~T=0.8950,λ2A~A~T=0.0578(52) 

Now, we eliminate the assumption of λ1A~A~T<1. Using Theorem 1, we have

λ1P167.3835, trP167.4438(53) 

By Theorem 2, we obtain the following determinant bound

P167.3844(54) 

From Theorem 3, we have

λnP0.0604, trP1.1217(55) 

Using Theorem 1 of [3], we have

 trP176.9051(56) 

Using Theorem 2 of [3], we obtain

 trP168.4448(57) 

By comparison, we know equation (53) is better than equation (56) and (57).


Ⅳ. Conclusions

One of essential problem for system stability analysis is the evaluation of the solution for the Lyapunov equation. Inspired by this issue, in the coverage of this paper, investigation of stability analysis for the solution of discrete Lyapunov equation is performed. By using similarity transformation of [3], we have proposed some new bounds which are extended with removal of the assumption of λ1(AAT) < 1. Compared with the results of [3], the obtained upper bounds are tighter. The results of [3] shows that tr(P) ≤ 111.7665, tr(P) ≤ 88.9502. But, the results of this study shows that tr(P) ≤ 85.0316. Then, we have the better results for upper bounds of trace of the solution of Lyapunove equation. Moreover, we give fine lower bounds. The work results illustrates that λn(P) ≥ 2.0867, tr(P) ≥ 8.0919. These lower bounds are new.

For verifying these outcomes, we demonstrate that mathematical evidence for better bound estimates of solution for the discrete Lyapunov equation from the numerical examples. Besides, performing the research for robust stability with some existing works would be valuable as future study. D. G. Lee[22][23] developed the works for robust stability of state feedback control with linear perturbation. As another work in stability analysis, the robust controller design for computer-controlled unified system is suggested by D. Lee and W. Lee [24]. Thus, the future study would be extended to the works for that of output feedback control for discrete-time and unified system. Another possible future research topic can be started from the research results of D.-G. Lee and I. Hyun [25]. They investigated the stochastic optimal controller design of decentralized singularly perturbed unified system. We consider this work would be extended to the study topic of feedback controller design with the case of linear perturbation.


References
1. Z. Gajic and M. T. J. Qureshi, "Lyapunov Matrix Equation in System Stability and Control", Academic Press, pp. 79-101, 1995.
2. Y. M. Kim and W. B. Baek, "Adaptive Sliding Mode Control based on Feedback Linearization for Quadrotor with Ground Effect", Journal of JAITC, Vol. 8, No. 2, pp. 101-110, Dec. 2018.
3. D. Lee, G. Heo, and J. Woo, "New Bounds using the solution of the discrete Lyapunov equation", International Journal of Control, Automation, and Systems, Vol. 1, No. 4, pp. 459-463, Dec. 2003.
4. Y. Fang, K. A. Loparo, and X. Feng, "New Estimates for Solutions of Lyapunov Equation", IEEE Trans. Automatic Control, Vol. 42, No. 3, pp. 408-411, Mar. 1997.
5. T. Mori, N. Fukuma, and M. Kuwahara, "Bounds in the Lyapunov matrix differential equation", IEEE Trans. Automatic Control, Vol. 32, No. 1, pp. 55-57, Mar. 1987.
6. H. T. Zhang, D. G. Lee, and D. C Oh, "New Bounds of the Solution for the Unified Lyapunov Matrix Equation", Journal of KIIT, Vol. 9, No. 3, pp. 1-9, Mar. 2011.
7. D. G. Lee, "A Comparative Study for New Estimates for Solution of Lyapunov Matrix Equation applied to Stability Analysis of Singularly Perturbed Systems", Journal of KIIT, Vol. 11, No. 1, pp. 35-44, Jan. 2013.
8. I. Hyun, M. E. Sawan, D. G. Lee, and D. Kim, "Robust stability for decentralized singularly perturbed unified system", Proceedings of the 2006 American Control Conference, Minneapolis, MN, USA, pp. 4338-4343, Jun. 2006.
9. N. Komaroff, "Upper Bounds for the Eigenvalues of the Solution of the Lyapunov Matrix Equation", IEEE Trans. Automatic Control, Vol. 35, No. 6, pp. 737-739, Jun. 1990.
10. T. Mori, N. Fukuma, and M. Kuwahara, "Bounds in the Lyapunov matrix differential equation", IEEE Trans. Automatic Control, Vol. 30, No. 9, pp. 925-926, Sep. 1985.
11. J. Garloff, "Bounds for the Eigenvalues of the Solution of the Discrete Riccati and Lyapunov Equation and the Continuous Lypunov Equation", International Journal of Control, Vol. 43, No. 2, pp. 423-431, May 1985.
12. N. Komaroff, "Upper Bounds for the Eigenvalues of the Solution of the Discrete Lyapunov Matrix Equation", IEEE Trans. Automatic Control, Vol. 35, No. 4, pp. 468-469, Apr. 1990.
13. C. H. Lee, "Upper and Lower Matrix Bounds of the Solution for the Discrete Lyapunov equation", IEEE Trans. Automatic Control, Vol. 41, No. 9, pp. 1338-1341, Sep. 1996.
14. T. Mori, N. Fukuma, and M. Kuwahara, "On the Discrete Lyapunov Matrix Equation", IEEE Trans. Automatic Control, Vol. 27, No. 2, pp. 463-464, Apr. 1982.
15. T. Mori, N. Fukuma, and M. Kuwahara, "On the Discrete Riccati Equation", IEEE Trans. Automatic Control, Vol. 32, No. 9, pp. 828-829, Sep. 1987.
16. N. Komaroff, "Lower Bounds for the Solution of the Discrete Algebraic Lyapunov Equation", IEEE Trans. Automatic Control, Vol. 37, No. 7, pp. 1017-1018, Jul. 1992.
17. N. Komaroff and B. Shahian, "Lower Summation Bounds for the Solution of the Discrete Riccati and Lyapunov Equation", IEEE Trans. Automatic Control, Vol. 37, No. 7, pp. 1017-1018, Jul. 1992.
18. M. Mrabti and A. Hmamed, "Bounds for the Solution of the Lyapunov Matrix Equation-A Unified Approach", System Control Letters, Vol. 18, No. 1, pp. 73-81, Jan. 1992.
19. A. W. Marshall, I. Olkin, and B. C. Arnold, "Inequalities: Theory of Majorization and its Applications", Springer-Verlag, New York, 2011.
20. G. H. Hardy, J. E. Littlewood, and G. Polya, "Inequalities", Cambridge University Press, 1952.
21. F. Zhang, "The Schur Complement and its Applications", Springer Verlag, New York, 2010.
22. D. G. Lee, "System Stability Analysis for Decentralized Singularly Pertrurbed Systems", Ph.D. Dissertation, Wichita State University, Wichita, USA, pp. 34-36, Dec. 2001.
23. D. G. Lee, "A Comparative Study for Robust Stability of State Feedback Control for Discrete-time and Unified System", Journal of KIIT, Vol. 13, No. 12, pp. 33-45, Dec. 2015.
24. W. S. Lee and D. G. Lee, "Robust Control using Output Feedback Control of Unified System", Journal of KIIT, Vol. 6, No. 6, pp. 14-19, Dec. 2008.
25. D. G. Lee and I. Hyun, "Stochastic Optimal Controller Design of Decentralized Singularly Perturbed Unified Systems", Journal of KIIT, Vol. 14, No. 12, pp. 33-45, Dec. 2016.

Authors
Dong-Gi Lee

1993 : BS degree in Department of Electronic Engineering, Dongguk University

1995 : MS degree in Department of Electronic Engineering, Dongguk University

1999 : MS degrees in Department of Electrical Engineering, Wichita State University, USA.

2001 : PhD degrees in Department of Electrical Engineering, Wichita State University, USA.

2002 ~ 2011 : Professor, Dep. of Electronics & Information Engineering, Konyang University, Korea

2012 ~ present : Professor, Dep. of Biomedical Engineering, Konyang University, Korea

Research interests : unified approach, optimal control, robust control, singular perturbation system, stochastic system

Inha Hyun

1989 : BS degree in Department of Mechanical Engineering, Korea Air Force Academy

1996 : MS degrees in Department of Electrical Engineering, Wichita State University, USA.

2006 : PhD degrees in Department of Electrical&Computer Engineering, Wichita State University, USA.

2007 ~ 2014 : Information & Communications Office, Korea Air Force Headquaters, Gyeryoung, Korea

2015 ~ 2017 : Korea Air Force Logistics Command, Daegu, Korea

2018 ~ present : Information & Communications Office, Korea Air Force Headquaters, Gyeryoung, Korea

Research interests : cmmunication system, unified approach, optimal control, robust control, singular perturbation system, stochastic system