Gradient-Based Iterative Algorithm for a Coupled Complex Conjugate and Transpose Matrix Equations ()
1. Introduction
How to solve a matrix equation is a focus question of the applied mathematics and engineering fields [1] [2]. Based on the classical iterative algorithm and the hierarchical identification principle, some gradient-based and least squares based iterative algorithms were established. This method has been developed in solving other coupled matrix equations [3]. For example, to speed up the convergence behavior, a shift-splitting hierarchical identification method was suggested [4]. Different from the above work, Zhou and his coworkers determined the optimal convergence factor using the object function and gradient search method [5] [6].
Although achieving some fruitful results, there are still some problems that need to be solved. For example, the gradient-based iterative algorithm for solving a class of complex matrix equations was established and the sufficient condition for the convergence of the algorithm was obtained [3]. So far this conjecture is still open. Although the convergence theory has been established for the real linear matrix equations [5] [7] [8] [9], the corresponding convergence theory for the complex matrix equations is still open especially for the complex matrix equations with conjugate transpose unknown matrices.
Inspired by the above work, this paper discusses gradient-based iterative algorithm for a coupled complex conjugate and transpose matrix equation. Using the real representation of a complex matrix, the convergence proof is given and the optimal convergence factor is determined. An numerical test is offered to validate the efficacy of the suggested algorithm.
We organized this paper as follows. Some preliminary lemmas and symbols are listed in Section 2. Section 3 proves convergence of the gradient-based iterative algorithm for solving a coupled complex conjugate and transpose matrix equation. Section 4 brings a numerical test to validate the efficacy of the proposed algorithm. Some concluding remarks are given in Section 5.
2. Preliminary Symbols and Lemmas
Let
be an
complex matrix, symbols
,
,
,
,
,
,
represents the conjugate, the conjugate transpose, the transpose, the maximal eigenvalue, the minimal nonzero eigenvalue, the spectral norm, the Frobenius norm, respectively.
denotes an identity matrix of size
. Let
be
real matrix and
, symbol
represents the nonzero singular values that satisfy
.
denotes an mn-dimensional vector defined by the formula
. Here,
. The Kronecker product
of matrices
and
is defined by formula
. Here
,
.
Next lemma is a conclusion of the singular values decomposition of a complex matrix, the proof can be found in a standard matrix theory book, we omit the proof here.
Lemma 1.
is an
complex matrix and
. There exist two unitary matrices
and
such that
(1)
where
with order
.
Refer to [10], we have the real representation of a complex matrix.
For a complex matrix
, it can be exclusive signified as
, where
are two real matrices. Now we use symbol
to represent it as
(2)
with this symbol, in the following we use the following notation
,
and
. Because
we use
to represent
and have symbols:
(3)
Using symbols [10]
We have the following lemma [10].
Lemma 2. The real representation possesses the following properties:
1) If
,
, then
2) If
, then
3) If
,
,
, then
The proof one can refer to [10] [11], we omit the proof here.
Next lemma describes the properties of the spectral norm and the Frobenius norm.
Lemma 3. Let
be a complex matrix, we have
1)
,
2)
.
For the complex matrix equation
, referring to [12], we have the following gradient-based iterative algorithm.
Lemma 4. For the complex matrix equation
, if
is a column-full rank matrix and
is a row-full rank matrix, then the iterative solution
given by the gradient-based iterative algorithm
converges to the exact solution
(i.e.,
) for any initial values
if and only if
Moreover, the best convergence factor
is
3. Complex Coupled Conjugate and Transpose Matrix Equations
In this section, we suggest the gradient-based iterative algorithm for solving the complex coupled conjugate and transpose matrix equations. For convenience, we introduce the following operator
(4)
Using these operators, we consider the following complex coupled matrix equations
(5)
where
,
, are known matrices and
are the matrices to be determined.
3.1. The Exact Solution
According to the definition of the real representation of a complex matrix and Lemma 2, the real representation of matrix
denoted as
can be rewritten as
(6)
Taking the vec-operator of the above equation gives
(7)
Here, symbol
is defined as
(8)
Taking the real representation of Equation (5) gives
(9)
Taking the vec-operator of the above system, we have
(10)
Using notation
gives
(11)
Setting
Equation (11) can be rewritten in a compact one as
(12)
For Equation (12), we have the following result.
Lemma 5. If matrix
is invertible, then Equation (12) has a unique solution and it can be given by formula
According to Lemma 4, the gradient-based iterative algorithm
(13)
converges to the exact solution pair
and
for any initial values
and
if and only if
Moreover, the best convergence factor
is
Clearly, if
then we have
,
and
. The increasing dimension leads to a computational difficulty due to an excessive computer memory. To overcome this problem, next we construct a gradient-based iterative algorithm by using the hierarchical identification principle.
3.2. The Iterative Solution
For convenience, we introduce notation
and
as follows:
(14)
(15)
According to the hierarchical identification principle, we introduce the intermediate matrices:
(16)
(17)
(18)
(19)
(20)
(21)
(22)
(23)
Equation (5) can be decomposed into the following matrix equations
(24)
(25)
(26)
(27)
(28)
(29)
(30)
(31)
According to Lemma 4, with proper manipulations, one can construct the following iterative algorithms for matrix equations in Equations (24)-(30) respectively,
(32)
(33)
(34)
(35)
(36)
(37)
(38)
(39)
(40)
(41)
(42)
(43)
(44)
(45)
(46)
(47)
Substituting Equations (16)-(23) into Equations (32)-(47) respectively gives
The unknown matrices
and
appear in the right-hand sides of the above equations, so it is impossible to realize the above algorithms. According to the hierarchical identification principle, the unknown matrices
and
can be replaced by their estimates
and
. Since only two iterative values
and
are needed, we take the average of
,
,
,
,
,
,
and
as the iterative value
and
,
,
,
,
,
,
and
as the iterative value
, respectively. We have the following algorithm:
(48)
(49)
(50)
(51)
(52)
(53)
(54)
(55)
(56)
(57)
(58)
(59)
(60)
(61)
(62)
(63)
(64)
(65)
(66)
(67)
Theorem 6. If the complex matrix Equation (5) has a unique solution pair
and
, then the iterative solution pair
and
given by the algorithm in Equations (50)-(66), converges to the unique solution pair
and
if and only if
(68)
Under these conditions, the best convergence factor
is
(69)
Proof. Similar to symbols in Equation (3), we use the following notation:
(70)
For convenience, we set
. Taking the real representation of the both sides of Equation (50) gives
(71)
Similarly, taking the real representation of Equations (50)-(64) give
(72)
(73)
(74)
(75)
(76)
(77)
(78)
(79)
(80)
(81)
(82)
(83)
(84)
(85)
(86)
(87)
Taking the vec-operator of Equations (71)-(86) respectively gives
(88)
(89)
(90)
(91)
(92)
(93)
(94)
(95)
(96)
(97)
(98)
(99)
(100)
(101)
(102)
(103)
(104)
(105)
Using notation in Equations (8) and Equations (104) and (105), the above equations can be equivalently written as
(106)
(107)
Combining these two equations gives
(108)
According to notation in Equations (48) and (49) and using the conclusions in Equations (12) and (7), we have
(109)
Substituting Equation (109) into Equation (108) gives
(110)
According to Lemma 4, if the algorithm in Equation (110) is convergent if and only if the convergence factor
satisfies
(111)
Namely, we have
The reminder of this theorem can be proved by referencing to Lemma 4. The proof is completed.
Remark 1. Although some similar iterative algorithms have been established, in the preceding proof [3], there is only the proof about the sufficient condition of the convergence factor for the convergence. Using the real representation tool, Theorem 6 offers the sufficient and necessary condition proof for the first time.
Remark 2. Although the sufficient and necessary condition of the convergence for algorithm in Equations (50)-(66) is given in Theorem 6, the Kronecker product and the real presentation of the coefficient matrices are involved in computing
, this results in the high dimensionality problem. To overcome this drawback, we give a sufficient condition for the suggested iterative algorithm.
Corollary 1. If the system of the complex coupled matrix Equations (5) has a unique solution pair
and
then the iterative algorithm in Equations (50)-(66) will converge to the solution pair
and
if
(112)
Here
Proof. Recall
and
and refer to Lemma 3, we have
(113)
Noting the notation in Equation (8), we have
(114)
Combining Equations (113) and (114) gives
(115)
Substituting Equation (115) into Equation (112) gives Equation (112). The proof is completed.
In the practical work, condition
almost does not hold, so we use symbol “≤” to replace “<” in Corollary 1. Clearly, the Frobenius norm
is easier to compute then
in practical work.
4. Numerical Test
In this section, we bring a numerical test to validate the efficacy of the related conclusions. Equation (5) includes some coupled complex matrix equations as its special cases. For convenience, we consider the following equation
with
The unique solution pair of this system is
According to the suggested algorithm in Equations (50)-(66), we can construct the gradient-based algorithm for this system as follows:
(116)
(117)
(118)
(119)
(120)
According to Corollary 1, a sufficient condition for the convergence factor
is
We take
as the initial iterative value and use the iterative technique in Equations (116)-(120) to compute
and
. The relative error with different convergence factors is shown in Figure 1, where
is the relative error.
From Figure 1, we find that the relative error
becomes smaller and approaches zero as the iterative stepk increases. This denotes that the suggested algorithm is efficacy and convergent. From the three convergence curves, we find that the convergence effectiveness is improved when the convergence factor is changed from
to
via
. In this example, we have
so the range of the convergence factor of Corollary 1 is conservative. Actually,
plays the role of the best convergence factor in this numerical example.
![]()
Figure 1. The relative error
versus iteration k.
5. Conclusion
This paper brings the gradient-based iterative technique for a coupled complex conjugate and transpose matrix equation. The convergence proof is offered. In the proof process, the necessary and sufficient conditions for the convergence factor are determined to guarantee the convergence of the algorithm. And the optimal choice of the convergence factor is settled theoretically. A numerical test is offered to validate the efficacy of the suggested algorithm. The iterative strategy used in this paper can be used in the system identification.