+ All Categories
Home > Documents > Polar factorization of a matrix OF RESEARCH of the National Bureau of Sta ndards- B. Mathematics and...

Polar factorization of a matrix OF RESEARCH of the National Bureau of Sta ndards- B. Mathematics and...

Date post: 26-Apr-2018
Category:
Upload: lykhuong
View: 215 times
Download: 2 times
Share this document with a friend
3
JOURNAL OF RESEAR CH of the National Burea u of Standa rd s- B. Mathemati cs a nd Mathemati ca l PhysICS Vo l. 7 1B, Nos. 2 a nd 3, A p ril -Se pt em be r 1967 Polar Factorization of a Matrix-¥- John Z. Hearon** (April 24, 1967) It is known that if A is a bo und ed line ar ope rat or with cl ose d ran ge on a Hilbert s pa ce th en A c an be fac tor ed as A = UH, with U a partial is om e tr y and H nonn egative a nd s elf adjoint. For the finite- dim ensional ca se a strictly matrix-th e oreti c derivation is g iven b ase d on the c on cept of a general- ized inverse. Ce rtain properti es of the fac tors are giv en as we ll as co nditions und e r whi c h H or both U a nd H are uniqu ely dete rmin ed by A. A pivotal item in th e derivation is th e re prese ntation of a square partial isome tr y as the pr odu ct of a unit ary matrix and an orth ogonal proj ec tion. Thi s re prese ntation is new, of some inter es t in it se lf and gr ea tly simplifies the derivations. Key Words: Ge neralized in verse, matrix, partial isome tr y. 1. Introduction It is well known but not well di sc usse d in the matrix lite ratur e' that a s qu are matrix , A, can be fac- tored as A = UH where U is a partial i so metry and H is positive se midefinite. Th e primar y purpo se of this pap er is to give a fairl y dir ec t demons tration of this fa ctorization, and the main r es ult is thu s not new (see footnote 1) . Th e demons tr a ti on, as well as th e de du c tion of ce rtain pr operti es of the fac tor s, is base d on a c hara cteriza ti on of partial isometri es which is new a nd of some int erest per se. Whil e not strictly necessa ry it is possible a nd illuminating to cast part of the developme nt in te rm s of generalized inver ses of sing ular matri ces . 2. Notation and Preliminaries In what follows all matri ces ar e considered to have complex entri es . We denot e by p(A), R(A ), N(A) and A* rank, range, null space and conju ga te tran spose, res pec tively, of any given matrix. Wh en A is non- s in g ular , A-t denote s the inverse. For generalized inver ses a sp ec ial terminology is use d. Thi s termi- nology, pr eviously introdu ce d and re lat ed to others [5, 6)2 is as follows : For a giv en matrix A de not e by C, (A) the se t of all matri ces B su ch that ABA =A. Th en C2(A) is de fin ed as the set of all matri ces B such that BEC, ( A) and AEC, (B); C3( A) is the se t of all mat- ri ces B such that BEC2( A) a nd AB is he rmitian ; finally C4(A) is the set of all matI'i ces B such that BEC3(A) *An in vi ted pa per. ·* Presc nl addr ess: Mathemati ca l Researc h Branch, NIAMD, Na ti onal In stitutes of hea lth , Belhe, da. Md . 20014. 'The factoriza ti on, with condition fo r both fac tors to be uniqu e. cf. Theo rem 2 to foll ow, is given as a pro bl e m in l4 , p. 171]. Th e fac lorizati on is well kn ow n as a res ult fo r bounded ope rators with closed range on a Hilbert s pa ce [I. 8]. Desoc r and Whalen [1] give the fac- to ri za ti on where U h as the property that is the pse udo- in ve r se (which on a finit e- dimen- sional inner-product sp ace is the Moore-Penrose in ve rse) of U. This is e<luivaie nt to a part ial isome tr y. 2 Figur es ill br acke ts indi cate the lit eratur e refere nces at the end of thi s pape r. 65 and BA is hermitian. We note that the se t C4( A) co n- tains a s in gle uniqu ely dete rmin ed matrix which is the Moore-Pe nr ose generalized inver se [7]. We ca ll a matrix HEC _ ;i (A) a C i-inver se of A. Th e relation be- tw ee n a C;l' inver se, as here de fin ed, and th e "we ak generalized inver se" of Goldman and Zelen [3] h as bee n noted else wh ere [5]. Repe at ed u se will be made of th e followin g fact: If BEC, (A) th en p(B) ;;;,: p(A) = p(A B) = p(BA), with strict e quality if and only if BE CAA) [5, 9] . We call a matrix A a partial isome tr y if there e xi sts a subspace, S, such that x* A*Ax = x*x, wh en XE S, a nd Ax = 0, when X ES.l, where S.l is the orth ogo nal co mpl eme nt of S. This definition is equivalent to the re quir ement that A*A be an orthogonal proj ec ti on [2] , [4, p. 150]. 3. The Polar Factorization We begin with the following two le mm as LEMMA 1. The square matrix, A, is a partiaL i so m- etry if and onL y if A = QE wh ere Q is an isometry a nd E is an orthogonaL projection. PROOF. If A=QE , with Q*Q=I and E=£2 =E*, we have A* A = E and A is a partial isometry. Let A = QH be the usual polar factorization of A, where Q is unitary and H is positive semidefinite. If A is a partial isometry then A* A = H2 is he rmitian and ide mp otent. If so then H, th e positive semidefinite s quar e root of H2 , is also he rmitian id e mpot ent. REMARK. It is an obvious con se qu en ce of Lemma r that A is a partial isome tr y if and only if A = FQ where F is an orthogonal proj ec tion and Q is unitary. For, from A = QE we have A = QEQ*Q, and we identify F with the orthogonal proj ec tion QEQ*. Conversely A=FQ=QQ*FQ=QE. LEMMA 2. Let A be normal and BECt(A). Then if E=AB is normal, E is uniquely det e rmin ed by A, and EA =AE=A.
Transcript

JOURNAL OF RESEARCH of th e Na tiona l Bureau of Sta nda rd s- B. M a th em a ti cs and M a th ema tica l PhysICS Vo l. 7 1 B, Nos. 2 a nd 3, A p ril -Septem ber 1967

Polar Factorization of a Matrix-¥-

John Z. Hearon**

(April 24, 1967)

It is known that if A is a bounded linear operator with closed range on a Hilbe rt space then A can be fac tored as A = UH, with U a partial isometry and H nonnegative and self adjoint. For the finite ­dimensional case a s tri ctly matrix-theoretic derivation is given based on the concept of a ge neral­ized inverse. Certain properti es of the factors are give n as well as conditions under whic h H or both U and H are uniquely de termined by A. A pivotal ite m in the derivation is the representation of a square partial isometry a s the produc t of a unitary matrix and a n orthogonal projection. Thi s representa tion is new, of some int e rest in itse lf and greatl y s impli fies the de rivations.

Key Words: Genera lized in verse, matrix, parti a l isometry.

1. Introduction

It is well known but not well di scussed in the matrix literature ' that a squ are matrix , A, can be fac­tored as A = UH where U is a partial iso me try and H is positive semidefinite. The primary purpose of thi s paper is to give a fairl y direc t de monstration of thi s factorization , and the main res ult is thus not ne w (see footn ote 1). The demonstra tion, as well as the deduc tion of certain properti es of the fac tors, is based on a characteriza ti on of parti al iso me tries whic h is new a nd of so me interes t per se. While not stri c tl y necessary it is possible and illuminating to cast part of the development in terms of ge neralized in verses of singular matri ces.

2. Notation and Preliminaries

In what follows all matrices are considered to have co mplex e ntries . We denote by p(A), R(A), N(A) and A* ra nk, range, null space and conjugate transpose, res pectively , of any given matrix. When A is non­s in gular, A- t denotes the inverse. For generalized inverses a special terminology is used. This termi­nology, previously introduced and related to others [5, 6)2 is as follows : For a given matrix A denote by C, (A) the se t of all matrices B such that ABA =A. The n C2(A) is defin ed as the se t of all matrices B such th at BEC,(A) and AEC,(B); C3(A) is the set of all mat­ri ces B such that BEC2(A) and AB is hermitian ; finally C4(A) is the set of all matI'ices B such that BEC3(A)

*An in vi ted pa per. ·*Prescnl address: Mathematical Researc h Branch, NIAMD , Na tional Ins titut es of

health , Belhe,da. Md. 20014. 'The factori za tion , with condition fo r both factors to be unique. cf. Theorem 2 to follow,

is given as a proble m in l4 , p. 171]. The fac lorization is well known as a res ult for bounded opera tors with c losed range on a Hilbe rt s pace [I. 8]. Desocr a nd Whalen [1] give the fac­tori za tion where U has the propert y that U· is the pseudo- in verse (which on a finit e-dimen­s iona l inne r-product space is the Moore-Penrose inve rse) of U. Thi s is e<luivaie nt to U bei ~g a part ial isometry.

2 Figures ill brackets indicate the literature references at the end of thi s pape r.

65

and BA is hermitian. W e note that the se t C4(A) con­tains a s ingle uniquely de termin ed ma trix which is the Moore-Penrose generalized inverse [7]. W e call a matrix HEC_; i(A) a C i-inverse of A. The relation be­tween a C;l'inverse, as here de fined, and the "weak generalized inverse" of Goldman and Zele n [3] has been noted elsewhere [5]. Repeated use will be made of the followin g fact: If BEC, (A) then p(B) ;;;,: p(A) = p(A B) = p(BA), with stric t equality if and only if BECAA) [5, 9].

We call a matrix A a parti al iso metry if the re exi sts a s ubs pace, S, s uch tha t x* A* Ax = x*x, when XES, and Ax = 0, whe n XES.l, where S.l is the orthogo nal comple ment of S. This de finiti on is equivale nt to the require ment th at A* A be an orthogonal projec tion [2], [4, p. 150].

3. The Polar Factorization

We begin with the following two lemmas LEMMA 1. The square matrix, A, is a partiaL isom­

etry if and onLy if A = QE where Q is an isometry and E is an orthogonaL projection.

PROOF. If A=QE, with Q*Q=I and E=£2 = E*, we have A* A = E and A is a partial isometry. Let A = QH be the us ual polar factorization of A , where Q is unitary and H is positive se midefinite. If A is a partial isometry then A* A = H2 is he rmitian and ide mpote nt. If so then H, the positive se midefinit e square root of H2 , is also hermitian ide mpotent.

REMARK. It is an obvious conseque nce of Lemma r that A is a partial isome try if and only if A = FQ where F is an orthogonal projection and Q is unitary. For, from A = QE we have A = QEQ*Q, and we identify F with the orthogonal projection QEQ*. Conversely A=FQ=QQ*FQ=QE.

LEMMA 2. Let A be normal and BECt(A). Then if E=AB is normal, E is uniquely determined by A, and EA =AE=A.

l_

PROOF. F rom ABA = A = EA it follows that Ax = Ax, implies Ex=x, provided A. "" 0. Let peA) = r. Then there are linearly independent Xi such that Ex i = Xi , 1 ,,;; i ,,;; r, and since pee) = p(A) we have R(E) =R(A). Since E is a normal projection , it is an orthogonal pro· jection and thus uniquely de termined by its range and he nce by A. Further , since E and A are normal, EA = A shows that N(E) =N(A). Hence E and A have a com­ple te set of eigenvec tors in common and must commute.

THEOREM 1. Let A be any n-square matrix . Then there exists a partial isometry U and a positive semi­definite matrix H, such that

(i) A=UH , (ii) U*A = H , (iii) N(U) = N(H) = l'< ~A) , (iv) U maps all of n-space onto R(A) (v) UH = HU if and only if A is normal , and in this

case U is normal . PROOF. Let A = QH be the usual polar fac torization

of A, whe re Q is unit ary and H is positive semidefi­nite. Le t P be a ny CI-inverse of H s uch that E = H P is an orthogonal projec ti on. Th en HPH = EH = H and we have A = QH = QEH = VH , where V = QE is, by Lemma 1, a parti al isome try . Thu s (i) is proved. Now V*V =E and he nce , from (i) , V*A = EH=H whi ch is (ii). It is clear tha t N(U) = N(E) and th at N(A) = N(H): and since pee ) = P(H) , EH = H s hows th at N(E)=N(H). Thu s N( U) = N(E) = N(H) = N(A ), which gives (iii ). Give n A , the projec tion E = HP is, b y Le mma 2, uniquely determined. If P is chosen to be non­si ngular , as is plainly poss ible (see aft e r (2) be low), the n A = VH = VEP- I= VP- I, and (iv) is evide nt. S uppose A to be norm al. The n A = QH = HQ and [rom thi s and EH = HE = H, whi eh we have from Le mm a 2 (but whic h in thi s case is obvious from EH = H since E a nd H are hermiti an), it follows that EA = AE = A. But thenAE =A = HQE = HV= VH. Con­ve rsely, s uppose VH = HU. We have a t once that AE = EA = A , which shows that N (A* ) = N(E) = N (A). Given this, and N( H ) = N(E), we have from A* = HQ* that QYEN (E) whenever YEN(E). W e can now assert that HQy = QHy = O, wh en YEN(E). Finally, HU= HQE = VH = QH implies that HQx = QHx, when xER(E). We have proved that HQ = QH and hence that A is normal. Given this , from A = QH = QEH = HQ = EHQ =EQH , we ha ve QEx = EQx when xER(H) , and we have seen that QYEN(E) = N( H) when YEN(E) . Thus QE = EQ and V is normal.

THEOREM 2. Let A = UR , where U is a partial isom­etry and H is positive semidefinite. Consider the con­dit ions: (i) U* A = H , (ii ) p(U) = p(H), (i ii) N(U) = N(H). Then, if (i) holds, H is uniquely determined; (iii) holds if and only if( i) and (ii ) hold, and in that case both U and H are uniquely determined.

PROOF. By Le mma 1, we may replace V by QE with Q unitSlry and E an orthogonal projec tion. Then, if (i) holds, V* A = EH = H. Thi s bein g so , we have A = VH = QEH =QH, and H2= A*A. Thus H is the unique positive se mide finit e square root of A* A. We next show that (i ii) is equi vale nt to (i) and (ii) together. Let (i) a nd (i i) hold. T hen, with V = QE , (i) gives V* A = EH = H, whi ch with (ii) implies (iii). Let (iii) hold.

66

W e obviously then have (ii) . Furthe r, with U= QE, (iii) states N(E)=N(H). Let XI, X2, . .. , x,. be any orthonormal bas is of N(E) =N(H) . The n from E = I - lxixi', we have EH=HE = H. This being the case, V*A=EH= H which is (i). Now let A = UBI =U2H2

be any two fac torizations of A and assume (iii). Since (iii) implies (i), HI = H2 = H and we have VIH = V2H which implies Vlx= V2x , when xER(H). But (iii) now also requires N(VI) =N(Uz) = N(H) and hence VI Y = V2y for YEN(H) . Thus VI = V2.

If H is hermitian , then H = T diag (A , O)T*, where T is unitary , A is real , diagonal and nonsingular. In the following disc ussion le t this unitary similarity via T be denoted by H - diag (A, 0) . The n for arbitrary K , L , and D of appropriate sizes and shapes any P such that

[A- I

P -L

(1)

is a Ct-inverse of H. For, from

(2)

we have th at HP is ide mpotent and has the rank of H and thi s is kn own [5] to be necessary and suffi cie nt for PEC(H). N ow E, in (2) , is hermitian if and only if K = O. Thu s gi ven K=O , any P as in (1) will serve in the proof of (i), (ii) , (iii) and (v) of Theorem 1, and an y P as in (1) with D nonsin gular will serve in the proof of (iv) of Theore m 1. Now we could , in th e proof of Theore m 1 exce pt for (iv ), forthwith have take n PEC(H) or PEC3(H) , for· in both cases E = HP is he rmitian . For the proof of (iv) , we could have the n not ed that for PEC4 (H) , P + Ell is nonsingular when Ell is the princ i­pal ide mpotent matrix of H (and of P) associated with the zero root ,3 and H(P + Eo) = HP = E. Of course th e T heore m 1 could be proved, without reference to ge nerali zed inverses, by simply producin g P as in in (1) with K = 0, noting that E as in (2) is then hermi­ti an ide mpotent , a nd that , subject to K = O, E is in­variant under choices of P. The pivotal idea of the proof is th e ob servation th at given A = QH, we have (i) of Theore m 1 at once , in view of Lemma 1, if we can produce an orthogonal projectio n, E, such th at EH = H. Thi s possibility is suggested by considering generali zed in verses and that it is indeed possi ble is percei ved a t once by considering the Moore-Pe nrose ge neralized in verse , but as we have see n, other " in­verses" will serve as well.

In the proof of (iv) of Theore m 1 and in the above di scussion we have encountered an observation whic h may be set out as a corollary.

CORoLLARY. If A is any square matrix, there exist matrices P such that AP is a partial isometry. Further there exis t such matrices P which are normal , in par­ticular positive definit e.

3 Eo is the ort.hogonal projec t ion upon N( H ) = N (P}.

4 I

I

PROOF. As we have seen any P as in (1) with K = 0 has the required property. Any P as in (1) with K = 0, L = 0 , D normal and nonsingular is normal and non· singular and has the required property. In particular, if K = 0, L = 0, and D is positive definite, we have a positive definite P from (1).

From Theorem 1, the corollary and the usual polar fac torization A = QH , we have the following statement: If A is any square matrix , there exists an isometry Q and a partial isometry U such that Q*A=U*A = H, where H is positive semidefinite. If A is nonsingular there exists a positive definite matrix, C, such that AC = Q is an isometry, but there always exists a posi· tive de finite P such that AP = U is a partial isometry.

4. References

[11 C. A. Desoer and B. H. Whalen, A note on pseudoinverses , J. . Soc. Indus!. Appl. Math. 11 , 442- 447 (1963).

67

(2] I. Erdelyi, On partial isometries in finite·dimensional euclidean spaces , J. SIAM Appl. Math. 14, 453-467 (1966).

'(3J A. J. Goldman and M. Zelen, Weak generalized inverses and minimum variance linear unbiased es timation, J. Res. NBS, 68B (Math. and Math. Phys.) No.4, 151- 172 (1964).

[4] P. Halmos, Finite·dimensional vec tor spaces (D. Van Nostrand, New York , 1958).

(5] J. Z. Hearon, Co nstruction of EPr gene ralized inverses by inver· sion of nonsingular matrices, J. Res . NBS 71B (Math. and Math. Phys.) Nos. 2 & 3, (1967).

(6] J. Z. Hearon, A generalized matrix vers ion of Rennie's inequality, J. Res. NBS 7lB (Math. and Math. Phys.) No.2, (1967).

(7] R. Penrose, A generalized inverse for matrices, Proc . Cambridge Philos. Soc. 51, 406-418 (1955).

(8] F . Riesz and B. Nagy, Functional Analysis, Frederic k Ungar, New York, 1955.

(9] C. A. Rohde, Some results on generalized inverses, SIAM Rev. 8, 201- 205 (1966).

(Paper 7lB2 & 3- 200)


Recommended