+ All Categories
Home > Documents > Discrete multitone modulation with principal component...

Discrete multitone modulation with principal component...

Date post: 20-Aug-2020
Category:
Upload: others
View: 2 times
Download: 0 times
Share this document with a friend
16
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS—I: FUNDAMENTAL THEORY AND APPLICATIONS, VOL. 49, NO.10, OCTOBER 2002 1397 Discrete Multitone Modulation With Principal Component Filter Banks P. P. Vaidyanathan, Fellow, IEEE, Yuan-Pei Lin, Member, IEEE, Sony Akkarakaran, Member, IEEE, and See-May Phoong, Associate Member, IEEE Abstract—Discrete multitone (DMT) modulation is an attractive method for communication over a nonflat channel with possibly colored noise. The uniform discrete Fourier transforn (DFT) filter bank and cosine modulated filter bank have in the past been used in this system because of low complexity. We show in this paper that principal component filter banks (PCFB) which are known to be optimal for data compression and denoising applications, are also optimal for a number of criteria in DMT modulation communica- tion. For example, the PCFB of the effective channel noise power spectrum (noise psd weighted by the inverse of the channel gain) is optimal for DMT modulation in the sense of maximizing bit rate for fixed power and error probabilities. We also establish an opti- mality property of the PCFB when scalar prefilters and postfilters are used around the channel. The difference between the PCFB and a traditional filter bank such as the brickwall filter bank or DFT filter bank is significant for effective power spectra which depart considerably from monotonicity. The twisted pair channel with its bridged taps, next and fext noises, and AM interference, therefore appears to be a good candidate for the application of a PCFB. This will be demonstrated with the help of numerical results for the case of the ADSL channel. Index Terms—Channel capacity, digital subscriber loops (DSL), discrete multitone (DMT) modulation , frequency division multi- plexing (FDM), principal component filter banks (PCFB). I. INTRODUCTION D ISCRETE multitone (DMT) modulation for nonflat chan- nels has been studied by a number of authors in the last decade. The theoretical advantages of multitone modulation were demonstrated in the pioneering paper by Kalet [15] more than ten years ago. DMT has been considered seriously for use in digital subscriber loops (DSL), and excellent descriptions of this can be found in [10] and [31], The DMT system can be regarded as a filter bank in transmultiplexer configuration [1], [36], [41]. Typically, the filter banks used for this purpose are Manuscript received December 11, 2001; revised April 3, 2002. This work was supported in part by the National Science Foundation under Grant MIP- 0703755, in part by the Office of Naval Research under Grant N00014-99-1- 1002, in part by Microsoft Research, Redmond, WA, and in part by the National Science Council (NSC), Taiwan, R.O.C., under Grant 89-2213-E-009-118 and Grant 89-2213-E-002-122. This paper was recommended by Associate Editor W.-S. Lu. P. P. Vaidyanathan and S. Akkarakaran are with the Department of Electrical Engineering, California Institute of Technology, Pasadena, CA 91125 USA (e-mail: [email protected]). Y.-P. Lin is with the Department of Electrical and Control Engineering, Na- tional Chiao Tung University, Hsinchu, Taiwan, R.O.C. S.-M. Phoong is with the Department of Electrical Engineering and Graduate Institute of Communication Engineering, National Taiwan University, Taipei, Taiwan, R.O.C. Digital Object Identifier 10.1109/TCSI.2002.803249. DFT filter banks which can be implemented efficiently with the FFT. The filters in these DFT filter banks provide poor separation between adjacent subchannels [27]. It is known that the use of better filters improves performance (e.g., higher bit rate for fixed error probabilities and power). This was clearly demonstrated in [27] using cosine modulated filter banks (CMFB) with sharp filters. Advantages of more general filter banks for this application are also described in [9]. In this paper, we consider a special type of orthonormal filter banks called the principal component filter bank (PCFB) (reviewed in Section IV) and show that it is optimal for the DMT application in a well-defined theoretical sense. The filter responses in the PCFB depend on the channel transfer function and the noise power spectrum. Moreover even though PCFBs can be defined for infinite filter orders, they are evidently unrealizable. However, there appear to be two reasons why the optimality of the PCFB is of interest. First, it serves as a benchmark for comparing the performance of conventional unoptimized DMT systems which use the DFT, CMFB, and so forth. Second, in applications where the channel characteristics are fixed (e.g., twisted pair lines with standard next and fext noise) we can design the PCFB apriori and approximate it with practical digital filters. Such approximations can yield better performance than unoptimized designs like the DFT at the expense of higher complexity of implementation. A. Outline and Relation to Past Work The PCFB was introduced first in [32] and its optimality for a variety of problems was suggested in [35]. It has since been proved to be optimal for a general class of objective functions in signal processing [4], [24], [37], [46]. The role of a specific class of PCFBs in the optimality of DMT systems was first ob- served in [22]. A related problem, namely the optimization of filter bank precoders [13], [44] has been considered in great depth in a series of recent papers by Giannakis and his group [13], [28], [29]. The precoder typically introduces redundancy (like a non maximally decimated filter bank) to combat inter- symbol interference. The precoder and receiver filters can be optimized according to several possible criteria. In this context, an excellent unification of several filter-bank based communi- cation systems (including DMT) can be found in [28]. In this paper, we consider the specific role of the PCFB in the design of optimal orthonormal DMT systems. We believe this provides a fundamentally different viewpoint. Two other excellent papers on related optimizations should be mentioned here. In [7], the authors consider many fundamental 1057-7122/02$17.00 © 2002 IEEE
Transcript
Page 1: Discrete multitone modulation with principal component ...systems.caltech.edu/dsp/students/sony/journ/ppsdmtieee.pdf · IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS—I: FUNDAMENTAL

IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS—I: FUNDAMENTAL THEORY AND APPLICATIONS, VOL. 49, NO. 10, OCTOBER 2002 1397

Discrete Multitone Modulation With PrincipalComponent Filter Banks

P. P. Vaidyanathan, Fellow, IEEE, Yuan-Pei Lin, Member, IEEE, Sony Akkarakaran, Member, IEEE, andSee-May Phoong, Associate Member, IEEE

Abstract—Discrete multitone (DMT) modulation is an attractivemethod for communication over a nonflat channel with possiblycolored noise. The uniform discrete Fourier transforn (DFT) filterbank and cosine modulated filter bank have in the past been used inthis system because of low complexity. We show in this paper thatprincipal component filter banks (PCFB) which are known to beoptimal for data compression and denoising applications, are alsooptimal for a number of criteria in DMT modulation communica-tion. For example, the PCFB of the effective channel noise powerspectrum (noise psd weighted by the inverse of the channel gain)is optimal for DMT modulation in the sense of maximizing bit ratefor fixed power and error probabilities. We also establish an opti-mality property of the PCFB when scalar prefilters and postfiltersare used around the channel. The difference between the PCFB anda traditional filter bank such as the brickwall filter bank or DFTfilter bank is significant for effective power spectra which departconsiderably from monotonicity. The twisted pair channel with itsbridged taps, next and fext noises, and AM interference, thereforeappears to be a good candidate for the application of a PCFB. Thiswill be demonstrated with the help of numerical results for the caseof the ADSL channel.

Index Terms—Channel capacity, digital subscriber loops (DSL),discrete multitone (DMT) modulation , frequency division multi-plexing (FDM), principal component filter banks (PCFB).

I. INTRODUCTION

D ISCRETE multitone (DMT) modulation for nonflat chan-nels has been studied by a number of authors in the last

decade. The theoretical advantages of multitone modulationwere demonstrated in the pioneering paper by Kalet [15] morethan ten years ago. DMT has been considered seriously for usein digital subscriber loops (DSL), and excellent descriptionsof this can be found in [10] and [31], The DMT system can beregarded as a filter bank in transmultiplexer configuration [1],[36], [41]. Typically, the filter banks used for this purpose are

Manuscript received December 11, 2001; revised April 3, 2002. This workwas supported in part by the National Science Foundation under Grant MIP-0703755, in part by the Office of Naval Research under Grant N00014-99-1-1002, in part by Microsoft Research, Redmond, WA, and in part by the NationalScience Council (NSC), Taiwan, R.O.C., under Grant 89-2213-E-009-118 andGrant 89-2213-E-002-122. This paper was recommended by Associate EditorW.-S. Lu.

P. P. Vaidyanathan and S. Akkarakaran are with the Department of ElectricalEngineering, California Institute of Technology, Pasadena, CA 91125 USA(e-mail: [email protected]).

Y.-P. Lin is with the Department of Electrical and Control Engineering, Na-tional Chiao Tung University, Hsinchu, Taiwan, R.O.C.

S.-M. Phoong is with the Department of Electrical Engineering and GraduateInstitute of Communication Engineering, National Taiwan University, Taipei,Taiwan, R.O.C.

Digital Object Identifier 10.1109/TCSI.2002.803249.

DFT filter banks which can be implemented efficiently withthe FFT. The filters in these DFT filter banks provide poorseparation between adjacent subchannels [27]. It is known thatthe use of better filters improves performance (e.g., higher bitrate for fixed error probabilities and power). This was clearlydemonstrated in [27] using cosine modulated filter banks(CMFB) with sharp filters. Advantages of more general filterbanks for this application are also described in [9]. In thispaper, we consider a special type of orthonormal filter bankscalled the principal component filter bank (PCFB) (reviewed inSection IV) and show that it isoptimal for the DMT applicationin a well-defined theoretical sense.

The filter responses in the PCFB depend on the channeltransfer function and the noise power spectrum. Moreover eventhough PCFBs can be defined for infinite filter orders, they areevidently unrealizable. However, there appear to be two reasonswhy the optimality of the PCFB is of interest. First, it serves asa benchmark for comparing the performance of conventionalunoptimized DMT systems which use the DFT, CMFB, and soforth. Second, in applications where the channel characteristicsare fixed (e.g., twisted pair lines with standardnext and fextnoise) we can design the PCFBapriori and approximate it withpractical digital filters. Such approximations can yield betterperformance than unoptimized designs like the DFT at theexpense of higher complexity of implementation.

A. Outline and Relation to Past Work

The PCFB was introduced first in [32] and its optimality fora variety of problems was suggested in [35]. It has since beenproved to be optimal for a general class of objective functionsin signal processing [4], [24], [37], [46]. The role of a specificclass of PCFBs in the optimality of DMT systems was first ob-served in [22]. A related problem, namely the optimization offilter bank precoders [13], [44] has been considered in greatdepth in a series of recent papers by Giannakis and his group[13], [28], [29]. The precoder typically introduces redundancy(like a non maximally decimated filter bank) to combat inter-symbol interference. The precoder and receiver filters can beoptimized according to several possible criteria. In this context,an excellent unification of several filter-bank based communi-cation systems (including DMT) can be found in [28]. In thispaper, we consider the specific role of the PCFB in the designof optimal orthonormal DMT systems. We believe this providesa fundamentally different viewpoint.

Two other excellent papers on related optimizations should bementioned here. In [7], the authors consider many fundamental

1057-7122/02$17.00 © 2002 IEEE

Page 2: Discrete multitone modulation with principal component ...systems.caltech.edu/dsp/students/sony/journ/ppsdmtieee.pdf · IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS—I: FUNDAMENTAL

1398 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS—I: FUNDAMENTAL THEORY AND APPLICATIONS, VOL. 49, NO. 10, OCTOBER 2002

questions pertaining to transmission of signals in blocks, overdispersive channels. One of the results there is on the optimiza-tion of the covariance matrix of the transmitted block to maxi-mize mutual information. The authors also show how such co-variance can be realized by filter design. Next, a very generalproblem of filter bank optimization is handled in [30] where theauthors optimize mutual information by optimizing the transmitand receive filters. Both zero forcing equalizers and minimummean square equalizers come out of this elegant approach asspecial cases. In our paper, we consider the case of orthogonalfilter banks with the perfect reconstruction property and assumethat the channel is equalized by a zero forcing equalizer. Fur-thermore, we do not consider the mutual information but in-stead consider the optimization of useful quantities such as, forexample, the actual bit rate with fixed error probabilities andtransmitted power. This makes the problem much simpler andleads to very elegant insights. For example, it becomes clear thatPCFBs optimize the bit rate for a fixed set of error probabili-ties and power. There is some commonality between the themeof our paper and the results in [30] and [7]. We shall see how-ever, that the approach here is simpler and insightful because wefocus directly on the PCFB solution based on simple convexityarguments.

In Section II, we describe the DMT system using multiratefilter bank language and formulate a noise model. The bene-fits of optimizing the transmitting filters is motivated with asimple example in Section III. A brief review of PCFBs andtheir optimality is given in Section IV. More details on this sec-tion can be found in [4], [5]. Various criteria for the optimiza-tion of orthonormal DMT filter banks are presented in Section Vand solutions presented. The role of principal component filterbanks for asymmetric DSL (ADSL) service on twisted pairs isexplained in Section VI, along with some numerical examples.Prefiltered orthonormal DMT systems (which are biorthogonalrather than orthonormal) are considered in Section VII and it isshown again that the PCFB has a role in optimality. Some partsof this paper have appeared in [38] and [39].

B. DSP and Multirate Notations

Bold faced letters denote matrices and vectors. The trans-pose, conjugate, and transpose–conjugate of a matrix are de-noted, respectively, as , and . We use a subscript[e.g., , etc.] to distinguish continuous-time quanti-ties from discretized versions. In general, the filters are allowedto be ideal (e.g., brickwall lowpass, etc.). So thetransformsmay not exist in any region of theplane. The notationshould be regarded as an abbreviation for theFourier trans-form . The language of multirate signal processing [36]will be used extensively throughout this paper. A summary ofthe most common ones follows.

1) The building block in the figures denotes a decimatorwith input/output relation . The building block

denotes an expander with input/output relation

multiple of

otherwise.

The expander followed by a filter yields an interpolated versionof . We use the notations and to denotethe decimated version and its -transform. Similarly, theexpanded version is denoted by , and its -transform

by . It can be shown that the Fourier transformof is a superposition of and shiftedversions [36]

2) Some standard abbreviations: a) PCFB: principal com-ponent filter bank, b) DMT: discrete multitone modulation, c)DSL: digital subscriber loop, d) ADSL: asymmetric DSL, e) PR:perfect reconstruction, f) KLT: Karhunen Loeve Transform, g)psd: power spectral density or power spectrum.

II. DMT FILTER BANK

Fig. 1(a) shows the essentials of DMT communication as re-quired for the discussions of this paper. The signals are

-bit symbols obtained from a PAM or QAM constellation(Appendix A). These symbols are interpolated-fold by thefilters to obtain the subchannel or subband signals .The th transmitting filter has output

(1)

Fig. 1(b) demonstrates how this construction is done for the0th filter , assumed to be lowpass. Essentially, we drawone copy of the impulse response sequence around everysample of (separated by ) and add them up. The outputsof the filters and so forth, are more complicatedwaveforms because they are bandpass. The filterstraditionally cover different uniform regions of frequency asshown in Fig. 1(c). The signals are analogous to mod-ulated versions of the “baseband” sequence because thebandwidth is shifted to the passband of . These are packedinto adjacent frequency bands (passbands of the filters) andadded to obtain the composite signal . Thus

(2)

This signal is then sent through the channel which is representedby a transfer function and additive Gaussian noisewith power spectrum . The received signal is adistorted and noisy version of . The receiving filter bank

separates this signal into the components whichare distorted and noisy versions of the symbols . The taskat this point is to detect the value of from withacceptable error probability.

In actual practice, the channel is a continuous-time systempreceded by conversion and followed by con-

version. We have replaced this with discrete equivalentsand . The original motivation behind multitone modulation[15] is that the power and/or bits could be allocated in an effi-cient manner in the subchannels, depending on the channel gain

Page 3: Discrete multitone modulation with principal component ...systems.caltech.edu/dsp/students/sony/journ/ppsdmtieee.pdf · IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS—I: FUNDAMENTAL

VAIDYANATHAN et al.: DISCRETE MULTITONE MODULATION WITH PRINCIPAL COMPONENT FILTER BANKS 1399

(a)

(b) (c)

Fig. 1. (a) The DMT communication system. (b) The interpolation or modulation performed by the transmitting filterF (z). (c) An example of responses of thetransmitting filters.

, and noise psd in that subchannel. In thisway, the classicalwater filling idea for resource allocation [11],[26] could be approximated. For a given transmitted power andprobability of error, this yields a better bit rate than direct singletone modulation (assuming no channel coding). The DMT ideais similar in principle tosubband codingwhere a signalto be quantized is first decomposed into subbands. Backgroundmaterial on the DMT system and more generally on the use ofdigital filter banks in communications can be found in [1], [10],[15], [17], [20], [33].

A. Perfect Reconstruction

In absence of the channel noise , the DMT system ofFig. 1(a) is LTI, with the transfer function from togiven by

In general, the symbol is therefore affected bywhen , resulting ininterband interference. For the case

, if the quantity is not a constant, then isaffected by when , and we haveintraband interfer-ence. The condition to eliminate these two interferences is

(3)

If interband and intraband interferences are eliminated, theDMT system is said to be free fromintersymbol interference(ISI). We then have the perfect reconstruction orPR property

for all (in absence of noise). If the filterresponses in Fig. 1(b) are nonoverlapping, then the subchannelsare completely isolated. There is no interband ISI, though we

might still have intraband ISI. Even if the filters have overlapas in any practical implementation, we can still avoid bothtypes of ISI as long as (3) holds. In fact, the most popular DMTsystem uses a DFT filter bank where the filters have significantoverlap even though (3) holds.

Biorthogonality: The filter bank is said to bebiorthogonal if

(4)

This means that the impulse response of the productfilter has the Nyquist( ) or zero-crossing prop-erty

for and . Under this biorthogonalitycondition, we have perfect reconstruction only if .In this paper, we shall make the simplifying assumptionthat is biorthogonal and that the channel transferfunction is equalized by using the inverse filter orzero-forcing equalizer just before entering the bankof filters . The path from to now hasthe effective form shown in Fig. 2(a).1 In actual practice,there are many ways to approximate this equalized system(see [25] and references therein). One approach would be touse a time domain equalizer in cascade with the channel andreduce the effective channel to be FIR with a short impulseresponse. This effective FIR filter is then compensated for bythe use of acyclic prefix followed by appropriate multipliersat the outputs of , called frequency domain equalizers.

1We make the assumption thatC(e ) 6= 0 for any!. Otherwise, we haveto leave out the offending frequency band.

Page 4: Discrete multitone modulation with principal component ...systems.caltech.edu/dsp/students/sony/journ/ppsdmtieee.pdf · IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS—I: FUNDAMENTAL

1400 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS—I: FUNDAMENTAL THEORY AND APPLICATIONS, VOL. 49, NO. 10, OCTOBER 2002

(a) (b)

(c)

Fig. 2. (a) The path fromx (n) to y (n) in a DMT system with ideal equalizer1=C(z). (b) Noise processing in thekth subchannel. (c) Complete noise model.

This is explained at length in [10] for DFT based DMT, and amodification for general DMT has been advanced in [22].

B. Channel Noise Model

Now consider the effect of channel noise . Assuming thatis biorthogonal and that is inserted as shown

in Fig. 2(a), the th received symbol at time is given by

(5)

where is the channel noise filtered throughand decimated [Fig. 2(b)]. If the channel noise is wide sense sta-tionary with power spectrum then, the variance ofis

(6)

Notice that the noise at the detector input can be viewed asthe output of a maximally decimatedanalysis bank inresponse to aneffective noise source with effective noisepsd

(7)

This yields the noise model shown in Fig. 2(c).Optimization of the DMT Filter Bank:We see that there is

some control on the variances of , because we can choosethe filters . We can take advantage of this. Even if weassume that the filters are allowed to be ideal, it turns out thatthe brickwall filter stacking shown in Fig. 1(c) is not necessarilythe best choice (Section III). For any given channel, we can de-fine a filter bank called the principal component filter bank. Thefrequency partitioning generated by such a filter bank is optimalfor the channel (Section V).

C. Probability of Error, Transmitted Power, and Bit Rate

For simplicity, we assume that are PAM symbols (Ap-pendix A). Assuming that is a random variable with

equiprobable levels, its variance represents theaverage powerin the symbol . The Gaussian channel noise is fil-

tered through and decimated by . For the pur-pose of variance calculation, the model for the noise atthe detector input can therefore be taken as in Fig. 2(c). Letbe the variance of . Then, theprobability of error in de-tecting the symbol is given by [26]

(8)

where (area of the normalizedGaussian tail). Since the-function can be inverted for any non-negative argument, we can invert (8) to obtain

(9)

where the exact nature of the function is not of immediateinterest. This expression says that if the probability of error hasto be or less at the bit rate , then the power inhas to be at least as large as. The required total transmittedpower is therefore

(10)

Suppose is converted into a continuous time signalby the D/A converter at sampling rate so that

. If a voltage waveform V is applied across a 1-resistor, the power delivered is actuallyW, regardless of thesample spacing . The samples of are separated bys. With representing the number of bits per sample in ,the th subchannel therefore carries bits/s. The total bitrate is therefore

bits/s

or equivalently, bits/s where .

Page 5: Discrete multitone modulation with principal component ...systems.caltech.edu/dsp/students/sony/journ/ppsdmtieee.pdf · IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS—I: FUNDAMENTAL

VAIDYANATHAN et al.: DISCRETE MULTITONE MODULATION WITH PRINCIPAL COMPONENT FILTER BANKS 1401

(a)

(b)

Fig. 3. Examples of orthonormal filter banks. (a) Delay chain system. (b)Brickwall filter bank with contiguous stacking(M = 4).

D. Orthonormal DMT Systems

The set of filters is said to beorthonormal if

(11)

In an orthonormal DMT system we choose the transmit filtersto be , i.e., . This en-sures biorthogonality (4), and furthermore the filters sat-

isfy . In terms of impulse

responses, this orthonormality condition is equivalent to

Thus, the composite signal in (2) can be regarded as asuperposition of elements from an orthonormal set. In fact, anysubchannel signal is a superposition of elements from theorthonormal set as seen from (1). Fig. 3 showstwo extreme examples of orthonormal filter banks. The first oneis the delay chain system [ and ] andthe second is the idealbrickwall filter bank.

For , (11) yields . If the impulseresponse of is denoted as then the precedingcondition is equivalent to the Nyquist() or zero-crossingconstraint . Similarly, for biorthogonal filterbanks, the product is Nyquist( ). Orthonormalfilter banks have been thoroughly studied [36], [42]. Hereare some of their properties: 1)(unit energy property); 2) (boundedness);3) (power complementarity). Statedhere for , these also hold for .

E. Polyphase Representation of DMT Systems

Using the polyphase notations described, for example, in [36,Ch. 5], we can express the row vector of transmitting filters andthe column vector of receiving filters as

where is the delay chain vector defined by. The DMT system can therefore

be redrawn as in Fig. 4(a). Using Noble identities [36] thedecimator and expander can be moved as shown in Fig. 4(b).This is the polyphase representation of the DMT filter bank.Note that the noise model shown in Fig. 2(c) can be redrawnin polyphase form as shown in Fig. 4(c). This will be quiteinsightful as we shall see.

The biorthogonality property (4) can be shown to be equiv-alent to . The special case where the matrix

is unitary for all corresponds to orthonormal DMTsystems. In this case, we choose (transposeconjugate) for perfect reconstruction. The DMT systems where

is a constant unitary matrix has been of some practicalimportance. In this case, the filters are FIR with lengths

. This is the DMT counter part of thetransform coder insubband coding theory. The example whereis the DFT ma-trix falls under this class.

III. OPTIMAL CHOICE OFDMT FILTER BANK

To motivate the usefulness of optimizing the transmitter andreceiver filters, consider Fig. 5(a). This shows an example of theeffective noise psd in terms of the continuous-time fre-quency variable . [The discretized version of this isdefined in (7)]. This is assumed bandlimited to 1 MHz. The unitsfor are in milliwatts per hertz, and a decibel plot wouldshow in dB m/Hz as in the figure. Using a sam-pling rate of 2 MHz, the digital version ofthe psd is as shown in Fig. 5(b) where (dueto the factor in the Fourier transform after sampling). Theseare not unrealistic numbers for typicaltwisted pair telephonechannels for which DMT modulation is the standard. The twobumps (each assumed 10-kHz wide) can be regarded as over-simplified versions of the effects of bridged taps (first bump)and AM noise (second bump) [31]. The rapid decay of channelgain is not depicted in this “toy” example, but we shall do thatin Section VI. Consider a two-band DMT system ( ).One choice of the orthonormal filter bank, namely the brickwallstacking, is shown in Fig. 5(c). With the effective psdas in Fig. 5(b) we can now calculate the variances. Let uspick some values for the remaining parameters.

1) Error probabilities .2) and . These are the bits in the PAM con-

stellations for and . It makes sense to use smallervalue for because there is more noise in the region coveredby . Since the average of s is 4, the average bit ratefor the 2-MHz sampling rate is 8 Mbits/s.

The average power needed to meet these requirements canbe calculated from (10), and the result turns out to be 56 mW.Instead of using the brickwall filter bank suppose we use thefilter bank shown in Fig. 5(d) and (e). We still have two sub-bands ( ) but each filter now has two passband regions. Itcan be verified that this filter bank still satisfies orthonormality(11). We can recalculate the variances now and compute theaverage power. The result is 5.67 mW. Thus

savings in total power

Page 6: Discrete multitone modulation with principal component ...systems.caltech.edu/dsp/students/sony/journ/ppsdmtieee.pdf · IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS—I: FUNDAMENTAL

1402 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS—I: FUNDAMENTAL THEORY AND APPLICATIONS, VOL. 49, NO. 10, OCTOBER 2002

(a)

(b)

(c)

Fig. 4. (a) Polyphase representation of the DMT filter bank. (b) Simplification using multirate identities. (c) Noise model in polyphase form.

(a) (b)

(c)

(d) (e)

Fig. 5. Demonstrating the effectiveness of good choice of filter banks in the DMT system. (a) Effective noise psd. (b) Digitized version. (c) Traditional brickwallfilter bank forM = 2. (d) and (e) Different choice of filter bank.

or about 10 dB. In summary, the modified filter bank achievesthe bit rate of 8 Mbits/s and error probability of 10 usingalmost 10 dB less power!

The difference between the two filter banks in the example isthat the variances (whose sum is fixed by orthonormality)are distributed differently depending on the shape of the effec-

Page 7: Discrete multitone modulation with principal component ...systems.caltech.edu/dsp/students/sony/journ/ppsdmtieee.pdf · IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS—I: FUNDAMENTAL

VAIDYANATHAN et al.: DISCRETE MULTITONE MODULATION WITH PRINCIPAL COMPONENT FILTER BANKS 1403

tive noise psd . The natural question then is: given aneffective noise psd and an arbitrary, how do we choose theorthonormal filter bank to minimize the transmittedpower for fixed specifications? The answer is thatshould be chosen as aprincipal component filter bankfor theeffective noise psd.

IV. PRINCIPAL COMPONENTFILTER BANKS

To define a PCFB first consider two sets of nonnegativenumbers and . We say that majorizes if,after reordering such that and , we have

for , with equality for . Thus,all the partial sums in dominate those in . Consider agiven class of -band uniform orthonormal filter banks. Thisclass can be the class of transform coders (with filter lengths

), or the class of ideal filter banks (filters allowed tohave infinite order, like brickwall filters). Or it could be a prac-tically attractive class like the FIR class with filter ordersbounded by a fixed integer, or the so-called cosine modulatedclass [36]. Given such a classand an input power spec-trum we say that a filter bank in is a principalcomponent filter bank orPCFB if the set of its subbandvariances [i.e., variances of the signals in Fig. 2(c)]majorizes the set of subband variances of all other filterbanks in the class. That is, with and ,

and so forth. The equality follows au-tomatically from orthonormality.

The advantage of PCFBs is that they are optimal for severalproblems. This includes subband coding with arbitrary (not nec-essarily high) bit rates, the denoising problem, and so forth, aselaborated in [4]. These arise from the result (proved in [4]) thatanyconcavefunction of the subband variance vector

isminimized by a PCFBwhen one exists. Similarly any convexfunction is maximized by a PCFB. Note that any permutation ofthe filters in a PCFB retains the PCFB property. Thus, given aparticular (concave or convex) objective, we have to choose theright permutation so that the objective is optimized.

Using the preceding results we show in this paper, that PCFBsalso serve as optimal solutions to certain problems in commu-nication systems which use DMT modulation. It is possible thatPCFBs do not exist for certain classes (e.g., see [4]). But whenthey exist, they have the stated optimality. Whenever we say thatthe PCFB is optimal for a problem, the implicit assumption isthat the class of filter banks searched is such that a PCFB exists.

A. Construction of the PCFB, and Compaction Filters

For the transform coder class the filters have length .This means that the polyphase matrix in Fig. 4(c) is a con-stant matrix . Suppose denotes the autocorre-

lation matrix of its input vector. If is chosen as the unitarymatrix diagonalizing then, it defines the PCFB in this case.This is nothing but the Karhunen–Loeve transform (KLT) ofthe effective noise input . This choice decorrelates the sig-nals for each . That is, the autocorrelation matrix of thevector

(12)

is diagonalized. For the ideal filter bank class , the ma-trix could have infinite order in . This means in par-ticular that ideal filters are allowed. In this case, thePCFB is such that the power spectrum of the vector (12) is di-agonalized which in particular means that the autocorrelationmatrix is diagonal as well. In short, the KLT forces the instan-taneous decorrelation property for each

, whereas the PCFB for forces thetotal decorrelationproperty for all (with ). Inaddition, the PCFB for also induces thespectral ma-jorization property. That is, assuming are in decreasingorder, the power spectra of are ordered such that

pointwise for all . It has been shown in[37] that total decorrelation and spectral majorization are neces-sary and sufficient for the PCFB property in the class . Forclasses other than and the transform coder class, such con-ditions for the PCFB property have not been established. In fact,the existence of a PCFB is not guaranteed for arbitrary classesof orthonormal filter banks (see [4] for counterexample). Whena PCFB does exist, there is a sequential algorithm that can beused to construct the filters [23], [4], [5].

Closely associated with PCFBs is the notion of an optimalcompaction filter for a signal with power spec-trum . Such a filter has the property that its output inresponse to the input has maximum variance subject to theNyquist( ) constraint . For the transformcoder class, this filter can be constructed by making theKLT, and taking the receiver filter with largest variance as thesolution. For the class the optimal compaction filter can beconstructed graphically [37]. Typically, there are multiple pass-bands. For example, the power spectrum in Fig. 6(a) has optimalcompaction filter for shown in Fig. 6(b). To constructsuch a filter we proceed as follows: take any frequencyin

and consider the set of frequencies

(13)

Choose one frequency in this set such that is a max-imum in this set (if there are multiple maxima choose one arbi-trarily). Include this frequency in the passband of , andthe remaining frequencies in the stopband. Repeat thisfor all in . Set the passband height equalto and stopband height equal to zero. This completely de-termines the optimal compaction filter for the powerspectrum .

The PCFB can be constructed by designing the filterssequentially one at a time as follows

[37]. First, design as an optimal compaction filter for. Then, define a partial power spectrum by removing or

Page 8: Discrete multitone modulation with principal component ...systems.caltech.edu/dsp/students/sony/journ/ppsdmtieee.pdf · IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS—I: FUNDAMENTAL

1404 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS—I: FUNDAMENTAL THEORY AND APPLICATIONS, VOL. 49, NO. 10, OCTOBER 2002

(a) (b)

(c) (d)

(e) (f)

Fig. 6. (a) A power spectrum. (b) Optimum compaction filter forM = 4 for (a). (c) Partial power spectrum obtained by peeling. (d) PCFB forM = 4. (e) Amonotone power spectrum. (f) PCFB forM = 4 for (e).

peeling off from those parts that fall in the passbandsof [Fig. 6(c)]. Design an optimal compaction filter

for this partial psd. Remove those parts of this partialpsd that fall under the passband of , and continue thisuntil all the filters have been designed. Fig. 6(d) shows thefilters designed in this manner for .

Filter banks constructed using this procedure have the fol-lowing properties.

1) A filter may have more than one passband, butthe sum of all its passband widths is equal to , andthe heights of the passbands are equal to (e.g., two inFig. 6).

2) The passbands of any two filters are disjoint, and the filterstogether cover the entire frequency range.

3) For any consider the set of frequencies in (13). Givenany filter , exactly one of these frequencies be-longs to its passband, and the others belong to the stop-band. This property implies two things: a) Each filter is analiasfree( ) filter. In other words, its output can be deci-mated by without causing overlaps of the copies of thespectrum created by downsampling; b) The decimated ver-sion for all .

It readily follows from these that the resulting filter bank isorthonormal. The proof that this is actually a PCFB can be foundin [37]. For the case of a monotonedecreasingpower spectrum

the compaction filter islowpass, as demonstrated inFig. 6(e) and (f). In this case, the PCFB happens to be the tradi-tional brickwall stacking of bandpass filters as shown.

V. OPTIMIZATION OF THE DMT FILTER BANK

In this section, we show how to optimize the orthonormalfilter bank used in a DMT system. We assume that the numberof subchannels is fixed. The channel transfer functionand the noise power spectrum are assumed to be fixedand known as well. A brief overview of these results will alsoappear in [40].

A. Minimizing Transmitted Power

Recall that the total transmitted power can be expressed interms of the error probability and noise variances as shown in(10)

Let us assume that the bit rates and probabilities of errorare fixed. For this desired combination of and, the total power required depends on the distribution

of noise variances . These in turn depend upon the filters. From (9) it follows that the required power in the

th band is a linear (hence concave) function2 of . The totaltransmitted power is therefore a concave function of thenoise variance vector

(14)

From Fig. 2(c), we see that this is the vector of subband vari-ances of the orthonormal filter bank in response tothe power spectrum . Recalling the discus-sion on PCFBs from Section IV we now see that the orthonormalfilter bank which minimizes total power for fixederror probabilities and bit rates is indeed aPCFB for the effec-tive noise power spectrum

Having identified this PCFB, the variances are readilycomputed, from which the powers for fixed bit rateand error probability can be found [using (9)]. Theminimized power can then be calculated.

2A linear function is also convex, so there is a permutation of the optimalPCFB which maximizes rather than minimizes power. Evidently it should beavoided!

Page 9: Discrete multitone modulation with principal component ...systems.caltech.edu/dsp/students/sony/journ/ppsdmtieee.pdf · IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS—I: FUNDAMENTAL

VAIDYANATHAN et al.: DISCRETE MULTITONE MODULATION WITH PRINCIPAL COMPONENT FILTER BANKS 1405

B. Maximizing Total Bit Rate

Returning to the error probability expression (8) let us nowinvert it to obtain a formula for the bit rate . This is trickybecause of the way occurs in two places. The factorhowever is a weak function of in the sense that it varies from0.5 to 1 as changes from one to infinity. Suppose we replace

with unity. Then, (8) yields

(15)

so the total is approximately

(16)

This is the achievable without channel coding, for a givenset of error probabilities and signal to noise ratios

. Since is convex in (for ),the total bit rate is convex in the variance vector (14). Thus, theorthonormal filter bank which maximizes the bitrate for fixed error probabilities and powers is again a PCFBfor the effective noise psd as before. Thisis intuitively appealing since the maximization of bit rate andminimization of total power are consistent goals.

Without the approximation the closed formexpression (16) is not possible, but the convexity ofcan stillbe proved in a more elaborate way as shown in Appendix B.

C. Optimal Power Allocation

The preceding result is true regardless of how the total poweris allocated among the bands. In particular we can

performoptimum power allocation. We have

(17)

where . The optimization offor fixed total power is a standard problem

in information theory [11]. The solution is given by

if this is nonnegative,otherwise

(18)

where is chosen to meet the power constraint. This is thefamiliar water pouring rule [11] demonstrated in Fig. 7. Thispower allocation is optimal regardless of the exact choice of thefilter bank . In particular, if is chosen as theoptimal PCFB and then power is allocated as above, it providesthe maximum possible DMT bit ratefor fixed total power andfixed set of error probabilities. Note that the power allocationautomatically determinesbit allocation because of the formula(15).

D. Capacity

We observe some similarities and differences between the ac-tual bit rate (16) and the theoretical capacity of the DMT system.

Fig. 7. Optimal power allocation by water pouring.

The biorthogonal DMT system with ideal channel equalizer canbe represented by

(19)

where are the modulation symbols and the noisecomponents shown in Fig. 2(c). In general it is not true thatthe effective noise components are Gaussian, white, anduncorrelated. However, if the number of bandsis large, andthe filters are good approximations to ideal filters, thenthis is nearly the case. In this case, the channel (19) is identicalto theparallel Gaussian channeland has information theoreticcapacity [11]

(20)

Since the noise variances depend on the filters ,the above capacity also depends on them. For the case where

is an orthonormal filter bank thiscapacity is maximizedif is chosen as a PCFB for the effective noise psd

. The reason again is that (20) is convex inthe variance vector (14). Moreover, as in [11], we can optimallyallocate the powers under a power constraint .

Equation (16) is thebit rate achieved for fixed probabili-ties of error , and without channel-coding in subbands.Equation (20) is theinformation capacity, that is, the theoret-ical upper bound on achievable bit rate with arbitrarily smallerror. We see that both (16) and (20) depend on the choice offilter bank, and are maximized by the PCFB. Suppose the errorprobabilities are for all . A calculation of thefactor shows that if the two quantitiesand

have to be equal then the total power in (16) should be9.74 dBmore than the power used in (20). Channel coding is includedin many DMT systems in order to reduce this gap.3

The preceding discussion on capacity should be interpretedcarefully. Indeed, the capacity of a channel is a property of thechannel itself, and cannot depend on the filter bank. It dependson the power, the channel transfer function, and the noise. How-ever, in the preceding interpretation we imagine that the-bandtransmitter filter bank and receiver filter bank are part of thechannel. The number of bands and the powers arefixed, and the filter bank is assumed orthonormal. Under thiscondition, (20) represents the capacity of the channel, and it de-pends only on the noise variance distribution which canbe controlled by the receiver filters (the transmitter filters are

3This gap is very similar to the gap between PCM rate and channel capacityfor AWGN channels [19, Ch. 15].

Page 10: Discrete multitone modulation with principal component ...systems.caltech.edu/dsp/students/sony/journ/ppsdmtieee.pdf · IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS—I: FUNDAMENTAL

1406 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS—I: FUNDAMENTAL THEORY AND APPLICATIONS, VOL. 49, NO. 10, OCTOBER 2002

(a) (b)

(c) (d)

(e)

Fig. 8. Qualitative frequency-domain plots for ADSL service on the copper twisted-pair channel. (a) and (b) Transmitted psd masks; (c) Channel gainjC (f)j .(d) Various noise spectra. (e) Model for the bridged tap.

conjugates of the receiver filters by orthonormality and perfectreconstruction requirement). This is a useful interpretation be-cause of the close analog between (20) and the bit rate (16). Thiscapacity is maximized by choosing the filter bank to be a PCFBand by performing power allocation as described earlier. Noticefinally that the bit rate equation (16) with nonzero error prob-ability is both practical and perfectly meaningful, and is in noway affected by the preceding interpretation based on capacitywhich in this context is only of aesthetic value.

VI. TWISTED PAIR CHANNEL

The data rate achievable on twisted-pair copper wires is lim-ited by the channel noise and the gain of the line , whichdecreases with frequency and wire length. The signal to noiseratio deteriorates rapidly with frequency as well as wire length.Nevertheless, with typical noise sources of the kind encoun-tered in a DSL environment and with typical transmitted powerlevels, a wire of length 18 kft could achieve a rate well above1 Mbits/s. Shorter wires (e.g., 1 kft) can achieve much more(40–60 Mbits/s) [31], [43]. This is done by allocating powerand bits into a much wider bandwidth than the traditional voiceband.

The purpose of this section is to demonstrate the improve-ment obtainable with optimal filter banks instead of a DFTbased DMT system. A simplified model of the twisted pairenvironment will be used. The model, while not accurate, helpsto demonstrate the ideas well. Only a real simulation withpublished data on the channel can reveal the improvementsmore accurately, but we shall not venture into that here.

The types of noise that are really important in a DSL en-vironment are near end cross talk ornext and far end cross

talk or fext. These arise because several twisted pairs are typ-ically placed in a single cable and therefore suffer from elec-tromagnetic interference from each other. A great deal of studyhas been done on this, both theoretical and measurement-based[31], [43]. Assuming that all the pairs in the cable are excitedwith the same input psd, the power spectra of thenextandfextnoise sources can be estimated using standard procedures. Eventhough the “next noise” is an interference, it has the character-istic of Gaussian noise as shown in [18].

Fig. 8 demonstrates the relevant quantities with plots thatreasonably resemble what one might expect in practice. Parts(a) and (b) show the transmitted downstream (telephone officeto customer) and upstream (customer to telephone office)power distributions for ADSL service. These signals oftenoccupy nonoverlapping bands but sometimes they are in thesame band, in which case echo cancelers are required [31]. Thedownstream bandwidth is larger because of higher rate (severalmegabits per second); upstream offers only a few hundredkilobits per second. Fig. 8(c) shows a typical plot of the channelgain. The dips are due tobridged tapstypically attached totelephone lines in the US for service flexibility. Fig. 8(d) showsthe typical power spectra of thenextandfextnoises. The figurealso shows the typical interference on the phone line caused byAM radio waves (560 kHz–1.6 MHz) and from amateur radio(1.81–29.7 MHz, which is outside the standard ADSL band asdeployed today). These interferences depend of course on thelocation of the line, time of the day and many other varyingfactors.

In any case, notice that the overall noise spectrum is far fromflat. The ratio of the noise spectrum to the channel gain givenby is not monotone. Because of the manybumps and dips in this ratio, the PCFB is significantly different

Page 11: Discrete multitone modulation with principal component ...systems.caltech.edu/dsp/students/sony/journ/ppsdmtieee.pdf · IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS—I: FUNDAMENTAL

VAIDYANATHAN et al.: DISCRETE MULTITONE MODULATION WITH PRINCIPAL COMPONENT FILTER BANKS 1407

from the contiguous brickwall stacking, and can therefore re-duce transmitted power significantly, similar to the example ofSection III. This is demonstrated next.

A. Details

We assume that the channel gain as a function of thecontinuous-time frequency has the form [16]

where is the length of the twisted pair line in kilofeet andis in kilohertz. The constants appearing in the equation are

, , and . Notice that this value ofyields an attenuation of 12 dB at zero frequency. The precedingexpression for is sometimes referred to as the RC-ap-proximation, and is valid for short lengths [16]. We approxi-mate each bridged tap with a multiplicative term havingthe form shown in shown in Fig. 8(e). The expression used inthe simulation is

otherwise.

This expression is used for , and it defines for allbecause . The center frequency is determinedby the length of the bridged tap. The noise psd as afunction of continuous-time frequencyhas the form

For simplicity, the AM noise psd for a given stationis assumed to be a constant with total bandwidth of 10 kHzaround the station frequency . Its strengthcan be specified in dBm/Hz (typically between 80 and 120dB m/Hz on phone lines [31]). We consider the ADSL down-stream channel for which thenextandfextsources are, respec-tively, the upstream and downstream signals in the other twistedpairs in the cable. We assume the upstream and downstreamsignal power spectra and to be as in the ADSLissue 2 mask described in [31]. More specifically, these are takento be the plots on pages 103 and 105 of [31] multiplied by thebaseband pulse shaping function

where MHz for downstream and 270 kHz for up-stream [31]. The psd ofnextandfextnoise sources are taken tobe

where and . Here is the wirelength in kilofeet and is in hertz. The integers and arethe number ofnextandfextdisturbers ( 49 in a 50-pair cable).For our example, we assume the following.

1) Number of subchannels , sampling rate3.2 MHz, and probabilities of error inall subchannels. PAM constellations are used in eachsubchannel.

2) Twisted pair channel length kft, and number ofdisturbers 49 (for both next and fext).

3) One bridged tap with , Hz andkHz.

4) Two AM stations with BW 10 kHz each, having carrierfrequencies 600 and 850 kHz with power spectra95dB m/Hz and 90 dBm/Hz, respectively.

Then, for a downstream ADSL bit rate of 3.2 Mbits/s, thetransmitted power is required to have the following values:

Traditional DFT-multitone: 4.68 mWDCT-multitone: 4.08 mWKLT-multitone: 2.76 mWIdeal FB [contiguous stacking, Fig. 3(b)]: 1.28 mWIdeal PCFB (unconstrained class): 0.94 mW

The PCFB is, therefore, significantly better than the other filterbanks. Compared to the traditional DFT, the savings in poweris about a factor of five. Fig. 9 shows the responses of two ofthe eight filters in the PCFB (normalized to unity). Notice thatthe filters have multiple passbands. The plot for showsthat its practical implementation could be expensive because ofthe very narrow passbands. In fact, by a slight variation of thePCFB design algorithm, it is possible to eliminate bands thatare narrower than a certain threshold. Such near-PCFB solutionswill still have performance close to ideal. In any case, it is ouropinion that the primary role of the PCFB is to provide boundson performance for fixed . If the performance gap between apractical system and the PCFB solution is small in a particularapplication, this gives the assurance that we are not very far fromoptimality.

If we plot the required transmitted power as a function of thenumber of bands (with all other parameters as in the pre-vious example) the result is as shown in Fig. 10. The plot showsthe results for 1, 2, 4, 8, 16, 32, 64, and 128. The PCFBrequires smaller power than all other methods (consistent withits theoretical optimality). However, the difference between var-ious filter banks becomes negligible as increases. This isanalogous to a well-known observation in subband coding [14];namely the coding gain is relatively insensitive to the choiceof filter bank as . DMT systems based on fixed filterbanks such as the DFT or cosine modulated filter banks are at-tractive because of their simplicity; they are non adaptive andcan be implemented efficiently [10], [27].

VII. SCALAR PREFILTERING BEFORECHANNEL

Consider again, Fig. 1 where is orthonormal with. Assume as before that has been

equalized by inserting . Suppose this configurationis further modified by insertion of a prefilter and postfilteraround the channel [Fig. 11(a)]. Thus the effective transmittingfilters are and receiving filters are

. This defines a biorthogonal filter bank. This system can achieve better performance

Page 12: Discrete multitone modulation with principal component ...systems.caltech.edu/dsp/students/sony/journ/ppsdmtieee.pdf · IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS—I: FUNDAMENTAL

1408 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS—I: FUNDAMENTAL THEORY AND APPLICATIONS, VOL. 49, NO. 10, OCTOBER 2002

(a)

(b)

Fig. 9. Two of theM filters in the PCFB which minimizes transmitted powerin the example.

Fig. 10. A comparison of the PCFB with other filter banks as a function ofnumber of bandsM .

than the orthonormal system . For example, wecan shape and such that the transmitted poweris minimized for fixed bit rates and probabilities of error.

The interpolated signal [Fig. 11(b)] has a variancewhich in general depends on. In fact, if we assume that

is a WSS process, the signal is cyclo WSS, and itsvariance is a periodic function of with period . The powerin the th symbol is this variance averaged over a period. Tofind this, redraw Fig. 11(b) as in Fig. 11(c) where arethe polyphase components of . We shall assumethat the symbols arewhite with zero mean and variance

. This is consistent with the view that is generated byparsing a binary i.i.d. sequence [8]. Thus the variance at theoutput of is given by . Theaverage variance of is then

Assuming further that areuncorrelated for different ,the total power input to the channel is the sum of these averagevariances

(21)

The quantity is also the physical signal-power at the input ofthe detector. The noise variance at the detector input can becomputed by referring to Fig. 2(c) and inserting the additionalfactor in the noise transfer functions. Thus

Since for some , the total power is

where we have substituted the preceding expression forandused the fact that for any orthonormal filterbank. For a given channel, and are fixed. As-sume the set of error probabilities and bit rates arealso fixed. The total power input to the channel then depends onthe orthonormal filter bank and the prefilter .The next result shows how this power can be minimized. It is anextension to the DMT system, of a familiar result in the subbandcoding theory [12].

Theorem 1: Optimum Prefiltered Orthonormal FB forDMT: Assume that the modulation symbols are white,and uncorrelated for different . For fixed probabilities oferror and bit rates , the combination of orthonormalfilter bank and prefilter which minimizes the totalrequired power is obtained as follows: 1) Choosewith magnitude response (22); 2) Make PCFB for

.

Page 13: Discrete multitone modulation with principal component ...systems.caltech.edu/dsp/students/sony/journ/ppsdmtieee.pdf · IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS—I: FUNDAMENTAL

VAIDYANATHAN et al.: DISCRETE MULTITONE MODULATION WITH PRINCIPAL COMPONENT FILTER BANKS 1409

(a)

(b) (c)

Fig. 11. (a) Pre and post filters in the DMT system. (b) Thekth subchannel symbol and its interpolation. (c) Equivalent polyphase diagram.

Proof: From the Cauchy–Schwartz inequality we have

where the argument has been eliminated for simplicity.Equality holds when the two integrands on the left are equal,that is,

(22)

This is the optimum no matter what the orthonormalfilter bank is. With the prefilter chosen as above, the totaltransmitted power is where

Thus, is a concave function ofwhich can be regarded as a subband variance vector froman orthonormal analysis bank with input power spectrum

. Applying the result of Section IVwe conclude that the orthonormal filter bank mini-mizing the total power is a PCFB for the power spectrum

.Note that the solution (22) also arises in optimal prefiltering

prior to scalar quantization, and is said to be thehalf whiteningfilter [14], [36] for the spectrum .

VIII. C ONCLUDING REMARKS

The DMT idea is similar in principle to subband coding wherea signal to be quantized is first decomposed into sub-bands. Depending on the power spectrum of the input,there is a certain distribution of signal energy across the sub-bands. This distribution is exploited in the coding process by op-timal bit allocation: we allocate more bits to the subband having

higher energy. Thus, in the subband coder, the frequency depen-dence of the input signal is exploited. In the DMT system,the frequency dependence of the channel and the noise

are exploited. The similarity of the two problems isexemplified by the fact that the PCFB serves as an optimal the-oretical benchmark in both cases. The complete duality betweenthe optimization of subband coders and DMT systems can alsobe seen in a more basic way as explained in [21]. The use ofnonuniform filter banks and PCFBs for DMT communicationhas not been addressed in this paper. Such an extension findsapplication in the so-called DWMT (discrete wavelet multitone)modulation. We conclude with one further remark. The implicitassumption throughout has been that the channel and the noisepower spectrum are entirely known so that the optimal filterbank can be identified. If there is an error in the estimation ofthese channel parameters, then naturally the performance wouldbe suboptimal. An interesting research problem in this contextwould be to analyze the extent to which the results will strayfrom optimality.

APPENDIX APARSING STAGE IN DMT COMMUNICATION

Fig. 12(a) shows the first stage of multitone modulation [8],[10] called theparsing stage. Here representsbinarydata to be transmitted over a channel. This data is dividedinto nonoverlapping -bit blocks. The bits in each block arepartitioned into groups, the th group being a collection of

bits (demonstrated in the figure for ). Thus, the totalnumber of bits per block can be expressed as .

The b in the th group constitute theth symbol whichcan therefore be regarded as a-b number. For the th block,this symbol is denoted as . This is themodulation symbolfor the th band. The vector issometimes referred to as theDMT symbol. For the case of pulseamplitude modulation (PAM), the sample is a quantizedreal number as demonstrated in Fig. 12(c) for . For the

Page 14: Discrete multitone modulation with principal component ...systems.caltech.edu/dsp/students/sony/journ/ppsdmtieee.pdf · IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS—I: FUNDAMENTAL

1410 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS—I: FUNDAMENTAL THEORY AND APPLICATIONS, VOL. 49, NO. 10, OCTOBER 2002

(a) (b)

(c) (d)

Fig. 12. (a) and (b) Explanation of the parsing stage in DMT. (c) The 8-PAM constellation (3 b). (d) the 16-QAM constellation (4 b).

case of quadrature amplitude modulation (QAM) can beregarded as a complex number, taking one ofpossible valuesfrom a rectangular constellation as demonstrated in Fig. 12(d).More efficient constellations exist [26].

APPENDIX BPROOF OFCONVEXITY OF BIT RATE

The following proof was first presented in [6]. Consider (8)and delete all dependence onfor simplicity. Without using theapproximation we will show that is convex in .First notice that

As increases from to , the quan-tity decreases from to zero. We will show that isconvex for . Since the inverse of a decreasingconvex function is convex (Appendix C), this will prove that

is convex in . For convenience define

Then, , and becomes

where the primes denote derivatives with respect to. We knowis convex if its second derivative is nonnegative. So it is

sufficient to show that is decreasing. Both andare positive and decreasing in ,

and so as well. It is therefore sufficient to show thatdecreases. Since , it

follows that . Similarly, the func-

tion has derivative .Using these we verify that

where . Now the rangetranslates to . In this range,

is decreasing. So, it is sufficient to showthat is decreasing in , or its derivative is negative.This is equivalent to showing that . Now

Using integration by parts this indeed becomes

APPENDIX CDECREASINGCONVEX FUNCTIONS

To verify that the inverse of a decreasing convex function isconvex, let be an invertible convex function (in somerange ). We have

for . Substituting and, and similarly for , we get

If is a decreasing function, then this implies

proving that is convex as well.

Page 15: Discrete multitone modulation with principal component ...systems.caltech.edu/dsp/students/sony/journ/ppsdmtieee.pdf · IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS—I: FUNDAMENTAL

VAIDYANATHAN et al.: DISCRETE MULTITONE MODULATION WITH PRINCIPAL COMPONENT FILTER BANKS 1411

REFERENCES

[1] A. N. Akansu, P. Duhamel, X. Lin, and M. de. Courville, “Orthogonaltransmultiplexers in communications: A review,”IEEE Trans. SignalProcessing, vol. 46, pp. 979–995, Apr. 1998.

[2] S. Akkarakaran and P. P. Vaidyanathan, “On optimization of filter bankswith denoising applications,” inProc. IEEE ISCAS’99, Orlando, FL,June 1999.

[3] , “The role of principal component filter banks in noise reduction,”in Proc. SPIE, Denver, CO, July 1999.

[4] , “Filter bank optimization with convex objectives, and the opti-mality of principal component forms,”IEEE Trans. Signal Processing,vol. 49, pp. 100–114, Jan. 2001.

[5] , “Results on principal component filter banks: Colored noise sup-pression and existence issues,”IEEE Trans. Inform. Theory, to be pub-lished.

[6] , “Discrete multitone communication with principal componentfilter banks,” inProc. IEEE Int. Conf. Communications (ICC), Helsinki,Finland, June 2001.

[7] N. Al-Dhahir and J. M. Cioffi, “Block transmission over dispersive chan-nels: Transmit filter optimization and realization, and MMSE-DFE re-ceiver performance,”IEEE Trans. Inform. Theory, vol. 42, pp. 137–160,Jan. 1996.

[8] J. A. C. Bingham, “Multicarrier modulation for data transmission: Anidea whose time has come,”IEEE Commun. Mag., pp. 5–14, May 1990.

[9] G. Cherubini, E. Eleftheriou, S. Olcer, and J. M. Cioffi, “Filter bankmodulation techniques for very high speed digital subscriber lines,”IEEE Commun. Mag., pp. 98–104, May 2000.

[10] J. S. Chow, J. C. Tu, and J. M. Cioffi, “A discrete multitone transreceiversystem for HDSL applications,”IEEE J. Select. Areas Commun., vol. 9,pp. 895–908, Aug. 1991.

[11] T. M. Cover and J. A. Thomas,Elements of Information Theory. NewYork: Wiley, 1991.

[12] I. Djokovic and P. P. Vaidyanathan, “On optimal analysis/synthesis fil-ters for coding gain optimization,”IEEE Trans. Signal Processing, vol.44, pp. 1276–1279, May 1996.

[13] G. B. Giannakis, “Filter banks for blind channel identification and equal-ization,” IEEE Signal Processing Lett., vol. 4, pp. 184–187, June 1997.

[14] N. S. Jayant and P. Noll,Digital Coding of Waveforms. EnglewoodCliffs, NJ: Prentice-Hall, 1984.

[15] I. Kalet, “The multitone channel,”IEEE Trans. Commun., vol. 37, pp.119–124, Feb. 1989.

[16] I. Kalet and S. Shlomo, “On the capacity of a twisted-wire pair: Gaussianmodel,” IEEE Trans. Commun., vol. 38, pp. 379–383, Mar. 1990.

[17] I. Kalet, “Multitone modulation,” inSubband and Wavelet Transforms,A. N. Akansu and M. J. Smith, Eds. Norwell, MA: Kluwer , 1996.

[18] J. K. Kerpez, “Near-end crosstalk is almost Gaussian,”IEEE Trans.Commun., vol. 41, pp. 670–672, Jan. 1993.

[19] B. P. Lathi, Modern Digital and Analog Communication Sys-tems. Oxford, U.K.: Oxford Univ. Press, 1998.

[20] X. Lin and A. N. Akansu, “A distortion analysis and optimal design oforthonormal basis for DMT receivers,” inProc. ICASSP’96, 1996, pp.1475–1478.

[21] Y. P. Lin, P. P. Vaidyanathan, S. Akkarakaran, and S.-M. Phoong, “Onthe duality of optimal DMT systems and biorthogonal subband coders,”in Proc. ICASSP’00, Istanbul, Turkey, June 2000.

[22] Y.-P. Lin and S.M. Phoong, “Perfect discrete multitone modulationwith optimal transceivers,”IEEE Trans. Signal Processing, vol. 48, pp.1702–1712, June 2000.

[23] P. Moulin, “A new look at signal-adapted QMF bank design,” inProc.ICASSP’95, Detroit, MI, May 1995, pp. 1312–1315.

[24] P. Moulin, M. Anitescu, and K. Ramchandran, “Theory of rate-distortionoptimal, constrained filter banks—Applications to IIR and FIR biorthog-onal designs,”IEEE Trans. Signal Processing, vol. 48, pp. 1120–1132,Apr. 2000.

[25] D. Pal, G. N. Iyengar, and J. M. Cioffi, “A new method of channel short-ening with applications to discrete multitone (DMT) systems,” inProc.IEEE Int. Conf. Communications, vol. 2, 1998, pp. 763–768.

[26] J. G. Proakis,Digital Communications. New York: McGraw Hill,1995.

[27] A. D. Rizos, J. G. Proakis, and T. Q. Nguyen, “Comparison of DFTand cosine modulated filter banks in multicarrier modulation,” inProc.Globecom’94, Nov. 1994, pp. 687–691.

[28] A. Scaglione, G. B. Giannakis, and S. Barbarossa, “Redundant filterbank precoders and equalizers Part I: Unification and optimal designs,”IEEE Trans. Signal Processing, vol. 47, pp. 1988–2006, July 1999.

[29] , “Redundant filter bank precoders and equalizers—Part II: Syn-chronization and direct equalization,”IEEE Trans. Signal Processing,vol. 47, pp. 2007–2022, July 1999.

[30] A. Scaglione, S. Barbarossa, and G. B. Giannakis, “Filterbank trans-ceivers optimizing information rate in block transmissions over disper-sive channels,”IEEE Trans. Inform. Theory, vol. 45, pp. 1019–1032,Apr. 1999.

[31] T. Starr, J. M. Cioffi, and P. J. Silverman,Understanding Digital Sub-scriber Line Technology. Englewood Cliffs, NJ: Prentice-Hall, 1999.

[32] M. K. Tsatsanis and G. B. Giannakis, “Principal component filter banksfor optimal multiresolution analysis,”IEEE Trans. Signal Processing,vol. 43, pp. 1766–1777, Aug. 1995.

[33] M. A. Tzannes, M. C. Tzannes, J. G. Proakis, and P. N. Heller, “DMTsystems, DWMT systems, and digital filter banks,” inProc. ICC’94,1994, pp. 311–315.

[34] M. Unser, “On the optimality of ideal filters for pyramid and waveletsignal approximation,”IEEE Trans. Signal Processing, vol. 41, pp.3591–3596, Dec. 1993.

[35] , “An extension of the KLT for wavelets and perfect reconstructionfilter banks,” inProc. Conf. Wavelet Applications in Signal and Image,San Diego, CA, 1993, pp. 45–56.

[36] P. P. Vaidyanathan,Multirate Systems and Filter Banks. EnglewoodCliffs, NJ: Prentice-Hall, 1993.

[37] , “Theory of optimal orthonormal subband coders,”IEEE Trans.Signal Processing, vol. 46, pp. 1528–1543, June 1998.

[38] P. P. Vaidyanathan, Y.-P. Lin, S. Akkarakaran, and S.-M. Phoong, “Opti-malilty of principal component filter banks for discrete multitone com-munication systems,” inProc. IEEE ISCAS’00, Geneva, Switzerland,May 2000.

[39] , “Optimizing the capacity of orthogonal and biorthogonal DMTchannels,” inProc. EUSIPCO’00, Tampere, Finland, Sept. 2000.

[40] P. P. Vaidyanathan and S. Akkarakaran, “A review of the theory andapplications of optimal subband and transform coders,”J. Appl. Comput.Harmonic Analysis, to be published.

[41] L. Vandendorpe, L. Cuvelier, F. Deryck, J. Louveaux, and O. vande Wiel, “Fractionally spaced linear and decision feedback detectorsfor transmultiplexers,”IEEE Trans. Signal Processing, vol. 46, pp.996–1011, Apr. 1998.

[42] M. Vetterli and J. Kovacevic, Wavelets and SubbandCoding. Englewood Cliffs, NJ: Prentice-Hall, 1995.

[43] J.-J. Werner, “The HDSL environment,”IEEE J. Select. Areas inCommun., vol. 9, pp. 785–800, Aug. 1991.

[44] X.-G. Xia, “New precoding for intersymbol interference cancellationusing nonmaximally decimated multirate filter banks with ideal FIRequalizers,”IEEE Trans. Signal Processing, vol. 45, pp. 2431–2441,Oct. 1997.

[45] , “Filterbank precoders for blind equalization: Polynomial ambi-guity resistant precoders (PARP),”IEEE Trans. Circuits Syst. I, vol. 48,pp. 193–209, Feb. 2001.

[46] B. Xuan and R. H. Bamberger, “FIR principal component filter banks,”IEEE Trans. Signal Processing, vol. 46, pp. 930–940, Apr. 1998.

P. P. Vaidyanathan(S’80–M’83–SM’88–F’91) wasborn in Calcutta, India, on Oct. 16, 1954. He receivedthe B.Sc. (Hons.) degree in physics and the B.Tech.and M.Tech. degrees in radiophysics and electronics,all from the University of Calcutta, India, in 1974,1977, and 1979, respectively, and the Ph.D. degree inelectrical and computer engineering from the Univer-sity of California at Santa Barbara in 1982.

He was a Postdoctoral Fellow at the University ofCalifornia, Santa Barbara from September 1982 toMarch 1983. In March 1983, he joined the Electrical

Engineering Department of the California Institute of Technology, Pasadena, asan Assistant Professor, and since 1993, has been Professor of electrical engi-neering there. His main research interests are in digital signal processing, mul-tirate systems, wavelet transforms and signal processing for digital communi-cations.

Page 16: Discrete multitone modulation with principal component ...systems.caltech.edu/dsp/students/sony/journ/ppsdmtieee.pdf · IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS—I: FUNDAMENTAL

1412 IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS—I: FUNDAMENTAL THEORY AND APPLICATIONS, VOL. 49, NO. 10, OCTOBER 2002

Dr. Vaidyanathan served as Vice-Chairman of the Technical Program com-mittee for the 1983 IEEE International Symposium on Circuits and Systems,and as the Technical Program Chairman for the 1992 IEEE InternationalSymposium on Circuits and Systems. He was an Associate Editor for theIEEE TRANSACTIONS ONCIRCUITS AND SYSTEMS for the period 1985–1987,and is currently an Associate Editor for the journal IEEE SIGNAL PROCESSING

LETTERS, and a Consulting Editor for the journalApplied and ComputationalHarmonic Analysis. He has been a Guest Editor in 1998 for special issues of theIEEE TRANSACTIONS ON SIGNAL PROCESSINGand the IEEE TRANSACTIONS

ON CIRCUITS AND SYSTEMS II, on the topics of filter banks, wavelets andsubband coders. He has authored a number of papers in IEEE journals, and isthe author of the bookMultirate Systems and Filter Banks. (NJ, EnglewoodCliffs: Prentice Hall, 1993). He has written several chapters for various signalprocessing handbooks. He was a recipient of the Award for excellence inteaching at the California Institute of Technology for the years 1983–1984,1992–1993, and 1993–1994. He also received the NSF’s Presidential YoungInvestigator Award in 1986. In 1989 he received the IEEE ASSP SeniorAward for his paper on multirate perfect-reconstruction filter banks. In 1990he was recipient of the S. K. Mitra Memorial Award from the Institute ofElectronics and Telecommunications Engineers, India, for his joint paperin the IETE journal. He was also the coauthor of a paper on linear-phaseperfect reconstruction filter banks in the IEEE SP TRANSACTIONS, for whichthe first author (Truong Nguyen) received the Young Outstanding AuthorAward in 1993. He received the 1995 F. E. Terman Award of the AmericanSociety for Engineering Education, sponsored by Hewlett Packard Co., forhis contributions to engineering education, especially the bookMultirateSystems and Filter Banks. He has given several plenary talks including at theSampta’01, Eusipco’98, SPCOM’95, and Asilomar’88 conferences on signalprocessing. He has been chosen a distinguished lecturer for the IEEE SignalProcessing Society for the year 1996–1997. In 1999, he was chosen to receivethe IEEE CAS Society’s Golden Jubilee Medal. He is a recipient of the IEEESignal Processing Society’s Technical Achievement Award for the year 2002.

Yuan-Pei Lin (S’93–M’97) was born in Taipei,Taiwan, R.O.C., in1970. She received the B.S.degree in control engineering from the NationalChiao-Tung University, Hsinchu, Taiwan, R.O.C.,in 1992, and the M.S. and Ph.D. degrees, both inelectrical engineering from California Institute ofTechnology, Pasadena, in 1993 and 1997, respec-tively.

She joined the Department of Electrical and Con-trol Engineering of National Chiao-Tung Universityin 1997. Her research interests include multirate filter

banks, wavelets and applications to communication systems. She is currently anAssociate Editor forMultidimensional Systems and Signal Processing.

Sony Akkarakaran (S’97–M’01) was born inThrissur, India in 1975. He received the B.Tech.degree from the Indian Institute of Technology,Bombay, in 1996, and the M.S. and the Ph.D.degrees from the California Institute of Technology,Pasadena, both in electrical engineering, in 1997 and2001, respectively.

Since July 2001, he has been with SequoiaCommunications Corp., Los Angeles, working ondesigning the baseband processor for a WCDMAmobile receiver. His doctoral thesis was on filter bank

optimization with communications and noise suppression applications. Hisresearch interests are wireless communications, CDMA and OFDM systems,filter banks and wavelets, and digital signal processing for communications.

See-May Phoong(S’93–A’96) was born in Johor,Malaysia, in 1968. He received the B.S. degree inelectrical engineering from the National TaiwanUniversity, Taipei, Taiwan, in 1991, and the M.S.and Ph.D. degrees in electrical engineering fromthe California Institute of Technology (Caltech),Pasadena, in 1992 and 1996, respectively.

He joined the faculty of the Department of Elec-tronic and Electrical Engineering, Nanyang Techno-logical University, Singapore, from September 1996to September 1997. In September 1997, he joined the

Graduate Institute of Communication Engineering, National Taiwan University, Taipei, Taiwan, as an Assistant Professor and since 2002, he has been an As-sociate Professor. His interests include multirate signal processing, filter banksand their application to communications.

Dr. Phoong is currently an Associate Editor for IEEE TRANSACTIONS ON

CIRCUITS AND SYSTEMS II, and IEEE SIGNAL PROCESSINGLETTERS. He is therecipient of the Wilts Prize (1997) for outstanding independent research in Elec-trical Engineering at Caltech.


Recommended