+ All Categories
Home > Documents > Introduction to Hilbert Space Frames - University of...

Introduction to Hilbert Space Frames - University of...

Date post: 16-Feb-2018
Category:
Upload: dinhnhi
View: 220 times
Download: 1 times
Share this document with a friend
25
Outline Introduction Frame Basics Examples of frames Dual frames Classification of frames in Euclidean space Fin... Introduction to Hilbert Space Frames Robert Crandall May 15, 2009 Robert Crandall Introduction to Hilbert Space Frames
Transcript
Page 1: Introduction to Hilbert Space Frames - University of Arizonamath.arizona.edu/~rcrandall/IntroToHilbertFrames_Slides.pdf · Outline Introduction Frame Basics Examples of frames Dual

OutlineIntroduction

Frame BasicsExamples of frames

Dual framesClassification of frames in Euclidean space

Fin...

Introduction to Hilbert Space Frames

Robert Crandall

May 15, 2009

Robert Crandall Introduction to Hilbert Space Frames

Page 2: Introduction to Hilbert Space Frames - University of Arizonamath.arizona.edu/~rcrandall/IntroToHilbertFrames_Slides.pdf · Outline Introduction Frame Basics Examples of frames Dual

OutlineIntroduction

Frame BasicsExamples of frames

Dual framesClassification of frames in Euclidean space

Fin...

IntroductionWhat is a frame?MotivationCoefficient Representations

Frame BasicsThe Frame Condition

Examples of framesBasesA linearly dependent frameAn infinite dimensional frame

Dual framesReconstructing a vectorThe Frame Operator’s AdjointThe Dual FrameFundamental Reconstruction FormulaExample of a Dual Frame

Classification of frames in Euclidean spaceFinite framesFinite normalized tight frames

Fin...

Robert Crandall Introduction to Hilbert Space Frames

Page 3: Introduction to Hilbert Space Frames - University of Arizonamath.arizona.edu/~rcrandall/IntroToHilbertFrames_Slides.pdf · Outline Introduction Frame Basics Examples of frames Dual

OutlineIntroduction

Frame BasicsExamples of frames

Dual framesClassification of frames in Euclidean space

Fin...

What is a frame?MotivationCoefficient Representations

What is a frame?

A frame is a generalization of a Hilbert space basis that is notnecessarily linearly independent. A frame allows us to representany vector as a set of ”frame coefficients,” and to reconstruct avector from its coefficients in a numerically stable way.

Robert Crandall Introduction to Hilbert Space Frames

Page 4: Introduction to Hilbert Space Frames - University of Arizonamath.arizona.edu/~rcrandall/IntroToHilbertFrames_Slides.pdf · Outline Introduction Frame Basics Examples of frames Dual

OutlineIntroduction

Frame BasicsExamples of frames

Dual framesClassification of frames in Euclidean space

Fin...

What is a frame?MotivationCoefficient Representations

Why frames?

Often want to decompose a function in terms of functions that arenot linearly independent.Examples:

I Windowed Fourier transforms

I Wavelet transforms

I Non-uniform sampling

Robert Crandall Introduction to Hilbert Space Frames

Page 5: Introduction to Hilbert Space Frames - University of Arizonamath.arizona.edu/~rcrandall/IntroToHilbertFrames_Slides.pdf · Outline Introduction Frame Basics Examples of frames Dual

OutlineIntroduction

Frame BasicsExamples of frames

Dual framesClassification of frames in Euclidean space

Fin...

What is a frame?MotivationCoefficient Representations

Coefficient Representations of Hilbert Space Vectors

Often useful to represent a vector by a sequence of coefficients.Familiar in Rn; consider

Figure: The vector (2,3) in R2, equal to 2e1 + 3e2Robert Crandall Introduction to Hilbert Space Frames

Page 6: Introduction to Hilbert Space Frames - University of Arizonamath.arizona.edu/~rcrandall/IntroToHilbertFrames_Slides.pdf · Outline Introduction Frame Basics Examples of frames Dual

OutlineIntroduction

Frame BasicsExamples of frames

Dual framesClassification of frames in Euclidean space

Fin...

What is a frame?MotivationCoefficient Representations

Another Example: Fourier coefficients

In L2(0, 1), the functions φn = e2πin (n ∈ Z) form an orthonormalbasis. We can represent functions in terms of their Fouriercoefficients:

cn = 〈φn, f 〉

This is the familiar Fourier series. Coefficients tell us the”frequency content” of a function.Function can be reconstructed from its coefficients using

f =∑n

cne2πin

Robert Crandall Introduction to Hilbert Space Frames

Page 7: Introduction to Hilbert Space Frames - University of Arizonamath.arizona.edu/~rcrandall/IntroToHilbertFrames_Slides.pdf · Outline Introduction Frame Basics Examples of frames Dual

OutlineIntroduction

Frame BasicsExamples of frames

Dual framesClassification of frames in Euclidean space

Fin...

What is a frame?MotivationCoefficient Representations

We determine coefficient representations by taking inner productswith some set of vectors φn. What sets of vectors will give suitablecoefficients?Frames! Frame theory gives necessary and sufficient condition forφn to give ”suitable” coefficients for every f ∈ H.

Robert Crandall Introduction to Hilbert Space Frames

Page 8: Introduction to Hilbert Space Frames - University of Arizonamath.arizona.edu/~rcrandall/IntroToHilbertFrames_Slides.pdf · Outline Introduction Frame Basics Examples of frames Dual

OutlineIntroduction

Frame BasicsExamples of frames

Dual framesClassification of frames in Euclidean space

Fin...

The Frame Condition

The Frame Operator

For a Hilbert space H and a set of vectors {φn}, define a mappingF such that ∀x ∈ H,

(Fx)n = 〈φn, x〉.

If the φn meet the ”frame condition,” then F is called a frameoperator. Note that F is linear.

Robert Crandall Introduction to Hilbert Space Frames

Page 9: Introduction to Hilbert Space Frames - University of Arizonamath.arizona.edu/~rcrandall/IntroToHilbertFrames_Slides.pdf · Outline Introduction Frame Basics Examples of frames Dual

OutlineIntroduction

Frame BasicsExamples of frames

Dual framesClassification of frames in Euclidean space

Fin...

The Frame Condition

What Vectors Give Suitable Coefficients?

We want to determine which sets of vectors φn can be used torepresent other vectors in a ”suitable” way.

1. Want unique coefficients for any f ∈ HI Frame operator should be injective

2. Want to be able to go from vector to coefficients, and backagain, in a numerically stable way

I Frame operator should be invertible, at least on its rangeI Frame operator and its pseudo-inverse should be bounded

For this we need the frame condition.

Robert Crandall Introduction to Hilbert Space Frames

Page 10: Introduction to Hilbert Space Frames - University of Arizonamath.arizona.edu/~rcrandall/IntroToHilbertFrames_Slides.pdf · Outline Introduction Frame Basics Examples of frames Dual

OutlineIntroduction

Frame BasicsExamples of frames

Dual framesClassification of frames in Euclidean space

Fin...

The Frame Condition

The Frame Condition

A set of vectors {φn} ∈ H is called a frame if there exist0 < A,B <∞ such that

A‖x‖2 ≤ ‖Fx‖2 ≤ B‖x‖2

where‖Fx‖2 =

∑|〈φn, x〉|2

for all x ∈ H.If A = B, φn is said to be a tight frame.

Robert Crandall Introduction to Hilbert Space Frames

Page 11: Introduction to Hilbert Space Frames - University of Arizonamath.arizona.edu/~rcrandall/IntroToHilbertFrames_Slides.pdf · Outline Introduction Frame Basics Examples of frames Dual

OutlineIntroduction

Frame BasicsExamples of frames

Dual framesClassification of frames in Euclidean space

Fin...

The Frame Condition

Why this frame condition?

I ‖Fx‖2 ≥ A‖x‖2 guarantees uniqueness of frame coefficients:

‖Fx − Fy‖ = 0 =⇒ ‖x − y‖ = 0

I ‖Fx‖2 ≤ B‖x‖2 guarantees numerical stability in computingframe coefficients, as long as B is reasonable:

‖F (x + δ)− F (x)‖ = ‖F δ‖ ≤√

B‖δ‖

I Also have stability when reconstructing a vector from itscoefficients; we will see that F has a left inverse bounded by1√A

.

Robert Crandall Introduction to Hilbert Space Frames

Page 12: Introduction to Hilbert Space Frames - University of Arizonamath.arizona.edu/~rcrandall/IntroToHilbertFrames_Slides.pdf · Outline Introduction Frame Basics Examples of frames Dual

OutlineIntroduction

Frame BasicsExamples of frames

Dual framesClassification of frames in Euclidean space

Fin...

BasesA linearly dependent frameAn infinite dimensional frame

Bases are frames

Any basis is also a frame. An orthonormal basis1 is a tight framewith A = B = 1 . However, a frame does not have to be a basis.

1An orthonormal basis is sometimes defined as a set of orthonormal vectorssatisfying the frame condition with A = B = 1

Robert Crandall Introduction to Hilbert Space Frames

Page 13: Introduction to Hilbert Space Frames - University of Arizonamath.arizona.edu/~rcrandall/IntroToHilbertFrames_Slides.pdf · Outline Introduction Frame Basics Examples of frames Dual

OutlineIntroduction

Frame BasicsExamples of frames

Dual framesClassification of frames in Euclidean space

Fin...

BasesA linearly dependent frameAn infinite dimensional frame

Not every frame is a basis

There are frames which are not bases. Let

F =

1 00 11 1

This is a frame operator, and its rows are the frame vectors. Framebounds come from the singular value decomposition:

σ1 =√

3, σ2 = 1

so‖x‖2 ≤ ‖Fx‖2 ≤ 3‖x‖2

Robert Crandall Introduction to Hilbert Space Frames

Page 14: Introduction to Hilbert Space Frames - University of Arizonamath.arizona.edu/~rcrandall/IntroToHilbertFrames_Slides.pdf · Outline Introduction Frame Basics Examples of frames Dual

OutlineIntroduction

Frame BasicsExamples of frames

Dual framesClassification of frames in Euclidean space

Fin...

BasesA linearly dependent frameAn infinite dimensional frame

A frame in L2 which is not a basis

A windowed Fourier frame of L2 has the form

{gn,k(t) = g(t − nu0)e ikξ0t}

for some window function g(t). This is useful for performinglocalized frequency analysis.

Robert Crandall Introduction to Hilbert Space Frames

Page 15: Introduction to Hilbert Space Frames - University of Arizonamath.arizona.edu/~rcrandall/IntroToHilbertFrames_Slides.pdf · Outline Introduction Frame Basics Examples of frames Dual

OutlineIntroduction

Frame BasicsExamples of frames

Dual framesClassification of frames in Euclidean space

Fin...

Reconstructing a vectorThe Frame Operator’s AdjointThe Dual FrameFundamental Reconstruction FormulaExample of a Dual Frame

The frame coefficients (Fx)n can be used to reconstruct any x .But how?For any frame {φn} and any vector x , we have the reconstructionformula

x =∑n

(Fx)nφ̃n

The φ̃n are not necessarily equal to the φn! They make up thedual frame.

Robert Crandall Introduction to Hilbert Space Frames

Page 16: Introduction to Hilbert Space Frames - University of Arizonamath.arizona.edu/~rcrandall/IntroToHilbertFrames_Slides.pdf · Outline Introduction Frame Basics Examples of frames Dual

OutlineIntroduction

Frame BasicsExamples of frames

Dual framesClassification of frames in Euclidean space

Fin...

Reconstructing a vectorThe Frame Operator’s AdjointThe Dual FrameFundamental Reconstruction FormulaExample of a Dual Frame

The Frame Operator’s Adjoint

To define the dual frame, we will need the adjoint of F .For a frame φn with frame operator F , the adjoint is the functionF ∗ l2 → H given by

F ∗c =∑

j

cjφj

Robert Crandall Introduction to Hilbert Space Frames

Page 17: Introduction to Hilbert Space Frames - University of Arizonamath.arizona.edu/~rcrandall/IntroToHilbertFrames_Slides.pdf · Outline Introduction Frame Basics Examples of frames Dual

OutlineIntroduction

Frame BasicsExamples of frames

Dual framesClassification of frames in Euclidean space

Fin...

Reconstructing a vectorThe Frame Operator’s AdjointThe Dual FrameFundamental Reconstruction FormulaExample of a Dual Frame

The Dual Frame

For a frame φn with frame operator F , the dual frame is

φ̃n = (F ∗F )−1φj

This is also a frame. Its frame operator2 is F̃ = F (F ∗F )−1. Itsframe bounds are given by

1

B‖x‖2 ≤ ‖F̃ x‖2 ≤ 1

A‖x‖2

2Note that if the frame is an orthonormal basis, F is unitary and F̃ = F !Robert Crandall Introduction to Hilbert Space Frames

Page 18: Introduction to Hilbert Space Frames - University of Arizonamath.arizona.edu/~rcrandall/IntroToHilbertFrames_Slides.pdf · Outline Introduction Frame Basics Examples of frames Dual

OutlineIntroduction

Frame BasicsExamples of frames

Dual framesClassification of frames in Euclidean space

Fin...

Reconstructing a vectorThe Frame Operator’s AdjointThe Dual FrameFundamental Reconstruction FormulaExample of a Dual Frame

Reconstruction formula

The frame operator and the dual frame operator satisfy

F̃ ∗F = F ∗F̃ = I

which gives the reconstruction formula3 for any x ∈ H:

x =∑

j

〈φj , x〉φ̃j =∑

j

〈φ̃j , x〉φj

3If the frame is an orthonormal basis, this reduces to x =P

j〈φj , x〉φj

Robert Crandall Introduction to Hilbert Space Frames

Page 19: Introduction to Hilbert Space Frames - University of Arizonamath.arizona.edu/~rcrandall/IntroToHilbertFrames_Slides.pdf · Outline Introduction Frame Basics Examples of frames Dual

OutlineIntroduction

Frame BasicsExamples of frames

Dual framesClassification of frames in Euclidean space

Fin...

Reconstructing a vectorThe Frame Operator’s AdjointThe Dual FrameFundamental Reconstruction FormulaExample of a Dual Frame

Example of a dual frame

Returning to our earlier example, with

F =

1 00 11 1

,

the dual frame operator is

F =

2/3 −1/3−1/3 2/31/3 1/3

.

The dual frame vectors are the rows of this matrix.

Robert Crandall Introduction to Hilbert Space Frames

Page 20: Introduction to Hilbert Space Frames - University of Arizonamath.arizona.edu/~rcrandall/IntroToHilbertFrames_Slides.pdf · Outline Introduction Frame Basics Examples of frames Dual

OutlineIntroduction

Frame BasicsExamples of frames

Dual framesClassification of frames in Euclidean space

Fin...

Reconstructing a vectorThe Frame Operator’s AdjointThe Dual FrameFundamental Reconstruction FormulaExample of a Dual Frame

Example of a dual frame (cont.)

Figure: Frame from example (blue) and dual frame (red)

Robert Crandall Introduction to Hilbert Space Frames

Page 21: Introduction to Hilbert Space Frames - University of Arizonamath.arizona.edu/~rcrandall/IntroToHilbertFrames_Slides.pdf · Outline Introduction Frame Basics Examples of frames Dual

OutlineIntroduction

Frame BasicsExamples of frames

Dual framesClassification of frames in Euclidean space

Fin...

Reconstructing a vectorThe Frame Operator’s AdjointThe Dual FrameFundamental Reconstruction FormulaExample of a Dual Frame

Say we want to expand x = (1, 2)T in terms of this frame. Wehave F̃ x = (0, 1, 1)T , so

x =

(12

)= 0

(10

)+ 1

(01

)+ 1

(11

).

The dual set of coefficients is Fx = (1, 2, 3)T , so the expansion interms of the dual frame vectors is

x =

(12

)= 1

(2/3−1/3

)+ 2

(−1/32/3

)+ 3

(1/31/3

).

Robert Crandall Introduction to Hilbert Space Frames

Page 22: Introduction to Hilbert Space Frames - University of Arizonamath.arizona.edu/~rcrandall/IntroToHilbertFrames_Slides.pdf · Outline Introduction Frame Basics Examples of frames Dual

OutlineIntroduction

Frame BasicsExamples of frames

Dual framesClassification of frames in Euclidean space

Fin...

Finite framesFinite normalized tight frames

Classification of Euclidean space frames

A finite set of vectors {φn} ∈ Rn is a frame iff it spans Rn andsatisfies ∑

n

‖φn‖2 <∞

Thus, any finite spanning set is a frame, and an infinite set can bea frame as long as the magnitudes of the frame vectors decaysufficiently quickly.

Robert Crandall Introduction to Hilbert Space Frames

Page 23: Introduction to Hilbert Space Frames - University of Arizonamath.arizona.edu/~rcrandall/IntroToHilbertFrames_Slides.pdf · Outline Introduction Frame Basics Examples of frames Dual

OutlineIntroduction

Frame BasicsExamples of frames

Dual framesClassification of frames in Euclidean space

Fin...

Finite framesFinite normalized tight frames

A special class of frames called Finite Normalized Tight Frames(FNTFs) exhibit a great deal of symmetry. These are tight framesconsisting of finitely many unit vectors. Classification of these ismore difficult, but has been done; see paper ”Finite NormalizedTight Frames” in bibliography.Some interesting results about FNTFs in Rn:

I FNTFs in Rn consisting of k vectors exist for all k ≥ n

I Frame bound of a FNTF measures ”redunancy” of framevectors; given by A = k

n

Robert Crandall Introduction to Hilbert Space Frames

Page 24: Introduction to Hilbert Space Frames - University of Arizonamath.arizona.edu/~rcrandall/IntroToHilbertFrames_Slides.pdf · Outline Introduction Frame Basics Examples of frames Dual

OutlineIntroduction

Frame BasicsExamples of frames

Dual framesClassification of frames in Euclidean space

Fin...

Finite framesFinite normalized tight frames

I The FNTFs with A = 1 are precisely the orthonormal bases inRn

I The vertices of any Platonic solid are a frame in Rn, as well asthe vertices of some other highly symmetric shapes like the”soccer ball”

I Problem of classifying FNTFs is related to problem ofequidistribution; how to ”evenly” distribute k vectors on theunit sphere?

Robert Crandall Introduction to Hilbert Space Frames

Page 25: Introduction to Hilbert Space Frames - University of Arizonamath.arizona.edu/~rcrandall/IntroToHilbertFrames_Slides.pdf · Outline Introduction Frame Basics Examples of frames Dual

OutlineIntroduction

Frame BasicsExamples of frames

Dual framesClassification of frames in Euclidean space

Fin...

The End

Thanks to Dr. Faris for advising this project.

References:

I A Wavelet Tour of Signal Processing, Stephan Mallat

I Ten Lectures on Wavelets, Ingrid Daubechies

I ”Finite Normalized Tight Frames”, J. Benedetto & M. Fickus,Advances in Computational Mathematics 18:357-385, 2003

Robert Crandall Introduction to Hilbert Space Frames


Recommended