+ All Categories
Home > Documents > Motivation - spi.labri.fr · C. Deledalle (CEREMADE) S´eminaire Probl`emes Inverses 16 f´evrier...

Motivation - spi.labri.fr · C. Deledalle (CEREMADE) S´eminaire Probl`emes Inverses 16 f´evrier...

Date post: 26-Jan-2021
Category:
Upload: others
View: 2 times
Download: 0 times
Share this document with a friend
26
Motivation Different manifestations of noise in imagery (a) Mitochondrion in microscopy c Chandra (b) Supernova in X-ray imagery (c) Fetus using ultrasound imagery (d) Plane wreckage in SONAR imagery c ONERA c CNES (e) Urban area using SAR imagery c DLR (f) Polarimetric SAR imagery C. Deledalle (CEREMADE) eminaire Probl` emes Inverses 16 f´ evrier 2012 4 / 41
Transcript
  • Motivation

    Different manifestations of noise in imagery

    (a) Mitochondrion in microscopy

    c�Chandra

    (b) Supernova in X-ray imagery (c) Fetus using ultrasound imagery

    (d) Plane wreckage in SONAR imagery

    c�ONERA c�CNES

    (e) Urban area using SAR imagery

    c�DLR

    (f) Polarimetric SAR imagery

    C. Deledalle (CEREMADE) Séminaire Problèmes Inverses 16 février 2012 4 / 41

  • Requirements for SAR image denoising methods

    Adapt to non-Gaussian noise distributions

    (a) Gaussian noise (b) BM3D filter (a) Signal-dependent noise (b) BM3D filter

    Adapt to complex-valued multivariate data

    c�DLR

    Process large images in reasonable time

    Control smoothing strength (noise reduction vs resolution loss tradeoff)

    C. Deledalle (CEREMADE) Séminaire Problèmes Inverses 16 février 2012 5 / 41

  • Outline

    1 Positioning and the limits of patch-based filtering

    2 A new similarity criterion to compare noisy patches

    3 Proposed methodology for non-Gaussian noise filteringIterative non-local filtering schemeAutomatic setting of the denoising parameters

    4 Adaptation to local image structures

    5 Conclusion and perspectives

    C. Deledalle (CEREMADE) Séminaire Problèmes Inverses 16 février 2012 6 / 41

  • Outline

    1 Positioning and the limits of patch-based filtering

    2 A new similarity criterion to compare noisy patches

    3 Proposed methodology for non-Gaussian noise filteringIterative non-local filtering schemeAutomatic setting of the denoising parameters

    4 Adaptation to local image structures

    5 Conclusion and perspectives

    C. Deledalle (CEREMADE) Séminaire Problèmes Inverses 16 février 2012 6 / 41

  • State-of-the-art of denoising approaches

    Patch-based approaches perform best (see review of [Katkovnik et al., 2010])

    C. Deledalle (CEREMADE) Séminaire Problèmes Inverses 16 février 2012 6 / 41

  • Selection-based filtering

    General idea

    Goal: estimate the image u from the noisy image v

    Choose a pixel x to denoise

    Inspect the pixels x� around the pixel of interest xSelect the suitable candidates x�

    Average their values and update the value of x

    Repeat for all pixel x

    How to choose suitable pixels x� to combine?

    C. Deledalle (CEREMADE) Séminaire Problèmes Inverses 16 février 2012 7 / 41

  • Selection-based filtering

    General idea

    Goal: estimate the image u from the noisy image v

    Choose a pixel x to denoiseInspect the pixels x� around the pixel of interest xSelect the suitable candidates x�

    Average their values and update the value of x

    Repeat for all pixel x

    How to choose suitable pixels x� to combine?

    C. Deledalle (CEREMADE) Séminaire Problèmes Inverses 16 février 2012 7 / 41

  • Selection-based filtering

    General idea

    Goal: estimate the image u from the noisy image v

    Choose a pixel x to denoiseInspect the pixels x� around the pixel of interest xSelect the suitable candidates x�

    Average their values and update the value of x

    Repeat for all pixel x

    How to choose suitable pixels x� to combine?

    C. Deledalle (CEREMADE) Séminaire Problèmes Inverses 16 février 2012 7 / 41

  • Selection-based filtering

    General idea

    Goal: estimate the image u from the noisy image v

    Choose a pixel x to denoiseInspect the pixels x� around the pixel of interest xSelect the suitable candidates x�

    Average their values and update the value of x

    Repeat for all pixel x

    How to choose suitable pixels x� to combine?

    C. Deledalle (CEREMADE) Séminaire Problèmes Inverses 16 février 2012 7 / 41

  • Selection-based filtering

    General idea

    Goal: estimate the image u from the noisy image v

    Choose a pixel x to denoiseInspect the pixels x� around the pixel of interest xSelect the suitable candidates x�

    Average their values and update the value of x

    Repeat for all pixel x

    How to choose suitable pixels x� to combine?

    C. Deledalle (CEREMADE) Séminaire Problèmes Inverses 16 février 2012 7 / 41

  • Selection-based filtering

    General idea

    Goal: estimate the image u from the noisy image v

    Choose a pixel x to denoiseInspect the pixels x� around the pixel of interest xSelect the suitable candidates x�

    Average their values and update the value of x

    Repeat for all pixel x

    How to choose suitable pixels x� to combine?

    C. Deledalle (CEREMADE) Séminaire Problèmes Inverses 16 février 2012 7 / 41

  • Selection-based filtering

    General idea

    Goal: estimate the image u from the noisy image v

    Choose a pixel x to denoiseInspect the pixels x� around the pixel of interest xSelect the suitable candidates x�

    Average their values and update the value of x

    Repeat for all pixel x

    How to choose suitable pixels x� to combine?

    C. Deledalle (CEREMADE) Séminaire Problèmes Inverses 16 février 2012 7 / 41

  • Selection-based filtering

    General idea

    Goal: estimate the image u from the noisy image v

    Choose a pixel x to denoiseInspect the pixels x� around the pixel of interest xSelect the suitable candidates x�

    Average their values and update the value of x

    Repeat for all pixel x

    How to choose suitable pixels x� to combine?

    C. Deledalle (CEREMADE) Séminaire Problèmes Inverses 16 février 2012 7 / 41

  • Patch-based filtering

    Non-local approach [Buades et al., 2005]

    Local filters: select neighborhood pixels

    Non-local filters: select pixels being in a similar context

    Euclidean distance between noise−free valuesEucl

    idean d

    ista

    nce

    betw

    een n

    ois

    e−

    free p

    atc

    hes

    0 10 20 30 40 500

    10

    20

    30

    40

    50

    0

    0.05

    0.1

    0.15

    How to compare noisy patches?

    C. Deledalle (CEREMADE) Séminaire Problèmes Inverses 16 février 2012 8 / 41

  • Patch-based filtering

    Non-local approach [Buades et al., 2005]

    Local filters: select neighborhood pixels

    Non-local filters: select pixels being in a similar context

    How to compare noisy patches?

    C. Deledalle (CEREMADE) Séminaire Problèmes Inverses 16 février 2012 8 / 41

  • Patch-based filtering

    Non-local approach [Buades et al., 2005]

    Local filters: select neighborhood pixels

    Non-local filters: select pixels being in a similar context

    How to compare noisy patches?

    C. Deledalle (CEREMADE) Séminaire Problèmes Inverses 16 février 2012 8 / 41

  • Patch-based filtering

    Non-local approach [Buades et al., 2005]

    Local filters: select neighborhood pixels

    Non-local filters: select pixels being in a similar context

    How to compare noisy patches?

    C. Deledalle (CEREMADE) Séminaire Problèmes Inverses 16 février 2012 8 / 41

  • Patch-similarity from the Euclidean distance

    How to compare noisy patches?

    Assume noise is additive and Gaussian such that:

    � �� �v1

    =

    � �� �u1

    +

    � �� �n1

    and

    � �� �v2

    =

    � �� �u2

    +

    � �� �n2

    [Buades et al., 2005] suggest using the Euclidean distance:

    when u1 = u2 :

    �−

    �2= is low ⇒ decide “similar”

    when u1 �= u2 :

    �−

    �2= is high ⇒ decide “dissimilar”

    What about non-Gaussian noise?

    C. Deledalle (CEREMADE) Séminaire Problèmes Inverses 16 février 2012 9 / 41

  • Patch-similarity from the Euclidean distance

    How to compare noisy patches?

    Assume noise is additive and Gaussian such that:

    � �� �v1

    =

    � �� �u1

    +

    � �� �n1

    and

    � �� �v2

    =

    � �� �u2

    +

    � �� �n2

    [Buades et al., 2005] suggest using the Euclidean distance:

    when u1 = u2 :

    �−

    �2= is low ⇒ decide “similar”

    when u1 �= u2 :

    �−

    �2= is high ⇒ decide “dissimilar”

    What about non-Gaussian noise?

    C. Deledalle (CEREMADE) Séminaire Problèmes Inverses 16 février 2012 9 / 41

  • Limits of the Euclidean distance

    Beyond the Gaussian noise assumption

    Noise can be non-additive and/or non-Gaussian, e.g., for Poisson noise:

    � �� �v1

    =

    � �� �u1

    +

    � �� �n1

    and

    � �� �v2

    =

    � �� �u2

    +

    � �� �n2

    The Euclidean distance is no longer discriminant:

    when u1 = u2 :

    �−

    �2=

    when u1 �= u2 :

    �−

    �2=

    Consequence?

    C. Deledalle (CEREMADE) Séminaire Problèmes Inverses 16 février 2012 10 / 41

  • Limits of the Euclidean distance

    Beyond the Gaussian noise assumption

    Noise can be non-additive and/or non-Gaussian, e.g., for Poisson noise:

    � �� �v1

    =

    � �� �u1

    +

    � �� �n1

    and

    � �� �v2

    =

    � �� �u2

    +

    � �� �n2

    The Euclidean distance is no longer discriminant:

    when u1 = u2 :

    �−

    �2=

    when u1 �= u2 :

    �−

    �2=

    Consequence?

    C. Deledalle (CEREMADE) Séminaire Problèmes Inverses 16 février 2012 10 / 41

  • Limits of the Euclidean distance

    Beyond the Gaussian noise assumption – IllustrationDrivenby

    thenoise-free

    content

    Drivenby

    thenoisyco

    ntent

    � �� �Gaussian noise

    � �� �Poisson noise

    When comparing noisy patches, one should take into account the noise distribution.

    C. Deledalle (CEREMADE) Séminaire Problèmes Inverses 16 février 2012 11 / 41

  • Outline

    1 Positioning and the limits of patch-based filtering

    2 A new similarity criterion to compare noisy patches

    3 Proposed methodology for non-Gaussian noise filteringIterative non-local filtering schemeAutomatic setting of the denoising parameters

    4 Adaptation to local image structures

    5 Conclusion and perspectives

    C. Deledalle (CEREMADE) Séminaire Problèmes Inverses 16 février 2012 12 / 41

  • Motivation

    (a) Microscopy (b) Astronomy (c) SAR polarimetry

    � �� �

    ?� �� �

    ?� �� �

    ?How to take into account the noise model?

    C. Deledalle (CEREMADE) Séminaire Problèmes Inverses 16 février 2012 12 / 41

  • Similarity through variance stabilization

    Variance stabilization approach

    Use an application s which stabilizes the variance for a specific noise model

    Evaluate the Euclidean distance between the transformed patches:�s

    � �− s

    � ��2=

    �−

    �2,

    Example

    Gamma noise (multiplicative) and the homomorphic approach:

    s(V ) = log V

    Poisson noise and the Anscombe transform:

    s(V ) = 2

    �V +

    3

    8

    C. Deledalle (CEREMADE) Séminaire Problèmes Inverses 16 février 2012 13 / 41

  • Similarity through variance stabilization

    Variance stabilization approach

    Use an application s which stabilizes the variance for a specific noise model

    Evaluate the Euclidean distance between the transformed patches:�s

    � �− s

    � ��2=

    �−

    �2,

    Example

    Gamma noise (multiplicative) and the homomorphic approach:

    s(V ) = log V

    Poisson noise and the Anscombe transform:

    s(V ) = 2

    �V +

    3

    8

    C. Deledalle (CEREMADE) Séminaire Problèmes Inverses 16 février 2012 13 / 41


Recommended