+ All Categories
Home > Documents > An algorithm for image restoration with mixed noise using total … · Key words: Image denoising,...

An algorithm for image restoration with mixed noise using total … · Key words: Image denoising,...

Date post: 21-Jan-2021
Category:
Upload: others
View: 7 times
Download: 0 times
Share this document with a friend
20
Turk J Elec Eng & Comp Sci (2018) 26: 2831 – 2845 © TÜBİTAK doi:10.3906/elk-1803-100 Turkish Journal of Electrical Engineering & Computer Sciences http://journals.tubitak.gov.tr/elektrik/ Research Article An algorithm for image restoration with mixed noise using total variation regularization Cong Thang PHAM 1,2,, Guilhem GAMARD 1 ,, Andrei KOPYLOV 3 ,, Thi Thu Thao TRAN 3,4 , 1 Faculty of Computer Science, National Research University Higher School of Economics, Moscow, Russia 2 The University of Da Nang - University of Science and Technology, Da Nang, Vietnam 3 Institute of Applied Mathematics and Computer Science, Tula State University, Tula, Russia 4 The University of Da Nang - University of Economics, Da Nang, Vietnam Received: 15.03.2018 Accepted/Published Online: 22.08.2018 Final Version: 29.11.2018 Abstract: We present here an effective scheme for image denoising based on total variation regularization. The proposed scheme allows to efficiently remove Poisson noise as well as Gaussian noise simultaneously with the help of a new kind of data fidelity term, suitable for the mixed Poisson–Gaussian noise model. The results show that the algorithm corresponding to our new scheme outperforms the existing methods for mixed Poisson–Gaussian noise removal. Key words: Image denoising, Gaussian noise, Poisson noise, total variation regularization, mixed noise distribution, gradient flow 1. Introduction This paper addresses the image reconstruction problem. Let there be an image, considered as a matrix of pixel values, which has been corrupted by some random noise. Our task is to compute an estimation of what the original image was. A wide range of image acquisition devices are subject to noise and therefore this problem has many applications, e.g., in medical imagery, astronomy, microscopy, or even usual digital cameras. The distribution of the random noise is usually known in advance since it can be deduced from the physical process of image acquisition. However, this distribution generally has some parameters that cannot be computed a priori and therefore have to be estimated by the image reconstruction algorithm itself. Two types of noise are commonly found in image acquisition applications: Gaussian noise and Poisson noise. A large body of literature is devoted to the denoising problem for both types: see [1] and its reference list for the Poisson case, and [25] for the Gaussian case. In [6], the authors proposed to model the noise with a mixture of Poisson and Gaussian distributions. The Gaussian part accounts for signal-independent sources of noise, such as thermal and electronic noise [7, 8]. The Poisson part accounts for the uncertainty intrinsic to the photon-counting process used in detectors. This makes noise strongly signal-dependent, which is especially true for electronic microscopy or astronomy, so the additive Gaussian noise model itself cannot provide sufficient accuracy for further data analysis and interpretation. Various approaches have been investigated to denoise images with Poisson–Gaussian noise [911]. In general, image denoising is an ill-posed problem. Therefore, we have to use some a priori knowledge Correspondence: [email protected] This work is licensed under a Creative Commons Attribution 4.0 International License. 2831
Transcript
Page 1: An algorithm for image restoration with mixed noise using total … · Key words: Image denoising, Gaussian noise, Poisson noise, total variation regularization, mixed noise distribution,

Turk J Elec Eng & Comp Sci(2018) 26: 2831 – 2845© TÜBİTAKdoi:10.3906/elk-1803-100

Turkish Journal of Electrical Engineering & Computer Sciences

http :// journa l s . tub i tak .gov . t r/e lektr ik/

Research Article

An algorithm for image restoration with mixed noise using total variationregularization

Cong Thang PHAM1,2∗ , Guilhem GAMARD1 , Andrei KOPYLOV 3 ,Thi Thu Thao TRAN 3,4

1Faculty of Computer Science, National Research University Higher School of Economics, Moscow, Russia2The University of Da Nang - University of Science and Technology, Da Nang, Vietnam

3Institute of Applied Mathematics and Computer Science, Tula State University, Tula, Russia4The University of Da Nang - University of Economics, Da Nang, Vietnam

Received: 15.03.2018 • Accepted/Published Online: 22.08.2018 • Final Version: 29.11.2018

Abstract: We present here an effective scheme for image denoising based on total variation regularization. The proposedscheme allows to efficiently remove Poisson noise as well as Gaussian noise simultaneously with the help of a newkind of data fidelity term, suitable for the mixed Poisson–Gaussian noise model. The results show that the algorithmcorresponding to our new scheme outperforms the existing methods for mixed Poisson–Gaussian noise removal.

Key words: Image denoising, Gaussian noise, Poisson noise, total variation regularization, mixed noise distribution,gradient flow

1. IntroductionThis paper addresses the image reconstruction problem. Let there be an image, considered as a matrix of pixelvalues, which has been corrupted by some random noise. Our task is to compute an estimation of what theoriginal image was. A wide range of image acquisition devices are subject to noise and therefore this problemhas many applications, e.g., in medical imagery, astronomy, microscopy, or even usual digital cameras. Thedistribution of the random noise is usually known in advance since it can be deduced from the physical processof image acquisition. However, this distribution generally has some parameters that cannot be computed apriori and therefore have to be estimated by the image reconstruction algorithm itself.

Two types of noise are commonly found in image acquisition applications: Gaussian noise and Poissonnoise. A large body of literature is devoted to the denoising problem for both types: see [1] and its referencelist for the Poisson case, and [2–5] for the Gaussian case. In [6], the authors proposed to model the noise witha mixture of Poisson and Gaussian distributions. The Gaussian part accounts for signal-independent sources ofnoise, such as thermal and electronic noise [7, 8]. The Poisson part accounts for the uncertainty intrinsic to thephoton-counting process used in detectors. This makes noise strongly signal-dependent, which is especially truefor electronic microscopy or astronomy, so the additive Gaussian noise model itself cannot provide sufficientaccuracy for further data analysis and interpretation. Various approaches have been investigated to denoiseimages with Poisson–Gaussian noise [9–11].

In general, image denoising is an ill-posed problem. Therefore, we have to use some a priori knowledge∗Correspondence: [email protected]

This work is licensed under a Creative Commons Attribution 4.0 International License.2831

Page 2: An algorithm for image restoration with mixed noise using total … · Key words: Image denoising, Gaussian noise, Poisson noise, total variation regularization, mixed noise distribution,

PHAM et al./Turk J Elec Eng & Comp Sci

about the original image to be able to reconstruct it. The well-known ROF model [12] is a common approachto do so: it prescribes that the reconstructed image u∗ is computed from the observed image f = f(x) (withx = (x1, x2) ∈ Ω , Ω ⊆ R2 being an open bounded domain) by the following formula:

u∗ = arg minu∈BV (Ω)

∫Ω

|∇u|dx+λ

2

∫Ω

(u− f)2dx, (1)

where λ > 0 is a regularization parameter, BV is the space of functions of bounded variation, and∫Ω|∇u|

stands for the total variation of u (see [13]). The definition of the |∇ · | operator is given later, cf. Eq. (4).The second term is a data fidelity term, which ensures that the reconstructed image should be close

enough to the observed image. The first term is a smoothness term, which ensures that the reconstructed imageis not noisy. This is where the a priori knowledge lies: we assume that the original image was smooth enough,in the sense that its total variation is low. Finally, λ is a parameter allowing to scale the relative importanceof these two requirements. Using Euler–Lagrange equations, we can rewrite Eq. (1) into a form that may benumerically solved using gradient descent or other techniques.

In [14], Eq. (1) was adapted to Poisson noise instead of Gaussian noise. The proposed method is tocompute the following:

u∗ = arg minu∈BV (Ω)

∫Ω

|∇u|dx+ β

∫Ω

(u− f logu)dx, (2)

where β > 0 is a parameter giving the relative weight of the two constraints, similarly to λ . The model ofEq. (2) is called the modified ROF model (M-ROF). However, the numerical algorithm proposed in [14] tocompute a solution to this equation has drawbacks; most notably, the intermediate solutions obtained duringthe execution of the algorithm may contain pixels with negative values. This causes problems with the logfunction when evaluating Eq. (2), and the algorithm may end up with a suboptimal result. This concern wasaddressed in [15], in which the authors gave a new numerical algorithm that avoids this problem.

More recent work [16, 17] showed that Eqs. (1) and (2) can be combined to denoise an image corruptedby a mixture of Poisson and Gaussian noise. However, similar problems of negative values arise in the proposednumerical algorithms. In this paper, we use the ideas from [15] to design a new numerical scheme that overcomesthese problems in the mixed Poisson–Gaussian case. We show that our scheme only yields positive values for eachpixel in each intermediate image it computes, thus avoiding the aforementioned problems. We also determinebounds on the rate of convergence of our algorithm. Then we provide experimental results, comparing ourproposal to the ones from [12, 14, 15, 18], which are based on the ROF model, as well as BM3D [19] andPES-TV [20]. We use standard metrics for performance evaluation: the peak signal-to-noise ratio (PSNR),structural similarity index (SSIM) [21], and Pratt’s figure of merit (FOM) [22].

Other techniques have been investigated to denoise images in the Poisson–Gaussian case. The PURE-LETapproach [11] uses statistical analysis on the noise model (PURE stands for Poisson Unbiased Risk Estimator,which can be modified to work on a Poisson–Gaussian mixed distribution [23]) to estimate the noise. Thedenoising process is then parametrized linearly, using linear expansion of thresholds (LET), so that the optimalparameters are simply computed by solving a system of linear equations.

Another technique uses maximum a priori (MAP) formulation of the denoising problem and statisticalanalysis of the noise distribution to give a total variation formulation [9]. The initial reasoning behind this

2832

Page 3: An algorithm for image restoration with mixed noise using total … · Key words: Image denoising, Gaussian noise, Poisson noise, total variation regularization, mixed noise distribution,

PHAM et al./Turk J Elec Eng & Comp Sci

approach is similar to ours; however, both the formulation and the algorithm scheme of [9] are more complexthan ours. They get possibly better results, at the cost of trickier implementation.

In [24], the authors dealt with a slightly different case, where we have many acquisitions of the sameimage (in other terms, several realizations of the random variable “image + noise”). Their assumptions are thatthe original image is fixed, while the noises are independent between realizations. They use an expectation-maximization approach to solve the problem.

This paper is organized as follows: Section 2 presents some preliminaries about Poisson–Gaussian noise.In Section 3, which is the main part of our contribution, we discuss a new numerical scheme for Poisson–Gaussiandenoising. Section 4 consists of experiments and discussions of the obtained results. Finally, some limits andconclusions are described in Section 5.

2. PreliminariesIn what follows, f denotes the observed image. We assume that f is positive everywhere it is defined, andbounded. Moreover, we suppose that the total variation of f is also bounded. An efficient numerical approachto solve the minimization problem in the case of the M-ROF model (2) is given in [15], called the modifiedscheme for Poisson-modified total variation model (MS-ROF): start with u(0) = f , the observed image, andcompute successive values of u(n) with the following formula:

u(n+1) − u(n)

τ= div

(∇u(n)∣∣∇u(u)

∣∣)

− β

(1− f

u(n+1)

), (3)

where τ ∈ (0; 1] is the time-step parameter of the gradient descent, while β > 0 is a parameter weighting therelative importance of data fidelity and smoothness requirements. Keep computing u(n) for successive values ofn , until the point where the difference u(n+1)−u(n) becomes negligible. The final u(n) is then the reconstructedimage, u∗ .

The images that we are handling are discrete, i.e. matrices of pixel values rather than functions from R2

to R . Therefore, we have to choose a discretization scheme for numerical computations. If u is a image, wewrite uj,k for the pixel at coordinates (j, k) in u (j = 1, ..,M ; k = 1, .., N ). We define the following quantities:

u(1)j,k = uj+1,k − uj−1,k u

(2)j,k = uj,k+1 − uj,k−1

∇uj,k = (u(1)j,k, u

(2)j,k) |∇uj,k| =

√(u

(1)j,k)

2 + (u(2)j,k)

2 + ε2, (4)

where ε is a small positive quantity, added for considerations of numerical stability.

The operator divergence div(

∇u|∇u|

)is defined by:

div

(∇u

|∇u|

)=

u(11)j,k (u

(2)j,k)

2 − 2u(1)j,ku

(2)j,ku

(12)j,k + u

(22)j,k (u

(1)j,k)

2((u

(1)j,k)

2 + (u(1)j,k)

2 + ε2)3/2 ,

where

u(11)j,k = uj+1,k − 2uj,k + uj−1,k u

(22)j,k = uj,k+1 − 2uj,k + uj,k−1

2833

Page 4: An algorithm for image restoration with mixed noise using total … · Key words: Image denoising, Gaussian noise, Poisson noise, total variation regularization, mixed noise distribution,

PHAM et al./Turk J Elec Eng & Comp Sci

u(12)j,k = uj+1,k+1 + uj−1,k−1 − uj+1,k−1 − uj−1,k+1.

As suggested in [16, 17], we can combine the models of Eqs. (1) and (2) into a single one, aiming atremoving a mixture of Gaussian and Poisson noise:

u∗ = arg minu

∫|∇u|dx+

λ

2

∫(u− f)2dx+ β

∫(u− f logu)dx, (5)

where f is the observed image, while λ > 0 and β > 0 are parameters that give the relative weight of Gaussianand Poisson noise (those parameters will have to be determined experimentally). One drawback of this modelis that the variances of Poisson and Gaussian noise are assumed to be the same.

If we try to use a similar reasoning to [15] in order to derive a numerical approach solving Eq. (5), thenwe run into problems. Indeed, it is impossible to guarantee that u will always remain positive; we need thepositivity since we have to compute logu to evaluate Eq. (5). We propose another numerical scheme to solveEq. (5), which avoids these problems.

3. Modified numerical schemeWe want to solve Eq. (5) by gradient descent. We have:

δu(t)

δt= div

(∇u

|∇u|

)− β(1− f

u)− λ(u− f), (6)

where f is the observed image, and λ, β are regularization parameters.For numerical implementation of Eq. (6), the authors in [18] used the following modified scheme for the

mixed Poisson–Gaussian model (MPGS):

u(n+1) − u(n)

τ= div

(∇u(n)∣∣∇u(n)

∣∣)

− β(1− f

u(n))− λ

σ2(u(n) − f), (7)

where f is the observed image, σ > 0 is an estimation for variance noise by the method of Immerker [25], andλ, β are positive parameters such that λ+ β = 1 .

Based on the ideas in [15], we propose the following numerical scheme to implement the gradient descent:

u(n+1) − u(n)

τ= div

(∇u(n)∣∣∇u(n)

∣∣)

− β

(1− f

u(n+1)

)− λ

σ2

(u(n+1) − f

), (8)

where f is the observed image, τ ∈ (0, 1] is the time-step parameter, and λ, β are positive parameters suchthat λ+ β = 1 . σ is an estimation for variance noise computed as follows [25]:

σ =

√π

2

1

6(M − 2)(N − 2)

M∑j

N∑k

|uj,k ∗K| K =

1 −2 1−2 4 −21 −2 1

.

Parameters λ, β determine the relative importance of Gaussian and Poisson noise compensation in ourscheme. We will determine the values of those parameters in the experimentation phase. Let us group the

2834

Page 5: An algorithm for image restoration with mixed noise using total … · Key words: Image denoising, Gaussian noise, Poisson noise, total variation regularization, mixed noise distribution,

PHAM et al./Turk J Elec Eng & Comp Sci

similar terms to rewrite Eq. (8) as:

an

(u(n+1)

)2+ bnu

(n+1) + cn = 0, (9)

where

an = (1 + τλ

σ2) bn = −

(u(n) + τ div

(∇u(n)∣∣∇u(n)

∣∣)

− τβ + τλ

σ2f

)cn = −τβf.

The solution is given by:

u(n+1) =−bn +

√(−bn)2 − 4ancn2an

. (10)

Theorem 1 If f ∈ BV (Ω) we always receive a positive solution u(n+1) in Eq. (10).

ProofLet M = sup(f) and m = inf(f) . If f ∈ BV (Ω) , using the proof of Theorem 1 in [15], we

have log(f) ∈ L1(Ω) and E(u) bounded in BV (Ω) . Therefore, we have 0 ≤ m ≤ u ≤ f ≤ M andcn = −τβf < 0 (τ > 0, β > 0) . Since an = (1 + τ λ

σ2 ) > 0 with τ > 0 and λ > 0, σ > 0 , cn < 0 , wehave ancn < 0 and ∆n > 0 . Hence, we always receive a positive solution for Eq. (10). 2

The next theorem shows the theoretical rate of convergence for our numerical approach.

Theorem 2 If f ∈ BV (Ω) and fj,k−1 < 4τλ(1 + τλ) for each j, k , then

u(n) ≤ sn(f − r) + r,

where s = a−1n = (1 + τ λ

σ2 )−1 and r = t/(1− s) , with t = sτ(

√8− β) + τf(s λ

σ2 + 2β) .

Proof By definition of an and cn , the hypothesis on f implies that −4ancn > 1 ; moreover, −bn > 0 . Wecan use the bound

√x2 + y ≤ x+ y to rewrite Eq. (10) into the following:

u(n+1) ≤ −2bn − 4ancn2an

= − bnan

− 2cn.

Following [26], we have:∣∣∣∣div( ∇u(n)

|∇u(n)|

)∣∣∣∣ ≤ √8.

Plug in the definitions of an, bn, cn to get:

un+1 ≤ un

1 + τ λσ2

+τ(√8− β + λ

σ2 f)

1 + τ λσ2

+ 2τβf.

By definition of s and t , this rewrites into u(n+1) ≤ su(n)+t . A simple recurrence shows that the generalterm is indeed u(n+1) ≤ sn(u(0) − r) + r . Since u(0) = f , the theorem is proved. 2

2835

Page 6: An algorithm for image restoration with mixed noise using total … · Key words: Image denoising, Gaussian noise, Poisson noise, total variation regularization, mixed noise distribution,

PHAM et al./Turk J Elec Eng & Comp Sci

Algorithm 1 Modified numerical scheme for mixed Poisson–Gaussian denoising.1: Initialize: λ , β , u(0) = f , k = 0 ;2: While the stopping criterion is not satisfied do3: -k = k + 1 .4: -Compute u(k) by using Eqs. (9) and (10).5: End while6: Return u∗ = u(k) .

The proposed denoising algorithm is described as follows:We terminate the iteration if the following stopping condition is satisfied for some prescribed tolerance

ς :∥u(k) − u(k−1)∥2

∥u(k)∥2< ς, (11)

where ς is a small positive parameter.

4. Experiments4.1. Implementation issues

The original images are 8-bit gray-scale standard images shown1 in Figures 1a−1j. All experiments were run ona machine with Core i7-CPU 2.GHz, SDRAM 4GB-DDR III 2.00 GHz, Windows 10 (64-bit), and implementedin MATLAB. We present the denoising results of the test images degraded by Poisson noise with a peak intensityImax and Gaussian noise with a standard deviation σG .

To compare the efficiency of the algorithms, we use the PSNR, SSIM [21], and Pratt’s FOM [22]. Thefirst metric, PSNR (db), is defined by:

PSNR = 10 log10

(MNI2max

∥u∗ − u∥22

),

where u, u∗ are the original image and the reconstructed or noisy image accordingly, Imax is the maximumintensity of the original image, and M and N are the number of image pixels in rows and columns.

The second metric, SSIM, is defined by:

SSIM(u, u∗) =(2µuµu∗ + c1)(2σu,u∗ + c2)

(µ2u + µ2

u∗ + c1)(σ2u + σ2

u∗ + c2),

where µu, µu∗ are the means of images; σu, σu∗ are the standard deviations (the square root of variance) ofimages; σu,u∗ is the covariance of the two images u and u∗ ; c1 = (K1L)

2 , c2 = (K2L)2 ; L is the dynamic

range of the pixel values (255 for 8-bit gray-scale images); and K1 ≪ 1 , K2 ≪ 1 are small constants.The last metric, FOM, is given by:

FOM =1

max(Ea, Ed)

Ed∑i=1

1

1 + γd2i,

1Coming from http://www.imageprocessingplace.com and http://www.cs.tut.fi/~foi/GCF-BM3D/BM3D_images.zip, both ac-cessed 20/02/2018.

2836

Page 7: An algorithm for image restoration with mixed noise using total … · Key words: Image denoising, Gaussian noise, Poisson noise, total variation regularization, mixed noise distribution,

PHAM et al./Turk J Elec Eng & Comp Sci

(d) Man(a) Cameraman (b) Lena (c) House

(e) Peppers (f) Fluocells (g) Boat (h) Hill

(i) Lake (j) Jetplane

Figure 1. Standard test images.

where Ea and Ed are the numbers of actual (ground truth) and detected edge points, respectively; di is theith detected edge pixel’s deviation or error distance; and γ stands for a positive scaling parameter. The scalingfactor γ is a constant typically set to 1/9 (see [22]). In experiments, the edge detector for ground truth andthe denoised image is chosen to be the Sobel edge detector as a built-in function in MATLAB.

In order to show the potentiality of our method, we compare the mixed Poisson–Gaussian denoisingresults of the algorithm corresponding to our scheme with other related methods, like the ROF model [12] usingthe model of Eq. (1), the modified ROF (M-ROF) [14] using the model of Eq. (2), the modified scheme for thePoisson-modified total variation model (MS-ROF) [15] using the scheme of Eq. (3) for the model of Eq. (2),and the modified scheme for the mixed Poisson–Gaussian model (MPGS) [18] using the scheme of Eq. (7) forthe model of Eq. (5). For these methods, we employ the Euler–Lagrange equation to solve the minimizationproblem (see [13] for more details). Furthermore, we also compare our method with some methods in imagedenoising, such as PES-TV [20] and BM3D [19].

For the ROF model, we set λ = 0.8 , and for M-ROF, we set β = 0.25 (see [14]). For MS-ROF, we setβ = 0.1 (see [15]). For MPGS, we set β = 0.2 , and λ = 0.8 (see [18]). For our method, the regularizationparameters λ and β are determined empirically: we set β = 0.6 and λ = 0.4 , which gave the best results. Thetolerance parameter ς in the stopping condition of Eq. (11) is set to ς = 5× 10−4 in the experiments.

2837

Page 8: An algorithm for image restoration with mixed noise using total … · Key words: Image denoising, Gaussian noise, Poisson noise, total variation regularization, mixed noise distribution,

PHAM et al./Turk J Elec Eng & Comp Sci

4.2. Numerical results and discussion

4.2.1. First experiment We compare the mixed Poisson–Gaussian denoising results of our algorithm withother related methods, like ROF, M-ROF, MS-ROF, and MPGS. Noisy observations are generated by Poissonnoise with some fixed peak Imax , and by Gaussian noise with standard deviation σG = Imax/10 to the testimages.

Figures 2a−2f show the results of the compared methods for the “Lake” image corrupted by noiseparameters Imax = 120 and σG = 12 . Table 1 shows the PSNR, SSIM, FOM, number of iterations, andcomputational time for each of the compared methods.

(a) (b) (c)

(d) (e) (f)

Figure 2. Lake (256× 256): (a) noisy image corrupted by Imax = 120 , σG = 12, PSNRnoisy = 18.6462 ; (b) ROF; (c)M-ROF; (d) MS-ROF; (e) MPGS; (f) our algorithm.

Similarly, Figures 3a−3f show the results of compared methods for the “Peppers” image corrupted bynoise parameters Imax = 60 and σG = 6 . Table 2 shows the numerical results.

Finally, Table 3 shows the average FOM, PSNR, and SSIM over all 10 test images for each methodfor Imax = 120, 60, 30 and σG = Imax/10 . Our experimental results show that the proposed algorithm hasapproximately the same computational time as the other methods. Our proposed method outperforms theother relative methods for mixed Poisson–Gaussian noise removal.

2838

Page 9: An algorithm for image restoration with mixed noise using total … · Key words: Image denoising, Gaussian noise, Poisson noise, total variation regularization, mixed noise distribution,

PHAM et al./Turk J Elec Eng & Comp Sci

Table 1. Comparison of measurements for Figure 2.

- b c d e fPSNR 21.8958 22.3070 22.0505 22.3733 22.7176SSIM 0.6485 0.6722 0.6566 0.6755 0.6909FOM 0.8616 0.8755 0.8703 0.8800 0.8883Number of iterations 215 200 212 201 192CPU time (s) 8.05 6.86 7.55 7.61 7.19Time in one iteration (s) 0.037 0.034 0.036 0.038 0.038

(a) (b) (c)

(d) (e) (f)

Figure 3. Peppers (256× 256): (a) noisy image corrupted by Imax = 60 , σG = 6, PSNRnoisy = 17.5778 ; (b) ROF; (c)M-ROF; (d) MS-ROF; (e) MPGS; (f) our algorithm.

4.2.1. Second experiment

We compare the mixed Poisson–Gaussian denoising results of our algorithm with other related methods (thesame as in the previous experiment), keeping either Imax or σG constant and varying the other parameter.

Figures 4a−4f show the results of the compared methods for the “Boat” image corrupted by Poissonnoise with peak Imax = 120 and Gaussian white noise with standard deviation σG = 10 . Figures 5a−5f showthe results of the compared methods for the “Cameraman” image corrupted by noise with parameters Imax = 60

and σG = 10 .

2839

Page 10: An algorithm for image restoration with mixed noise using total … · Key words: Image denoising, Gaussian noise, Poisson noise, total variation regularization, mixed noise distribution,

PHAM et al./Turk J Elec Eng & Comp Sci

Table 2. Comparison of measurements for Figure 3.

- b c d e fPSNR 23.7174 24.5055 24.1221 24.8585 25.2848SSIm 0.6870 0.7197 0.7026 0.7345 0.7505FOM 0.7889 0.8371 0.8110 0.8411 0.8683Number of iterations 184 160 171 148 139CPU time (s) 6.78 5.76 5.98 5.34 5.15Time in one iteration (s) 0.037 0.036 0.035 0.036 0.037

Table 3. Mean results of the methods with σG = Imax/10 .

Noise level Method FOM PSNR SSIM

Imax = 120, σG = 12

ROF 0.8381 24.5248 0.6775M-ROF 0.8609 24.8036 0.6970MS-ROF 0.8442 24.5869 0.6818MPGS 0.8576 24.7542 0.6904Our proposed 0.8722 24.9503 0.7012

Imax = 60, σG = 6

ROF 0.6851 22.8774 0.5908M-ROF 0.7524 23.5051 0.6277MS-ROF 0.7062 23.1186 0.6039MPGS 0.7734 23.7948 0.6433Our proposed 0.8048 24.1607 0.6664

Imax = 30, σG = 3

ROF 0.4041 20.4332 0.4858M-ROF 0.5505 21.6461 0.5490MS-ROF 0.4617 20.9798 0.5147MPGS 0.6703 22.6461 0.6008Our proposed 0.7151 23.1175 0.6242

We compare the mixed Poisson–Gaussian denoising results in two cases: first, Poisson noise with peakImax = 120, 60, 30 and Gaussian white noise with constant standard deviation σG = 10 , and then Poisson noisewith constant peak Imax = 120 and Gaussian white noise with standard deviation σG = 5, 10, 15 . The averageresults over all images for each method appear in Table 4. Our proposed method gets better results than otherrelative methods in the vast majority of cases.

4.2.2. Third experiment

We compare the mixed Poisson–Gaussian denoising results of our algorithm with some well-known methods,such as PES-TV [20] and BM3D [19]. Figures 6a−6l show the results of the compared methods for the “House”images corrupted by Poisson noise with peak Imax = 120 and Gaussian white noise with standard deviationσG = 10, 15, 20 .

We compare mixed Poisson–Gaussian denoising results of our proposed method with PES-TV and BM3Dfor Poisson noise with peak Imax = 60, 120 and Gaussian noise with standard deviation σG = 10, 15, 20 . Table 5shows the mean results over all images for the tested methods.

2840

Page 11: An algorithm for image restoration with mixed noise using total … · Key words: Image denoising, Gaussian noise, Poisson noise, total variation regularization, mixed noise distribution,

PHAM et al./Turk J Elec Eng & Comp Sci

(a) (b) (c)

(d) (e) (f)

Figure 4. Boat image (256 × 256): (a) noisy image corrupted by Imax = 120 , σG = 10, PSNRnoisy = 19.5344 ; (b)ROF; (c) M-ROF; (d) MS-ROF; (e) MPGS; (f) our algorithm.

(a) (b) (c)

(d) (e) (f)

Figure 5. Cameraman (256 × 256): (a) noisy image corrupted by Imax = 60 , σG = 10, PSNRnoisy = 14.8874 ; (b)ROF; (c) M-ROF; (d) MS-ROF; (e) MPGS; (f) our algorithm.

2841

Page 12: An algorithm for image restoration with mixed noise using total … · Key words: Image denoising, Gaussian noise, Poisson noise, total variation regularization, mixed noise distribution,

PHAM et al./Turk J Elec Eng & Comp Sci

(a) (b) (c)

(d) (e) (f)

(g) (h) (i)

(j) (k) (l)

Figure 6. House (256×256). Recovered images of different approaches for removing mixed Poisson–Gaussian noise. Firstrow from left to right: noisy images with PSNRNoisy = 19.4321 (a), PSNRNoisy = 17.0552 (b), PSNRNoisy = 15.0527(c); second row: restored images by PES-TV (d–f); third row: restored images by BM3D (g–i); fourth row: restoredimages by our proposed method (j–l).

2842

Page 13: An algorithm for image restoration with mixed noise using total … · Key words: Image denoising, Gaussian noise, Poisson noise, total variation regularization, mixed noise distribution,

PHAM et al./Turk J Elec Eng & Comp Sci

Table 4. Mean results of the methods with various values of Imax and σG .

Noise level Method FOM PSNR SSIM

Imax = 60, σG = 10

ROF 0.6649 22.3266 0.5698M-ROF 0.7381 22.9267 0.6071MS-ROF 0.6803 22.4975 0.5797MPGS 0.7278 22.8553 0.6020Our proposed 0.7806 23.2842 0.6285

Imax = 30, σG = 10

ROF 0.3873 19.6661 0.4591M-ROF 0.5480 20.3906 0.5027MS-ROF 0.4299 19.9012 0.4751MPGS 0.5253 20.2414 0.4975Our proposed 0.6455 20.8141 0.5210

Imax = 120, σG = 5

ROF 0.8640 25.4744 0.71556M-ROF 0.8870 25.8046 0.7345MS-ROF 0.8709 25.5646 0.7209MPGS 0.8905 25.9822 0.7437Our proposed 0.8972 26.1420 0.7537

Imax = 120, σG = 10

ROF 0.8463 24.7989 0.6894M-ROF 0.8647 25.0982 0.7078MS-ROF 0.8572 24.8873 0.6952MPGS 0.8659 25.0903 0.7056Our proposed 0.8790 25.2982 0.7190

Imax = 120, σG = 15

ROF 0.8262 24.0763 0.6582M-ROF 0.8543 24.3675 0.6771MS-ROF 0.8312 24.1240 0.6607MPGS 0.8446 24.2499 0.6672Our proposed 0.8546 24.4083 0.6786

PES-TV and the BM3D are well-known techniques for image denoising. They can allow good results forremoving mixed Poisson–Gaussian noise. However, our method gets similar results in some cases. Particularly,in the case of a high level of mixed Poisson–Gaussian noise, our method outperforms PES-TV and the BM3Din terms of PSNR and SSIM. Please see the Appendix for more detailed results.

5. ConclusionWe proposed a new computational scheme based on total variation regularization for mixed Poisson–Gaussiannoise. Our proposed scheme allows us to avoid sign-changing of the solution during the optimization processand guarantees the reconstructed image to be positive in the image domain. Therefore, the proposed algorithmcan lead to mixed Poisson–Gaussian noise removal with good results. The comparison of the results achieved bythe proposed algorithm with the other methods has shown that the proposed algorithm perceptibly improvesthe quality of the denoised images with mixed Poisson–Gaussian noise. Moreover, it has been shown that theproposed scheme has approximately the same computational time as the other methods.

2843

Page 14: An algorithm for image restoration with mixed noise using total … · Key words: Image denoising, Gaussian noise, Poisson noise, total variation regularization, mixed noise distribution,

PHAM et al./Turk J Elec Eng & Comp Sci

Table 5. The mean results of the methods for all test images.

Image Method FOM PSNR SSIM

Imax = 120, σG = 10

PES-TV 0.8980 25.6058 0.7323BM3D 0.9199 26.7727 0.7719Our proposed 0.8790 25.2982 0.7190

Imax = 120, σG = 15

PES-TV 0.8784 24.5073 0.6754BM3D 0.9126 23.6589 0.5875Our proposed 0.8546 24.4083 0.6786

Imax = 120, σG = 20

PES-TV 0.8552 23.4161 0.6134BM3D 0.8684 19.3248 0.3871Our proposed 0.8379 23.5480 0.6358

Imax = 60, σG = 10

PES-TV 0.8471 23.0235 0.5872BM3D 0.8124 24.0691 0.6652Our proposed 0.7806 23.2842 0.6285

Imax = 60, σG = 15

PES-TV 0.8028 21.1647 0.4823BM3D 0.7980 21.2283 0.4552Our proposed 0.7486 22.2087 0.5787

Imax = 60, σG = 20

PES-TV 0.7531 19.4028 0.3926BM3D 0.70145 16.4663 0.2747Our proposed 0.7256 21.1732 0.5273

Our algorithm has the advantage of being rather easy to implement and offers a good compromise betweenperformance and quality of results. Like similar algorithms, no previous training is required (in contrast to deeplearning techniques), and only one observation of the image is needed (in contrast to the EM approaches [24]).The user can tweak parameters λ and β if she precisely knows the noise distribution. One disadvantageintrinsic to our approach is that the Poisson and Gaussian noise are assumed to have the same variance. Othermodels could be designed to overcome this obstacle, probably at the cost of ease of implementation. Moreover,parameter-tweaking might be required in some specific cases.

Acknowledgments

The authors would like to thank the anonymous referees for their helpful remarks and suggestions. The authorswere supported by Russian Academic Excellence Project ‘5-100’ at the National Research University HigherSchool of Economics (HSE), Moscow, Russia.

References

[1] Bertero M, Boccacci P, Desider G, Vicidomini G. Image deblurring with Poisson data: from cells to galaxies. InverseProbl 2009; 25: 123006.

[2] Pham CT, Kopylov AV. Multi-quadratic dynamic programming procedure of edge-preserving denoising for medicalimages. Int Arch Photogramm 2015; 40: 101-106.

2844

Page 15: An algorithm for image restoration with mixed noise using total … · Key words: Image denoising, Gaussian noise, Poisson noise, total variation regularization, mixed noise distribution,

PHAM et al./Turk J Elec Eng & Comp Sci

[3] Pham CT, Kopylov AV. Parametric procedures for image denoising with flexible prior model. In: Symposium onInformation and Communication Technology; 8–9 December 2016; Ho Chi Minh City, Vietnam. New York, NY,USA: ACM. pp. 294-301.

[4] Chan RH, Lanza A, Morigi S, Sgallari F. An adaptive strategy for the restoration of textured images using fractionalorder regularization. Numer Math-Theory Me 2013; 6: 276-296.

[5] Wen YW, Chan RH. Parameter selection for total variation based image restoration using discrepancy principle.IEEE T Image Process 2012; 21: 1770-1781.

[6] Snyder DL, Hammoud AM, White RL. Image recovery from data acquired with a charge-coupled device camera. JOpt Soc Am A 1993; 10: 1014-1023.

[7] Pham CT, Kopylov AV, Dvoenko SD. Edge-preserving denoising based on dynamic programming on the full set ofadjacency graphs. Int Arch Photogramm 2017; 42: 55-60.

[8] Pham CT. Image processing procedures based on multi-quadratic dynamic programming. Informatica 2017; 41:255-256.

[9] Lanza A, Morigi S, Sgallari F, Wen YW. Image restoration with Poisson–Gaussian mixed noise. Comput MethodBiomec 2014; 2: 12-24.

[10] Jezierska A, Chaux C, Pesquet JC, Talbot H, Engler G. An EM approach for time-variant Poisson-Gaussian modelparameter estimation. IEEE T Signal Proces 2014; 62: 17-30.

[11] Luisier F, Vonesch C, Blu T, Unser M. Fast interscale wavelet denoising of Poisson-corrupted images. Signal Proces2010; 90: 415-427.

[12] Rudin L, Osher S, Fatemi E. Nonlinear total variation-based noise removal algorithms. Physica D 1992; 60: 259-268.[13] Chan TF, Shen J. Image Processing and Analysis: Variational, PDE, Wavelet, and Stochastic Methods. Philadel-

phia, PA, USA: Society for Industrial and Applied Mathematics, 2005.[14] Le T, Chartrand R, Asaki TJ. A variational approach to reconstructing images corrupted by Poisson noise. J Math

Imaging Vis 2007; 27: 257-263.[15] Wang W, He C. A fast and effective algorithm for a Poisson denoising model with total variation. IEEE Signal Proc

Let 2017; 24: 269-273.[16] De Los Reyes JC, Schnlieb CB. Image denoising: learning the noise model via nonsmooth PDE-constrained

optimization. Inverse Probl Imag 2013; 7: 1183-1214.[17] Calatroni L, De Los Reyes JC, Schnlieb CB. Infimal convolution of data discrepancies for mixed noise removal.

SIAM J Imaging Sci 2017; 10: 1196-1233.[18] Dang T, Dvoenko S. Image noise removal based on total variation. Computer Optics 2015; 39: 564-571.[19] Dabov K, Foi A, Katkovnik V, Egiazarian K. Image denoising by sparse 3D transform-domain collaborative filtering.

IEEE T Image Process 2007; 16: 2080-2095.[20] Tofighi M, Kose K, Cetin AE. Denoising images corrupted by impulsive noise using projections onto the epigraph

set of the total variation function (PES-TV). Signal Image Video P 2015; 9: 41-48.[21] Bovik AC, Wang Z. Modern Image Quality Assessment, Synthesis Lectures on Image, Video, and Multimedia

Processing. Williston, VT, USA: Morgan and Claypool Publishers, 2006.[22] Pratt WK. Digital Image Processing. New York, NY, USA: John Wiley and Sons, 2007.[23] Luisier F, Blu T, Unser M. Image denoising in mixed Poisson-Gaussian noise. IEEE T Image Process 2011; 20:

696-708.[24] Jezierska A, Chaux C, Pesquet JC, Talbot H. An EM approach for Poisson-Gaussian noise modeling. In: European

Signal Processing Conference; 29 August–2 September 2011; Barcelona, Spain. New York, NY, USA: IEEE. pp.2244-2248.

[25] Immerker J. Fast noise variance estimation. Comput Vis Image Und 1996; 64: 300-302.[26] Chambolle A. An algorithm for total variation minimization and applications. J Math Imaging Vis 2004; 20: 89-97.

2845

Page 16: An algorithm for image restoration with mixed noise using total … · Key words: Image denoising, Gaussian noise, Poisson noise, total variation regularization, mixed noise distribution,

PHAM et al./Turk J Elec Eng & Comp Sci

Appendix: Detailed values of experimental results.

Appendix A: Detailed values used to compute Table 3 with σG = Imax/10 .

- Noisy Imax = 120, σG = 12 Imax = 60, σG = 6 Imax = 30, σG = 3Image Method FOM PSNR SSIM FOM PSNR SSIM FOM PSNR SSIM

Cameraman

ROF 0.9199 24.5394 0.7398 0.8602 22.6454 0.6835 0.5082 19.3186 0.5553M-ROF 0.9299 24.7267 0.7439 0.8838 23.2938 0.7027 0.7220 20.8705 0.6200MS-ROF 0.9241 24.6588 0.7427 0.8830 23.0255 0.6944 0.6076 20.0389 0.5861MPGS 0.9304 24.7990 0.7434 0.9000 23.7201 0.7143 0.8472 22.0480 0.6602Our proposed 0.9358 25.0635 0.7492 0.9102 24.0544 0.7233 0.8593 22.6848 0.6760

Lena

ROF 0.8292 24.5952 0.7651 0.6904 24.2059 0.7102 0.4159 21.6453 0.5714M-ROF 0.8479 24.6702 0.7724 0.7384 24.5371 0.7381 0.5564 23.4209 0.6594MS-ROF 0.8373 24.6570 0.7703 0.7180 24.3475 0.7228 0.4667 22.4347 0.6135MPGS 0.8474 24.6805 0.7699 0.7703 24.7872 0.7512 0.6670 24.6616 0.7146Our proposed 0.8740 24.6350 0.7743 0.8104 24.7978 0.7659 0.6946 24.8540 0.7344

House

ROF 0.9079 28.1878 0.7606 0.8647 27.0100 0.7518 0.6031 22.5354 0.6479M-ROF 0.9070 28.0619 0.7592 0.8719 27.2481 0.7565 0.7345 23.9786 0.6927MS-ROF 0.9035 28.1251 0.7590 0.8602 27.1090 0.7537 0.6309 23.0987 0.6668MPGS 0.9054 28.1083 0.7546 0.8816 27.4742 0.7615 0.7958 25.3430 0.7225Our proposed 0.9211 28.3184 0.7526 0.8811 27.5518 0.7618 0.8140 25.7914 0.7326

Man

ROF 0.7959 22.9418 0.5670 0.6205 21.2064 0.4450 0.3285 19.4515 0.3493M-ROF 0.8155 23.4122 0.6038 0.6614 21.7839 0.4877 0.4619 20.4387 0.4140MS-ROF 0.8059 23.0937 0.5783 0.6235 21.4691 0.4648 0.3973 19.8857 0.3775MPGS 0.8159 23.3933 0.6007 0.7045 22.1872 0.5184 0.5978 21.3335 0.4789Our proposed 0.8314 23.6556 0.6242 0.7532 22.5874 0.5479 0.6335 21.7100 0.5036

Peppers

ROF 0.8923 25.6905 0.7569 0.7889 23.7174 0.6870 0.4068 19.8225 0.5338M-ROF 0.9026 25.7680 0.7597 0.8371 24.5055 0.7197 0.5948 21.6891 0.6207MS-ROF 0.8990 25.6978 0.7576 0.8110 24.1221 0.7026 0.4826 20.7150 0.5765MPGS 0.9004 25.8028 0.7601 0.8411 24.8585 0.7345 0.7590 23.0036 0.6811Our proposed 0.9054 25.8933 0.7581 0.8683 25.2848 0.7505 0.7916 23.7320 0.7058

Fluocells

ROF 0.7002 23.2486 0.4746 0.3390 21.2405 0.3405 0.1783 20.2377 0.2853M-ROF 0.8070 24.5677 0.5690 0.6133 22.6443 0.4333 0.4214 21.3699 0.3636MS-ROF 0.7136 23.3976 0.4819 0.3981 21.4892 0.3566 0.2759 20.8134 0.3231MPGS 0.7469 23.7110 0.5033 0.6097 22.5170 0.4290 0.5684 22.1918 0.4301Our proposed 0.7928 24.3279 0.5533 0.7112 23.4913 0.4978 0.6721 22.8834 0.4726

Boat

ROF 0.8071 24.7599 0.6661 0.6320 22.9356 0.5640 0.3963 21.0518 0.4785M-ROF 0.8276 24.9905 0.6808 0.6787 23.4091 0.5930 0.4945 21.9118 0.5249MS-ROF 0.8160 24.8233 0.6692 0.6389 23.1064 0.5737 0.4431 21.4028 0.4979MPGS 0.8389 25.0576 0.6811 0.7229 23.7418 0.6148 0.5836 22.5671 0.5664Our proposed 0.8448 25.1854 0.6898 0.7428 24.1193 0.6350 0.6348 22.9839 0.5894

Hill

ROF 0.7767 25.2484 0.6626 0.5509 23.9751 0.5411 0.2976 22.7024 0.4618M-ROF 0.7984 25.3293 0.6775 0.6417 24.5392 0.5868 0.3852 23.5155 0.5201MS-ROF 0.7778 25.2396 0.6685 0.5880 24.1822 0.5562 0.3323 23.0923 0.4872MPGS 0.8038 25.3576 0.6854 0.6718 24.8643 0.6148 0.5185 24.2881 0.5796Our proposed 0.8213 25.4305 0.6954 0.7016 25.1280 0.6432 0.5765 24.6108 0.6042

Lake

ROF 0.8616 21.8958 0.6485 0.7025 19.5149 0.5009 0.4213 17.6097 0.3968M-ROF 0.8755 22.3070 0.6722 0.7729 20.3944 0.5604 0.5583 18.6460 0.4645MS-ROF 0.8703 22.0505 0.6566 0.7286 19.8114 0.5231 0.4823 18.0912 0.4282MPGS 0.8800 22.3733 0.6755 0.7912 20.7478 0.5829 0.6874 19.6737 0.5312Our proposed 0.8883 22.7176 0.6909 0.8228 21.3336 0.6204 0.7383 20.1370 0.5633

Jetplane

ROF 0.8906 24.1407 0.7334 0.8019 22.3228 0.6839 0.4850 19.9568 0.5778M-ROF 0.8976 24.2024 0.7314 0.8250 22.6957 0.6986 0.5764 20.6203 0.6102MS-ROF 0.8944 24.1251 0.7341 0.8122 22.5235 0.6914 0.4984 20.2256 0.5905MPGS 0.9067 24.2584 0.7295 0.8413 23.0501 0.7116 0.6787 21.3501 0.6438Our proposed 0.9074 24.2759 0.7238 0.8460 23.2588 0.7182 0.7364 21.7880 0.6602

1

Page 17: An algorithm for image restoration with mixed noise using total … · Key words: Image denoising, Gaussian noise, Poisson noise, total variation regularization, mixed noise distribution,

PHAM et al./Turk J Elec Eng & Comp Sci

Appendix B: Detailed values used to compute Table 4 with σG = 10 .

- Noisy Imax = 120, σG = 10 Imax = 60, σG = 10 Imax = 30, σG = 10Image Method FOM PSNR SSIM FOM PSNR SSIM FOM PSNR SSIM

Cameraman

ROF 0.9262 24.9371 0.7515 0.8503 21.9358 0.6556 0.4810 18.4544 0.5119M-ROF 0.9330 25.1807 0.7555 0.8689 22.3365 0.6656 0.6913 19.1275 0.5336MS-ROF 0.9326 25.0388 0.7554 0.8615 22.1358 0.6604 0.5333 18.6731 0.5215MPGS 0.9351 25.3053 0.7604 0.8799 22.4461 0.6695 0.6382 18.9857 0.5320Our proposed 0.9417 25.5463 0.7656 0.8963 22.9267 0.6799 0.7730 19.7057 0.5381

Lena

ROF 0.8504 24.8484 0.7797 0.6583 23.8987 0.6911 0.3782 21.4624 0.5598M-ROF 0.8487 24.8529 0.7826 0.7074 24.2424 0.7157 0.5526 22.9047 0.6230MS-ROF 0.8616 24.8087 0.7816 0.6763 23.9845 0.7002 0.4300 22.0418 0.5855MPGS 0.8535 24.8609 0.7845 0.7224 24.2874 0.7174 0.5246 22.7122 0.6147Our proposed 0.8769 24.8692 0.7872 0.7812 24.3220 0.7306 0.6610 23.3852 0.6384

House

ROF 0.9062 28.5702 0.7689 0.8177 25.6213 0.7205 0.5765 21.3370 0.6132M-ROF 0.9176 28.6171 0.7705 0.8464 25.9557 0.7272 0.6808 22.1063 0.6346MS-ROF 0.9211 28.6899 0.7726 0.8368 25.7305 0.7246 0.5996 21.6045 0.6253MPGS 0.9177 28.6357 0.7713 0.8469 25.9589 0.7272 0.6765 22.0541 0.6375Our proposed 0.9218 28.6597 0.7693 0.8616 26.2128 0.7321 0.7510 22.5826 0.6338

Man

ROF 0.8069 23.1949 0.5796 0.6029 20.8386 0.4286 0.3221 18.9551 0.3375M-ROF 0.8170 23.4648 0.6008 0.6938 21.6291 0.4896 0.5074 19.6965 0.3947MS-ROF 0.8076 23.3186 0.5913 0.6169 21.0679 0.4449 0.3493 19.1933 0.3557MPGS 0.8362 23.6619 0.6153 0.6663 21.5127 0.4803 0.4663 19.4729 0.3844Our proposed 0.8387 23.9124 0.6364 0.7197 21.9879 0.5196 0.5765 20.0190 0.4248

Peppers

ROF 0.9033 26.0486 0.7718 0.7552 22.8440 0.6599 0.4236 18.9466 0.5094M-ROF 0.9032 26.2242 0.7747 0.7838 23.6038 0.6893 0.6195 20.2335 0.5773MS-ROF 0.9116 26.0679 0.7720 0.7733 23.2133 0.6743 0.4712 19.3978 0.5366MPGS 0.9140 26.2380 0.7745 0.8043 23.6253 0.6951 0.5966 19.9447 0.5688Our proposed 0.9176 26.3372 0.7776 0.8369 24.0426 0.7073 0.7182 20.7933 0.5929

Fluocells

ROF 0.6941 23.2383 0.4766 0.3515 21.0717 0.3254 0.1638 19.0235 0.2477M-ROF 0.8086 24.6907 0.5750 0.6280 22.2072 0.4116 0.4041 18.8568 0.2873MS-ROF 0.7201 23.4271 0.4878 0.3807 21.1290 0.3325 0.2469 18.7747 0.2578MPGS 0.7628 23.8531 0.5155 0.4979 21.4300 0.3605 0.3791 18.6151 0.2769Our proposed 0.8064 24.6279 0.5739 0.6827 22.3934 0.4318 0.5477 19.0185 0.3150

Boat

ROF 0.8286 25.1196 0.6826 0.5969 22.4824 0.5454 0.3789 20.2214 0.4541M-ROF 0.8295 25.2911 0.6930 0.6453 22.8603 0.5683 0.4781 20.6862 0.4816MS-ROF 0.8371 25.2253 0.6892 0.6075 22.5963 0.5528 0.3898 20.4328 0.4658MPGS 0.8436 25.4171 0.6984 0.6710 22.9695 0.5776 0.4687 20.6788 0.4862Our proposed 0.8548 25.6009 0.7090 0.7052 23.3266 0.5977 0.5530 21.1057 0.5006

Hill

ROF 0.7902 25.4293 0.6775 0.5383 23.6703 0.5246 0.2971 22.0681 0.4430M-ROF 0.8047 25.5567 0.6941 0.6146 24.1710 0.5717 0.4085 22.5944 0.4891MS-ROF 0.8115 25.5130 0.6848 0.5492 23.7864 0.5362 0.3315 22.2310 0.4600MPGS 0.8179 25.6146 0.7005 0.6236 24.2043 0.5729 0.3896 22.5384 0.4843Our proposed 0.8274 25.6896 0.7131 0.6869 24.5259 0.6102 0.5404 22.9198 0.5150

Lake

ROF 0.8581 22.1170 0.6568 0.7032 19.2661 0.4911 0.3992 17.0843 0.3761M-ROF 0.8770 22.4513 0.6788 0.7873 20.2912 0.5626 0.6076 18.1061 0.4463MS-ROF 0.8680 22.2546 0.6654 0.7147 19.5284 0.5093 0.4632 17.3631 0.3970MPGS 0.8751 22.6848 0.6892 0.7678 20.0836 0.5493 0.5549 17.8142 0.4316Our proposed 0.8931 22.9972 0.7069 0.8121 20.7335 0.5945 0.6730 18.5209 0.4781

Jetplane

ROF 0.8993 24.4858 0.7486 0.7744 21.6373 0.6558 0.4528 19.1077 0.5387M-ROF 0.9075 24.6520 0.7525 0.8058 21.9702 0.6692 0.5298 19.5937 0.5590MS-ROF 0.9012 24.5294 0.7514 0.7863 21.8032 0.6621 0.4839 19.3001 0.5469MPGS 0.9026 24.6314 0.7465 0.7980 22.0356 0.6699 0.5589 19.5974 0.5588Our proposed 0.9115 24.7848 0.7511 0.8232 22.3705 0.6815 0.6610 20.0901 0.5733

2

Page 18: An algorithm for image restoration with mixed noise using total … · Key words: Image denoising, Gaussian noise, Poisson noise, total variation regularization, mixed noise distribution,

PHAM et al./Turk J Elec Eng & Comp Sci

Appendix C: Detailed values used to compute Table 4 with Imax = 120 .

- Noisy Imax = 120, σG = 5 Imax = 120, σG = 10 Imax = 120, σG = 15Image Method FOM PSNR SSIM FOM PSNR SSIM FOM PSNR SSIM

Cameraman

ROF 0.9382 25.8413 0.7764 0.9262 24.9371 0.7515 0.9139 23.9743 0.7186M-ROF 0.9488 26.1780 0.7850 0.9330 25.1807 0.7555 0.9283 24.2059 0.7179MS-ROF 0.9398 25.8743 0.7793 0.9326 25.0388 0.7554 0.9179 24.0708 0.7160MPGS 0.9490 26.3738 0.7914 0.9351 25.3053 0.7604 0.9211 24.2179 0.7210Our proposed 0.9563 26.5012 0.7972 0.9417 25.5463 0.7656 0.9265 24.3728 0.7206

Lena

ROF 0.8771 25.2265 0.8039 0.8504 24.8484 0.7797 0.8098 24.3207 0.7451M-ROF 0.8872 25.2172 0.8101 0.8487 24.8529 0.7826 0.8345 24.3822 0.7475MS-ROF 0.8834 25.2105 0.8079 0.8616 24.8087 0.7816 0.8197 24.3887 0.7481MPGS 0.8913 25.3006 0.8153 0.8535 24.8609 0.7845 0.8338 24.3597 0.7483Our proposed 0.9047 25.3110 0.8203 0.8769 24.8259 0.7872 0.8598 24.3187 0.7482

House

ROF 0.9266 29.8141 0.7956 0.9062 28.5702 0.7689 0.8891 27.3401 0.7378M-ROF 0.9365 29.9052 0.7992 0.9176 28.6171 0.7705 0.8875 27.3248 0.7306MS-ROF 0.9308 29.8762 0.7948 0.9211 28.6899 0.7726 0.8912 27.2343 0.7328MPGS 0.9292 29.8536 0.7933 0.9177 28.6357 0.7713 0.9005 27.3088 0.7307Our proposed 0.9374 29.9920 0.7978 0.9218 28.6597 0.7693 0.9032 27.4791 0.7511

Man

ROF 0.8188 23.6212 0.5994 0.8069 23.1949 0.5796 0.7793 22.6586 0.5536M-ROF 0.8360 23.9601 0.6223 0.8170 23.4648 0.6008 0.8192 23.1397 0.5978MS-ROF 0.8321 23.8300 0.6115 0.8076 23.3186 0.5913 0.7833 22.7252 0.5615MPGS 0.8522 24.2938 0.6461 0.8362 23.6619 0.6153 0.7978 22.9477 0.5784Our proposed 0.8565 24.5097 0.6589 0.8387 23.9124 0.6364 0.8108 23.1871 0.5990

Peppers

ROF 0.9241 26.9732 0.7971 0.9033 26.0486 0.7718 0.8828 25.0753 0.7359M-ROF 0.9295 27.1786 0.8020 0.9032 26.2242 0.7747 0.8889 25.1178 0.7344MS-ROF 0.9206 27.0301 0.7995 0.9116 26.0679 0.7720 0.8872 25.0925 0.7377MPGS 0.9319 27.2624 0.8075 0.9140 26.2380 0.7745 0.8933 25.2101 0.7388Our proposed 0.9343 27.3628 0.8094 0.9176 26.3372 0.7776 0.8901 25.2866 0.7450

Fluocells

ROF 0.7016 23.3252 0.4941 0.6941 23.2383 0.4766 0.6988 23.1452 0.4669M-ROF 0.8113 24.8993 0.5952 0.8086 24.6907 0.5750 0.8096 24.3018 0.5613MS-ROF 0.7187 23.5514 0.5101 0.7201 23.4271 0.4878 0.7176 23.2452 0.4718MPGS 0.8071 24.9233 0.5982 0.7628 23.8531 0.5155 0.7480 23.4877 0.4892Our proposed 0.8303 25.4436 0.6365 0.8064 24.6279 0.5739 0.7847 23.8319 0.5207

Boat

ROF 0.8523 25.8554 0.7132 0.8286 25.1196 0.6826 0.7934 24.3024 0.6453M-ROF 0.8670 26.0539 0.7213 0.8295 25.2911 0.6930 0.8215 24.5621 0.6572MS-ROF 0.8512 25.9423 0.7151 0.8371 25.2253 0.6892 0.7893 24.3458 0.6465MPGS 0.8707 26.3682 0.7394 0.8436 25.4171 0.6984 0.8105 24.4508 0.6544Our proposed 0.8751 26.4666 0.7449 0.8548 25.6009 0.7090 0.8221 24.6813 0.6625

Hill

ROF 0.8103 26.0033 0.7120 0.7902 25.4293 0.6775 0.7624 24.9316 0.6452M-ROF 0.8398 26.1117 0.7251 0.8047 25.5567 0.6941 0.7833 24.9671 0.6627MS-ROF 0.8291 26.0447 0.7158 0.8115 25.5130 0.6848 0.7624 24.9629 0.6504MPGS 0.8539 26.2505 0.7386 0.8179 25.6146 0.7005 0.7839 24.9777 0.6587Our proposed 0.8528 26.2983 0.7481 0.8274 25.6896 0.7131 0.7854 25.0078 0.6718

Lake

ROF 0.8700 22.6330 0.6784 0.8581 22.1170 0.6568 0.8516 21.5343 0.6303M-ROF 0.8897 22.9966 0.6981 0.8770 22.4513 0.6788 0.8787 22.0856 0.6573MS-ROF 0.8829 22.7596 0.6856 0.8680 22.2546 0.6654 0.8574 21.6330 0.6371MPGS 0.8964 23.4097 0.7170 0.8751 22.6848 0.6892 0.8663 21.9319 0.6533Our proposed 0.9026 23.6865 0.7314 0.8931 22.9972 0.7069 0.8718 22.2260 0.6709

Jetplane

ROF 0.9205 25.4507 0.7857 0.8993 24.4858 0.7486 0.8810 23.4802 0.7036M-ROF 0.9240 25.5458 0.7863 0.9075 24.6520 0.7525 0.8917 23.5881 0.7040MS-ROF 0.9208 25.5270 0.7891 0.9012 24.5294 0.7514 0.8858 23.5405 0.7050MPGS 0.9234 25.7865 0.7904 0.9026 24.6314 0.7465 0.8909 23.6068 0.6991Our proposed 0.9219 25.8479 0.7920 0.9115 24.7848 0.7511 0.8918 23.6918 0.6959

3

Page 19: An algorithm for image restoration with mixed noise using total … · Key words: Image denoising, Gaussian noise, Poisson noise, total variation regularization, mixed noise distribution,

PHAM et al./Turk J Elec Eng & Comp Sci

Appendix D: Detailed values used to compute Table 5 with Imax = 120 .

- Noisy Imax = 120, σG = 10 Imax = 120, σG = 15 Imax = 120, σG = 20Image Method FOM PSNR SSIM FOM PSNR SSIM FOM PSNR SSIM

Cameraman

PES-TV 0.9569 25.7722 0.7503 0.9467 24.2940 0.6746 0.9328 22.9801 0.6093BM3D 0.9703 27.9250 0.8156 0.9703 24.4029 0.5938 0.9544 19.5549 0.4045Our proposed 0.9417 25.5463 0.7656 0.9265 24.3728 0.7206 0.9140 23.4362 0.6668

Lena

PES-TV 0.8869 25.1409 0.7734 0.8648 24.5888 0.7149 0.8338 23.9982 0.6579BM3D 0.8926 26.6040 0.8065 0.8933 23.7575 0.5808 0.8369 19.2769 0.3429Our proposed 0.8769 24.8259 0.7872 0.8598 24.3187 0.7482 0.8281 24.0167 0.7173

House

PES-TV 0.9150 28.3952 0.7549 0.8911 26.9171 0.6967 0.8802 25.3805 0.6167BM3D 0.9590 30.7734 0.8003 0.9427 25.3716 0.5354 0.8895 19.4416 0.2922Our proposed 0.9218 28.6597 0.7693 0.9032 27.4791 0.7511 0.8877 25.8784 0.6732

Man

PES-TV 0.8640 24.3794 0.6736 0.8404 23.4299 0.6275 0.8239 22.5397 0.5793BM3D 0.9116 25.6800 0.7373 0.9026 23.0325 0.6222 0.8662 18.9755 0.4304Our proposed 0.8387 23.9124 0.6364 0.8108 23.1871 0.5990 0.7932 22.5658 0.5670

Peppers

PES-TV 0.9179 26.0672 0.7688 0.9077 24.8455 0.7120 0.8857 23.6511 0.6512BM3D 0.9394 26.9035 0.7910 0.9311 23.8032 0.5985 0.8893 19.3797 0.3789Our proposed 0.9176 26.3372 0.7776 0.8901 25.2866 0.7450 0.8828 24.2065 0.6836

Fluocells

PES-TV 0.8900 25.9616 0.6692 0.8533 24.4257 0.5937 0.8268 22.9856 0.5251BM3D 0.8576 26.6251 0.7024 0.8447 24.7663 0.6360 0.7858 21.5162 0.4936Our proposed 0.8064 24.6279 0.5739 0.7847 23.8319 0.5207 0.7596 23.0981 0.4969

Boat

PES-TV 0.8832 25.9313 0.7218 0.8530 24.8616 0.6689 0.8192 23.7515 0.6085BM3D 0.9191 27.0591 0.7752 0.9067 23.7041 0.5871 0.8408 19.0665 0.3708Our proposed 0.8548 25.6009 0.7090 0.8221 24.6813 0.6625 0.8020 23.7909 0.6175

Hill

PES-TV 0.8251 26.0862 0.7280 0.8158 25.3142 0.6809 0.7828 24.4138 0.6235BM3D 0.8618 24.8089 0.7374 0.8520 22.8941 0.5971 0.7850 19.2268 0.3720Our proposed 0.8274 25.6896 0.7131 0.7854 25.0078 0.6718 0.7747 24.2233 0.6284

Lake

PES-TV 0.9165 23.4713 0.7208 0.8966 22.5284 0.6764 0.8793 21.6254 0.6250BM3D 0.9366 24.9300 0.7701 0.9356 22.3404 0.6118 0.9160 18.6763 0.4511Our proposed 0.8931 22.9972 0.7069 0.8718 22.2260 0.6709 0.8625 21.4985 0.6332

Jetplane

PES-TV 0.9247 24.8529 0.7620 0.9143 23.8680 0.7079 0.8870 22.8354 0.6371BM3D 0.9507 26.4180 0.7828 0.9469 22.5165 0.5125 0.9203 18.1336 0.3348Our proposed 0.9115 24.7848 0.7511 0.8918 23.6918 0.6959 0.8742 22.7658 0.6745

4

Page 20: An algorithm for image restoration with mixed noise using total … · Key words: Image denoising, Gaussian noise, Poisson noise, total variation regularization, mixed noise distribution,

PHAM et al./Turk J Elec Eng & Comp Sci

Appendix E: Detailed values used to compute values in Table 5 with Imax = 60 .

- Noisy Imax = 60, σG = 10 Imax = 60, σG = 15 Imax = 60, σG = 20

Image Method FOM PSNR SSIM FOM PSNR SSIM FOM PSNR SSIM

Cameraman

PES-TV 0.9246 22.5352 0.5753 0.8985 20.3047 0.4452 0.8606 18.6156 0.3566BM3D 0.9424 24.5551 0.7231 0.9266 21.2471 0.4408 0.8380 15.5974 0.2690Our proposed 0.8963 22.9267 0.6799 0.8628 21.5319 0.6170 0.8426 20.2920 0.5510

Lena

PES-TV 0.8234 23.8328 0.6244 0.7713 22.5978 0.5328 0.7326 20.8252 0.4278BM3D 0.7758 24.7615 0.7332 0.7406 21.8187 0.4685 0.6255 16.1469 0.2256Our proposed 0.7812 24.3220 0.7306 0.7332 23.6129 0.6826 0.7269 22.8731 0.6264

House

PES-TV 0.8772 24.8385 0.5894 0.8421 22.5343 0.4785 0.7650 20.3648 0.3871BM3D 0.8680 28.2024 0.7701 0.8545 23.0547 0.4565 0.7650 20.3648 0.3871Our proposed 0.8616 26.2128 0.7321 0.8296 24.6272 0.6801 0.7955 23.1804 0.6265

Man

PES-TV 0.8039 22.2552 0.5640 0.7677 20.6081 0.4769 0.7246 19.0839 0.3977BM3D 0.7733 22.7812 0.5798 0.7816 20.7682 0.4735 0.6920 16.0282 0.2853Our proposed 0.7197 21.9879 0.5196 0.6921 21.2349 0.4837 0.6756 20.4444 0.4460

Peppers

PES-TV 0.8801 23.0700 0.6250 0.8352 21.0264 0.5117 0.7973 19.0686 0.4123BM3D 0.8488 24.3312 0.7139 0.8451 21.4479 0.4962 0.7494 16.1525 0.2595Our proposed 0.8369 24.0426 0.7073 0.8129 22.7161 0.6534 0.7945 21.4286 0.5961

Fluocells

PES-TV 0.8221 22.5875 0.5135 0.7703 20.1688 0.4043 0.7256 17.9799 0.3155BM3D 0.6874 23.1913 0.4971 0.6656 21.2476 0.4369 0.5634 18.5003 0.3246Our proposed 0.6827 22.3934 0.4318 0.6212 21.0439 0.3730 0.6159 19.6536 0.3277

Boat

PES-TV 0.8122 23.2143 0.5801 0.7448 21.3611 0.4776 0.6873 19.8225 0.4001BM3D 0.7977 24.3491 0.6564 0.7820 21.3500 0.4457 0.6396 15.5960 0.2343Our proposed 0.7052 23.3266 0.5977 0.6887 22.4224 0.5546 0.6536 21.4955 0.5060

Hill

PES-TV 0.7559 24.1885 0.6070 0.7182 22.5647 0.5120 0.6505 20.8095 0.4252BM3D 0.7298 23.4028 0.6277 0.6914 21.4617 0.4701 0.6084 16.6456 0.2369Our proposed 0.6869 24.5259 0.6102 0.6675 23.7144 0.5655 0.6401 22.9105 0.5203

Lake

PES-TV 0.8841 21.3185 0.5926 0.8428 19.6911 0.4904 0.8018 18.2386 0.4108BM3D 0.8255 21.5789 0.6352 0.8168 19.7159 0.4665 0.7624 15.3245 0.3158Our proposed 0.8121 20.7335 0.5945 0.7928 19.9102 0.5526 0.7600 19.0875 0.5045

Jetplane

PES-TV 0.8877 22.3947 0.6003 0.8367 20.7899 0.4936 0.7861 19.2198 0.3933BM3D 0.8749 23.5375 0.7152 0.8755 20.1712 0.3971 0.7708 14.3063 0.2093Our proposed 0.8232 22.3705 0.6815 0.7847 21.2727 0.6247 0.7513 20.3661 0.5687

5


Recommended