Next Article in Journal
Optimal Robust Tracking Control of Injection Velocity in an Injection Molding Machine
Previous Article in Journal
NASCTY: Neuroevolution to Attack Side-Channel Leakages Yielding Convolutional Neural Networks
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Variational Model for Wrapped Phase Denoising

by
Ivan May-Cen
1,2,†,
Ricardo Legarda-Saenz
1,*,† and
Carlos Brito-Loeza
1,†
1
CLIR at Facultad de Matematicas, Universidad Autonoma de Yucatan, Merida 97205, Mexico
2
Tecnológico Nacional de México Campus Progreso, Progreso 97320, Mexico
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
Mathematics 2023, 11(12), 2618; https://doi.org/10.3390/math11122618
Submission received: 28 April 2023 / Revised: 26 May 2023 / Accepted: 7 June 2023 / Published: 8 June 2023
(This article belongs to the Section Computational and Applied Mathematics)

Abstract

:
This paper presents a variational model for the denoising of wrapped phase images. By enforcing the required Pythagorean trigonometric identity between the real and imaginary components of the signal, this model improves the signal-to-noise ratio of the restored signal. To preserve phase map discontinuities, the model is based on total variation. The existence and uniqueness of the model’s solution are demonstrated using standard techniques. In addition, the convergence of a rapid fixed-point method to determine the numerical solution is demonstrated. Experiments on both synthetic and actual patterns validate the model’s performance.
MSC:
35A15; 65N21; 35Q60

1. Introduction

Phase map digital images are used in several major technologies around the world. For instance, radar technology uses them for the 3D reconstruction of landscapes; in the manufacturing industry, they are used for quality assurance by estimating an object’s properties, such as shape and deformation, in a contact-free process. The raw signal data from these technologies are usually presented in an image format where each pixel of the image renders two-dimensional information. Because of this, each pixel can be seen as a complex element with real and imaginary parts encoding the magnitude A and phase information ϕ of the data.
In this work, U = U ( x , y ) represents the signal satisfying the expression
U ( x , y ) = A ( x , y ) e i ϕ ( x , y ) = A ( x , y ) cos ( ϕ ( x , y ) ) + i A ( x , y ) sin ( ϕ ( x , y ) )
where the pair ( U r e a l ( x , y ) , U i m ( x , y ) ) represent the pixel values of the acquired complex signal, with U r e a l = A cos ϕ and U i m = A sin ϕ , and the dependence on ( x , y ) has been omitted for brevity.
It is standard practice to encode the information in only one variable known as the wrapped phase, here denoted by ψ , using the arctan 2 function as follows:
ψ = arctan 2 ( U r e a l , U i m ) .
In optical metrology, the wrapped phase derived from a single or collection of interference fringe pattern images can be unwrapped and used to estimate the physical properties of the objects being measured; see References [1,2,3]. In interferometric synthetic aperture radar (InSAR), the wrapped phase is the absolute phase’s principal value, i.e., a modulo- 2 π observation. In optical metrology, InSAR, or any other similar technology, the pair of signal data elements, i.e., U r e a l and U i m , and consequently ψ , are not immune to noise, which can originate from a variety of sources [4,5,6] and is the primary cause of inaccuracies. Therefore, it is necessary to apply signal denoising to the data. This can be performed directly over ψ , but there is a risk of removing pertinent information from the phase map ψ . Consequently, it is common practice to denoise the real and imaginary components independently. Denoising one sample at a time is not recommended, even when employing cutting-edge denoise algorithms, because it breaks the Pythagorean identity between the real and imaginary signal components. This relationship must be maintained for the arctan 2 function to recover the phase map with high precision. If the identity condition is not met, the ψ values derived from this formula cannot be relied upon.
The following is an overview of some phase denoising techniques that have been utilized in the past. In References [7,8], the authors proposed simultaneous phase unwrapping and noise filtering algorithms with a probabilistic approach based on random Markov fields and Kalman filters; their proposals work well for continuous phases, but discontinuous phase maps are not mentioned. Reference [9] proposes a phase filtering method based on a variational decomposition model with total variation regularization; they do not demonstrate any results with discontinuous phase maps either. Reference [10] presents a global filtering process that makes use of the local frequencies of the wrapped phase map and tunes each pixel to its instantaneous frequency; this linear filtering method only works for continuous phases. References [11,12] propose different methods for discontinuous maps; however, they assume the phase to be locally polynomial and the overall process requires quality windows, which adds complexity to the scheme and uncertainty if the size of the window is not chosen appropriately. Modern methods for noise filtering based on deep learning algorithms [13,14,15,16] only perform well for continuous phase maps.
More recently, two variational models with second-order regularizers have been proposed in Reference [17] to enhance the preservation of features such as edges, contrast, and smoothness. Reference [18] proposes a scalable subspace clustering method that combines the learning of a concise dictionary with a robust subspace representation in a unified model, thereby reducing the size of optimization problems. Reference [19] suggests a scalable approximate Bayesian method for image restoration based on TV priors, expectation propagation, and expectation-maximization. In order to preserve image details and minimize vanishing gradients, a novel deep learning method of despeckling SAR images with a dilated residual network (SAR-DRN) and skip connections is proposed in Reference [20]. Reference [21] proposes a hybrid denoising method to eliminate SAR speckle distortions using a convolutional neural network (CNN) and consistent cycle spinning (CCS) in the nonsubsample shearlet transform (NSST) domain. The method achieves superior speckle removal performance and preserves more granular data than existing algorithmic techniques. In this paper, the variational approach is utilized, which has proven effective in many other image processing techniques by preserving discontinuities and noise filtering (see, for example, References [22,23,24] and references therein). This paper proposes and analyzes a variational model for the denoising of wrapped phase maps that preserves not only discontinuities but also the Pythagorean relationship between the real and imaginary portions of the phase map.
The following are this paper’s contributions.
  • A variational model for the removal of noise from wrapped phase images while preserving the Pythagorean identity of the signal elements. Total variation regularization is incorporated into the model to preserve signal discontinuities when necessary.
  • A mathematical analysis of the model, demonstrating the existence and uniqueness of the model’s solution.
  • A fixed-point algorithm for the rapid solution of the model.
  • The mathematical proof of the fixed-point algorithm’s convergence.
This work is structured as follows: In Section 2, the proposed variational model is described; Section 3 is devoted to the analysis of the model and the derivation of the Euler–Lagrange equations; and Section 4 explains numerical techniques to solve the model. In particular, a fixed-point method, its proof of convergence, and its computational implementation are presented; in Section 5, experiments illustrating the performance of the model and a comparison with state-of-the-art methods for denoising are presented. In Section 6, conclusions are presented.

2. A Variational Model to Denoise Wrapped Phase Maps

In this section, we present our model for the denoising of wrapped phase images. Consequently, let us start by defining the relevant variables:
  • ψ ^ , U ^ r e a l = A cos ψ ^ , and U ^ i m = A sin ψ ^ are the noisy wrapped phase image and its noisy components;
  • U r e a l , U i m and ψ are the phase components and wrapped phase to be estimated;
  • U r e a l , U i m , and ψ are the denoised solutions from the proposed model.
The well-known mathematical model of a wrapped phase map ψ ^ contaminated with additive Gaussian noise η is
ψ ^ = ψ + η ,
Possibly the most common technique for the filtering of wrapped phase maps is the one proposed in Reference [25], in which U ^ r e a l and U ^ i m are filtered independently and ψ is then calculated as ψ = arctan ( U i m / U r e a l ) with magnitude A = [ ( U r e a l ) 2 + ( U i m ) 2 ] 1 / 2 . Due to the periodicity of the sine and cosine functions, it is possible that modulo- 2 π discontinuities will be lost during this process.
Since there is no difficulty in computing the magnitude A for an arbitrary phase map and normalizing it, we consider the case where A = 1 to simplify U ^ r e a l = cos ψ ^ and U ^ i m = sin ψ ^ without sacrificing generality. Then, we implement the subsequent minimization
( U r e a l , U i m ) = arg min ( U r e a l , U i m ) F ( U r e a l , U i m ) ,
where
F λ 1 2 Ω ( U r e a l U ^ r e a l ) 2 d Ω + λ 2 2 Ω ( U i m U ^ i m ) 2 d Ω + λ 3 2 Ω ( ( U r e a l ) 2 + ( U i m ) 2 1 ) 2 d Ω + Ω | U r e a l | d Ω + Ω | U i m | d Ω
where Ω R 2 is the domain of integration and λ 1 , λ 2 , and λ 3 are the regularization parameters. Following Ströbel’s technique for the filtering of wrapped phase maps, the first two terms of F constitute the fitting function. The third term is a major contribution of the proposed model and forces the Pythagorean identity ( U i m ) 2 + ( U r e a l ) 2 = 1 to be satisfied, thereby enhancing the estimation of ψ using the arctan function. The final two variables serve to regularize the solutions U i m , U r e a l . It is well known that the total variation regularizer permits discontinuities in the solution while simultaneously removing [26].

3. Model Analysis

In this section, standard techniques are used to demonstrate that the model’s solution exists and is unique. Let us assume that Ω is a convex region and define its bounded variation norm as | | · | | B V .
  • Existence
Let us start by showing that F is BV-coercive. To this end, note that
Ω ( U i m U ^ i m ) 2 d Ω 0 ,
Ω ( U r e a l U ^ r e a l ) 2 d Ω 0 ,
Ω ( ( U r e a l ) 2 + ( U i m ) 2 1 ) 2 d Ω 0 .
Then, it is immediately found that
lim | | ( U r e a l , U i m ) | | B V F ( U r e a l , U i m ) =
meaning that F is B V -coercive.
The weakly lower semi-continuity of (4)–(6) is a consequence of the weakly lower semi-continuity of the norms on Banach spaces. The same property holds true for | | U r e a l | | B V and | | U i m | | B V , as demonstrated by Reference [27]. In conclusion, with F being weakly lower semi-continuous and B V -coercive, the existence of the solution in the B V space is guaranteed according to Reference [27].
  • Uniqueness
The uniqueness of the solution is due to the convexity of the model. The convexity of (4) and (5), | | U r e a l | | B V , and | | U i m | | B V is demonstrated in Reference [27]. Therefore, it only remains to demonstrate the convexity of (6). Section 4.2 demonstrates that (6) can be viewed as | | K u d | | 2 2 , where u = ( U r e a l ; U i m ) and K is a bounded operator. It is readily apparent that therefore (6) is convex [28]. Note also that F is bounded below by zero.

Euler–Lagrange Equations

This section shows the derivation of the model’s Euler–Lagrange equations. Define φ C ( Ω ) with compact support and ε as a given scalar. The first variations are then set to zero, i.e.,
δ F r e a l d d ε F ( U r e a l + ε φ , U i m ) | ε = 0 = 0 , and δ F i m d d ε F ( U r e a l , U i m + ε φ ) | ε = 0 = 0 .
Here, only the computation for U r e a l is provided because U i m is nearly identical.
δ F r e a l = d d ε λ 1 2 Ω ( U r e a l + ε φ U ^ r e a l ) 2 d Ω + λ 2 2 Ω ( U i m U ^ i m ) 2 d Ω
+ λ 3 2 Ω ( ( U r e a l + ε φ ) 2 + ( U i m ) 2 1 ) 2 d Ω
+ Ω | ( U r e a l + ε φ ) | d Ω + Ω | U i m | d Ω | ε = 0
= λ 1 Ω ( U r e a l U ^ r e a l ) φ d Ω + 2 λ 3 Ω ( U r e a l ) 2 + ( U i m ) 2 1 U r e a l φ d Ω
+ Ω U r e a l | U r e a l | · φ d Ω .
Now, by applying Green’s Theorem in the last term,
Ω U r e a l | U r e a l | · φ d Ω = Ω · U r e a l | U r e a l | φ d Ω + Ω U r e a l | U r e a l | · n φ d ( Ω )
the following nonlinear partial differential equation (PDE) is obtained
· U r e a l | U r e a l | + λ 1 ( U r e a l U ^ r e a l ) + 2 λ 3 ( U r e a l ) 2 + ( U i m ) 2 1 U r e a l = 0 in Ω
with Neumann’s boundary condition
U r e a l | U r e a l | · n = 0 on Ω
where n denotes the outward unit normal vector on Ω .
The corresponding PDE for U i m is
· U i m | U i m | + λ 2 ( U i m U ^ i m ) + 2 λ 3 ( U r e a l ) 2 + ( U i m ) 2 1 U i m = 0 in Ω
with Neumann’s boundary condition
U i m | U i m | · n = 0 on Ω .

4. Numerical Solution

The nonlinear PDEs in (14) and (16) are anisotropic second-order nonlinear equations; consequently, it is anticipated that conventional numerical methods will struggle to quickly converge to the solution. This is the case with the popular gradient descent method, which, due to stability constraints, may converge to the solution very slowly. In both PDEs, the discrete diffusion coefficient D = 1 | U r e a l | for (14) must be regularized to prevent division by zero by adding a very small scalar β > 0 , i.e., D β = 1 | U r e a l + β | . It was demonstrated in Reference [29] that as β 0 , the time-step parameter in the gradient descent algorithm must also approach zero in order to ensure the stability of the numerical method. Clearly, the smaller the value of β , the greater the number of iterations required.
The dual formulations [30,31], alternating minimization methods [32], Newton-based method [33], Bregman iterative algorithms [34], and fixed-point methods [35] are among the other numerical methods that have been developed for similar PDEs but have yet to be tested in the proposed wrapped phase denoising model. This paper demonstrates an effective fixed-point method with rapid convergence, leaving the remainder for future research.

4.1. Fixed-Point Method

This section introduces the fixed-point algorithm for the solution of PDEs (14) and (16). The following fixed-point scheme should initially work for U r e a l with U i m fixed.
· | U r e a l k | + λ 1 + 2 λ 3 ( U r e a l k ) 2 + ( U i m k ) 2 1 U r e a l k + 1 = λ 1 U ^ r e a l for k = 1 , 2 , 3 ,
Note, however, that the term ( U r e a l ) 2 + ( U i m ) 2 1 may be negative at some iterations, and when 2 λ 3 λ 1 , the resulting matrix is no longer strictly diagonally dominant. Therefore, the convergence of algorithms such as Gauss–Seidel and Jacobi cannot be guaranteed to converge.
To resolve this issue, one element is moved to the right, resulting in
· | U r e a l k | + λ 1 + 2 λ 3 ( U r e a l k ) 2 + ( U i m k ) 2 U r e a l k + 1 = λ 1 U ^ r e a l + 2 λ 3 U r e a l k in Ω .
Now, λ 1 + 2 λ 3 ( U r e a l k ) 2 + ( U i m k ) 2 , which is always positive, is added to the main diagonal, ensuring strict diagonal dominance.
Following the same steps, a fixed-point scheme for U i m is obtained with U r e a l fixed.
· | U i m k | + λ 2 + 2 λ 3 ( U r e a l k ) 2 + ( U i m k ) 2 U i m k + 1 = λ 2 U ^ i m + 2 λ 3 U i m k in Ω .
In shortened form, (19) and (20) can be written as
H ( U r e a l k ) U r e a l k + 1 = f ( U r e a l k ) ,
H ( U i m k ) U i m k + 1 = f ( U i m k ) .
where f is the right-hand side and H the differential operator multiplying U r e a l and U i m of (19) and (20), respectively. This system can be solved initially for U r e a l with U i m fixed, and then solved in the opposite direction. However, an improvement is feasible by creating the system
L ( u k ) u k + 1 = c k
where
L ( u k ) = H ( U r e a l k ) 0 0 H ( U i m k ) , u k + 1 = U r e a l k + 1 U i m k + 1 , c k = f ( U r e a l k ) f ( U i m k ) .
The matrix L ( u ) inherits the same satisfactory properties of H, i.e., L is symmetric, positive definite, and strictly diagonal dominant.

4.2. Fixed-Point Algorithm Convergence

To prove the convergence of the proposed fixed-point scheme (23), the Weiszfeld method will be used; see References [36,37,38]. Here, a lexicographic ordering on U r e a l and U i m is considered, both in R N , to define u R 2 N as the column vector u = ( U r e a l , U i m ) , and K R 2 N × 2 N where N = m × n . Further, we define the set { d 1 , d 2 , d 3 } with elements in R 2 N , and K is the adjoint of the bounded operator K as follows:
K = U r e a l k U i m k U i m k U r e a l k , d 1 = U ^ r e a l 0 , d 2 = 0 U ^ i m , d 3 = 1 0 ,
with 1 the vector with all entries equal to one and 0 the null vector.
Then, the model in (3) can be written as follows:
arg min u F ( u )
where
F ( u ) = l | A l T u | β + λ 1 2 | | u d 1 | | 2 2 + λ 2 2 | | u d 2 | | 2 2 + λ 3 2 | | K u d 3 | | 2 2 ,
and A l T R 2 × 2 N is an array that contains the gradient of u that is approximated using finite differences. Here, l defined as
l = l = ( i 1 ) n + j if   ( i , j )   belongs   to   U r e a l l = N + ( i 1 ) n + j if   ( i , j )   belongs   to   U i m ,
stands for the pixel coordinates where the gradient is computed and
| A l T u | β = ( x u l ) 2 + ( y u l ) 2 + β
where β > 0 is a regularization parameter. Note that A l T u can be split as A l T u = ( A 1 l T , 0 ) u + ( 0 , A 2 l T ) u . For instance, the operator ( A 1 l T , 0 ) computes the gradient of the first half of u, i.e., U r e a l , and pads the vector with zeros. By defining B 1 l = ( A 1 l T , 0 ) and B 2 l = ( 0 , A 2 l T ) , the two regularization terms in (3) can be compactly expressed as l | A l T u | β .
Further, the set { d 1 , d 2 , d 3 } has elements in R 2 N , and K is a bounded operator with K its adjoint.
K = U r e a l k U i m k U i m k U r e a l k , d 1 = U ^ r e a l 0 , d 2 = 0 U ^ i m , d 3 = 1 0 ,
with 1 the vector with all entries equal to one and 0 the null vector.
Note that the fixed-point algorithm in (23) then can be written as
l A l A l T u k + 1 | A l T u k | β + λ 1 ( u k + 1 d 1 ) + λ 2 ( u k + 1 d 2 ) + 2 λ 3 K ( K u k + 1 d 3 ) = 0 .

Generalized Weiszfeld Method

The generalized Weiszfeld method consists of choosing a uniformly strictly convex quadratic function G ( w , u ) that approximates F ( u ) under the assumptions of Hypothesis 1 below.
Hypothesis 1.
1. 
G ( w , u ) = F ( u ) + ( w u , F ( u ) ) + 1 2 ( w u , C ( u ) ( w u ) ) .
2. 
C ( u ) is continuous.
3. 
λ min ( C ( u ) ) μ > 0 u .
4. 
F ( w ) G ( w , u ) w .
Weiszfeld’s generalized method solves (25) via the following iterative scheme:
u k + 1 = min w G ( w , u k )
where G ( w , u k ) is a quadratic approximation of F ( u ) at iteration k. Under Hypothesis 1 and for fixed u, G ( w , u ) is coercive, bounded, and strictly convex. Therefore, the minimum exists and can be computed by
0 = G w ( u k + 1 , u k ) = F ( u k ) + C ( u k ) ( u k + 1 u k )
with global and linear convergence [36,37].
In what follows, it will be shown, with the help of the following Lemma, that (29) and (31) are equivalent.
Lemma 1.
If C ( u ) is given by
C ( u ) = B 1 d i a g 1 | B 1 l T | β I 2 B 1 T + B 2 d i a g 1 | B 2 l T | β I 2 B 2 T + λ 1 + λ 2 + 2 λ 3 K K
for B 1 = ( B 11 , , B 1 m ) , I 2 the 2 × 2 identity matrix and B 2 are defined in a similar way. Then,
G ( w , u ) = F ( u ) + ( w u , F ( u ) ) + 1 2 ( w u , C ( u ) ( w u ) )
defines a generalized Weiszfeld method and (29) is equivalent to (31).
Proof. 
The proof is similar to the one given for Lemma 6.1 in Reference [37]. First, it is shown that Property 1 in Hypothesis 1 is satisfied, i.e., that (29) and (31) are equivalent.
F ( u k ) + C ( u k ) ( u k + 1 u k ) = λ 1 ( u k d 1 ) + λ 2 ( u k d 2 ) + 2 λ 3 K ( K u k d 3 ) + l B 1 l B 1 l T u k | B 1 l T u k | β + l B 2 l B 2 l T u k | B 2 l T u k | β + l B 1 l B 1 l T u k + 1 | B 1 l T u k | β + l B 2 l B 2 l T u k + 1 | B 2 l T u k | β + λ 1 u k + 1 + λ 2 u k + 1 + 2 λ 3 K K u k + 1 l B 1 l B 1 l T u k | B 1 l T u k | β l B 2 l B 2 l T u k | B 2 l T u k | β λ 1 u k λ 2 u k 2 λ 3 K K u k = λ 1 ( u k + 1 d 1 ) + λ 2 ( u k + 1 d 2 ) + 2 λ 3 K ( K u k + 1 d 3 ) + l B 1 l B 1 l T u k + 1 | B 1 l T u k | β + l B 2 l B 2 l T u k + 1 | B 2 l T u k | β = λ 1 ( u k + 1 d 1 ) + λ 2 ( u k + 1 d 2 ) + 2 λ 3 K ( K u k + 1 d 3 ) + l A l A l T u k + 1 | A l T u k | β .
Property 2 holds because the continuity of C ( u ) is guaranteed by | B 1 l T u k | β > 0 and | B 2 l T u k | β > 0 .
Property 3 is fulfilled by noticing that K is a bounded nonzero operator.
Property 4 is straightforwardly obtained from the procedure in the proof of Lemma 6.1 in Reference [37] and will be omitted here. □

4.3. Numerical Realization

Here, the numerical realization of the fixed-point method for the Euler–Lagrange equations is presented. To this end, we define the discrete domain as Ω h = [ 0 , m ] × [ 0 , n ] and, without loss of generalization, set the spatial step size h = h x = h y = 1 over the grid defined as Γ h = { ( x , y ) : x = i h x , y = j h y , i , j Z } .
To approximate the partial derivatives of a given variable w, we use the finite differences method. The norm of the gradient of w at points ( i + 1 , j ) , ( i 1 , j ) , ( i , j + 1 ) , and ( i , j 1 ) is computed as follows:
| w | i + 1 , j = ( w i + 1 , j w i , j ) 2 h x 2 + ( w i , j + 1 w i , j ) 2 h y 2 ,
| w | i 1 , j = ( w i , j w i 1 , j ) 2 h x 2 + ( w i 1 , j + 1 w i 1 , j ) 2 h y 2 ,
| w | i , j + 1 = ( w i + 1 , j w i , j ) 2 h x 2 + ( w i , j + 1 w i , j ) 2 h y 2 ,
| w | i , j 1 = ( w i + 1 , j 1 w i , j 1 ) 2 h x 2 + ( w i , j w i , j 1 ) 2 h y 2 .
Then, the curvature term · u | u | is approximated at point ( i , j ) by
· w | w | 2 + β = ( w i + 1 , j w i , j ) / h x | w | i + 1 , j 2 + β ( w i , j w i 1 , j ) / h x | w | i 1 , j 2 + β + ( w i , j + 1 w i , j ) / h y | w | i , j + 1 2 + β ( w i , j w i , j 1 ) / h y | w | i , j 1 + β
where β > 0 is a regularization parameter to avoid division by zero. Finally, the boundary conditions are enforced by
w i , 0 = w i , 1 , w i , n + 1 = w i , n , w 0 , j = w 1 , j , w m + 1 , j = w m , j .
To realize the fixed-point iteration, we first define
| U r e a l | i , j 2 + β = G i , j , and | U i m | i , j 2 + β = G ¯ i , j .
Then, by taking advantage of the fact that the resulting matrix is strictly diagonal dominant, each iteration of the fixed-point method can be solved using the Gauss–Seidel method as follows:
u l k + 1 = ( U r e a l k + 1 ) l ( U i m k + 1 ) l = ( N r e a l ) i , j / ( D r e a l ) i , j ( N i m ) i , j / ( D i m ) i , j
with l as in (27) and
( N r e a l ) i , j = G i + 1 , j k ( U r e a l k ) i + 1 , j + G i 1 , j k ( U r e a l k + 1 ) i 1 , j + G i , j + 1 k ( U r e a l k ) i , j + 1
+ G i , j 1 k ( U r e a l k + 1 ) i , j 1 + λ 1 ( U ^ r e a l ) i , j + 2 λ 3 ( U r e a l k ) i , j
( D r e a l ) i , j = λ 1 + 2 λ 3 ( U r e a l k ) i , j 2 + ( U i m k ) i , j 2 + G i + 1 , j k + G i 1 , j k + G i , j + 1 k + G i , j 1 k
( N i m ) i , j = G ¯ i + 1 , j k ( U i m k ) i + 1 , j + G ¯ i 1 , j k ( U i m k + 1 ) i 1 , j + G ¯ i , j + 1 k ( U i m k ) i , j + 1
+ G ¯ i , j 1 k ( U i m k + 1 ) i , j 1 + λ 2 ( U ^ i m ) i , j + 2 λ 3 ( U i m k ) i , j
( D i m ) i , j = λ 2 + 2 λ 3 ( U r e a l k ) i , j 2 + ( U i m k ) i , j 2 + G ¯ i + 1 , j k + G ¯ i 1 , j k + G ¯ i , j + 1 k + G ¯ i , j 1 k

5. Experimental Results

In this section, results are shown using both synthetic and real-world examples. All algorithms in this section were executed on a computer with an Intel Core i7 2.5 GHz processor, 16 GB of RAM, and a 64-bit installation of Debian GNU/Linux 9 (stretch). The proposed model was implemented using the C/C++ programming language and the high-performance vector mathematics library Blitz++ [39]. The code and experiments can be found at https://github.com/clirlab/wrapped_phase_denoising (accessed on 27 April 2023).

5.1. Quality of Results

Let us begin by analyzing the outcomes of synthetic images polluted with varying levels of additive Gaussian noise. A wrapped phase image with a vertical discontinuity in the middle is depicted in Figure 1a,c, with signal-to-noise ratio (SNR) values of 74.41 dB and 43.34 dB, respectively. The proposed model was applied to both images, resulting in the restored images shown in Figure 1b,d. The parameters were fixed at β = 0.001 , λ 1 = λ 2 = 2.5 , and λ 3 = 5 for both problems, and the noise was successfully eliminated while the discontinuity was preserved.
In addition, Figure 2 depicts a noisy and restored image of a real problem. Again, the restoration is excellent, as are the edges. This problem comes from a brain MRI scan.

5.2. Algorithm Performance

In this section, the performance of the gradient descent and fixed-point numerical algorithms in solving the proposed variational model is analyzed. Table 1 displays the CPU time and number of iterations required by each algorithm to solve the problems presented in Figure 1a,c. Iterations were terminated for both algorithms when the relative residual was less than ϵ = 10 7 with ϵ | | u k + 1 u k | | 2 / | | u k | | 2 .
As anticipated, Table 1 demonstrates that the fixed-point method is roughly one order of magnitude faster than the gradient descent method.

5.3. Comparison against Other Denoising Algorithms

A natural question is whether state-of-the-art image denoising algorithms provide an acceptable restoration of U r e a l and U i m as well as the wrapped phase map.
In order to compare the results, the mean squared error (MSE) and the image fidelity index (IFI) [8] were evaluated for any variable y R m × n .
M S E = 1 m n i = 1 m j = 1 n ( y ( i , j ) y ¯ ( i , j ) ) 2 ,
and
I F I = 1 i = 1 m j = 1 n y ( i , j ) y ¯ ( i , j ) 2 i = 1 m j = 1 n y ( i , j ) 2 .
The closer the IFI is to 1, the more accurate the resulting estimate will be.
There are two methods for the denoising of interferograms, the most common of which is directly processing the wrapped phase image. The second method, which was utilized in this study, is to denoise independently each component of the complex image and then use both to reconstruct the wrapped phase image using the arctan-2 function. First, we demonstrate the results of the first approach using BM3D [40], Non-Local Means (NLM) [41], and the de facto method to denoise wrapped phase maps, Ströbel’s method [25], on the synthetic problems of Figure 1a,c and the real problem of Figure 2a. Then, we apply cutting-edge algorithms to the wrapped phase image.
The results of using the first method are shown in Table 2. The proposed model has by far the best restoration. Even Strobel’s method outperforms BM3D and NLM, demonstrating that the relationship between U r e a l and U i m must be preserved when denoising a wrapped phase map image. Figure 3 and Figure 4 illustrate that enforcing the Pythagorean trigonometric identity between the real and imaginary parts of the phase map improves the wrapped phase map restoration, thereby reducing inaccuracies in potential applications.
In Table 3, we present the CPU times required by each model to denoise the problems depicted in Figure 1. As can be seen, the processing time of the proposed method is very competitive.
The results of using the second method are shown in Figure 5, where we compare it against two convolutional neural network (CNN) models for SAR image despeckling. In the work of Wang et al. [42], a deep-learning-based approach to remove speckle from SAR images using convolutional layers, batch normalization, a rectified linear unit activation function, and a componentwise division residual layer is presented. In Reference [43], however, a different strategy is taken by applying a CNN model to a recently proposed SAR speckle removal framework, constructing a reliable dataset of speckle-free SAR images and training a hybrid CNN on speckle-free SAR images.
We evaluate the proposed model against the two CNN-based models described previously. Figure 5 demonstrates that both CNN-based models obtain significantly worse MSE and IFI values than our model. Moreover, the reconstruction of our proposed model appears to be of superior quality to those of the other two.

6. Conclusions

This article presents a novel variational model for the denoising of wrapped phase maps. Regularization is achieved through total variation, so the model preserves discontinuities, and the fundamental Pythagorean trigonometric identity between the real and imaginary portions of the phase map is enforced, significantly enhancing the phase map restoration. In addition, the existence and uniqueness of our model’s solution are analyzed, and a rapid fixed-point algorithm for the numerical implementation is presented. Also provided is a theoretical analysis of this fixed-point method to demonstrate its convergence. In conclusion, restoration results on synthetic and real-world examples are presented as evidence of the restoration quality, and comparisons are made with well-known denoising techniques such as BM3D, NLM, and Strobel. In addition, comparisons are made with cutting-edge CNN-based models. In both instances, the proposed variational model produces the best results.

Author Contributions

Conceptualization, R.L.-S.; Methodology, I.M.-C., R.L.-S. and C.B.-L.; Validation, C.B.-L.; Formal analysis, C.B.-L.; Investigation, I.M.-C., R.L.-S. and C.B.-L.; Writing—original draft, C.B.-L.; Writing—review & editing, I.M.-C. and R.L.-S.; Supervision, R.L.-S. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Data Availability Statement

Data underlying the results presented in this paper are not publicly available at this time but may be obtained from the authors upon reasonable request.

Acknowledgments

I. May-Cen acknowledges the support of CONACYT through the Ph.D. scholarship with number 818310.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Kulkarni, R.; Rastogi, P. Single and Multicomponent Digital Optical Signal AnalysisEstimation of Phase and Its Derivatives; IOP Publishing: Bristol, UK, 2017. [Google Scholar]
  2. Servin, M.; Quiroga, J.A.; Padilla, M. Fringe Pattern Analysis for Optical Metrology: Theory, Algorithms, and Applications; Wiley-VCH: Weinheim, Germany, 2014. [Google Scholar]
  3. Surrel, Y. Fringe Analysis. In Handbook of Optical Metrology: Principles and Applications, 2nd ed.; Rastogi, P.K., Ed.; Springer: Berlin/Heidelberg, Germany, 2000; Volume 77, pp. 55–102. [Google Scholar]
  4. Warlick, Z.; Katz, R. Errors in non-contact sensor measurements due to misalignment and scanning methodology. Int. J. Metrol. Qual. Eng. 2015, 6, 305. [Google Scholar] [CrossRef] [Green Version]
  5. Wyant, J.C. Dynamic Interferometry. Opt. Photonics News 2003, 14, 36. [Google Scholar] [CrossRef]
  6. Huntley, J.M. Random phase measurement errors in digital speckle pattern interferometry. Opt. Lasers Eng. 1997, 26, 131–150. [Google Scholar] [CrossRef]
  7. Kulkarni, R.; Rastogi, P. Phase unwrapping algorithm using polynomial phase approximation and linear Kalman filter. Appl. Opt. 2018, 57, 702. [Google Scholar] [CrossRef]
  8. Kulkarni, R.; Rastogi, P. Fringe denoising algorithms: A review. Opt. Lasers Eng. 2020, 135, 106190. [Google Scholar] [CrossRef]
  9. Li, B.; Tang, C.; Gao, G.; Chen, M.; Tang, S.; Lei, Z. General filtering method for electronic speckle pattern interferometry fringe images with various densities based on variational image decomposition. Appl. Opt. 2017, 56, 4843. [Google Scholar] [CrossRef] [PubMed]
  10. Medina, O.M.; Estrada, J.C.; Lopez, Y.Y. Filtering optical wrapped phase images algorithm. Opt. Eng. 2017, 56, 111704. [Google Scholar] [CrossRef]
  11. Kemao, Q.; Gao, W.; Wang, H. Windowed Fourier-filtered and quality-guided phase-unwrapping algorithm. Appl. Opt. 2008, 47, 5420. [Google Scholar] [CrossRef]
  12. Kemao, Q.; Gao, W.; Wang, H. Windowed Fourier filtered and quality guided phase unwrapping algorithm: On locally high-order polynomial phase. Appl. Opt. 2010, 49, 1075. [Google Scholar] [CrossRef]
  13. Yan, K.; Yu, Y.; Huang, C.; Sui, L.; Qian, K.; Asundi, A. Fringe pattern denoising based on deep learning. Opt. Commun. 2019, 437, 148–152. [Google Scholar] [CrossRef]
  14. Zhang, J.; Tian, X.; Shao, J.; Luo, H.; Liang, R. Phase unwrapping in optical metrology via denoised and convolutional segmentation networks. Opt. Express 2019, 27, 14903. [Google Scholar] [CrossRef] [Green Version]
  15. Yan, K.; Yu, Y.; Sun, T.; Asundi, A.; Kemao, Q. Wrapped phase denoising using convolutional neural networks. Opt. Lasers Eng. 2020, 128, 105999. [Google Scholar] [CrossRef]
  16. Yan, K.; Chang, L.; Andrianakis, M.; Tornari, V.; Yu, Y. Deep Learning-Based Wrapped Phase Denoising Method for Application in Digital Holographic Speckle Pattern Interferometry. Appl. Sci. 2020, 10, 4044. [Google Scholar] [CrossRef]
  17. Zhai, Y.; Pan, Z.; Wei, W. Two Variational Models for Image Denoising Using Jacobian of Normals. IEEE Access 2021, 9, 43301–43315. [Google Scholar] [CrossRef]
  18. Huang, S.; Zhang, H.; Pižuric, A. Subspace Clustering for Hyperspectral Images via Dictionary Learning with Adaptive Regularization. IEEE Trans. Geosci. Remote Sens. 2022, 60, 5524017. [Google Scholar] [CrossRef]
  19. Yao, D.; McLaughlin, S.; Altmann, Y. Fast Scalable Image Restoration Using Total Variation Priors and Expectation Propagation. IEEE Trans. Image Process. 2022, 31, 5762–5773. [Google Scholar] [CrossRef] [PubMed]
  20. Zhang, Q.; Yuan, Q.; Li, J.; Yang, Z.; Ma, X. Learning a dilated residual network for SAR image despeckling. Remote Sens. 2018, 10, 196. [Google Scholar] [CrossRef] [Green Version]
  21. Liu, S.; Gao, L.; Lei, Y.; Wang, M.; Hu, Q.; Ma, X.; Zhang, Y.D. Deep SAR speckle removal using hybrid frequency modulations. IEEE Trans. Geosci. Remote Sens. 2020, 59, 3956–3966. [Google Scholar] [CrossRef]
  22. Sartor, K.; Tenali, G.B.; Kozaitis, S.P. Variational phase unwrapping and wavelet denoising of interferometric SAR data using Mumford-Shah framework. Int. J. Signal Imaging Syst. Eng. 2008, 1, 145. [Google Scholar] [CrossRef]
  23. Vese, L.A.; Le Guyader, C. Variational Methods in Image Processing; Chapman and Hall/CRC: Boca Raton, FL, USA, 2015. [Google Scholar]
  24. Song, H.; Sun, Y. InSAR phase filtering using spatially adapted total generalized variation. Remote Sens. Lett. 2017, 8, 370–379. [Google Scholar] [CrossRef]
  25. Strobel, B. Processing of interferometric phase maps as complex-valued phasor images. Appl. Opt. 1996, 35, 2192–2198. [Google Scholar] [CrossRef]
  26. Chan, T.F.; Esedoglu, S. Aspects of total variation regularized L1 function approximation. SIAM J. Appl. Math. 2005, 65, 1817–1837. [Google Scholar] [CrossRef] [Green Version]
  27. Acar, R.; Vogel, C.R. Analysis of bounded variation penalty methods for ill-posed problems. Inverse Probl. 1994, 10, 1217–1229. [Google Scholar] [CrossRef]
  28. Boyd, S.; Vandenberghe, L. Convex Optimization, 1st ed.; Cambridge University Press: Cambridge, UK, 2004. [Google Scholar]
  29. Marquina, A.; Osher, S. Explicit algorithms for a new time dependent model based on level set motion for nonlinear deblurring and noise removal. SIAM J. Sci. Comput. 2000, 22, 387–405. [Google Scholar] [CrossRef] [Green Version]
  30. Chan, T.F.; Golub, G.H.; Mulet, P. A Nonlinear Primal-Dual Method for Total Variation-Based Image Restoration. SIAM J. Sci. Comput. 1999, 20, 1964–1977. [Google Scholar] [CrossRef] [Green Version]
  31. Chambolle, A. An algorithm for total variation minimization and applications. J. Math. Imaging Vis. 2004, 20, 89–97. [Google Scholar]
  32. Huang, Y.; Ng, M.K.; Wen, Y.-W. A Fast Total Variation Minimization Method for Image Restoration. Multiscale Model. Simul. 2008, 7, 774–795. [Google Scholar] [CrossRef]
  33. Ng, M.K.; Qi, L.; Yang, Y.-F.; Huang, Y.-M. On Semismooth Newton’s Methods for Total Variation Minimization. J. Math. Imaging Vis. 2007, 27, 265–276. [Google Scholar] [CrossRef]
  34. Osher, S.; Burger, M.; Goldfarb, D.; Xu, J.; Yin, W. An Iterative Regularization Method for Total Variation-Based Image Restoration. Multiscale Model. Simul. 2005, 4, 460–489. [Google Scholar] [CrossRef]
  35. Vogel, C.R.; Oman, M.E. Iterative methods for total variation denoising. SIAM J. Sci. Comput. 1996, 17, 227–238. [Google Scholar] [CrossRef] [Green Version]
  36. Chan, T.F.; Mulet, P. On the Convergence of the Lagged Diffusivity Fixed Point Method in Total Variation Image Restoration. SIAM J. Numer. Anal. 1999, 36, 354–367. [Google Scholar] [CrossRef] [Green Version]
  37. Shi, Y. Convergence of Fixed Point Iteration for Modified Restoration Problems. J. Math. Imaging Vis. 2008, 32, 31–39. [Google Scholar] [CrossRef]
  38. Brito-Loeza, C.; Legarda-Saenz, R.; Martin-Gonzalez, A. A fast algorithm for a total variation based phase demodulation model. Numer. Methods Partial Differ. Equ. 2019, 36, 617–636. [Google Scholar] [CrossRef]
  39. Veldhuizen, T.L. Blitz++: The Library that Thinks it is a Compiler. In Advances in Software Tools for Scientific Computing; Griebel, M., Keyes, D.E., Nieminen, R.M., Roose, D., Schlick, T., Langtangen, H.P., Bruaset, A.M., Quak, E., Eds.; Springer: Berlin/Heidelberg, Germany, 2000; Volume 10, pp. 57–87. [Google Scholar]
  40. Dabov, K.; Foi, A.; Katkovnik, V.; Egiazarian, K. Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering. IEEE Trans. Image Process. 2007, 16, 2080–2095. [Google Scholar] [CrossRef] [PubMed]
  41. Buades, A.; Coll, B.; Morel, J.-M. A Non-Local Algorithm for Image Denoising. In Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05), San Diego, CA, USA, 20–25 June 2005; Volume 2, pp. 60–65. [Google Scholar]
  42. Wang, P.; Zhang, H.; Patel, V.M. SAR Image Despeckling Using a Convolutional Neural Network. IEEE Signal Process. Lett. 2017, 24, 1763–1767. [Google Scholar] [CrossRef] [Green Version]
  43. Dalsasso, E.; Yang, X.; Denis, L.; Tupin, F.; Yang, W. SAR image despeckling by deep neural networks: From a pre-trained model to an end-to-end training strategy. Remote Sens. 2020, 12, 2636. [Google Scholar] [CrossRef]
Figure 1. Left column: noisy wrapped phase map images with 74.41 dB (a) and 43.34 dB (c) SNR levels. Right column: restored phase maps using the proposed model (b,d). The parameters were fixed at β = 0.001 , λ 1 = λ 2 = 1 , and λ 3 = 5 .
Figure 1. Left column: noisy wrapped phase map images with 74.41 dB (a) and 43.34 dB (c) SNR levels. Right column: restored phase maps using the proposed model (b,d). The parameters were fixed at β = 0.001 , λ 1 = λ 2 = 1 , and λ 3 = 5 .
Mathematics 11 02618 g001
Figure 2. In (a), a noisy wrapped phase map image from an MRI scan. In (b), the restored wrapped phase map using the proposed model. The parameters were fixed at β = 0.001 , λ 1 = λ 2 = 2.5 , and λ 3 = 5 .
Figure 2. In (a), a noisy wrapped phase map image from an MRI scan. In (b), the restored wrapped phase map using the proposed model. The parameters were fixed at β = 0.001 , λ 1 = λ 2 = 2.5 , and λ 3 = 5 .
Mathematics 11 02618 g002
Figure 3. | | U r e a l 2 + U i m 2 | | 2 1 for the problem depicted in Figure 1a. (a) Observe that the proposed model can maintain the Pythagorean identity. (b) Pythagorean identity of Ströbel’s method. (c) BM3D does not preserve the Pythagorean identity. (d) NLM does not preserve the Pythagorean identity.
Figure 3. | | U r e a l 2 + U i m 2 | | 2 1 for the problem depicted in Figure 1a. (a) Observe that the proposed model can maintain the Pythagorean identity. (b) Pythagorean identity of Ströbel’s method. (c) BM3D does not preserve the Pythagorean identity. (d) NLM does not preserve the Pythagorean identity.
Mathematics 11 02618 g003
Figure 4. In the top row (ad), we display the difference | U r e a l U ^ r e a l | for the problem depicted in Figure 1a for all models evaluated in this study. The bottom row (eh) displays the difference | U i m U ^ i m | for the same models. Observe that the proposed model’s first column contains only a small error represented by thin horizontal lines. In contrast, the Ströbel result in the second column, the BM3D result in the third column, and the NLM result in the fourth column each indicate a larger error at numerous other points in the domain. The parameters were fixed at β = 0.001 , λ 1 = λ 2 = 1 , and λ 3 = 5 .
Figure 4. In the top row (ad), we display the difference | U r e a l U ^ r e a l | for the problem depicted in Figure 1a for all models evaluated in this study. The bottom row (eh) displays the difference | U i m U ^ i m | for the same models. Observe that the proposed model’s first column contains only a small error represented by thin horizontal lines. In contrast, the Ströbel result in the second column, the BM3D result in the third column, and the NLM result in the fourth column each indicate a larger error at numerous other points in the domain. The parameters were fixed at β = 0.001 , λ 1 = λ 2 = 1 , and λ 3 = 5 .
Mathematics 11 02618 g004
Figure 5. Comparison results of our model against cutting-edge and CNN-based SAR despeckling algorithms of Wang et al. and Dalsasso et al. Visually, our model produces superior outcomes, as confirmed by MSE and IFE. The parameters were fixed at β = 0.001 , λ 1 = λ 2 = 1 , and λ 3 = 5 . (a) Synthetic image polluted with multiplicative noise. (b) Wang et al.’s model: M S E = 1.37173 and I F I = 0.58008 . (c) Dalsasso et al.’s model: M S E = 1.1679 and I F I = 0.642461 . (d) The model proposed here: M S E = 0.743804 and I F I = 0.772304 .
Figure 5. Comparison results of our model against cutting-edge and CNN-based SAR despeckling algorithms of Wang et al. and Dalsasso et al. Visually, our model produces superior outcomes, as confirmed by MSE and IFE. The parameters were fixed at β = 0.001 , λ 1 = λ 2 = 1 , and λ 3 = 5 . (a) Synthetic image polluted with multiplicative noise. (b) Wang et al.’s model: M S E = 1.37173 and I F I = 0.58008 . (c) Dalsasso et al.’s model: M S E = 1.1679 and I F I = 0.642461 . (d) The model proposed here: M S E = 0.743804 and I F I = 0.772304 .
Mathematics 11 02618 g005
Table 1. Comparison between the gradient descent method and the fixed-point method.
Table 1. Comparison between the gradient descent method and the fixed-point method.
Numerical MethodProblem# of IterationsCPU Time (s)
Gradient DescentFigure 1a1649130
Figure 1c5159431
Fixed PointFigure 1a10418
Figure 1c30755
Table 2. Comparison among different denoising algorithms.
Table 2. Comparison among different denoising algorithms.
MSEIFI
Model U real U im U real U im
Proposed model0.05550.05420.85150.8551
Ströbel0.15370.14890.58910.6021
BM3D0.36960.36870.01250.0149
NLM0.34780.35110.07060.0621
Table 3. CPU times of each algorithm when running the experiments of Figure 1.
Table 3. CPU times of each algorithm when running the experiments of Figure 1.
Algorithm SNR = 43.34 dB SNR = 74.41 dB
Proposed model6.9 s63 s
Ströbel5.5 s6.2 s
BM3D36.6 s45.6 s
NLM14.4 s106 s
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

May-Cen, I.; Legarda-Saenz, R.; Brito-Loeza, C. A Variational Model for Wrapped Phase Denoising. Mathematics 2023, 11, 2618. https://doi.org/10.3390/math11122618

AMA Style

May-Cen I, Legarda-Saenz R, Brito-Loeza C. A Variational Model for Wrapped Phase Denoising. Mathematics. 2023; 11(12):2618. https://doi.org/10.3390/math11122618

Chicago/Turabian Style

May-Cen, Ivan, Ricardo Legarda-Saenz, and Carlos Brito-Loeza. 2023. "A Variational Model for Wrapped Phase Denoising" Mathematics 11, no. 12: 2618. https://doi.org/10.3390/math11122618

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop