Next Article in Journal
The Utility of Low-Dose-Dobutamine Stress Echocardiography in Patients with Heart Failure with Reduced Ejection Fraction: An Update
Next Article in Special Issue
Emerging Technology-Driven Hybrid Models for Preventing and Monitoring Infectious Diseases: A Comprehensive Review and Conceptual Framework
Previous Article in Journal
Prevalence of Incidental Maxillary Sinus Anomalies on CBCT Scans: A Radiographic Study
Previous Article in Special Issue
A New Weighted Deep Learning Feature Using Particle Swarm and Ant Lion Optimization for Cervical Cancer Diagnosis on Pap Smear Images
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Medical Image Despeckling Using the Invertible Sparse Fuzzy Wavelet Transform with Nature-Inspired Minibatch Water Wave Swarm Optimization

by
Ahila Amarnath
1,
Poongodi Manoharan
2,*,
Buvaneswari Natarajan
3,
Roobaea Alroobaea
4,
Majed Alsafyani
4,
Abdullah M. Baqasah
5,
Ismail Keshta
6 and
Kaamran Raahemifar
7,8,9
1
Indian Institute of Technology, Madras, Chennai 600036, Tamilnadu, India
2
College of Science and Engineering, Hamad Bin Khalifa University, Doha P.O. Box 34110, Qatar
3
Middlesex College, Edison, NJ 08818, USA
4
Department of Computer Science, College of Computers and Information Technology, Taif University, P.O. Box 11099, Taif 21944, Saudi Arabia
5
Department of Information Technology, College of Computers and Information Technology, Taif University, Taif 21974, Saudi Arabia
6
Computer Science and Information Systems Department, College of Applied Sciences, AlMaarefa University, Riyadh 11597, Saudi Arabia
7
Data Science and Artificial Intelligence Program, College of Information Sciences and Technology, Penn State University, State College, PA 16801, USA
8
School of Optometry and Vision Science, Faculty of Science, University of Waterloo, 200 University, Waterloo, ON N2L3G1, Canada
9
Faculty of Engineering, University of Waterloo, 200 University Ave W, Waterloo, ON N2L 3E9, Canada
*
Author to whom correspondence should be addressed.
Diagnostics 2023, 13(18), 2919; https://doi.org/10.3390/diagnostics13182919
Submission received: 9 March 2023 / Revised: 20 May 2023 / Accepted: 26 May 2023 / Published: 12 September 2023
(This article belongs to the Special Issue Medical Data Processing and Analysis—2nd Edition)

Abstract

:
Speckle noise is a pervasive problem in medical imaging, and conventional methods for despeckling often lead to loss of edge information due to smoothing. To address this issue, we propose a novel approach that combines a nature-inspired minibatch water wave swarm optimization (NIMWVSO) framework with an invertible sparse fuzzy wavelet transform (ISFWT) in the frequency domain. The ISFWT learns a non-linear redundant transform with a perfect reconstruction property that effectively removes noise while preserving structural and edge information in medical images. The resulting threshold is then used by the NIMWVSO to further reduce multiplicative speckle noise. Our approach was evaluated using the MSTAR dataset, and objective functions were based on two contrasting reference metrics, namely the peak signal-to-noise ratio (PSNR) and the mean structural similarity index metric (MSSIM). Our results show that the suggested approach outperforms modern filters and has significant generalization ability to unknown noise levels, while also being highly interpretable. By providing a new framework for despeckling medical images, our work has the potential to improve the accuracy and reliability of medical imaging diagnosis and treatment planning.

1. Introduction

Ultrasound imaging is widely used in the medical field. It may be used to scan the uterus, liver, kidneys, spleen, brain, heart, and other soft tissues. Because of its efficiency, quickness, and low price, scanning equipment is frequently utilized. In ultrasound pictures, speckle noise is a common problem that may be ascribed to the imaging method, which may be based on coherent waves such as acoustic or laser imaging. The sorts of noise that may be brought on by various outside factors and the transmission system itself include Gaussian, Poisson, blurred, speckle, and salt-and-pepper noise. The practice of removing background noise has grown in importance in medical imaging applications, and the most often used filters—the median, Gaussian, and Wiener filters—deliver the greatest results for each kind of noise. Picture smoothing, which often uses the best filters or the industry standard filters, is used in most image processing programs to remove noise. A denoising model’s capability is to remove noise from the image while still maintaining the edges. Unwanted noise may be eliminated using both linear and non-linear models. Despite their inability to adequately maintain image borders, linear models are often put to the test due to their speed. The histogram, size, and clarity of the MRI images are fed into filters, and depending on these inputs, the best filter is chosen. The area of image noise reduction benefits greatly from the usage of filtering techniques, which may be used to denoise a picture in a number of ways. It can be solved using a variety of algorithms. In order to remove noise without lowering the quality of the examined image, the best filtering techniques are utilized to identify noise with neighboring data.
This work presents a method for suppressing this kind of speckle noise and analyzes its performance. Mathematical morphology is the foundation of this method. It is an updated version of a previously developed algorithm. It is different from other algorithms since it does not rely on the histogram to determine an image’s threshold. It also employs a different approach for rebuilding the characteristics of the speckle’s size. In addition, it employs structuring components with an arbitrary structure that are similar to the forms of the speckles. In terms of both time complexity and output quality, this method improves upon its predecessor. The general contribution of the study may be summarized as follows:
  • Implementation of the sparse fuzzy wavelet transform for obtaining the noisy threshold for analyzing the noisy areas in the image;
  • Then, in order to accurately remove the speckle noise in the input image, the determined threshold was applied to NIMWVSO.
The remainder of this document is structured as follows. Section 2 discusses the earlier literature. The ISFWT and NIMWVSO for image denoising are described in Section 3. The experimental data examined throughout the procedure are presented in Section 4. Section 5 provides the general conclusion and suggestions for further development.

2. Related Work

Here are a few of the several reported techniques for speckle-noise reduction. The authors of [1] offer a method for eliminating spot noise from ultrasound images using kinetic gas molecule optimization (KGMO) and a Bayesian framework. Here, the window widths of the image patches are optimized by KGMO, and noise is removed from those windows by the Bayesian network. Five deep learning networks with varied network topologies are introduced by [2] to decrease the influence of speckle noise on ultrasound images. It also includes U-shaped networks with batch normalization and batch re-normalization layers, a denoising network based on residual connections, and a modified generative adversarial network. The autocoder network is built on a convolutional neural network (CNN) with dilated convolution layers. Researchers have created a hybrid strategy that makes use of Kuan and non-local means filters to reduce noise (as stated in [3]). They use a Kuan filter to first sharpen the edges, and then non-local techniques to eliminate the speckle noise. Furthermore, the performance of the proposed hybrid filter and its design parameters are optimized using a meta-heuristic known as the gray wolf optimizer. Ref. [4] proposes SORAMA (Semantic Object Region and Morphological Analysis), an excellent technique for analyzing semantic object regions. A scan is the first step, followed by a noise-reduction process. After that, image quality becomes better. The area of interest (ROI) for the picture is identified. The morphological processes of dilatation and erosion then blur the image. The polished image clearly shows the stone. If the stone is still hidden, noise reduction is performed once again, and the process is repeated until a smoothed image containing the stone is discovered. The use of a progressive feature fusion attention dense network (PFFADN) to eliminate speckle noise from OCT images is described in [5]. They first build up tightly connected dense blocks in the deep convolution network before connecting each shallowly generated feature map to the deep one to form a residual block. They use an attention mechanism to assist the network concentrate on the most crucial information while removing the rest. A uniform collection of feature maps that have been combined from all dense blocks are sent to the reconstruction output layer. There, a technique for removing the speckle noise that often shows up in ultrasound images is described [6,7]. These images are used in the medical industry to assist physicians in finding abnormalities and illnesses that are deeply buried inside a patient’s body. There have been a number of recommended filters for despeckling ultrasonic images, but it is still possible to enhance the quality of the denoised image to avoid false detection. This essay makes use of a bilateral filter that has been improved. The minimum mean brightness error bi-histogram equalization (MMBEBHE) approach was introduced to enhance the contrast of MRI images [8]. To reduce visual noise, this technique combines the Wiener and bilateral filters. The results of the study using the provided approach include results from speckle and Gaussian noise. In [9], the author describes the most popular convolutional neural network (CNN)-based despeckling techniques for ultrasound images, both in the transform domain and the spatial domain. Using transform domain methods such as wavelet, curvelet, and Bayes shrink has been successful in several studies. Deep-learning-based techniques, including DnCNN, ECNDNet, etc., enhance despeckling’s effectiveness. Here, image fusion is carried out by combining the speckle-noise-reduction (SNR) approach with the multi-modality image fusion method [10]. The SNR approach is used to eliminate background noise for enhanced medical image quality. The advantages and disadvantages of fusing many medical images into a single, meaningful image are also addressed. Additionally, the stationary wavelet transformation (SWT) technique is being studied as a more reliable approach of accomplishing the same goal. A novel fuzzy-logic-based non-local mean filter is introduced in [11] to model the speckle noise, recover the damaged image using fuzzy uncertainty modeling (FUM), smoothed by local statistic-based information while keeping the image characteristics for low and highly speckled ultrasound pictures. The presented denoising approach gathers local characteristics to use FUM in order to distinguish “similar and non-similar” non-local locations. By applying local statistical data to smooth these homogeneous zones, the fuzzy-logic-based noise-reduction approach is started. In this instance, an ultrasonic image is divided into subbands using the wavelet transform [12,13]. The approximation subband is modified using bilateral filtering, while the detail subbands are modified using thresholding and anisotropic diffusion. The smoothing and removal approaches covered in [14,15] are closely related to a number of processes (such as the identification of regions of interest) addressed in earlier studies that were examined here. Furthermore, defining this toolbox makes it simpler to conduct analyses and research with a more focused scope.
The classic methods are extensively covered in the first half of this research and include space, diffusion, and wavelet filters, to name just a few. The next section describes different state-of-the-art and hybrid models in the realm of speckle-noise filtering as well as contemporary, less well-known deep-learning-based machine learning techniques. A novel technique for reducing speckle noise in OCT volumes is presented in [16], which makes use of the matching en face representation to provide relatively speckle-free frontal parts of the retinal layers. The suggested method estimates the anatomical structures by resolving a constrained optimization problem that combines wavelet-domain sparsity and total variation (wavelet-TV) regularization in order to preserve the edges of retinal layers and lessen artifacts brought on by pure wavelet thresholding. To accomplish the goal function outlined in [17,18], we use a brand-new hybrid approach called the Randomized FireFly (FF) update in Lion Algorithm (RFU-LA), which includes components of both the Lion Algorithm (LA) and the FireFly Algorithm (FF). By taking the mean of images that have been routinely median-filtered using different kernel sizes, the hybrid median-mean filter (HM2F) proposed in [19] is a one-shot image processing method for decreasing speckle noise. Together, the median filter and mean technique may preserve up to 97 percentage of the original spatial resolution while producing a denoised image with reduced speckle contrast. The HM2F method is compared against several other well-known filtering techniques, including the classic median filter method, the 3D block-matching filter, the non-local means filter, the 2D windowed Fourier transform filter, and the Wiener filter, using a variety of speckle-distorted images. According to the authors of [20], there is a technique that uses a guided filter and speckle-reducing anisotropic diffusion (SRAD) to reduce the impact of speckle noise while maintaining sharp edges. First, speckle, a multiplicative noise, is removed using SRAD. After filtering, if there is still noise, it is added to using a logarithmic transformation. After the first filtering, any remaining noise in the image is removed using a guided filter. The final image is noise-free thanks to the exponential transform. The authors of [21,22,23,24,25] examine and summarize popular techniques for reducing speckle noise in ultrasonic images for the most part. We evaluate the different approaches via experiments, highlighting the distinctive contributions of each strategy to feature retention and denoising using quality assessments, texture analysis, and profile interpretation. Ref. [26] propose the method of computer-aided diagnostics that combines a wavelet neural network (WNN) and the grey wolf optimization (GWO) algorithm to find anomalies in breast ultrasound images [27]. The retrieved features have a substantial impact on the recognition rate of prior approaches, thus a new and improved CAD system based on a convolutional neural network (CNN) is developed to address them. It is capable of differentiating between those with normal control and those suffering from Alzheimer’s disease.

3. Problem Statement

Image quality is essential for analyzing or segmenting ultrasonic images because speckle hides small details. Recent studies have demonstrated that speckle reduction improves the expert’s visual perception while assessing ultrasound imaging of human organs. Processing ultrasonic images, which are used to offer essential diagnostic information about the human body, requires the removal of speckle noise. Speckle noise makes ultrasound images more difficult to visually analyze. The main objective of despeckling is to prevent losing tiny details or blurring the borders in ultrasonographic images. Speckle can be removed using a variety of approaches; however, noise reduction may be more difficult due to the higher threshold level. Speckle noise is a multiplicative noise, making it impossible to entirely remove it without altering the image’s boundaries and texture characteristics. This presents one of the technological obstacles in despeckling ultrasonic images. Traditional filtering methods frequently lead to a loss of resolution and fine characteristics as well, which might affect the accuracy of diagnostic data. Speckle noise has a non-Gaussian distribution and is strongly influenced by the imaging modality and tissue type, which makes it more challenging to find an ideal solution. Therefore, it is imperative to create an optimized method for speckle reduction that takes into account these particular difficulties while also maintaining image quality, resolution, and small details and edges. Additionally, quantitative metrics such as peak signal-to-noise ratio (PSNR), mean square error (MSE), structural similarity index (SSIM), and subjective visual quality assessment are frequently used to analyze the efficacy of despeckling algorithms. Therefore, when developing a despeckling algorithm for ultrasonic images, it is crucial to take both objective and subjective evaluation criteria into account.

4. Proposed Work

The ultrasound image quality is compromised by speckle, a kind of signal-dependent noise. Speckle noise has an additive impact. The diagnostic value of ultrasonic imaging is diminished as a result of this noise. Noise of this sort is an inevitable byproduct of medical ultrasound imaging. Therefore, anytime ultrasound imaging is utilized for medical imaging, speckle-noise reduction is a crucial pre-processing step. Figure 1 is a comprehensive representation of the proposed technique.

4.1. Data Source

In these experiments, we just look at two different kinds of images. Figure 2 displays one kind of phantom picture, a 200 × 200 modified Shepp–Logan created using Matlab 2013’s phantom function (a). The noise variance was set to 0.1 in order to demonstrate the addition of speckle noise to this phantom picture. The second picture was a genuine ultrasound of the belly taken with a portable scanner (a SonoStar UBox-10 Ultrasound B Scanner equipped with a transabdominal convex probe operating at 3.5 MHz). Figure 2 shows an actual view of a fetal abdomen (b). Obstacles for the next phases include the phantom picture, the ambiguous limits of the abdomen, and the existence of speckle noise. Despeckling a picture is a crucial process that has to be accomplished in a way that does not compromise the image’s essential qualities. That is why we use a two-pronged approach in this case to eliminate the speckle noise.

4.2. System Model

Let f j i be the deteriorated, noisy picture,
f j i = a j i N j i
where a j i and N j i are the multiplicative noise and the speckle-free picture pixel at position ( j , i ) . a j i must be rescued from f j i . Pixels’ coordinates in the picture space are indicated by the ( j , i ) subscripts.
The mathematical model of the speckle noise described in (2) demonstrates that the noise distribution in an ultrasound medical image is signal-dependent and multiplicative in nature, and is expressed as
J n o i s y ( a ) = J o r i g i n a l ( a ) ± ( a )
The original image is represented by J o r i g i n a l ( a ) . For each given pixel a, where an is an index, the observed picture, including noise, is denoted by J n o i s y ( a ) and ±(a) identifies a noise that is multiplicative in nature. The mathematical model is log transformed, leading to the following Equation (3):
log J n o i s y ( a ) = log ( J o r i g i n a l ( a ) ) + log ± ( a ) )
The following formula describes the standard model of speckle noise:
J n o i s y ( a ) = J o r i g i n a l ( a ) + J o r i g i n a l ( a ) H ± ( a )
where H is a constant associated with the zero-mean Gaussian distribution of the ultrasonic acquisition equipment. Setting r to 0.5 provides a decent approximation of the ultrasound data in the B-mode ultrasound picture research. When H is equal to 1, the model demonstrates that speckle noise is multiplicative.
The following equation is obtained by substituting a wavelet function into both sides of the expression.
ln f j i = ln a j i + ln N j i
The wavelet transform is often used to shift medical images from the multiplicative speckle model to the additive noise model during processing and analysis. To estimate the medical picture devoid of speckles while still accounting for the logarithmic impact, an extra exponential threshold procedure is carried out.

4.3. ISFWT-Based Pixel Coefficient Analysis

The ISFWT detailed coefficients are determined using a thresholding method. Coefficients in the approximation are not thresholded in the same manner as the detailed coefficients are because they represent ’low-frequency’ terms that often comprise essential components of the signal and are less impacted by noise. The success of a threshold-based strategy depends on two main factors. The threshold value and the threshold function used are both crucial. Input images are segmented into E K 2 × n e patches where each column represents a vectorized K K patch and n e may be thought of as the patch count. We offer a thresholding framework as an alternative to repeatedly picking low-rank patches L : ( K 2 ) 1 to estimate a scalar weight C j [ 0 , 1 ] for each patch. With the use of soft selection, the suggested method may be trained to automatically give more weight to low-rank patches. The noise variance may be computed using the estimated weights and the patches by finding the lowest singular value in the weighted covariance matrix of the patch matrix:
π 2 = 1 j = 1 n e C j π m i n
where π m i n determines the covariance matrix’s least singular value after weighting E d i a g ( C ) E D with = [ 1 , , n e ] D .
The two most popular types of thresholding are hard threshold and soft threshold schemes. The hard threshold method disregards coefficients below a threshold value D, where D is determined by the variance of the noise. This method of decision making is sometimes referred to as the “keep or kill” approach.
C ( g , o ) = C ( g , o ) if | C ( g , o ) | D 0 if | C ( g , o ) | < D
Using Equation (7) (above), we see that the soft threshold method reduces wavelet coefficients both above and below the threshold. The hard threshold produces results with harsher edges, while the soft threshold produces smoother results. A new exponential threshold is developed to deal with the drawbacks of both discontinuous and constant deviation in decision making, taking into consideration the benefits of the soft, hard, semi-soft, and Garrote threshold functions. The effectiveness of exponential threshold-based denoising is enhanced by this method. The exponential threshold function is defined mathematically as
C ( g , o ) = K N R ( C ( g , o ) ) ( | C g , o | 1 if | C ( g , o ) | D 0 if | C ( g , o ) | < D
where C ( g , o ) may be easily manipulated using a shape parameter α . Since it is simply an ordinary integer, the scales may be set any way we want, and each signal will have its own value. It is important to carefully consider each element of Equation (9) since even little adjustments can significantly affect the amount of background noise. When the function’s α value approaches 0, it becomes a soft threshold. With ‘ α ’ at infinity, the function exhibits a severe cutoff. We may adjust the following settings in this exponential thresholding technique: ‘ α ’ and D. These adjusting factors are chosen by the optimization procedure. In order to maximize both smoothing and detail retention, we use two separate goal functions.

4.4. NIMWVSO-Based Noise Removal

Optimizing using NIMWVSO helps in determining the best settings for the models (‘ α ’ and D) of the exponential threshold function.
ϑ ( g , o ) = K N R ( C ( g , o ) ) { ( | C g , o | D e x p 3 [ α ( | C g , o | D ] / D } if | C ( g , o ) | D 0 if | C ( g , o ) | < D
That is, each particle a j is constructed such that a j = ( D 11 , D 12 , . . . . . . D j i ) , where D j i is the jth particle’s ith tweak factor. Two tuning variables t, β and d, are selected for this suggested task. One such method is NIMWVS optimization, which has found usage in many different scientific and practical contexts with positive results. Here, any change in inertia weight will result in a shift in the wave particle’s position. The bigger the worth, the more accessible it is globally, yet the less feasible it is to mine locally. Results may be enhanced by using dynamic values rather than fixed ones. In this case, a more constrained radius for the search window, R s e a r c h , is convolved around a noisy p i x e l j dependent upon the found threshold. Utilizing the proposed based optimization statistics criterion, p i x e l i is similar to p i x e l j . The radii of the local and global windows are similar, O j and O i , centered at p i x e l j and p i x e l I , respectively. Similarity between p i x e l j and all non-local neighboring p i x e l I uses a fitness function that is optimized for a certain geographical area to determine its value. The starting location is determined by the density of the swarming pixels. At this stage, the degree of similarity between windows is evaluated.For each non-local window O i , an optimization-based approach is employed to determine the value of O j . Looking for nearby, comparable non-local pixels may give a fair approximation of a noise-free pixel. Edge pixels often have extremely distinct values from the surrounding pixels and serve to visually separate two parts of a picture at first. Non-local neighbors, those that are not themselves part of an edge, are used to estimate noise-free pixels since they cannot distort those edges. These distorted edges may lead to incorrect diagnosis of illness using ultrasonic data. Due to the inherent uncertainty in noisy ultrasound images, it is challenging to locate similar patches or locations beyond the immediate vicinity of the central patch, O j . To address these unknowns, tuning functions are created using an optimization-based approach. These functions incorporate the mean ratio and the variance ratio denoted as G θ and G ( τ 2 ) respectively for the patches O j and O i . These ratios are then utilized to determine the mutual resemblance grade. The similarity of the non-local window is then calculated as the sum of all of these similarities, O i . With the information we have on the error threshold ratio, we may be able to pinpoint where the mistakes are being made. For regions with a greater membership degree, the local and non-local areas resemble one another more closely, but for regions with a lower membership degree, the O i belong to a different location; therefore, despeckling throws away those pixels. The similarity mechanism is based on the trapezoidal-shaped function of Equation (11).
W ( a : Z 1 , Z 2 , Z 3 , Z 4 ) = 0 a Z 1 a z 1 z 1 Z 1 Z 1 a Z 2 1 Z 2 a Z 3 Z 4 a Z 4 Z 3 Z 3 a Z 4 0 Z 4 a
For the trapezoidal function, the input x-vector is denoted by an. The scalar factors are constants Z 1 , Z 2 , Z 3 , and Z 4 . Here, Z 1 and Z 4 denote the trapezoidal function’s bottom and top, respectively, whereas Z 2 and Z 3 denote its upper and lower bounds, respectively. The rigorous steps are used to derive these components and evaluate how similar O j and O i are as input windows. All comparable regions outside of the immediate area have now been counted. They are first restored after being smoothed using noise estimates based on optimal local statistics. Using the definition of the local linear minimum mean square error, we may generate the noise-free region w ( a ) .
J L L M M S E ( a ) = P ( J ( a ) ) + τ j 2 ( a ) τ n 2 ( a ) [ n ( a ) P ( n ( a ) ) ]
where J L L M M S E ( a ) is the estimation of noise free image J ( a ) ; τ J 2 ( a ) and τ n 2 ( a ) noise in the picture n, and the J ( a ) variance ( a ) . The expectations of the ideal picture J ( a ) and the input noisy patch n ( a ) are denoted by P ( J ( a ) ) and P ( n ( a ) ) , correspondingly. These numbers are derived in the manner specified. Here, we use local statistics to compare non-locally similar patches and calculate the restored fitness value of a noisy pixel, j. Pixels that are visually identical also have the same statistical features. Euclidean distance are used to measure the proximity of two points on a map or at two different locations. The estimated noise level tends to cluster around low numbers rather than high ones. Zero-mean Gaussian distribution ( θ = 0 ) and an estimated noise variance ( τ 2 ) are used to identify extra-regional participation O i :
weight ( τ j i τ , θ ) = p ( t j i θ ) 2 2 τ 2
Euclidean distance t j i among the local region ‘j’ and non-local region ‘i’ is given by
t j i = O j O i
The central pixel of patch O j has the value calculated by adding the values of all neighboring pixels that are not included in the local region. The predicted noise-free value is pixel j as a consequence of the fuzzy centroid technique employed in the defuzzification step, and this is written as
p i x e l l = 1.0 g = 1 N w e i g h t g g = 1 N ( p i x e l g X w e i g h t g )
The value of p i x e l j estimates the restored pixel’s value, where N is the number of non-locally comparable regions and local regions with similar values. p i x e l g is the value of the central pixel of window O g , and w e i g h t g corresponds to the importance placed on the pixel with the highest degree of similarity as calculated by Equation (15).
“Case 1—Full Reference (FR) Measure”
Reference objective functions for the whole process include the peak-to-noise ratio (PSNR) and the mean structural similarity index metric (MSSSIM). Together, optimizing for these two aims produces a more distinct image overall while keeping the reaction smooth in otherwise similar regions. As the peak signal-to-noise ratio rises, so does the quality of the image following speckle reduction.
P S N R ( J D , J G ) = 10 log 10 [ ( J G ) p e a k 2 M S E ]
M S E ( J D , J G ) = 1 V n j = 1 V i = 1 n ( J g ( j , i ) J T ( j , i ) ) 2
A further complete reference measure that places an emphasis on edge-preserving abilities is the mean structural similarity index. Two images’ degree of resemblance is quantified using the structural similarity index metric (SSIM). The MSSIM index may be between 0 and 1, with 1 indicating excellent edge preservation. A demonstration of MSSIM’s calculation is shown below.
M S S I M ( J T , J G ) = 1 V e = 0 V 1 S S I M ( J T , J G )
S S I M ( J T , J G ) = ( 2 θ j t θ I G + Z 1 ) ( 2 π j T I G + Z 2 ) ( θ J T 2 + θ J G 2 + Z 2 ) ( π J T 2 + π J G 2 + Z 2 )
where V is the number of the image’s local windows, J T and J G are the filtered and ground truth counterparts, and Z 1 and Z 2 are constants. The terms θ and π parallel the average and the deviation. The best solution is obtained by maximizing the objective functions I ( J ) (such as PSNR and MSSIM), as shown in Equation (20)
J = a r g ( m a x ( I ( J ) ) )
“Case 2—No Reference (NR) Measure”
The alpha–beta measure, which is derived from the ratio of the edge estimator and the despeckling evaluation index, is one example of a non-reference metric that may be used in MOPSO-tuned medical image despeckling (DEI). The estimator is then used to evaluate the filter’s noise-reduction capability, and the DEI of the Edge Around Region is then used to assess the filter’s edge-preserving abilities in this situation (EAR). Estimator examples include
β γ γ = β | τ E N L | + ( 1 β ) | τ θ | + γ
γ = j = 1 S ( ( J u ) n o i s y ( J u ) n o i s y ) ( ( J u ) r a t i o ( J u ) r a t i o ) j = 1 S ( ( J u ) n o i s y ( J u ) n o i s y ) 2 j = 1 S ( ( J u ) r a t i o ( J u ) r a t i o ) 2
where J u is the high-pass filtered image, J u is the average of the filtered image, τ E N L . The mean of the ratio image is the Equivalent Number of Looks (ENL), which is calculated by subtracting the noisy picture from the ratio image. Typically, the estimator’s values are between zero and one. A filter’s ability to preserve edges is measured using the despeckling evaluation index (DEI), calculated by dividing the standard deviation of a narrower neighborhood window by that of a broader one. The DEI value must be negative. If the data in the window has a bigger standard deviation, there will be more edges. So, a lower DEI is associated with better edge preservation ability.
D E I = 1 V n a , b m i n ( s t d ( C e , U v ) s t d ( C a , b N )
To improve edge maintenance and eliminate noise, the goal function here should have small values. Therefore, it is necessary to minimize the objective function, as shown in Equation (24).
j = a r g ( m i n ( I ( J ) ) )
Finally, the noises in the images are despeckled precisely.

5. Performance Analysis

The effectiveness of the approach that was recommended is analyzed in this section. Python was used as the operating system for the whole of the experiment. In order to show that the suggested network is superior to other conventional and well-known despeckling algorithms in terms of performance, the proposed network was compared with these other methods. Both actual ultrasounds and phantom images were used in the conducted experiments.
Figure 3 shows the denoised output of the Shepp–Logan phantom which was built as a reference standard for use in evaluating the accuracy of head CT image reconstruction simulations. The ISFWT-NIMWVSO technique was used to denoise this phantom, as seen in the picture. Subsequently, the real-time fetal image was processed to remove noise, as seen in Figure 3 and the comparison of the input sample and noise amplitude shown in Figure 4.
In addition to this, we evaluated the estimate technique by applying it to phantom and fetal ultrasound images that had varying amounts of noise, and the results are shown in Table 1. We can observe that the suggested estimation technique has errors that are within acceptable ranges, since the estimated noise levels are somewhat higher than the actual low noise levels but slightly lower than the actual medium- and high-level estimates.

Image Quality Evaluation Metrics

A novel algorithm for reducing speckle was recently shown. Several methods have been utilized to evaluate the efficiency of the proposed algorithm vs. the existing filters. Two common approaches to comparing results are quantitative assessments of image quality and qualitative evaluation, the latter of which is commonly carried out by the authors themselves. Significant effort has been made in recent years to establish objective metrics of image quality that correlate with assessments of how the quality is perceived. In order to evaluate filtering in relation to a speckle-free ideal reference, we use clinical and phantom images in addition to simulated ultrasonography as test data. However, it is difficult to tell how much enhancement was performed on an ultrasound image, and there is no universal way for doing so (Wang 2011). Quality evaluation metrics such as average difference (AD), Pratt’s figure of merit (FOM), root mean square error (RMSE), signal-to-noise ratio (SNR), peak signal-to-noise ratio (PSNR), maximum difference (MD), normalized absolute error (NAE), normalized cross-correlation (NK), structural content (SC), coefficient of correlation (CoC), universal quality index (UQI), and quality index (QI) were applied to the final images in this study (MSSIM). In addition to serving as an index, the final metric incorporates a visibility error map, which allows for the examination of areas in the distorted image where deviations occur between the original and distorted versions. Furthermore, we introduce a novel evaluation measure called the Speckle Reduction Score, which assesses the degree of improvement achieved. This new measure (SRS) mixes the edge preservation evaluation with a local similarity map.
  • Signal-to-noise ratio (SNR): A common method for determining how well coherent imaging suppresses noise when that noise is multiplicative. This is achieved by comparing the intensity of the desired signal to that of the surrounding noise.
  • Root mean square error (RMSE): This is calculated by squaring the intensity value difference between the original and denoised images and then dividing that number by the image’s size to obtain the root average.
  • Peak signal-to-noise ratio (PSNR): This provides the image quality as a ratio of the original signal power to the signal power after denoising. A higher PSNR number indicates a better quality image.
  • Pratt’s figure of merit (FOM) (Pratt 2007): In particular, this assesses how effectively an image retains its borders. The method used to generate a binary edge map has a significant impact on the FOM; higher PSNR values suggest better image quality. The Canny edge detector, which optimizes the FOM, is used for all of the speckle-reduction methods so that the results may be fairly compared. The FOM may take on any value between 0 and 1, with 1 representing optimal edge preservation.
  • Normalized cross-correlation (NK): Its value (as a correlation-based measure of picture quality) is 1 for pairs of identical images.
  • Average difference (AD): The average noise reduction is determined by comparing the original and denoised versions of a single pixel.
  • Maximum difference (MD): Image denoising to the greatest possible degree.
  • Normalized absolute error (NAE): This is a measurement of how effectively an image can predict its own mistakes.
  • Coefficient of correlation (CoC): illustrates the linear relationship between the original and denoised photos and the direction in which that relationship runs.
  • Quality index based on local variance (QILV) (Aja-Fernandez 2006): This theory relies on the observation that the local variance distribution of a picture encodes a great deal of the image’s structural information.
  • Universal quality index (UQI) (Wang 2002): This is built on the idea that every distorted picture has three parts: a lack of correlation, distorted brightness, and distorted contrast.
  • Laplacian mean square error (LMSE): Local contrast is an essential aspect of picture quality. Laplacian mean square error is the standard method for assessing picture local contrast.
  • Mean structural similarity index map (MSSIM): We may use MSSIM to compare the lighting, contrast, and structure of two photos to see how closely they are alike (Wang, 2004). It may be used to discover comparable images for comparative purposes.
  • Speckle Reduction Score (SRS): Several experiments have shown the usefulness of the MSSIM index, although there may be cases when the resulting quality measure does not agree with a subjective assessment based on visual data. A novel metric, the Speckle Reduction Score (SRS), is proposed and its computation is decomposed into two stages. The first stage is to determine the local similarity map, and the second is to combine the results from each map into a single value.
Table 2 synthesizes the results of applying the improved speckle filter algorithm to the simulated picture by calculating a number of performance measures. Each metric’s optimal value is shown in bold. Figure 5 depicts performance analysis of the suggested mechanism.
Table 3 and Figure 6 compile the findings from several quality assessment techniques. Across the board, ISFWT-NIMWVSO filtering performs better than its competitors. As far as FOM is concerned, the suggested technique provides for more fulfilling results than do existing alternatives, enabling it to maintain its edge. Using the MSSIM, we can see that the suggested speckle filtering would maintain an appearance that is in line with how humans see things. The root mean squared error shows that the thresholding method employed in the multiresolution wavelet-based technique may keep the average error low all the way through the restoration procedure. By using optimization in place of a filter and a thresholding wavelet, our proposed method delivers the highest quantitative results. When the recommended method is implemented, the MSSIM index value dramatically rises. Thus, the proposed method yields an image that is very structurally similar to the standard. Since it is based on Pratt’s FOM, this method is more advantageous. So, this demonstrates that the method may continue to evolve and improve. The suggested method outperforms the current one since it increases the values of Pratt’s FOM, PSNR, and RMSE. The greatest noise reduction and edge retention is shown in Figure 6, thanks to the recommended method. The result of performance evaluation of the suggested mechanism is shown in Figure 7 and Table 4 compile the findings of performance metrics from existing and proposed method.
As shown by the result obtained, the suggested methodology outperforms other existing speckle filter methodologies in use.

6. Conclusions

In this study, we compare and contrast several widely used algorithms and methods for speckle-noise reduction from medical ultrasound images. A revised set of metrics for evaluating despeckling performance is provided. Research evaluating various methods of noise suppression in ultrasound images employed both the fetal image and a noise-free synthetic image of a phantom. The image was manipulated using Field II to add the typical noise seen in ultrasound images. Finally, we showed the proposed speckle smoothing algorithms in action by comparing them to the noise-free image. This study compiles an inventory of strategies for diminishing speckle, all of which are evaluated using qualitative metrics. Experimental findings on both simulated and clinical ultrasound pictures show quantitatively that the proposed method is better in terms of PSNR, SSIM, SRS, and coefficient of correlation. From what can be seen, the proposed approach outperforms the previous despeckling techniques in terms of reducing speckle noise and preserving clarity. In the future, we want to apply the proposed method to denoising other kinds of medical imaging, such as CT, MR, and PET scans, and to use deep learning to estimate the amount of speckle noise present in actual ultrasound images.

Author Contributions

Conceptualization, A.A. and R.A.; Methodology, P.M.; Software, M.A. and I.K.; Validation, A.A. and K.R.; Formal analysis, P.M., A.M.B. and I.K.; Investigation, R.A.; Resources, M.A.; Writing—original draft, A.M.B.; Writing—review and editing, B.N.; Supervision, A.M.B. and K.R.; Project administration, K.R. All authors have read and agreed to the published version of the manuscript.

Funding

The Research Paper received funding from Deanship of Scientific Research, Taif University.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The phantom picture used in our study, a modified Shepp-Logan image of size 200 × 200 was created using Matlab phantom function from the year 2013. The specific details and parameters of this modified Shepp-Logan phantom picture are available upon request.

Acknowledgments

The researchers would like to acknowledge Deanship of Scientific Research, Taif University for funding this work.

Conflicts of Interest

The Authors declare no conflict of interest regarding the publication of this research paper.

References

  1. Shabana Sulthana, S.L.; Sucharitha, M. Kinetic Gas Molecule Optimization (KGMO)-Based Speckle Noise Reduction in Ultrasound Images. Soft Comput. Signal Process. 2022, 10, 447–455. [Google Scholar]
  2. Karaoğlu, O.; Bilge, H.Ş.; Uluer, İ. Removal of speckle noises from ultrasound images using five different deep learning networks. EST 2022, 29, 101030. [Google Scholar] [CrossRef]
  3. Shereena, V.B.; Raju, G. Modified non-local means model for speckle noise reduction in ultrasound images. Congr. Intell. Syst. 2022, 10, 691–707. [Google Scholar]
  4. Jayasingh, R.; RJS, J.K.; Telagathoti, D.B.; Sagayam, K.M.; Pramanik, S.; Jena, O.P.; Bandyopadhyay, S.K. Speckle noise removal by SORAMA segmentation in Digital Image Processing to facilitate precise robotic surgery. Int. J. Reliab. Qual. E-Healthc. 2022, 11, 1–19. [Google Scholar]
  5. Zeng, L.; Huang, M.; Li, Y.; Chen, Q.; Dai, H.N. Progressive Feature Fusion Attention Dense Network for Speckle Noise Removal in OCT Images. IEEE/ACM Trans. Comput. Biol. Bioinform. 2022, 10, 447–455. [Google Scholar] [CrossRef] [PubMed]
  6. Bhonsle, D.; Rizvi, T.; Mishra, S.; Sinha, G.R.; Kumar, A.; Jain, V.K. Reduction of Ultrasound Images using Combined Bilateral Filter & Median Modified Wiener Filter. In Proceedings of the 2022 Second International Conference on Advances in Electrical, Computing, Communication and Sustainable Technologies, Bhilai, India, 21–22 April 2022; pp. 1–5. [Google Scholar]
  7. Tătăranu, E.L.E.N.A.; Diaconescu, S.; Ivănescu, C.G.; Sarbu, I.; Stamatin, M. Clinical, immunological and pathological profile of infants suffering from cow’s milk protein allergy. Rom. J. Morphol. Embryol. Rev. Roum. Morphol. Embryol. 2016, 57, 1031–1035. [Google Scholar]
  8. Lather, M.; Singh, P. Contrast Enhancement and Noise Removal from Medical Images Using a Hybrid Technique. In New Approaches for Multidimensional Signal Processing: Proceedings of International Workshop, NAMSP 2021; Springer: Berlin/Heidelberg, Germany, 2022; Volume 10, pp. 223–232. [Google Scholar]
  9. Pradeep, S.; Nirmaladevi, P. A review on speckle noise reduction techniques in ultrasound medical images based on spatial domain, transform domain and CNN methods. In IOP Conference Series: Materials Science and Engineering; IOP Publishing: Bristol, UK, 2021; Volume 10, p. 012116. [Google Scholar]
  10. Joshi, K.; Memoria, M.; Singh, L.; Verma, P.; Barthwal, A. Multi-Modality Medical Image Fusion Using SWT & Speckle Noise Reduction with Bidirectional Exact Pattern Matching Algorithm. In Disruptive Technologies for Society 5.0; CRC Press: Boca Raton, FL, USA, 2021; Volume 10, pp. 339–359. [Google Scholar]
  11. Nadeem, M.; Hussain, A.; Munir, A. Fuzzy logic based computational model for speckle noise removal in ultrasound images. Multimed. Tools Appl. 2019, 78, 18531–18548. [Google Scholar] [CrossRef]
  12. Hermawati, F.A.; Tjandrasa, H.; Suciati, N. Hybrid Speckle Noise Reduction Method for Abdominal Circumference Segmentation of Fetal Ultrasound Images. Int. J. Electr. Comput. Eng. 2018, 8, 2088–8708. [Google Scholar]
  13. Ciongradi, C.I.; Sârbu, I.; Iliescu Halițchi, C.O.; Benchia, D.; Sârbu, K. Fertility of Cryptorchid Testis—An Unsolved Mistery. Genes 2021, 12, 1894. [Google Scholar] [CrossRef]
  14. Ciongradi, C.I.; Filip, F.; Sârbu, I.; Iliescu Halițchi, C.O.; Munteanu, V.; Candussi, I.L. The Impact of Water and Other Fluids on Pediatric Nephrolithiasis. Nutrients 2022, 14, 4161. [Google Scholar] [CrossRef]
  15. Duarte-Salazar, C.A.; Castro-Ospina, A.E.; Becerra, M.A.; Delgado-Trejos, E. Speckle noise reduction in ultrasound images for improving the metrological evaluation of biomedical applications: An overview. IEEE Access 2020, 8, 15983–15999. [Google Scholar] [CrossRef]
  16. Sui, X.; Ishikawa, H.; Selesnick, I.W.; Wollstein, G.; Schuman, J.S. Speckle noise reduction in OCT and projection images using hybrid wavelet thresholding. In Proceedings of the 2018 IEEE Signal Processing in Medicine and Biology Symposium, Philadelphia, PA, USA, 1 December 2018; pp. 1–6. [Google Scholar]
  17. SL, S.S. Bayesian Framework-Based Adaptive Hybrid Filtering for Speckle Noise Reduction in Ultrasound Images Via Lion Plus FireFly Algorithm. J. Digit. Imaging 2021, 34, 1463–1477. [Google Scholar]
  18. Ciongradi, C.I.; Benchia, D.; Stupu, C.A.; Iliescu Halițchi, C.O.; Sârbu, I. Quality of Life in Pediatric Patients with Continent Urinary Diversion-A Single Center Experience. Int. J. Environ. Res. Public Health 2022, 19, 9628. [Google Scholar] [CrossRef] [PubMed]
  19. Castaneda, R.; Garcia-Sucerquia, J.; Doblas, A. Speckle noise reduction in coherent imaging systems via hybrid median–mean filter. Opt. Eng. 2021, 60, 123107. [Google Scholar] [CrossRef]
  20. Choi, H.; Jeong, J. Speckle noise reduction in ultrasound images using SRAD and guided filter. In Proceedings of the 2018 International Workshop on Advanced Image Technology, Chiang Mai, Thailand, 7–9 January 2018; Volume 60, pp. 1–4. [Google Scholar]
  21. Rosa, R. Performance analysis of speckle ultrasound image filtering. Comput. Methods Biomech. Biomed. Eng. Imaging Vis. 2016, 4, 193–201. [Google Scholar] [CrossRef]
  22. Ramesh, T.R.; Lilhore, U.K.; Poongodi, M.; Simaiya, S.; Kaur, A.; Hamdi, M. Predictive Analysis of Heart Disease with Machine learning Approaches. Malays. J. Comput. Sci. 2022, 132–148. [Google Scholar] [CrossRef]
  23. Lilhore, U.K.; Poongodi, M.; Kaur, A.; Simaiya, S.; Algarni, A.D.; Elmannai, H.; Vijayakumar, V.; Tunze, G.B.; Hamdi, M. Hybrid Model for Detection of Cervical Cancer Using Causal Analysis and Machine Learning Techniques. Comput. Math. Methods Med. 2022, 2022, 4688327. [Google Scholar] [CrossRef]
  24. Popa, Ș.; Apostol, D.; Bîcă, O.; Benchia, D.; Sârbu, I.; Ciongradi, C.I. Prenatally Diagnosed Infantile Myofibroma of Sartorius Muscle-A Differential for Soft Tissue Masses in Early Infancy. Diagnostics 2021, 11, 2389. [Google Scholar] [CrossRef] [PubMed]
  25. Poongodi, M.; Hamdi, M.; Malviya, M.; Sharma, A.; Dhiman, G.; Vimal, S. Diagnosis and combating COVID-19 using wearable Oura smart ring with deep learning methods. Pers. Ubiquitous Comput. 2022, 26, 25–35. [Google Scholar] [CrossRef]
  26. Ahila, A.; Poongodi, M.; Hamdi, M.; Bourouis, S.; Rastislav, K.; Mohmed, F. Evaluation of Neuro Images for the Diagnosis of Alzheimer’s Disease Using Deep Learning Neural Network. Front. Public Health 2022, 10, 834032. [Google Scholar] [CrossRef]
  27. Bourouis, S.; Band, S.S.; Mosavi, A.; Agrawal, S.; Hamdi, M. Meta-heuristic algorithm-tuned neural network for breast cancer diagnosis using ultrasound images. Front. Oncol. 2022, 12, 834028. [Google Scholar]
Figure 1. Schematic representation of the suggested methodology.
Figure 1. Schematic representation of the suggested methodology.
Diagnostics 13 02919 g001
Figure 2. Sample input.
Figure 2. Sample input.
Diagnostics 13 02919 g002
Figure 3. Denoised output.
Figure 3. Denoised output.
Diagnostics 13 02919 g003
Figure 4. Image sample vs. noise amplitude.
Figure 4. Image sample vs. noise amplitude.
Diagnostics 13 02919 g004
Figure 5. Performance analysis of the suggested mechanism.
Figure 5. Performance analysis of the suggested mechanism.
Diagnostics 13 02919 g005
Figure 6. Performance evaluation.
Figure 6. Performance evaluation.
Diagnostics 13 02919 g006
Figure 7. Performance evaluation.
Figure 7. Performance evaluation.
Diagnostics 13 02919 g007
Table 1. Estimate Technique.
Table 1. Estimate Technique.
Read Noise LevelsMean of Estimated Noise LevelMean Estimated Error
0.10.090.01
0.20.180.02
0.30.30
0.40.40
0.50.50
Table 2. Comparative Performance Analysis.
Table 2. Comparative Performance Analysis.
MethodRMSEPSNRMSSIMPratt’s FOM
Lee Filter [12]30210.78386
Frost Filter [12]23240.8893
Shock Filter [12]17270.87758
Bilateral Filter [12]12300.88253
AD [12]13290.7865
SRAD [12]32210.75782
DWT [12]16270.70137
MBF [12]16270.86178
Thresholding Technique and the Anisotropic Diffusion Method [12]13290.90393
Proposed Method10130.230
Table 3. Proposed vs. existing comparative analysis.
Table 3. Proposed vs. existing comparative analysis.
MetricsRMSESNRPSNRLMSEMDADNK
Median [21]34.4611.817.383.6113922.370.79
Lee [21]33.2812.0317.7427.4312122.310.79
Frost [21]33.3712.0317.6643.3212022.080.8
Kuan [21]34.0611.8617.492.6512121.820.79
Wiener [21]34.1211.8517.472.5312821.840.79
Fourier [21]34.9611.6517.2615.5713821.510.79
Butterworth [21]34.2911.817.4314.7613121.430.79
Bilateral [21]33.4212.0217.6547.212222.250.8
ISFWT-NIMWVSO (proposed)10111310114100.5
Table 4. Proposed vs. existing comparative analysis.
Table 4. Proposed vs. existing comparative analysis.
MetricsCoCNAEUQIQILVFOMSCMSSIMSRS
Median [21]0.760.290.150.740.441.450.471.68
Lee [21]0.760.320.170.730.361.470.5314.54
Frost [21]0.790.290.160.750.481.420.5323.09
Kuan [21]0.760.290.140.750.381.430.441.17
Wiener [21]0.760.290.150.750.331.430.471.18
Fourier [21]0.740.30.140.730.451.440.426.47
Butterworth [21]0.750.290.150.740.451.430.456.69
Bilateral [21]0.790.290.170.750.551.430.5425.38
ISFWT-NIMWVSO (proposed)0.50.10.10.50.31.20.25
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Amarnath, A.; Manoharan, P.; Natarajan, B.; Alroobaea, R.; Alsafyani, M.; Baqasah, A.M.; Keshta, I.; Raahemifar, K. Medical Image Despeckling Using the Invertible Sparse Fuzzy Wavelet Transform with Nature-Inspired Minibatch Water Wave Swarm Optimization. Diagnostics 2023, 13, 2919. https://doi.org/10.3390/diagnostics13182919

AMA Style

Amarnath A, Manoharan P, Natarajan B, Alroobaea R, Alsafyani M, Baqasah AM, Keshta I, Raahemifar K. Medical Image Despeckling Using the Invertible Sparse Fuzzy Wavelet Transform with Nature-Inspired Minibatch Water Wave Swarm Optimization. Diagnostics. 2023; 13(18):2919. https://doi.org/10.3390/diagnostics13182919

Chicago/Turabian Style

Amarnath, Ahila, Poongodi Manoharan, Buvaneswari Natarajan, Roobaea Alroobaea, Majed Alsafyani, Abdullah M. Baqasah, Ismail Keshta, and Kaamran Raahemifar. 2023. "Medical Image Despeckling Using the Invertible Sparse Fuzzy Wavelet Transform with Nature-Inspired Minibatch Water Wave Swarm Optimization" Diagnostics 13, no. 18: 2919. https://doi.org/10.3390/diagnostics13182919

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop