Next Article in Journal
TimeREISE: Time Series Randomized Evolving Input Sample Explanation
Previous Article in Journal
Design and Analysis of a 6-DOF Magnetic Suspension Platform with an Improved Permanent Magnetic Array
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

X-ray Image Enhancement Based on Nonsubsampled Shearlet Transform and Gradient Domain Guided Filtering

1
School of Mechanical Engineering, Hebei University of Technology, Tianjin 300131, China
2
Department of Mechanical Engineering, Zhonghuan Information College Tianjin University of Technology, Tianjin 300380, China
*
Author to whom correspondence should be addressed.
Sensors 2022, 22(11), 4074; https://doi.org/10.3390/s22114074
Submission received: 22 April 2022 / Revised: 16 May 2022 / Accepted: 25 May 2022 / Published: 27 May 2022
(This article belongs to the Section Sensing and Imaging)

Abstract

:
In this paper, we propose an image enhancement algorithm combining non-subsampled shearlet transform and gradient-domain guided filtering to address the problems of low resolution, noise amplification, missing details, and weak edge gradient retention in the X-ray image enhancement process. First, we decompose histogram equalization and nonsubsampled shearlet transform to the original image. We get a low-frequency sub-band and several high-frequency sub-bands. Adaptive gamma correction with weighting distribution is used for the low-frequency sub-band to highlight image contour information and improve the overall contrast of the image. The gradient-domain guided filtering is conducted for the high-frequency sub-bands to suppress image noise and highlight detail and edge information. Finally, we reconstruct all the effectively processed sub-bands by the inverse non-subsampled shearlet transform and obtain the final enhanced image. The experimental results show that the proposed algorithm has good results in X-ray image enhancement, and its objective index also has evident advantages over some classical algorithms.

1. Introduction

X-ray image has become widely employed in medical diagnosis, security inspection, aerospace, defect detection, machinery manufacture, and other industries since the development of photoelectric detecting technology and image analysis technology. The radiographic inspection system’s detecting principle, the image of the hardware equipment, and the picture created by the X-ray instrument all suffer from low dynamic range, low definition, low contrast, and excessive noise. Defect detection and image analysis are performed directly on the collected image. It causes significant inaccuracy in the detection results. As a result, it is beneficial to use image enhancement algorithms to analyze X-ray images [1,2], increase image quality and visual effects, and make subsequent detection easier.
Spatial domain pixel enhancement and transform domain multi-scale coefficient improvement enhancement methods are the most common image enhancement algorithms. The spatial domain improvement is to improve the image by directly processing the pixels, such as histogram equalization [3,4,5], image sharpening and grayscale stretching [6,7,8], and retinex theory [9]. Zeng et al. [10] proposed a gray-level information histogram for X-ray image contrast enhancement, which improves the performance of many histogram-based enhancement techniques dramatically. However, when the image is enhanced, there will be an over-enhancement phenomenon that will cause the image to be distorted. Panetta et al. [11] introduced nonlinear unsharp masking for mammogram enhancement. This method has good performance for enhancing the fine details in the original images. However, it also amplifies noise and overshoots the sharp details at the same time. Tao et al. [12] introduced a retinex-based framework for medical X-ray image enhancement. The framework can increase the contrast, eliminate the noise, and enhance the details, but the contour edges of the image are affected by the dark area pixels in the original image, showing shadows that did not exist at all.
The enhancement based on the transform domain first transforms the original image into the frequency domain for multi-scale decomposition, amplifies or filters the decomposed sub-image, and then inversely transforms the image. The wavelet transform [13], ridgelet transform [14], curvelet transform [15], wedgelet transform [16], contourlet transform [17], nonsubsampled contourlet transform(NSCT) [18,19], shearlet transform [20,21], nonsubsampled shearlet transform (NSST) [22], and other transformations are commonly used. Tang et al. [23] proposed an algorithm based on a multiscale measure in the wavelet domain for screening mammograms to enhance the details at different scales. However, the wavelet transform can only capture information in three directions: horizontal, vertical, and diagonal, which is poor in representing anisotropic singular features in images. Ostojié et al. [24] proposed an intensity adaptive nonlinear multiscale detail and contrast enhancement algorithm for digital radiography. The method adapts to the local exposure level and thus reduces the artifacts’ saliency, but the adaptation of detail enhancement to image pixel intensity needs to be strengthened. Zhou et al. [25] introduced a medical image enhancement method based on improved gamma correction in the shearlet domain, which makes the texture details of the image more prominent and the overall contrast is significantly improved. Nevertheless, since this method does not have translation invariance, the image will produce a pseudo-Gibbs phenomenon.
Because of the unconstrained shearing directions, images after NSST may achieve optimal sparse representation and nonlinear error approximation. There have been many achievements in applying the NSST to image enhancement. Zhang et al. [26] employed NSST and tetrolet transform to remote sensing images, effectively retaining the details and edges of the image and significantly improving the information entropy and mean; Li et al. [27] studied the NSST domain to improve blur. The contrast enhancement algorithm uses the remote sensing image enhancement coefficient as an adjustable pattern recognition task, effectively removing the pseudo-Gibbs phenomenon from the image during the enhancement process. Tong et al. [28] proposed a visual sensor image enhancement algorithm using NSST and phase stretching transformation. In this method, the author uses nonlinear models with different thresholds to process the different scale parts after NSST decomposition. The algorithm can suppress noise and effectively increase the contrast of the image. However, none of the above studies have analyzed the parameters and effects of the decomposition levels and shearing directions of NSST, and the parameter selection has a certain degree of randomness.
He et al. [29] proposed a linear edge-preserving guided image filtering algorithm. The filtered image can avoid a blurring effect on detailed information. Li et al. [30] introduced a weighted guided image filter by incorporating an edge-aware weighting into an existing guided image filter to address the problem of abiding by halo artifacts. Kou et al. [31] proposed gradient-domain guided filtering to reduce the effect of image edge smoothing and introduced first-order edge-aware constraints to processing images, which can better preserve image edges. However, using intensity domain constraints for edges and details can over-smooth edges and reduce edge retention.
To address the above issues, we propose an image enhancement method. It is based on NSST and gradient-domain guided filtering and applies it to X-ray images. The algorithm combines the advantages of NSST for sparse image representation with gradient-domain guided filtering for image detail enhancement. The low-frequency sub-band uses adaptive gamma correction with a weighted distribution to enhance contrast, highlighting tiny details in the background. The high-frequency sub-bands use gradient-domain guided filtering to filter out image noise and extract edge and texture information by analyzing the image quality of the four-levels direction decomposition under different scale decomposition levels, and the image quality of various direction decomposition sequences under the four-levels scale decomposition. We compare the running times of different decompositions and obtain optimal NSST decomposition parameters. The enhancement experiments on medical and industrial X-ray images show that the proposed algorithm can enhance the image contrast, details, and texture information and obtain high-quality images for subsequent research and analysis.

2. Related Works

2.1. Nonsubsampled Shearlet Transform

The nonsubsampled shearlet transform is extended based on the shearlet transform. The shearlet transform is an algorithm that combines synthetic dilated affine systems with multiscale analysis. It can decompose the image more sparsely and achieve optimal approximation. Its construction is simple and anisotropic, and in dimension n = 2 , the affine systems with composite dilations are collections of the form:
Λ A B ( ψ ) = { ψ j , l , k ( x ) = | det A | j / 2 ψ ( B l A j x k ) : j , l , k 2 }
A = ( a 0 0 a ) ,   B = ( 1 s 0 1 )
Among them, ψ L 2 ( 2 ) represents the basis function, A is a 2-dimensional invertible matrix of anisotropic expansion, which is related to scale transformation. B is a 2-dimensional shear invertible matrix, related to rotation or shear transformation, and | det B | = 1 , j , l , k represents the scale parameter, shearing parameter, and translation parameter. If the system Λ A B ( ψ ) forms a Parseval frame (also called a tight frame) for L 2 ( 2 ) , then ψ in the system is called a synthetic wavelet, and the following formula holds for all f L 2 ( 2 ) :
j , l , k | f , ψ j , l , k | 2 = f 2
This synthetic wavelet is called a shear wave when a = 4 , s = 1 . As shown in Figure 1, the three-levels NSST decomposition structure diagram, in which the scale parameter j = 3 and the numbers of the shearing parameters of each level are set to [2,3,4] respectively, then the corresponding shearing directions of each level are [4,8,16].

2.2. Adaptive Gamma Correction with Weighted Distribution

Gamma correction can expand the bright part in the X-ray image to make the image contrast more obvious, and the simple form of the transform-based gamma correction is derived by
T ( v ) = v max ( v / v max ) γ
where v is the grayscale of the input image and v max is the maximum intensity of the input image, and γ is the varying adaptive parameter.
Define the probability density function of each gray level in the image as p d f approximated by
p d f ( v ) = n v / ( M N )
where n v is the number of pixels whose gray level is v , M N is the total number of image pixels, and its cumulative distribution function c d f is defined as
c d f ( v ) = k = 0 v p d f ( v )
The weighted distribution function is defined as
p d f ω ( v ) = p d f max ( p d f ( v ) p d f min p d f max p d f min ) α
Adjust the histogram of statistics with a weighted distribution function, where α is the adjustment parameter, p d f max is the maximum p d f of the statistical histogram, and p d f min is the minimum of the statistical histogram. Applying c d f ( v ) and p d f ω ( v ) to the normalized gamma function, the formula of adaptive gamma correction with weighting distribution (AGCWD) [32] is obtained as
T ( v ) = v max ( v / v max ) γ A
where
γ A = 1 v = 0 v max p d f ω ( v ) / Σ p d f ω
with
Σ p d f ω = v = 0 v max p d f ω ( v )
Since most of the pixels of the X-ray image are densely distributed in the low grayscale area, the AGCWD algorithm can gradually increase the low pixel intensity of the image based on the weight distribution function, smooth the fluctuation phenomenon, and thus reduce the excessive enhancement of the image by gamma correction.

2.3. Gradient Domain Guided Filtering

The output of any pixel in the filtered image can be expressed as the following linear model:
Z ( p ) = a p G ( p ) + b p , p Ω ς 1 ( p )
Among them, Z ( p ) is the output image, G ( p ) is the guide image, Ω ς 1 ( p ) is a local square window with the point p as the center and ς 1 as the radius in the guide image G ( p ) , a p and b p are the constant term coefficients in the window Ω ς 1 ( p ) . To compute a p and b p , we define E ( a p , b p ) (hereafter abbreviated as E ) as the noise-dependent loss function within the window Ω ς 1 ( p ) as follows:
E = p Ω ς 1 ( p ) [ ( a p G ( p ) + b p X ( p ) ) 2 + λ Γ G ( p ) ( a p γ p ) 2 ]
Among them, X ( p ) is the image to be filtered, λ is the regularization parameter to prevent a p from being too large, and Γ G ( p ) is the edge perception weight, which is defined as follows:
Γ G ( p ) = 1 N p = 1 N χ ( p ) + ε χ ( p ) + ε
χ ( p ) = σ G , 1 ( p ) × σ G , ς 1 ( p )
where σ G , 1 ( p ) and σ G , ς 1 ( p ) represent the standard deviation within the window 3 × 3 and within the window ( 2 ς + 1 ) × ( 2 ς + 1 ) , centered on the point p . ε defined as ( 0.001 × L ) 2 , L is the dynamic range of the input image. γ p is the edge image factor, defined as follows:
γ p = 1 1 1 + e η ( χ ( p ) μ χ , )
where μ χ , is the mean of χ ( p ) , and η is calculated as 4 / ( μ χ , min ( χ ( p ) ) ) . It can be known from formula (15) that if the pixel p is in the smooth area of the image, the value of γ p is close to 0, and if it is at the edge of the image, the value of γ p is close to 1.
To minimize the noise of the filtered image, take the minimum value of E , and the linear regression is used to solve the formula (12) to obtain
a p = μ G X , ς 1 ( p ) μ G , ς 1 ( p ) μ X , ς 1 ( p ) + λ Γ G ( p ) γ p σ G , ς 1 2 ( p ) + λ Γ G ( p )
b p = μ X , ς 1 ( p ) a p μ G , ς 1 ( p )
where is the dot product between the two matrices, μ G X , ς 1 ( p ) , μ G , ς 1 ( p ) and μ X , ς 1 ( p ) are the mean values of G X , G , and X . Bringing formulas (16) and (17) into formula (11), the final calculation formula of Z ( p ) is simplified as
Z ( p ) = a p G ( p ) + b p
where a p and b p are the mean values of a p and b p in the window Ω ς 1 ( p ) .
Gradient-domain guided filtering preserves its detailed features while smoothing the image. To further enhance the edge and texture information of the image, the smoothed image is subtracted from the original image to obtain a different image, which is added to the smoothed image to obtain an enhanced one, and the specific formula is as follows
G e n h a n c e d = Z ( p ) + ξ ( X ( p ) Z ( p ) )
where ξ is the scale coefficient of the differential gain effect of the image gradient-domain guided filtering.

3. Implementation of the Algorithm

3.1. Algorithm Implementation Steps

The flow of the enhancement algorithm is shown in Figure 2. The high-frequency sub-bands of the image contain noise, and as the decomposition scale increases, they become almost invisible. We use gradient-domain guided filtering to process the high-frequency sub-bands to reduce noise interference. The detailed information in the image can be well preserved. To display the high-frequency images more clearly, both the high-frequency sub-bands and the images enhanced by the gradient domain guided filtering have undergone a linear grayscale transformation.
Step 1: Perform histogram equalization on the X-ray image, stretch the overall grayscale range of the image, and improve the image layering.
Step 2: Perform NSST scale decomposition on the image processed in Step 1 to obtain one low-frequency sub-band and multiple high-frequency sub-bands.
Step 3: Use adaptive gamma correction with weighted distribution to enhance the contrast of the low-frequency sub-band to highlight a small amount of detailed information in the background.
Step 4: Use gradient-domain guided filtering for the high-frequency sub-bands to filter out image noise and subtract the smoothed image from the original image to obtain a differential image, which was added to the smoothed image by scale coefficient ξ to perform image enhancement.
Step 5: Perform inverse NSST on the processed low-frequency sub-band and high-frequency sub-bands and output the final enhanced image.

3.2. Decomposition Levels Analysis of NSST

The key parameters of NSST decomposition are the decomposition levels and shearing directions of each level. To analyze the effect of decomposition levels on image quality, five X-ray images of different sizes and different grayscales were selected for the experiments. Experiments were performed on the 64-bit operating system of Windows 10 (Intel Core i7-8750H CPU2.20GHz), and the experimental tool was MATLAB R2016b. The scale decomposition levels are set to 1-5, respectively, the number of shearing parameter of each level is set to 4, and the corresponding shearing directions of each level are 16. The window radius of the gradient domain guided filtering ς is 16, the regularization parameter λ is 0.5, the scale coefficient ξ is 5, and the parameters of other experimental conditions are kept the same.
Select two representative medical images for analysis: Image 1 with the size of 440 × 440 and image 2 with the size of 1024 × 1024 . The enhanced X-ray images obtained under different decomposition levels are shown in Figure 3 and Figure 4 where (a) is the original image, and (b–f) corresponds to the decomposition levels j equal to 1–5. When the number of scale decomposition levels is j , NSST decomposition requires 2 j times of image and filter convolution; the running time of the algorithm gradually increases. Observing the image, the image contrast has been significantly improved after histogram equalization. When the decomposition scale j 3 , with the increase of the NSST decomposition scale, the boundary and texture features of the image are gradually obvious, and the detailed information is enhanced. When 5 j > 3 , the enhancement effect is further improved; the change is not significant.
The subjective evaluation of the enhancement effect purely from the visual aspect has a certain one-sidedness. Therefore, five indicators of average gradient (AG), information entropy (H), spatial frequency (SF), edge intensity (EI), and running time (RT) are selected to objectively analyze the enhancement effect.
The average gradient (AG) can reflect the sharpness of the image and is defined as:
A G = i j ( ( f ( i , j ) f ( i + 1 , j ) ) 2 + ( f ( i , j ) f ( i , j + 1 ) ) 2 ) 1 2 M N
The larger the average gradient of an image, the higher the image clarity.
The information entropy (H) is an important indicator to measure the richness of image information and is defined as:
H ( p ) = l = 0 L 1 P ( l ) log P ( l )
where L refers to the number of gray levels, and P ( l ) represents the distribution probability of each gray level. The information entropy value indicates the average amount of information contained in the enhanced image. The larger the value, the richer the information contained in the enhanced image.
Spatial frequency (SF) can reflect the overall activity of an image in the spatial domain. The higher the spatial frequency, the better the quality of the enhanced image. Its formula is defined as follows:
S F = R F 2 + C F 2
Among them, R F represents the spatial row frequency and C F represents the spatial column frequency; the definitions of R F and C F are as follows:
R F = 1 M N i = 1 M j = 2 N [ f i , j f i , j 1 ] 2
C F = 1 M N j = 1 N i = 2 M [ f i , j f i 1 , j ] 2
The edge intensity (EI) reflects the image clarity degree. The more abundant the image detail and edge, the higher the image clarity.
E I = i j G x 2 ( i , j ) + G y 2 ( i , j )
where G x ( i , j ) , G y ( i , j ) represent the first-order partial derivative in horizontal and vertical directions and is defined as:
G x ( i , j ) = f ( i , j ) g x
G y ( i , j ) = f ( i , j ) g y
where is the convolution symbol, g x and g y are the horizontal template and vertical template for the Sobel operator. When the kernel size is 3, they are defined as:
g x = 1 4 [ 1 0 1 2 0 2 1 0 1 ] ,   g y = 1 4 [ 1 2 1 0 0 0 1 2 1 ]
Having analyzed the effects of the decomposition levels on image enhancement, the statistical data is shown in Table 1 and Table 2.
The larger the above four parameters are, the better the enhancement effect. Observing the data in Table 1 and Table 2 and Figure 5, under the condition of a certain number of shearing parameter in each level, with the increase of the decomposition scale, the information entropy slightly increases, but the overall fluctuation effect is not large. The average gradient, spatial frequency, and edge intensity of the image increase significantly, reaching their extreme value when the decomposition scale is 4. If the decomposition scale is increased again, the image enhancement effect is not obvious. Therefore, the primary decomposition scale is set to 4.

3.3. Shearing Directions Analysis of NSST

Performing l -level directional decomposition on the high-frequency sub-band image can obtain a 2 l -directional sub-band image of the same size as the source image, achieving more accurate directional decomposition in the frequency domain. The time taken by the 4-level directional decomposition of the NSST algorithm is much longer than that of the 2-level directional one. The shearing directions experiment was carried out on the same batch of pictures by selecting two representative medical images for analysis. The enhanced X-ray images obtained under different shearing directions are shown in Figure 6 and Figure 7. Having analyzed the effects of the shearing directions on image enhancement, the statistical data is shown in Table 3 and Table 4.
To prove the effectiveness of the proposed algorithm in this paper, 30 chest X-ray images obtained from [33] are selected to simulate, and the average metrics are shown in Table 5. Five indicators of average gradient (AG), information entropy (H), spatial frequency (SF), edge intensity (EI), and running time (RT) are introduced to objectively analyze the enhancement effect. The line charts of the average values of the objective metrics data in Table 5 are given in Figure 8. To display the data in the same graph, the value of EI has taken one-ninth of the original value, the value of SF has taken half of the original value, and the value of T has taken one-fifth of the original value.
Observing the experimental data, under the condition of a certain decomposition scale, with the increase of the shearing parameter of each level, the operation time gradually increases due to the low efficiency of the iterative filtering operation during the direction division process. However, the average gradient, information entropy, spatial frequency, and edge intensity are not obvious, indicating that the number of clipping directions will increase the complexity of the operation and make the running time of the algorithm longer, but the enhancement effect on the image is not obvious. In the final algorithm scheme, the decomposition scale of NSST is set to four levels, the shearing parameters of each level are set to (2,2,2,2), and the shearing directions are (4,4,4,4).

4. Experimental Results and Discussion

4.1. Subjective Analysis

To demonstrate the effectiveness of the algorithm in this paper, experiments were carried out on five X-ray images, as is shown in Figure 9, in which (1) and (2) are medical images mentioned before, (3) and (5) are industrial images with a size of 2048 × 2048, and (4) is a thermal battery image with a size of 1000 × 1000. The enhancement effect of the algorithm in this paper is compared with the FLM method [34], the AGCWD method [32], the TSSR method [9], and the LCM-CLAHE method [8] in terms of subjective visual effects and objective evaluation indicators.
To facilitate the observation and analysis of the detailed information in the image, we zoomed in on part of the image, as shown in the red box in the experimental results. It can be seen from Figure 9 that the FLM method may appear excessively enhanced, such as the bone background in (b)(2) being too bright, and the single-cell stack of the battery in (b)(4) being too bright, making the image lose a large amount of detail information; the AGCWD method has a certain enhancement effect on the image clarity, but the enhancement of details and texture information is not obvious in (c)(1) and (2); the TSSR algorithm enhances the contrast, but it will make the black areas in the image connect to produce a blurring effect, such as (d)(3)–(5); the LCM-CLAHE method can improve the texture information of the image, such as (e)(1), (2) and (5), but because the image is dark and the contrast is low, it is not conducive to the observation of image details. Figure 9f shows the results of the algorithm used in this paper, which suggests that the method proposed in this paper is very effective for X-ray image enhancement. Dealing with medical X-ray images like Figure 9((1),(2)), we can see that the sharpness of bone and soft tissue information is significantly increased, image noise is suppressed, and contrast in local areas is also improved. The algorithm makes the texture information more prominent, which is beneficial to the doctor’s diagnosis and follow-up treatment of the patient’s disease. When applied to the industrial X-ray images in Figure 9((3)–(5)), we can see that the local details in the enhanced image are clearly visible, and the contrast between the battery texture information and the component edge information is obvious. The overall brightness of the image is moderate, and the noise components in the image are not seriously amplified so that the processed image is more in line with the visual effect of the human eye.

4.2. Objective Analysis

Four evaluation indicators, average gradient (AG), information entropy (H), spatial frequency (SF), and edge intensity (EI), were selected to objectively analyze the image enhancement effect. From the aggregated data in Table 6, we can see that the algorithm proposed in this paper has achieved the optimal values in the three indicators of average gradient, spatial frequency, and edge intensity compared with the other four enhancement algorithms, and the information entropy also ranks in second place. From the average index data of the five pictures, we can see that the proposed method has achieved the best results in all four indicators.
The algorithm in this paper can improve the local contrast and sharpness, making it easier for people to obtain useful information about the target area from the enhanced image. To verify the robustness and general adaptability of the algorithm, experimental statistics were performed on 30 COVID-19 X-ray images with a size of 1024 × 1024 collected from [33]. The average metrics of their objective evaluation are given in Table 7.
The line charts of the average values of the objective metrics data in Table 7 are given in Figure 10. To display the data in the same graph, the value of EI has taken one-eighth of the original value. It can be seen from Figure 10 that the four evaluation indicators (AG, H, SF, and EI) obtained by the algorithm in this paper have achieved the optimal values among all the five algorithms. These results indicate that the proposed X-ray image enhancement algorithm can achieve a better enhancement effect.
Compared with existing enhancement methods, the proposed algorithm does not show significant advantages in terms of running time. The image enhancement model based on shearlet transform has relatively high computational complexity. The choice of the number of decomposition layers influences the effect of image enhancement, and the increase in the number of decomposition layers will bring higher computational complexity. This results in a long time for image enhancement. The different processing of sub-bands after multi-scale decomposition also affects the image enhancement effect and running time. Therefore, how to select a better sub-band processing method to obtain the optimal enhancement effect while reducing the number of decomposition layers is the next problem we will study. In addition, some parameter values in the algorithm need to be determined by empirical values. For X-ray images of different initial conditions, the algorithm parameters need to be changed accordingly. Future research will focus on the adaptability of this method.

5. Conclusions

Due to the influence of the X-ray detection hardware system and other factors, the quality of the X-ray image will decline, and the visual effect will become worse, causing certain difficulties in the process of X-ray image detection. Therefore, it is necessary to perform enhancement processing on the radiographic image to obtain higher quality images for subsequent analysis. This paper proposes a new image enhancement algorithm combining NSST and gradient-domain guided filtering. The innovation is that the image is decomposed in the NSST domain. AGCWD is used to enhance the contrast of the low frequency. Gradient-domain guided filtering is performed on the high-frequency sub-bands to improve image details and texture features. The final enhanced image is obtained through NSST coefficient reconstruction. The algorithm makes full use of the image sparse representation characteristics of NSST, the advantages of adaptive gamma correction in image contrast enhancement, and the advantages of the gradient domain guided filter in image detail enhancement. The algorithm proposed in this paper has an obvious effect on image enhancement, not only improving the contrast and clarity of the image but also improving the image quality, as demonstrated by experiments on 30 X-ray images compared to the other four advanced image enhancement methods at home and abroad. From the experimental results, we can see that the evaluation indicators AG, H, SF, and EI have all achieved optimal value. This demonstrates that the proposed algorithm can obtain a better enhancement effect for both medical and industrial radiographic images. It will provide a basis for later medical X-ray image diagnosis and industrial X-ray defect identification and detection.

Author Contributions

The experimental measurements and data collection were carried out by T.Z. and S.-X.Z. The manuscript was written by T.Z. with the assistance of S.-X.Z. All authors have read and agreed to the published version of the manuscript.

Funding

This work is supported by the Scientific research project of the Tianjin Education Commission under Grant No. 2020KJ077.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Öktem, H.; Egiazarian, K.; Niittylahti, J.; Lemmetti, J. An approach to adaptive enhancement of diagnostic X-ray images. EURASIP J. Adv. Signal Process. 2003, 2003, 1–7. [Google Scholar] [CrossRef] [Green Version]
  2. Rui, W.; Guoyu, W. Medical X-Ray Image Enhancement Method Based on TV-Homomorphic Filter. In Proceedings of the 2017 2nd International Conference on Image, Vision and Computing (ICIVC), Chengdu, China, 2–4 June 2017; pp. 315–318. [Google Scholar]
  3. Wang, X.; Chen, L. Contrast enhancement using feature-preserving bi-histogram equalization. Signal Image Video Process. 2018, 12, 685–692. [Google Scholar] [CrossRef]
  4. Wu, W.; Yang, X.; Li, H.; Liu, K.; Jian, L.; Zhou, Z. A novel scheme for infrared image enhancement by using weighted least squares filter and fuzzy plateau histogram equalization. Multimed. Tools Appl. 2017, 76, 24789–24817. [Google Scholar] [CrossRef]
  5. Xiao, B.; Tang, H.; Jiang, Y.; Li, W.; Wang, G. Brightness and contrast controllable image enhancement based on histogram specification. Neurocomputing 2018, 275, 2798–2809. [Google Scholar] [CrossRef]
  6. Lombardo, P.; Oliver, C.J.; Pellizzeri, T.M.; Meloni, M. A new maximum-likelihood joint segmentation technique for multitemporal SAR and multiband optical images. IEEE Trans. Geosci. Remote Sens. 2003, 41, 2500–2518. [Google Scholar] [CrossRef]
  7. Magudeeswaran, V.; Ravichandran, C.; Thirumurugan, P. Brightness preserving bi-level fuzzy histogram equalization for MRI brain image contrast enhancement. Int. J. Imaging Syst. Technol. 2017, 27, 153–161. [Google Scholar] [CrossRef]
  8. Mohan, S.; Ravishankar, M. Modified contrast limited adaptive histogram equalization based on local contrast enhancement for mammogram images. In Proceedings of the International Conference on Advances in Information Technology and Mobile Communication, Bangalore, India, 27–28 April 2012; pp. 397–403. [Google Scholar]
  9. Al-Ameen, Z.; Sulong, G. Ameliorating the Dynamic Range of Magnetic Resonance Images Using a Tuned Single-Scale Retinex Algorithm. Int. J. Signal Processing Image Process. Pattern Recognit. 2016, 9, 285–292. [Google Scholar] [CrossRef]
  10. Zeng, M.; Li, Y.; Meng, Q.; Yang, T.; Liu, J. Improving histogram-based image contrast enhancement using gray-level information histogram with application to X-ray images. Optik 2012, 123, 511–520. [Google Scholar] [CrossRef]
  11. Panetta, K.; Zhou, Y.; Agaian, S.; Jia, H. Nonlinear unsharp masking for mammogram enhancement. IEEE Trans. Inf. Technol. Biomed. 2011, 15, 918–928. [Google Scholar] [CrossRef]
  12. Tao, F.; Yang, X.; Wu, W.; Liu, K.; Zhou, Z.; Liu, Y. Retinex-based image enhancement framework by using region covariance filter. Soft Comput. 2018, 22, 1399–1420. [Google Scholar] [CrossRef]
  13. Zhang, Q.; Shen, S.; Su, X.; Guo, Q. A novel method of medical image enhancement based on wavelet decomposition. Autom. Control. Comput. Sci. 2017, 51, 263–269. [Google Scholar] [CrossRef]
  14. Do, M.N.; Vetterli, M. The finite ridgelet transform for image representation. IEEE Trans. Image Process. 2003, 12, 16–28. [Google Scholar] [CrossRef] [Green Version]
  15. Starck, J.L.; Murtagh, F.; Candes, E.J.; Donoho, D.L. Gray and color image contrast enhancement by the curvelet transform. IEEE Trans. Image Process. 2003, 12, 706–717. [Google Scholar] [CrossRef] [Green Version]
  16. Kiani, V.; Harati, A.; Mazloum, A.V. Iterative Wedgelet Transform: An efficient algorithm for computing wedgelet representation and approximation of images. J. Vis. Commun. Image Represent. 2016, 34, 65–77. [Google Scholar] [CrossRef]
  17. Lixia, C.; Ning, Z.; Hua, Y.; Ning, O. Remote sensing image fusion algorithm based on modified Contourlet transform. J. Comput. Appl. 2015, 35, 2015–2019. [Google Scholar]
  18. Da Cunha, A.L.; Zhou, J.; Do, M.N. The nonsubsampled contourlet transform: Theory, design, and applications. IEEE Trans. Image Process. 2006, 15, 3089–3101. [Google Scholar] [CrossRef] [Green Version]
  19. Wu, C.; Liu, Z.; Jiang, H. Choosing the filter for catenary image enhancement method based on the non-subsampled contourlet transform. Rev. Sci. Instrum. 2017, 88, 054701. [Google Scholar] [CrossRef]
  20. Easley, G.; Labate, D.; Lim, W.-Q. Sparse directional image representations using the discrete shearlet transform. Appl. Comput. Harmon. Anal. 2008, 25, 25–46. [Google Scholar] [CrossRef] [Green Version]
  21. Lim, W.-Q. The discrete shearlet transform: A new directional transform and compactly supported shearlet frames. IEEE Trans. Image Process. 2010, 19, 1166–1180. [Google Scholar]
  22. Li, L.; Ma, H. Saliency-Guided Nonsubsampled Shearlet Transform for Multisource Remote Sensing Image Fusion. Sensors 2021, 21, 1756. [Google Scholar] [CrossRef]
  23. Tang, J.; Liu, X.; Sun, Q. A direct image contrast enhancement algorithm in the wavelet domain for screening mammograms. IEEE J. Sel. Top. Signal Process. 2009, 3, 74–80. [Google Scholar] [CrossRef]
  24. Ostojić, V.; Starčević, Đ.; Petrović, V. Artifact reduction in multiscale contrast enhancement for digital radiography. In Proceedings of the 2014 22nd Telecommunications Forum Telfor (TELFOR), Belgrade, Serbia, 25–27 November 2014; pp. 513–516. [Google Scholar]
  25. Zhou, F.; Jia, Z.; Yang, J. Medical image enhancement method based on improved Gamma correction in shearlet domain. J. Optoelectron. Laser 2017, 28, 566–572. [Google Scholar]
  26. Zhang, L.; Jia, Z.; Koefoed, L.; Yang, J.; Kasabov, N. Remote sensing image enhancement based on the combination of adaptive nonlinear gain and the PLIP model in the NSST domain. Multimed. Tools Appl. 2020, 79, 13647–13665. [Google Scholar] [CrossRef]
  27. Li, L.; Si, Y. Enhancement of hyperspectral remote sensing images based on improved fuzzy contrast in nonsubsampled shearlet transform domain. Multimed. Tools Appl. 2019, 78, 18077–18094. [Google Scholar] [CrossRef]
  28. Tong, Y. Visual sensor image enhancement based on non-sub-sampled shearlet transform and phase stretch transform. EURASIP J. Wirel. Commun. Netw. 2019, 2019, 1–8. [Google Scholar] [CrossRef] [Green Version]
  29. He, K.; Sun, J.; Tang, X. Guided image filtering. IEEE Trans. Pattern Anal. Mach. Intell. 2012, 35, 1397–1409. [Google Scholar] [CrossRef] [PubMed]
  30. Li, Z.; Zheng, J.; Zhu, Z.; Yao, W.; Wu, S. Weighted guided image filtering. IEEE Trans. Image Process. 2014, 24, 120–129. [Google Scholar] [PubMed]
  31. Kou, F.; Chen, W.; Wen, C.; Li, Z. Gradient domain guided image filtering. IEEE Trans. Image Process. 2015, 24, 4528–4539. [Google Scholar] [CrossRef] [PubMed]
  32. Huang, S.-C.; Cheng, F.-C.; Chiu, Y.-S. Efficient contrast enhancement using adaptive gamma correction with weighting distribution. IEEE Trans. Image process. 2012, 22, 1032–1041. [Google Scholar] [CrossRef] [PubMed]
  33. Khan, S.H.; Sohail, A.; Khan, A.; Lee, Y.-S. COVID-19 detection in chest X-ray images using a new channel boosted CNN. Diagnostics 2022, 12, 267. [Google Scholar] [CrossRef]
  34. Zhan, K.; Teng, J.; Shi, J.; Li, Q.; Wang, M. Feature-linking model for image enhancement. Neural Comput. 2016, 28, 1072–1100. [Google Scholar] [CrossRef]
Figure 1. NSST of the three-levels decomposition process.
Figure 1. NSST of the three-levels decomposition process.
Sensors 22 04074 g001
Figure 2. The proposed method for enhancing X-ray images is depicted schematically.
Figure 2. The proposed method for enhancing X-ray images is depicted schematically.
Sensors 22 04074 g002
Figure 3. The enhanced effects of different decomposition levels on the X-ray image 1. (a) is the original image, and (bf) corresponds to the decomposition levels j equal to 1–5.
Figure 3. The enhanced effects of different decomposition levels on the X-ray image 1. (a) is the original image, and (bf) corresponds to the decomposition levels j equal to 1–5.
Sensors 22 04074 g003
Figure 4. The enhanced effects of different decomposition levels on the X-ray image 2. (a) is the original image, and (bf) corresponds to the decomposition levels j equal to 1–5.
Figure 4. The enhanced effects of different decomposition levels on the X-ray image 2. (a) is the original image, and (bf) corresponds to the decomposition levels j equal to 1–5.
Sensors 22 04074 g004
Figure 5. The effects of different decomposition levels: (a) are for Table 1 and (b) are for Table 2.
Figure 5. The effects of different decomposition levels: (a) are for Table 1 and (b) are for Table 2.
Sensors 22 04074 g005
Figure 6. The enhanced effects of different shearing directions on X-ray image 1. In (a), the shearing parameters of each level are set to (4,4,4) and the shearing directions are (16,16,16). For (bh), the decomposition scale was set to 4 levels, the shearing parameters of each level are set from (2,2,2,2) to (4,4,4,4), and the shearing directions are from (4,4,4,4) to (16,16,16,16). The number of shearing directions of each level was gradually increased.
Figure 6. The enhanced effects of different shearing directions on X-ray image 1. In (a), the shearing parameters of each level are set to (4,4,4) and the shearing directions are (16,16,16). For (bh), the decomposition scale was set to 4 levels, the shearing parameters of each level are set from (2,2,2,2) to (4,4,4,4), and the shearing directions are from (4,4,4,4) to (16,16,16,16). The number of shearing directions of each level was gradually increased.
Sensors 22 04074 g006
Figure 7. The enhanced effects of different shearing directions on X-ray image 2. In (a), the shearing parameters of each level are set to (4,4,4) and the shearing directions are (16,16,16). For (bh), the decomposition scale was set to 4 levels, the shearing parameters of each level are set from (2,2,2,2) to (4,4,4,4), and the shearing directions are from (4,4,4,4) to (16,16,16,16). The number of shearing directions of each level was gradually increased.
Figure 7. The enhanced effects of different shearing directions on X-ray image 2. In (a), the shearing parameters of each level are set to (4,4,4) and the shearing directions are (16,16,16). For (bh), the decomposition scale was set to 4 levels, the shearing parameters of each level are set from (2,2,2,2) to (4,4,4,4), and the shearing directions are from (4,4,4,4) to (16,16,16,16). The number of shearing directions of each level was gradually increased.
Sensors 22 04074 g007
Figure 8. The effects of different shearing directions for Table 5.
Figure 8. The effects of different shearing directions for Table 5.
Sensors 22 04074 g008
Figure 9. Comparison of different enhancement algorithms. (a) Original image, (b) FLM, (c) AGCWD, (d) TSSR, (e) LCM-CLAHE, (f) Proposed method.
Figure 9. Comparison of different enhancement algorithms. (a) Original image, (b) FLM, (c) AGCWD, (d) TSSR, (e) LCM-CLAHE, (f) Proposed method.
Sensors 22 04074 g009
Figure 10. The average index of different enhancement algorithms on the 30 chest X-ray images was calculated.
Figure 10. The average index of different enhancement algorithms on the 30 chest X-ray images was calculated.
Sensors 22 04074 g010
Table 1. An objective evaluation of the NSST decomposition levels for Figure 3.
Table 1. An objective evaluation of the NSST decomposition levels for Figure 3.
Figure Levels   ( j ) Directions   ( 2 l ) AGHSFEIRT
Figure 3a//1.0209 6.7705 3.2987 11.0071 0
Figure 3b1163.7609 7.5542 9.5269 38.7133 2.6598
Figure 3c216,164.9984 7.5516 11.8834 51.0562 3.7920
Figure 3d316,16,165.6034 7.5394 12.7895 58.1641 5.3340
Figure 3e416,16,16,165.7891 7.4672 13.1481 60.6308 6.9986
Figure 3f516,16,16,16,165.7363 7.2994 13.2229 60.5058 8.5886
Table 2. An objective evaluation of the NSST decomposition levels for Figure 4.
Table 2. An objective evaluation of the NSST decomposition levels for Figure 4.
Figure Levels   ( j ) Directions   ( 2 l ) AGHSFEIRT
Figure 4a//2.3300 7.5341 10.3475 24.0514 0
Figure 4b1164.5223 7.2774 17.1468 42.1044 18.4116
Figure 4c216,166.3055 7.2848 19.5768 61.0428 35.8895
Figure 4d316, 16,166.8069 7.3293 20.1561 67.3551 53.7948
Figure 4e416,16,16,166.9036 7.4187 20.2654 68.8586 75.4546
Figure 4f516,16,16,16,166.8085 7.4351 20.1713 68.1701 86.2375
Table 3. An objective evaluation of the NSST shearing directions for Figure 6.
Table 3. An objective evaluation of the NSST shearing directions for Figure 6.
Figure Levels   ( j ) Directions   ( 2 l ) AGHSFEIRT
Figure 6a316,16,165.60347.5394 12.7895 58.1641 5.3340
Figure 6b44,4,4,45.82237.458113.266861.24742.9424
Figure 6c44,4,8,85.85287.4573 13.2985 61.4832 3.5790
Figure 6d48,8,4,45.7827.4581 13.1731 60.7947 3.6289
Figure 6e48,8,8,85.81227.4612 13.2097 61.0277 4.1941
Figure 6f48,8,16,165.83567.4599 13.2460 61.2155 5.6572
Figure 6g416,16,8,85.76507.4683 13.1010 60.4517 5.5436
Figure 6h416,16,16,165.78917.4672 13.1481 60.6308 6.9986
Table 4. An objective evaluation of the NSST shearing directions for Figure 7.
Table 4. An objective evaluation of the NSST shearing directions for Figure 7.
Figure Levels   ( j ) Directions   ( 2 l ) AGHSFEIRT
Figure 7a316,16,166.8069 7.3293 20.1561 67.3551 53.7948
Figure 7b44,4,4,47.33317.410921.090973.070222.6136
Figure 7c44,4,8,87.1990 7.4119 21.0370 72.0519 30.6810
Figure 7d48,8,4,47.2375 7.4133 20.9472 71.9375 30.6267
Figure 7e48,8,8,87.1001 7.4142 20.8958 70.8976 38.6901
Figure 7f48,8,16,167.0193 7.4163 20.4215 70.2705 54.8658
Figure 7g416,16,8,86.9897 7.4174 20.7423 69.5446 55.5662
Figure 7h416,16,16,166.9036 7.4187 20.2654 68.8586 75.4546
Table 5. The average objective evaluation of the methods on the 30 chest X-ray images.
Table 5. The average objective evaluation of the methods on the 30 chest X-ray images.
Figure Levels   ( j ) Directions   ( 2 l ) AGHSFEIRT
Figure 8a316,16,168.3583 7.4553 20.4879 84.1216 31.3269
Figure 8b44,4,4,48.74767.431521.407188.366815.2641
Figure 8c44,4,8,88.6903 7.4313 21.2207 88.0425 19.6420
Figure 8d48,8,4,48.6895 7.4350 21.2853 87.7092 20.5452
Figure 8e48,8,8,88.6322 7.4351 21.1022 87.3851 24.9692
Figure 8f48,8,16,168.5567 7.4352 20.8234 86.7944 33.6135
Figure 8g416,16,8,88.5685 7.4401 20.9832 86.6336 35.4185
Figure 8h416,16,16,168.4898 7.4401 20.7023 86.0090 42.0250
Table 6. Objective index analysis of methods for image enhancement.
Table 6. Objective index analysis of methods for image enhancement.
InputIndexOriginalFLMAGCWDTSSRLCM-CLAHEProposed
(1)AG1.02093.78501.49181.44742.76405.8223
H6.77057.67026.79237.00877.16677.4581
SF3.298710.02613.64823.82146.290813.2668
EI11.0071 38.4831 15.8314 15.4658 28.8997 61.2474
(2)AG2.3300 3.26462.70962.55084.30327.3331
H7.53416.62967.28176.29817.39067.4109
SF10.3475 20.308513.188712.167712.599321.0909
EI24.0514 31.7895 28.0340 26.3186 43.4980 73.0702
(3)AG2.7952 3.89043.09283.73143.98376.3108
H6.0726 6.21126.21145.15266.41696.7970
SF10.4788 16.485910.659613.634411.918423.6223
EI30.4747 39.5424 34.0402 40.6691 42.9675 67.1452
(4)AG1.3866 2.55081.58101.74102.50794.1480
H6.9763 5.98835.93706.59067.07257.5378
SF5.3728 12.90206.49227.59817.306912.9766
EI14.9979 25.8824 17.1513 18.8056 26.7857 42.5292
(5)AG2.34832.43612.61112.45743.14364.5574
H6.34075.36835.96304.08546.29086.5791
SF7.76979.08028.105410.02109.380614.3243
EI25.9900 26.2052 28.8516 27.4110 33.3082 47.2777
Table 7. Objective index analysis of the methods on the 30 COVID-19 X-ray images.
Table 7. Objective index analysis of the methods on the 30 COVID-19 X-ray images.
InputIndexOriginalFLMAGCWDTSSRLCM-CLAHEProposed
30AG1.91923.68772.63402.60473.97898.7476
H7.21536.51797.30227.16157.40347.4315
SF6.409914.53018.41128.47089.779721.4071
EI19.610435.432226.838126.688240.325888.3668
RT04.3355 0.05390.2668 5.5797 14.8398
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Zhao, T.; Zhang, S.-X. X-ray Image Enhancement Based on Nonsubsampled Shearlet Transform and Gradient Domain Guided Filtering. Sensors 2022, 22, 4074. https://doi.org/10.3390/s22114074

AMA Style

Zhao T, Zhang S-X. X-ray Image Enhancement Based on Nonsubsampled Shearlet Transform and Gradient Domain Guided Filtering. Sensors. 2022; 22(11):4074. https://doi.org/10.3390/s22114074

Chicago/Turabian Style

Zhao, Tao, and Si-Xiang Zhang. 2022. "X-ray Image Enhancement Based on Nonsubsampled Shearlet Transform and Gradient Domain Guided Filtering" Sensors 22, no. 11: 4074. https://doi.org/10.3390/s22114074

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop