Next Article in Journal
Skew Constacyclic Codes over a Non-Chain Ring
Next Article in Special Issue
Ensemble Improved Permutation Entropy: A New Approach for Time Series Analysis
Previous Article in Journal
Prediction of the Number of Cumulative Pulses Based on the Photon Statistical Entropy Evaluation in Photon-Counting LiDAR
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Remote Sensing Image of The Landsat 8–9 Compressive Sensing via Non-Local Low-Rank Regularization with the Laplace Function

1
School of Electrical Engineering, Southwest Jiaotong University, Chengdu 611756, China
2
Key Laboratory for Computer Systems of State Ethnic Affairs Commission, Southwest Minzu University, Chengdu 610041, China
3
China-ASEAN International Joint Laboratory of Integrated Transportation, Nanning University, Nanning 530299, China
4
School of Mathematics, Southwest Minzu University, Chengdu 610041, China
5
School of Computer Science and Engineering, Southwest Minzu University, Chengdu 610041, China
*
Author to whom correspondence should be addressed.
Entropy 2023, 25(3), 523; https://doi.org/10.3390/e25030523
Submission received: 26 January 2023 / Revised: 11 March 2023 / Accepted: 13 March 2023 / Published: 17 March 2023
(This article belongs to the Special Issue Information Theory and Nonlinear Signal Processing)

Abstract

:
Utilizing low-rank prior data in compressed sensing (CS) schemes for Landsat 8–9 remote sensing images (RSIs) has recently received widespread attention. Nevertheless, most CS algorithms focus on the sparsity of an RSI and ignore its low-rank (LR) nature. Therefore, this paper proposes a new CS reconstruction algorithm for Landsat 8–9 remote sensing images based on a non-local optimization framework (NLOF) that is combined with non-convex Laplace functions (NCLF) used for the low-rank approximation (LAA). Since the developed algorithm is based on an approximate low-rank model of the Laplace function, it can adaptively assign different weights to different singular values. Moreover, exploiting the structural sparsity (SS) and low-rank (LR) between the image patches enables the restored image to obtain better CS reconstruction results of Landsat 8–9 RSI than the existing models. For the proposed scheme, first, a CS reconstruction model is proposed using the non-local low-rank regularization (NLLRR) and variational framework. Then, the image patch grouping and Laplace function are used as regularization/penalty terms to constrain the CS reconstruction model. Finally, to effectively solve the rank minimization problem, the alternating direction multiplier method (ADMM) is used to solve the model. Extensive numerical experimental results demonstrate that the non-local variational framework (NLVF) combined with the low-rank approximate regularization (LRAR) method of non-convex Laplace function (NCLF) can obtain better reconstruction results than the more advanced image CS reconstruction algorithms. At the same time, the model preserves the details of Landsat 8–9 RSIs and the boundaries of the transition areas.

1. Introduction

The transmission, reception, and storage of Landsat 8–9 remote sensing images (RSIs) is a critical practical challenge in remote sensing (RS). Therefore, the collection time and processing of massive Landsat 8–9 images have become hot research topics. Compressed sensing (CS) aims to sample/compress the original image using part of the image data (or the corresponding frequency-domain data) and then reconstruct the sampled/compressed data at the terminal by obtaining the reconstructed image [1] close to or beyond the quality of the original data. Generally, CS theory exploits the sparsity and low-rank prior information of the original image to compress the RSI through a data compression method and to recover and reconstruct the compressed data when required.
Nevertheless, the Landsat 8–9 RSIs involve huge real matrices, and this huge data volume (the compressed file size of each group of Landsat 8–9 RSIs exceeds 1GB) imposes a long data transmission time [2], while many practical applications require fast remote sensing data acquisition, limiting the practical application of Landsat 8–9 RSIs. For example, fast data acquisition enables timely assessment of the losses caused by natural disasters, and real-time monitoring of ground objects also depends on the rapid transmission and analysis of RSIs. Therefore, CS technology has prominent practical applications in reconstructing Landsat 8–9 RSIs. At the same time, the compression perception model of an RSI poses a great practical application potential in improving the energy efficiency of imaging sensors [3]. Given that the proportion of random measuring signals acquired by CS in the image is relatively low (typically 10–25%), measuring signal transmission [4] has a significant advantage in time and space storage.
The traditional CS model usually employs a regularization model, compresses the original image using the frequency-domain random sampling (FDRS) method, and then obtains the compressed data [5] with sparsity. Consequently, many image CS reconstruction models are built on practical problem situations. For instance, the traditional CS reconstruction method can be effectively solved using the 11-norm of the sampled signal, i.e., the sparsity of the original signal, and the low-rank function replacement (LRFR) method [6], which effectively solves the CS reconstruction problem. In recent years, the concept of sparsity has been developed into various complex forms, including model-based or Bayesian, non-local sparsity, and structural sparse/group sparsity [7]. Thus, CS data can be reconstructed by exploiting the high correlation between the sparse coefficient, while some experimental studies have demonstrated that the non-convex optimization method (NCOM) based on CS has better image reconstruction results. Indeed, NCOM-based reconstructed images are often higher in visual effect and numerical accuracy than the convex optimization method (COM) [8,9]. To exploit the high correlation between the sparse coefficient and non-convex optimization and find a solution algorithm with relatively high computational efficiency, [10] introduced a method for solving the nuclear norm low-rank approximation model (LRAM) using the SVD algorithm, which yields an easily solved convex optimization problem (COP) [10] by minimizing the sum of all singular values in the image. However, each singular value of the optimization problem in image reconstruction has its practical physical meaning, and therefore, each singular value in any real problem should be treated differently [11]. However, all the singular values have been averaged in the nuclear norm LRAM, limiting the algorithm’s ability and flexibility.
Spurred by the findings presented above, we suggest a CS reconstruction model for the Landsat 8–9 RSI based on low-rank approximation (LRA) of non-local associative non-convex Laplace functions (NL-NCLF), which adaptively assign weights to different singular values [12]. Extensive experimental studies demonstrate that the reconstruction results of NCOMs are more accurate than COMs, but the algorithms are slightly complex and impose a greater computational complexity [13]. In the ongoing big data era, overemphasizing the algorithm’s computational time is no longer an important target; therefore, NCOMs have good practical value and prospects. Hence, the core priority is the model to make full use of the prior information of the original signal (such as sparsity and low-rank) in the CS theory of Landsat 8–9 RSIs [14,15].
Generally, the image patches of Landsat 8–9 RSIs present a strong sparsity and have an approximate structural low rank [16]. Therefore, due to the low rank of the structural information in the Landsat 8–9 RSIs, we employ the SVD method to solve the CS model and thus obtain better CS reconstruction results [17]. Moreover, for the image reconstruction, we utilize the regularization model of the low-rank approximate penalty of the non-local combined non-convex Laplace function, which is based on structural self-similarity in the total variation framework [8,9,12]. Our model is a non-convex CS reconstruction model involving a regularization/penalty constraint, low-rank approximation, and image patch grouping [18]. Substituting the low-rank regularization with a non-local and Laplace function enhances the CS reconstruction accuracy compared to common low-rank substitution methods, e.g., nuclear norm, with extensive theoretical analysis proving our algorithm’s effectiveness and stability.

2. Background

In the CS theory of Landsat 8–9 RSIs, random linear measurement/sampling is conducted in the corresponding Fourier transform domain (FTD) of the RSIs x, and then the sampling data y of the Fourier frequency domain (FFD) is obtained. The original Landsat 8–9 RSIs x are recovered through image reconstruction with the sampling data y. In general, the real Landsat 8–9 RSIs are not absolutely sparse but approximately sparse under a certain transformation domain, i.e., they can be transformed into a compressible signal. The sparsity or compressibility of image signals is an important premise and the theoretical basis for CS. Hence, a remote sensing image x can be represented by a linear combination of a set of bases Ψ = η i , i = 1 , 2 , , n , where η i C N are the sparse bases, i.e., x = Ψ α . Specifically, y can be expressed as y = Φ x = Φ Ψ α , where x C N , y C M and Φ C M × N is the measurement/sampling matrix, M < N . Since M < N , matrix Φ is not a full rank, i.e., multiple reconstruction results x C N can be generated using the same measurement y. Generally, if the measurement matrix Φ satisfies the limited isometry property (RIP) condition [12,16], CS theory can guarantee the perfect reconstruction of signal x by utilizing the sparse (or compressed) signal y. Prior information about the image x must be known to reconstruct a unique perfect image x from the measured data y. The traditional CS method is to recover remote sensing images by using the sparsity of images x, and to satisfy y = Φ x , the following constraint optimization problem is employed:
x = arg min x α 0 s . t . y = Φ Ψ α ,
where 0 is a pseudo-norm counting the number of non-zero elements in α . However, minimizing the norm 0 is an NP-hard problem. Therefore, we recover the RSI signal from the random measurement/sampling y by using the convex norm l 1 instead of the non-convex norm l 0 and then solve the norm l 1 optimization problem. The optimal model obtained by substituting norm l 1 for the norm l 0 is a convex optimization model, and therefore multiple solution algorithms such as an iterative contraction algorithm (ICA) [19], Bregman splitting algorithm (BSA) [20], and alternating direction multiplier method (ADMM) [21,22] can effectively solve this problem. Recent studies have demonstrated that replacing the norm l 1 with a non-convex norm achieves better CS reconstruction results [16].
By modeling the high correlation between sparse coefficients, the uncertainty of unknown signals can be significantly reduced and afford a more accurate CS reconstruction. The structural sparsity of Landsat 8–9 RSI is particularly important in establishing the CS model for RSIs. Usually, image structure information presents a rich repeatability, so the non-local self-similarity (NLSS) principle of an image structure can be obtained by combining the non-local method [14] and the simultaneous sparse coding (SSC) mechanism [23]. One of the key issues in the CS model is the minimization of the rank function. Because the kernel norm is the minimum convex envelope of the rank function, the rank function in the traditional CS model is often relaxed to the kernel norm (the sum of all singular values of the matrix). However, many works in the literature have proven that using kernel norm to approximate the rank of a matrix has many weaknesses, especially when the matrix has large singular values, the inaccuracy of this approximation is particularly obvious. Therefore, it is particularly necessary to study how to construct a more accurate rank approximation function (RAF) and establish a corresponding low-rank matrix (LRM) recovery model based on it. In recent years, the non-convex function approximation (NNFA) of the LRM’s rank function has widely concerned many scholars. A large number of experimental results have proven that these non-convex rank approximation functions are more accurate than the convex function approximation of the kernel norm. The approximate rank function method of the non-convex function (NCF) can not only avoid the NP-hard problem but also provide the optimal solution. The non-convex function replacement (NCFR) can usually provide more scalable solutions. The comparison between the non-convex Laplace replacement function (NCLRF) and the kernel norm replacement function (KNRF) under standard conditions shows that the NCLRF model can better approximate the rank function than the kernel norm model when solving the rank minimization problem. Therefore, it is very meaningful to explore the non-convex regularized low-rank approximation (NCRLRA) model, establish a fast and effective solution algorithm, and apply it to practical problems such as the compressed sensing of a remote sensing image (RSI). This paper suggests a variational framework for CS reconstruction using non-local structural sparsity (NLSS) and non-convex low-rank approximation (NCLRA) [23].

3. Regularized CS Reconstruction Model Based on Non-Local and Non-Convex Approximate Low-Rank Functions

This section presents a new regularized CS reconstruction model with non-local and an NCLRA, comprising a patch grouping to describe the self-similarity of the images and an NCLRA for low-rank enhancement. Our method assumes that the non-local self-similarity in Landsat 8–9 RSIs is very rich. This assumption implies that for each sample image patch x ^ i ( n × n ) sample patch at position (i), a sufficient number of similar image patches can be found by performing a k-nearest neighbor (KNN) search algorithm in a local window, e.g., 100 × 100 , when x ^ i C n , namely:
G i = i j | x ^ i x ^ i , j < T ,
where T is a predefined threshold and G i represents the set of locations corresponding to the similar image patch. After the patch is grouped, we obtain the data matrix X i = x i 0 , x i 1 , , x i m 1 , X i C n × m . For each sample image patch x i , each column of X i represents a patch similar to x i (including x i ). Since these patches have similar structures, the data matrix X i formed is low-rank.
In practical applications, X i may be interfered with by noise, thus deviating from the ideal low-rank constraint (LRC). Thus, a better representation of the data matrix X i is X i = L i + W i , where L i and W i represent the low-rank matrix (LRM) and the Gaussian noise matrix (GNM), respectively. By solving the optimization problem in Equation (3), the LRM is reconstructed:
L i = argmin r a n k L i L i s . t . X i L i F 2 σ w 2 ,
where F 2 represents the Frobenius norm and σ w 2 is the variance of additive Gaussian noise. Although the low-rank convex substitution method has good theoretical guarantees, the optimization method of non-convex substitution for the rank minimization problem may obtain better recovery results.
This paper uses a smooth non-convex function (Laplace function) as the alternative to the low-rank function. Nowadays, several works employ the nuclear norm approximate low-rank function, which provides equal weight to all the singular values in the image patch. However, in many practical situations, the singular values have different physical meanings and should be treated differently [11,12], which is particularly prominent for RSIs. For example, larger singular values represent low-frequency information in Landsat 8–9 RSIs, while smaller values represent high-frequency information and noise. The Laplace function ϕ ( x ) = 1 e x / ε used in this paper is closer to the pseudo-norm l 0 than the nuclear norm, and thus the sum of the singular values of the Laplace function is closer to the rank function than the nuclear norm. Additionally, the advantage of the Laplace function is that it automatically assigns different weights to each singular value. Based on the above observations, we propose a non-convex low-rank substitution model of the Laplace function, defined as the norm form in Equation (4):
X ε = ϕ σ X = i = 1 n 1 e σ i X / ε ,
where ε denotes a smaller constant value. Note that function X ε is the sum of n singular value functions of the matrix X. So it is smooth and non-convex. Laplace non-convex functions can substitute rank function, which has been proven better when considering information theory [24,25]. On these grounds, the non-convex low-rank approximation optimization model (NC-LRAOM) of Equation (5) is proposed to solve L i .
L i = arg min L i L i ε s . t . X i L i F 2 σ w 2 ,
In practice, the constrained minimization problem can be solved with an unconstrained minimization problem, namely:
L i = arg min L i X i L i F 2 + λ L i ε ,
By selecting the appropriate λ , Equation (6) can be made equivalent to Equation (5). For each sample image patch, an approximate low-rank matrix L i of the matrix X i can be obtained by solving Equation (6), and for each extracted sample image patch the low-rank was enforced on the non-local similar image patch set. Hence, a new non-convex CS reconstruction model is proposed following the proposed low-rank regularization term. The specific CS reconstruction scheme is as follows:
x ^ , L ^ i = arg min x , L i y Φ x 2 2 + η i R ˜ i x L i F 2 + λ L i ε ,
where R ˜ i x R i 0 x , R i 1 x , , R i m 1 x is a matrix comprising a group of similar patches of each sample image patch x i . The proposed regularized model with non-local combined non-convex approximate low-rank function (NL-NCALF) simultaneously utilizes the group sparsity of similar image patches and the non-convexity of rank minimization, thus being able to obtain better reconstruction results. In the next section, the proposed objective function will be solved effectively using the minimization method of the non-convex function instead of the low-rank function.

4. Landsat 8–9 Remote Sensing Image CS Reconstruction Algorithm

The proposed CS reconstructed algorithm of the Landsat 8–9 RSI can be solved by minimizing the objective function and the low-rank matrix (LRM) L i of the whole image x. For the initial estimate of the unknown image x, we first extract the sample image patch x i at each pixel i in each direction and assign a similar set to each image patch x i , as described in Section 3. Then we solve the following minimization problem for each image patch as follows:
L i = arg min L i η R ˜ i x L i F 2 + λ L i ε ,
Equation (8) is solved using Theorem 1:
Theorem 1. 
Given Z R m 1 × m 2 , the minimum value of Equation (9):
arg min X X ε + β 2 Z X F 2 ,
is given by a weighted singular value threshold, i.e.,:
X = U D ϕ / β V H ,
where Z = U S V H and D ϕ / β R m 1 × m 2 is a diagonal matrix, D ϕ β i , i = S i , i ϕ σ i β + , ϕ σ i = 1 ε exp σ i ε denotes the gradient of ϕ at position σ i , and σ i is the ith singular value of X.
Proof. 
Equation (4) shows that the function X ε is the sum of n singular value functions of matrix X, then Equation (9) can be expressed in the form of Equation (11):
arg min X i = 1 m ϕ σ i X + β 2 X Z F 2 ,
where X , Z C m 1 × m 2 , and the optimal solution of Equation (11) can be obtained using the general weighted singular value threshold [26,27], namely:
X = U D ϕ / β V H ,
where Z = U S V H , D ϕ β i , i = S i , i ϕ σ i β + , ϕ σ i = 1 ε exp σ i ε , Consequently, the conclusion of Theorem 1 can be confirmed. □
In the case of a real matrix, the proposed CS reconstruction model for the Landsat 8–9 RSI is non-convex, so it is not expected to find its global minimum. However, the weighted singular threshold algorithm can obtain the minimum value (possibly the local minimum value) of Equation (9). Note that even though the weighted threshold method is only a local minimum, the value of the objective function still decreases. In the experiment, we set w 0 = 1 , 1 , , 1 T .
According to [28], weighting l 1 -norm performs much better than l 1 -norm in approximating l 0 -norm and generally produces better image CS perception reconstruction results. Similarly, the experimental results in the next section demonstrate that the Laplace function produces CS reconstruction results better than the nuclear norm. By solving the following minimization problem to obtain L i , we can further reconstruct the whole Landsat 8–9 RSI:
x = arg min x y Φ x 2 2 + η i R ˜ i x L i F 2 ,
when the measurement matrix Φ is the Fourier transform matrix (the Fourier transform is one of the important transforms in the field of Landsat 8–9 RSI processing), Equation (12) can be quickly solved using the alternating direction multiplier method (ADMM) [29]. In this case, first, the augmented Lagrangian form of Equation (12) can be expressed as in Equation (13):
x , z , μ = arg min x y Φ x 2 2 + β x z + μ 2 β 2 2 + η i R ˜ i z L i F 2 ,
where z C N is an auxiliary variable, μ C N is a Lagrange multiplier, and β is a positive constant. The advantage of ADMM is that Equation (13) can be divided into two subproblems, where both can find their closed solutions. Applying ADMM to Equation (13), the iterative form of the following Equation (14) can be obtained:
z l + 1 = arg min z β l x l z + μ l 2 β l 2 2 + η i R ˜ i z L i F 2 x l + 1 = arg min x y Φ x 2 2 + β l x z l + 1 + μ l 2 β l 2 2 μ l + 1 = μ l + β l x l + 1 z l + 1 β l + 1 = ρ β l ,
In Equation (14), ρ > 1 is a constant. By determining x l , μ l , β l , and z l + 1 , a closed solution can be obtained:
z l + 1 = η i R ˜ i T R ˜ i + β l I 1 β l x l + μ l 2 + η i R ˜ i L i ,
Note that i R ˜ i T R ˜ i is a diagonal matrix. Therefore, Equation (15) can be easily calculated.
The sub-problems of x and y can be calculated using Equation (16):
Φ H Φ + β l I x = Φ H y + β l z l + 1 μ l 2 ,
where Φ is the Fourier transform matrix (FTM), Φ = D F and where D and F represent the down-sampling matrix and Fourier transform matrix (FTM), respectively. In other words, the sub-problems of x and y can be solved from the image space to the Fourier frequency domain space by Equation (16). Equation (17) can be obtained by replacing Φ with D F in Equation (16) and executing Fourier transform on both sides of the equation.
F D F H D F + β l I F H F x = F D F H y + F β l z l + 1 μ l 2 ,
So, we simplify Equation (17) and calculate x by taking the inverse Fourier transform, namely:
x l + 1 = F H D T D + β l 1 D T y + F β l z l + 1 μ l 2 ,
By updating x and z according to Equation (14), μ and β can be easily calculated.
After the unknown image x is calculated, the low-rank matrix L i is updated using Equation (8), from which we obtain the updated L i that is used to recalculate the estimate of image x. This process is repeated until the algorithm meets the convergence condition.
The proposed CS reconstruction model for the Landsat 8–9 RSIs is non-convex. Therefore, the hot start method is used to preprocess the CS reconstruction images. When the reconstruction results reach a certain accuracy, the above ADMM method is used to solve the proposed model and obtain higher accuracy. To save computing time, image patch grouping is not updated after each iteration but at the end of an outer cycle.

5. Data Sources

This study employs Landsat 8–9 RSIs for all simulation experiments obtained from the US Geological Survey Center for Earth Resource Observation and Science (EROS). Landsat 8 is the eighth satellite of the US Landsat Missions (Landsat), successfully launched on an Atlas-V rocket from Vandenberg Air Force Base, California, on 11 February 2013, originally known as the Landsat Data Continuity Mission (LDCM). Landsat 8 carries an operational land imager (OLI) and a thermal infrared sensor (TIRS). The OLI measures the spectrum’s visible, near-infrared, and shortwave infrared portions (VNIR, NIR, and SWIR). The TIRS measures the temperature of land surfaces in two thermal bands with a new technology that applies quantum physics to detect heat. The OLI Land Imager includes nine spectral bands with 30-m multi-spectral spatial resolutions, which include a 15-m panchromatic band. This study’s first set of satellite images was the Landsat-8 LITP product of the blue band (30-m) with a wavelength range of 450–515 nm. Landsat 9 is the ninth satellite of the US Landsat Missions (Landsat), successfully launched from the Vandenburg Space Force Base, California, on 27 September 2021. Landsat 9 Carries the second-generation land imager (Operational Land Imager 2, OLI-2) built by Ball Aerospace & Technologies and the second-generation thermal infrared sensor (Thermal Infrared Sensor 2, TIRS-2) built by NASA Goddard Space Flight Center. The OLI–2 captures images of the Earth’s surface in visible, near-infrared, and shortwave-infrared bands, increasing the radiative measurement accuracy from 12 to 14 bits with Landsat 8 and slightly improving the overall signal-to-noise ratio. The OLI-2 land imager includes nine spectral bands with a 30-meter spatial resolution, which includes a 15-meter panchromatic band. The TIRS-2 measures the thermal infrared radiation or heat of the Earth’s surface in two bands that perform better than the thermal band of the Landsat 8. This study’s second set of satellite images is the Landsat 9 L2SP product of the red band (30-meter) with a wavelength range of 640–670 nm. Table 1 summarizes the locations and dates of the observed images.
The Landsat 8 RSIs were ordered in four different geographical regions: Antarctica; Selkirk in Manitoba, Canada; Flathead Lake in Montana, USA; Lincoln in Washington, USA. Antarctica is mainly composed of ice sheets, glaciers, and snow, while Selkirk in Manitoba, Canada, is a grassland area with relatively flat terrain, a Precambrian shield, and its northern end is the permafrost layer. Flathead Lake in Montana, USA, is in the state’s northeast and is known for its rich rocks and plains. It includes rich land features, such as water, mountain, forest, and vegetation. Lincoln has abundant landforms, abundant rainfall, and large desert areas in the east.
The Landsat 9 remote sensing images (RSIs) [30] were ordered in five different geographical regions: Lake Abitibi in Ontario, Canada; Yeosu, South Korea; Shanghai, China; Huangshi, Hubei, China; Erenhot, Inner Mongolia, China. The Lake Abitibi waters range from western Lake Forest to the St. Lawrence River in eastern Cornwall. Lake Abitibi stretches between Ontario and Quebec and includes many land features, such as lakes, forests, cities, and farmland. Yeosu is located in the Yeosu Peninsula, the southernmost tip of the Korean Peninsula, belonging to South Jeolla Province, and it includes the ocean, coastline, and city. Shanghai is located on the west coast of the Pacific Ocean, where the Yangtze River and Huangpu River converge. Its land features include rivers, oceans, cities, islands, and peninsulas. Huangshi City is located on the south bank of the middle reaches of the Yangtze River, facing the Yangtze River in the northeast and Huanggang City across the river, and it is rich in minerals. In the northwest and middle of the city, lakes such as Baoan, Sanshan, and Daye form a plain lake marshland, while the rest are low mountains and hills. Erenhot is flat and gently inclined from southwest to northeast. The land features include forests, deserts, grasslands, villages, and vegetation.
The objective of selecting Landsat 8–9 RSIs of different regions is to ensure that the newly-developed model performs very well for diverse land cover types.

6. Experimental Results and Analysis

To demonstrate the effectiveness of the newly developed method, extensive simulations were conducted using Landsat 8–9 RSIs. Since Landsat 8–9 RSIs (30-meter resolution) are too large, we adjusted the images by cropping, scaling, recombining, and synthesizing. After processing, the simulated Landsat 8–9 RSI had a 1000 × 1000 resolution used to evaluate the proposed CS model. Then, the CS model was applied to reconstruct the compressed sampling data and obtain the restored image, which was compared against the original image to assess the model. All simulations were conducted on an Intel (R) Core (TM) i9-10980XE CPU @ 3.00 GHz and with 128 GB RAM. The synthetic RSIs for reconstruction are illustrated in Figure 1:
Figure 1 illustrates a series of synthetic images obtained from the original Landsat 8–9 images, which were used to evaluate our algorithm after cutting and resizing. The above images were used in the newly developed CS model for reconstruction and comparative evaluation against other CS models, namely, NL-Laplace-CS, NL-SRF-CS [16], KCS-GSR [31], and NLDR-CS [32], and revealed the advantages and disadvantages of each model. The Landsat 8–9 RSIs were sampled using different frequency-domain sampling ratios (10%, 15%, 20%, and 25%) and were reconstructed using the above model. The corresponding reconstruction results are presented in Figure 2, Figure 3, Figure 4, Figure 5, Figure 6, Figure 7, Figure 8, Figure 9 and Figure 10.
Figure 2 reveals that the NL-Laplace-CS model performs better than NL-SRF-CS, KCS-GSR, and NLDR-CS considering reconstruction. From the first line (10%), the fourth line (15%), the seventh line (20%), and the tenth line (25%), it is evident that the images reconstructed by the NL-Laplace-CS model have no obvious edge blur, but the competitor method reconstructs images with a visible edge blur. The reconstructed image using the NL-SRF-CS model has information loss in surface features and heterogeneous regions of textures. The images reconstructed with the NL-Laplace-CS and KCS-GSR methods present fewer zigzag effects than the other models. The overall reconstruction result of the NLDR-CS model is better than the NL-Laplace-CS and KCS-GSR models but still slightly inferior to the NL-Laplace-CS model. The NL-Laplace-CS model has inherent noise suppression and, therefore, can suppress areas of high-frequency changes. However, from the different images in Figure 2e red magnified diagram at the lower left corner of each image), we observe that the NL-Laplace-CS model retains the most details.
Figure 3 illustrates the CS reconstruction results of the Landsat 8 RSI covering Selkirk, Manitoba, Canada, using the same model presented in Figure 2 Compared with the competitor models, the NL-SRF-CS and KCS-GSR models present large differences compared to the original images. Specifically, the images reconstructed with the NL-SRF-CS method have significant edge blurring and lost more details in areas with more edges. The images reconstructed with the KCS-GSR model have a sharp zigzag effect. Moreover, the results of images reconstructed by NLDR-CS show a greater data loss of surface features and edge areas than those reconstructed images using the NL-Laplace-CS model. The overall visual effect of the reconstructed image from the NL-Laplace-CS model has the highest fidelity relative to the original images.
Figure 4 depicts the CS reconstruction of a Landsat 8 RSI of Lake Flathead, Montana, USA, using the same model as in Figure 2 and Figure 3. The difference between the reconstructed image of the KCS-GSR model and the original image is the largest, followed by the NL-SRF-CS model and NLDR-CS model. However, the proposed NL-Laplace-CS model has the smallest difference from the original image. The reconstructed images of the NL-SRF-CS model have much edge blurring and loss of detail in the edge area, and the KCS-GSR reconstructed image also lost more details than the original image. The reconstructed image of the NLDR-CS model affords fine surface structure and edge information, but there is a minor blurring effect in the edge area. In the image reconstructed by the NL-Laplace-CS model, the partially magnified area (lower left red box diagram) reveals a good visual effect, while the details of edges and non-smooth areas are also well preserved.
Figure 5 illustrates the resulting images of CS reconstruction of Landsat 8 RSIs from Lincoln, Washington, USA, using the model of Figure 2. The difference images show that the reconstructed result images of the KCS-GSR model and the NLDR-CS model differ the most from the original image, and the proposed NL-Laplace-CS model differs the least. For KCS-GSR and NLDR-CS models, the reconstructed image’s local magnified area (red block diagram in the lower left corner) has a more obvious edge blur. Furthermore, the reconstructed images of the NL-SRF-CS model reveal that the reconstruction results are significantly serrated, and there is also a small fuzzy effect in the uneven areas. For the NL-Laplace-CS model, the reconstructed images afford a good visualization, the suppression of details is invisible, and the boundaries of each object region in the image are well preserved.
Table 2 summarizes the number of pixels within a range ( ± 260 ) of around 0 for each image. The more pixels within a pixel value range around 0, the better the reconstruction effect. Table 2 highlights the fact that most pixels of the different numbers between the image reconstructed by the NL-Laplace-CS model and the original image are concentrated in the range 260 , 260 . Moreover, Figure 2, Figure 3, Figure 4 and Figure 5 illustrate that the range 0 , 260 of the pixel values is very small compared to 16-bit images (0–65535). Besides, Table 2 reveals that the percentage of pixel difference within the 260 , 260 range between the reconstructed image of the NL-Laplace-CS model and the original image is the largest (the percentage of the whole image), indicating that the fidelity of a Landsat 8 RSI reconstructed by the proposed NL-Laplace-CS model is the highest.
To further evaluate our model’s performance, we employ three quantitative image quality indicators (PQI): root mean square error (RMSE), peak signal-to-noise ratio (PSNR), and structural similarity (SSIM) [33]. A lower RMSE value, higher PSNR value, or higher SSIM value indicates a better model performance. Table 3 summarizes the PQI values in different areas for each model presented in Figure 2, Figure 3, Figure 4 and Figure 5. For the Antarctic region (Figure 2), the difference in the RMSE values between the competitor models is obvious, as the RMSE values of the NL-SRF-CS model are significantly larger, followed by the RMSE of the KCS-GSR model and NLDR-CS model. The NL-Laplace-CS model has the smallest RMSE among all models.
Moreover, the average error generated by the NL-Laplace-CS model in all geographic regions is the smallest among all models for all sampling ratios. For Selkirk in Manitoba, Canada (Figure 3), all models have similar PSNR values, but the PSNR values of NL-SRF-CS and KCS-GSR models are relatively smaller than the other models. Although the NLDR-CS model has high PSNR values, it changes relatively slowly with the sampling rate increasing. In any case, the PSNR of the NL-Laplace-CS model is the maximum. Furthermore, the PSNR results (see Table 3) indicate that the NL-Laplace-CS model performs well, and its SSIM value is greater than the competitor models. Although the SSIM value increases with the image sampling rate, the rate at which the new model increases is much larger than the other models. These PQI results indicate that the newly developed NL-Laplace-CS model has lower RMSE values, higher PSNR and SSIM values, better visual effects, and edge preservation.
The second group of satellite images used in our simulations involves the Landsat 9 L2SP product in the red band (30-meter) with a wavelength range of 640–670 nm. Similar to the Landsat 8 synthetic simulation images, the Landsat 9 image was trimmed and scaled to obtain the simulation Landsat 9 data presented in the second row in Figure 1. Finally, we evaluated that dataset with the NL-SRF-CS, KCS-GSR, NLDR-CS, and NL-Laplace-CS models and analyze the performance of each algorithm through the simulation results.
Figure 6 illustrates the CS reconstruction images of the Landsat 9 RSIs from Lake Abitibi, Ontario, Canada, using the model presented in Figure 2. In the algorithm simulation experiment in this region, various CS reconstruction models can reconstruct the resulting images well. However, there are still some differences, as Figure 6 highlights the fact that the NL-SRF-CS model has a good reconstruction effect in the relatively smooth area, but the reconstruction effect in the edge area and the detailed area is unsatisfactory. The reconstructed resulting images of the KCS-GSR model are quite different from the original images; namely, there is a certain gap between the overall reconstruction results of the KCS-GSR model and those of the NLDR-CS model and NL-Laplace-CS model. For NL-Laplace-CS and NLDR-CS models, the reconstructed image’s local magnified area (red block diagram in the lower left corner) has more obvious detail preservation. At the same time, the reconstruction results of the proposed NL-Laplace-CS model have the least difference from the original images.
Figure 7 depicts the resulting images of the CS reconstruction of the Landsat 9 RSI of Yeosu, South Korea, using the model presented in Figure 2. For this area, the reconstructed images of all CS reconstruction models present unsatisfactory results, mainly due to the geographic details in this region. Figure 7 reveals that the KCS-GSR model’s reconstructed images differ the most from the original ones, followed by the NL-SRF-CS model. The NLDR-CS model shows better reconstruction results but is still imperfect in the marginal and detailed areas. The reconstruction results of the proposed NL-Laplace-CS model present minor differences from the original images and thus affords the best visual effect.
Figure 8, Figure 9 and Figure 10 demonstrate each competitor algorithm’s advantages and disadvantages based on each image’s corresponding reconstruction result. However, due to paper length limitations, we neglect a detailed analysis. Additionally, Table 4 summarizes the number of pixels within a range ( ± 260 ) of around 0 for different Landsat 9 images. The more pixel values within the range around 0, the better the reconstruction effect. Table 4 reveals that most pixels of the NL-Laplace-CS model-based reconstructed images are concentrated within the range 260 , 260 , as illustrated in Figure 6, Figure 7, Figure 8, Figure 9 and Figure 10. For 16-bit images (0 to 65,535), the range of (0 to 260) is very small. Table 4 highlights the fact that the NL-Laplace-CS model has the largest percentage of pixels (percentage of the whole image) in a range of around 0, indicating that its performance is best among the models evaluated.
To further evaluate the proposed model’s performance, we calculate the RMSE, PSNR, and SSIM values on the CS reconstructed Landsat 9 images. Table 5 summarizes the information presented in Figure 6, Figure 7, Figure 8, Figure 9 and Figure 10 and highlights the fact that the NL-Laplace-CS model has the lowest RMSE value and the highest PSNR and SSIM values. The resulting images used for the CS reconstruction based on the NL-Laplace-CS model had the best visual effect, namely, the most preserved edge information and image details.

7. Discussion

The NL-Laplace-CS regularization method relies on the appropriate adjustment of the data fidelity and weight parameters in the regularization terms. With the optimal choice of the weight parameters, this method yields the best reconstruction results. The experiments use the Landsat 8–9 RSI for CS simulation reconstruction, and we compared the reconstruction results obtained from the Landsat 8–9 RSI simulation with the NL-Laplace-CS model against the NL-SRF-CS, KCS-GSR, and NLDR-CS image reconstruction models. We also compared these reconstruction results with the original Landsat 8–9 RSI. The results highlighted that the new NL-Laplace-CS had lower RMSE values, higher PSNR and SSIM values, and better visual effects than the competitor models. Errors mostly occur between geological structures and land cover classes in the transition zone. The resulting images of the CS reconstruction of the newly developed NL-Laplace-CS model reveal that, even in such a transition zone, the reconstructed pixel values still have a high fidelity relative to the original Landsat 8–9 RSIs. This is important because most remote sensing image applications require high fidelity in the transition zone to clarify the geological surface features with complex geographical compositions.

8. Conclusions

This work developed a Landsat 8–9 RSI CS reconstruction model based on a non-local framework combined with low-rank regularization approximation of non-convex Laplace functions, which was solved using the ADMM algorithm. The proposed NL-Laplace-CS model was challenged against advanced CS image reconstruction models such as NL-SRF-CS, KCS-GSR, and NLDR-CS in a simulation reconstruction for Landsat 8–9 RSIs. The simulation results revealed that the proposed NL-Laplace-CS model effectively utilized similar image patches of sparse groups and established a low-rank regularized approximate minimization model of non-convex Laplace functions, suggesting a very effective method for CS reconstruction of Landsat 8–9 RSIs. Specifically, the proposed NL-Laplace-CS model has lower RMSE values, higher PSNR and SSIM values, and outperforms state-of-the-art CS image reconstruction models such as NL-SRF-CS, KCS-GSR, and NLDR-CS.

Author Contributions

Conceptualization, G.L. and W.J.; methodology, J.M. and G.L.; software, W.J. and G.L.; investigation, J.M. and G.L.; data curation, W.J. and G.L.; writing—original draft preparation, W.J. and G.L.; writing—review and editing, G.L. and Y.T.; visualization, W.Z. and L.L.; project administration, W.J. and Y.L.; funding acquisition, Y.L. and L.L. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the National Natural Science Foundation (Grant No. 12271083), the Sichuan Science and Technology Project (Grant No. 2021ZYD0021, 2022NSFSC0530, 2022NSFSC0507, 23NSFSC2062), the Southwest Minzu University Research Startup Funds (Grant No. RQD2021066), and the APC was funded by the Sichuan Science and Technology Project (Grant No. 2021ZYD0021).

Institutional Review Board Statement

Not applicable.

Data Availability Statement

The data presented in this study are available on request from the corresponding author.

Acknowledgments

The authors would like to express their gratitude to Edit Springs for the expert linguistic services provided 12 March 2023 (https://www.editsprings.cn).

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Goldfarb, D.; Qin, Z. Robust Low-rank Tensor Recovery: Models and Algorithms. SIAM J. Matrix Anal. Appl. 2013, 35, 225–253. [Google Scholar] [CrossRef] [Green Version]
  2. Cheng, Z.; Chen, B.; Liu, G.; Zhang, H.; Lu, R.; Wang, Z. Memory-efficient network for large-scale video compressive sensing. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA, 20–25 June 2021; pp. 16246–16255. [Google Scholar]
  3. Donoho, D. Compressed sensing. IEEE Trans. Inf. Theory 2006, 52, 128–1305. [Google Scholar] [CrossRef]
  4. Candè, E.J.; Wakin, M.B. An introduction to compressive sampling. IEEE Signal Process. Mag. 2008, 25, 21–30. [Google Scholar] [CrossRef]
  5. Yuan, X.; Yang, J. Sparse and low-rank matrix decomposition via alternating direction methods. Pac. J. Optim. 2013, 9, 167–180. [Google Scholar]
  6. Hillar, C.J.; Lim, L.H. Most tensor problems are np-hard. J. ACM 2013, 7, 1–39. [Google Scholar] [CrossRef] [Green Version]
  7. Liu, J.; Huang, T.-Z.; Selesnick, I.W.; Lv, X.-G.; Chen, P.-Y. Image restoration using total variation with overlapping group sparsity. Inf. Sci. 2015, 295, 232–246. [Google Scholar] [CrossRef] [Green Version]
  8. Fan, Y.R.; Huang, T.Z.; Liu, J.; Zhao, X.L. Compressive sensing via nonlocal smoothed rank function. PLoS ONE 2016, 11, e0162041. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  9. Ji, T.Y.; Yokoya, N.; Zhu, X.X.; Huang, T.Z. Nonlocal tensor completion for multitemporal remotely sensed images’ inpainting. IEEE Trans. Geosci. Remote. Sens. 2018, 56, 3047–3061. [Google Scholar] [CrossRef]
  10. Zhang, S.; Zhu, Y.; Dong, G.; Kuang, G. Truncated SVD-based compressive sensing for downward-looking three-dimensional SAR imaging with uniform/nonuniform linear array. IEEE Geosci. Remote Sens. Lett. 2015, 12, 1853–1857. [Google Scholar] [CrossRef]
  11. Miao, J.Q.; Zhou, X.B.; Huang, T.Z.; Zhang, T.B.; Zhou, Z.M. A Novel Inpainting Algorithm for Recovering Landsat-7 ETM+ SLC-OFF Images Based on the Low-rank Approximate Regularization Method of Dictionary Learning with Non-local and Non-convex models. IEEE Trans. Geosci. Remote Sens. 2019, 57, 6741–6754. [Google Scholar] [CrossRef]
  12. Dong, W.; Shi, G.; Li, X.; Ma, Y.; Huang, F. Compressive sensing via nonlocal low-rank regularization. IEEE Trans. Image Process. 2014, 23, 3618–3632. [Google Scholar] [CrossRef]
  13. Ji, T.Y.; Huang, T.Z.; Zhao, X.L.; Ma, T.H.; Deng, L.J. A non-convex tensor rank approximation for tensor completion. Appl. Math. Model. 2017, 48, 410–422. [Google Scholar] [CrossRef]
  14. Dong, W.; Shi, G.; Li, X. Nonlocal image restoration with bilateral variance estimation: A low-rank approach. IEEE Trans. Image Process. 2013, 22, 700–711. [Google Scholar] [CrossRef] [PubMed]
  15. Dong, W.; Zhang, L.; Shi, G.; Wu, X. Image deblurring and super-resolution by adaptive sparse domain selection and adaptive regularization. IEEE Trans. Image Process. 2011, 20, 1838–1857. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  16. Fan, Y.R.; Buccini, A.; Donatelli, M.; Huang, T.Z. A non-convex regularization approach for compressive sensing. Adv. Comput. Math. 2019, 45, 563–588. [Google Scholar] [CrossRef]
  17. Su, Q.; Zhang, X.; Wang, H. A blind color image watermarking algorithm combined spatial domain and SVD. Int. J. Intell. Syst. 2022, 37, 4747–4771. [Google Scholar] [CrossRef]
  18. Taha, A.; Alrabeiah, M.; Alkhateeb, A. Enabling large intelligent surfaces with compressive sensing and deep learning. IEEE Access 2021, 9, 44304–44321. [Google Scholar] [CrossRef]
  19. Deng, L.J.; Guo, W.; Huang, T.Z. Single-image super-resolution via an iterative reproducing kernel Hilbert space method. IEEE Trans. Circuits Syst. Video Technol. 2016, 26, 2001–2014. [Google Scholar] [CrossRef]
  20. Cai, J.F.; Osher, S.; Shen, Z. Split Bregman methods and frame based image restoration. Multiscale Model. Simul. 2009, 8, 337–369. [Google Scholar] [CrossRef]
  21. Boyd, S.; Parikh, N.; Chu, E.; Peleato, B.; Eckstein, J. Distributed optimization and statistical learning via the alternating direction method of multipliers. Found. Trends Mach. Learn. 2011, 3, 1–122. [Google Scholar] [CrossRef]
  22. Chen, C.; Ng, M.K.; Zhao, X.L. Alternating direction method of multipliers for nonlinear image restoration problems. IEEE Trans. Image Process. 2015, 24, 33–43. [Google Scholar] [CrossRef] [PubMed]
  23. Dong, W.; Fu, F.; Shi, G.; Cao, X.; Wu, J.; Li, G.; Li, X. Hyperspectral Image Super-Resolution via Non-Negative Structured Sparse Representation. IEEE Trans. Image Process. Publ. IEEE Signal Process. Soc. 2016, 25, 2337–2352. [Google Scholar] [CrossRef] [PubMed]
  24. Xu, W.H.; Zhao, X.L.; Ji, T.Y.; Miao, J.Q.; Ma, T.H.; Wang, S.; Huang, T.H. Laplace function based non-convex surrogate for low-rank tensor completion. Signal Process. Image Commun. 2019, 73, 62–69. [Google Scholar] [CrossRef]
  25. Malek-Mohammadi, M.; Babaie-Zadeh, M.; Amini, A.; Jutten, C. Recovery of low-rank matrices under affine constraints via a smoothed rank function. IEEE Trans. Signal Process. 2014, 62, 981–992. [Google Scholar] [CrossRef] [Green Version]
  26. Chen, Y.; Guo, Y.; Wang, Y.; Wang, D.; Peng, C.; He, G. Denoising of hyperspectral images using nonconvex low rank matrix approximation. IEEE Trans. Geosci. Remote. Sens. 2017, 55, 5366–5380. [Google Scholar] [CrossRef]
  27. Lu, C.; Tang, J.; Yan, S.; Lin, Z. Generalized nonconvex non-smooth low-rank minimization. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA, 23–28 June 2014; pp. 4130–4137. [Google Scholar]
  28. Zhao, X.L.; Wang, W.; Zeng, T.Y.; Huang, T.H.; Ng, M.K. Total variation structured total least squares method for image restoration. SIAM J. Sci. Comput. 2013, 35, B1304–B1320. [Google Scholar] [CrossRef] [Green Version]
  29. Zhao, X.L.; Wang, F.; Ng, M.K. A new convex optimization model for multiplicative noise and blur removal. SIAM J. Imaging Sci. 2014, 7, 456–475. [Google Scholar] [CrossRef]
  30. Niroumand-Jadidi, M.; Legleiter, C.J.; Bovolo, F. River Bathymetry Retrieval From Landsat-9 Images Based on Neural Networks and Comparison to SuperDove and Sentinel-2. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 2022, 15, 5250–5260. [Google Scholar] [CrossRef]
  31. Canh, T.N.; Dinh, K.Q.; Jeon, B. Detail-preserving compressive sensing recovery based on cartoon texture image decomposition. In Proceedings of the International Conference on Image Processing (ICIP), Paris, France, 27–30 October 2014; pp. 1327–1331. [Google Scholar]
  32. Li, S.; Qi, H. A Douglas–Rachford splitting approach to compressed sensing image recovery using low-rank regularization. IEEE Trans. Image Process. 2015, 24, 4240–4249. [Google Scholar] [CrossRef]
  33. Wang, Z.; Bovik, A.C.; Sheikh, H.R.; Simoncelli, E.P. Image quality assessment: From error visibility to structural similarity. IEEE Trans. Image Process. 2004, 13, 600–612. [Google Scholar] [CrossRef] [Green Version]
Figure 1. Synthetic Landsat 8–9 RSIs used for model evaluation. The first row presents the synthetic Landsat 8 images (from left to right: the first image was collected in Antarctica on 22 February 2018; the second image was collected in Selkirk, Manitoba, Canada, on 7 October 2022; the third image was collected in Lake Flathead, Montana, USA, on 29 September 2017; the last image was collected in Lincoln, Washington, USA on 15 October 2015). The second row presents the synthetic Landsat 9 RSIs (from left to right: the first image was collected in Lake Abitibi, Ontario, Canada, on 11 October 2022; the second image was collected in Yeosu, Korea, on 12 October 2022; the third image was collected in Shanghai, China on 8 April 2022; the fourth image was collected in Huangshi, Hubei, China on 13 October 2022; the last image was collected in Erenhot, Inner Mongolia, China on 28 July 2022).
Figure 1. Synthetic Landsat 8–9 RSIs used for model evaluation. The first row presents the synthetic Landsat 8 images (from left to right: the first image was collected in Antarctica on 22 February 2018; the second image was collected in Selkirk, Manitoba, Canada, on 7 October 2022; the third image was collected in Lake Flathead, Montana, USA, on 29 September 2017; the last image was collected in Lincoln, Washington, USA on 15 October 2015). The second row presents the synthetic Landsat 9 RSIs (from left to right: the first image was collected in Lake Abitibi, Ontario, Canada, on 11 October 2022; the second image was collected in Yeosu, Korea, on 12 October 2022; the third image was collected in Shanghai, China on 8 April 2022; the fourth image was collected in Huangshi, Hubei, China on 13 October 2022; the last image was collected in Erenhot, Inner Mongolia, China on 28 July 2022).
Entropy 25 00523 g001
Figure 2. Reconstruction Results using Sampling Rates of 10%, 15%, 20%, and 25% for a Landsat 8 RSI in Antarctica, (a) original Landsat 8 RSI of Antarctica, (be) of the first row (10%), the fourth row (15%), the seventh row (20%), and the tenth row (25%) are the reconstruction result images of NL-SRF-CS, KCS-GSR, NLDR-CS, and NL-Laplace-CS models, respectively. The red square area in the lower left corner of each image is the magnified form of the selected area in the image, which is convenient for observing the details of the reconstruction results. The images in the second, fifth, eighth, and eleventh rows are the differences between the reconstructed and original images corresponding to each sampling ratio. The third, sixth, ninth, and twelfth rows show the histograms of the corresponding difference image.
Figure 2. Reconstruction Results using Sampling Rates of 10%, 15%, 20%, and 25% for a Landsat 8 RSI in Antarctica, (a) original Landsat 8 RSI of Antarctica, (be) of the first row (10%), the fourth row (15%), the seventh row (20%), and the tenth row (25%) are the reconstruction result images of NL-SRF-CS, KCS-GSR, NLDR-CS, and NL-Laplace-CS models, respectively. The red square area in the lower left corner of each image is the magnified form of the selected area in the image, which is convenient for observing the details of the reconstruction results. The images in the second, fifth, eighth, and eleventh rows are the differences between the reconstructed and original images corresponding to each sampling ratio. The third, sixth, ninth, and twelfth rows show the histograms of the corresponding difference image.
Entropy 25 00523 g002
Figure 3. CS reconstruction result images of a Landsat 8 RSI in Selkirk, Manitoba, Canada, are the same as the second image on the left of the top row of Figure 1. (ae) The specific details of the images are the ones presented in Figure 2.
Figure 3. CS reconstruction result images of a Landsat 8 RSI in Selkirk, Manitoba, Canada, are the same as the second image on the left of the top row of Figure 1. (ae) The specific details of the images are the ones presented in Figure 2.
Entropy 25 00523 g003
Figure 4. CS reconstruction result images of a Landsat 8 RSI in Lake Flathead, Montana, USA ((ae) similar to Figure 2 and the third to the left image in the first line of Figure 1).
Figure 4. CS reconstruction result images of a Landsat 8 RSI in Lake Flathead, Montana, USA ((ae) similar to Figure 2 and the third to the left image in the first line of Figure 1).
Entropy 25 00523 g004
Figure 5. CS reconstruction result images of a Landsat 8 RSI in Lincoln, Washington, USA ((ae) similar to Figure 2 and the last image in the first line of Figure 1).
Figure 5. CS reconstruction result images of a Landsat 8 RSI in Lincoln, Washington, USA ((ae) similar to Figure 2 and the last image in the first line of Figure 1).
Entropy 25 00523 g005
Figure 6. CS reconstruction result images of a Landsat 9 RSI in Lake Abitibi, Ontario, Canada, using various models ((ae) similar to Figure 2 and the first image on the left in the second row of Figure 1).
Figure 6. CS reconstruction result images of a Landsat 9 RSI in Lake Abitibi, Ontario, Canada, using various models ((ae) similar to Figure 2 and the first image on the left in the second row of Figure 1).
Entropy 25 00523 g006
Figure 7. Landsat 9 remote CS reconstruction of Yeosu using various models ((ae) similar to Figure 6 and the second left image in the second row of Figure 1).
Figure 7. Landsat 9 remote CS reconstruction of Yeosu using various models ((ae) similar to Figure 6 and the second left image in the second row of Figure 1).
Entropy 25 00523 g007
Figure 8. CS reconstruction result images of a Landsat 9 RSI in Shanghai, China, using various models ((ae) similar to Figure 6 and the second left image in the second row of Figure 1).
Figure 8. CS reconstruction result images of a Landsat 9 RSI in Shanghai, China, using various models ((ae) similar to Figure 6 and the second left image in the second row of Figure 1).
Entropy 25 00523 g008
Figure 9. CS reconstruction result images of a Landsat 9 RSI in Huangshi, Hubei, China, using various models ((ae) similar to Figure 6 and the fourth left image in the second row of Figure 1).
Figure 9. CS reconstruction result images of a Landsat 9 RSI in Huangshi, Hubei, China, using various models ((ae) similar to Figure 6 and the fourth left image in the second row of Figure 1).
Entropy 25 00523 g009
Figure 10. CS reconstruction result images of a Landsat 9 RSI in Erenhot, Inner Mongolia, China, using various models ((ae) similar to Figure 6 and the last image in the second row of Figure 1).
Figure 10. CS reconstruction result images of a Landsat 9 RSI in Erenhot, Inner Mongolia, China, using various models ((ae) similar to Figure 6 and the last image in the second row of Figure 1).
Entropy 25 00523 g010
Table 1. The images and regions used for the CS reconstruction algorithm of remote sensing image.
Table 1. The images and regions used for the CS reconstruction algorithm of remote sensing image.
Image Locations and Date
Remote Sensing Image TypeLocationsWRS2
(Worldwide Reference System 2)
Date
Landsat 8Antarctica12811122/02/2018
Selkirk, Manitoba, Canada03102507/10/2022
Lake Flathead, Montana, USA04102729/09/2017
Lincoln, Washington, USA04402715/10/2015
Landsat 9Lake Abitibi, Ontario, Canada01902611/10/2022
Yeosu, Republic of Korea11503612/10/2022
Shanghai, China11803808/04/2022
Huangshi, Hubei, China12203913/10/2022
Erenhot, Inner Mongolia, China12703028/07/2022
Table 2. Percentage of the number of pixels (in a small range 260 , 260 of around 0) of the difference images between the original Landsat 8 RSI and the reconstructed image using different CS models.
Table 2. Percentage of the number of pixels (in a small range 260 , 260 of around 0) of the difference images between the original Landsat 8 RSI and the reconstructed image using different CS models.
Landsat 8
Remote Sensing
Image
Range of
Pixel
Value
RatePercentage of Pixels Occupied
NL-SRF-CSKCS-GSRNLDR-CSNL-Laplace-CS
InsideOutsideInsideOutsideInsideOutsideInsideOutside
Antarctica
128111_20180222
[ 260 , 260 ] 0.1031.731868.268251.817648.355770.919729.080386.548613.4514
[ 260 , 260 ] 0.1540.978359.021755.645744.533677.859022.141094.20105.7990
[ 260 , 260 ] 0.2044.693055.307058.509941.679182.776017.224097.97072.0293
[ 260 , 260 ] 0.2554.705345.294761.482638.712786.651713.348399.60800.3920
Selkirk, Manitoba,
Canada
031025_20221007
[ 260 , 260 ] 0.1030.707869.292238.921561.216660.493039.507066.722433.2776
[ 260 , 260 ] 0.1536.955863.044242.094158.049768.567031.433074.774225.2258
[ 260 , 260 ] 0.2039.874560.125545.064755.090575.508624.491482.878817.1212
[ 260 , 260 ] 0.2546.738953.261147.809752.349381.544018.456090.48729.5128
Flathead Lake,
Montana, USA,
041027_20170929
[ 260 , 260 ] 0.1077.419122.580978.454121.701284.859315.140793.99166.0084
[ 260 , 260 ] 0.1587.413712.586380.514019.633888.028711.971396.80533.1947
[ 260 , 260 ] 0.2088.300111.699982.632317.509990.40249.597698.81481.1852
[ 260 , 260 ] 0.2593.22026.779883.705116.439392.26637.733799.67930.3207
Lincoln,
Washington, USA
044027_2015288
[ 260 , 260 ] 0.1086.414713.585381.859218.301485.637814.362296.82693.1731
[ 260 , 260 ] 0.1594.44275.557387.794212.348089.072910.927198.64881.3512
[ 260 , 260 ] 0.2095.19544.804686.157813.987891.68878.311399.60900.3910
[ 260 , 260 ] 0.2597.90792.092187.794212.348093.71666.283499.91290.0871
Table 3. RMSE, PSNR, and SSIM values for different models in the Landsat 8 remote sensing image (RSI) study shown in Figure 2, Figure 3, Figure 4 and Figure 5.
Table 3. RMSE, PSNR, and SSIM values for different models in the Landsat 8 remote sensing image (RSI) study shown in Figure 2, Figure 3, Figure 4 and Figure 5.
Landsat 8 Remote-Sensing ImagesPQIs NL-SRF-CSKCS-GSRNLDR-CSNL-Laplace-CS
Antarctica
128111_20180222
Rate0.10RMSE898.253480.6734203.4486195.7073
PSNR37.261543.262450.092550.4973
SSIM0.94150.978080.99350.9942
Rate0.15RMSE641.1155412.0085153.7279130.5971
PSNR40.190744.805452.526654.0107
SSIM0.95980.98280.99590.9971
Rate0.20RMSE539.2623373.2582124.795993.5328
PSNR41.693545.846754.337656.9102
SSIM0.96640.985610.99710.9984
Rate0.25RMSE401.2769326.7187104.849768.3434
PSNR44.260647.313455.850359.6355
SSIM0.9780.988820.99790.9991
Selkirk, Manitoba,
Canada,
031025_20221007
Rate0.10RMSE833.0314699.6305360.0842307.8145
PSNR37.916239.530145.133546.5637
SSIM0.9240.937740.97770.9834
Rate0.15RMSE639.0923620.12276.0758242.2749
PSNR40.218240.616347.44148.6433
SSIM0.94470.94760.98590.9893
Rate0.20RMSE555.8848553.2539220.699190.908
PSNR41.429841.651449.385650.713
SSIM0.95430.956530.99060.9931
Rate0.25RMSE446.627501.8709179.8765149.425
PSNR43.330642.539251.162152.841
SSIM0.99480.96330.99350.9957
Flathead Lake,
Montana, USA
041027_20170929
Rate0.10RMSE251.2652243.7577177.0215130.6265
PSNR48.326849.354951.301154.0088
SSIM0.99150.9920.99380.9964
Rate0.15RMSE190.7938226.0831152.4969109.2699
PSNR50.718250.174352.596455.5595
SSIM0.99390.992920.99510.9974
Rate0.20RMSE178.4575206.608134.718488.429
PSNR51.298851.194553.673157.3976
SSIM0.99450.993960.9960.9982
Rate0.25RMSE147.1679198.9782120.640372.7902
PSNR52.973251.634654.631859.088
SSIM0.99590.994470.99670.9988
Lincoln, Washington,
USA, 044027_2015288
Rate0.10RMSE170.9491197.1138163.8181110.3724
PSNR51.672151.784351.974455.4723
SSIM0.99530.995050.9950.9974
Rate0.15RMSE129.7697184.5744142.78892.3254
PSNR54.06652.612253.167857.023
SSIM0.99670.995660.995957.023
Rate0.20RMSE125.595174.4205126.31975.308
PSNR54.3553.321354.232258.7926
SSIM0.9970.996160.99660.9987
Rate0.25RMSE105.3094166.1922113.333562.0297
PSNR55.880153.986755.174460.4775
SSIM0.99770.99660.99720.9991
Table 4. Number of pixels in a small range around 0 (in percentage) of the difference images between the original Landsat 9 RSI and the reconstructed image using different CS models.
Table 4. Number of pixels in a small range around 0 (in percentage) of the difference images between the original Landsat 9 RSI and the reconstructed image using different CS models.
Landsat 9
Remote Sensing
Image
Range of
Pixel
Value
RatePercentage of Pixels Occupied
NL-SRF-CSKCS-GSRNLDR-CSNL-Laplace-CS
InsideOutsideInsideOutsideInsideOutsideInsideOutside
Lake Abitibi,
Ontario, Canada
019026_20221011
[ 260 , 260 ] 0.1086.179413.820681.830718.334386.325213.674895.45894.5411
[ 260 , 260 ] 0.1593.34026.659883.711616.446988.656311.343797.70122.2988
[ 260 , 260 ] 0.2094.21585.784285.296614.848490.64639.353799.11530.8847
[ 260 , 260 ] 0.2597.19152.808586.546613.595992.39517.604999.75080.2492
Yeosu, Korea
115036_20221012
[ 260 , 260 ] 0.1056.789943.210166.328533.827380.714319.285782.927817.0722
[ 260 , 260 ] 0.1570.692529.307568.237231.919184.925815.074287.384912.6151
[ 260 , 260 ] 0.2072.417527.582569.634530.527488.233411.766692.17327.8268
[ 260 , 260 ] 0.2579.808220.191870.979029.182891.06568.934496.09453.9055
Shanghai, China
118038_20220408
[ 260 , 260 ] 0.1053.952646.047465.224034.939779.806720.193383.392616.6074
[ 260 , 260 ] 0.1565.821334.178766.530233.637684.356015.644087.187312.8127
[ 260 , 260 ] 0.2067.461932.538167.901332.269688.057911.942192.18897.8111
[ 260 , 260 ] 0.2575.592324.407768.776631.394791.13118.868996.22433.7757
Huangshi, Hubei,
China
122039_20221013
[ 260 , 260 ] 0.1049.532150.467955.523544.643465.593334.406768.380731.6193
[ 260 , 260 ] 0.1560.225839.774257.751242.428971.278728.721373.071526.9285
[ 260 , 260 ] 0.2063.558036.442059.754140.425176.411323.588778.874021.1260
[ 260 , 260 ] 0.2570.971929.028161.648438.529081.146718.853384.383915.6161
Erenhot, Inner
Mongolia, China
127030_20220728
[ 260 , 260 ] 0.1064.597235.402867.363732.821775.747324.252788.750611.2494
[ 260 , 260 ] 0.1578.593021.407069.772630.413679.786220.213892.65477.3453
[ 260 , 260 ] 0.2079.651020.349071.620628.570683.079616.920495.98274.0173
[ 260 , 260 ] 0.2587.118212.881873.074227.116985.781214.218898.20611.7939
Table 5. RMSE, PSNR, and SSIM values of the different models in the Landsat 9 RSI study, as illustrated in Figure 6, Figure 7, Figure 8, Figure 9 and Figure 10.
Table 5. RMSE, PSNR, and SSIM values of the different models in the Landsat 9 RSI study, as illustrated in Figure 6, Figure 7, Figure 8, Figure 9 and Figure 10.
Landsat 9 Sensing ImagePQIs NL-SRF-CSKCS-GSRNLDR-CSNL-Laplace-CS
Lake Abitibi, Ontario, Canada 019026_20221011Rate0.10RMSE178.6558202.9490165.8346122.6032
PSNR51.289151.338951.868154.5594
SSIM0.99460.99420.99450.9967
Rate0.15RMSE139.6148191.3931148.7677104.8770
PSNR53.430852.043552.811455.9159
SSIM0.99610.99480.99530.9975
Rate0.20RMSE133.2829181.8600135.400388.0589
PSNR53.834052.662853.629257.4340
SSIM0.99650.99540.99600.9982
Rate0.25RMSE112.5607174.6843124.127574.0333
PSNR55.301753.179454.384258.9409
SSIM0.99730.99580.99650.9987
Yeosu, Korea, 115036_20221012Rate0.10RMSE357.9920352.5152234.8635211.7692
PSNR45.252045.737048.845349.8122
SSIM0.98090.98050.98850.9907
Rate0.15RMSE277.7287325.7535191.6372175.6439
PSNR47.457146.492450.612051.4368
SSIM0.98600.98260.99200.9935
Rate0.20RMSE255.6346308.1822160.4600140.0482
PSNR48.177147.033152.154353.4039
SSIM0.98800.98420.99430.9958
Rate0.25RMSE212.1976290.5371136.3814111.8590
PSNR49.794747.609553.566555.3560
SSIM0.99110.98570.99580.9972
Shanghai, China, 118038_20220408Rate0.10RMSE421.4962375.1064235.0718213.3513
PSNR43.833645.274348.837649.7476
SSIM0.97670.97870.98860.9908
Rate0.15RMSE317.1140353.8817185.3175178.0600
PSNR46.305245.832050.903351.3181
SSIM0.98320.98050.99260.9935
Rate0.20RMSE290.2904327.6273150.3745137.9961
PSNR47.072846.583452.718153.5321
SSIM0.98540.98280.99500.9960
Rate0.25RMSE236.4489316.6613123.8975108.0126
PSNR48.854746.923154.400455.6600
SSIM0.98940.98400.99660.9975
Huangshi, Hubei, China 122039_20221013Rate0.10RMSE396.5857388.7419292.8481277.0668
PSNR44.362744.850846.928847.4778
SSIM0.97550.97510.98200.9840
Rate0.15RMSE318.2901362.8340249.2427243.6536
PSNR46.273045.508248.329248.5940
SSIM0.98120.97750.98630.9874
Rate0.20RMSE291.5050341.4579215.0280209.8189
PSNR47.036546.078449.611749.8926
SSIM0.98390.97970.98950.9904
Rate0.25RMSE247.1052324.2598185.9369180.8646
PSNR48.471846.573350.874351.1824
SSIM0.98770.98150.99200.9928
Erenhot, Inner Mongolia, China 127030_20220728Rate0.10RMSE303.5128291.5269202.6761167.4437
PSNR46.685948.045250.125651.8521
SSIM0.98790.98880.99190.9942
Rate0.15RMSE222.9116271.3286173.9108141.6788
PSNR49.366848.850051.455153.3034
SSIM0.99150.99000.99360.9957
Rate0.20RMSE210.7621255.6723152.7735118.1105
PSNR49.853649.525552.580654.8837
SSIM0.99230.99110.99490.9969
Rate0.25RMSE171.3273244.1732136.670398.9114
PSNR51.652950.081053.548156.4245
SSIM0.99440.99190.99580.9978
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Li, G.; Jin, W.; Miao, J.; Tan, Y.; Li, Y.; Zhang, W.; Li, L. Remote Sensing Image of The Landsat 8–9 Compressive Sensing via Non-Local Low-Rank Regularization with the Laplace Function. Entropy 2023, 25, 523. https://doi.org/10.3390/e25030523

AMA Style

Li G, Jin W, Miao J, Tan Y, Li Y, Zhang W, Li L. Remote Sensing Image of The Landsat 8–9 Compressive Sensing via Non-Local Low-Rank Regularization with the Laplace Function. Entropy. 2023; 25(3):523. https://doi.org/10.3390/e25030523

Chicago/Turabian Style

Li, Guibing, Weidong Jin, Jiaqing Miao, Ying Tan, Yingling Li, Weixuan Zhang, and Liang Li. 2023. "Remote Sensing Image of The Landsat 8–9 Compressive Sensing via Non-Local Low-Rank Regularization with the Laplace Function" Entropy 25, no. 3: 523. https://doi.org/10.3390/e25030523

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop