Next Article in Journal
Assessment of Estimated Phycocyanin and Chlorophyll-a Concentration from PRISMA and OLCI in Brazilian Inland Waters: A Comparison between Semi-Analytical and Machine Learning Algorithms
Next Article in Special Issue
A Clutter Parameter Estimation Method Based on Origin Moment Derivation
Previous Article in Journal
Possible Future Climate Change Impacts on the Meteorological and Hydrological Drought Characteristics in the Jinghe River Basin, China
Previous Article in Special Issue
A Modified 2-D Notch Filter Based on Image Segmentation for RFI Mitigation in Synthetic Aperture Radar
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Technical Note

Recognizing the Shape and Size of Tundra Lakes in Synthetic Aperture Radar (SAR) Images Using Deep Learning Segmentation

1
Department of Space, Earth and Environment, Chalmers University of Technology, 412 96 Gothenburg, Sweden
2
School of Mathematics and Statistics, The Open University, Milton Keynes MK7 6AA, UK
3
The Center for Research and Invention, Veliky Novgorod 173008, Russia
4
Arctic and Antarctic Research Institute, Saint Petersburg 199397, Russia
5
Visual Computing Center, King Abdullah University of Science and Technology, Thuwal 23955, Saudi Arabia
*
Author to whom correspondence should be addressed.
Remote Sens. 2023, 15(5), 1298; https://doi.org/10.3390/rs15051298
Submission received: 15 January 2023 / Revised: 18 February 2023 / Accepted: 24 February 2023 / Published: 26 February 2023
(This article belongs to the Special Issue SAR-Based Signal Processing and Target Recognition)

Abstract

:
Permafrost tundra contains more than twice as much carbon as is currently in the atmosphere, and it is warming six times as fast as the global mean. Tundra lakes dynamics is a robust indicator of global climate processes, and is still not well understood. Satellite data, particularly, from synthetic aperture radar (SAR) is a suitable tool for tundra lakes recognition and monitoring of their changes. However, manual analysis of lake boundaries can be slow and inefficient; therefore, reliable automated algorithms are required. To address this issue, we propose a two-stage approach, comprising instance deep-learning-based segmentation by U-Net, followed by semantic segmentation based on a watershed algorithm for separating touching and overlapping lakes. Implementation of this concept is essential for accurate sizes and shapes estimation of an individual lake. Here, we evaluated the performance of the proposed approach on lakes, manually extracted from tens of C-band SAR images from Sentinel-1, which were collected in the Yamal Peninsula and Alaska areas in the summer months of 2015–2022. An accuracy of 0.73, in terms of the Jaccard similarity index, was achieved. The lake’s perimeter, area and fractal sizes were estimated, based on the algorithm framework output from hundreds of SAR images. It was recognized as lognormal distributed. The evaluation of the results indicated the efficiency of the proposed approach for accurate automatic estimation of tundra lake shapes and sizes, and its potential to be used for further studies on tundra lake dynamics, in the context of global climate change, aimed at revealing new factors that could cause the planet to warm or cool.

Graphical Abstract

1. Introduction

As permafrost thaws, some portion of its organic matter will be decomposed by microorganisms, emitting large amounts of greenhouse gases. This permafrost carbon–climate feedback is the largest terrestrial feedback to climate change, and one of the most likely to occur. It is increasingly recognized that the magnitude and timing of the permafrost carbon–climate feedback depends largely on the reorganization of hydrology (the distribution of wet and dry surfaces), and associated changes in redox conditions in permafrost landscapes [1,2,3]. One of the major hydrologic transitions that can occur during permafrost thaw is surface collapse due to the melting of ground ice supporting the soil profile. This abrupt, non-linear process, termed thermokarst, has proven exceedingly difficult to map, let alone predict [4,5,6]. In lowland landscapes, thermokarst can transform dry land to a lake.
In some areas of the permafrost zone, current or drained thermokarst lakes occupy 40–80% of the landscape surface, often forming characteristic features [7,8]. If permafrost thaw continues after lake formation, loss of frozen ground supporting the water body can trigger drainage of lakes to groundwater or connected river networks, decreasing the overall number and area of large lakes, but increasing residual small lakes. Generally, high latitudes of the permafrost zone are experiencing an increase in lake area, while lower latitudes of the permafrost zone are seeing a decrease, though trends are spatiotemporally complex [9,10,11,12,13]. Integrating permafrost lake formation and draining into Earth system models is a high priority in the permafrost community, for improving predictions of the permafrost climate feedback [14,15,16,17].
The abundance and size distribution of tundra lakes are important spatial characteristics of the landscape, for understanding the dynamics of permafrost thawing and related processes in tundra ecosystems. In addition, the trade of the shapes of tundra lake patterns can be rigorously quantified by employing these quantities. Many studies [18,19,20] have recently revealed that quantification of size distribution and fractal features requires a high volume of remote sensing data on the land surface. Statistical and geometrical parameters, such as size distribution and fractal dimension, could play a role, as a metric of the accuracy of tundra lakes image segmentation when real physical parameters are limited or unavailable.
Several studies have addressed the problem of automized tundra lakes recognition from satellite optical data. Manuscript [21] reports that the traditional way is to utilize image segmentation techniques, where images are divided into regions based on some features: for example, a paper by [22] employed a cloud-removal technique, called the function of mask (Fmask) algorithm, on Landsat imagery of a tundra surface. Automatic segmentation of water bodies in satellite imagery, to estimate lake size distributions, was considered in [23]. In [17], the authors applied robust linear trends based on the Theil–Sen regression algorithm, and random forest (RF) classification technique, by feeding pre-calculated spatiotemporal trend information, to analyze the lake dynamics across Northern permafrost regions. Application of supervised classification, using a maximum likelihood classifier and digital change detection, to identify areas of high erosion or deposition of permafrost, was investigated in [24].
Although data sets of permafrost surface features based on passive-microwave satellite data do exist [25,26], their spatial resolution is relatively coarse (20–50 km), and thus only allows for estimation of inundation fractions and their variations [27,28]. For accurate monitoring of waterbodies, data with a higher spatial resolution are required, as in tens of meters in a pixel [29]. Some optical instruments acquire high-resolution images (typically 1–15 m), but they depend on cloud cover conditions and the luminance of the surface, which significantly limits their utilization, particularly in polar regions. Thus, a number of studies have focused on synthetic aperture radar (SAR) data for recognition of permafrost surface features and quantifying their dynamics [30,31,32,33,34,35], including InSAR techniques [36,37,38]. SAR backscatter intensity strongly depends on the dielectric constant of the surface, and is very different for water and ice [39]. Thus, thanks to the high spatial resolution and the signature differences, SAR is a suitable tool for tundra lakes recognition in many cases.
Although the manual analysis of SAR data is sensor-independent, and relatively robust against misclassification [35,40,41], it is time-consuming; therefore, automated methods are preferable. Some studies have proposed using machine learning for characterizing Arctic tundra landscapes, including lakes [30,42]. To the best of our knowledge, state-of-the-art deep learning methods have not been previously applied to the problems of automatic tundra lakes recognition from SAR, and, thus, one of the primary aims of this study was to investigate the potential of deep learning for accurate tundra lake shape and size recognition. C-band Sentinel-1 images, freely available under the Copernicus Program, were used to develop a machine learning methodology capable of segmenting the images into two classes: tundra lakes and background. To assess the applicability of the method, we analyzed the generated time series of segmented Sentinel-1 images, for quantification of the lake spatial features in the Arctic region.
The rest of the paper is organized as follows. In Section 2, a description of satellite SAR data processing, selected test sites, reference data preparation and tundra lakes recognition algorithm workflows are given. The results obtained in this study are presented in Section 3, followed by discussion in Section 4. The main findings and implications are summarized in the conclusions in Section 5.

2. Materials and Methods

2.1. Satellite SAR Images and Test Sites

For our study, we selected two test sites in the Arctic region, characterized by the presence of tundra lakes: the Yamal Peninsula and Alaska. The regions are located far from each other, which allowed for an improved understanding of the performance of our approach in different environmental conditions. From the two test sites, we downloaded hundreds of Sentinel-1 Level-1.5 Ground Range Detected (GRD) dual-polarized data through the Alaska SAR Facility data archive facility, for the summer months of 2015–2022, when the lakes characterized their maximum development. The spatial boundaries of the collected images are depicted on a map in Figure 1.
Then, we computed the SAR backscattering coefficient σ 0 from digital numbers D N as
σ 0 = D N 2 / A 2 ,
where A was a calibration constant from a look-up table from auxiliary calibration files (for details, see [43]). Then, σ 0 was conventionally converted to dB: σ d b 0 = 10 · l o g ( σ 0 ) for both H V and H H polarizations. Finally, the data were projected onto a Polar Stereographic grid with a pixel size of 50 m. Radar backscattering σ 0 from water and ice is strongly angle-dependent, due to the specificities of SAR system geometry [39,44,45]: hence, information on the incidence angle ( I a ) is very useful for SAR data analysis. Contrary to polarization and frequency, I a is not fixed, and varies across the image. The backscatter intensity from a homogeneous surface varies with I a , and decreases across a SAR image from near-range (low I a ) to far-range (high I a ). To compensate for this effect, most research applies a global I a correction, using constant slope before the classification task [46,47,48]: however, in doing this, they neglect the known physical differences in backscatter behavior, with I a for different surface types. Thus, to take these specificities into account, we utilized incidence angle information in our recognition framework for every corresponding pixel. The Sentinel-1 metadata contained values of I a at certain points, which we extracted and interpolated onto the image grid by linear interpolation. Then, the values of σ H V 0 (Figure 2A), σ H H 0 (Figure 2B) and incidence angle I a (Figure 2C) were normalized in the range 0–1 by min–max normalization ( v a l u e m i n m a x m i n ), and then used to form a 3-channel image (Figure 2D). This data structure was used in both the training and segmentation stages.

2.2. Manual Mapping of Tundra Lakes

For the training of the U-Net, we prepared binary images containing manually annotated regions of tundra lakes. The analysis was performed manually by visual expert analysis, using VGG image annotator software [49]. The lakes were mapped in the Yamal and Alaska test sites (Figure 1), from tens of images, and stored as binary tiff files, where a pixel intensity of 255 corresponded to the lake, and 0 to the background. Overall, we generated sets of 668 and 296, respectively, of 512 × 512 images containing labeled lakes in the Yamal and Alaska sites [50]. An example of an image generated from manual recognition of tundra lakes is shown in Figure 3.

2.3. Automatic Tundra Lake Recognition from SAR Images

In this study, we propose a two-stage algorithm framework for tundra lakes recognition from SAR images. The algorithm operates with so-called semantic and instance segmentation. Semantic segmentation is the first stage, and associates every pixel of an image with a class label, such as a lake or other surface feature: it treats multiple objects of the same class as a single entity. By contrast, instance segmentation, which is the second stage, treats multiple objects of the same class as distinct individual instances. Here, we propose a combination of both methods, which is useful for separating touching or overlapping individual objects—which, in our case, were the lakes—for unambiguous estimation of their size and shape. The majority of semantic segmentation methods utilize encoder–decoder deep neural network structures, most of which are based on the U-Net architecture proposed in [51], which is an improved version of the fully convolutional network for medical images [52], and which has also been applied to the water bodies imagery [53,54]. The underlying technique of U-Net involves skipped connections, to improve gradient flow, and to allow for transferring of information between the down-sampling and up-sampling paths, by connecting each pair of encoder–decoder layers. In our algorithm framework, the U-Net took an input SAR image, classified each pixel in the image into tundra lake/background classes, and produced a binary image. The semantic segmentation by the U-Net was followed by instance segmentation with a classical watershed algorithm [55,56], which is a region-based technique that utilizes image morphology. The general scheme of our tundra lakes recognition workflow is shown in Figure 4.
The framework operated with Sentinel-1 data synthesized into 3-channel images, as described in Section 2.1. As a low-pass filter prior to classification and detection strongly improved the recognition results [30], we applied an anisotropic diffusion filter to suppress speckle appearance [57,58]. For training of the U-Net, the Adam optimizer [59] was employed with default parameters. A batch size of sixteen was used, and the network was trained for 200 epochs. As a loss function, the Jaccard similarity index or the Intersection over Union ( I o U = A r e a o f I n t e r s e c t i o n / A r e a o f U n i o n ) was used. This metric operated with the A r e a o f I n t e r s e c t i o n , which was the area where our predicted image overlapped the ground truth image, and the A r e a o f U n i o n , which combined our predicted image and the ground truth image. For the training, image patches of 512 × 512 pixels containing SAR data, and corresponding masks of tundra lakes labels, were used. After the U-Net training, an accuracy of 0.73, in terms of IoU, was achieved. The output of the semantic segmentation stage with U-Net was a binary image containing pixels with values of 0 (background) and 255 (tundra lakes).
Often, lakes can overlap or touch each other, therefore for accurate estimation of their shapes, special methods are required. To address this potential issue, we complemented our recognition framework with instance segmentation, which was the second stage. Here, we aimed at labeling each pixel of an image with a corresponding instance: in our case, the instance was an individual tundra lake. The watershed algorithm described in [56] was used. A chessboard metric was chosen, as it provided more robust results than other widely used metrics [60,61]. This step of our framework was implemented using a combination of several computer vision methods from the Python-based OpenCV framework [62]. In the following text, we complement the description of the processing methods with a corresponding reference to OpenCV functions.
First, we treated isolated groups of a few pixels as artificial, and discarded them using (cv2.morphologyEx). Then, we identified sure background areas, by convolving an image with a kernel, K, that replaced the image pixel in the anchor point position with that maximal value (cv2.dilate), consequently causing the tundra lake areas to extend their coverage. This increased the lake boundary to their background and, thus, we defined pixels that corresponded with certainty to the background (pixel value = 0). To find a sure foreground area, the distance transform method was used (cv2.distanceTransform), followed by thresholding the obtained values inside the foreground regions to their respective distances from the closest background value. The threshold of the distance transform was chosen empirically, and was 15% of its maximum value. Higher values might have resulted in the discarding of small lakes. Then, we estimated the ambiguous pixels (pixel value = 1 ) by subtracting the background from the foreground. Pixel labeling was performed, using (cv2.ConnectedComponents) for the three categories: foreground (1); background (0); and ambiguous ( 1 ). Finally, for defining instances that were individual lakes, watershed segmentation based on the derived markers was applied by (cv2.watershed). All the described steps are summarized in the pseudo-code Algorithm listing 1.
Algorithm 1: Tundra lake shapes recognition from SAR images
  • Prepare { S i } i = 1 N — a set of 3-channel SAR images (HH + HV + I a , where I a -incidence angle values).
  • Label tundra lakes from a subset { S j } j = 1 M { S i } , to create set of labeled images { L j } j = 1 M .
  • Generate sets of 512 × 512 patches { P k S } k = 1 K and { P k L } k = 1 K from { S j } and { L j } .
  • Train U-Net model M for 200 epochs, based on { P k S } k = 1 K and { P k L } k = 1 K .
  • Generate a set of image patches { P x I } x = 1 X from SAR image for segmentation
  • for P x I P I do ( (
  •  Segment P x I with M into binary image B x I , where pixel value x of 255
  •  corresponds to the lakes, and to 0 for the background.
  • end (
  • Merge { B x I } x = 1 X into B I .
  • Remove small noisy areas in B I by morphological opening with kernel of 3 × 3 pixels.
  • Identify sure background area, by dilating x = 255 a few times, to increase lake boundary to background.
    Calculate Chessboard transform distance P DT for each pixel x.
  • Estimate foreground pixels x FG , by thresholding P DT as 15% of max ( P DT ) .
  • Estimate ambiguous pixels as x A = x = 255 x FG .
  • Define pixels that correspond to a certain lake (instance) by watershed segmentation, given as x Li = f ( B I , x A ) .

2.4. Measuring Trade Features of Segmented Lakes

The formation of geological objects entails different complex natural phenomena, and it is quite remarkable that some of them have identical fractal dimensions, as was shown for clouds, in the pioneering paper by [63]. Fractal theory [64] can be used as a method for studying partially correlated (over many scales) spatial phenomena that are not differentiable but are continuous. This theory helps quantify complex shapes or boundaries, and relates them to underlying processes that may affect pattern complexity. For simple objects like circles and polygons, the perimeter P scales as the square root of the area A. However, for complex planar regions, with fractal curves as their boundaries:
P A D ,
where the exponent D is the fractal dimension of the boundary curve.

Box Counting Method

The Box counting method is a computer method of extracting data from real pixel images, for further analysis. The methodology consists of breaking the whole image into smaller pieces, and counting the boxes with some particular feature.
In the fractal analysis, we have to count the number of boxes that cover the fractal, and to see how it changes when the size of the box is decreasing. The number of boxes should approximately follow a power law:
N = N 0 R d ,
where R is the size of box, and d is called Kolmogorov capacity or simply box-counting dimension.
There are other methods for counting fractal dimensions, such as the area–perimeter or divider method, which is also used in geological research [65]: in order to apply it, we need to detect boundaries with high precision, which is subject to segmentation method and resolution. Instead, the box-counting method provides a simple computer method that gives robust complexity characteristics for a mixed land–lakes object.

3. Results

3.1. Tundra Lakes Recognition by U-Net

To assess the performance of our framework (described in Section 2.3) for the lakes recognition, we applied it to Sentinel-1 Extra Wide Swath (EW) data acquired over the Yamal Peninsula on 23 August 2016 at 12:49:16. First, the data at HV- and HH-polarization mode were calibrated, and incidence angle information was extracted. Then, we projected them onto a polar stereographic grid with a grid step size of 50 m. A pseudo-RGB image was synthesized from the data, and is shown in Figure 5A. It should be noted that this image was not used in the training stage. Then, we applied a pre-trained U-Net to extract the tundra lakes from the data, and a binary image was generated (Figure 5B). Before the automatic recognition, we manually labeled the tundra lakes from the image, and used them as ground truth labels (Figure 5C). From visual inspection, in general, we saw good agreement between automatically and manually extracted lakes. However, the lake borders produced by our framework looked more smooth and more natural, compared to those manually extracted. To show the difference between the data, we subtracted the ground truth from the U-Net output, and the result is shown in Figure 5D. The blue areas correspond to lakes that were not detected by our U-Net, but were recognized by an expert, and the red, conversely, corresponded to areas which were recognized as lakes by the U-Net, but not in the manually derived image. In total, four lakes were not detected by the U-Net model (the blue blobs in Figure 5). The other differences mostly corresponded to lake border areas. As we mentioned above, the lake borders in the image generated by U-Net were more natural, and closer to what we see on the satellite image. Most of the very small lakes, the size of a few pixels, were not recognized either by U-Net or by expert analysis, because of their too-small sizes in terms of the SAR image resolution.

3.2. Instance Segmentation of the Lakes and Noise Filtering

To demonstrate the advantage of our tundra lakes recognition concept, let us consider an example of the lakes recognition products obtained from a Sentinel-1 image taken over the northern coast of Alaska (157.0301°W, 70.93083 ° N) on 20 October 2016 at 04:02:51. The result of segmentation by U-Net is shown in Figure 6A, after noisy areas removal in Figure 6B, and the final result obtained with instance segmentation using the watershed algorithm is in Figure 6C.
In the zoomed area in Figure 6D, we can recognize three lakes, but lake 2 and lake 3 are overlapped, which means that if we analyze their shapes they will be considered as one lake, which is not desirable, as we want to derive their spatial characteristics separately. Thanks to the instance segmentation stage of our framework, we can separate the two overlapped lakes by recognizing their borders (see Algorithm 1), and then applying the watershed algorithm. Finally, the lakes are separated and ready for further analysis, such as their shapes and sizes estimation (Figure 6F).

3.3. Fractal Dimension

Fractal dimension counted by the box-counting method led to the two following plots. It clearly showed that, except for some deviation, fractal dimension remained almost constant. Fluctuation could be explained as the computational process being vulnerable according to the choice of the size of the box, which was subject to the finite size of the pixels on the images.

3.4. Size Distribution

We calculated the size distribution of the lakes on historical maps, by means of MATLAB (R2022a, The MathWorks Inc., Natick, MA, USA) core function library skimage. The standard procedures counted the number of pixels associated with lands and lakes, which led to the plots below.

4. Discussion

Some of the most recent comprehensive comparisons between the original U-Net [51] and its modifications, such as [66,67], indicate that architectural changes in U-Net are potentially unnecessary for images formed from coherent signals and associated with increased trade and slower speed for the marginal performance gains [68]. Thus, in this study, we utilized the original architecture of U-Net. But, in future work, state-of-the-art modifications of U-Net can be assessed, to improve the performance.
As a loss function, binary cross-entropy computed by predicted values and ground truths is typically selected for segmentation tasks with U-Net. But the targets generally occupy a small part of the entire training image, so that the minimization of cross-entropy inclines to be biased towards the outside of the target (background). Thus, in our recognition framework, we utilized the Jaccard similarity index, to avoid false-positive detection, and to increase binary classification accuracy.
There are many challenges in quantifying changes in the shape and patterning of tundra lakes [69], because in comparison to mathematical fractals (like the Koch snowflake or the Sierpinski gasket) in mathematical space, we have to restrict ourselves to the finite size of pixels on images. The novel techniques of image analysis may successfully tackle these scaling challenges. Found here, time series of fractal dimensions show that the fractal features of tundra lakes are constant enough in time (see Figure 7 and Figure 8). We did not observe an increase in shape complexity, even if a lake’s size was growing. In manuscript [70], the authors analyzed Landsat images for the Western Siberia region, using region-growing segmentation techniques. While the average fractal dimension of tundra lakes lay within the interval found in our work, there were a few spikes, probably due to used technique issues. For the two sites, Alaska and Yamal, we showed that the lakes that were recognized on Sentinel-1 satellite images were lognormal distributed (see Figure 9 and Figure 10). In manuscript [22], tundra lakes of the size of 0.002 km 2 to 50 km 2 were segmented from high-resolution Sentinel-2 satellite images covering 725,000 km 2 of the East Siberia region. The authors found that tundra lakes in the region were also log-normal distributed. The fractal dimension and size distributions exhibited universal characteristics that did not necessarily depend on the details of the driving mechanisms and associated complexities: thus, they could be used in tundra landscape modeling [71,72]. Pattern recognition, and quantifying its fractal dimension, are also important in the field of biomedical image analysis [73,74]. We believe that the methods of fractal pattern recognition developed here will be useful in other areas where the system complexity should be defined.

5. Conclusions

This study addressed the problem of automated tundra lake recognition from SAR images for the lake shape and size calculations. We proposed a two-stage recognition framework comprising instance (1) and semantic segmentation (2), which operated with Sentinel-1 images. In the first stage, the tundra lake areas were extracted by U-Net, and a segmentation accuracy of 0.73, in terms of the Jaccard similarity, was achieved. The second stage, which was the watershed algorithm, was aimed at the separation of touching and overlapping lakes produced in the first stage, for the unambiguous estimation of the shape and size of an individual lake. The high performance of the proposed method was demonstrated, based on a generated dataset of manually labeled lakes from hundreds of images taken over the Yamal Peninsula and Alaska areas in the summer months of 2015–2022. The approach was powerful and reliable, in terms of recognition accuracy, computational efficiency and degree of automation.
The applicability of the proposed framework was assessed, based on a generated multi-year dataset of segmented binary images containing derived tundra lakes from Sentinel-1 data. Lake sizes and shapes were estimated from the framework output, and showed high potential gains for tundra lake changes analysis in the context of global climate. However, the model results for a wider range of environmental conditions and regions still need to be proven. Possible directions for improving the recognition of lakes include training over different areas and seasons, and utilizing SAR texture characteristics. State-of-the-art U-Net architectures could be incorporated into the framework, and its performance gain evaluated, but at the cost of complexity and reduced speed. Although the new approach is used here for SAR images from Sentinel-1, it has great potential for images taken from other satellite platforms, including optical imagery.
The study of the fractal characterizations of networks of tundra lakes, and their size distributions, is essential for the representation of permafrost, vegetation and landscape dynamics in climate models. The analysis of new SAR imagery of tundra lakes by a novel deep learning method showed that the average fractal dimension of recognized lake patterns was very stable over seven-year time intervals, and that all the changes fitted into the limits of accuracy. The lake sizes were lognormally distributed for every year in the studied time interval. We expect that the proposed approach to tundra lake recognition will be demanded in climate emulators that are based on conducting high-quality data analysis and revealing complex features of the systems [75].

Author Contributions

Conceptualization, D.D., I.S. and D.L.; methodology, I.S., D.M. and D.D.; software, D.D., I.S., A.K. and D.L; validation, D.D., I.S., A.K., I.A. and D.L.; data curation, D.D., A.K., I.A., I.S. and D.L.; original draft preparation, I.S., D.D. and D.L.; project administration, I.S. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Russian Science Foundation (RSF), project # 21-71-10052. D.L. and D.M. were partially supported by KAUST baseline funding. I.S. was supported in part by the Microsoft AI for Earth Grant Program and by the National Science Foundation, Grant No. NSF PHY-1748958.

Data Availability Statement

The training and validation dataset, containing Sentinel-1 imagery of the tundra lakes and corresponding binary masks, is freely available through the NSF Arctic Data Center catalog [50].

Acknowledgments

The authors thank Viktoria Kharchenko for manual labeling of part of the Sentinel-1 training and validation images.

Conflicts of Interest

The authors declare no conflict of interest.

Abbreviations

The following abbreviations are used in this manuscript:
SARsynthetic aperture radar
U-Netfull convolutional neural network architecture
InSARinterferometric synthetic aperture radar
IoU (or Jaccard similarity index)the Intersection of Union metric

References

  1. Treat, C.C.; Frolking, S. A permafrost carbon bomb? Nat. Clim. Chang. 2013, 3, 865–867. [Google Scholar] [CrossRef]
  2. Lawrence, N.S.; O’Sullivan, J.; Parslow, D.; Javaid, M.; Adams, R.C.; Chambers, C.D.; Kos, K.; Verbruggen, F. Training response inhibition to food is associated with weight loss and reduced energy intake. Appetite 2015, 95, 17–28. [Google Scholar] [CrossRef] [PubMed]
  3. Schädel, C.; Bader, M.K.F.; Schuur, E.A.; Biasi, C.; Bracho, R.; Čapek, P.; De Baets, S.; Diáková, K.; Ernakovich, J.; Estop-Aragones, C.; et al. Potential carbon emissions dominated by carbon dioxide from thawed permafrost soils. Nat. Clim. Chang. 2016, 6, 950–953. [Google Scholar] [CrossRef]
  4. Kokelj, S.V.; Jorgenson, M. Advances in thermokarst research. Permafr. Periglac. Process. 2013, 24, 108–119. [Google Scholar] [CrossRef]
  5. Olefeldt, D.; Hovemyr, M.; Kuhn, M.A.; Bastviken, D.; Bohn, T.J.; Connolly, J.; Crill, P.; Euskirchen, E.S.; Finkelstein, S.A.; Genet, H.; et al. The Boreal–Arctic Wetland and Lake Dataset (BAWLD). Earth Syst. Sci. Data 2021, 13, 5127–5149. [Google Scholar] [CrossRef]
  6. Miner, K.R.; Turetsky, M.R.; Malina, E.; Bartsch, A.; Tamminen, J.; McGuire, A.D.; Fix, A.; Sweeney, C.; Elder, C.D.; Miller, C.E. Permafrost carbon emissions in a changing Arctic. Nat. Rev. Earth Environ. 2022, 3, 55–67. [Google Scholar] [CrossRef]
  7. Kirpotin, S.; Polishchuk, Y.; Zakharova, E.; Shirokova, L.; Pokrovsky, O.; Kolmakova, M.; Dupre, B. One of the possible mechanisms of thermokarst lakes drainage in West-Siberian North. Int. J. Environ. Stud. 2008, 65, 631–635. [Google Scholar] [CrossRef]
  8. Jorgenson, J.C.; Jorgenson, M.T.; Boldenow, M.L.; Orndahl, K.M. Landscape change detected over a half century in the Arctic National Wildlife Refuge using high-resolution aerial imagery. Remote Sens. 2018, 10, 1305. [Google Scholar] [CrossRef]
  9. Shiklomanov, N.I.; Streletskiy, D.A.; Little, J.D.; Nelson, F.E. Isotropic thaw subsidence in undisturbed permafrost landscapes. Geophys. Res. Lett. 2013, 40, 6356–6361. [Google Scholar] [CrossRef]
  10. Andresen, C.G.; Lougheed, V.L. Disappearing Arctic tundra ponds: Fine-scale analysis of surface hydrology in drained thaw lake basins over a 65 year period (1948–2013). J. Geophys. Res. Biogeosci. 2015, 120, 466–479. [Google Scholar] [CrossRef]
  11. Karlsson, J.M.; Jaramillo, F.; Destouni, G. Hydro-climatic and lake change patterns in Arctic permafrost and non-permafrost areas. J. Hydrol. 2015, 529, 134–145. [Google Scholar] [CrossRef]
  12. Boike, J.; Grau, T.; Heim, B.; Günther, F.; Langer, M.; Muster, S.; Gouttevin, I.; Lange, S. Satellite-derived changes in the permafrost landscape of central Yakutia, 2000–2011: Wetting, drying, and fires. Glob. Planet. Change 2016, 139, 116–127. [Google Scholar] [CrossRef]
  13. Muster, S.; Roth, K.; Langer, M.; Lange, S.; Cresto Aleina, F.; Bartsch, A.; Morgenstern, A.; Grosse, G.; Jones, B.; Sannel, A.B.K.; et al. PeRL: A circum-Arctic permafrost region pond and lake database. Earth Syst. Sci. Data 2017, 9, 317–348. [Google Scholar] [CrossRef]
  14. Anthony, K.; Zimov, S.; Grosse, G.; Jones, M.C.; Anthony, P.; FS III, C.; Finlay, J.; Mack, M.; Davydov, S.; Frenzel, P.; et al. A shift of thermokarst lakes from carbon sources to sinks during the Holocene epoch. Nature 2014, 511, 452–456. [Google Scholar] [CrossRef] [PubMed]
  15. Schuur, E.A.; McGuire, A.D.; Schädel, C.; Grosse, G.; Harden, J.W.; Hayes, D.J.; Hugelius, G.; Koven, C.D.; Kuhry, P.; Lawrence, D.M.; et al. Climate change and the permafrost carbon feedback. Nature 2015, 520, 171–179. [Google Scholar] [CrossRef]
  16. Abbott, B.W.; Jones, J.B.; Schuur, E.A.; Chapin III, F.S.; Bowden, W.B.; Bret-Harte, M.S.; Epstein, H.E.; Flannigan, M.D.; Harms, T.K.; Hollingsworth, T.N.; et al. Biomass offsets little or none of permafrost carbon release from soils, streams, and wildfire: An expert assessment. Environ. Res. Lett. 2016, 11, 034014. [Google Scholar] [CrossRef]
  17. Nitze, I.; Grosse, G.; Jones, B.M.; Arp, C.D.; Ulrich, M.; Fedorov, A.; Veremeeva, A. Landsat-based trend analysis of lake dynamics across northern permafrost regions. Remote Sens. 2017, 9, 640. [Google Scholar] [CrossRef]
  18. Muster, S.; Riley, W.J.; Roth, K.; Langer, M.; Cresto Aleina, F.; Koven, C.D.; Lange, S.; Bartsch, A.; Grosse, G.; Wilson, C.J.; et al. Size Distributions of Arctic Waterbodies Reveal Consistent Relations in Their Statistical Moments in Space and Time. Front. Earth Sci. 2019, 7, 2296–6463. [Google Scholar] [CrossRef]
  19. Carroll, M.L.; Loboda, T.V. Multi-Decadal Surface Water Dynamics in North American Tundra. Remote Sens. 2017, 9, 497. [Google Scholar] [CrossRef]
  20. Nitze, I.; Grosse, G.; Jones, B.M.; Romanovsky, V.E.; Boike, J. Remote sensing quantifies widespread abundance of permafrost region disturbances across the Arctic and Subarctic. Nat. Commun. 2018, 9, 5423. [Google Scholar] [CrossRef]
  21. Jawak, S.D.; Kulkarni, K.; Luis, A.J. A review on extraction of lakes from remotely sensed optical satellite data with a special focus on cryospheric lakes. Adv. Remote. Sens. 2015, 4, 196. [Google Scholar] [CrossRef]
  22. Polishchuk, Y.M.; Bogdanov, A.N.; Polishchuk, V.Y.; Manasypov, R.M.; Shirokova, L.S.; Kirpotin, S.N.; Pokrovsky, O.S. Size distribution, surface coverage, water, carbon, and metal storage of thermokarst lakes in the permafrost zone of the Western Siberia Lowland. Water 2017, 9, 228. [Google Scholar] [CrossRef]
  23. Karlsson, J.M.; Lyon, S.W.; Destouni, G. Temporal behavior of lake size-distribution in a thawing permafrost landscape in northwestern Siberia. Remote Sens. 2014, 6, 621–636. [Google Scholar] [CrossRef]
  24. Payne, C.; Panda, S.; Prakash, A. Remote sensing of river erosion on the Colville River, North Slope Alaska. Remote Sens. 2018, 10, 397. [Google Scholar] [CrossRef]
  25. Naeimi, V.; Bartalis, Z.; Wagner, W. ASCAT soil moisture: An assessment of the data quality and consistency with the ERS scatterometer heritage. J. Hydrometeorol. 2009, 10, 555–563. [Google Scholar] [CrossRef]
  26. Kerr, Y.; Waldteufel, P.; Wigneron, J.; Martinuzzi, J.; Font, J.M. Berger: Soil moisture retrieval from space: The Soil Moisture and Ocean Salinity (SMOS) mission. IEEE T Geosci. Remote 2001, 39, 1729–1735. [Google Scholar] [CrossRef]
  27. Jones, B.M.; Grosse, G.; Arp, C.; Jones, M.; Walter Anthony, K.; Romanovsky, V. Modern thermokarst lake dynamics in the continuous permafrost zone, northern Seward Peninsula, Alaska. J. Geophys. Res. Biogeosci. 2011, 116, 0148–0227. [Google Scholar] [CrossRef]
  28. Schroeder, R.; Rawlins, M.; McDonald, K.; Podest, E.; Zimmermann, R.; Kueppers, M. Satellite microwave remote sensing of North Eurasian inundation dynamics: Development of coarse-resolution products and comparison with high-resolution synthetic aperture radar data. Environ. Res. Lett. 2010, 5, 015003. [Google Scholar] [CrossRef]
  29. Bartsch, A.; Wagner, W.; Scipal, K.; Pathe, C.; Sabel, D.; Wolski, P. Global monitoring of wetlands–the value of ENVISAT ASAR global mode. J. Environ. Manag. 2009, 90, 2226–2233. [Google Scholar] [CrossRef]
  30. Sobiech, J.; Dierking, W. Observing lake-and river-ice decay with SAR: Advantages and limitations of the unsupervised k-means classification approach. Ann. Glaciol. 2013, 54, 65–72. [Google Scholar] [CrossRef]
  31. Widhalm, B.; Bartsch, A.; Heim, B. A novel approach for the characterization of tundra wetland regions with C-band SAR satellite data. Int. J. Remote. Sens. 2015, 36, 5537–5556. [Google Scholar] [CrossRef]
  32. Hirose, T.; Kapfer, M.; Bennett, J.; Cott, P.; Manson, G.; Solomon, S. Bottomfast Ice Mapping and the Measurement of Ice Thickness on Tundra Lakes Using C-Band Synthetic Aperture Radar Remote Sensing 1. JAWRA J. Am. Water Resour. Assoc. 2008, 44, 285–292. [Google Scholar] [CrossRef]
  33. Walter, K.M.; Engram, M.; Duguay, C.R.; Jeffries, M.O.; Chapin III, F. The Potential Use of Synthetic Aperture Radar for Estimating Methane Ebullition From Arctic Lakes 1. JAWRA J. Am. Water Resour. Assoc. 2008, 44, 305–315. [Google Scholar] [CrossRef]
  34. Duguay, C.; Rouse, W.R.; Lafleur, P.M.; Boudreau, L.D.; Crevier, Y.; Pultz, T.J. Analysis of multi-temporal ERS-1 SAR data of subarctic tundra and forest in the northern Hudson Bay Lowland and implications for climate studies. Can. J. Remote. Sens. 1999, 25, 21–33. [Google Scholar] [CrossRef]
  35. Wakabayashi, H.; Jeffries, M.; Weeks, W. C-band backscatter variation and modelling for lake ice in northern Alaska. J. Remote. Sens. Soc. Jpn. 1994, 14, 220–229. [Google Scholar]
  36. Liu, L.; Schaefer, K.; Chen, A.; Gusmeroli, A.; Zebker, H.; Zhang, T. Remote sensing measurements of thermokarst subsidence using InSAR. J. Geophys. Res. Earth Surf. 2015, 120, 1935–1948. [Google Scholar] [CrossRef]
  37. Liu, X.; Guo, Y.; Hu, H.; Sun, C.; Zhao, X.; Wei, C. Dynamics and controls of CO2 and CH4 emissions in the wetland of a montane permafrost region, northeast China. Atmos. Environ. 2015, 122, 454–462. [Google Scholar] [CrossRef]
  38. Bartsch, A.; Leibman, M.; Strozzi, T.; Khomutov, A.; Widhalm, B.; Babkina, E.; Mullanurov, D.; Ermokhina, K.; Kroisleitner, C.; Bergstedt, H. Seasonal progression of ground displacement identified with satellite radar interferometry and the impact of unusually warm conditions on permafrost at the Yamal Peninsula in 2016. Remote Sens. 2019, 11, 1865. [Google Scholar] [CrossRef]
  39. Onstott, R.G.; Carsey, F. SAR and scatterometer signatures of sea ice. Microw. Remote. Sens. Sea Ice 1992, 68, 73–104. [Google Scholar]
  40. Geldsetzer, T.; Sanden, J.v.d.; Brisco, B. Monitoring lake ice during spring melt using RADARSAT-2 SAR. Can. J. Remote. Sens. 2010, 36, S391–S400. [Google Scholar] [CrossRef]
  41. Jeffries, M.; Morris, K.; Weeks, W.; Wakabayashi, H. Structural and stratigraphie features and ERS 1 synthetic aperture radar backscatter characteristics of ice growing on shallow lakes in NW Alaska, winter 1991–1992. J. Geophys. Res. Ocean. 1994, 99, 22459–22471. [Google Scholar] [CrossRef]
  42. Merchant, M.A.; Obadia, M.; Brisco, B.; DeVries, B.; Berg, A. Applying Machine Learning and Time-Series Analysis on Sentinel-1A SAR/InSAR for Characterizing Arctic Tundra Hydro-Ecological Conditions. Remote Sens. 2022, 14, 1123. [Google Scholar] [CrossRef]
  43. Piantanida, R.; Hajduch, G.; Poullaouec, J. Sentinel-1 Level 1 Detailed Algorithm Definition; Techreport SEN-TN-52-7445; ESA: Paris, France, 2016. [Google Scholar]
  44. Makynen, M.; Manninen, A.T.; Simila, M.; Karvonen, J.A.; Hallikainen, M.T. Incidence angle dependence of the statistical properties of C-band HH-polarization backscattering signatures of the Baltic Sea ice. IEEE Trans. Geosci. Remote. Sens. 2002, 40, 2593–2605. [Google Scholar] [CrossRef]
  45. Wakabayashi, H.; Weeks, W.; Jeffries, M.O. A C-band backscatter model for lake ice in Alaska. In Proceedings of the IGARSS’93-IEEE International Geoscience and Remote Sensing Symposium, Tokyo, Japan, 18–21 August 1993; pp. 1264–1266. [Google Scholar]
  46. Zakhvatkina, N.Y.; Alexandrov, V.Y.; Johannessen, O.M.; Sandven, S.; Frolov, I.Y. Classification of sea ice types in ENVISAT synthetic aperture radar images. IEEE Trans. Geosci. Remote. Sens. 2012, 51, 2587–2600. [Google Scholar] [CrossRef]
  47. Karvonen, J. A sea ice concentration estimation algorithm utilizing radiometer and SAR data. Cryosphere 2014, 8, 1639–1650. [Google Scholar] [CrossRef]
  48. Karvonen, J. Baltic sea ice concentration estimation using SENTINEL-1 SAR and AMSR2 microwave radiometer data. IEEE Trans. Geosci. Remote. Sens. 2017, 55, 2871–2883. [Google Scholar] [CrossRef]
  49. Dutta, A.; Gupta, A.; Zissermann, A. VGG Image Annotator (VIA). 2016. Volume 2. Available online: http://www.robots.ox.ac.uk/vgg/software/via (accessed on 10 January 2023).
  50. Demchev, D.; Sudakow, I. A dataset of 512 × 512 tundra lakes imagery and binary masks from Sentinel-1 in the Yamal and Alaska areas, summer, 2015–2022. Arct. Data Cent. 2023. Available online: https://arcticdata.io/catalog/view/urn%3Auuid%3Aaec6b61a-7318-4680-a39c-85837fa8a5c1 (accessed on 10 January 2023).
  51. Ronneberger, O.; Fischer, P.; Brox, T. U-net: Convolutional networks for biomedical image segmentation. In Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Munich, Germany, 5–9 October 2015; Springer: Berlin/Heidelberg, Germany, 2015; pp. 234–241. [Google Scholar]
  52. Long, J.; Shelhamer, E.; Darrell, T. Fully convolutional networks for semantic segmentation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA, 7–12 June 2015; pp. 3431–3440. [Google Scholar]
  53. Ren, Y.; Li, X.; Yang, X.; Xu, H. Development of a dual-attention U-Net model for sea ice and open water classification on SAR images. IEEE Geosci. Remote. Sens. Lett. 2021, 19, 1–5. [Google Scholar] [CrossRef]
  54. Sudakow, I.; Asari, V.K.; Liu, R.; Demchev, D. MeltPondNet: A Swin Transformer U-Net for Detection of Melt Ponds on Arctic Sea Ice. IEEE J. Sel. Top. Appl. Earth Obs. Remote. Sens. 2022, 15, 8776–8784. [Google Scholar] [CrossRef]
  55. Vincent, L.; Soille, P. Watersheds in digital spaces: An efficient algorithm based on immersion simulations. IEEE Trans. Pattern Anal. Mach. Intell. 1991, 13, 583–598. [Google Scholar] [CrossRef]
  56. Beucher, S.; Meyer, F. The morphological approach to segmentation: The watershed transformation. In Mathematical Morphology in Image Processing; CRC Press: Boca Raton, FL, USA, 2018; pp. 433–481. [Google Scholar]
  57. Yu, Y.; Acton, S.T. Speckle reducing anisotropic diffusion. IEEE Trans. Image Process. 2002, 11, 1260–1270. [Google Scholar]
  58. Demchev, D.; Volkov, V.; Kazakov, E.; Alcantarilla, P.F.; Sandven, S.; Khmeleva, V. Sea ice drift tracking from sequential SAR images using accelerated-KAZE features. IEEE Trans. Geosci. Remote. Sens. 2017, 55, 5174–5184. [Google Scholar] [CrossRef]
  59. Kingma, D.P.; Ba, J. Adam: A method for stochastic optimization. arXiv 2014, arXiv:1412.6980. [Google Scholar]
  60. Chen, Q.; Yang, X.; Petriu, E.M. Watershed segmentation for binary images with different distance transforms. In Proceedings of the 3rd IEEE International Workshop on Haptic, Audio and Visual Environments and Their Applications, Ottawa, ON, Canada, 2–3 October 2004; Volume 2, pp. 111–116. [Google Scholar]
  61. Raju, C.N.; Raju, G.; Gottumukkala, V.V. Studies on watershed segmentation for blood cell images using different distance transforms. IOSR J. Vlsi Signal Process. (IOSR-JVSP) 2016, 6, 79–85. [Google Scholar]
  62. Bradski, G. The OpenCV Library. Dr. Dobb’S J. Softw. Tools 2000, 25, 109–141. [Google Scholar]
  63. Lovejoy, S. Area-perimeter relation for rain and cloud areas. Science 1982, 216, 185–187. [Google Scholar] [CrossRef]
  64. Mandelbrot, B. The Fractal Geometry of Nature; W. H. Freeman and Co.: San Francisco, CA, USA, 1982; p. 460. [Google Scholar]
  65. Klinkenberg, B. A Review of Methods Used to Determine the Fractal Dimension of Linear Features. Math. Geol. 2022, 26, 23–45. [Google Scholar] [CrossRef]
  66. Oktay, O.; Schlemper, J.; Folgoc, L.L.; Lee, M.; Heinrich, M.; Misawa, K.; Mori, K.; McDonagh, S.; Hammerla, N.Y.; Kainz, B.; et al. Attention u-net: Learning where to look for the pancreas. arXiv 2018, arXiv:1804.03999. [Google Scholar]
  67. Zhou, Z.; Siddiquee, M.M.R.; Tajbakhsh, N.; Liang, J. Unet++: Redesigning skip connections to exploit multiscale features in image segmentation. IEEE Trans. Med. Imaging 2019, 39, 1856–1867. [Google Scholar] [CrossRef]
  68. Kugelman, J.; Allman, J.; Read, S.A.; Vincent, S.J.; Tong, J.; Kalloniatis, M.; Chen, F.K.; Collins, M.J.; Alonso-Caneiro, D. A comparison of deep learning U-Net architectures for posterior segment OCT retinal layer segmentation. Sci. Rep. 2022, 12, 14888. [Google Scholar] [CrossRef]
  69. Seekell, D.A.; Pace, M.L.; Tranvik, L.J.; Verpoorter, C. A fractal-based approach to lake size-distributions. Geophys. Res. Lett. 2013, 40, 517–521. [Google Scholar] [CrossRef]
  70. Sudakov, I.; Essa, A.; Mander, L.; Gong, M.; Kariyawasam, T. The Geometry of Large Tundra Lakes Observed in Historical Maps and Satellite Images. Remote Sens. 2017, 9, 1072. [Google Scholar] [CrossRef]
  71. Aleina, F.C.; Brovkin, V.; Muster, S.; Boike, J.; Kutzbach, L.; Sachs, T.; Zuyev, S. A stochastic model for the polygonal tundra based on Poisson–Voronoi diagrams. Earth Syst. Dyn. 2013, 4, 187–198. [Google Scholar] [CrossRef]
  72. Polishchuk, V.Y.; Polishchuk, Y.M. Geoimitatsionnoe modelirovanie polei termokarstovykh ozer v zonakh merzloty [Geo-Simulation Modeling of Thermokarst Lakes Fields in Permafrost Zones]. Khanty-Mansijsk Uip Yugu 2013, 174, 195–199. [Google Scholar]
  73. Lopes, R.; Betrouni, N. Fractal and multifractal analysis: A review. Med. Image Anal. 2009, 13, 634–649. [Google Scholar] [CrossRef] [PubMed]
  74. Nayak, S.R. Analysis of medical images using fractal geometry. In The Research Anthology on Improving Medical Imaging Techniques for Analysis and Intervention; Medical Information Science Reference; IGI Global: Hershey, PA, USA, 2023; pp. 1547–1562. [Google Scholar]
  75. Sudakow, I.; Pokojovy, M.; Lyakhov, D. Statistical mechanics in climate emulation: Challenges and perspectives. Environ. Data Sci. 2022, 1, e16. [Google Scholar] [CrossRef]
Figure 1. Sentinel-1 images collected over the two test sites: in red—Alaska test site; in blue—Yamal test site.
Figure 1. Sentinel-1 images collected over the two test sites: in red—Alaska test site; in blue—Yamal test site.
Remotesensing 15 01298 g001
Figure 2. A pseudo-RGB image synthesized from Sentinel-1 data: (A) σ 0 at HV-polarization; (B) σ 0 at HH-polarization; (C) incidence angle ( I a ); (D) synthesized 3-channel image ( σ H V 0 + σ H V 0 + I a ) from normalized values in 0–1.
Figure 2. A pseudo-RGB image synthesized from Sentinel-1 data: (A) σ 0 at HV-polarization; (B) σ 0 at HH-polarization; (C) incidence angle ( I a ); (D) synthesized 3-channel image ( σ H V 0 + σ H V 0 + I a ) from normalized values in 0–1.
Remotesensing 15 01298 g002
Figure 3. A pseudo-RGB Sentinel-1 image (R: HV-polarization; G: HH-polarization; B: incidence angle) taken over the Yamal Peninsula on 12 August 2015 at 12:40:52, containing tundra lakes with different shapes and sizes (A), and a binary image with manually extracted tundra lakes (B), where the white color corresponds to the tundra lake areas.
Figure 3. A pseudo-RGB Sentinel-1 image (R: HV-polarization; G: HH-polarization; B: incidence angle) taken over the Yamal Peninsula on 12 August 2015 at 12:40:52, containing tundra lakes with different shapes and sizes (A), and a binary image with manually extracted tundra lakes (B), where the white color corresponds to the tundra lake areas.
Remotesensing 15 01298 g003
Figure 4. Tundra lakes recognition workflow.
Figure 4. Tundra lakes recognition workflow.
Remotesensing 15 01298 g004
Figure 5. Results of tundra lakes recognition from Sentinel-1 data taken over the Yamal Peninsula (69.4366 ° E, 68.5102 ° N) from 23 August 2016 at 12:49:16 by our algorithm framework: (A) input pseudo-RGB image where R = SAR backscattering at HV-polarization, B = SAR backscattering at HH-polarization and G = incidence angle; (B) predicted tundra lakes (white) (C) ground truth image with manually mapped lakes; (D) the difference between ground truth and predicted data, where red indicates pixels corresponding to lakes in the framework output but not in the ground truth, blue corresponds to pixels recognized as lakes in the ground truth but not in the framework output and white stands for agreement between the data.
Figure 5. Results of tundra lakes recognition from Sentinel-1 data taken over the Yamal Peninsula (69.4366 ° E, 68.5102 ° N) from 23 August 2016 at 12:49:16 by our algorithm framework: (A) input pseudo-RGB image where R = SAR backscattering at HV-polarization, B = SAR backscattering at HH-polarization and G = incidence angle; (B) predicted tundra lakes (white) (C) ground truth image with manually mapped lakes; (D) the difference between ground truth and predicted data, where red indicates pixels corresponding to lakes in the framework output but not in the ground truth, blue corresponds to pixels recognized as lakes in the ground truth but not in the framework output and white stands for agreement between the data.
Remotesensing 15 01298 g005
Figure 6. (A) segmented tundra lakes at Alaska test site (157.0301 ° W, 70.93083 ° N) from 20 October 2016 at 04:02:51, obtained by U-Net; (B) after filtering of small “noisy lakes”; followed by (C) instance segmentation, where white areas correspond to tundra lakes, and colored blobs stand for individual segmented lakes (instances). The white rectangles in (AC) correspond to a zoomed area containing three lakes labeled as (1), (2) and (3); (D) raw U-Net output in the zoomed area, where lake 2 and lake 3 are overlapped (one instance); (E) lakes areas after morphological opening, and the obtained lake borders by the watershed segmentation, are indicated in red; (F) results of instance segmentation with the watershed algorithm, where each lake (instance) is depicted in different colors.
Figure 6. (A) segmented tundra lakes at Alaska test site (157.0301 ° W, 70.93083 ° N) from 20 October 2016 at 04:02:51, obtained by U-Net; (B) after filtering of small “noisy lakes”; followed by (C) instance segmentation, where white areas correspond to tundra lakes, and colored blobs stand for individual segmented lakes (instances). The white rectangles in (AC) correspond to a zoomed area containing three lakes labeled as (1), (2) and (3); (D) raw U-Net output in the zoomed area, where lake 2 and lake 3 are overlapped (one instance); (E) lakes areas after morphological opening, and the obtained lake borders by the watershed segmentation, are indicated in red; (F) results of instance segmentation with the watershed algorithm, where each lake (instance) is depicted in different colors.
Remotesensing 15 01298 g006
Figure 7. Box plot of the fractal dimension (fd) for the time period 2015–2022; the studied region is in Alaska.
Figure 7. Box plot of the fractal dimension (fd) for the time period 2015–2022; the studied region is in Alaska.
Remotesensing 15 01298 g007
Figure 8. Box plot of the fractal dimension (fd) for the time period 2015–2022; the studied region is in Yamal.
Figure 8. Box plot of the fractal dimension (fd) for the time period 2015–2022; the studied region is in Yamal.
Remotesensing 15 01298 g008
Figure 9. Histogram of the number of recognized lakes on images from Alaska vs the log of lake size (area).
Figure 9. Histogram of the number of recognized lakes on images from Alaska vs the log of lake size (area).
Remotesensing 15 01298 g009
Figure 10. Histogram of the number of recognized lakes on images from Yamal vs the log of lake size (area).
Figure 10. Histogram of the number of recognized lakes on images from Yamal vs the log of lake size (area).
Remotesensing 15 01298 g010
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Demchev, D.; Sudakow, I.; Khodos, A.; Abramova, I.; Lyakhov, D.; Michels, D. Recognizing the Shape and Size of Tundra Lakes in Synthetic Aperture Radar (SAR) Images Using Deep Learning Segmentation. Remote Sens. 2023, 15, 1298. https://doi.org/10.3390/rs15051298

AMA Style

Demchev D, Sudakow I, Khodos A, Abramova I, Lyakhov D, Michels D. Recognizing the Shape and Size of Tundra Lakes in Synthetic Aperture Radar (SAR) Images Using Deep Learning Segmentation. Remote Sensing. 2023; 15(5):1298. https://doi.org/10.3390/rs15051298

Chicago/Turabian Style

Demchev, Denis, Ivan Sudakow, Alexander Khodos, Irina Abramova, Dmitry Lyakhov, and Dominik Michels. 2023. "Recognizing the Shape and Size of Tundra Lakes in Synthetic Aperture Radar (SAR) Images Using Deep Learning Segmentation" Remote Sensing 15, no. 5: 1298. https://doi.org/10.3390/rs15051298

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop