Next Article in Journal
Intelligent Safety Ergonomics: A Cleaner Research Direction for Ergonomics in the Era of Big Data
Previous Article in Journal
Estimation of Lockdowns’ Impact on Well-Being in Selected Countries: An Application of Novel Bayesian Methods and Google Search Queries Data
Previous Article in Special Issue
Analysis of the Green Development Effects of High-Speed Railways Based on Eco-Efficiency: Evidence from Multisource Remote Sensing and Statistical Data of Urban Agglomerations in the Middle Reaches of the Yangtze River, China
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Assessment of Urban Agglomeration Ecological Sustainability and Identification of Influencing Factors: Based on the 3DEF Model and the Random Forest

1
College of Management Science, Chengdu University of Technology, Chengdu 610059, China
2
The Engineering & Technical College of Chengdu University of Technology, Leshan 614000, China
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2023, 20(1), 422; https://doi.org/10.3390/ijerph20010422
Submission received: 24 November 2022 / Revised: 22 December 2022 / Accepted: 23 December 2022 / Published: 27 December 2022

Abstract

:
The evaluation of ecological sustainability is significant for high-quality urban development and scientific management and regulation. Taking the Chengdu urban agglomeration (CUA) as the research object, this paper combined the three-dimensional ecological footprint model (3DEF) and random forest to evaluate the ecological sustainability of the study area and identify the influencing factors. The study results indicate that: (1) From 2000 to 2019, the ecological sustainability of Chengdu urban agglomeration was divided into four types, and the overall ecological sustainability of this region showed a downward trend. The areas with higher ecological sustainability were mainly distributed in the northern part of the urban agglomeration (Mianyang City) and the southern part (Leshan City and Ya’an City), while the cities in the central region (Chengdu City, Meishan City, and Ziyang City) had lower ecological sustainability. (2) The main factors affecting the ecological sustainability of urban agglomerations are industrial wastewater discharge, industrial smoke (powder) dust discharge, and green coverage of built-up areas, followed by urbanization and population size. Through this study, we have two meaningful findings: (a) Our research method in this paper provides a new way to study the factors affecting the ecological sustainability of urban agglomerations. (b) The results of the identification of influencing factors might be the reference for urban environmental infrastructure construction and urban planning.

1. Introduction

Since the reform and opening up, China’s economy has developed rapidly. However, many ecological and environmental problems have emerged. China’s environmental protection and sustainable development are full of challenges [1]. Among the Sustainable Development Goals (SDGs), the ecological Sustainable Development Goals emphasize limiting human activities to what nature can afford. Only by effectively utilizing natural resources and maintaining the coordinated development of the natural environment and social economy can the goal of ecologically sustainable development be realized [2].
The ecological footprint concept was first proposed in 1992 by Ree [3], and then Wackemagel developed it into the ecological footprint model [4]. The model quantifies the consumption and occupation of natural capital by human activities in biologically productive land area and directly expresses the occupation degree of natural capital by human beings [5,6]. Therefore, it is very effective to evaluate ecological sustainability based on this model [7]. However, traditional ecological footprint models only calculate the size of natural capital flow without separating capital flow and capital stock, which cannot reflect the role of natural capital stock on ecological balance [8]. So, Niccolucci [9] introduced the ecological footprint size (EFsize) and ecological footprint depth (EFdepth) to construct a three-dimensional ecological footprint model (3DEF), and the spatial and temporal variation characteristics of global ecological footprint size and depth from 1961 to 2006 were analyzed using this model [10]. The 3DEF model was introduced by Kai Fang for the first time to analyze the capital utilization patterns of Chinese provinces [11]. Fang [12] comprehensively interpreted the EFsize and the EFdepth and the results showed that we could analyze whether human consumption is overloaded from both horizontal and vertical perspectives by using the 3DEF model. The model could be a new method to study ecological sustainable development. Then, Fang [13] analyzed the spatial variation characteristics of natural capital utilization in G20 countries from 1999 to 2008 and found that the traditional three-dimensional ecological footprint model has the problem of offsetting the regional deficit. To overcome this problem, Fang [14] modified the model to obtain a revised 3DEF model and used it to study the characteristics of natural capital utilization in 11 countries.
Currently, the 3DEF model has been widely used to evaluate the ecological sustainability of different scale study areas, such as the national scale, the provincial scale, and the urban agglomeration scale. On the national scale, Fang [13] found that resource-rich countries have higher EFsize and lower EFdepth; that is, they have higher capital flow and lower capital stock, and the prospect of ecological sustainable development is limited by resource endowment and the economic development level. In addition, renewable resources might restrict the utilization efficiency of natural capital flow, and there is a significant negative correlation between the consumption of natural capital stock and the level of social and economic development [14]. On the provincial scale, Wang et al. [15] measured the three-dimensional ecological footprint of 12 cities in Inner Mongolia from 2010 to 2016 and examined the driving factors. The results showed that there was over-utilization of resources. The determinants of ecological surplus/deficit were not only the natural endowment but also population density, industrial structure, and the technological level. Based on the revised 3DEF model, Wu [16] analyzed the sustainability and decoupling of natural capital utilization in 30 provinces of China from the two dimensions of capital flow and stock and believed that increasing footprint scale and decreasing footprint depth are conducive to ecologically sustainable development. On the urban agglomeration scale, in Du’s research [17], the EFdepth was influenced by the quantity and structure of energy consumption and had an inverted “N”-shaped relationship with economic development. Wang et al. [18] conducted PLS modeling with the EFdepth as the explained variable and socioeconomic indicators as the explanatory variables and found that the natural capital utilization patterns of the Guangdong–Hong Kong–Macao Greater Bay Area could be divided into four categories. Ecological sustainability was best when capital stock consumption was reduced and capital flow was abundant. Additionally, Yang et al. [19] and Chen et al. [20] showed that evaluating the ecological sustainability of urban agglomerations by the 3DEF model is reliable.
Overall, the use of the 3DEF model to evaluate ecological sustainability has been quite mature. However, due to the nonlinear relationship between ecological footprint indicators and socioeconomic indicators [21], the high number of features, and the small sample sizes [22], there are few studies on the influencing factors of ecological sustainability from the perspective of data mining. Fortunately, the random forest method is not dependent on the sample size, and the OOB algorithm with the importance of measure variables extracts multiple samples from the original sample through the bootstrap resampling method [23], which is a data mining method that can overcome the nonlinear relationship and poor data information [24].
With the Chengdu urban agglomeration (CUA) as an example, this work is a preliminary attempt to remedy these gaps by investigating ecological sustainability from the standpoint of machine learning (ML). As a starting point, we used the 3DEF model to determine the EFsize and EFdepth of the study region. Using the two indicators, the study area’s ecologically sustainable types can then be segmented. The random forest technique was finally established to pinpoint the variables that affect ecological sustainability. The following are some possible innovations from this study: (1) The factors affecting ecological sustainability were initially discussed using footprint methods and machine learning; (2) our research methodology in this paper offers a new way to investigate the factors affecting the ecological sustainability of urban agglomeration; and (3) our study may serve as a guide for the analysis of ecological footprint indicators in the case of small samples.

2. Materials and Methods

2.1. Study Area

The Chengdu urban agglomeration (CUA) is located in western China. It includes eight cities, with Chengdu as the center. The overall terrain of the CUA is flat, dominated by plains, basins, and hills. As the core area of Sichuan Province’s multi-point and multi-polar support development strategy, it plays a vital role in the economic development of Sichuan Province. At the end of 2020, the regional land area was about 78,000 square kilometers, with a permanent population of 38.518 million and a GDP of RMB 2829.56 billion.

2.2. Data Sources

This study uses the Chengdu urban agglomeration as the research object and collected socioeconomic and land use data in 4 years (2000, 2010, 2015, and 2019). Among them, the socioeconomic data comes from the statistical yearbooks of various cities, and the land use data and administrative division vector data come from the Resource Environment and Science Data Center of the Institute of Geographical Sciences (https://www.resdc.cn/Default.aspx, accessed on 8 July 2022). In the ecological footprint calculation, the equilibrium and yield factors were determined by referring to existing research results [25,26], as shown in Table 1. According to the scale characteristics of the study area, the consumption account of biological resources was updated from “global hectare” to “provincial hectare”, that is, the average output of various consumer goods in Sichuan Province. According to The General Rules for Calculation of China’s Comprehensive Energy Consumption (GB/T2589-2008), the energy consumption is converted into the area of fossil energy land and building land based on the low calorific value generated per kilogram of fossil fuel, as shown in Table 2. Since economic, social, and environmental factors impact the use of natural capital [16], this paper selects nine elements, as shown in Table 3.

2.3. Methods

In this study, the improved three-dimensional ecological footprint model was used to determine the ecological footprint size (EFsize), ecological footprint depth (EFdepth), and three-dimensional ecological footprint (EF3D) of 8 cities in the Chengdu urban agglomeration in 2000, 2010, 2015, and 2019. First, the EFsize and EFdepth were used to assess the research area’s ecological sustainability. Then, using the random forest OOB algorithm, the Chengdu urban agglomeration’s ecological sustainability impact elements were discovered and examined. The two sections that make up the research framework for this paper are (1) evaluating ecological sustainability and (2) identifying the influencing elements (Figure 1).

2.3.1. Three-Dimensional Ecological Footprint Model

The ecological footprint model has experienced the evolution from a one-dimensional ecological footprint to two-dimensional and three-dimensional models (See the Figure 2).
A one-dimensional ecological footprint converts biological resources into the land area to quantify human utilization of natural resources [27]. The calculation formula for one-dimensional ecological footprint is as follows.
e f = r j C i Y i
E F = e f × N
where e f is the per capita ecological footprint (hm2/cap); E F is the ecological footprint (hm2); r j is the equivalence factor; Y i is the average product of item i ; C i is the consumption of item i .
A two-dimensional ecological footprint increases the calculation of ecological carrying capacity. The difference between ecological footprint and ecological carrying capacity (i.e., ecological profit and loss) is used to determine whether the ecological footprint can meet the needs of human production activities. The calculation formula for a two-dimensional ecological footprint is as follows.
e c = a j × r j × y j × 0.88
E C = e c × N
E D = E F E C
where e c is the per capita ecological carrying capacity (hm2/cap); E C is the ecological carrying capacity (hm2); E D is the ecological profit and loss (hm2); j is the land type; a j is the per capita area of land j ; and y j is the yield factor.
The three-dimensional ecological footprint model also introduces two indicators of footprint breadth and depth to quantify the relationship between natural capital stock and flow on a two-dimensional basis [9]. Based on the research of Chinese scholar Fang Kai, a revised three-dimensional ecological footprint model was obtained [14]. The calculation formula for the fixed three-dimensional ecological footprint is as follows.
E F s i z e = min { E F i , E C i }
E F d e p t h = 1 + E D i E C i = 1 + max { E F i E C i , 0 } E C i
E F 3 D = E F s i z e × E F d e p t h
where E F s i z e is the ecological footprint size, which indicates the size of natural capital flow; E F d e p t h is the depth of ecological footprint, which represents the size of natural capital stock; and E F 3 D is the three-dimensional ecological footprint. Obviously, in the Equation (7), when the E F i E C i , the E F d e p t h is the original length “1”, which means the capital flow is surplus.

2.3.2. The OOB Algorithm in Random Forest

Random forest is a statistical learning theory. It uses the bootstrap re-sampling method to extract multiple samples from the original samples, conducts decision tree modeling for each bootstrap sample, and then combines the predictions of numerous decision trees to obtain the final prediction result through voting [28,29]. The random forest can be well used to evaluate the importance of variables [30] and is widely used in ecology [31].
There are usually Gini importance and mean square error reduction methods for variable importance measurement using random forest, among which the calculation steps of the mean square error reduction method are as follows.
Step 1: Calculate the mean square error (MSE) of each decision tree’s out-of-bag data (OOB), and the calculation formula is as follows.
M S E t = 1 N t i = 1 N t ( y i y ^ i , t ) 2
Step 2: Replace the target variables randomly and calculate the new mean square deviation. The calculation formula is as follows.
M S E t ( ν ) = 1 N t i = 1 N t ( y i y ^ i , t ( ν ) ) 2
Step 3: The importance measure of variables was calculated based on the mean square deviation before and after replacement, and the calculation formula is as follows:
V I ( ν ) = M S E ( ν ) = 1 n t = 1 n ( M S E t M S E t ( ν ) )
R ( ν ) = V I ν V I ν
where in the Equations (9)–(12), N t is the number of cities in the tree with OOB data; y ^ i , t is the predicted value of the dependent variable of the city under the tree; y ^ i , t ( ν ) is the predicted value of the dependent variable of the city under the new tree after random substitution of variables; V I ( ν ) is the importance of variables; and R ( ν ) is the variable importance ratio.

2.3.3. A Combination of the Two Approaches

Ecological footprint size (EFsize) and depth (EFdepth) of the study area can be obtained through the three-dimensional ecological footprint model (Equations (1)–(7)). These two variables are taken as explained variables, and the indicators (X1, …, X9 in Table 3) representing the three aspects of economy, society, and environment are taken as explanatory variables. Then, we conducted random forest regression model fitting to investigate the explanatory ability of indicators and then calculated the importance proportion of all variables (X1, …, X9) based on the OOB algorithm (see “Section 2.3.2”) so as to complete the task of identifying influencing factors.

3. Results

3.1. Ecological Footprint Size

The ecological footprint size represents the human occupation of natural capital flow. As shown in Figure 3, the per capita EFsize of each city showed an overall increasing trend over time, but the value of per capita EFsize varies significantly among cities. In 2019, the natural capital flows of Ziyang City, Deyang City, and Mianyang City were more fully occupied, with per capita EFsize exceeding 0.5 hm2. It is worth noting that the per capita EFsize of Ziyang City changed the most from 2000 to 2019, while the other seven cities had little change, and the per capita EFsize values for Chengdu City and Leshan City were always within the range of 0.2–0.4 hm2.
Further analysis of the EFsize of each land type (as shown in Figure 4) found that the EFsize ratio of cultivated land in all cities was the largest, and the EFsize ratio of cultivated land in other cities is more than 90%, except Ya’an City. It means that the regional development of the CUA is highly dependent on cultivated land. However, the proportion of EFsize in forests, grazing lands, fishing grounds, and built-up areas varies among cities. Except for the EFsize proportion of forests in Ya’an City increasing significantly, the EFsize proportion of different land types remained relatively stable from the perspective of time until 2019. Therefore, the EFsize of different kinds of land in each city in 2019 can be analyzed in detail. In 2019, the proportion of the EFsize of croplands was the largest, with the highest being Ziyang City (96.09%) and the lowest being Ya’an City (45.41%). It is followed by forest EFsize (Ya’an City is the highest at 43.99%, and Ziyang City is the lowest at 2.64%), grazing lands (Ya’an City is the highest at 8.59%, and Ziyang City is the lowest with 0.11%), built-up areas (Leshan City is the highest with 1.74%, and Mianyang City is the lowest with 0.35%), fishing grounds (Leshan City is the highest with 0.57%, and Deyang City is the lowest with 0.15%). In general, these four land types have little influence on the ecological footprint size of the CUA.

3.2. Ecological Footprint Depth

The EFdepth represents the consumption of the natural capital stock. Only Ya’an’s EFdepth is always at the original length, while the other cities exceed the actual length (Figure 5), which means that only Ya’an’s natural capital flow can meet the regional development needs. Meanwhile, much of the natural capital stock has been consumed in the remaining seven cities. There are apparent differences in EFdepth values among cities. Specifically, the EFdepth of Mianyang is lower than 10, and the value of Leshan’s EFdepth is between 6 and 11. The EFdepth values in Deyang and Chengdu ranged from 16 to 26, and Meishan and Suining were between 30 and 50. Ziyang had the highest EFdepth at 61. The difference in EFdepth indicates the difference in capital stock consumption and unsustainable development level in different cities. In terms of time, the development trend of EFdepth in the eight cities is also different. The average annual change of EFdepth showed an increasing trend of seven cities excluding Ya’an. The average annual growth rates were as follows: Leshan (6.60%), Mianyang (5.79%), Ziyang (5.04%), Meishan (5.04%), Chengdu (4.85%), Suining (3.08%), and Deyang (2.73%).
Table 4 shows the EFdepth exploration of five land types (excluding carbon capture land) in 2000 and 2019. The EFdepth of croplands, built-up areas, and forests (excluding Meishan Ziyang, Deyang, and Chengdu) remains 1, which shows that under the condition of the overall urban ecological deficit, the forests and built-up areas have an ecological surplus and are in a sustainable development state. Combined with the growth of the built-up areas in each city, it shows that the expansion of built-up areas and the strengthening of industrialization in urbanization can alleviate the ecological pressure of built-up areas to a certain extent. However, the EFdepth of other land types showed overdevelopment, and the difference in the EFdepth of grazing land was the largest. The variation coefficient of EFdepth of grazing land in 8 cities increased from 88.79% to 94.3% (From 2000 to 2019), which indicates that the consumption of natural capital stock of grazing land is large and different among cities.

3.3. Three-Dimensional Ecological Footprint

The results of the three-dimensional ecological footprint of the CUA in 4 years are shown in Table 5. Specifically, only Chengdu presents a downward trend, declining by 8.32%. On the contrary, the other seven cities have a more substantial increase, as follows: Ziyang (251.77%), Leshan (126.56%), Mianyang (113.08%), Meishan (88.82%), Suining (72.74%), Ya’an (66.56%), and Deyang (50.81%). Therefore, we can infer that the characteristics of comprehensive utilization of regional resources in Chengdu urban agglomeration are as follows: Chengdu is the core of the radial development, and Chengdu’s industrial migration makes the surrounding cities develop rapidly. Furthermore, especially in 2016, Chengdu incorporated Jianyang city, an area under the jurisdiction of Ziyang city, into its administrative region.

3.4. Classification of Urban Agglomeration Ecological Sustainability

According to the standardized size relationship of the EFsize and EFdepth (Figure 6) and the systematic clustering results of standardized data, the ecological sustainability of 8 cities in the study area was intuitively divided into four types:
Type 1: both the EFsize and EFdepth are high, indicating high natural capital utilization and massive capital stock consumption. Cities in this category have the most extraordinary ecological environment pressure and the lowest degree of ecological sustainability.
Type 2: the EFsize is low and the EFdepth is moderate, manifested by the reasonable utilization of natural capital and the consumption rate of capital stock is higher than that of capital flow. These cities are facing more significant pressure from regional development and have a low degree of ecological sustainability.
Type 3: both the EFsize and EFdepth are moderate, which shows that the utilization rate of natural capital flow is higher than the utilization rate of the stock. These cities have high ecological sustainability
Type 4: the EFsize is moderate, and the EFdepth is low, manifested by lagging utilization of natural capital stock and dominated by capital flow utilization, these cities have the highest ecological sustainability.
As shown in Figure 7, obviously, during the study period (2000–2019), the ecological sustainability of the Chengdu urban agglomeration became worse, and some cities’ natural capital utilization types also changed significantly. For example, Chengdu changed from type 4 to type 2, and Ziyang changed from type 3 to type 1. The intensification of capital stock consumption led to a downward trend of regional ecological sustainability [32]. Furthermore, regarding geographical location, ecological sustainability is low, mainly concentrated in the central cities (such as Chengdu and Ziyang). In contrast, ecological sustainability is high in the north and south (in cities such as Mianyang, Ya’an, and Leshan). The spatial distribution characteristics of resource endowments in this region are consistent [33].

3.5. Identification Results of Influencing Factors

The nine indicators related to economy, society, and environment are selected (X1, X2, …, X9) as explanatory variables. Natural logarithms of the EFsize and the EFdepth were used as explained variables for random forest regression model fitting and the importance ratio (Table 6). Table 6 shows the OOB measurement results of 2000, 2010, 2015, 2019, the four years as a whole, and the corresponding goodness-of-fit R2 of the model. First, all R2 values are more significant than 0.7, indicating that all models are valid. Second, for footprint breadth, the importance of economic and social indicators for the EFsize increased from 2000 to 2019. The volume of economic indicators rose from 16.0% to 24.2%, and the importance of social indicators increased from 19.4% to 37.4%. However, the importance of environmental indicators decreased from 64.4% to 38.4%. Third, for the EFdepth, the situation changed significantly. The volume of environmental indicators has increased dramatically, from 40.4 percent in 2000 to 72.9 percent in 2019. On the other hand, the importance of economic and social indicators decreased significantly. Fourthly, according to the importance ratio of the accurate data, the three indexes that have the most significant impact on the EFsize are X6 (21.8%), X9 (20.3%), and X4 (15.4%), with a cumulative ratio of more than 50%. The three indexes that have the most significant influence on the EFdepth are X8 (35.8%), X9 (13.4%), and X3 (14.0%), which are the three indexes with the most significant importance, and the accumulative proportion exceeds 60%. It can be seen that, on the whole, environmental factors in the study area have the most significant impact on ecological sustainability.

4. Discussion

4.1. Influence the Effectiveness and Universality of Factor Identification Method

4.1.1. The Effectiveness of the Method

From the point of view of data characteristics, the EFsize and the EFdepth measured by the 3DEF model are numerical values with exponential properties, and there is a complex nonlinear relationship between a series of indicators of the economy, society, and environment, so the traditional factor identification method is invalid [34]. Therefore, previous studies just used the 3DEF model to measure ecological sustainability indicators [35] and conducted a simple descriptive statistical analysis of the measurement results [17]. The random forest can overcome the nonlinear relationship between variables [36]. It is meaningful to combine the measurement results of 3DEF model with the random forest. Fortunately, the R2 of the model obtained in Table 6 is very high, ranging from 0.75 to 0.90, indicating that this algorithm is indeed feasible.

4.1.2. The Universality of the Method

Computing the loss reduction on the out-of-bag (OOB) instead of the in-bag training samples makes the variable importance measurement unbiased [37]. So, the value of R2 increases gradually with time, implying that the random forest algorithm selected in this paper successfully identifies the factors affecting the ecological sustainability of urban agglomeration and has extensibility. Moreover, due to the extremely high ecological fragility of the Chengdu urban agglomeration, environmental protection is the primary measure to maintain and improve ecological sustainability [38,39]. That is to say, the realistic results also confirm the rationality of our method. In addition, whether the random forest is used to determine the key attributes of the fishery improvement projects (FIPs) [40] or obtain the importance measure of single and group variables, it has achieved good results [41]. In particular, the random forest has universal applicability to urban environmental problems, for example, the study of urban impervious surface extraction [42], research on the impact of spatial scale on urban ecological environment and human activities [43], and so on.

4.2. The Main Factors Affecting Ecological Sustainability

Among the three influencing factors of economy, society, and environment, the environmental factor has become the main influencing factor of ecological sustainability. The social and economic factors have more and more influence on utilizing natural capital flow. The research of this paper can provide the following two aspects of exploring the ecologically sustainable development and management of urban agglomeration. First, managers should focus on improving the utilization efficiency of natural capital flow to enhance the ecological sustainability of urban agglomeration. Industrial wastewater discharge (X6) and green coverage of built-up areas (X9) are significant to the EFsize. The water environment resources are an essential source of natural capital flow. Reducing industrial wastewater discharge in cities is conducive to protecting water environment resources, and the utilization efficiency of water resources will be improved [44]. Land resources are also essential donors of natural capital flow.
The improvement of green coverage in built-up areas can enhance the resilience of the urban ecological environment and the efficiency of land use [45]. With the acceleration of urbanization, human demand for natural capital increases, even if the utilization efficiency of natural capital flow is improved. Because the acceleration of urbanization makes consumption of the capital stock faster, urban ecological sustainability still faces a severe test [46]. Second, we could explore measures to balance the accumulation of natural capital and stock consumption to promote the ecological sustainability of urban agglomeration. Industrial smoke and dust emission (X8) and green coverage of built-up areas (X9) are the main influencing factors of the EFdepth. If we reduce emissions of pollutants, we can increase the accumulation of natural capital and thus increase the consumptive capacity of the capital stock [47]. Urban green space promotes ecosystem supply and regulation services [48]. The surge in population size in urban agglomerations brings a particular burden to ecological carrying capacity [49,50]. Therefore, maintaining the appropriateness of urban population size can alleviate the consumption of natural capital stock [51]. A suitable factor identification method is the cornerstone of a comprehensive evaluation study [52], and the research method in this paper may provide a basis for constructing an evaluation system for regional sustainable development research.

4.3. Limitations and Extensions of this Study

The study has several limitations. First, there are limitations to land use data used for ecological footprint accounting, such as low spatial and temporal resolution of data or high costs and long periods [53]. In fact, in future research, we may combine remote sensing interpretation, the Land-Parcel Identification System (LPIS), and the original Public Land Survey (PLS) in small areas to obtain high-accuracy data. Second, in the selection of indicators, the method of literature research has certain coverage limitations. In future studies, statistical methods such as structure equation modeling (SEM) and principal component analysis (PCA) can be combined to make the selection of indicators more comprehensive and objective. Thirdly, we need to further narrow the administrative scale of the research area (for example, take towns or streets as research objects) to make the research conclusions more targeted and the policy suggestions more operable. Finally, this study is the first to combine footprinting and machine learning methods despite some limitations.

5. Conclusions

Taking the Chengdu urban agglomeration as the research object, this paper first calculates the breadth and depth of the ecological footprint of this region by using the three-dimensional ecological footprint model, then divides the ecological sustainability types of the urban agglomeration according to it. Then it introduces the random forest OOB algorithm to identify the influencing factors of ecological sustainability and finally draws the following conclusions:
(1)
The ecological sustainability of the study area was divided into four categories.
(a)
The first category, the least ecologically sustainable, is characterized by high utilization of natural capital and massive consumption of capital stock. In this category, cities (such as Ziyang and Meishan in 2019 and Meishan in 2010) face tremendous ecological pressure and unsustainable risks.
(b)
Category two has low ecological sustainability because of the moderate use of natural capital and faster consumption of capital stock than flow, and cities (such as Chengdu in 2010, 2015, and 2019) are facing more significant pressure from regional development. As a result, they have a low degree of ecological sustainability.
(c)
The third category (with cities such as Suining Deyang, and Meishan in 2000, 2015, and 2019) has high ecological sustainability and is characterized by the utilization rate of natural capital flow being higher than the rate of stock consumption.
(d)
The last category (with cities such as Leshan and Ya’an in 2000, 2010, 2015, and 2019) has the highest ecological sustainability, which means the natural capital stock consumption lags, and the capital flow utilization leads.
(2)
The environment (the average importance ratio is 58.2%) is the main aspect affecting the ecological sustainability of urban agglomerations, among which the discharge of industrial wastewater, industrial smoke (powder) dust, and the green space of built-up areas are the most important. Therefore, we propose to improve the utilization efficiency of natural capital flow and the consumption resistance of stock by strictly controlling the discharge of industrial waste water and industrial smoke (powder) dust. The improvement of urban ecological sustainability can be used as a reference for evaluating the efficiency of urban environmental management.
(3)
Social (the average importance ratio is 25.9%) and economic (the average importance ratio is 15.9%) aspects also impact the ecological sustainability of urban agglomerations, especially on natural capital accumulation and stock consumption. At the same time as accelerating urbanization, maintaining the appropriateness of population size and enlarging urban green space can improve ecological sustainability. Furthermore, it is suggested to strengthen urban infrastructure construction, especially the GI (green infrastructure), to promote high-quality economic development and improve people’s living standards.
(4)
The random forest OOB algorithm overcomes the nonlinearity between the ecological footprint index and the economy–society–environment index. The model accuracy is higher than that of a traditional regression model. In the study of environmental assessment and management, the combination of machine learning methods and footprinting methods is feasible and reliable.

Author Contributions

Z.L.: conceptualization, funding acquisition, methodology, writing—review and editing. J.Y.: methodology, formal analysis, investigation, writing—original draft. D.Z.: data curation, visualization, writing—review and editing. J.Z.: data curation. All authors have read and agreed to the published version of the manuscript.

Funding

This research was supported by the National Social Science Fund of China: “Ecological Importance and Supporting Policies of Ecological Functional Areas in Key Urban Clusters in China” [No. 19FJY003].

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Zhang, K.; Wen, Z. Review and challenges of policies of environmental protection and sustainable development in China. J. Environ. Manag. 2008, 88, 1249–1261. [Google Scholar] [CrossRef] [PubMed]
  2. Xun, F.F.; Hu, Y.C. Evaluation of ecological sustainability based on a revised three-dimensional ecological footprint model in Shandong Province China. Sci. Total Environ. 2019, 649, 582–591. [Google Scholar] [CrossRef] [PubMed]
  3. Rees, W.E. Ecological footprints and appropriated carrying capacity: What urban economics leaves out. Environ. Urban. 1992, 4, 121–130. [Google Scholar] [CrossRef]
  4. Wackernagel, M. Ecological Footprint and Appropriated Carrying Capacity: A Tool for Planning Toward Sustainability; University of British Columbia: Vancouver, BC, Canada, 1994. [Google Scholar]
  5. Wackernagel, M.; Rees, W.E. Our Ecological Footprint: Reducing Human Impact on the Earth; New Society Publishers: Gabriola Island, BC, Canada, 1996; p. 160. [Google Scholar]
  6. Lenzen, M.; Murray, S.A. A modified ecological footprint method and its application to Australia. Ecol. Econ. 2001, 37, 229–255. [Google Scholar] [CrossRef]
  7. Syrovátka, M. On sustainability interpretations of the Ecological Footprint. Ecol. Econ. 2020, 169, 106543. [Google Scholar] [CrossRef]
  8. Li, P.H.; Zhang, R.Q.; Wei, H.; Xu, L. Assessment of physical quantity and value of natural capital in China since the 21st century based on a modified ecological footprint model. Sci. Total Environ. 2022, 806, 150676. [Google Scholar] [CrossRef]
  9. Niccolucci, V.; Bastianoni, S.; Tiezzi, E.B.P.; Wackernagel, M.; Marchettini, N. How deep is the footprint? A 3D representation. Ecol. Model. 2009, 220, 2819–2823. [Google Scholar] [CrossRef]
  10. Niccolucci, V.; Galli, A.; Reed, A.; Neri, E.; Wackernagel, M.; Bastianoni, S. Towards a 3D National Ecological Footprint Geography. Ecol. Model. 2011, 222, 2939–2944. [Google Scholar] [CrossRef]
  11. Fang, K.; Li, H.C. Provincial pattern of China’s natural capital use: A modification and application of eco-logical footprint depth and size. Nat. Resour. 2012, 27, 1995–2005. [Google Scholar] [CrossRef]
  12. Fang, K. Ecological footprint depth and size: New indicators for a 3D model. Acta Ecol. Sin. 2013, 33, 267–274. [Google Scholar] [CrossRef]
  13. Fang, K. Changes in the spatial distribution of natural capital use among G20 countries from 1999 to 2008. Resour. Sci. 2014, 36, 793–800. [Google Scholar]
  14. Fang, K. Assessing the natural capital use of eleven nations: An application of a revised three-dimensional model of ecological footprint. Acta Ecol. Sin. 2015, 35, 3766–3777. [Google Scholar] [CrossRef] [Green Version]
  15. Wang, Y.N.; Jiang, Y.T.; Zheng, Y.M.; Wang, H.W. Assessing the Ecological Carrying Capacity Based on Revised Three-Dimensional Ecological Footprint Model in Inner Mongolia, China. Sustainability 2019, 11, 2002. [Google Scholar] [CrossRef] [Green Version]
  16. Wu, F.F.; Yang, X.H.; Shen, Z.Y.; Bian, D.; Babuna, P. Exploring Sustainability and Decoupling Effects of Natural Capital Utilization in China: Evidence from a Provincial Three-Dimensional Ecological Footprint. J. Clean. Prod. 2021, 295, 126486. [Google Scholar] [CrossRef]
  17. Du, Y.Y.; Peng, J.; Gao, Y.; Zhao, H. Sustainability evaluation of natural capital utilization based on a three-dimensional ecological foot-print model: A case study of the Beijing-Tianjin-Hebei Metropolitan region. Prog. Geogr. 2016, 35, 1186–1196. [Google Scholar] [CrossRef] [Green Version]
  18. Wang, Y.N.; Zhou, Q.; Wang, H.W. Assessing Ecological Carrying Capacity in the Guangdong-Hong Kong-Macao Greater Bay Area Based on a Three-Dimensional Ecological Footprint Model. Sustainability 2020, 12, 9705. [Google Scholar] [CrossRef]
  19. Yang, Y.Y.; Lu, H.W.; Liang, D.Z.; Chen, Y.; Tian, P.; Xia, J.; Wang, H.; Lei, X. Ecological Sustainability and Its Driving Factor of Urban Agglomerations in the Yangtze River Economic Belt Based on Three-Dimensional Ecological Footprint Analysis. J. Clean. Prod. 2021, 330, 129802. [Google Scholar] [CrossRef]
  20. Chen, Y.Z.; Lu, H.W.; Yan, D.P.; Qiao, Y.; Xia, J. Spatial-Temporal Collaborative Relation among Ecological Footprint Depth/Size and Economic Development in Chengyu Urban Agglomeration. Sci. Total Environ. 2022, 812, 151510. [Google Scholar] [CrossRef]
  21. Frugoli, P.A.; Almeida, C.M.V.B.; Agostinho, F.; Giannetti, B.F.; Huisingh, D. Can measures of well-being and progress help societies to achieve sustainable development? Clean. Prod. 2015, 90, 370–380. [Google Scholar] [CrossRef]
  22. Bolón-Canedo, V.; Sánchez-Marono, N.; Alonso-Betanzos, A.; Benitez, J.M.; Herrera, F. A review of microarray datasets and applied feature selection methods. Inf. Sci. 2014, 282, 111–135. [Google Scholar] [CrossRef]
  23. Ziegler, A.; König, I.R. Mining data with random forests: Current options for real-world applications. Wiley Interdiscip. Rev. Data Min. Knowl. Discov. 2014, 4, 55–63. [Google Scholar] [CrossRef]
  24. Geng, A.X.; Tu, Q.S.; Chen, J.X.; Wang, W.; Yang, H. Improving litterfall production prediction in China under variable environmental conditions using machine learning algorithms. J. Environ. Manag. 2022, 103, 363–372. [Google Scholar] [CrossRef] [PubMed]
  25. Liu, M.C.; Li, W.H. Calculation of Equivalence Factor Used in Ecological Footprint for China and Its Provinces Based on Net Primary Production. J. Ecol. Rural Environ. 2010, 26, 401–406. [Google Scholar]
  26. Liu, M.C.; Li, W.H.; Xie, G.D. Estimation of China ecological footprint production coefficient based on net primary productivity. Chin. J. Ecol. 2010, 29, 592–597. [Google Scholar] [CrossRef]
  27. Fang, K.; Heijungs, R. A Review on Three-Dimensional Ecological Footprint Model for Natural Capital Accounting. Prog. Geogr. 2012, 31, 1700–1707. [Google Scholar] [CrossRef]
  28. Zhao, X.; Yu, B.; Liu, Y.; Chen, Z.; Li, Q.; Wang, C.; Wu, J. Estimation of Poverty Using Random Forest Regression with Multi-Source Data: A Case Study in Bangladesh. Remote Sens. 2019, 11, 375. [Google Scholar] [CrossRef] [Green Version]
  29. Verikas, A.; Gelzinis, A.; Bacauskiene, M. Mining Data with Random Forests: A Survey and Results of New Tests. Pattern Recognit. 2011, 44, 330–349. [Google Scholar] [CrossRef]
  30. Luo, Y.; Yan, J.; McClure, S.C.; Li, F. Socioeconomic and environmental factors of poverty in China using geographically weighted random forest regression model. Environ. Sci. Pollut. Res. Int. 2022, 29, 33205–33217. [Google Scholar] [CrossRef]
  31. Zhang, L.; Wang, L.L.; Zhang, X.D.; Shirong, L.; Pengsen, S. The basic principle of random forest and its applications in ecology: A case study of Pinus yunnanensis. Acta Ecol. Sin. 2014, 34, 650–659. [Google Scholar] [CrossRef]
  32. Dong, H.W.; Li, P.; Feng, Z.M.; Yang, Y.; You, Z.; Li, Q. Natural Capital Utilization on an International Tourism Island Based on a Three-Dimensional Ecological Footprint Model: A Case Study of Hainan Province, China. Ecol. Indic. 2019, 104, 479–488. [Google Scholar] [CrossRef]
  33. Ma, L.; Tang, H.; Ran, R.P.; Xiao, Y.J. Study on spatial and temporal evolvement and coupling effect of water resources pressure and cultivated land use effeciency in Sichuan. Chin. J. Agric. Resour. Reg. Plan. 2019, 40, 9–19. [Google Scholar] [CrossRef]
  34. Aldrich, C. Process Variable Importance Analysis by Use of Random Forests in a Shapley Regression Framework. Minerals 2020, 10, 420. [Google Scholar] [CrossRef]
  35. Guo, J. Evaluation and Prediction of Ecological Sustainability in the Upper Reaches of the Yellow River Based on Improved Three-Dimensional Ecological Footprint Model. Int. J. Environ. Res. Public Health 2022, 19, 13550. [Google Scholar] [CrossRef]
  36. Grömping, U. Variable Importance Assessment in Regression: Linear Regression versus Random Forest. Am. Stat. 2009, 63, 308–319. [Google Scholar] [CrossRef]
  37. Loecher, M. Unbiased variable importance for random forests. Commun. Stat.-Theory Methods 2022, 51, 1413–1425. [Google Scholar] [CrossRef]
  38. Jin, L.J.; Xu, Q.L. Ecological vulnerability assessment of Sichuan Province based on SRP model. Ecol. Sci. 2022, 41, 156–165. [Google Scholar] [CrossRef]
  39. Liu, Y.; Yang, S.; Han, C.; Ni, W.; Zhu, Y. Variability in Regional Ecological Vulnerability: A Case Study of Sichuan Province, China. Int. J. Disaster Risk Sci. 2020, 11, 696–708. [Google Scholar] [CrossRef]
  40. Kendra, L.; Thomas, T.; Larry, B.; Kendrick, G.A.; Clifton, J. Key attributes related to fishery improvement project (FIP) effectiveness in promoting improvements towards sustainability. Fish Fish. 2019, 20, 451–465. [Google Scholar] [CrossRef]
  41. Song, S.F.; He, R.Y. Importance measure index system based on random forest. J. Natl. Univ. Def. Technol. 2021, 43, 25–32. [Google Scholar] [CrossRef]
  42. Gao, Y.F.; Li, J.M.; Liu, D.W.; Ren, Z.; Wang, N. Research on extraction of urban impervious surface based on random forest model: A case study in Hohhot. J. Glaciol. Geocryol. 2018, 40, 828–836. [Google Scholar] [CrossRef]
  43. Cheng, P.G.; Yue, C.; Wei, X.J.; Zhou, J.W. Study on the influence of scale change on the relationship between urban ecological environment and human activities. Bull. Surv. Mapp. 2020, 3, 56–63. [Google Scholar] [CrossRef]
  44. Liang, D.; Lu, H.; Feng, L.; Qiu, L.; He, L. Assessment of the Sustainable Utilization Level of Water Resources in the Wuhan Metropolitan Area Based on a Three-Dimensional Water Ecological Footprint Model. Water 2021, 13, 3505. [Google Scholar] [CrossRef]
  45. Huang, B.X.; Chiou, S.C.; Li, W.Y. Landscape Pattern and Ecological Network Structure in Urban Green Space Planning: A Case Study of Fuzhou City. Land 2021, 10, 769. [Google Scholar] [CrossRef]
  46. Abaidoo, R.; Agyapong, E.K. Environmental Sustainability Risk, Institutional Effectiveness and Urbanization. Energy Environ. 2022, 0958305X221118876. [Google Scholar] [CrossRef]
  47. Wang, H.F.; Li, J.L.; Tian, P.; Jiao, H.Y.; Wang, Z.Y.; Gao, Y. Research of spatial and temporal evolution and driving mechanism of local three-dimensional ecological footprint in Ningbo. Ecol. Sci. 2021, 40, 57–65. [Google Scholar] [CrossRef]
  48. Chen, Y.; Ge, Y.; Yang, G.; Wu, Z.; Du, Y.; Mao, F.; Liu, S.; Xu, R.; Qu, Z.; Xu, B.; et al. Inequalities of Urban Green Space Area and Ecosystem Services along Urban Center-Edge Gradients. Landsc. Urban Plan. 2021, 217, 104266. [Google Scholar] [CrossRef]
  49. He, X.; Tian, L.H.; Mao, L.L. Study on optimum population based on ecological footprint model—A case study of Changde City. Chin. J. Agric. Resour. Reg. Plan. 2019, 40, 54–64. [Google Scholar] [CrossRef]
  50. Bengochea Paz, D.; Henderson, K.; Loreau, M. Habitat percolation transition undermines sustainability in social-ecological agricultural systems. Ecol. Lett. 2022, 25, 163–176. [Google Scholar] [CrossRef]
  51. Lu, Y.N.; Yao, S.B.; Deng, Y.J.; Ding, Z.M.; Hou, M.Y.; Zheng, X.; Li, Y.N. The effects of land use and landscape pattern change on ecosystem service values under the background of the slpoing land conversion program in northern ShananXi. Chin. J. Agric. Resour. Reg. Plan. 2019, 40, 180–192. [Google Scholar] [CrossRef]
  52. Li, Z.G.; Zhong, J.L.; Yang, J.; Zhang, D.; He, S. Assessment framework and empirical analysis of the ecological protection importance for key town agglomerations in China. J. Clean. Prod. 2022, 372, 133682. [Google Scholar] [CrossRef]
  53. Zimmermann, J.; Fealy, R.M.; Lydon, K.; Mockler, E.M.; O’Brien, P.; Packham, I.; Smith, G.; Green, S. The Irish Land-Parcels Identification System (LPIS)—Experiences in ongoing and recent environmental research and land cover mapping. Biol. Environ. Proc. R. Ir. Acad. 2016, 116 Pt B, 53–62. Available online: https://www.muse.jhu.edu/article/809457 (accessed on 21 December 2022).
Figure 1. Research framework.
Figure 1. Research framework.
Ijerph 20 00422 g001
Figure 2. The evolution of ecological footprint model from a one-dimensional model to a three-dimensional model.
Figure 2. The evolution of ecological footprint model from a one-dimensional model to a three-dimensional model.
Ijerph 20 00422 g002
Figure 3. The EFsize of the eight cities from 2000 to 2019 (hm2).
Figure 3. The EFsize of the eight cities from 2000 to 2019 (hm2).
Ijerph 20 00422 g003
Figure 4. The EFdepth of land types composition from 2000 to 2019.
Figure 4. The EFdepth of land types composition from 2000 to 2019.
Ijerph 20 00422 g004
Figure 5. The EFdepth of eight cities from 2000 to 2019.
Figure 5. The EFdepth of eight cities from 2000 to 2019.
Ijerph 20 00422 g005
Figure 6. Quadrant scatter plots of the relationship between regional footprint depth and regional footprint size of each city.
Figure 6. Quadrant scatter plots of the relationship between regional footprint depth and regional footprint size of each city.
Ijerph 20 00422 g006
Figure 7. Spatial and temporal distribution of ecological sustainability in 8 cities.
Figure 7. Spatial and temporal distribution of ecological sustainability in 8 cities.
Ijerph 20 00422 g007
Table 1. Accounting account of three-dimensional ecological footprint of the CUA.
Table 1. Accounting account of three-dimensional ecological footprint of the CUA.
AccountSub-AccountConsumer Goods ItemsLand TypesEquivalence FactorYield Factor
Biological resourcesfarm productsgrains (grains, tubers, beans), oil, vegetables and edible fungi, sugarcane, tobaccocroplands3.391.74
forest productsgarden fruit, tea, cocoonsforests1.10.86
livestock productsmeat (cattle, sheep, pigs, poultry, rabbits), milk (milk, sheep’s milk), eggsgrazing lands0.560.51
aquatic productsaquatic products (fish, shrimp and crabs, shellfish, algae, etc.)fishing grounds0.440.74
Energy resourcesfossil energyraw coal, natural gas, gasoline, diesel, cokecarbon capture land1.10
electricityelectricitybuilt-up area3.391.74
Table 2. Average yield and energy conversion coefficient of “province hectare” in the CUA.
Table 2. Average yield and energy conversion coefficient of “province hectare” in the CUA.
ItemsAverage Yield (kg/hm2)ItemsAverage Yield (kg/hm2)ItemsEnergy
Footprint * (GJ/hm2)
Convert Coefficient (GJ/ton)
grain5453.472tea804.813raw coal5520.934
oil2189.756garden fruit2459.02natural gas9318.003
vegetables and edible fungi28,912.615meat5592.36gasoline9343.124
sugarcane46,910.696milk494.10diesel9342.705
tobacco2112.329eggs1151.27coke5528.47
cocoons600aquatic products1475.079electricity100011.84
Note: index data with * was calculated in global hectares.
Table 3. Socioeconomic and environmental indicators of the CUA.
Table 3. Socioeconomic and environmental indicators of the CUA.
PerspectiveIndicator and CodeUnit
EconomicEconomic development, X1RMB 10,000
Industrial structure, X2%
SocialPopulation size, X310,000 people
Urbanization, X4%
Government intervention, X5RMB 10,000
EnvironmentalIndustrial wastewater discharge, X6million tons
Industrial exhaust emissions, X7billion standard cubic meters
Industrial smoke (powder) dust emission, X8ton
Greenery coverage of urban area, X9%
Table 4. EFdepth of land types.
Table 4. EFdepth of land types.
CityCroplandsForestsGrazing LandsFishing GroundsBuilt-Up Areas
2000201920002019200020192000201920002019
Chengdu1112.7510.9113.272.497.1211
Deyang1111.1814.6315.882.236.2611
Mianyang11111.091.411.785.3411
Suining111128.3935.861.324.1111
Leshan11112.102.801.025.0811
Meishan111.043.8715.8418.743.5110.2311
Yaan1111111111
Ziyang112.809.0629.1240.851.934.9311
Table 5. Per capita 3D ecological footprint from 2000 to 2019 (hm2).
Table 5. Per capita 3D ecological footprint from 2000 to 2019 (hm2).
City2000201020152019Changes from 2000 to 2019
Chengdu4.99 6.24 4.73 4.57 −0.41 −8.32%
Deyang9.50 13.97 13.71 14.33 4.83 50.81%
Mianyang2.53 4.78 4.61 5.39 2.86 113.08%
Suining10.90 23.66 19.77 18.83 7.93 72.74%
Leshan1.84 3.29 3.65 4.18 2.33 126.56%
Meishan8.10 12.64 18.17 15.30 7.19 88.82%
Yaan1.43 2.33 2.41 2.38 0.95 66.56%
Ziyang11.02 24.10 35.19 38.76 27.74 251.77%
Table 6. The importance ratio and model performance of indicators in each year.
Table 6. The importance ratio and model performance of indicators in each year.
ProjectTimeEconomicSocietyEnvironmentR2
X1X2X3X4X5X6X7X8X9
for EFsize200010.0%6.0%4.1%11.1%4.2%10.2%9.2%20.0%25.2%0.747
201012.9%10.8%10.8%6.4%10.1%7.3%9.5%14.5%17.7%0.806
20158.4%17.7%16.2%14.7%11.9%10.4%5.6%5.2%9.9%0.899
201911.9%12.3%15.4%12.0%10.0%7.1%12.9%3.8%14.6%0.888
2000–20198.5%13.1%8.4%15.4%3.2%21.8%5.5%3.9%20.3%0.934
for EFdepth200015.2%11.7%17.8%6.8%8.1%6.4%5.0%6.5%22.5%0.728
201014.5%4.9%8.4%19.5%3.5%10.8%13.2%14.8%10.4%0.753
201511.8%8.4%4.5%8.8%8.5%6.1%40.4%7.6%3.9%0.768
20199.2%9.2%3.3%5.4%9.2%3.6%12.8%40.8%6.5%0.838
2000–20195.9%4.4%14.0%5.3%5.5%9.3%6.4%35.8%13.4%0.828
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Li, Z.; Yang, J.; Zhong, J.; Zhang, D. Assessment of Urban Agglomeration Ecological Sustainability and Identification of Influencing Factors: Based on the 3DEF Model and the Random Forest. Int. J. Environ. Res. Public Health 2023, 20, 422. https://doi.org/10.3390/ijerph20010422

AMA Style

Li Z, Yang J, Zhong J, Zhang D. Assessment of Urban Agglomeration Ecological Sustainability and Identification of Influencing Factors: Based on the 3DEF Model and the Random Forest. International Journal of Environmental Research and Public Health. 2023; 20(1):422. https://doi.org/10.3390/ijerph20010422

Chicago/Turabian Style

Li, Zhigang, Jie Yang, Jialong Zhong, and Dong Zhang. 2023. "Assessment of Urban Agglomeration Ecological Sustainability and Identification of Influencing Factors: Based on the 3DEF Model and the Random Forest" International Journal of Environmental Research and Public Health 20, no. 1: 422. https://doi.org/10.3390/ijerph20010422

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop