Next Article in Journal
Analysis of Walkable Street Networks by Using the Space Syntax and GIS Techniques: A Case Study of Çankırı City
Next Article in Special Issue
Synergy of Road Network Planning Indices on Central Retail District Pedestrian Evacuation Efficiency
Previous Article in Journal
Using Enhanced Gap-Filling and Whittaker Smoothing to Reconstruct High Spatiotemporal Resolution NDVI Time Series Based on Landsat 8, Sentinel-2, and MODIS Imagery
Previous Article in Special Issue
The Spatial Data Analysis of Determinants of U.S. Presidential Voting Results in the Rustbelt States during the COVID-19 Pandemic
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Hybrid Prediction Model Based on Decomposed and Synthesized COVID-19 Cumulative Confirmed Data

1
School of Computer Science and Engineering, Wuhan Institute of Technology, Wuhan 430205, China
2
Hubei Key Laboratory of Advanced Control and Intelligent Automation for Complex Systems, Wuhan 430074, China
3
Engineering Research Center of Intelligent Technology for Geo-Exploration, Ministry of Education, Wuhan 443002, China
*
Author to whom correspondence should be addressed.
ISPRS Int. J. Geo-Inf. 2023, 12(6), 215; https://doi.org/10.3390/ijgi12060215
Submission received: 16 March 2023 / Revised: 16 May 2023 / Accepted: 19 May 2023 / Published: 24 May 2023

Abstract

:
Since 2020, COVID-19 has repeatedly arisen around the world, which has had a significant impact on the global economy and culture. The prediction of the COVID-19 epidemic will help to deal with the current epidemic and similar risks that may arise in the future. So, this paper proposes a hybrid prediction model based on particle swarm optimization variational mode decomposition (PSO-VMD), Long Short-Term Memory Network (LSTM) and AdaBoost algorithm. To address the issue of determining the optimal number of modes K and the penalty factor ( α ) in the variational mode decomposition (VMD), an adaptive value for particle swarm optimization (PSO) is proposed. Specifically, the weighted average sample entropy of the relevant coefficients is utilized to determine the adaptive value. First, the epidemic data are decomposed into multiple modal components, known as intrinsic mode functions (IMFs), using PSO-VMD. These components, along with policy-based factors, are integrated to form a multivariate forecast dataset. Next, each IMF is predicted using AdaBoost-LSTM. Finally, the prediction results of all the IMF components are reconstructed to obtain the final prediction result. Our proposed method is validated by the cumulative confirmed data of Hubei and Hebei provinces. Specifically, in the case of cumulative confirmation data, the coefficient of determination ( R 2 ) of the mixed model is increased compared to the control model, and the average mean absolute error (MAE) and root mean square error (RMSE) decreased. The experimental results demonstrate that the VMD–AdaBoost–LSTM model achieves the highest prediction accuracy, thereby offering a new approach to COVID-19 epidemic prediction.

1. Introduction

In late 2019, an outbreak of novel coronavirus pneumonia occurred in Wuhan, Hubei Province, China. The virus spread rapidly around the world in a short period of time. It has posed enormous threats and challenges to human life, global public health security, and the global economy, causing significant impacts and damage. Targeted epidemic prevention policies and measures are key to controlling the spread of the epidemic. Accurate predictions of the spread of the epidemic can provide a reference for countries to design epidemic prevention policies. Therefore, how to improve prediction accuracy has become the focus of research for many scholars [1,2,3].

1.1. Literature Review

Since the outbreak of the epidemic, many scholars have carried out research on the prediction of COVID-19, and this can be roughly divided into two categories: (1) single model prediction, and (2) hybrid model prediction. Single-model forecasting can be divided into traditional epidemiological models and machine learning models. In [3], the SIR model was used to predict the COVID-19 epidemic, but the results were not satisfactory, because the development of the epidemic was affected by many factors, and it was difficult to achieve accurate prediction results using the pure Susceptible Infected Recovered (SIR) model [4]. In [5], an SIR model that can adapt to the surge of susceptible populations is developed. It can better predict the actual number of infections and deaths in some areas, but it still struggles to overcome the sudden change in external factors. It is challenging to accurately predict the drastic fluctuations in the actual numbers of infections and deaths due to changing external factors. In [6,7,8,9], the traditional Susceptible, Exposed, Infected, Recovered (SEIR) model was combined with some external factors such as quarantine, vaccination and other strategies for the prediction of the COVID-19 epidemic, and they achieved good results, but the parameters of the model, such as the mutation rate of the virus, the probability of recovery, etc., change dynamically during the evolution of the epidemic, and these models do not take this feature into account. So, there are still some problems.
In [10], four models were used to predict the COVID-19 epidemic—cumulative confirmed cases and deaths, including linear regression, exponential smoothing, least absolute shrinkage and selection operator (Lasso), and support vector machine (SVM). Among them, the predictive effect of SVM applied to the three types of data is poor. Ref. [11] used random forest, linear regression, and multi-layer perceptron to predict data for the United States, Germany, and the world. Among these models, SVM achieved the best results. This is due to the fact that the epidemic data are inherently unstable and difficult to predict. If the complexity of the data can be reduced, the prediction effect of SVM will be improved.
In [12], the LSTM model was first used to predict the spread of the epidemic in Canada, Italy, and the United States. In [13], LSTM, bidirectional long short-term memory (BILSTM), and Encoding–Decoding–LSTM models were used to predict the development of the epidemic in India. Among these models, Encoding–Decoding–LSTM achieved the best prediction effect. In [14], BILSTM–Encoding–Decoding and 16 other models were used to make comparative predictions based on the epidemic data from Saudi Arabia. In the end, BILSTM–Encoding–Decoding achieved the best results, but a problem was also raised in [14], in that it failed to consider the impact of relevant policies on the development of the epidemic.
In [15], the Autoregressive Integrated Moving Average (ARIMA) model was used to compare SIR, SEIR and other infectious disease models, and to predict the epidemic situation in Kuwait. Finally, the ARIMA model achieved better results. In [16], ARIMA was used to predict the epidemic trend pattern in Saudi Arabia. The best ARIMA model for predicting daily new cases was identified, enabling the estimation of the approximate number of confirmed cases in the next month.
To sum up, the infectious disease model can achieve better prediction results when there is a large amount of stable data, but the epidemic data are complex, nonlinear, and unstable. Moreover, the infectious disease model can only make rough predictions, and cannot achieve accurate predictions. Single models such as SVM, ARIMA, and LSTM can accurately predict the development of the epidemic, but they also have certain limitations.
To achieve better prediction accuracy, some researchers have proposed a hybrid prediction model, combining different models to achieve the desired forecasting effect. Hybrid models can be roughly divided into two categories: hybrid models based on component composition, and hybrid models based on data processing. The former combines more than two models to predict the epidemic. For example, in [17], a combination of the hybrid neural network and SEIR model predicted that the occupancy rate of ICUs during the epidemic would improve at the national level and within the city. While the superposition of two models may improve the prediction accuracy to a certain extent, this may not necessarily overcome the limitations of the model itself. Furthermore, introducing too many models may increase the number of undetermined parameters and complicate the forecasting process. The latter approach is built upon a hybrid model of data processing, using the related processing of input data, such as decomposition, filtering, denoising, feature engineering, interpolation, and other processing methods. The decomposition method can decompose the original data into components of varying complexity, which may more effectively capture the inherent characteristics of the data, reduce the complexity of the original sequence, and ultimately yield more accurate prediction results. For example, ref. [18] proposed a prediction method based on wavelet decomposition (DWD). He used DWD to decompose the original sequence into several sub-components, each of which contained some of the information of the original sequence, and he then used ARIMA to predict the sub-components. Finally, the prediction results of the subcomponents were linearly summed as the final prediction result. Good results were obtained in most cases, but the nature of DWD is a Fourier transform, which is difficult to apply to non-stationary signals such as epidemics.
Ref. [19] proposed an EEMD-based prediction model for the COVID-19 epidemic, which decomposes the input raw data into several modal components, and then uses LSTM to make predictions on these components. The data-based processing model is more adaptable to various types of data, leading to prediction results that are closer to the actual data. However, empirical mode decomposition algorithms such as Empirical Mode Decomposition (EMD), Ensemble Empirical Mode Decomposition (EEMD), and Complete Ensemble Empirical Mode Decomposition with Adaptive Noise (CEEMDAN) have common shortcomings, such as a lack of a solid theoretical foundation and modal aliasing, meaning that similar frequencies are decomposed into separate components, which can lead to significant deviations from forecasts. VMD is a cutting-edge decomposition algorithm with a solid theoretical foundation, capable of addressing the issue of modal aliasing [20] and effectively capturing inherent data characteristics. Therefore, to avoid the limitations of other decomposition algorithms, this paper chooses VMD to decompose the original data [21]. However, VMD also has its own disadvantages. The modal component K and the penalty factor α are determined based on experience and are relatively subjective [22]. To address this problem, the PSO algorithm is introduced. PSO algorithm is a classic intelligent optimization algorithm. It is easy to implement and achieves relatively fast convergence. Therefore, this paper proposes to use PSO algorithm to obtain K and a penalty factor, so as to improve the adaptability of the algorithm.
In addition, Refs. [23,24] described positive intervention methods, such as wearing masks and home isolation, which have a significant curbing effect on the development of the epidemic. However, due to the difficulty in obtaining data, we only introduced policy factors to simulate the actual epidemic situation. The introduction to policy factors will inevitably increase the difficulty of forecasting. To improve the accuracy of forecasting, we propose a hybrid prediction model, PSO–VMD–AdaBoost–LSTM, based on optimized variational mode decomposition (PSO-VMD) and an AdaBoost-enhanced long short-term memory network (AdaBoost-LSTM).

1.2. Contributions of This Paper

  • Currently, COVID-19 predictions are mostly univariate. This paper builds a new predictive dataset by incorporating policy factors.
  • Existing hybrid models for COVID-19 prediction are mainly based on component combinations, while methods based on data processing have just begun to emerge. Aiming at the defects of EMD and its optimization algorithms such as EEMD, CEEMDAN, etc., this paper proposes a VMD method for decomposing COVID data.
  • The VMD method has certain defects, namely, the key parameters K and α need to be preset based on experience. Aiming at this problem, this paper proposes a PSO–VMD method, which realizes the adaptive value of K and α.
  • The AdaBoost algorithm is proposed to enhance the LSTM, which finally improves the prediction accuracy to a certain extent.
  • The effectiveness of the method is verified and tested using the epidemic data from Hubei Province and Hebei Province.

2. Materials and Methods

2.1. Variational Mode Decomposition (VMD)

VMD is a novel adaptive non-recursive signal decomposition method that enhances the stability of sequences [25]. The VMD method can effectively overcome the mode mixing issue of the EMD method [26] and has a solid theoretical foundation. In this study, VMD is used to decompose the COVID-19 data, and the structure and solution of VMD are as follows.
The structure of VMD involves constructing and solving a variational constraint problem to decompose a sequence. The epidemic time series is treated as the input signal f, and the variational problem is described as using the center frequency to find K modal functions with limited bandwidth to minimize the sum of the bandwidth estimates of each mode [26]. The model of the constructed variational constraint problem is formulated as in Formula (1).
min { u k } , { ω k } { k = 1 K t [ ( δ ( t ) + j π t ) u k ( t ) ] j ω k t 2 2 } s . t . k = 1 K u k ( t ) = f ( t )
Formula (1) shows the intrinsic mode function (IMF) obtained after decomposition. { ω k } = { ω 1 , , ω k } represents the corresponding central frequency of each IMF. δ ( t ) is the impact function. To solve the variational constraint problem described above, the Lagrange multiplication operator λ ( t ) is introduced to penalize the factor C. This converts the constrained variational problem into an unconstrained one, expressed as Formula (2), which enables the solving of the variational problem.
L ( { u k } , { ω k } , λ ) = C k = 1 K t [ ( δ ( t ) + j π t ) u k ( t ) ] j ω k t 2 2 + f ( t ) k = 1 K u k ( t ) 2 2 + λ ( t ) , f ( t ) k = 1 K u k ( t )
The Alternate Direction Method of Multipliers (ADMM) is introduced, where u k n + 1 , ω k n + 1 , λ k n + 1 are alternately updated, and n represents the number of iterations.
u ^ k ( n + 1 ) ( ω ) = f ^ ( ω ) k = 1 K u ^ k ( ω ) + λ ^ ( ω ) 2 1 + 2 C ( ω ω k )
ω ^ k ( n + 1 ) = 0 ω | u ^ k ( ω ) | 2 d ω 0 | u ^ k ( ω ) | 2 d ω
λ ^ n + 1 ( ω ) = λ ^ n + 1 ( ω ) + τ [ f ^ ( t ) k = 1 K u k n + 1 ( ω ) ]
The iteration is terminated based on the accuracy e, and the stopping condition is expressed in Formula (6).
k = 1 K u ^ k ( n + 1 ) u ^ k n 2 2 u ^ k n 2 2 < e

2.2. LSTM

LSTM is carefully designed by adding memory features based on Recurrent Neural Networks (RNN) to avoid the problems of long-term dependence [27]. LSTM can maintain the long-term memory of the neural network, making the model more suitable for epidemic data prediction. For RNN, due to the unrestricted updating of information in the network layer, there will be a problem of gradient disappearance or gradient explosion, while the LSTM network introduces forgetting units and storage units into the hidden layer, which discards secondary information when new information is input and retains important information in long-term memory. These units are referred to as gates in the LSTM model.
Forget gate: read the output h t 1 of the previous layer and the current input x t , output and assign it to the current cell state C t 1 .
f t = σ ( W f [ h t 1 , x t ] + b f )
Input gate: remember the current i t and part of the output information C ˜ t of the forget gate.
i t = σ ( W i [ h t 1 , x t ] + b i )
C ˜ t = tanh ( W c [ h t 1 , x t ] + b C )
Output gate: select a part of the cell state and finally output h t .
σ t = σ ( W o [ h t 1 , x t ] + b o )
h t = σ tanh ( C t )
The σ is the sigmoid activation function.
In Figure 1, each solid black line transmits the entire vector, the circles represent element-wise operations, and the rectangular boxes represent network layers. The composite lines represent connections between vectors.

2.3. VMD Optimized by PSO

If the value of K is too large or too small, it will affect the final prediction. So, this paper proposes a VMD method based on particle swarm optimization (PSO). Inspired by [28], a weighted average sample entropy based on the correlation coefficients is proposed as the objective function for the PSO algorithm to optimize VMD and achieve better decomposition results. The correlation coefficient is a measure of the degree of association between two signals [29].
Calculation method of correlation coefficient: x i is a subsequence, y i is the original sequence, x ¯ i is the mean of the subsequence, y ¯ i is the mean of the original series, and K is the number of the IMF.
r i = i = 1 K ( x i x i ¯ ) ( y i y ¯ ) i = 1 K ( x i x i ¯ ) 2 ( y i y ¯ ) 2 i = 1 , 2 K
By calculating the r i between each IMF and the original signal, we can assign weights to the sample entropy of each IMF. The overall average sample entropy is then calculated for each K value, which serves as the fitness value for the particle swarm optimization algorithm. Therefore, the fitness function of the particle swarm algorithm is f o b j . Here, SampEn is used to calculate the sample entropy of the current, and r i to calculate the correlation coefficient between the current and the original sequence. Formula (13) is the objective function of PSO. Figure 2 introduces the process of PSO for optimizing VMD.
f o b j = i = 1 K SampEn ( I M F i ) r i K , i = 1 , , K

2.4. AdaBoost–LSTM

Due to the inherent complexity and randomness of epidemics, a simple LSTM model is insufficient for accurate prediction. Thus, the AdaBoost algorithm is used to enhance the LSTM network.
The fundamental idea of the AdaBoost algorithm is to aggregate the training results of multiple weak learners to obtain a strong learner capable of tackling complex tasks, with the strong learner’s prediction results serving as the final output [30].
While originally developed for classification tasks, AdaBoost could also be adapted for regression problems. The specific method of using the AdaBoost algorithm to enhance the LSTM neural network model is given below. Figure 3 is the framework of Adaboost-LSTM.
The specific algorithm flow is as follows:
Step 1. Initialize the distribution of weights for the training data. Each sample is given the phase W I = 1 N , and N is the total number of samples. For each sample after the first iteration, the weight set of D i = ( W 11 , W 12 , , W 1 N ) ;
Step 2. Set the number of weak learners K. According to time and accuracy requirements, comprehensively set the number of weak learners;
Step 3. Weak learner prediction—train the i-th weak predictor, use the training data to predict in the LSTM network, get the output result, and compare it with the real value to get the error function e i   . The calculation method is
e t = i D i , i = 1 , 2 , , N
Step 4. Compute weak predictor weights. Calculate weak according to error function value. The predictor weight is   α t   , and the calculation formula is
α t = 1 2 ln ( 1 e i e i ) , t = 1 , 2 , , N
Step 5. Update the training data sample weights. Adjust the training data sample weight by the weak predictor weight a. The update formula is
W t + 1 , i = ω t , i β exp ( a t y i f t ( x i ) )
Step 6. Strong predictive function. After the weak learner is trained K times, K groups of weak prediction values are obtained, and the strong predictor is obtained after combination. The calculation formula of the strong predictor is
G ( x ) = s i g n [ t = 1 K a g f t ( x ) ]

2.5. Final Model

Based on the theoretical foundations above, we propose a hybrid prediction model, named PSO–VMD–AdaBoost–LSTM, that combines PSO, VMD, LSTM, and AdaBoost. The workflow of the proposed model is depicted in Figure 4.
First, the COVID-19 data are optimized using PSO–VMD to iteratively obtain the optimal K value and alpha, as well as the decomposed intrinsic mode functions. Based on the obtained IMF components, the AdaBoost–LSTM prediction model is established to generate the output results p r e i . Finally, the prediction results of each component are combined as in Formula (18), as the complete prediction result, and K is the number of the IMF.
X m i x = i = 1 n p r e i , i = 1 , 2 K

2.6. Date Modeling

2.6.1. Data Sources and Experimental Environment

This study has conducted a predictive simulation experiment using actual daily cumulative confirmed COVID-19 data. The data of Hubei Province and Hebei Province from 1 May 2020 to 31 December 2021 were selected from the COVID-19 policy tracking data warehouse released by Oxford University “https://github.com/OxCGRT/covid-policy-tracker (accessed on 13 April 2020)”, which is a multivariate time series with multiple dependent variables over time. In the end, a category of variables with strong correlation was selected, comprising mainly those related to policies that curbed public activities and closed public places and transportation. The variables are explained in Table 1. Finally, the first 90% of the data were selected as the training set, and the last 10% as the testing set. The specific experimental environment was developed using Python 3.7. The CEEMDAN decomposition was performed using the PyEMD library version 1.2.3, while the VMD decomposition used the vmdpy library. The LSTM network was built by Tensorflow 2.6. The cumulative confirmed data of Hubei Province and Hebei Province are shown in Figure 5.

2.6.2. Evaluating Indicator

To quantitatively describe and evaluate the performance of the model, root mean square error (RMSE), the coefficient of determination ( R 2 ), the mean absolute error (MAE), and the mean absolute percentage Error (MAPE) are selected.
R M S E = 1 n i = 1 n ( Y i Y ^ i ) 2
R 2 = 1 i = 1 n ( Y ^ i Y i ) 2 i = 1 n ( Y ¯ i Y i ) 2
M A E = 1 n i = 1 n | Y i Y ^ i |
M A P E = 1 n i = 1 n | Y i Y ^ i | Y i
Y i   is the true value, Y ^ i   is the predicted value, and n is the total number of samples.

3. Results

3.1. The Experiment of PSO–VMD

Since the particle swarm optimization algorithm was proposed, many scholars have carried out relevant research. To improve the convergence performance of the algorithm, we introduced the concept of inertia weight w. The inertia weight (w), as a crucial parameter in PSO, determines the magnitude of influence exerted by the historical state on the algorithm’s evolutionary process. This paper introduces a strategy of non-linear weight reduction, as shown in Formula (23).
ω O = ω start ( ω start ω end ) × ( 2 × ( p / T max ) ( p / T max ) 2 )
ω start is the initial weight, ω end is the termination weight, p is the current round number of iteration, and T max   is the maximum number of iteration rounds. The dynamically decreasing ω enables the algorithm to conduct a global search in the early stage of operation. This helps in finding more optimal solutions in a large search space. The gradually reducing ω in the iterative process gives the particles a finer local search ability, which is beneficial in helping the algorithm to search for a better optimal solution among the potential optimal solutions that have been identified. Therefore, we set the initial weight of the particle swarm optimization algorithm to 0.9, and gradually decreased the termination weight by 0.1; the step size of each decrease was also 0.1.
The cumulative confirmed data in Hubei Province from 1 May 2020 to 31 December 2021 have been used as the input of the VMD algorithm. The particle swarm algorithm with inertia weight was used to optimize VMD. Table 2 shows the other parameters of the particle swarm optimization algorithm. Figure 6 shows the decrement in inertia weight across eight experiments. The results of the final eight iterations are all 4, and α = 2685 ± 10. Therefore, the particle swarm optimization algorithm can be optimal. The final decomposition result of PSO–VMD is shown in Figure 7.
To compare the effects of VMD decomposition, the complete set of empirical mode decompositions was selected for comparison. CEEMDAN is an optimization algorithm based on empirical mode decomposition, which improves the defects of the EMD algorithm to a large extent. CEEMDAN is widely used in many fields due to its high performance ability. Figure 8 is the decomposition result of CEEMDAN.
In Figure 8, IMF4 and IMF5 exhibit obvious modal aliasing phenomena. These two modes are of the same characteristic scale, and their waveforms are essentially similar, which satisfies the modal aliasing standard proposed by Huang [31]. In Figure 8, the first three components show a significant swing on the right end due to the noise interference, and these three components account for a large proportion of the original sequence, so they will have a greater impact on the entire sequence. The PSO–VMD method shown in Figure 7 demonstrates smaller waveform distortion and better noise robustness.

3.2. Forecasting Results

3.2.1. Prediction Based on Hubei Cumulative Confirmed Data

In this chapter, we present the prediction results obtained from the previously discussed VMD–AdaBoost–LSTM model. Table 3 is the four evaluation indicators mentioned in Section 2.6.2, which are used for quantitative analysis.The key parameters of the model are shown in Table 4. To demonstrate its superiority, it has been compared with three other models: CEEMDAN–LSTM, VMD–LSTM and LSTM. Figure 9 shows the comparison of the prediction results of the four prediction models. For example, Figure 10 presents the comparison results of the overall model using the data from Hubei Province. Figure 11 is the error distribution diagram of the four models.
It can be seen from Figure 9 that, compared with the other three models, the prediction effect of VMD–AdaBoost–LSTM is most consistent with the original data. Furthermore, it can be seen from Figure 10 that the predicted points of VMD–LSTM and VMD–AdaBoost–LSTM are the closest to the original point. In Figure 11, it is shown that the predicted value of VMD–AdaBoost–LSTM fluctuated slightly around the actual value in the first 32 days, and the error increased in the middle 10 days. However, in the following 20 days, it gradually stabilized. Finally, combined with the evaluation index shown in Table 3, the VMD–AdaBoost–LSTM proposed in this paper has the best prediction effect, with a maximum error of 2.06 and a minimum error of −1.23. VMD–AdaBoost–LSTM predicts the least overall fluctuation compared with the other three models. The predictive performance of VMD–AdaBoost–LSTM is clearly superior to that of other models.
The indicators of Table 3 show the average RMSE, MAE, and MAPE of VMD–AdaBoost–LSTM and the other three models. It was observed that the average RMSE of VMD–AdaBoost–LSTM decreased by 36.2%, while the average MAPE decreased by 80.2%. Additionally, the average MAE showed a reduction of 40%. Moreover, the R-square value of VMD–AdaBoost–LSTM was found to be the highest among all models.
Therefore, according to Figure 9, Figure 10 and Figure 11, Table 3 offers the following conclusions:
  • The hybrid prediction model optimized by PSO–VMD demonstrates superior performance compared to the undecomposed model. This highlights the advantages of employing VMD decomposition in prediction.
  • The RMSE, MAE and MAPE of the hybrid model VMD–AdaBoost–LSTM are lower than those of the other three models. The prediction result of VMD–AdaBoost–LSTM is the best among all models. Hence, the utilization of the VMD method contributes to improved prediction accuracy.

3.2.2. Prediction Based on Hebei Cumulative Confirmed Data

This chapter will briefly introduce the experimental process of cumulative confirmed cases in Hebei Province and compare the prediction results of different models. The evaluation indicators of each model are presented in Table 5. Additionally, Figure 12 and Figure 13 show the prediction effects of each model, among which VMD–AdaBoost–LSTM, LSTM, and VMD–LSTM exhibit relatively close prediction effects, while CEEMDAN has a relatively large prediction deviation. The results in Figure 14 indicate that the VMD–AdaBoost–LSTM model has a brilliant prediction effect, with the smallest deviation between the prediction curve and the real value. The evaluation indicators in Table 5 demonstrate that the evaluation indicators of VMD–LSTM and VMD–AdaBoost–LSTM are relatively close, and better than those of the other two models, indicating that the VMD decomposition method can effectively improve the accuracy of predictions. Meanwhile, the RMSE and MAE of VMD–LSTM and VMD–AdaBoost–LSTM are relatively close, indicating that the AdaBoost method cannot improve the performance of basic learners without limit. When the performance of basic learners has reached a certain level or has been saturated, the impact of AdaBoost–LSTM on improvement will not be significant. To sum up, the VMD method can improve the prediction accuracy, and AdaBoost can also improve the prediction performance of base learning, which is consistent with the conclusion in Section 3.2.1.

4. Discussion

Although the epidemic situation has stabilized now, the research on the epidemic remains meaningful, as it provides insights for similar infectious diseases that may emerge in the future. The epidemic data are characterized by strong randomness and show a typical non-stationary sequence, which poses a challenge to prediction. To mitigate the difficulty of prediction, we used VMD to reduce the complexity of the target sequence. Furthermore, we address the problem of empirically setting K and the penalty factor in the VMD method by introducing the average sample entropy weighted by the correlation coefficient as the objective function. This enables the adaptive acquisition of K and a penalty factor with PSO. In Section 3.1, we compare the VMD results with those of the CEEMDAN method, and find that the decomposition results of VMD method are superior to those of CEEMDAN.
In addition, as the development of the epidemic is influenced by multiple factors, the introduction of policy factors can better reflect the actual situation. The choice of the research interval determines the impact of the small-scale, precise city closure policy on the development of the epidemic. The sudden lifting of the ban one month before the unblocking caused a sudden influx of people, which could have led to fluctuations in the collection of epidemic data, which would thus not be representative. This data interval was therefore chosen.
Both the use of the VMD method and the introduction of multiple factors aimed to improve the accuracy of epidemic prediction. Initially, a single LSTM was used for prediction, but it did not meet the accuracy requirements. After combining with the VMD method, some improvement was observed, but there is still room for further enhancement. As a result, the PSO–VMD–AdaBoost–LSTM method was proposed in this paper, which achieved the best performance in terms of RMSE, MAE and MAPE compared to other models in the selected research area. Furthermore, the R2 value was higher than that of other models, such as those presented in Table 3 and Table 5.
While the proposed method provides a new approach to predicting the epidemic, some limitations exist due to the authors’ knowledge and incomplete understanding of entropy theory. Further research is needed to address the following issues:
  • The selection of models used to predict IMF components after VMD decomposition is limited, indicating the need to explore other models so as to optimize prediction accuracy;
  • Due to the limited amount of epidemic data available, there is a possibility that the neural network’s prediction accuracy could be affected;
  • The growth of the epidemic is related to various factors, such as surrounding environment-related policies and population movement, but this paper only obtained factors related to containment policies. Therefore, the consideration of other factors is not comprehensive enough.

5. Conclusions

In this work, we apply VMD to the cumulative cases of COVID-19, alleviating the problem of mode mixing and high computational complexity encountered in CEEMDAN. To solve the defects of VMD itself, that is, the problem of the values of K and α, a method of optimizing VMD using PSO with inertia weight is proposed, that is, PSO–VMD. This method uses the correlation coefficient as the weight of the sample entropy to calculate the weighted average value, which is used as the fitness value to determine K and α. The adaptive values of K and α are realized. In addition, to obtain a higher prediction accuracy, the AdaBoost method is used to enhance the LSTM. The results show that the AdaBoost boosting method can improve the performance of the LSTM network to a certain extent. Particularly when the prediction effect of the basic model is relatively general, the AdaBoost method is significantly improved. We used the cumulative confirmed data from Hubei Province and Hebei Province in China to verify and predict the epidemic situation over a period of 2 months. Finally, the model we proposed achieved the best results. The interval selected this time falls in the middle and late stages of the epidemic’s development. Currently, the epidemic’s development is stable. In the forecast for Hubei Province, the fluctuation in the epidemic situation is very small, while the fluctuation projected in Hebei Province is slightly greater. Due to the adoption of stricter containment measures and precise targeted prevention and control measures in Hubei Province, the spread of the epidemic has been effectively curbed. In summary, this work has achieved good results in certain epidemic predictions, but there is still room for improvement. The VMD method plays a role in reducing the complexity of the data, and its application is not limited to epidemic prediction. It can also be extended to other fields, such as wind power and photovoltaics. Therefore, follow-up works should seek to obtain more different COVID-19 data, and train the model to strengthen its generalization ability. We should also try to use this model in different fields.

Author Contributions

Conceptualization, Zongyou Xia, Gonghao Duan and Ting Xu; methodology, Zongyou Xia and Gonghao Duan; software, Zongyou Xia; validation, Zongyou Xia; formal analysis, Gonghao Duan; data curation, Zongyou Xia; writing—original draft preparation, Zongyou Xia and Ting Xu; writing—review and editing, Zongyou Xia and Ting Xu. All authors have read and agreed to the published version of the manuscript.

Funding

This research is supported by the 111 project under Grant B17040 and Open Fund of Key Laboratory of Geological Hazards on Three Gorges Reservoir (China Three Gorges University), Ministry of Education under Grant 2022KDZ05. NO:CX2022363, Supported by Graduate Innovative Fund of Wuhan Institute of Technology.

Data Availability Statement

Publicly available datasets were analyzed in this study. This data can be found here: [https://github.com/OxCGRT/covid-policy-tracker], accessed on 13 April 2020.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Gnanvi, J.E.; Salako, K.V.; Kotanmi, G.B.; Kakaï, R.G. On the reliability of predictions on COVID-19 dynamics: A systematic and critical review of modelling techniques. Infect. Dis. Model. 2021, 6, 258–272. [Google Scholar] [CrossRef] [PubMed]
  2. Zoabi, Y.; Deri-Rozov, S.; Shomron, N. Machine learning-based prediction of COVID-19 diagnosis based on symptoms. NPJ Digit. Med. 2021, 4, 3. [Google Scholar] [CrossRef] [PubMed]
  3. Alenezi, M.N.; Al-Anzi, F.S.; Alabdulrazzaq, H. Building a sensible SIR estimation model for COVID-19 outspread in Kuwait. Alex. Eng. J. 2021, 60, 3161–3175. [Google Scholar] [CrossRef]
  4. Moein, S.; Nickaeen, N.; Roointan, A.; Borhani, N.; Heidary, Z.; Javanmard, S.H.; Ghaisari, J.; Gheisari, Y. Inefficiency of SIR models in forecasting COVID-19 epidemic: A case study of Isfahan. Sci. Rep. 2021, 11, 4725. [Google Scholar] [CrossRef]
  5. Cooper, I.; Mondal, A.; Antonopoulos, C.G. A SIR model assumption for the spread of COVID-19 in different communities. Chaos Solitons Fractals 2020, 139, 110057. [Google Scholar] [CrossRef]
  6. He, S.; Peng, Y.; Sun, K. SEIR modeling of the COVID-19 and its dynamics. Nonlinear Dyn. 2020, 101, 1667–1680. [Google Scholar] [CrossRef]
  7. Annas, S.; Pratama, M.I.; Rifandi, M.; Sanusi, W.; Side, S. Stability analysis and numerical simulation of SEIR model for pandemic COVID-19 spread in Indonesia. Chaos Solitons Fractals 2020, 139, 110072. [Google Scholar] [CrossRef]
  8. Rǎdulescu, A.; Williams, C.; Cavanagh, K. Management strategies in a SEIR-type model of COVID 19 community spread. Sci. Rep. 2020, 10, 21256. [Google Scholar] [CrossRef]
  9. Ren, X.; Weisel, C.P.; Georgopoulos, P.G. Modeling effects of spatial heterogeneities and layered exposure interventions on the spread of COVID-19 across New Jersey. Int. J. Environ. Res. Public Health 2021, 18, 11950. [Google Scholar] [CrossRef]
  10. Rustam, F.; Reshi, A.A.; Mehmood, A.; Ullah, S.; On, B.W.; Aslam, W.; Choi, G.S. COVID-19 future forecasting using supervised machine learning models. IEEE Access 2020, 8, 101489–101499. [Google Scholar] [CrossRef]
  11. Ballı, S. Data analysis of COVID-19 pandemic and short-term cumulative case forecasting using machine learning time series methods. Chaos Solitons Fractals 2021, 142, 110512. [Google Scholar] [CrossRef] [PubMed]
  12. Chimmula, V.K.R.; Zhang, L. Time series forecasting of COVID-19 transmission in Canada using LSTM networks. Chaos Solitons Fractals 2020, 135, 109864. [Google Scholar] [CrossRef] [PubMed]
  13. Chandra, R.; Jain, A.; Chauhan, D.S. Deep learning via LSTM models for COVID-19 infection forecasting in India. PLoS ONE 2022, 17, e0262708. [Google Scholar] [CrossRef] [PubMed]
  14. Shahin, A.I.; Almotairi, S. A deep learning BiLSTM encoding-decoding model for COVID-19 pandemic spread forecasting. Fractal Fract. 2021, 5, 175. [Google Scholar] [CrossRef]
  15. Alabdulrazzaq, H.; Alenezi, M.N.; Rawajfih, Y.; Alghannam, B.A.; Al-Hassan, A.A.; Al-Anzi, F.S. On the accuracy of ARIMA based prediction of COVID-19 spread. Results Phys. 2021, 27, 104509. [Google Scholar] [CrossRef]
  16. Alzahrani, S.I.; Aljamaan, I.A.; Al-Fakih, E.A. Forecasting the spread of the COVID-19 pandemic in Saudi Arabia using ARIMA prediction model under current public health interventions. J. Infect. Public Health 2020, 13, 914–919. [Google Scholar] [CrossRef]
  17. Delli Compagni, R.; Cheng, Z.; Russo, S.; Van Boeckel, T.P. A hybrid Neural Network-SEIR model for forecasting intensive care occupancy in Switzerland during COVID-19 epidemics. PLoS ONE 2022, 17, e0263789. [Google Scholar] [CrossRef]
  18. Singh, S.; Parmar, K.S.; Kumar, J.; Makkhan, S.J.S. Development of new hybrid model of discrete wavelet decomposition and autoregressive integrated moving average (ARIMA) models in application to one month forecast the casualties cases of COVID-19. Chaos Solitons Fractals 2020, 135, 109866. [Google Scholar] [CrossRef]
  19. Liu, S.; Wan, Y.; Yang, W.; Tan, A.; Jian, J.; Lei, X. A Hybrid Model for Coronavirus Disease 2019 Forecasting Based on Ensemble Empirical Mode Decomposition and Deep Learning. Int. J. Environ. Res. Public Health 2022, 20, 617. [Google Scholar] [CrossRef]
  20. Yuan, F.; Che, J. An ensemble multi-step M-RMLSSVR model based on VMD and two-group strategy for day-ahead short-term load forecasting. Knowl.-Based Syst. 2022, 252, 109440. [Google Scholar] [CrossRef]
  21. Zhang, Y.; Zhao, Y.; Kong, C.; Chen, B. A new prediction method based on VMD-PRBF-ARMA-E model considering wind speed characteristic. Energy Convers. Manag. 2020, 203, 112254. [Google Scholar] [CrossRef]
  22. Jin, Z.; He, D.; Wei, Z. Intelligent fault diagnosis of train axle box bearing based on parameter optimization VMD and improved DBN. Eng. Appl. Artif. Intell. 2022, 110, 104713. [Google Scholar] [CrossRef]
  23. Chinazzi, M.; Davis, J.T.; Ajelli, M.; Gioannini, C.; Litvinova, M.; Merler, S.; Piontti, Y.; Pastore, A.; Mu, K.; Rossi, L.; et al. The effect of travel restrictions on the spread of the 2019 novel coronavirus (COVID-19) outbreak. Science 2020, 368, 395–400. [Google Scholar] [CrossRef] [PubMed]
  24. Pei, S.; Kandula, S.; Shaman, J. Differential effects of intervention timing on COVID-19 spread in the United States. Sci. Adv. 2020, 6, eabd6370. [Google Scholar] [CrossRef]
  25. Li, G.; Chen, K.; Yang, H. A new hybrid prediction model of cumulative COVID-19 confirmed data. Process Saf. Environ. Prot. 2022, 157, 1–19. [Google Scholar] [CrossRef]
  26. Dragomiretskiy, K.; Zosso, D. Variational mode decomposition. IEEE Trans. Signal Process. 2013, 62, 531–544. [Google Scholar] [CrossRef]
  27. Nikparvar, B.; Rahman, M.M.; Hatami, F.; Thill, J.C. Spatio-temporal prediction of the COVID-19 pandemic in US counties: Modeling with a deep LSTM neural network. Sci. Rep. 2021, 11, 21715. [Google Scholar] [CrossRef]
  28. Zhang, Y.; Pan, G. A hybrid prediction model for forecasting wind energy resources. Environ. Sci. Pollut. Res. 2020, 27, 19428–19446. [Google Scholar] [CrossRef]
  29. Zhao, Y.; Fan, Y.; Li, H.; Gao, X. Rolling bearing composite fault diagnosis method based on EEMD fusion feature. J. Mech. Sci. Technol. 2022, 36, 4563–4570. [Google Scholar] [CrossRef]
  30. Busari, G.A.; Lim, D.H. Crude oil price prediction: A comparison between AdaBoost-LSTM and AdaBoost-GRU for improving forecasting performance. Comput. Chem. Eng. 2021, 155, 107513. [Google Scholar] [CrossRef]
  31. Huang, N.E.; Shen, Z.; Long, S.R.; Wu, M.C.; Shih, H.H.; Zheng, Q.; Yen, N.-C.; Tung, C.C.; Liu, H.H. The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis. Proceedings of the Royal Society of London. Ser. A Math. Phys. Eng. Sci. 1998, 454, 903–995. [Google Scholar] [CrossRef]
Figure 1. LSTM memory cell.
Figure 1. LSTM memory cell.
Ijgi 12 00215 g001
Figure 2. The process of PSO–VMD.
Figure 2. The process of PSO–VMD.
Ijgi 12 00215 g002
Figure 3. AdaBoost framework.
Figure 3. AdaBoost framework.
Ijgi 12 00215 g003
Figure 4. The flow chart of PSO–VMD–AdaBoost–LSTM.
Figure 4. The flow chart of PSO–VMD–AdaBoost–LSTM.
Ijgi 12 00215 g004
Figure 5. Cumulative confirmed cases.
Figure 5. Cumulative confirmed cases.
Ijgi 12 00215 g005
Figure 6. Decrement in inertia weight in the iterative process of PSO.
Figure 6. Decrement in inertia weight in the iterative process of PSO.
Ijgi 12 00215 g006
Figure 7. Results of VMD decomposition.
Figure 7. Results of VMD decomposition.
Ijgi 12 00215 g007
Figure 8. Results of CEEMDAN decomposition.
Figure 8. Results of CEEMDAN decomposition.
Ijgi 12 00215 g008
Figure 9. (a) The prediction result of LSTM in Hubei. (b) The prediction result of VMD–LSTM in Hubei. (c) The prediction result of CEEMDAN–LSTM in Hubei. (d) The prediction result of VMD–AdaBoost–LSTM in Hubei.
Figure 9. (a) The prediction result of LSTM in Hubei. (b) The prediction result of VMD–LSTM in Hubei. (c) The prediction result of CEEMDAN–LSTM in Hubei. (d) The prediction result of VMD–AdaBoost–LSTM in Hubei.
Ijgi 12 00215 g009
Figure 10. Prediction results of each model.
Figure 10. Prediction results of each model.
Ijgi 12 00215 g010
Figure 11. Distribution of Forecast Errors in Hubei.
Figure 11. Distribution of Forecast Errors in Hubei.
Ijgi 12 00215 g011
Figure 12. (a) The prediction result of LSTM in Hebei. (b) The prediction result of VMD–LSTM in Hebei. (c) The prediction result of CEEMDAN–LSTM in Hebei. (d) The prediction result of VMD–AdaBoost–LSTM in Hebei.
Figure 12. (a) The prediction result of LSTM in Hebei. (b) The prediction result of VMD–LSTM in Hebei. (c) The prediction result of CEEMDAN–LSTM in Hebei. (d) The prediction result of VMD–AdaBoost–LSTM in Hebei.
Ijgi 12 00215 g012
Figure 13. Comparison of prediction results of each model.
Figure 13. Comparison of prediction results of each model.
Ijgi 12 00215 g013
Figure 14. Distribution of Forecast Errors in Hebei.
Figure 14. Distribution of Forecast Errors in Hebei.
Ijgi 12 00215 g014
Table 1. Policy variable parameter description.
Table 1. Policy variable parameter description.
VariableExplain
C1_School closingRecord school suspensions
C2_Workplace closingRecord the closure of public places
C3_Cancel public eventsRecord the development of public events
C4_Restrictions on gatheringsRecord party restrictions
C5_Close public transportRecord whether public transport is closed
C6_Stay at home requirementsRecord whether home isolation is imposed
C7_Restrictions on internal movementRecord restrictions on internal mobility between cities/regions
Table 2. Parameters of particle swarm algorithm.
Table 2. Parameters of particle swarm algorithm.
VariableValue
population30
Tmax50
acceleration constant2
boundaryK ∈ [2, 12], α ∈ [10, 5000]
Table 3. Evaluation index of each model.
Table 3. Evaluation index of each model.
ModelR2RMSEMAEMAPE
LSTM0.890.87400.430690.00063
CEEMDAN–LSTM0.791.24741.126550.00165
VMD–LSTM0.930.69110.482590.00071
VMD–AdaBoost–LSTM0.950.59790.401900.00059
Table 4. Model parameter settings.
Table 4. Model parameter settings.
MethodParametersValues
LSTMLayer2
Neurons64
Learning rate0.01
Batchsize32
Epoch50
VMD–LSTMLayer3
Neurons128
Learning rate0.001
Batchsize32
Epoch60
CEEMDAN–LSTMLayer2
Neurons256
Learning rate0.002
Batchsize64
Epoch50
VMD–AdaBoost–LSTMLayer3
Neurons128
Learning rate0.001
Batchsize32
Epoch100
Number of base learners5
Table 5. Evaluation index of each model.
Table 5. Evaluation index of each model.
ModelR2RMSEMAEMAPE
LSTM0.835.74474.09630.2844
CEEMDAN–LSTM0.618.855176.217070.43007
VMD–LSTM0.845.464024.081210.28175
VMD–AdaBoost–LSTM0.914.24363.526030.24323
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Xia, Z.; Duan, G.; Xu, T. Hybrid Prediction Model Based on Decomposed and Synthesized COVID-19 Cumulative Confirmed Data. ISPRS Int. J. Geo-Inf. 2023, 12, 215. https://doi.org/10.3390/ijgi12060215

AMA Style

Xia Z, Duan G, Xu T. Hybrid Prediction Model Based on Decomposed and Synthesized COVID-19 Cumulative Confirmed Data. ISPRS International Journal of Geo-Information. 2023; 12(6):215. https://doi.org/10.3390/ijgi12060215

Chicago/Turabian Style

Xia, Zongyou, Gonghao Duan, and Ting Xu. 2023. "Hybrid Prediction Model Based on Decomposed and Synthesized COVID-19 Cumulative Confirmed Data" ISPRS International Journal of Geo-Information 12, no. 6: 215. https://doi.org/10.3390/ijgi12060215

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop