Next Article in Journal
Dynamic Skyline Computation with LSD Trees
Previous Article in Journal
Theory-Guided Analytics Process: Using Theories to Underpin an Analytics Process for New Banking Product Development Using Segmentation-Based Marketing Analytics Leveraging on Marketing Intelligence
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Technical Note

Untangling Energy Consumption Dynamics with Renewable Energy Using Recurrent Neural Network

1
Civil and Environmental Engineering, Idaho State University, Pocatello, ID 83209, USA
2
Civil and Environmental Engineering, University of Connecticut, Storrs, CT 06269, USA
*
Author to whom correspondence should be addressed.
Analytics 2023, 2(1), 132-145; https://doi.org/10.3390/analytics2010008
Submission received: 22 August 2022 / Revised: 4 January 2023 / Accepted: 28 January 2023 / Published: 1 February 2023

Abstract

:
The environmental issues we are currently facing require long-term prospective efforts for sustainable growth. Renewable energy sources seem to be one of the most practical and efficient alternatives in this regard. Understanding a nation’s pattern of energy use and renewable energy production is crucial for developing strategic plans. No previous study has been performed to explore the dynamics of power consumption with the change in renewable energy production on a country-wide scale. In contrast, a number of deep learning algorithms have demonstrated acceptable performance while handling sequential data in the era of data-driven predictions. In this study, we developed a scheme to investigate and predict total power consumption and renewable energy production time series for eleven years of data using a recurrent neural network (RNN). The dynamics of the interaction between the total annual power consumption and renewable energy production were investigated through extensive exploratory data analysis (EDA) and a feature engineering framework. The performance of the model was found to be satisfactory through the comparison of the predicted data with the observed data, the visualization of the distribution of the errors and root mean squared error (RMSE), and the R2 values of 0.084 and 0.82. Higher performance was achieved by increasing the number of epochs and hyperparameter tuning. The proposed framework has the potential to be used and transferred to investigate the trend of renewable energy production and power consumption and predict future scenarios for different communities. The incorporation of a cloud-based platform into the proposed pipeline to perform predictive studies from data acquisition to outcome generation may lead to real-time forecasting.

1. Introduction

In recent decades, interest in renewable energy has grown significantly [1,2,3,4]. These non-polluting, resource-unrestricted energies would provide the perfect electrical source for any activity, whether household or industrial, if not for their unpredictability [5,6,7]. It is challenging to predict how much power will be gained from renewable sources, because their throughput varies greatly depending on the circumstances and qualities of the location in which they are found. In many nations today, it is essential to promote the use of renewable energy sources, because they provide a wealth of benefits [8,9,10]. As a result, while the main energy resource imports are greatly decreased, the security of the energy supply and the preservation of traditional resources are both guaranteed. Additionally, the use of renewable energy spurs economic growth on a local, regional, and international scale and generates new job possibilities [11,12,13,14]. Utilizing renewable energy has the advantage of lessening environmental degradation [15,16,17,18].
Solar energy has emerged as one of the most important sources of energy in recent years [19,20]. In some countries, solar energy uses a significant percentage of the sun’s energy and has more predictable behavior than wind-based energy. As a result, it ranks among the most significant renewable energy sources for a variety of nations in south Europe, including Spain, as well as other places along the same latitude, such as Saudi Arabia or India [21,22,23]. Solar energy includes thermal solar energy, which transforms solar radiation into thermal energy used to heat buildings, desalination plants, homes, and water treatment facilities, among other things, and photovoltaic solar energy, which transforms solar radiation into electrical energy that can be transported for purposes other than heating [24,25]. Wind is a plentiful natural resource and sustainable energy source that is known to be both clean and pollution-free. In general, the characteristics of wind are its speed, direction, and time of occurrence. The force or speed of the wind determines how much energy can be extracted from its natural flow [26,27]. Generally speaking, the wind speed or force has a nonlinear and variable nature. Despite its natural origins, wind has the capacity to produce the necessary amount of energy for a nation’s ongoing needs. It is necessary to forecast wind speeds in order to increase the amount of energy produced [28,29,30]. Wind speed forecasting strikes a balance between the energy generated and the demand. An efficient technique for reducing operating costs and enhancing grid system functionality is a wind speed prediction model that is very accurate and dependable [31,32,33,34,35].
The use of deep learning (DL) has made it possible to anticipate various physical systems with greater accuracy. Several industries use DL [36,37,38,39,40]. In the modern world, virtually every power grid incorporates renewable-energy-based sources. For successful participation in the electricity market, accurate predictions of renewable energy sources are crucial. Considering how much these sources depend on consumption, it can be difficult to forecast the planet’s production. In recent years, there has been a rise in ML research and applications for forecasting plant output from renewable energy sources. Different models, including feedforward backpropagation (FFBP), feedforward neural networks (FFNNs), and multilayer feedforward with backpropagation neural networks (MFFNNBP), with various learning algorithms, including Bayesian regularization (BR) and the Levenberg–Marquardt (LM) algorithm, can be found in references under the category of variants of neural networks [41,42,43]. Examples of these techniques include support vector regression (SVR), random trees (RTs), M5P decision trees (M5PDTs), Gaussian process regression (GPR), and physical photovoltaic forecasting models (P-PVFMs) [44,45,46,47]. Although several approaches for the supervised training of RNNs have been investigated over the past decade, and there are many types of training algorithms, none stand out as the ideal model. Backpropagation revisited and through time are common training methods for RNNs, as they combine the following two qualities: (1) they have a distributed hidden state that enables them to store a significant amount of historical data effectively; and (2) they implement nonlinear dynamics, which enables them to develop sophisticated ways to update their hidden state. These are the main reasons that RNN can compute a large dataset with enough neurons and time.
The use of RNN models to investigate the dynamics of energy consumption in relation to renewable energy is a relatively recent development [48,49,50,51,52]. This study aimed to evaluate how well RNN models can predict energy consumption using renewable energy sources. In order to enable researchers, engineers, and decision makers to understand the temporal dynamics of power consumption and renewable energy production so that they can make informed engineering/managerial decisions, the goal of this study was to build an effective and practical RNN framework for forecasting future scenarios of annual power production and consumption [53,54,55,56,57,58,59,60,61,62,63,64]. The model was tested against observed data to assess whether it performed well using daily energy consumption and renewable energy production data for a country. With this model, engineers and managers would be able to evaluate the short- and long-term behavior and trends of energy, allowing them to eventually develop preventative measures based on earlier observational data for a variety of issues in a region. The RNN-based method used in this study only requires observed data; therefore, a substantial amount of computational effort is needed. To make the most of the RNN results in this study, comprehensive exploratory data analysis, feature engineering, and hyperparameter optimization were conducted. The remainder of this paper is structured as follows: Section 2 provides a full explanation of the fundamentals of RNN and describes the data engineering and experimental methodology. The outcomes of the experiment are thoroughly discussed and analyzed in Section 3. The conclusion portion and closing thoughts regarding this article are presented in Section 4.

2. Data and Methods

2.1. Data Source and Workflow

The time series of the total energy consumption and wind and solar power production was used in this study to forecast the future trends of the variables in Germany. The time-series dataset was retrieved from open power system data (OPSD) for Germany, which has been rapidly expanding its renewable energy production in recent years [65,66]. The temporal resolution of the variables used for the RNN-based prediction was daily. The dataset’s timeframe included data over a decade, from 2006 to 2017. Electricity usage and generation from wind and solar sources were reported in gigawatt hours (GWh). In Table 1, a full description of the variables is presented. In Figure 1, the full workflow of the predictive analysis of renewable energy production and total energy consumption is shown.
The shifts and fluctuations in electricity usage and generation over time in Germany were scrutinized in this paper. Time-series tools were used to examine both seasonal variations and long-term trends in the production of wind and solar power, as well as their consumption. Furthermore, these tools were used to compare the wind and solar power production with electricity usage. Using an RNN model, we anticipated each day’s consumption based on historical and observed data. Figure 2 shows the temporal variation of the variables.

2.2. Multivariate Exploratory Data Analysis

As indicated by activity 2 in Figure 1, a multivariate exploratory data analysis (EDA) was performed to understand the internal distribution of the attributes of the variables. The temporal distribution of all the variables was explored using several visual and numerical representations. The EDA included the important process of conducting an initial exploration of the variables to investigate the hidden patterns in the dataset. The EDA was grouped into multiple activities in this study. The descriptive statistics of the variables are presented alongside the probability distribution via histograms to determine the normality (skewness) of the variables. Descriptive statistics provided an effective way to demonstrate the basic distribution of the values of the variables according to the number of data points, mean, standard deviation, percentiles, interquartile range, and range (max/min). The full multivariate descriptive statistics of the all the variables are shown in Table 2. To show the normality, histograms with a line of probability distribution were used as a visual representation, and the Pearson coefficient of skewness (PCS) was used as an indicator of skewness to analyze the distribution.
A visual representation of the distribution and the normality of the variables is shown in Figure 3. The overall non-linearity of the wind production was high with left skewness. The values of the Pearson correlation of skewness (PCS) were calculated for the numeric measurement of the skewness. The PCS values for wind and solar power production and total energy consumption were 5.97, 0.49, and 0.65. Wind power production showed the highest non-normality among the variables. Normal distribution is a very crucial part of RNN model performance, as it is directly linked to error minimization through backpropagation. Normal distribution is the most crucial factor in the field of data-driven predictive analysis, e.g., deep neural network regression. As the distribution of the values of wind power production was highly skewed to the left, showing significant non-normality, the neural network regression algorithms without appropriate data transformation did not contribute to satisfactory outcomes with good optimization. As the distribution of the renewable energy production series was found to be highly skewed, data transformation was performed to decrease the non-normality of the series in the feature engineering stage. The linear linkage was found to be low among the variables. The values of the linear correlation coefficients are shown in the bivariate correlation plot in Figure 4. The direction of the linear relationship was found to be both positive and negative.

2.3. Feature Engineering

As indicated by activity 3 in Figure 1, feature engineering (FE) was performed after a successful EDA. FE is an important step before the training/testing phase of an RNN algorithm. Without successful FE, any data-driven method may not yield a satisfactory performance with minimum errors. Adequate optimization through iterative gradient descent cannot be reached without the successful scrutiny of the dataset. Therefore, comprehensive feature engineering was performed to transform the dataset so that it was more suitable for the learning algorithm of the RNN. FE was performed to prepare the dataset for the predictive analysis. The FE involved imputation, data transformation, data standardization, and splitting the dataset into training and testing sets. Imputation was performed to fill the null values so that the entire dataset became consistent. In this research, null values or null observations were found in every variable. These cells in the dataset were imputed with the median of the entire series. Three methods of data transformation were considered, i.e., logarithmic, power, and cubic transformation, to bring the distribution of the features closer to normal distribution. The Pearson coefficient was used as an indicator of normality.
Through the data standardization process, the values of a variable were rescaled so that the variable had a mean of 0 and variance of 1 (or Z-score normalization), which was identical to the bell-shaped normal distribution curve. As the variable considered in this study was the continuous independent variable, the standardization of the variable was crucial for training/testing the neural network algorithm. Standardization was an important step for the optimization problem. The RNN recurrent neural network model used the gradient descent technique, with the feature value (renewable energy production) affecting the step size of the technique. Smooth progress towards minima in gradient descent required the updating of the steps at the same rate for all the feature values. A standardized variable is a prerequisite of reaching the minima in the gradient descent process.
z = x μ σ
All the values in the renewable energy production series were standardized to prepare the training dataset for the RNN model.
Equation (1) shows the standardization formula for the renewable energy production series. The difference between the renewable energy production value and the minimum of the entire renewable energy production series was divided by the range of the series, providing the standardized data, which were further used in the training/testing process of the RNN, indicated as activity 4 in Figure 1. The entire standardized renewable energy production series was split into two portions, i.e., a training set that was used to train the model and a testing set that was used to test/evaluate the model. Seventy percent of the dataset was used for training, and thirty percent was used for testing. In a nutshell, EDA and feature engineering were pivotal steps for the satisfactory performance of the predictive model.

2.4. Recurrent Neural Network (RNN)

Recurrent neural networks (RNNs) are a type of neural system that can reveal dynamic temporal behavior by enabling the use of hidden states and previous outputs as inputs. RNNs, which are derived from feedforward neural networks, process input sequences of various lengths using their internal state (memory) and connect the outputs of all neurons to their inputs. The main structural concept of an NN is the replication of connection weight configurations to zero to imitate the lack of connections between particular neurons.
For each timestep t , the activation a t and the output y t are expressed as follows:
a t = g 1 W a a a t 1 + W a x x t + b a
y t = g 2 W y a a t + b y
where W a x , W a a , W y a , b a , and b y are coefficients that are shared temporally, and g 1 and g 2 are activation functions (Figure 4).
In the case of a recurrent neural network, the loss function Ը of all timesteps is defined based on the loss at every timestep, as follows:
Ը y ^ , y = t = 1 T y Ը y ^ t , y t
Backpropagation was carried out at each point in time. At timestep T, the derivative of the loss Ը with respect to the weight matric W is expressed as follows:
Ը T W = t = 1 T Ը T W t

2.5. Model Evaluation

As indicated by activity 5 in Figure 1, the model performance was evaluated. The coefficient of determination ( R 2 ) is a popular error metric for assessing the accuracy of a model by depicting the model fitness to datapoint values. The better the model fits the data, the higher the R 2 . The square root of the coefficient of determination is represented as the correlation coefficient (R), which was the second error function implemented in this study.
R 2 = t = 1 N Q t c o m Q ¯ c o m Q t o b s Q ¯ o b s 2 t = 1 N Q t c o m Q ¯ c o m 2 t = 1 N Q t o b s Q ¯ o b s 2

3. Results and Discussion

After the successful training of the RNN model, it was deployed to predict the target variable (activity 6 in Figure 1). The output from the RNN algorithm was compared to the observed renewable energy production data from the database through visualization, as shown in Figure 5. Both the observed and predicted renewable energy production time series were plotted against the number of datapoints. The overall distribution of the predicted renewable energy production values was approximately identical to that of the observed data, demonstrating the satisfactory performance of the RNN algorithm. After the RNN model was trained with the training portion of the dataset, the entire observed dataset was fed in to predict the outcome. The entire dataset was divided into training and testing sets in the proportions 70% and 30%. The training dataset was used to train the model, and the testing dataset was used to evaluate the model performance. The observed data are shown in Figure 5a in green. In Figure 5b, the deep cyan portion of the plot indicates the training portion of the dataset, whereas the deep blue portion shows the testing portion. The RMSE values of the training and testing portion were 0.097 and 0.045, respectively. The lower RMSE values showed the satisfactory performance of the RNN algorithm.
The rolling mean of the predicted consumption series showed the temporal dynamics of consumption in relation to the original observed consumption throughout the study period. It demonstrated the impact of downscaling the data with comparatively coarser datapoints for the target variable (consumption). The downscaling of a temporal series is usually conducted to reduce the size of the dataset to obtain faster computation ability as well as to reduce the burden of a large amount of observed data with a finer temporal resolution. However, observing and storing a large amount of data is always expensive and has significant limitations. Therefore, the rolling mean could be a good tool for determining whether there is any significant difference between observed and transformed data, with the potential to assist decision makers in evaluating future scenarios.

Model Evaluation Metrics and Improvement

The performance of the RNN neural network was evaluated using three error metrics, i.e., the root mean square error (RMSE), the coefficient of determination (R2), and the Nash–Sutcliffe model efficiency coefficient (E) [64]. Further, the performance of the model was also evaluated and improved through increasing the number of iterations, i.e., epochs, in the neural network. The value of R2 is plotted against an increasing number of epochs in Figure 6. The number of epochs was increased up to 100 to improve the performance. The RMSE value was found to decrease from 0.01 to 0.0025, which indicated satisfactory performance by the RNN algorithm. The model performance increased significantly from the very beginning of the iterations for both the training and testing scenarios. The trend of change in the decrease in the RMSE values reached a near-steady state after 20 epochs. A local decrease in the performance, i.e., increase in the RMSE value, could be seen after 20 epochs (Figure 6).
Observed and predicted energy values from the RNN model and the distribution of the RMSE values are illustrated in Figure 7 using a scatter plot. The scatterplot shows that the points followed an approximately 45° trend line originating at zero. Some points were located outside of the main cluster of points, which showed an error in the prediction process. The R2 value of the best-fitted straight line was +0.862, which indicated good performance.
Time-series prediction for renewable energy production and consumption is a pivotal task in the field of power management. The application of data-driven prediction models is highly efficacious in predicting energy variables without taking complicated equations and assumptions into consideration. In this study, annual power consumption and renewable energy production were predicted using the most powerful neural network for predicting sequential data, i.e., a recurrent neural network (RNN).
The RNN algorithm was capable of recalling both the short- and long-term patterns of the time series for forecasting. The range of the energy time series considered in this research was quite large, containing multiple seasonal dynamics. Traditional physics-based numerical modeling tools require assumptions, other correlated variables, and the expensive calibration of the parameters. Compared to the other neural network regression models, RNNs have been proven to show good performance, especially in time-series prediction. As energy consumption and production provided sequential data with considerable temporal dynamics, an RNN was used to quantify future values based on past data. As the shape of the energy dataset was comparatively large, representing eleven years of daily data, the RNN algorithms showed a highly satisfactory performance.

4. Conclusions

This study contributes to the development of a reproducible template for analyzing large amounts of exploratory data in order to understand the distinctive temporal dynamics of energy consumption and renewable energy production. Various modern data exploration technologies were used to uncover a hidden pattern in the distribution of energy values based on more than eleven years of data, which was a necessary condition for the successful training of the RNN algorithm. Following a successful training phase, an explicit iterative performance record was used to tweak and optimize the RNN. This performance record could then be used to anticipate the energy values in a similar geographic area. The effectiveness of the RNN algorithm in predicting energy showed how well-suited the algorithm is to energy time series. Many error metrics indicated positive performance with small errors. In this study, an RNN algorithm was used to forecast energy consumption based on the dynamics of renewable energy production. The proposed model could be used as a tool for planning and designing energy distribution systems in communities to improve operational and maintenance decisions. The proposed model framework was found to be highly efficient in predicting time-series data for energy consumption, presenting minimum errors when compared with the observed data.
The RNN algorithm was trained using only the observed data without any intermediate transformation of the variables using physics-based equations. Therefore, the proposed framework could be a powerful tool for predicting energy consumption in a real-time manner without the burden of further computation with physic-based models. This is a powerful analytical advancement in practice.
Along with the benefits, there are a few disadvantages of adopting this RNN, including the following: (1) a large amount of time is necessary to train the model, with more time required for RNN analysis and for running the model over a big dataset compared to other conceptual models. The computing effort/time needed for the RNN algorithm in this investigation was discovered to be extremely high. (2) The slow process also made it necessary to use more of the system’s memory and storage capacity, which could make it difficult to train on a large dataset, as was the case in our study. (3) A challenging aspect of RNNs for time-series data processing is overfitting, which can lead to incorrect extremely low error measurements. (4) Despite the fact that the essential factor for implementing RNNs is the capacity to compare time lags throughout the whole time-series dataset, we were unable to obtain sufficient performance for this dataset for periods longer than three days. Any time lapses that occurred during a three-day period were flawless and produced low error measurements that were satisfactory. To achieve the best results, future research projects should be carried out incorporating high-performance computing and cloud-based processes. To test the model’s transferability, RNN models with various configurations should be used in various geographic and climatic regions.

Author Contributions

Conceptualization, M.M.S.Y.; methodology, S.S. and M.M.S.Y.; investigation, R.K. and M.M.S.Y.; formal analysis, S.S. and M.M.S.Y.; resources, M.M.S.Y.; data preparation, M.M.S.Y. and S.S.; writing—original draft preparation, M.M.S.Y., S.S. and R.K.; writing—review and editing, M.M.S.Y., S.S. and R.K.; visualization, S.S and M.M.S.Y.; project administration, M.M.S.Y. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Acknowledgments

This paper and the research behind it would not have been possible without the exceptional support of Md Abdullah Al Mehedi, a research assistant and PhD candidate in the Department of Civil and Environmental Engineering at Villanova University. His enthusiasm, knowledge and exacting attention to detail have been an inspiration and kept the work on track from my first encounter to the final draft of this paper. He contributed to the model formulation, code, dataset, strategic planning on model simulation, structuring and interpreting of the results, and identification of future directions and limitations. We are grateful to his valuable ideation and contribution.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. De Atholia, T.; Flannigan, G.; Lai, S. Renewable Energy Investment in Australia. Bull. Reserve Bank Aust. 2020, 36–46. Available online: https://www.rba.gov.au/publications/bulletin/2020/mar/renewable-energy-investment-in-australia.html (accessed on 21 September 2021).
  2. Adebayo, T.S.; Awosusi, A.A.; Rjoub, H.; Agyekum, E.B.; Kirikkaleli, D. The Influence of Renewable Energy Usage on Consumption-Based Carbon Emissions in MINT Economies. Heliyon 2022, 8, e08941. [Google Scholar] [CrossRef]
  3. Bhattacharya, M.; Paramati, S.R.; Ozturk, I.; Bhattacharya, S. The Effect of Renewable Energy Consumption on Economic Growth: Evidence from Top 38 Countries. Appl. Energy 2016, 162, 733–741. [Google Scholar] [CrossRef]
  4. Samour, A.; Baskaya, M.M.; Tursoy, T. The Impact of Financial Development and FDI on Renewable Energy in the UAE: A Path towards Sustainable Development. Sustainability 2022, 14, 1208. [Google Scholar] [CrossRef]
  5. Baloch, Z.A.; Tan, Q.; Kamran, H.W.; Nawaz, M.A.; Albashar, G.; Hameed, J. A Multi-Perspective Assessment Approach of Renewable Energy Production: Policy Perspective Analysis. Environ. Dev. Sustain. 2022, 24, 2164–2192. [Google Scholar] [CrossRef]
  6. Pérez-García, J.M.; Morant, J.; Arrondo, E.; Sebastián-González, E.; Lambertucci, S.A.; Santangeli, A.; Margalida, A.; Sánchez-Zapata, J.A.; Blanco, G.; Donázar, J.A.; et al. Priority Areas for Conservation Alone Are Not a Good Proxy for Predicting the Impact of Renewable Energy Expansion. Proc. Natl. Acad. Sci. USA 2022, 119, e2204505119. [Google Scholar] [CrossRef]
  7. Tutak, M.; Brodny, J. Renewable Energy Consumption in Economic Sectors in the EU-27. The Impact on Economics, Environment and Conventional Energy Sources. A 20-Year Perspective. J. Clean. Prod. 2022, 345, 131076. [Google Scholar] [CrossRef]
  8. Cook, D.; Karlsdóttir, I.; Minelgaite, I. Enjoying the Heat? Co-Creation of Stakeholder Benefits and Sustainable Energy Development within Projects in the Geothermal Sector. Energies 2022, 15, 1029. [Google Scholar] [CrossRef]
  9. Schulte, E.; Scheller, F.; Sloot, D.; Bruckner, T. A Meta-Analysis of Residential PV Adoption: The Important Role of Perceived Benefits, Intentions and Antecedents in Solar Energy Acceptance. Energy Res. Soc. Sci. 2022, 84, 102339. [Google Scholar] [CrossRef]
  10. Elahi, E.; Khalid, Z.; Zhang, Z. Understanding Farmers’ Intention and Willingness to Install Renewable Energy Technology: A Solution to Reduce the Environmental Emissions of Agriculture. Appl. Energy 2022, 309, 118459. [Google Scholar] [CrossRef]
  11. Ahmad, U.S.; Usman, M.; Hussain, S.; Jahanger, A.; Abrar, M. Determinants of Renewable Energy Sources in Pakistan: An Overview. Environ. Sci. Pollut. Res. 2022, 29, 29183–29201. [Google Scholar] [CrossRef]
  12. Sohag, K.; Chukavina, K.; Samargandi, N. Renewable Energy and Total Factor Productivity in OECD Member Countries. J. Clean. Prod. 2021, 296, 126499. [Google Scholar] [CrossRef]
  13. O’Sullivan, M.; Overland, I.; Sandalow, D. The Geopolitics of Renewable Energy. SSRN Electron. J. 2017. [Google Scholar] [CrossRef]
  14. Igliński, B.; Iglińska, A.; Cichosz, M.; Kujawski, W.; Buczkowski, R. Renewable Energy Production in the Łódzkie Voivodeship. The PEST Analysis of the RES in the Voivodeship and in Poland. Renew. Sustain. Energy Rev. 2016, 58, 737–750. [Google Scholar] [CrossRef]
  15. Zheng, X.F.; Liu, C.X.; Yan, Y.Y.; Wang, Q. A Review of Thermoelectrics Research—Recent Developments and Potentials for Sustainable and Renewable Energy Applications. Renew. Sustain. Energy Rev. 2014, 32, 486–503. [Google Scholar] [CrossRef]
  16. Mehedi, M.A.A.; Yazdan, M.M.S.; Ahad, M.T.; Akatu, W.; Kumar, R.; Rahman, A. Quantifying Small-Scale Hyporheic Streamlines and Resident Time under Gravel-Sand Streambed Using a Coupled HEC-RAS and MIN3P Model. Eng 2022, 3, 276–300. [Google Scholar] [CrossRef]
  17. Panwar, N.L.; Kaushik, S.C.; Kothari, S. Role of Renewable Energy Sources in Environmental Protection: A Review. Renew. Sustain. Energy Rev. 2011, 15, 1513–1524. [Google Scholar] [CrossRef]
  18. Abdullah Al Mehedi, M.; Reichert, N.; Molkenthin, F. Sensitivity Analysis of Hyporheic Exchange to Small Scale Changes in Gravel-Sand Flumebed Using a Coupled Groundwater-Surface Water Model. In Proceedings of the EGU General Assembly 2020, Online, 4–8 May 2020; p. 20319. [Google Scholar] [CrossRef]
  19. Omri, A.; Nguyen, D.K. On the Determinants of Renewable Energy Consumption: International Evidence. Energy 2014, 72, 554–560. [Google Scholar] [CrossRef]
  20. Heras-Saizarbitoria, I.; Sáez, L.; Allur, E.; Morandeira, J. The Emergence of Renewable Energy Cooperatives in Spain: A Review. Renew. Sustain. Energy Rev. 2018, 94, 1036–1043. [Google Scholar] [CrossRef]
  21. Kumar, R.; Yazdan, M.M.S.; Mehedi, M.A.A. Demystifying the Preventive Measures for Flooding from Groundwater Triggered by the Rise in Adjacent River Stage. Preprints 2022, 2022090452. [Google Scholar] [CrossRef]
  22. Yazdan, M.M.S.; Ahad, M.T.; Kumar, R.; Mehedi, M.A.A. Estimating Flooding at River Spree Floodplain Using HEC-RAS Simulation. J 2022, 5, 410–426. [Google Scholar] [CrossRef]
  23. Mehedi, M.A.A.; Khosravi, M.; Yazdan, M.M.S.; Shabanian, H. Exploring Temporal Dynamics of River Discharge Using Univariate Long Short-Term Memory (LSTM) Recurrent Neural Network at East Branch of Delaware River. Hydrology 2022, 9, 202. [Google Scholar] [CrossRef]
  24. Aktar, N.; Hossain, B.M.T.A.; Ahmed, T.; Khan, M.; Islam, A.; Yazdan, M.M.S.; Noor, F.; Rahaman, A. Climate Change Impacts on Water Availability in the Brahmaputra Basin. In Proceedings of the 5th International Conference on Water and Flood Management, Dhaka, Bangladesh, 6–8 March 2015. [Google Scholar]
  25. Yazdan, M.M.S.; Kumar, R.; Leung, S.W. The Environmental and Health Impacts of Steroids and Hormones in Wastewater Effluent, as Well as Existing Removal Technologies: A Review. Ecologies 2022, 3, 206–224. [Google Scholar] [CrossRef]
  26. Rahaman, A.; Yazdan, M.M.S.; Noor, F.; Duti, B. Establishment of Co-Relation between Remote Sensing Based Trmm Data and Ground Based Precipitation Data in North-East Region of Bangladesh. In Proceedings of the 2nd International Conference on Civil Engineering for Sustainable Development (ICCESD-2014), Khulna, Bangladesh, 14–16 February 2014. [Google Scholar]
  27. Yazdan, M.M.S.; Ahad, M.T.; Jahan, I.; Mazumder, M. Review on the Evaluation of the Impacts of Wastewater Disposal in Hydraulic Fracturing Industry in the United States. Technologies 2020, 8, 67. [Google Scholar] [CrossRef]
  28. Hossain, B.M.T.A.; Ahmed, T.; Aktar, N.; Khan, F.; Islam, A.; Yazdan, M.M.S.; Noor, F.; Rahaman, A. Climate Change Impacts on Water Availability in the Meghna Basin. In Proceedings of the 5th International Conference on Water and Flood Management (ICWFM-2015), Dhaka, Bangladesh, 6–8 March 2015. [Google Scholar]
  29. Yazdan, M.M.S.; Ahad, M.T.; Mallick, Z.; Mallick, S.P.; Jahan, I.; Mazumder, M. An Overview of the Glucocorticoids’ Pathways in the Environment and Their Removal Using Conventional Wastewater Treatment Systems. Pollutants 2021, 1, 141–155. [Google Scholar] [CrossRef]
  30. Tilley, S.D. Recent Advances and Emerging Trends in Photo-Electrochemical Solar Energy Conversion. Adv. Energy Mater. 2019, 9, 1802877. [Google Scholar] [CrossRef]
  31. Gish, M.K.; Pace, N.A.; Rumbles, G.; Johnson, J.C. Emerging Design Principles for Enhanced Solar Energy Utilization with Singlet Fission. J. Phys. Chem. C 2019, 123, 3923–3934. [Google Scholar] [CrossRef]
  32. Zhang, H.; Lu, Y.; Han, W.; Zhu, J.; Zhang, Y.; Huang, W. Solar Energy Conversion and Utilization: Towards the Emerging Photo-Electrochemical Devices Based on Perovskite Photovoltaics. Chem. Eng. J. 2020, 393, 124766. [Google Scholar] [CrossRef]
  33. Homadi, A.; Hall, T.; Whitman, L. Using Solar Energy to Generate Power through a Solar Wall. J. King Saud Univ.—Eng. Sci. 2020, 32, 470–477. [Google Scholar] [CrossRef]
  34. Martín, L.; Zarzalejo, L.F.; Polo, J.; Navarro, A.; Marchante, R.; Cony, M. Prediction of Global Solar Irradiance Based on Time Series Analysis: Application to Solar Thermal Power Plants Energy Production Planning. Sol. Energy 2010, 84, 1772–1781. [Google Scholar] [CrossRef]
  35. Khosravi, M.; Arellano, D. Selection of Adequate EPS-Block Geofoam for Use in Embankments Subjected to Seismic Loads. Preprints 2022, 2022100074. [Google Scholar] [CrossRef]
  36. Liu, M.; Steven Tay, N.H.; Bell, S.; Belusko, M.; Jacob, R.; Will, G.; Saman, W.; Bruno, F. Review on Concentrating Solar Power Plants and New Developments in High Temperature Thermal Energy Storage Technologies. Renew. Sustain. Energy Rev. 2016, 53, 1411–1432. [Google Scholar] [CrossRef]
  37. Zhang, H.L.; Baeyens, J.; Degrève, J.; Cacères, G. Concentrated Solar Power Plants: Review and Design Methodology. Renew. Sustain. Energy Rev. 2013, 22, 466–481. [Google Scholar] [CrossRef]
  38. Publishers, E.A. Proceedings of the Estonian Academy of Sciences, Engineering; Estonian Academy Publishers: Tallinn, Estonia, 2003. [Google Scholar]
  39. Archer, C.L.; Jacobson, M.Z. Evaluation of Global Wind Power. J. Geophys. Res. Atmos. 2005, 110. [Google Scholar] [CrossRef]
  40. Golding, E.W. Generation of Electricity by Wind Power; U.S. Department of Energy: Washington, DC, USA, 1976. [Google Scholar]
  41. Nazir, M.S.; Alturise, F.; Alshmrany, S.; Nazir, H.M.J.; Bilal, M.; Abdalla, A.N.; Sanjeevikumar, P.; Ali, Z.M. Wind Generation Forecasting Methods and Proliferation of Artificial Neural Network: A Review of Five Years Research Trend. Sustainability 2020, 12, 3778. [Google Scholar] [CrossRef]
  42. Wu, Q.; Peng, C. Wind Power Generation Forecasting Using Least Squares Support Vector Machine Combined with Ensemble Empirical Mode Decomposition, Principal Component Analysis and a Bat Algorithm. Energies 2016, 9, 261. [Google Scholar] [CrossRef]
  43. Khosravi, M.; Mehedi, M.A.A.; Baghalian, S.; Burns, M.; Welker, A.L.; Golub, M. Using Machine Learning to Improve Performance of a Low-Cost Real-Time Stormwater Control Measure. Preprints 2022, 2022110519. [Google Scholar] [CrossRef]
  44. Shi, J.; Qu, X.; Zeng, S. Short-Term Wind Power Generation Forecasting: Direct Versus Indirect Arima-Based Approaches. Int. J. Green Energy 2011, 8, 100–112. [Google Scholar] [CrossRef]
  45. Foley, A.M.; Leahy, P.G.; Marvuglia, A.; McKeogh, E.J. Current Methods and Advances in Forecasting of Wind Power Generation. Renew. Energy 2012, 37, 1–8. [Google Scholar] [CrossRef]
  46. Khosravi, M.; Arif, S.B.; Ghaseminejad, A.; Tohidi, H.; Shabanian, H. Performance Evaluation of Machine Learning Regressors for Estimating Real Estate House Prices. Preprints 2022, 2022090341. [Google Scholar] [CrossRef]
  47. Akatu, W.; Khosravi, M.; Mehedi, M.A.A.; Mantey, J.; Tohidi, H.; Shabanian, H. Demystifying the Relationship Between River Discharge and Suspended Sediment Using Exploratory Analysis and Deep Neural Network Algorithms. Preprints 2022, 2022110437. [Google Scholar] [CrossRef]
  48. Verma, T.; Tiwana, A.P.S.; Reddy, C.C.; Arora, V.; Devanand, P. Data Analysis to Generate Models Based on Neural Network and Regression for Solar Power Generation Forecasting. In Proceedings of the 2016 7th International Conference on Intelligent Systems, Modelling and Simulation (ISMS), Bangkok, Thailand, 25–27 January 2016; pp. 97–100. [Google Scholar]
  49. Azadeh, A.; Babazadeh, R.; Asadzadeh, S.M. Optimum Estimation and Forecasting of Renewable Energy Consumption by Artificial Neural Networks. Renew. Sustain. Energy Rev. 2013, 27, 605–612. [Google Scholar] [CrossRef]
  50. Hassan, M.A.; Bailek, N.; Bouchouicha, K.; Nwokolo, S.C. Ultra-Short-Term Exogenous Forecasting of Photovoltaic Power Production Using Genetically Optimized Non-Linear Auto-Regressive Recurrent Neural Networks. Renew. Energy 2021, 171, 191–209. [Google Scholar] [CrossRef]
  51. Fentis, A.; Bahatti, L.; Mestari, M.; Chouri, B. Short-Term Solar Power Forecasting Using Support Vector Regression and Feed-Forward NN. In Proceedings of the 2017 15th IEEE International New Circuits and Systems Conference (NEWCAS), Strasbourg, France, 25–28 June 2017; pp. 405–408. [Google Scholar]
  52. Lin, K.-P.; Pai, P.-F. Solar Power Output Forecasting Using Evolutionary Seasonal Decomposition Least-Square Support Vector Regression. J. Clean. Prod. 2016, 134, 456–462. [Google Scholar] [CrossRef]
  53. Jawaid, F.; NazirJunejo, K. Predicting Daily Mean Solar Power Using Machine Learning Regression Techniques. In Proceedings of the 2016 Sixth International Conference on Innovative Computing Technology (INTECH), Dublin, Ireland, 24–26 August 2016; pp. 355–360. [Google Scholar]
  54. Ahmad, M.; Al Mehedi, M.A.; Yazdan, M.M.S.; Kumar, R. Development of Machine Learning Flood Model Using Artificial Neural Network (ANN) at Var River. Liquids 2022, 2, 147–160. [Google Scholar] [CrossRef]
  55. Mehedi, M.A.A.; Yazdan, M.M.S. Automated Particle Tracing & Sensitivity Analysis for Residence Time in a Saturated Subsurface Media. Liquids 2022, 2, 72–84. [Google Scholar] [CrossRef]
  56. Karimi, M.; Khosravi, M.; Fathollahi, R.; Khandakar, A.; Vaferi, B. Determination of the Heat Capacity of Cellulosic Biosamples Employing Diverse Machine Learning Approaches. Energy Sci. Eng. 2022, 10, 1925–1939. [Google Scholar] [CrossRef]
  57. Abdollahzadeh, M.; Khosravi, M.; Hajipour Khire Masjidi, B.; Samimi Behbahan, A.; Bagherzadeh, A.; Shahkar, A.; Tat Shahdost, F. Estimating the Density of Deep Eutectic Solvents Applying Supervised Machine Learning Techniques. Sci. Rep. 2022, 12, 4954. [Google Scholar] [CrossRef]
  58. Sachin, M.M.; Baby, M.P.; Ponraj, A.S. Analysis of Energy Consumption Using RNN-LSTM and ARIMA Model. J. Phys. Conf. Ser. 2020, 1716, 012048. [Google Scholar] [CrossRef]
  59. Xia, M.; Shao, H.; Ma, X.; de Silva, C.W. A Stacked GRU-RNN-Based Approach for Predicting Renewable Energy and Electricity Load for Smart Grid Operation. IEEE Trans. Ind. Inform. 2021, 17, 7050–7059. [Google Scholar] [CrossRef]
  60. Bouktif, S.; Fiaz, A.; Ouni, A.; Serhani, M.A. Multi-Sequence LSTM-RNN Deep Learning and Metaheuristics for Electric Load Forecasting. Energies 2020, 13, 391. [Google Scholar] [CrossRef]
  61. Yuniarti, E.; Nurmaini, N.; Suprapto, B.Y.; Naufal Rachmatullah, M. Short Term Electrical Energy Consumption Forecasting Using RNN-LSTM. In Proceedings of the 2019 International Conference on Electrical Engineering and Computer Science (ICECOS), Batam Island, 2–3 October 2019; pp. 287–292. [Google Scholar]
  62. Capizzi, G.; Bonanno, F.; Napoli, C. Recurrent Neural Network-Based Control Strategy for Battery Energy Storage in Generation Systems with Intermittent Renewable Energy Sources. In Proceedings of the 2011 International Conference on Clean Electrical Power (ICCEP), Ischia, Italy, 14–16 June 2011; pp. 336–340. [Google Scholar]
  63. Khosravi, M.; Tabasi, S.; Hossam Eldien, H.; Motahari, M.R.; Alizadeh, S.M. Evaluation and Prediction of the Rock Static and Dynamic Parameters. J. Appl. Geophys. 2022, 199, 104581. [Google Scholar] [CrossRef]
  64. Zhu, X.; Khosravi, M.; Vaferi, B.; Nait Amar, M.; Ghriga, M.A.; Mohammed, A.H. Application of Machine Learning Methods for Estimating and Comparing the Sulfur Dioxide Absorption Capacity of a Variety of Deep Eutectic Solvents. J. Clean. Prod. 2022, 363, 132465. [Google Scholar] [CrossRef]
  65. Open Power System Data—A Platform for Open Data of the European Power System. Available online: https://open-power-system-data.org/ (accessed on 12 August 2022).
  66. Kumar, R.; Yazdan, M.M.S. Evaluating Preventive Measures for Flooding from Groundwater: A Case Study. J 2023, 6, 1–16. [Google Scholar] [CrossRef]
Figure 1. Entire pipeline of RNN-based prediction.
Figure 1. Entire pipeline of RNN-based prediction.
Analytics 02 00008 g001
Figure 2. Line plots showing the temporal dynamics of the variables: (a) total energy consumption, (b) wind production, and (c) electricity production from 2006 to 2017.
Figure 2. Line plots showing the temporal dynamics of the variables: (a) total energy consumption, (b) wind production, and (c) electricity production from 2006 to 2017.
Analytics 02 00008 g002
Figure 3. Distribution of the variables using (a) box plot and (b) histogram and density plot. The Pearson correlation coefficient (PCS) values show the measure of skewness.
Figure 3. Distribution of the variables using (a) box plot and (b) histogram and density plot. The Pearson correlation coefficient (PCS) values show the measure of skewness.
Analytics 02 00008 g003aAnalytics 02 00008 g003b
Figure 4. Schematic of the recurrent neural network (RNN).
Figure 4. Schematic of the recurrent neural network (RNN).
Analytics 02 00008 g004
Figure 5. Rolling mean of the predicted consumption and the observed consumption.
Figure 5. Rolling mean of the predicted consumption and the observed consumption.
Analytics 02 00008 g005
Figure 6. Improvement in the model prediction capability with the increase in the number of iterations, i.e., epochs, for the training and testing sets (a). The R2 value is also shown as an indicator of the model performance (b).
Figure 6. Improvement in the model prediction capability with the increase in the number of iterations, i.e., epochs, for the training and testing sets (a). The R2 value is also shown as an indicator of the model performance (b).
Analytics 02 00008 g006
Figure 7. Model performance represented using a scatterplot of the observed and predicted renewable energy production values from the RNN model.
Figure 7. Model performance represented using a scatterplot of the observed and predicted renewable energy production values from the RNN model.
Analytics 02 00008 g007
Table 1. Full description of the energy consumption variables used for EDA and predictive analysis with RNN.
Table 1. Full description of the energy consumption variables used for EDA and predictive analysis with RNN.
Energy Consumption VariablesUnitDescriptions
Total consumptionGWh (gigawatt hours)Daily total energy consumption
Wind power productionGWhDaily wind power production
Solar power productionGWhDaily solar power production
Table 2. Descriptive statistics of the variables.
Table 2. Descriptive statistics of the variables.
VariableCountMeanStdMin25%50%75%Max
Consumption43831338.67165.77842.391217.851367.121457.761709.56
Wind2920164.81143.695.7562.35119.09217.90826.27
Solar218889.2558.551.9635.1786.40135.07241.58
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Yazdan, M.M.S.; Saki, S.; Kumar, R. Untangling Energy Consumption Dynamics with Renewable Energy Using Recurrent Neural Network. Analytics 2023, 2, 132-145. https://doi.org/10.3390/analytics2010008

AMA Style

Yazdan MMS, Saki S, Kumar R. Untangling Energy Consumption Dynamics with Renewable Energy Using Recurrent Neural Network. Analytics. 2023; 2(1):132-145. https://doi.org/10.3390/analytics2010008

Chicago/Turabian Style

Yazdan, Munshi Md Shafwat, Shah Saki, and Raaghul Kumar. 2023. "Untangling Energy Consumption Dynamics with Renewable Energy Using Recurrent Neural Network" Analytics 2, no. 1: 132-145. https://doi.org/10.3390/analytics2010008

Article Metrics

Back to TopTop