Next Article in Journal
Closed-Form Expressions for Local Absorbing Boundary Conditions in Electromagnetic Scattering Problems and Their Implementation into Commercial FEM Software
Next Article in Special Issue
Analysis of Different Scenarios to Include PV Rooftop Systems with Battery Energy Storage Systems in Olive Mills
Previous Article in Journal
A Method for the Characterization of the Energy Demand Aggregate Based on Electricity Data Provided by AMI Systems and Metering in Substations
Previous Article in Special Issue
Addressing Challenges in Delivering Sustainable Rural Water Provision Using Solar Water Pumping in Malawi: A Stakeholder Analysis
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Revolutionizing Solar Power Forecasts by Correcting the Outputs of the WRF-SOLAR Model

1
Department of Electrical Engineering, National Chung Cheng University, Chia-Yi 62102, Taiwan
2
Meteorology and Information Center, Central Weather Bureau, Taipei 100006, Taiwan
3
Department of Chemical Engineering, National Chung Cheng University, Chia-Yi 62102, Taiwan
4
Advanced Institute of Manufacturing with High-Tech Innovations, National Chung Cheng University, Chia-Yi 62102, Taiwan
*
Author to whom correspondence should be addressed.
Energies 2024, 17(1), 88; https://doi.org/10.3390/en17010088
Submission received: 15 November 2023 / Revised: 12 December 2023 / Accepted: 19 December 2023 / Published: 22 December 2023
(This article belongs to the Special Issue Advances in Photovoltaic Solar Energy II)

Abstract

:
Climate change poses a significant threat to humanity. Achieving net-zero emissions is a key goal in many countries. Among various energy resources, solar power generation is one of the prominent renewable energy sources. Previous studies have demonstrated that post-processing techniques such as bias correction can enhance the accuracy of solar power forecasting based on numerical weather prediction (NWP) models. To improve the post-processing technique, this study proposes a new day-ahead forecasting framework that integrates weather research and forecasting solar (WRF-Solar) irradiances and the total solar power generation measurements for five cities in northern, central, and southern Taiwan. The WRF-Solar irradiances generated by the Taiwan Central Weather Bureau (CWB) were first subjected to bias correction using the decaying average (DA) method. Then, the effectiveness of this correction method was verified, which led to an improvement of 22% in the forecasting capability from the WRF-Solar model. Subsequently, the WRF-Solar irradiances after bias correction using the DA method were utilized as inputs into the transformer model to predict the day-ahead total solar power generation. The experimental results demonstrate that the application of bias-corrected WRF-Solar irradiances enhances the accuracy of day-ahead solar power forecasts by 15% compared with experiments conducted without bias correction. These findings highlight the necessity of correcting numerical weather predictions to improve the accuracy of solar power forecasts.

1. Introduction

Under the concept of reducing global warming and promoting zero-carbon emissions, the development of new energy sources and energy conservation has become a significant topic for many countries. Due to limited natural resources, Taiwan currently relies on imports for 97% of its energy supply. To achieve energy autonomy and diversification, the primary goal in Taiwan is to develop self-generated energy and decentralized energy sources. Taiwan is located in the subtropical zone with high solar irradiances, so it is a suitable area to develop solar power generation.
Solar power generation is highly correlated with solar irradiance, and a numerical weather prediction (NWP) model to estimate solar irradiance is significant for solar power forecasting [1]. The most advanced NWP model designed for solar energy is WRF-Solar, a mesoscale professional meteorological model based on the weather research and forecasting (WRF) model [2,3]. It is specifically designed to provide resource assessment and solar power forecasts [4,5,6]. Although the WRF-Solar model has made numerous improvements and optimizations to the parameterization process of WRF irradiances, it does not consider the effect of dynamic aerosol processes on solar irradiance [7]. In other words, an incomplete understanding of the dynamical laws of weather events would hinder accurate predictions. Under a clear sky, aerosols directly affect the forecasting accuracy of global horizontal irradiance (GHI) and direct normal irradiance, making them the largest source of uncertainty [8]. Therefore, improving the forecasting accuracy of aerosol optical thickness under clear sky conditions is crucial [9,10]. While the meteorological parameters of a specific region can be investigated using specialized meteorological instruments, collecting meteorological data worldwide is currently not feasible. Therefore, data-driven and machine learning (ML) approaches for NWP bias correction have become an important trend [11].
The bias correction of deterministic predictions by WRF-Solar is a critical aspect that needs to be addressed, especially to ensure a high accuracy on GHI forecasts. Accurate GHI predictions are essential for the widespread adoption of grid-connected photovoltaic (PV) installations. For deterministic forecasting models, two commonly used post-processing methods for bias correction are model output statistics (MOS) and Kalman filtering. MOS, initially introduced by the National Weather Service in the United States, aims to reduce bias in an NWP output model through post-processing [12]. The major concept of MOS is to represent the bias in NWP forecasts with a regression function. Once a regression function is fitted, it can be used to predict the bias. To enhance the solar irradiance forecasts made by NWP models, various regression methods have been employed, such as multivariate linear regressions with stepwise variable selection [13,14,15], probability-based distributions [16,17], and other bias correction techniques. That is, there are numerous options for regression methods. Many data-driven or ML methods can be combined with regression functions for bias correction. One approach utilized a clear-sky model with an artificial neural network to correct the GHI in the integrated forecasting system [18]. Additionally, an optimization method based on extreme-learning machines was applied to predict the missing values in a solar irradiance dataset, achieving a high forecasting accuracy [19]. The ν-support vector regression was utilized to enhance ML-based methods for day-ahead solar irradiance prediction, and the results showed a great improvement compared with the Japan Meteorological Agency mesoscale model [20]. The ML methods described so far have followed the concept of shallow network learning models for correction and prediction. However, these shallow network models provide poor methods for feature selection, which cannot handle the high complexity of extensive datasets. Consequently, this drives more advanced and promising correction and prediction methods.
Deep learning (DL), a subfield of ML, has garnered rapid popularity in recent years owing to hardware and software advancements. Notably, the self-attention mechanism of DL enables it to automatically discern and capture long-range dependencies within a sequence during processing [21]. This empowers DL models to grasp contextual nuances and intricate patterns within a sequence, rendering it suitable for tasks in natural-language processing and sequence modeling [22]. As a result, numerous self-attention-based network models have been further developed to improve the forecasting accuracy of solar irradiance. Noteworthy examples include the robust self-attention multi-horizon model based on the transformer model [23], the spatial and temporal attention-based neural network in conjunction with federated learning techniques [24], and the Informer model [25]. However, such a self-attention mechanism has drawbacks, including its complexity, large resource demands, and computational costs, which hinder its scalability and efficiency, especially in resource-constrained environments.
In contrast to the batch post-processing approach of MOS, Kalman filtering is another sequential method for post-processing. It has been a significant engineering concept for various scientific fields, including solar energy applications [26,27,28]. Among the different variants of Kalman filtering, the decaying average (DA) method applies the principles of Kalman filtering and utilizes a simple mathematical approach to calculate the systematic bias correction in the model. Up to now, solar energy applications using the DA method are few in the literature, although they have been applied in the context of surface temperature [29,30], daily maximum temperature [31], rainfall [32], and wind speed [33]. Nevertheless, they have been formally implemented in online ensemble forecasts by the National Centers for Environmental Prediction and the Meteorological Service of Canada [34]. These studies have demonstrated the success of the DA method to improve NWP forecasts, rendering them more accurate and aligned with actual forecasting operations. The DA method provides the advantage of adaptively capturing short-term variations by assigning greater weights to the recent data, rendering it suitable for real-time applications and non-stationary data. It does not need substantial historical data for calibration [35]. Due to its simplicity and reduced risk of overfitting, many works have further enhanced the computational efficiency of the DA method and achieved rapid adaptation to data trends [36]. Some research works have explored its potential applications in the field of renewable energy [37,38,39]. Although the DA method has been employed to correct weather forecasts, it still has a largely unexplored potential to forecast solar power generation.
To resolve the above-mentioned research gaps, this paper proposes a comprehensive solar power forecasting procedure that integrates NWP correction. The novelty of this study lies in the development of a DA method based on the Kalman filter; additionally, this method refines daily raw solar irradiance forecasts obtained by the WRF-Solar forecasting model developed by the Taiwan Central Weather Bureau (CWB). To validate the efficiency of the post-processing method, WRF-Solar irradiance forecasts at five cities spanning different latitudes and longitudes were collected with the aim to verify the applicability of the DA method across diverse geographical regions. Additionally, this study compared the performance between the DA method and the transformer model for WRF-Solar bias correction. In collaboration with PV sites in five cities, the PV power generation data from local PV sites were also aggregated. The bias-corrected WRF-Solar irradiances were then combined with the total solar power generation to obtain day-ahead total solar power deterministic forecasts. The operational viability of this forecasting framework has been successfully demonstrated in this paper. The content of this paper includes the following main items:
  • The Pearson correlation analysis was used to select representative meteorological sites in five cities. These cities are located in northern, central, and southern Taiwan.
  • An analysis of the discrepancy between the WRF-Solar irradiances and the observed solar irradiances was carried out at the selected meteorological sites in each city.
  • The development of a post-processing algorithm using the DA method was proposed. It considers WRF-Solar irradiance forecasts as inputs to generate day-ahead bias-corrected WRF-Solar irradiance forecasts at five cities. This study implemented the validation and comparison for the outputs of the WRF-Solar model using the DA method, the original WRF-Solar forecast model, or the transformer model. In addition, this study utilized diverse performance evaluation metrics, including mean error (ME) and root-mean-square error (RMSE).
  • The WRF-Solar model, after undergoing post-processing with the DA method, was combined with the total solar power generation at each city to predict solar power generation. It aims to generate day-ahead total power generation forecasts. Subsequently, these forecasting results were validated and compared against the results using the original WRF-Solar forecast model and the transformer model with several performance evaluation metrics, including RMSE, normalized RMSE (nRMSE), mean absolute error (MAE), mean absolute percentage error (MAPE), and R-squared (R2).
The paper is divided into four sections: Section 1 is the introduction; Section 2 describes the WRF-Solar prediction model and the two post-processing algorithms; Section 3 presents the forecasting results and analyses; Section 4 discusses the results of the review; and Section 5 draws the conclusions.

2. Methods

The framework of this study is presented in Figure 1 and is divided into three main parts. In the first part, the WRF-Solar meteorological sites at the five cities were selected using Pearson correlation analysis. That is, representative WRF-Solar meteorological sites were subsequently selected at each city based on their correlations with the total solar power generation. Figure 2 displays the number of WRF-Solar meteorological sites and solar power sites at each of the five cities. From northern to southern Taiwan, there are four WRF-Solar meteorological sites in Taoyuan, ten sites in Taichung, seven sites in Tainan, five sites in Kaohsiung, and nine sites in Pingtung. As for PV power stations, Taoyuan, Taichung, Tainan, Kaohsiung, and Pingtung include 30, 14, 18, 21, and 14 sites, respectively. The historical data recorded from the WRF-Solar meteorological sites and PV power stations cover the period from January to December 2019. The second part of Figure 1 shows that the representative WRF-Solar irradiances at each city were further corrected for bias using the DA method. The corrected performance was subsequently compared with that of the transformer model. The third part of Figure 1 shows that the bias-corrected WRF-Solar irradiances obtained through the DA method were combined with the total solar power generation for PV power forecasts. The transformer model was then employed to generate day-ahead deterministic forecasts. Additionally, the corrected performance was compared against the day-ahead deterministic forecasts generated by the transformer model using bias-corrected WRF-Solar irradiances.
In the second part, the bias-correction method for wind speeds described in our previous study [33] was used for bias correction for the WRF-Solar irradiances. The previous study employed the DA method to enhance the WRF ensemble wind speed forecasts in Taiwan. However, in this study, the weighting coefficients were predefined in the DA method for the solar power application (these weighting coefficients are introduced in Section 2.2) and set the training window for WRF-Solar irradiances at approximately two months. This approach aims to emphasize the weighting of error samples around the analyzed time. Consequently, in this study, a fixed weighting coefficient of 0.06 was designed for the DA method, which corresponds to a two-month training period. To evaluate the adaptability of using the DA method across various geographical regions and seasons, WRF-Solar irradiances at five cities were collected and validated in spring (May), summer (August), and winter (December) to evaluate the performance after the bias-correction technique. The transformer model was used to compare the bias-correction performance with the DA method. Therefore, the training period for the transformer model was set to two months, the same as the DA method.
In the third part, the training model obtained in the second part with a two-month period was utilized to predict the total solar power generation. The bias-corrected WRF-Solar irradiances obtained using the DA method or the transformer model were then used as inputs into the transformer model to predict day-ahead solar power generation. This process aims to generate a day-ahead forecast for total solar power generation. Likewise, the transformer model was employed to forecast day-ahead total solar power generation by utilizing the bias-corrected WRF-Solar irradiances obtained from the transformer model itself. The following section introduces the theory of WRF-Solar, the DA method, and the transformer model.

2.1. Numerical Weather Prediction Modeling Systems–WRF-Solar

In this study, the bias correction of WRF-Solar irradiances and solar power generation forecasts was performed using the WRF-Solar model developed by Taiwan CWB. The WRF-Solar model is specialized to provide solar irradiances for various applications. The WRF-Solar model is based on version 4.3 of the community WRF model [2,3] with one-way nested domains. The horizontal grid spacing of the coarse and nested domains is equal to 15 and 3 km, respectively (Figure 3), and the vertical levels of the atmosphere are in 52 layers. The WRF-Solar model employs standardized modules that are designed specifically for solar energy applications [4,5,6]. Physical parameterization of the WRF-Solar model includes the Kain–Fritsch cumulus parameterization with a new trigger function [40], the Goddard 5-class scheme for microphysical parameterization [41], the Yonsei University scheme for boundary layer parameterization [42], the RRTMG scheme for long/short-wave irradiation parameterization [43], the Monin–Obukhov scheme for surface parameterization, and the NOAH soil model with four soil layers [44]. Additionally, dynamical parameters are configured using a Eulerian mass dynamical core, Runge–Kutta third order for time integration, evaluation of a second-order diffusion term on coordinate surfaces for turbulence and mixing, and horizontal Smagorinsky first-order closure. Finally, the model of the configured WRF-Solar generates solar irradiance forecasts initialized at 0000/0600/1200/1800 Coordinated Universal Time (UTC) for each day, with each forecast providing a 120 h prediction at hourly intervals.
For the collection of day-ahead WRF-Solar irradiances, the 1200 UTC updated solar irradiance data from the WRF-Solar model were selected for concatenation, as shown in Figure 4. Because the initialization of running a WRF-Solar model requires a 6 h preparation time, the initial 6 h of WRF-Solar irradiances were deleted. Furthermore, because the time format of the WRF-Solar model used is based on UTC, the time zone needed to be converted to the Taiwan time zone (UTC + 8). Consequently, the starting time of the collected WRF-Solar irradiances was set at 2:00 a.m. for each day.

2.2. DA Bias Correction

The DA method employs an adaptive algorithm, which is a straightforward mathematical method for the bias correction of WRF-Solar irradiances. This method uses both WRF-Solar irradiances and actual observed solar irradiances to establish the training model. The application of the DA algorithm involves three main steps: estimation of forecasting errors, estimation of systematic bias, and bias correction [29,33,34].
  • Step 1. Calculate the model prediction error ( b t ) by the difference between the WRF-Solar irradiances ( f t ) and the corresponding observed solar irradiances ( o ) at the same time horizon.
    b t = f t o
  • Step 2. Compute the systematic bias ( B t ) utilizing a weight coefficient ( w ) including the cumulative systematic bias ( b t 1 ) and prediction error ( b t 1 ).
    B t = 1 w × B t 1 + w × b t 1
  • Step 3. Obtain the bias-corrected WRF-Solar irradiances ( F t ), which are derived based on the difference between the WRF-Solar irradiances and the systematic bias.
    F t = f t B t

2.3. Transformer Model

The transformer model is an architecture with neural networks initially developed for natural language translation that has gained widespread applications in various domains [22]. Unlike recursive or convolutional models, the transformer model utilizes an attention mechanism to capture global information [21]. The model consists of two essential components, the encoder and the decoder, as shown in Figure 5. The encoder aims to encode the input sequence. It consists of multiple stacked encoder layers, which are structurally identical but do not share parameters between layers. Each encoder layer contains two sub-layers: a fully connected feedforward layer and a multi-head attention (MHA) layer. The encoder aims to extract key spatial information from WRF-Solar irradiances. Subsequently, this key spatial information is input into the decoder. The decoder decodes the output sequence from the encoder. Similar to the encoder, it consists of a stack of N identical decoder layers. The distinction between encoder and decoder is that the decoder includes a masked MHA layer preceding the MHA layer. The masking prevents the predicted input from influencing subsequent positions. In this study, the SoftMax layer that originally appeared in the decoder was removed because this study focused on deterministic predictions instead of probabilistic predictions [45]. The decoder combines the potential spatial WRF-Solar irradiances from the encoder to predict day-ahead WRF-Solar irradiance. Furthermore, in this study, the WRF-Solar irradiances corrected by the DA method or the transformer model were utilized for solar power generation forecasting via a transformer model. The input of the transformer model encoder was changed from the uncorrected WRF-Solar irradiances to the corrected WRF-Solar irradiances. Moreover, the corrected WRF-Solar irradiances were further encoded and were used as the input of the decoder. Finally, the decoder was used to forecast the total power generation using the corrected WRF-Solar irradiances. In this study, the transformer model consists of two layers at both encoder and decoder with a dimension of 64 (typical default value) in the input layer and a multi-head attention (the head number is two). The computer employed in this study was equipped with an Intel Core i9-9900K processor (Intel, Santa Clara, CA, USA), an NVIDIA RTX 2080Ti GPU (NVIDIA, Santa Clara, CA, USA), and 64GB of RAM. The transformer model was executed using Python software (Python 3.6) with Keras (version 2.10.0), TensorFlow(version 2.6.2), and Sklearn libraries (version 0.24.2), where identical hyperparameters were applied across all experiments to maintain a fair result.

3. Results

3.1. Pearson Correlation Analysis

The representative meteorological sites at each city were selected based on their highest correlation with the total solar power generation using Pearson correlation analysis. The following representative meteorological sites at the five cities were identified: Maobitou meteorological site for Pingtung county, Meinong meteorological site for Kaohsiung county, Haoying meteorological site for Tainan county, Datou meteorological site for Taichung county, and Pingzhen meteorological site for Taoyuan county. The correlation coefficients between the observed solar irradiances and the total PV power generation at each city were 0.8539, 0.8823, 0.9019, 0.86, and 0.872, respectively, as illustrated in Figure 6a–e. Moreover, in this study, the WRF-Solar irradiances at the five cities were further bias-corrected.

3.2. Bias Correction for WRF-Solar Irradiances

It is important to understand the ME and probability density function (PDF) bias level of the representative WRF-Solar irradiances and the observed solar irradiances at the five cities, as shown in Figure 7a–j. The results indicate that the WRF-Solar irradiances in Taoyuan in December are comparable to the observed solar irradiances, with an average ME of 3.46 W/m2. Additionally, the PDF shows an overestimation for low solar irradiances and an underestimation for high solar irradiances, as shown in Figure 7i,j. Moreover, both the ME (Figure 7a,c,e,g,i) and PDF (Figure 7b,d,f,h,j) clearly demonstrate that the generated WRF-Solar irradiances at the cities of Pingtung, Kaohsiung, Tainan, and Taichung were consistently overestimated in May, August, and December. This indicates that WRF-Solar irradiances must be corrected for the forecasting biases.
In this study, the DA method was employed for the bias correction of the WRF-Solar irradiances, and the performance of its correction is presented in Table 1, which demonstrates that at the five cities, using the DA method achieved an improvement in the WRF-Solar irradiances during the three validation months. The RMSE index is reduced from the uncorrected solar irradiance of 137.91 W/m2 to the corrected solar irradiance of 107.94 W/m2, which causes a reduction in error of 22%. Except for Taoyuan in December, using the DA method did not result in an improvement. As shown in Table 1, after the bias correction with the DA method, the forecasting accuracy of solar irradiance is reduced by 2.5%. This discrepancy could be attributed to the nature of the DA method, which accumulates systematic errors over the past two months to correct for bias on the validation date. In cases when the correction bias in the validation month is smaller but the correction bias in the preceding two months is larger, it could cause an inability to correct the validation data. However, for most areas and seasons, bias correction using the DA method does improve the accuracy of solar irradiances from the WRF-Solar.
To further investigate the reason for the low accuracy in a particular month in Taoyuan, this study analyzed the differences between the WRF-Solar irradiances and observed solar irradiances. Figure 8 shows the bias levels between the WRF-Solar irradiances and observed solar irradiances, as measured with ME (Figure 8a) and PDF (Figure 8b), in October and November in Taoyuan. It shows that the WRF-Solar irradiances at 2:00 p.m. and 3:00 p.m. in October and November are overestimated, with an average ME of 29.81 W/m2 and 22.80 W/m2 in October and November, respectively, which causes a low accuracy using the DA method. These observations emphasize the limitations of using the DA method.
In northern Taiwan, the winter season typically begins around December, leading to a large influence of the northeast monsoon. As a result, the temperature gradually drops with the strengthening of the northeast winds. In winter, the average solar irradiance is reduced. To enhance the effectiveness of the DA bias correction method, future work will focus on resolving the observed systematic bias at meteorological sites in northern Taiwan. Therefore, the update on the outputs of the WRF-Solar model will be increased or the accumulated time of the systematic biases will be reduced. Those strategies aim to mitigate the impact of previously accumulated systematic biases on the following forecasts. Furthermore, it is expected that the DA method will be improved by incorporating additional meteorological variables, such as wind direction, wind speed, temperature, and humidity, into the training model. In addition, the use of AI algorithms is expected to obtain a comprehensive relationship between surface solar irradiances and three-dimensional meteorological variables. Thus, these AI algorithms could provide another appropriate solution to improve the outputs of the WRF-Solar model.
To make a comparison with the DA method, the bias correction of the WRF-Solar irradiances was also performed using a transformer model. As shown in Table 1, the transformer model used mostly outperforms the DA method for the performance of bias correction. However, at some cities, the DA method outperformed the transformer model in specific months, such as Kaohsiung in May and Tainan in August. Additionally, in terms of calculation speed, the DA method operated in 4.4 s, while the transformer model needs 119.4 s. Thus, the runtime cost clearly highlights the advantages of the DA method, aligning with its simplicity and enhanced computational efficiency [36].

3.3. Solar Power Generation Forecasting

The WRF-Solar irradiances at the five cities, with or without bias correction with the DA method, were input into the transformer model to predict day-ahead solar power generation in the validation months. Table 2 and Table 3 illustrate that the accuracy of the total solar power generation forecasts for the three validation months at the five cities can be effectively improved by 15.5% when the DA method is applied for bias correction. The exception case appears in Taoyuan, where the accuracy of power generation forecasting in December is worse than that using uncorrected WRF-Solar irradiances, as indicated in Table 3. This phenomenon was caused owing to the limitation of the bias correction of WRF-Solar irradiances, as previously discussed in Section 3.2. That is, the limitation of the bias correction would affect the accuracy of solar power forecasts. It also reaffirms the strong positive correlation between the accuracy of WRF-Solar irradiance and PV power forecasting.
To make a comparison with the solar power forecasts using the DA method, bias-corrected WRF-Solar irradiances obtained via the transformer model were also employed to make one-day-ahead forecasts of total solar power generation. The results in Table 2 and Table 3 show an improvement in the accuracy of the WRF-Solar irradiances using the transformer model. However, even though the WRF-Solar irradiances corrected with the transformer model are closer to the observed solar irradiances, there is no substantial enhancement in the total power generation forecasting, because the total power generation was forecasted based on the observed solar irradiances from the representative meteorological sites rather than the sites of specific power plants. The solar power plants are located in diverse geographical areas within the city, while the climatic conditions would be different at the representative meteorological sites. As a result, there will be estimation errors for solar irradiances.
In summary, the use of the WRF-Solar model is effective to estimate total power generation when WRF-Solar irradiances are bias-corrected successfully using the DA method. This highlights the necessity of the bias correction technique for WRF-Solar and reaffirms the viability of the DA method. The primary contribution of this study is to apply the DA method to bias-correct WRF-Solar irradiances and then use the result of the WRF-Solar corrections for solar power generation forecasting. It improves on the disadvantages of the previous literature, which focused only on the bias correction of meteorological factors without further considering renewable power forecasting.

4. Discussion

This study employed the DA method to correct and refine the output of the WRF-Solar model and utilized the bias correction of solar irradiances to input the forecasting model for the day-ahead forecasting of solar power generation. The DA method has demonstrated its effectiveness in correcting other meteorological parameters such as temperature, wind speed, etc. [29,30,31,32,33]. However, it is noteworthy that the performance of this method was not validated for solar irradiance before. Nevertheless, this paper successfully demonstrates the application of the DA method on the bias correction of the solar irradiances from the WRF-Solar model, which identifies several gaps in our current knowledge.
Furthermore, the reliability of solar power generation forecasts is attributed to the WRF-Solar model produced by Taiwan CWB. The model provides valuable solar irradiances with the highest horizontal resolution of 3 km and a lead time of 120 h for deterministic forecasts, and the predicted solar irradiances are updated four times daily. Then, the output from the WRF-Solar model serves as input for the day-ahead forecasting of solar power generation. This paper explores how the WRF-Solar model can be used to provide useful and valuable weather forecasts for solar power forecasts in Taiwan.
Regarding the limitations of the DA method, the main constraint comes from its statistical nature, because the DA method relies on historical data. As a result, it may exhibit limitations in accurately predicting extreme weather events that could occur in the future. This is a significant limitation of using the DA method. To deal with short-term extreme weather events, such as a rapid change in solar irradiances or wind speeds, it is recommended to use a new NWP model to replace the DA method. This NWP model can combine its outputs with real-time observations to update the forecast quickly. In other words, the new NWP model can update the output rapidly and generate a short-term weather forecast for the next 12 h. Furthermore, utilizing AI-related algorithms can also provide post-processing products and apply to various weather forecasts. These AI algorithms can train the forecasting model through a long-term three-dimensional meteorological dataset and combine NWP forecasts with real-time observations to improve forecasting accuracy.

5. Conclusions

In this study, a comprehensive framework for day-ahead solar power generation forecasts has been proposed. The primary contribution of this paper is to introduce a novel application using the DA method to correct WRF-Solar irradiances across five distinct geographic locations and different seasons. Moreover, the corrected WRF-Solar irradiances were combined with total solar power generation to generate deterministic day-ahead total solar power forecasting. The aforementioned procedures were compared with a transformer model to assess the effectiveness of using the DA method for WRF-Solar irradiance correction and solar power forecasts. The developed framework has been validated across five cities in Taiwan, covering diverse geographic regions (north, central, and south) and seasonal variations (spring, summer, and winter), yielding outstanding results.
The results after bias correction demonstrate that the DA method effectively corrects the WRF-Solar irradiances, improving the accuracy of WRF-Solar irradiances (with a 22% reduction in error) and reducing computational time from 119.4 s to 4.4 s. Notably, although the DA method provided acceptable bias corrections in most cases, it could not fully correct the bias due to its systematic bias accumulation, which presents a limit to using this method. Nevertheless, the advantage of its simplicity should not be underestimated. The results of day-ahead solar power generation forecasts show that the bias correction of WRF-Solar irradiances through the DA method enhances the forecasting accuracy by 15.5%. In conclusion, this study highlights the significance of bias correction in WRF-Solar irradiances to improve solar power generation forecasts.

Author Contributions

Conceptualization, C.-L.H. and Y.-K.W.; methodology, C.-L.H. and Y.-K.W.; software, C.-L.H.; validation, Y.-K.W. and Y.-Y.L.; formal analysis, C.-L.H.; investigation, C.-L.H.; resources, C.-L.H., Y.-K.W., C.-C.T., and J.-S.H.; writing—original draft preparation, C.-L.H., Y.-K.W. and Y.-Y.L.; writing—review and editing, Y.-K.W.; supervision, Y.-K.W. and Y.-Y.L.; project administration, Y.-K.W. All authors have read and agreed to the published version of the manuscript.

Funding

This work is financially supported by the Ministry of Science and Technology (MOST) of Taiwan under the grant MOST 108-3116-F-194-001- and the project title: Development of Renewable Power Forecasting Technique Combing Numerical Weather Prediction and Artificial Intelligence.

Data Availability Statement

Data are contained within the article.

Conflicts of Interest

The authors declare no conflict of interest.

Nomenclature

NWPNumerical weather prediction
WRF-SolarWeather research and forecasting solar
WRFWeather research and forecasting
CWBCentral Weather Bureau
DADecaying average
GHIGlobal horizontal irradiance
PVPhotovoltaic
MOSModel output statistics
MLMachine learning
DLDeep learning
MEMean error
RMSERoot-mean-square error
nRMSENormalized root-mean-square error
MAEMean absolute error
MAPEMean absolute percentage error
R2R-squared
UTCCoordinated Universal Time
MHAMulti-head attention
PDFProbability density function

References

  1. Ahmed, R.; Sreeram, V.; Mishra, Y.; Arif, M. A review and evaluation of the state-of-the-art in PV solar power forecasting: Techniques and optimization. Renew. Sustain. Energy Rev. 2020, 124, 109792. [Google Scholar] [CrossRef]
  2. Skamarock, W.C.; Klemp, J.B.; Dudhia, J.; Gill, D.O.; Liu, Z.; Berner, J.; Wang, W.; Powers, J.; Duda, M.; Barker, D. A Description of the Advanced Research WRF Version 4; National Center for Atmospheric Research (NCAR): Boulder, CO, USA, 2019; Volume 145. [Google Scholar]
  3. Powers, J.G.; Klemp, J.B.; Skamarock, W.C.; Davis, C.A.; Dudhia, J.; Gill, D.O.; Coen, J.L.; Gochis, D.J.; Ahmadov, R.; Peckham, S.E. The weather research and forecasting model: Overview, system efforts, and future directions. Bull. Am. Meteorol. Soc. 2017, 98, 1717–1737. [Google Scholar] [CrossRef]
  4. Jimenez, P.A.; Hacker, J.P.; Dudhia, J.; Haupt, S.E.; Ruiz-Arias, J.A.; Gueymard, C.A.; Thompson, G.; Eidhammer, T.; Deng, A. WRF-Solar: Description and clear-sky assessment of an augmented NWP model for solar power prediction. Bull. Am. Meteorol. Soc. 2016, 97, 1249–1264. [Google Scholar] [CrossRef]
  5. Jiménez, P.A.; Alessandrini, S.; Haupt, S.E.; Deng, A.; Kosovic, B.; Lee, J.A.; Delle Monache, L. The role of unresolved clouds on short-range global horizontal irradiance predictability. Mon. Weather Rev. 2016, 144, 3099–3107. [Google Scholar] [CrossRef]
  6. Haupt, S.E.; Kosovic, B.; Jensen, T.; Lee, J.; Jimenez, P.; Lazo, J.; Cowie, J.; McCandless, T.; Pearson, J.; Weiner, G. The SunCast Solar-Power Forecasting System: The Results of the Public-Private-Academic Partnership to Advance Solar Power Forecasting; National Center for Atmospheric Research (NCAR): Boulder, CO, USA, 2016. [Google Scholar]
  7. Liu, Y.; Qian, Y.; Feng, S.; Berg, L.K.; Juliano, T.W.; Jiménez, P.A.; Liu, Y. Sensitivity of solar irradiance to model parameters in cloud and aerosol treatments of WRF-solar. Sol. Energy 2022, 233, 446–460. [Google Scholar] [CrossRef]
  8. Gueymard, C.A. Temporal variability in direct and global irradiance at various time scales as affected by aerosols. Sol. Energy 2012, 86, 3544–3553. [Google Scholar] [CrossRef]
  9. Randles, C.A.; Kinne, S.; Myhre, G.; Schulz, M.; Stier, P.; Fischer, J.; Doppler, L.; Highwood, E.; Ryder, C.; Harris, B. Intercomparison of shortwave radiative transfer schemes in global aerosol modeling: Results from the AeroCom Radiative Transfer Experiment. Atmos. Chem. Phys. 2013, 13, 2347–2379. [Google Scholar] [CrossRef]
  10. Ruiz-Arias, J.A.; Dudhia, J.; Santos-Alamillos, F.J.; Pozo-Vázquez, D. Surface clear-sky shortwave radiative closure intercomparisons in the Weather Research and Forecasting model. J. Geophys. Res. Atmos. 2013, 118, 9901–9913. [Google Scholar] [CrossRef]
  11. Yang, D.; van der Meer, D. Post-processing in solar forecasting: Ten overarching thinking tools. Renew. Sustain. Energy Rev. 2021, 140, 110735. [Google Scholar] [CrossRef]
  12. Glahn, H.R.; Lowry, D.A. The use of model output statistics (MOS) in objective weather forecasting. J. Appl. Meteorol. Climatol. 1972, 11, 1203–1211. [Google Scholar] [CrossRef]
  13. Verzijlbergh, R.A.; Heijnen, P.W.; de Roode, S.R.; Los, A.; Jonker, H.J. Improved model output statistics of numerical weather prediction based irradiance forecasts for solar power applications. Sol. Energy 2015, 118, 634–645. [Google Scholar] [CrossRef]
  14. Lopes, F.M.; Conceição, R.; Silva, H.G.; Salgado, R.; Collares-Pereira, M. Improved ECMWF forecasts of direct normal irradiance: A tool for better operational strategies in concentrating solar power plants. Renew. Energy 2021, 163, 755–771. [Google Scholar] [CrossRef]
  15. Verbois, H.; Huva, R.; Rusydi, A.; Walsh, W. Solar irradiance forecasting in the tropics using numerical weather prediction and statistical learning. Sol. Energy 2018, 162, 265–277. [Google Scholar] [CrossRef]
  16. Li, T.; Hui, P.; Tang, J.; Fang, J. Future projections of wind and solar energy resources over China from regional climate models based on bias correction. Environ. Res. Commun. 2023, 5, 061004. [Google Scholar] [CrossRef]
  17. Dieng, D.; Cannon, A.J.; Laux, P.; Hald, C.; Adeyeri, O.; Rahimi, J.; Srivastava, A.K.; Mbaye, M.L.; Kunstmann, H. Multivariate bias-correction of high-resolution regional climate change simulations for West Africa: Performance and climate change implications. J. Geophys. Res. Atmos. 2022, 127, e2021JD034836. [Google Scholar] [CrossRef]
  18. Pereira, S.; Canhoto, P.; Salgado, R.; Costa, M.J. Development of an ANN based corrective algorithm of the operational ECMWF global horizontal irradiation forecasts. Sol. Energy 2019, 185, 387–405. [Google Scholar] [CrossRef]
  19. Boriratrit, S.; Fuangfoo, P.; Srithapon, C.; Chatthaworn, R. Adaptive meta-learning extreme learning machine with golden eagle optimization and logistic map for forecasting the incomplete data of solar irradiance. Energy AI 2023, 13, 100243. [Google Scholar] [CrossRef]
  20. Gari da Silva Fonseca Jr, J.; Uno, F.; Ohtake, H.; Oozeki, T.; Ogimoto, K. Enhancements in day-ahead forecasts of solar irradiation with machine learning: A novel analysis with the Japanese mesoscale model. J. Appl. Meteorol. Climatol. 2020, 59, 1011–1028. [Google Scholar] [CrossRef]
  21. Bahdanau, D.; Cho, K.; Bengio, Y. Neural machine translation by jointly learning to align and translate. arXiv 2014, arXiv:1409.0473. [Google Scholar]
  22. Vaswani, A.; Shazeer, N.; Parmar, N.; Uszkoreit, J.; Jones, L.; Gomez, A.N.; Kaiser, Ł.; Polosukhin, I. Attention is all you need. Adv. Neural Inf. Process. Syst. 2017, 30, 5998–6008. [Google Scholar]
  23. Sharda, S.; Singh, M.; Sharma, K. RSAM: Robust self-attention based multi-horizon model for solar irradiance forecasting. IEEE Trans. Sustain. Energy 2020, 12, 1394–1405. [Google Scholar] [CrossRef]
  24. Wen, H.; Du, Y.; Lim, E.G.; Wen, H.; Yan, K.; Li, X.; Jiang, L. A solar forecasting framework based on federated learning and distributed computing. Build. Environ. 2022, 225, 109556. [Google Scholar] [CrossRef]
  25. Jiang, C.; Zhu, Q. Evaluating the most significant input parameters for forecasting global solar radiation of different sequences based on Informer. Appl. Energy 2023, 348, 121544. [Google Scholar] [CrossRef]
  26. Pelland, S.; Galanis, G.; Kallos, G. Solar and photovoltaic forecasting through post-processing of the Global Environmental Multiscale numerical weather prediction model. Prog. Photovolt. Res. Appl. 2013, 21, 284–296. [Google Scholar] [CrossRef]
  27. Liu, Y. Solar GHI Ensemble Prediction Based on a Meteorological Model and Method Kalman Filter. Adv. Meteorol. 2022, 2022, 1523198. [Google Scholar] [CrossRef]
  28. Yang, D. On post-processing day-ahead NWP forecasts using Kalman filtering. Sol. Energy 2019, 182, 179–181. [Google Scholar] [CrossRef]
  29. Chen, Y.; Hong, J. Bias Correction of Surface Temperature Prediction by Using the Decaying Average Algorithm. Atmos. Sci. (Meteorol. Soc. ROC) 2017, 45, 25–42. [Google Scholar]
  30. Boyd, P.; Phillips, W. Predicting Surface Temperatures of Roads: Utilizing a Decaying Average in Forecasting. J. Purdue Undergrad. Res. 2016, 6, 3. [Google Scholar] [CrossRef]
  31. Belorid, M.; Kim, K.R.; Cho, C. Bias Correction of short-range ensemble forecasts of daily maximum temperature using decaying average. Asia-Pac. J. Atmos. Sci. 2020, 56, 503–514. [Google Scholar] [CrossRef]
  32. Kaewmesri, P. Improving Rainfall Performance by Decaying Average Bias Correction via Lyapunov Theory. GEOMATE J. 2020, 19, 49–56. [Google Scholar] [CrossRef]
  33. Tsai, C.-C.; Hong, J.-S.; Chang, P.-L.; Chen, Y.-R.; Su, Y.-J.; Li, C.-H. Application of bias correction to improve WRF ensemble wind speed forecast. Atmosphere 2021, 12, 1688. [Google Scholar] [CrossRef]
  34. Cui, B.; Toth, Z.; Zhu, Y.; Hou, D. Bias correction for global ensemble forecast. Weather Forecast. 2012, 27, 396–410. [Google Scholar] [CrossRef]
  35. Singh, H.; Dube, A.; Kumar, S.; Ashrit, R. Bias correction of maximum temperature forecasts over India during March–May 2017. J. Earth Syst. Sci. 2020, 129, 1–10. [Google Scholar] [CrossRef]
  36. Guan, H.; Cui, B.; Zhu, Y. Improvement of statistical postprocessing using GEFS reforecast information. Weather Forecast. 2015, 30, 841–854. [Google Scholar] [CrossRef]
  37. Hamill, T.M. Comparing and combining deterministic surface temperature postprocessing methods over the United States. Mon. Weather Rev. 2021, 149, 3289–3298. [Google Scholar] [CrossRef]
  38. Gong, L.; Peng, Z.; Wei, Z.; Zhang, B.; Dong, J.; Chen, H.; Cai, J.; Zhang, Q.; Zhang, F. Medium-to long-term forecast of reference crop evapotranspiration based on the correction of the principal control factor. Irrig. Drain. 2022, 71, 912–925. [Google Scholar] [CrossRef]
  39. Zhao, L.; Lu, S.; Qi, D. Improvement of Maximum Air Temperature Forecasts Using a Stacking Ensemble Technique. Atmosphere 2023, 14, 600. [Google Scholar] [CrossRef]
  40. Kain, J.S. The Kain–Fritsch convective parameterization: An update. J. Appl. Meteorol. 2004, 43, 170–181. [Google Scholar] [CrossRef]
  41. Tao, W.-K.; Simpson, J.; Baker, D.; Braun, S.; Chou, M.-D.; Ferrier, B.; Johnson, D.; Khain, A.; Lang, S.; Lynn, B. Microphysics, radiation and surface processes in the Goddard Cumulus Ensemble (GCE) model. Meteorol. Atmos. Phys. 2003, 82, 97–137. [Google Scholar] [CrossRef]
  42. Hong, S.-Y.; Noh, Y.; Dudhia, J. A new vertical diffusion package with an explicit treatment of entrainment processes. Mon. Weather Rev. 2006, 134, 2318–2341. [Google Scholar] [CrossRef]
  43. Iacono, M.J.; Delamere, J.S.; Mlawer, E.J.; Shephard, M.W.; Clough, S.A.; Collins, W.D. Radiative forcing by long-lived greenhouse gases: Calculations with the AER radiative transfer models. J. Geophys. Res. Atmos. 2008, 113, D13103. [Google Scholar] [CrossRef]
  44. Mukul Tewari, N.; Tewari, M.; Chen, F.; Wang, W.; Dudhia, J.; LeMone, M.; Mitchell, K.; Ek, M.; Gayno, G.; Wegiel, J. Implementation and Verification of the Unified NOAH land Surface Model in the WRF Model (Formerly Paper Number 17.5). In Proceedings of the 20th Conference on Weather Analysis and Forecasting/16th Conference on Numerical Weather Prediction, Seattle, WA, USA, 14 January 2004. [Google Scholar]
  45. Qu, K.; Si, G.; Shan, Z.; Kong, X.; Yang, X. Short-term forecasting for multiple wind farms based on transformer model. Energy Rep. 2022, 8, 483–490. [Google Scholar] [CrossRef]
Figure 1. Scheme of the WRF-Solar irradiance bias correction and one-day-ahead solar power generation forecasting model.
Figure 1. Scheme of the WRF-Solar irradiance bias correction and one-day-ahead solar power generation forecasting model.
Energies 17 00088 g001
Figure 2. Number of WRF-Solar meteorological sites and solar power sites at five cities in Taiwan.
Figure 2. Number of WRF-Solar meteorological sites and solar power sites at five cities in Taiwan.
Energies 17 00088 g002
Figure 3. The covered range of WRF-Solar.
Figure 3. The covered range of WRF-Solar.
Energies 17 00088 g003
Figure 4. The schematic diagram of the concatenated WRF-Solar data.
Figure 4. The schematic diagram of the concatenated WRF-Solar data.
Energies 17 00088 g004
Figure 5. Architecture of transformer forecasting model for WRF-Solar irradiance bias correction.
Figure 5. Architecture of transformer forecasting model for WRF-Solar irradiance bias correction.
Energies 17 00088 g005
Figure 6. Pearson correlation analysis of WRF-Solar meteorological sites and total solar power generation in (a) Pingtung, (b) Kaohsiung, (c) Tainan, (d) Taichung, and (e) Taoyuan cities in Taiwan.
Figure 6. Pearson correlation analysis of WRF-Solar meteorological sites and total solar power generation in (a) Pingtung, (b) Kaohsiung, (c) Tainan, (d) Taichung, and (e) Taoyuan cities in Taiwan.
Energies 17 00088 g006
Figure 7. (a,c,e,g,i) Mean error and (b,d,f,h,j) probability density function of WRF-Solar irradiance before bias correction in five cities.
Figure 7. (a,c,e,g,i) Mean error and (b,d,f,h,j) probability density function of WRF-Solar irradiance before bias correction in five cities.
Energies 17 00088 g007
Figure 8. (a) Mean error and (b) probability density function of WRF-Solar irradiance before bias correction in Taoyuan.
Figure 8. (a) Mean error and (b) probability density function of WRF-Solar irradiance before bias correction in Taoyuan.
Energies 17 00088 g008
Table 1. The RMSE and error reduction rate of the WRF-Solar irradiance after bias correction using methods 1, 2, and 3 in five cities.
Table 1. The RMSE and error reduction rate of the WRF-Solar irradiance after bias correction using methods 1, 2, and 3 in five cities.
CityMonthsBefore
Bias Correction
RMSE (W/m2)
After Bias Correction
DA MethodTransformer Model
RMSE
(W/m2)
Reduced
(%)
RMSE
(W/m2)
Reduced
(%)
PingtungMay182.09172.065.51162.1610.94
August243.77237.412.61227.656.61
December143.97130.839.13112.4021.93
KaohsiungMay227.48213.586.11212.916.41
August227.45217.704.29195.5114.04
December143.28122.1414.7596.9132.36
TainanMay210.56201.784.17190.219.67
August204.14202.980.57202.290.91
December127.47117.717.6694.8625.58
TaichungMay222.96181.4818.60168.3924.48
August212.20195.487.88179.0615.62
December137.91107.9421.73102.6825.55
TaoyuanMay257.42205.4020.21174.3232.28
August247.47223.169.82191.2422.72
December158.39162.37−2.51128.3218.98
Table 2. The one-day-ahead forecast results of total solar power generation in Pingtung, Kaohsiung, Tainan, and Taichung using WRF-Solar irradiance with and without bias correction.
Table 2. The one-day-ahead forecast results of total solar power generation in Pingtung, Kaohsiung, Tainan, and Taichung using WRF-Solar irradiance with and without bias correction.
CityMonthsMethodsRMSE (W)nRMSE (%)MAE (W)MAPE (%)R2 (%)
PingtungMayBefore bias correction2118.8713.291287.148.0779.44
DA method1957.1912.281207.377.5782.45
Transformer model1849.3511.601185.527.4484.33
AugustBefore bias correction2227.5814.651692.5811.1372.17
DA method2154.0114.171623.4111.0273.98
Transformer model2118.6113.931611.5610.6874.82
DecemberBefore bias correction1698.6213.901223.6010.0275.28
DA method1604.6713.141178.589.6577.94
Transformer model1555.3512.731091.108.9379.27
KaohsiungMayBefore bias correction4226.8714.232946.499.9278.37
DA method4100.8113.812725.499.1879.64
Transformer model3830.5012.902652.428.9382.23
AugustBefore bias correction4469.1415.283347.4311.4572.23
DA method4438.4515.182991.8710.2372.61
Transformer model4036.6913.802721.629.3177.34
DecemberBefore bias correction2677.5611.321735.407.3484.86
DA method2261.439.561480.106.2689.20
Transformer model2082.348.801454.936.1590.85
TainanMayBefore bias correction4193.2612.422715.358.0481.06
DA method4042.2711.972625.397.7782.40
Transformer model3338.599.892477.877.3488.00
AugustBefore bias correction4640.9215.083131.8710.1873.59
DA method4414.9514.343064.759.9676.10
Transformer model3859.4712.542805.889.1281.74
DecemberBefore bias correction2966.5311.282212.218.4184.21
DA method2962.3611.262084.707.9284.25
Transformer model2470.299.391665.256.3389.05
TaichungMayBefore bias correction5571.3715.223566.679.7471.32
DA method5328.1314.553628.389.9173.77
Transformer model4353.1211.893001.438.2082.49
AugustBefore bias correction5857.0316.214538.9412.5763.46
DA method5782.8416.014537.3212.5664.38
Transformer model5563.8015.404233.9611.7267.03
DecemberBefore bias correction3984.6712.662772.058.8181.20
DA method3652.2211.602643.758.4084.21
Transformer model3577.1111.362633.858.3784.84
Table 3. The one-day-ahead forecast results of total solar power generation in Taoyuan using WRF-Solar irradiance with and without bias correction.
Table 3. The one-day-ahead forecast results of total solar power generation in Taoyuan using WRF-Solar irradiance with and without bias correction.
CityMonthsMethodsRMSE (W)nRMSE (%)MAE (W)MAPE (%)R2 (%)
TaoyuanMayBefore bias correction7528.5215.404662.429.5470.84
DA method6924.9914.174643.399.5075.33
Transformer model5463.5811.183697.087.5684.64
AugustBefore bias correction4941.9310.333531.977.3886.22
DA method4849.7410.143423.617.1686.73
Transformer model4243.308.873346.177.0089.84
DecemberBefore bias correction4478.3011.723078.468.0668.44
DA method5320.8213.933833.7310.0455.45
Transformer model4365.3311.432934.817.6870.01
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Huang, C.-L.; Wu, Y.-K.; Tsai, C.-C.; Hong, J.-S.; Li, Y.-Y. Revolutionizing Solar Power Forecasts by Correcting the Outputs of the WRF-SOLAR Model. Energies 2024, 17, 88. https://doi.org/10.3390/en17010088

AMA Style

Huang C-L, Wu Y-K, Tsai C-C, Hong J-S, Li Y-Y. Revolutionizing Solar Power Forecasts by Correcting the Outputs of the WRF-SOLAR Model. Energies. 2024; 17(1):88. https://doi.org/10.3390/en17010088

Chicago/Turabian Style

Huang, Cheng-Liang, Yuan-Kang Wu, Chin-Cheng Tsai, Jing-Shan Hong, and Yuan-Yao Li. 2024. "Revolutionizing Solar Power Forecasts by Correcting the Outputs of the WRF-SOLAR Model" Energies 17, no. 1: 88. https://doi.org/10.3390/en17010088

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop