1.1. Background
The maturation of wind technology, economies of scale, and advances in turbine design are consistently driving down costs, rendering wind power increasingly competitive with traditional energy sources. Consequently, wind energy assumes a pivotal role in addressing global energy demands while mitigating carbon emissions, thereby promoting sustainability in the energy sector. In 2021, worldwide wind-generated renewable energy reached 1861.9 Terawatt-hours, boasting a remarkable 17% annual growth rate, as per data from the BP Statistical Review of World Energy [
1]. This impressive growth trajectory is expected to persist, as an expanding number of countries, including China, invest in wind energy projects to fulfill their renewable energy and climate objectives [
2].
Offshore locations typically offer a more dependable and potent wind resource than onshore sites, resulting in a more consistent and reliable energy output, thereby rendering offshore wind farms notably more efficient in electricity generation when compared to their land-based counterparts [
3]. Moreover, offshore wind farms hold a distinct advantage as they do not encroach upon precious terrestrial real estate, preserving the potential for the multifaceted use of coastal areas and thereby presenting ample room for expansion. Furthermore, the expanse of offshore environments facilitates the deployment of larger and more robust wind turbines, unhindered by the spatial constraints often encountered on land. This capacity for utilizing larger turbines translates to heightened energy production per unit and ultimately reduces the total number of turbines required for a given capacity, consequently yielding substantial cost savings. The overall structure of offshore wind farms is shown in
Figure 1.
While offshore wind farms offer numerous advantages, they are also accompanied by distinct challenges, including intricate installation requirements, heightened maintenance costs, and potential environmental and maritime concerns. Maintenance plays a crucial role in ensuring the sustained efficiency, safety, and profitability of these offshore installations. To facilitate effective maintenance planning, extensive research has delved into the failure modes of wind power generation system components. For instance, Li and Soares [
4] employed Bayesian network analysis to scrutinize failure rates and the overall reliability of the offshore wind turbines. Such studies contribute to the development of robust maintenance strategies and underscore the essential nature of maintenance in optimizing offshore wind farm performance [
5]. To uphold system reliability above a crucial threshold and minimize unexpected failures, the implementation of routine preventive maintenances (PMs) is imperative [
6]. These PMs serve to inspect, identify, and rectify potential component failures. However, while increased PM frequency enhances reliability, it concurrently escalates maintenance costs and extends wind turbine downtime, subsequently diminishing system output. Furthermore, it is noteworthy that the timing of two equal-duration shutdowns can result in different output losses due to variations in wind forces during distinct periods [
7].
To conclude, optimizing long-term preventive maintenance planning is essential to enhance the economic viability of offshore wind farms. It means that we need to ensure that maintenance activities are executed at optimal times, striking a balance between reliability enhancement and minimizing downtime-related productivity losses. These routine preventive maintenances, involving scheduled inspections and servicing, are indispensable for averting component degradation, encompassing vital elements such as turbine blades, gearboxes, and electrical systems in offshore wind farms. In addition, it is necessary to predict the wind force for the whole planning horizon when managers determine the maintenance plan because only accurate wind forecasting can lead to the accurate judgement of system output loss caused by the executed maintenances. However, the prediction of long-term wind force is rather difficult compared with the prediction of short-term wind force. That is also the reason why most articles about wind force prediction in the literature focus on the short-term prediction.
1.2. Motivations and Main Contributions
The published articles related to the maintenance management of offshore wind farms have indicated the difficulty caused by the unknown wind force when making the maintenance plan. Although researchers admit that this problem can be handled well if the unknown wind force can be predicted accurately, they still choose to use the stochastic model to deal with this difficulty because the long-term forecast of wind force is rather complicated. Therefore, the motivation of our paper is to build a prediction model using big data and deep learning methods to forecast the wind force during the whole period of maintenance planning, which can be used to simplify the optimization model of maintenance planning and obtain good application performance simultaneously.
Therefore, this paper aims to answer the following two research questions.
(1) What prediction techniques are suitable for long-term wind force forecasting? Addressing this question is crucial not only for optimizing maintenance planning within offshore wind farms but also for facilitating informed decision making across various operational aspects of wind farms. Additionally, research in this domain proves valuable when evaluating the potential profitability that long-term wind force forecasting can offer to offshore wind farms.
(2) How can an optimization model be developed to encapsulate the fundamental aspects of preventive maintenance in offshore wind farms while ensuring rapid solvability? Addressing this question is instrumental in assisting offshore wind farms in identifying efficient and cost-effective approaches to resolve their maintenance decision dilemmas.
In order to answer the first question, we design a large framework combining three different kinds of networks in
Section 3. This can be viewed as the application of deep learning methods into the optimization area, which is a hot topic recently showing different research trends and advantages, such as Mocanu et al. [
8] and Yang et al. [
9]. Simultaneously, to demonstrate the efficacy of the devised framework, we utilize publicly available data from the city of Leeds to execute the entire process, subsequently comparing its performance against other conventional frameworks.
In order to answer the second question, we establish a mixed integer linear programming model in
Section 2, which takes the wind force as one input parameter of model. This model is structured to define the objective function encompassing various cost components and constraints pertinent to practical maintenance requisites. Subsequently, numerical experiments, detailed in
Section 4, are undertaken to validate the efficacy of this optimization model. Additionally, these experiments yield managerial insights gleaned from the numerical outcomes.
To sum up, the main contributions of this paper can be described as follows.
(1) A prediction model, combining the variational mode decomposition, convolutional neural network, long short-term memory network, and full-connected network, is designed to realize a good long-term wind force forecast. Not only can it be used in the maintenance optimization problem, but it can also be used in other applications.
(2) A mixed-integer linear programming model is established for the maintenance optimization problem, which considers different kinds of costs. The optimal solution can be solved by the common commercial solver such as Cplex, Gurobi, and COPT within an acceptable computation time.
(3) An abundance of numerical experiments are conducted in this paper. They not only validate the effectiveness of the prediction model and optimization model, but they also show the relationship between the total cost and different parameters, which can guide offshore wind farm managers to execute the most appropriate plan based on their reality.
1.3. Literature Review
In recent years, wind power has emerged as a significant contributor to the global power grid. With the development of renewable energy trading management platforms, the value utilization of renewable energy is also more convenient [
10]. Its inherent cleanliness and environmental friendliness have propelled its rapid integration. Achieving the efficient utilization of wind energy necessitates the precise prediction of future wind speeds. Data collection for wind farms is becoming increasingly intensive. Kou et al. [
11] summarized the data monitoring and operation and maintenance of offshore wind farms and explained the importance of wind farm data for wind turbine maintenance, and the future research directions in this field were explored. Studies on wind speed prediction can be categorized into short-term prediction and medium- to long-term prediction based on the length of their prediction time [
12,
13,
14,
15,
16]. Jung et al. [
17] summarized the knowledge of wind speed and power prediction and proposed methods to improve the prediction accuracy. Wang et al. [
18] conducted a comprehensive summary and analysis of the wind speed prediction issue. They outlined the classification criteria for wind speed prediction, experimentally compared various prediction methods, and suggested that one-dimensional convolutional neural networks (CNNs) significantly enhance model prediction accuracy.
In the area of short-term forecasting, the available research studies are already mature and accurate. Shukur et al. [
19] improved the machine learning Autoregressive Integrated Moving Average model (ARIMA) prediction method by combining an artificial neural network (ANN) with a Kalman Filter (KF) to construct a hybrid model for short-term wind speed prediction. Aasim et al. [
20] used wavelet transform (WT) to decompose the data for prediction based on the ARIMA prediction method to achieve the ultra-short-term prediction of wind speed data. Liu et al. [
21] applied a combination of long short-term memory neural networks (LSTMs) to the wind speed prediction problem. Liang et al. [
22] used multivariate weather data to realize the prediction of wind speed based on an LSTM network. Liu et al. [
23] proposed a hybrid prediction network, which decomposes the data and then applies multiple prediction models for separate predictions and finally realizes the prediction of wind speed together. Memarzadeh et al. [
24] combined an LSTM model with algorithms such as the Crow Search Algorithm (CSA) and WT for wind speed prediction. Altan et al. [
25] combined the LSTM network with the Gray Wolf Optimizer (GWO) decomposition method to create a new model to achieve the short-term single-step prediction of wind speed. Kim et al. [
26] proposed a neural network prediction model combining CNN with LSTM and verified its effectiveness in a residential energy consumption prediction problem. Ghimire et al. [
27] applied the combined CNN-LSTM model to the field of solar radiation prediction and verified the improvement of CNN convolution on the prediction accuracy of time series data.
In the area of medium- to long-term prediction forecasting, there have been some studies that have explored prediction methods and achieved wind speed data prediction over relatively long periods. Akash et al. [
28] validated the accuracy of different machine learning prediction models at the long-period level. Liu et al. [
29] provide an introduction to Variable Mode Decomposition (VMD) and propose a new signal decomposition method based on it in combination with Detrended Fluctuation Analysis (DFA). Han et al. [
30] applied the VMD decomposition method to wind speed data decomposition and combined it with LSTM to realize the multi-step prediction of wind speed data. Liu et al. [
31] used the wavelet decomposition method to process the data and combined it with a hybrid optimization framework for multi-step wind speed prediction. Zheng et al. [
32] combined VMD with neural networks to realize the multi-step prediction of wind speed data. Wang et al. [
33] considered the similarity characteristics of data between multiple sites to improve the multi-step wind speed prediction accuracy.
On the other side, the power generation systems of offshore wind farms consist of large and intricate wind turbines, facing challenges such as wear, degradation, and malfunctions within the wind power system. Ensuring the reliability, availability, maintainability, and safety of offshore wind power systems is paramount for their efficient and secure operation [
34]. The selection of an appropriate maintenance strategy plays a pivotal role in the normal functioning of wind farms. Optimal maintenance strategies depend on various factors, including energy costs, required reliability levels, weather conditions, availability of skilled technical personnel, and the accessibility of crew transport vehicles [
35,
36,
37]. Maintenance strategies may vary across different power plants based on factors such as the type, size, and number of wind turbines, required reliability, and other maintenance standards [
38].
Extensive research has been conducted on the maintenance issues in production systems [
39]. Common maintenance approaches include preventive maintenance (PM), corrective maintenance (CM), replacement maintenance (RM), and effective opportunity maintenance (OM), as well as predictive maintenance and condition-based maintenance [
40,
41]. Traditionally, maintenance methods have been predominantly passive, such as corrective maintenance, focusing on promptly addressing equipment or system failures to minimize downtime and production losses [
42]. For instance, a mathematical model proposed by Nachimuthu et al. [
43] aided stakeholders in offshore wind farms in making critical decisions related to corrective maintenance, considering uncertainties in turbine failure information.
With the advent of condition monitoring technologies, fault diagnostic techniques, and numerous fault control theories, the maintenance of wind power systems has witnessed significant advancements [
44]. The offshore wind power industry is transitioning towards more proactive, state-based maintenance methods. Proactive strategies aim to take action before failures occur through regular, preventive, or prescriptive maintenance. Proactive maintenance primarily encompasses preventive maintenance and prescriptive maintenance, with the latter being an evolution of the former [
45,
46]. Both leverage operational data to determine the likelihood of wind turbine component failures, providing sufficient warnings for necessary maintenance [
47]. Preventive maintenance reduces the probability of failures by conducting appropriate measurements before failures occur. It generally focuses on short-term planning, considering factors such as weather, personnel availability, and daily maintenance. Particularly challenging is the scheduling of maintenance work several days in advance due to the uncertainty of weather forecasts [
48]. Tian and Zhang [
49] researched component-level maintenance and economic dependencies, developing a predictive maintenance approach for wind farms. To address the fuzzy multi-objective decision-making problem of spare part batch size in long-term predictive maintenance planning for offshore wind farms, Su et al. [
50] introduced a novel fuzzy multi-objective linear programming model, simultaneously evaluating maintenance costs and system reliability. The probability is calculated through Fault Tree Analysis and Binary Decision Diagrams to reduce computational costs. Garan et al. [
51] utilized reinforcement learning methods, utilizing information provided by the system to optimize wind turbine operation and maintenance schedules. They compared it with common strategies such as predictive and planned maintenance, finding that the use of reinforcement learning methods results in higher average profits.
1.4. Theoretical Overviews
1.4.1. Variational Mode Decomposition (VMD)
Variational mode decomposition is an innovative data decomposition method employed for the analysis of non-stationary or nonlinear data. Compared with the rest of existing decomposition methods, this method can solve the problems of noise, sampling sensitivity, and other limitations, as the method is more robust to noise, and the detailed calculation process and principle can be found in the literature [
52]. It effectively decomposes the original signal into many groups of sub-signals known as Intrinsic Mode Functions (IMFs). Each group of sub-signals possesses distinct local frequencies and modes, representing the long-term and local data characteristics of the original signal from low to high frequencies, respectively. Different from other decomposition models, VMD adopts a non-recursive solution method and can effectively extract the local characteristics of the data signal. It mainly consists of two parts: the construction and solution of variational problems. The VMD problem is formulated as an equation, where
is the decomposition signal for each mode,
is the decomposition signal after the Hilbert transform calculation,
is the center frequency, and
is the exponential term corresponding to the center frequency.
First, the variation problem is constructed. Hilbert transform is performed on the original signal to obtain the analytical signal of modal components, and the single-sided spectrum is obtained. Then, the spectrum of each mode is modulated to the fundamental frequency band to complete the variation problem. The function construction is as shown in the formula, and then the function can be solved.
In the specific implementation, this paper employs the vmdpy open library in Python to implement the VMD function. For the determination of the decomposition dimension, i.e., the number of decompositions, of the raw wind speed data, the center frequency can be used for discrimination. After the decomposition of the original signal data, the center frequency of adjacent decomposition signals is compared, and if the relative value of the center frequency exceeds 90%, it is considered that the decomposition is excessive, and the maximum number of undecomposed excessive modes is selected as the target number for VMD [
32]. In this paper, in order to simplify the data preprocessing steps, the VMD dimension of wind speed data in existing studies is used as the decomposition parameter. The number of decomposed modes, denoted as
, is set to 18, and the balance term
is assigned a value of 2000. This term serves to weigh the trade-off between the signal fitting and smoothness of the modal function.
In the prediction model construction of this paper, VMD is applied to the decomposition of raw mean wind speed data to solve the problem of the poor prediction effect of the original unstable signal. According to the existing studies on wind speed prediction, VMD can effectively deal with irregular wind speed data and combine with other models to obtain more accurate prediction results.
1.4.2. Convolutional Neural Networks (CNNs)
The convolutional neural network is a highly effective method for extracting data features, and it is a feed-forward neural network, commonly employed for the convolution and feature extraction of image data [
53]. When dealing with time series data, CNNs can leverage one-dimensional convolution kernels to extract features from one-dimensional time series data. This approach contributes to enhancing the accuracy of deep learning prediction models. In the field of energy prediction, CNNs have been used in many applications and have shown great advantages. For example, solar radiation prediction has verified its powerful role in neural network prediction [
27]. Its main role is in the characteristics of complex time series data. The extraction helps other prediction models such as recurrent neural network (RNN) models to extract features from complex time series data.
This study uses a one-dimensional convolutional neural network (1-D CNN), which conducts data convolution for feature extraction on one-dimensional time series wind speed data. The CNN performs sliding convolution on one-dimensional data based on the size of the convolution kernel and superposes the data around a single data point to generate new convolutional values, effectively achieving convolution on data features.
The process is depicted in the formula, where represents the new value after convolution, is the activation function, denotes the data sequence of the input convolution kernel, represents the weight information of the convolution kernel, and is the bias term. In this study, the Rectified Linear Unit (ReLU) function was employed as the activation function, and the Adam optimizer was utilized.
In the prediction model construction of this paper, the convolutional neural network was used to construct the data feature extraction layer, which utilizes its efficient extraction capability of data features to achieve feature extraction of one-dimensional average wind speed data. The convolutional layer will help the subsequent neural network to carry out deep feature learning and improve the prediction accuracy.
1.4.3. Long Short-Term Memory Network (LSTM)
The long short-term memory neural network is an evolution of the RNN, designed for predicting long-term cyclic time series data.
RNN is different from CNN in that its elements are not independent of each other. The LSTM model increases the connectivity between elements, that is, the inheritance of information is increased between elements. Similar to other recurrent neural network structures, a set of neural network loops in the RNN model can be expanded into a process in which multiple nodes are processed individually and passed to each other. Each node consists of three layers, namely, the input layer, hidden layer, and output layer. During the processing of each node, the neurons receive information from both the input layer and the hidden layer of the preceding node, producing the output result. However, when the time series data are excessively long, the information from the hidden layer of the preceding nodes that the current node can receive gradually diminishes. This leads to a diminishing impact of the preceding node information, resulting in the loss of data features from preceding nodes in the input information to the neuron. This contributes to suboptimal performance in predicting long-term cyclic time series.
The LSTM model is developed from the RNN model to address the issue of gradient vanishing of the preceding node’s information in long sequences that occurs in the RNN model. The difference is also the core of the LSTM model, which always runs through the entire recurrent neural network and is used for information transfer between nodes when predicting long-term series data.
Compared with the RNN model, the LSTM model adds a new gate control mechanism, which realizes the memory and forgetting of information in the neural network by controlling the increase and decrease in information in the network. The problem of data feature loss in RNN networks during the prediction of too long time series data can be solved by adding a forgetting gate [
54]. A singular LSTM recurrent structure comprises three gates processed sequentially: the forget gate, input gate, and output gate. The forget gate receives data from the previous time step and data features from the current time step. It processes the input information through neurons activated by the sigmoid function, yielding a ratio value that determines the extent to which information from the previous time step is retained. In summary, the LSTM model achieves the long-term transmission of information in long sequence loop problems by adding a gate control mechanism and a cell state layer, effectively solving the problem of the inability of the long-term transmission of information in the RNN model.
In the prediction model construction of this paper, LSTM constitutes the prediction layer of the entire neural network. The LSTM network achieves the purpose of learning the features of the post-convolution data and realizing the final prediction.