1. Introduction
Cloud computing is a service related to information technology, software, and the Internet, and it is centered on the Internet and provides fast and secure cloud computing services and data storage on websites so that everyone can use enormous computing resources and convenient services through the Internet [
1,
2,
3]. With the vigorous development of cloud computing, users’ requirements for cloud computing have increased dramatically, and the needs are also diverse [
4,
5,
6]. However, the vast energy cost of data centers is becoming more and more prominent, and the utilization of computing resources of data centers is low. It is estimated that the average resource utilization of a data center is below 30% [
7]. At the same time, the energy consumption of idle physical machines accounts for more than 70% of the peak energy consumption [
8].
The utilization of computing resources is an important factor affecting the energy consumption of cloud computing. To make better use of the computing resources and reduce the energy consumption of the data center, an effective and commonly used method to solve the problem of huge energy consumption in data centers is virtual machine consolidation. Virtual machine consolidation refers to virtual machine migration, placing it on fewer servers according to the resource requirements of virtual machines and then shutting down some servers. However, frequent and largescale migration also generates a lot of energy consumption. Therefore, minimizing the number of virtual machine migrations is also necessary to achieve balanced energy consumption optimization in virtual machine consolidation.
Note that reducing the number of virtual machine migrations is one of the most critical in the timing of the virtual machine migration. When the timing is accurate enough, it will improve the whole process of the virtual machine integration process. Judging the virtual machine migration trigger time requires setting an appropriate threshold. Threshold setting is generally divided into two types. One is static the threshold setting, which cannot be changed while the workload of the cloud datacenter is constantly changeable, and it also cannot be adjusted dynamically according to the dynamic change of load, making it difficult for the dynamic merging of virtual machines to improve the rate of computing resources. The other is the dynamic threshold setting, which effectively alleviates this problem and can adaptively adjust the threshold according to the change in the historical workload and achieve better resource allocation under the condition of complex resource requirements [
9].
The problem of the frequent fluctuations and changes of cloud data centers is not suitable for a static threshold setting. The setting of dynamic thresholds with a single model is not efficient. There is a potential symmetrical problem with the high and low fluctuations, which is worthy of attention. We propose a virtual machine energysaving merging method based on a threeway decision (ESMM3WD), which firstly divides the fluctuation of historical load utilization into three parts based on the threeway decision. Then, using different mathematical models to predict the workload and adjust the threshold according to the predicted load for dynamically achieving virtual machine integration.
Threeway decision (3WD) is a native threelevel decision theory proposed by Yao [
10], essential elements including trisecting, acting, and outcome, i.e., the TAO model. In recent years, this theory has been widely used in cloud computing, and there are many “3 phenomena” in cloud data centers, such as cloud tasks, which include longtime, mediumtime, and shorttime tasks. The workload can be divided into low, medium, and high loads. The physical machine can be divided into active, sleep, shutdown three states, etc. This paper divides the fluctuation value of physical machine historical load into three types based on the threeway decision: high, medium, and low, and uses the corresponding mathematical model to predict the load. Finally, the predicted load is used to set the threshold dynamically, and then a virtual machine energysaving combination method based on the threeway decision is proposed [
11,
12,
13,
14]. The main contributions of the current article are as follows:
 1.
We establish the correlation between virtual machine migration and granular computing theory to deeply analyze the widespread granularity phenomenon in the process of virtual machine migration. Then, we design the corresponding multigranularity intelligent decisionmaking scheme to optimize the energy consumption;
 2.
Compared with other methods, this paper studies the performance of virtual machine migration under a particular granularity, that is, a magic number 3, and constructs the dynamic migration mechanism of the virtual machine and the analysis method of threeway decision;
 3.
Based on the threeway decision model, we propose a novel cloud resource prediction algorithm to study the quasiperiodic effect of cloud resource demand and dynamically adjust the virtual machine migration mechanism via predicting the cloud resource demand.
The remainder of this paper is organized as follows:
Section 2 mainly introduces some related research on the thresholdtriggered virtual machine.
Section 3 describes the problems that need to be solved, establishes mathematical models, and describes the core algorithms.
Section 4 puts forward the measurement indicators and compares and analyzes some algorithms. Finally, this paper is concluded with further work in
Section 5.
2. Related Work
Thresholdbased triggering methods are divided into two types: one is the static threshold triggering method, and the other is the dynamic threshold triggering method. As we all know, a static single threshold triggering strategy only determines that the physical machine is overloaded when the utilization rate of the physical machine is more significant than 85% to trigger the migration of the virtual machine. However, this single threshold static triggering of the migration of the virtual machine will lead to a surplus of physical machine resources, resulting in a significant waste of resources. Virtual machine migration will be triggered when the CPU utilization of physical machine load is lower than the lower threshold and higher than the upper threshold. However, static thresholds cannot adapt to the complex changes in workload, which leads to the low efficiency of resource integration.
For virtual machine migration, Arshad et al. [
15] propose the Energy Efficiency Heuristic with VM Consolidation, which reduces power consumption while reducing SLA violations. Bahrami et al. [
16] propose using the time series prediction method and double smooth development technique to predict the processor efficiency in the future and also propose the optimal relationship by the dynamic threshold that improves SLA performance, reducing VM migrations and optimizing energy consumption. Liu et al. [
17] propose an enhancing energyefficient and QoS dynamic VM consolidation method, which consists of four algorithms that correspond to different stages in VM consolidation, guaranteeing QoS, reducing VM migrations, and optimizing energy consumption. Khan et al. [
18] propose a normalizationbased VM consolidation strategy that places virtual machines in an online strategy while minimizing energy consumption, SLA violations, and the number of VM migrations.
For the study of dynamic thresholds, Seth et al. [
19] propose that using dynamic thresholds has significant effects in reducing the number of VM migrations, improving SLA performance, and optimizing energy consumption. Yan et al. [
20] propose a virtual machine migration algorithm based on dynamic threshold adjustment. The algorithm mainly takes the historical workload as the main parameter, analyzes the historical load, and predicts the load. Adjust the virtual machine migration threshold dynamically to achieve a more accurate timing for triggering virtual machine migration.Deafallah et al. [
21] use the remaining capacity and the difference between the predicted value and the current value to predict the threshold. This algorithm can convert the physical machine load fluctuation data into stable data, calculate the difference between the predicted load and the current load, add or subtract the calculated value and the current threshold, and finally obtain the dynamic change of the threshold. In ref. [
22], a distributed mathematical model calculates the intervals of physical machine loads to achieve dynamic adjustment thresholds. The above study of dynamic thresholds only uses a single mathematical model to predict load utilization, which is unsuitable for complex and variable workload change.
The basic theory of a threeway decision is to think with three, and the subsequent research has established the trisectionactingoutcome model (TAO model of threeway decision) [
23,
24], and there are numerous “3” phenomena in the cloud data center. According to the threeway decision model, the workload fluctuation is divided into three regions, and then different prediction models are used to predict the load. Finally, the threshold is adjusted dynamically to carry out the virtual machine consolidation for improving resource [
2,
25,
26]. The related studies are shown in
Table 1.
Given the shortcomings of the above research on the dynamic threshold, and combined with the threeway decision, this paper proposes a virtual machine energysaving merger method based on the threeway decision. This method divides the workload fluctuation into three parts based on the threeway decision and uses different mathematical models to predict the load, respectively [
27,
28]. Finally, the predicted load adjusts the double threshold dynamically, making the virtual machine trigger more accurate. This method not only optimizes the number of computing nodes, but also dramatically reduces the number of migrations to achieve the purpose of optimal energy consumption optimization.
3. Preliminaries
This section mainly introduces some basic models, such as the process of VM consolidation, prediction model, workload model, and threeway decision model.
3.1. Process of the Virtual Machine Dynamic Consolidation
Virtual machine dynamic consolidation mainly includes three processes: (1) trigger of VM migration timing; (2) select the virtual machine to be; and (3) placement of virtual machines.
Figure 1 depicts the process of virtual machine dynamically consolidation, and PM represents the physical machine.
As shown in
Figure 1, when a large number of user requirements are transmitted to the cloud, the cloud data center receives them through the interfaces and then allocates computing resources to users according to various decisions to meet the needs of users. However, due to users’ complex and diverse requirements, VM migration is required to optimize resource allocation. The specific migration process includes the following three parts:
(1) Virtual machine migration trigger timing
Virtual machine migration trigger means that the system detects the resource utilization of the physical machine. It will trigger the migration if it finds that the resource utilization exceeds the set threshold. Virtual machine migration triggers are generally divided into two types, one is triggered by low load, and the high load triggers the other. The low load trigger is that when the load of the physical machine is lower than the lower threshold, all the virtual machines in the physical machine are migrated out, and the physical machine is converted into a sleep state. The high load trigger is when the workload is higher than the upper threshold, some suitable virtual machines are migrated out so that the workload status returns to normal, and the SLA quality of service is guaranteed. Static threshold triggered virtual machine migration cannot allocate computing resources according to the various load changes. In contrast, a dynamic threshold triggering virtual machine migration can dynamically adjust the threshold according to the workload, which can fully integrate computing resources and make more physical machines shut down to save energy consumption.
(2) Virtual machines selection
When it is detected that the resource utilization of a physical machine exceeds the predetermined threshold, the physical machine will trigger the virtual machine migration, which requires selecting some virtual machines for migration. There are many methods to select virtual machines, and different methods have different consideration angles. Including considering the cost of virtual machine migration and the minimum time of virtual machine migration;
(3) Virtual machines placement
The data center consists of hundreds or thousands of physical machines, and many virtual machines are waiting to be migrated simultaneously, so there are many ways to place virtual machines. Different placement methods also have different effects. It is necessary to use an appropriate way and method to achieve the best energy consumption optimization under the condition of ensuring QoS.
3.2. Prediction Model for Cloud Workload
(1) Exponential sliding model
where,
${s}_{i}$ is the smoothed value at time step i (understood as the ith time point), and
${x}_{i}$ is the actual data at this time step.
$\alpha $ can be any value between 0 and 1, which controls the balance between old and new information: when
$\alpha $ approaches 1, only the current data point is retained; when
$\alpha $ approaches 0, only the previous smoothing value is retained (the whole curve is flat). The recurrence relation is:
According to the recurrence relation, it can be seen that in the exponential smoothing method, all previous observations have an impact on the current smoothed value, but their role gradually decreases as the power of the parameter
$\alpha $ increases. Those relatively early observations play a relatively minor role. The result of an exponential smoothing calculation can be extended beyond the dataset and range and thus can be used for forecasting. The prediction method is:
where, this
${s}_{i}$ is the last value that has been calculated. When
h is equal to 1, it represents the next value of the predicted.
(2) Holt’s twoparameter exponential smoothing models
In Holt’s twoparameter smoothing model, the prediction consists of two parts. One part is the horizontal part, which is updated by a simple exponential smoothing method based on the horizontal part of the previous period. The other part is the trend part, which is adjusted smoothly based on the trend part of the previous period and updated by a simple exponential smoothing method; the sum of the two will get the predicted value. The model is established as follows:
where
$\alpha $ and
$\gamma $ are smoothing coefficients, which can reflect the impact of recent data on the prediction results,
${x}_{t}$ is the monitoring value of state data at time
t, and
${\widehat{x}}_{t+1}$ is the predicted value of state data at the next time.
${S}_{t}$ is the smoothing value predicted at time
t, reflecting the overall level of previous state data.
${b}_{t}$ is the trend value, reflecting the changing state data trend. The state prediction model based on Holt Exponential Smoothing predicts the smooth value of state data in the sliding window and its trend value. Adding the trend value to the smooth value eliminates the disadvantage of prediction lag existing in other prediction models, and prediction accuracy is improved. Selecting optimal parameters by step acceleration method, the definition is as follows:
where,
n is the coefficient, this method mainly calculates the parameters of Holt’s twoparameter exponential smoothing model to find the smoothing parameters
$\alpha $ and
$\gamma $ that minimize the value
F in the every step.
3.3. The Fluctuation Model of Workload
This subsection mainly introduces the workload fluctuation function, which can calculate the fluctuation of workload.
where,
n is the number of historical CPU utilization,
${x}_{i}$ is the workload at the
ith moment, and
${x}_{avg}$ is the average historical load. The smaller the
${P}_{load}$ value, the smaller the fluctuation of the workload, and on the contrary, the greater the fluctuation.
3.4. ThreeWay Decision Model
The basic idea of the threeway decision is to divide the whole into three different regions according to a pair of thresholds
$(\alpha ,\beta )$ in the rough set, namely the positive region
$POS\left(X\right)$, the negative region
$NEG\left(X\right)$, and the boundary region
$BND\left(X\right)$. Let
$OB$ be a set of objects, and
$Pr\left(X\right\left[x\right])$ represents the conditional probability that an object in the equivalence class belongs to the set
X. Then, we have:
The decisionmaking scheme is given as
$D=\{{a}_{P},{a}_{B},{a}_{N}\}$, which represent that the decisionmaking is accepted immediately, the decisionmaking is delayed, and the decisionmaking is rejected, respectively. Let
${\lambda}_{ij}(i=P,B,N,j=P,N)$ represent the loss value for different actions, we can obtain the Formula (10) and
Table 2.
According to the Bayes minimization criterion, the optimal decision scheme is the action set with the minimum expected loss, and follows the following decision rules:
(P) If $R\left({a}_{P}\right\left[x\right])\le R\left({a}_{B}\right\left[x\right])$ and $R\left({a}_{P}\right\left[x\right])\le R\left({a}_{N}\right\left[x\right])$ are satisfied, it can obtain $x\in POS\left(X\right)$;
(B) If both $R\left({a}_{B}\right\left[x\right])\le R\left({a}_{P}\right\left[x\right])$ and $R\left({a}_{B}\right\left[x\right])\le R\left({a}_{N}\right\left[x\right])$ are satisfied, it can obtain $x\in BND\left(X\right)$;
(N) If both $R\left({a}_{N}\right\left[x\right])\le R\left({a}_{P}\right\left[x\right])$ and $R\left({a}_{N}\right\left[x\right])\le R\left({a}_{B}\right\left[x\right])$ are satisfied, it can obtain $x\in NEG\left(X\right)$;
The thresholds
$\alpha $ and
$\beta $ are as follows:
where,
${\lambda}_{ij}(i=P,B,N,j=P,N)$ represents the loss value for different actions
${a}_{P}$,
${a}_{B}$,
${a}_{N}$.
4. A Virtual Machine EnergySaving Merging Method Based on ThreeWay Decision
The specific process of the virtual machine energysaving merging method based on the threeway decision is first to calculate the fluctuation of load history rate. Then, we divide the workload fluctuation into three parts based on the threeway decision and predict the workload using different mathematical models through different types of division. Finally, adjust the upper and lower thresholds dynamically through the predicted workload.
The block diagram of the steps of the proposed approach is shown in
Figure 2. First, by analyzing the workload data of the cloud data center, the historical data fluctuations are divided into three parts, and then different prediction algorithms are used for each part to obtain the virtual machine trigger migration threshold. When the trigger condition of the VM migration is satisfied, VM integration is performed according to the predicted threshold to achieve the purpose of energy consumption optimization.
The algorithm flow is shown in
Figure 3, and this process mainly consists of two parts:
(1) Workload predictor
First, obtaining the historical workload usage from the cloud datacenter, and then calculating the fluctuation value $\delta $ by Formula (8). When the fluctuation value is low, the workload is relatively stable, and the change is small. When it is a high fluctuation value, the workload has changed significantly, but when it is not high or low, considering global changes.
(2) VM integration
When VM migration trigger conditions are met, the data center will give the decision to consolidate the VMs. The threshold is adjusted by predicting the workload, and the selected virtual machine is triggered to migrate, and then the virtual machine is placed in the suitable physical machine. The Algorithm 1 is inspired from [
29] and described as follows:
Algorithm 1: Dynamic threshold adjustment algorithm. 
Input:
Historical CPU utilization (CPU(x)) obtained from GoogleTrace (capacity:CPU(%)) = $\{{x}_{1},{x}_{2},{x}_{3},\dots ,{x}_{n}\}$; The number of PM is m Output:
UT, LT; 
 1:
Calculate $\alpha $ and $\beta $ from Equations (10) and (11);  2:
Initialize UT ← 70%, LT ← 30%, Over_utilizedList, Low_utilizedList;  3:
Put the load value less than 30% into Low_utilizedList;  4:
Put the load value higher than 70% into Over_utilizedList;  5:
if Over_utilizedList.Size < n/5 or Low_utilizedList.Size < n/5 then  6:
The threshold remains unchanged;  7:
end if  8:
Calculate $\delta $ from Equation (8);  9:
if$\delta $ ≤ $\beta $ then  10:
Load predicting using exponential smoothing method;  11:
if the predicted load − the threshold ≤ 5% then  12:
The threshold ← the predicted load;  13:
else  14:
The threshold remains unchanged. The maximum threshold cannot exceed 90%, and the minimum cannot be lower than 10%.  15:
end if  16:
end if  17:
if$\delta $≥$\alpha $then  18:
Load predicting using Holt’s doubleparameter exponential smoothing method;  19:
if the predicted load − the threshold ≤ 5% then  20:
The threshold ← the predicted load;  21:
else  22:
The threshold remains unchanged. The maximum threshold cannot exceed 90%, and the minimum cannot be lower than 10%.  23:
end if  24:
end if  25:
if$\beta $ < $\delta $ < $\alpha $ then  26:
if (85% of the physical machine CPU usage exceeds the threshold) or (within 5% of the threshold) then  27:
Load predicting using exponential smoothing method;  28:
The threshold ← the predicted load;  29:
else  30:
The threshold remains unchanged;  31:
end if  32:
end if

There are ${n}^{2}$ historical loads in each physical machine of the algorithm, and the number of physical machines is $O\left(m\right)$. First, the time complexity of calculating the upper and lower thresholds is $O\left(n\right)$, and calculating the load fluctuation is also $O\left(n\right)$. The prediction of each physical host is $O\left(n\right)$. So, the time complexity of this algorithm is $O(m\times {n}^{2})$.
4.1. Virtual Machine Selection Strategy
MMT (minimum migration time) algorithm [
29] is an effective single target virtual machine selection algorithm, which selects virtual machines based on the minimum migration time. Divide the amount of RAM used by the bandwidth required for the VM migration to get the migration time. The MMT formula is as follows:
where,
$RA{M}_{u}\left(a\right)$ is the amount of ram utilized by virtual machine
a, and
$NE{T}_{j}$ is the bandwidth utilized by physical machine
j.
4.2. Virtual Machine Placement Strategy
Best fit algorithm (best fit) [
30], which always assigns the minimum free partition that meets the job’s requirements. In order to speed up the search, the algorithm requires that all accessible areas are sorted by their size to form a blank chain in increasing order. This way, the first free area that satisfies the requirements found each time must be optimal, and the algorithm is very convenient.
5. Performance Analysis
This paper adopts the CloudSim Plus platform, which has more models and algorithms, which include heuristic algorithms, more VM migration algorithms, higher accuracy, scalability, and ease of use [
31]. The algorithm in this paper compares the performance of the STA algorithm [
19] and DTA algorithm [
32] from five aspects: data center energy consumption, number of virtual machine migration, SLA violation rate, closing computer nodes, and virtual machine migration efficiency.The dataset uses Google clusters, which is a randomlypicked 1s sample of CPU usage from within the associated 5min usagereporting period for that task, and using this data, it is possible to build up a stochastic model of task utilization over time for longrunning tasks on a cluster of about 12.5 k machines [
33]. The link to the dataset is
https://github.com/google/clusterdata (access on 1 December 2021).
5.1. Experiment Setup
The experiment creates a simulated cloud datacenter on the cloudsim plus platform and constructs various resources such as physical machines and virtual machines of a specific scale. The experimental environment uses idea2021 2.2, jdk8, and cloudsim plus5 0.4. The symbols and definitions are shown in
Table 3. The configuration of the physical machine and the virtual machine is shown in
Table 4.
5.2. Performance Metrics
(1) Number of virtual machine migrations: the number of virtual machines in the migration queue is NUM.
(2) Calculate the number of closed nodes: ${B}_{c}\left(i\right)$ is a binary decision variable indicating whether the physical machine i is powered on and working, i equal to 1 means that the physical machine i is in the active state,${B}_{c}\left(i\right)$ equal to 0 means that the physical machine i is in the shutdown state, $PMList$ means the complete set of physical machines, $PMLis{t}^{\prime}$ represents an active set of physical machines.
(3) Service Level Agreement Violation Rate (SLAViolations, SLAV) In order to test the performance of the algorithm, the default rate of SLA mainly depends on two aspects: one is the time that each active physical machine violates the SLA (SLATAH) [
29], and the other is the performance degradation due to virtual machine migration (PDM).
SLATAH is defined as the percentage of the time that the active physical machine is under 100% CPU utilization and the service time:
where,
N is the number of active physical machines,
${T}_{si}$ is the time of the
ith physical machine under 100% utilization of CPU; and
${T}_{ai}$ represents the total time that the
ith physical machine provides services.
PDM is defined as the percentage of virtual machine performance degradation due to migration:
where,
M represents the number of virtual machines.
${C}_{dj}$ represents an approximation of the performance degradation caused by the migration of the jth virtual machine;
${C}_{rj}$ represents the CPU performance required by the jth physical machine during operation.
Then, the SLA violation rate can be defined by
SLATAH and
PDM together as:
5.3. Experiment Results
This subsection includes two parts: the first part demonstrates the performance and hypothesis testing analysis of the cloud load prediction algorithm, and the second is the performance evaluation and analysis of the proposed virtual machine migration algorithm.
5.3.1. Prediction Analysis
This part presents the analysis of the proposed algorithm showing the prediction performance under various scenarios and hypothesis testing analysis. The prediction evaluation indicators under different scenes are shown in
Table 5. The comparison of actual values and predicted values are shown in
Figure 4.
5.3.2. Performance Analysis
Through cloud platform simulation experiments, the results will show in this subsection. The experiment is to compare the number of cloud tasks under different conditions. As seen from
Figure 5 and
Table 6, the proposed algorithm has fewer migrations times than the others, which are found via different mathematical models to obtain the double thresholds according to different load fluctuations, and the effect is noticeable.
Figure 6 and
Table 7 show the comparison of the number of closed physical machines. The proposed algorithm is similar to the STA algorithm on the number of the closed physical machine. The STA algorithm is the best in static threshold situations. In comparing the number of closed physical machines, the performance of the STA algorithm is similar to the proposed algorithm.
Figure 7 and
Table 8 show the comparison of SLAV. The DTA algorithm has certain fluctuations, ESMM3WD and the STA algorithm is more effective in ensuring the SLA service quality and the SLAV of STA algorithm is similar to the ESMM3WD algorithm.
Figure 8 and
Table 9 show the comparison of energy consumption. It can be seen from the figure that the energy consumption of ESMM3WD algorithm is lower than that of the other two algorithms under various conditions of the number of virtual machines.
In order to test whether there are significant differences between different algorithms, we adopt Wilcoxon pairwise test to compare these experimental results. Given that the test threshold is 0.05, we can find that all the test
pvalues are smaller than the threshold in
Table 10, where the units of
Pvalues is
$\times {10}^{4}$. Thus, we could consider that ESMM3wd is significantly different from other comparison algorithms (i.e., DTA, STA) in most cases.
Finally, the ESMM3WD algorithm combines the theories of threeway decision, firstly dividing the workload fluctuation into three parts and then using different mathematical models to predict the load and dynamically adjust the threshold. The predicted load improves the integration probability of virtual machines to optimize energy consumption. From the effectiveness of the above indicators, the proposed algorithm has better performance than other algorithms in reducing the number of migrations and saving energy consumption, user service experience, and it is suitable for the dynamic and complex environment of cloud data centers.
6. Conclusions
At present, the energy consumption of cloud datacenters is increasing daily, but most of the waste of energy consumption is caused by the number of idle physical machines and the excessive migration of virtual machines. In order to solve the above problems, the proposed algorithm in this paper divides the load fluctuation into three categories: high, medium, and low based on the threeway decision and uses different mathematical models to predict the load according to different fluctuation categories. Finally, the predicted load value adjusts the double threshold dynamically for virtual machine integration and reducing energy consumption. In further research, we will focus on virtual machine selection and placement under the cloud environment and propose a more significant algorithm for energy savings.This paper does not consider the type of physical machines, such as computeintensive, memoryintensive, or storageintensive, when migrating virtual machines.
Author Contributions
Conceptualization, J.Y. and G.Z.; methodology, J.Y.; software, J.Y.; validation, J.Y., G.Z.; formal analysis, J.Y.; investigation, J.Y.; resources, J.Y.; data curation, J.Y.; writing—original draft preparation, J.Y.; writing—review and editing, J.Y. and G.Z.; visualization, J.Y.; supervision, J.Y.; project administration, J.Y. and G.Z.; funding acquisition, J.Y. and G.Z. All authors have read and agreed to the published version of the manuscript.
Funding
This research was supported by the Special financial fund of Guangdong Province (2220062000038) and the National Natural Science Foundation of China (62003092).
Institutional Review Board Statement
Not applicable.
Informed Consent Statement
Not applicable.
Data Availability Statement
The data presented in this study are available on request from the corresponding author. They are restricted to experimental results.
Conflicts of Interest
The authors declare no conflict of interest.
References
 Armbrust, M.; Fox, A.; Griffith, R. Above the Clouds: A Berkeley View of Cloud Computing; Technical Report UCB/EECS200928; EECS Department, University of California: Berkeley, CA, USA, 2009. [Google Scholar]
 Foster, I.; Kesselman, C.; Tuecke, S. The anatomy of the grid: Enabling scalable virtual organizations. Int. J. High Perform. Comput. Appl. 2001, 15, 200–222. [Google Scholar] [CrossRef]
 Mell, P.; Grance, T. The NIST Definition of Cloud Computing; Special Publication (NIST SP); National Institute of Standards and Technology: Gaithersburg, MD, USA, 2011; pp. 145–800. [Google Scholar]
 Theja, P.R.; Babu, S.K. Evolutionary computing based on QoS oriented energy efficient VM consolidation scheme for large scale cloud data centers. Cybern. Inf. Technol. 2016, 16, 97–112. [Google Scholar] [CrossRef]
 Armbrust, M.; Fox, A.; Griffith, R. A view of cloud computing. Commun. ACM 2010, 53, 50–58. [Google Scholar] [CrossRef]
 Chu, Y.; Ma, T.; Zhao, L. Cloud Computing Resource Scheduling Policy and Algorithm. Comput. Sci. 2013, 40, 8–13. [Google Scholar]
 Barroso, L.A.; Clidaras, J.; Hölzle, U. The datacenter as a computer: An introduction to the design of warehousescale machines. Synth. Lect. Comput. Archit. 2013, 8, 1–154. [Google Scholar]
 Fan, X.; Weber, W.D.; Barroso, L.A. Power provisioning for a warehousesized computer. ACM Sigarch Comput. Archit. News 2007, 35, 13–23. [Google Scholar] [CrossRef]
 Huang, J.; Wu, K.; Moh, M. Dynamic Virtual Machine migration algorithms using enhanced energy consumption model for green cloud data centers. In Proceedings of the International Conference on High Performance Computing & Simulation (HPCS), Bologna, Italy, 21–25 September 2014. [Google Scholar]
 Yao, Y. Threeway decision: An interpretation of rules in rough set theory. In Proceedings of the 4th International Conference on Rough Sets and Know Ledge Technology (RSKT 2009), Gold Coast, Australia, 14–16 July 2009. [Google Scholar]
 Yuan, K.; Xu, W.; Li, W.; Ding, W. An incremental learning mechanism for object classificationbased on progressive fuzzy threeway concept. Inf. Sci. 2022, 584, 127–147. [Google Scholar] [CrossRef]
 Chen, X.; Xu, W. Doublequantitative multigranulation rough fuzzy set based on logical operations in multisource decision systems. Int. J. Mach. Learn. Cybern. 2022, 13, 1021–1048. [Google Scholar] [CrossRef]
 Li, W.; Xu, W.; Zhang, X.; Zhang, J. Updating approximations with dynamic objects based on local multigranulation rough sets in ordered information systems. Artif. Intell. Rev. 2022, 55, 1821–1855. [Google Scholar] [CrossRef]
 Xu, W.; Yuan, K.; Li, W. Dynamic updating approximations of local generalized multigranulation neighborhood rough set. Appl. Intell. 2022, 52, 9148–9173. [Google Scholar] [CrossRef]
 Arshad, U.; Aleem, M.; Srivastava, G.; Lin, J.C.W. Utilizing power consumption and SLA violations using dynamic VM consolidation in cloud data centers. Renew. Sustain. Energy Rev. 2022, 67, 112782. [Google Scholar] [CrossRef]
 Bahrami, M.; Haghighat, A.; Gholipour, M. The Reduce energy consumption in cloud computing data centres by optimizing virtual machines. Turk. J. Comput. Math. Educ. 2021, 12, 5342–5350. [Google Scholar]
 Liu, Y.; Sun, X.; Wei, W.; Jing, W. Enhancing energyefficient and QoS dynamic virtual machine consolidation method in cloud environment. IEEE Access 2018, 6, 31224–31335. [Google Scholar] [CrossRef]
 Khan, M.A. An efficient energyaware approach for dynamic VM consolidation on cloud platforms. Cluster Comput. 2021, 21, 1–18. [Google Scholar] [CrossRef]
 Seth, S.; Singh, N. Dynamic thresholdbased dynamic resource allocation using multiple VM migration for cloud computing systems. In Proceedings of the International Conference on Information, Communication and Computing Technology, New Delhi, India, 13 May 2017. [Google Scholar]
 Yan, C.; Li, Z.; Yu, X. Virtual machine dynamic consolidation method based on adaptive overloaded threshold selection. J. Comput. Appl. 2016, 36, 2698–2703. [Google Scholar]
 Deafallah, A.; Eidah, J.A.; Nasrin, S.; Zahir, T.; Albert, Y.Z. DTFA: A Dynamic ThresholdBased Fuzzy Approach for PowerEfficient VM Consolidation. In Proceedings of the 2018 IEEE 17th International Symposium on Network Computing and Applications (NCA), Cambridge, MA, USA, 1–3 November 2018. [Google Scholar]
 Beloglazov, A.; Buyya, R. Adaptive ThresholdBased Approach for EnergyEfficient Consolidation of Virtual Machines in Cloud Datacenters. 2010. Available online: https://www.researchgate.net/publication/240319582_Adaptive_ThresholdBased_Approach_for_EnergyEfficient_Consolidation_of_Virtual_Machines_in_Cloud_Data_Centers (accessed on 10 August 2022).
 Guo, D.; Jiang, C.; Wu, P. Threeway decision based on confidence level change in rough set. Int. J. Approx. Reason. 2022, 143, 57–77. [Google Scholar] [CrossRef]
 Xu, W.; Yu, J. A novel approach to information fusion in multisource datasets: A granular computing viewpoint. Inf. Sci. 2017, 378, 410–423. [Google Scholar] [CrossRef]
 Guo, D.; Jiang, C.; Sheng, R. A novel outcome evaluation model of threeway decision: A change viewpoint. Inf. Sci. 2022, 607, 1089–1110. [Google Scholar] [CrossRef]
 Xu, W.; Guo, Y. Generalized multigranulation doublequantitative decisiontheoretic rough set. Knowl.Based Syst. 2016, 105, 190–205. [Google Scholar] [CrossRef]
 Xu, W.; Li, W. Granular computing approach to twoway learning based on formal concept analysis in fuzzy datasets. IEEE Trans. Cybern. 2016, 46, 366–379. [Google Scholar] [CrossRef]
 Xu, W.; Yuan, K.; Li, W.; Ding, W. An emerging fuzzy feature selection method using composite entropybased uncertainty measure and data distribution. IEEE Trans. Emerg. Top. Comput. Intel. 2022, 1–13. [Google Scholar] [CrossRef]
 Beloglazov, A.; Buyya, R. Optimal online deterministic algorithms and adaptive heuristics for energy and performance efficient dynamic consolidation of virtual machines in cloud datacenters. Concurr. Comput. Pract. Exp. 2012, 24, 1397–1420. [Google Scholar] [CrossRef]
 Kou, L.; Markowsky, G. Multidimensional bin packing algorithms. IBM J. Res. Dev. 1977, 21, 443–448. [Google Scholar] [CrossRef]
 Silva, F.; Oliveira, R.; Monteiro, C.; Inácio, P.; Freire, M. CloudSim Plus: A cloud computing simulation framework pursuing software engineering principles for improved modularity, extensibility and correctness. In Proceedings of the 2017 IFIP/IEEE Symposium on Integrated Network and Service Management (IM), Lisbon, Portugal, 8–12 May 2017. [Google Scholar]
 Zhao, C.; Yao, L.; Cui, Y.; Xiang, H.; Feng, B. Dynamic adjusting threshold algorithm for virtual machine migration. J. Comput. Appl. 2017, 37, 2547–2550. [Google Scholar]
 Dong, Z.; Zhuang, W.; RojasCessa, R. Energyaware scheduling schemes for cloud datacenters on google trace data. In Proceedings of the 2014 IEEE Online Conference on Green Communications (OnlineGreencomm), Online, 12–14 November 2014. [Google Scholar]
 Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. 
© 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).