Next Article in Journal
A Passive Channel Measurement and Analysis Based on a 5G Commercial Network in V2I Communications
Next Article in Special Issue
GPU-Accelerated Interaction-Aware Motion Prediction
Previous Article in Journal
Software Design for Airborne GNSS Air Service Performance Evaluation under Ionospheric Scintillation
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Cooperative Environmental Perception Task Offloading for Connected and Autonomous Vehicles

1
School of Computer, Electronics and Information, Guangxi University, Nanning 530004, China
2
Guangxi Key Laboratory of Multimedia Communications and Network Technology, Nanning 530004, China
3
School of Information and Management, Guangxi Medical University, Nanning 530021, China
4
Institute of Data Science, City University of Macau, Macao 999078, China
*
Author to whom correspondence should be addressed.
Electronics 2023, 12(17), 3714; https://doi.org/10.3390/electronics12173714
Submission received: 26 July 2023 / Revised: 26 August 2023 / Accepted: 30 August 2023 / Published: 2 September 2023
(This article belongs to the Special Issue Emerging Technologies in Autonomous Vehicles)

Abstract

:
Cooperative environmental perception is an effective way to provide connected and autonomous vehicles (CAVs) with the necessary environmental information. The research goal of this paper is to achieve efficient sharing of cooperative environmental perception information. Hence, a novel vehicular edge computing scheme is proposed. In this scheme, the environmental perception tasks are selected to be offloaded based on their shareability, and the edge server directly delivers the task results to the CAVs who need the perception information. The experimental results show that the proposed task offloading scheme can decrease the perception information delivery latency up to 20%. Therefore, it is an effective way to improve cooperative environmental perception efficiency by taking the shareability of the perception information into consideration.

1. Introduction

In recent years, connected and autonomous vehicles (CAVs) have become a hot research topic in both academia and in the industry [1,2,3,4]. For CAVs, environmental perception is a fundamental requirement. Although current CAVs have been equipped with various sensors (e.g., cameras, radars, and lidars) for environmental perception [5,6,7], there still exist blind areas that CAVs cannot perceive in certain scenarios (e.g., obstacles, bend in a road, etc.). Therefore, cooperative environmental perception [8] is an effective way to enhance the perceptive capabilities of CAVs. With cooperative environmental perception, a CAV can obtain the environmental information shared by other CAVs even if the CAV cannot perceive the environmental information directly.
Since the timeliness of the environmental perception information is vital for driving safety, achieving efficient cooperative environmental perception is the research goal of this paper. Cooperative environmental perception can be divided into the following two parts.
(1) Sensing data processing. The sensors on a CAV may generate 2 GB of real-time data per second on average [9]. Hence, it is difficult to guarantee that all the sensing data can be processed by the CAV within the tolerable delay [10]. To overcome this limitation, vehicular edge computing (VEC) [11] has become a promising computing paradigm. Resource-constrained CAVs can offload some perception tasks, especially those that are delay-sensitive and computing power-consuming, to edge servers for computation.
(2) Environmental information delivery. After the sensing data are processed, the environmental information extracted from the sensing data is sent to the CAVs that need the information to make driving decisions.
In traditional schemes [12,13,14,15,16,17,18,19], once a CAV offloads a task to the edge server, the computation result of the task is returned to the CAV. After that, the CAV transmits the result to the specific CAVs or simply broadcasts the result to its adjacent CAVs, which is inefficient.
In this paper, the shareable characteristics of the environmental perception task results are considered, and a novel vehicular edge computing scheme is established. According to this scheme, if the result of an environmental perception task is required by more CAVs in the surrounding areas, the task is offloaded to the edge server with a higher priority. Moreover, the edge server delivers the task result directly to the CAVs that require it, which reduces delivery latency. We first design an offloading strategy based on the greedy algorithm, which offloads tasks according to the shareable level of environmental perception tasks. Since this strategy does not consider the load of the vehicle, an improved version of the task offloading algorithm considering load balance is also proposed. The simulation results show that the task offloading strategy proposed in this paper makes full use of the shareable features of the environmental perception task and effectively improves the timeliness of environmental perception information.
The main contributions of this paper are summarized as follows:
(1) The concept of environmental perception task shareability for CAVs is created, and the shareability coefficient is designed to quantify the shareability of environmental perception tasks.
(2) Aiming at the straight road and the intersection scenario, respectively, the requiring area model for the environmental perception task of CAVs is established.
(3) An edge computing architecture is proposed for the shareable perception tasks of CAVs, in which the computational results of the tasks are directly delivered to the requiring CAVs to effectively reduce transmission latency.
(4) Two environmental perception task offloading strategies are designed, including the greedy offloading strategy and the load balancing offloading strategy. The effectiveness and efficiency of the two strategies are verified through extensive simulation experiments.
To the best of our knowledge, this is the first attempt to consider the shareability of the task result in a vehicular edge computing context.
The remainder of the paper is organized as follows. Related works are summarized in Section 2. The system model is described in Section 3. The designed algorithms are presented in Section 4 in detail. The experimental results are shown and analyzed in Section 5. Finally, we conclude the paper in Section 6.

2. Literature Reviews

2.1. Cooperative Perception for CAVs

Cooperative perception technology is very helpful for CAVs to promote the environmental perception ability. In Reference [20], a comprehensive survey of state estimation and motion prediction schemes for vehicles and pedestrians is provided. The survey takes the cooperative perception of CAVs as an application scenario and puts forward the key challenges faced by the cooperative perception of CAVs. Yuan et al. study the sharing of cooperative perception data between vehicles to improve perception accuracy and reduce the communication overhead of CAVs [21]. Lei et al. propose the first latency-aware cooperative perception system from the perspective of machine learning in [22], which enhances the robustness and effectiveness of cooperative perception. To overcome the shortage of irrelevant information in the cooperative perception scheme between vehicles, a cooperative perception system called augmented informative cooperative perception is proposed in [23], which can filter irrelative information quickly and optimize the informativeness of shared data between vehicles to improve the fused presentation.
The above research works explore the cooperative perception of CAVs, but edge computing architecture is not considered in these works. In the paper, we combine cooperative perception technology and edge computing to make full use of their advantages, thus further promoting the safety and task-processing ability of CAVs.

2.2. Perception Task Offloading for CAVs

When CAVs are not able to process environmental perception tasks in a timely manner, they can offload the tasks to edge servers. Ahmed et al. make a comprehensive survey on task offloading in vehicular edge computing environments [24]. In [25], each offloaded perception task is assigned a priority, so that the edge server can process more tasks with high priorities within a certain time. To address the safety threats arising from obstructed lines of sight, Xiao et al. propose a multi-tier perception task offloading framework with a collaborative computing approach in [26]. In this way, a CAV can achieve comprehensive perception of the concerned region-of-interest by leveraging collaborative computation with nearby CAVs and road side units. Krijestorac et al. design a hybrid offloading strategy mixing up the horizontal offloading (vehicle-to-vehicle) and vertical offloading (vehicle-to-edge server) to promote the speed of the task processing [27]. In order to solve the problem of overloaded edge servers caused by the increasing number of vehicles, Feng et al. design a reverse offloading scheme [28]. After receiving the environmental perception information uploaded by the vehicles, the edge servers reverse offload the computing task to vehicles. In this way, the computing loads of the edge servers are reduced. Jin et al. present a context-aware offloading strategy based on a differential evolution algorithm [29], which considers vehicle mobility, roadside unit (RSU) coverage, vehicle priority, etc. They solve the joint optimization problems of the offloading decision and resource allocation. Sun et al. consider collaborative task offloading between vehicles in [30], and present an offloading algorithm based on adaptive learning. The algorithm enables vehicles to learn the offloading latency performance of their neighboring vehicles, and the goal is to minimize the average offloading delay. The fact is considered in [31] that the vehicles travels a distance during the time period between offloading sensing data and receiving the computation results. The offloading order of the tasks is determined by vehicle mobility and the computation capacity of the edge server, as well as the aforementioned distance effectively. Qin et al. propose an approach to jointly schedule task offloading and result caching to minimize data duplication [32]. This research considers the reusability of perception task results; however, it ignores the dynamic features of the sensing data and does not make sure that the results are delivered accurately and in a timely manner to vehicles which need the results.
The research works mentioned above do not focus on the shareability of the results of the environmental perception task, i.e., there may be multiple CAVs in the scenario that also need the results of the environmental perception task. In this paper, we analyze the shareability of the environmental perception results and design an offloading strategy which is significantly different from the existing studies.

3. System Model

3.1. System Architecture

A typical application scenario considered in this paper is shown in Figure 1. An edge server and multiple access points (APs) are deployed at the roadside, and the APs are connected to the edge server. The APs provide wireless access service for the CAVs, and the edge server can execute environmental perception tasks offloaded by the CAVs. A CAV can offload its environmental perception tasks to the edge server through an AP and can obtain the perception results from another appropriate AP even if it leaves the original AP.
In traditional vehicular edge computing solutions for cooperative perception, the task results are returned to the vehicle that generates the task, and the vehicle then delivers the results to other vehicles who demand the results through V2V communications, as shown in Figure 2a. Different from the traditional scheme, in our design, the edge server directly delivers the task results to the vehicles with demands, as demonstrated in Figure 2b. With such a design, the latency of the task result delivery is greatly reduced.

3.2. Perception Task Model

Assume that there are n CAVs in the considered scenario, denoted by a set V = v 1 , v 2 , , v n . Each CAV needs to perceive environmental information from four directions, i.e., front-side, rear-side, left-side, and right-side. Hence, the CAV v i ( i = 1 , 2 , , n ) generates four perception tasks in a perceptive cycle, denoted by a set T i = τ front ( i ) , τ rear ( i ) , τ left ( i ) , τ right ( i ) where i = 1 , 2 , , n , as shown in Figure 3. Therefore, the set of tasks generated by all CAVs in this scenario in a perceptive cycle is T all = T i ( i = 1 , 2 , , n ) . The maximum tolerable latency of each perception task τ is denoted as Δ .

3.3. Requiring Areas of Perception Tasks

In this paper, a new concept is proposed, which is requiring area. For a perception task, its result is needed by the CAVs in its requiring areas. The requiring areas of perception tasks are analyzed using two common traffic scenarios, i.e., straight roads and intersections. As indicated in Figure 4, the shaded regions in the four subplots represent the requiring areas for the perception tasks T i = τ front ( i ) , τ rear ( i ) , τ left ( i ) , τ right ( i ) generated by the task vehicle from the four directions in the straight road scenario. Taking Figure 4a as an example, the environmental information directly in front of the task vehicle (i.e., the vehicles parking on the side of the road, the pedestrians crossing the road, etc.) has an impact on the vehicles driving in the same direction behind the task vehicle and also on the oncoming vehicles towards the lane. Therefore, the vehicles in the shaded area in Figure 4a need the front-side environmental perception information of the task vehicle.
Similarly, the shaded areas in the four subplots in Figure 5 represent the requiring areas for the perception tasks T i = τ front ( i ) , τ rear ( i ) , τ left ( i ) , τ right ( i ) generated by the task vehicle from the four directions in the intersection scenario. In Figure 5a, for example, the front-side environmental information of the task vehicle has an impact on vehicles that are about to enter the intersection from all directions, while it does not affect the vehicles that have already left the intersection. Therefore, the four shaded areas in Figure 5a are the requiring areas for the front-side environmental perception task τ front of the task vehicle.
The environmental perception tasks τ generated by a task vehicle are assigned different weights w τ according to the number of vehicles in the requiring areas. The more vehicles exist in the requiring areas of a task, the higher the weight is that is assigned to the task. The weight of task τ is defined as the ratio of the number of vehicles in the requiring area k τ , and the total number of vehicles n in the scenario is defined as
w τ = k τ n

3.4. Shareability Factor of the Task Result

Since the computation resource on the edge server is also limited, it is not practical to offload all tasks to the edge server when there are too many vehicles. Therefore, only a part of the tasks can be offloaded. The set of offloaded tasks is denoted as O , where O T all , and the number of offloaded tasks is | O | .
Another new concept that is part of the shareability factor is also created to measure the level of sharing for each environmental perception task τ , which is denoted as θ . The physical meaning of the shareability factor θ is that an offloaded task result is needed by θ vehicles on average. Hence, a larger θ means a higher efficiency for the offloaded task selection.
Since the number of vehicles in the requiring areas of task τ is k τ , the shareability factor is computed as
θ = τ O k τ | O | O 0 O =
where τ O k τ represents the sum of the number of vehicles in the requiring areas of each task that is offloaded.

3.5. Delay Model

Since efficiency is significant for environmental information perception, the offloading delay from the generation of a task to the delivery of its result is analyzed. The delay includes two parts, i.e., the transmission delay and the processing delay.

3.5.1. Transmission Delay

In the scenario considered in this paper, the APs are installed along a road to provide seamless coverage, and multiple APs connect to an edge server. The CAVs transmit the tasks to the edge server or receive the results from the edge server through the APs. It is assumed that x tasks are needed to be uploaded to the AP within an AP communication range, but only y subchannels are available for the transmissions ( y < x ). Thus, the M / M / y queuing model is adopted to express the process of task uploading. Assume that the data arrival rate is λ , and its service time is exponentially distributed with a mean value of 1 μ . Thus, the waiting time of task transmission can be denoted as
t w u p ( τ ) = ρ ς ( 1 ρ ) λ
where ρ is the service utilization factor and ς denotes the queuing probability. In the M / M / y queuing model, the following equations holds:
ρ = λ y μ
ζ = ( y ρ ) y y ! ( 1 ρ ) 1 + ( y ρ ) y y ! ( 1 ρ ) + i = 1 y 1 ( y ρ ) i i ! 1
The uplink transmission rate r up and the downlink transmission rate r down can be derived from Shannon’s formula as
r up = B up log 2 1 + P v d α h up N
r down = B down log 2 1 + P a d α h down N
where B up and B down denote the uplink and downlink transmission bandwidths, respectively; P v and P a denote the transmission power of the vehicle and AP, respectively; d denotes the distance between the vehicle and AP; α denotes the path loss index; the channel gains of the uplink and downlink are h up , h down , respectively; and N is the environmental noise of the system. Therefore, the uplink transmission delay and downlink transmission delay are expressed as
t up ( τ ) = l τ r up
t down ( τ ) = d τ r down
where l τ is the size of the perception task τ (in bits), and d τ is the size of the task result.
It is assumed that the edge server has an appropriate mobility management scheme. Hence, when the edge server finishes the task processing, it can deliver the task result to the APs that cover the requiring areas of the task. These APs then send the result to vehicles within the requiring areas. Since the edge server and APs are connected by high-speed wired links whose transmission rate is much higher than the transmission rate between the APs and the vehicles, the transmission delay between the edge server and the APs is ignored.

3.5.2. Processing Delay

Queuing occurs when multiple tasks arrive at an edge server and the edge server has only one service queue with a queuing model of M / M / 1 [33]. The average waiting time for the tasks in the edge server is
t w com ( τ ) = λ s μ s μ s λ s
where λ s and μ s represent task arrival rate and the service rate of the edge server, respectively.
The processing time of task τ i , j on the edge server can be written as
t com ( τ ) = l τ C F
where the period required by the edge server to complete every bit of task is C, and F is the computational frequency of the edge server.
Thus, the total offloading delay of task τ is the sum of the transmitting delay and the processing delay, i.e.,
t total ( τ ) = t w up ( τ ) + t up ( τ ) + t w com ( τ ) + t com ( τ ) + t down ( τ )

3.6. Optimization Formulation

When offloading a perception task, two optimization goals should be achieved. The first goal is to minimize the average offloading delay and the second goal is to maximize the shareability factor. The optimization goals are expressed as follows.
min τ O t total ( τ ) | O | s . t . 0 f i F ( C 1 ) t total ( τ ) Δ ( C 2 ) λ s μ s ( C 3 )
max τ O k τ | O | s . t . k τ Z + ( C 4 ) C 1 , C 2 , C 3
where C1 represents that the computing capacity allocated to each perception task is lower than the total computing capacity of the edge server; C2 requires that the total latency must not exceed the maximum tolerable latency of each perception task; C3 means that the service capability of the edge server is not less than the arrival rate of perception tasks; and C4 indicates that it is an integer constraint.

4. Methods

4.1. Offloading Based on Greedy Sharing Strategy

In order to decide which tasks are offloaded to the edge servers, an offloading strategy based on greedy sharing, referred to as OG, is designed. The input is the task set T generated by the sensors from the four directions of a vehicle. For a task from a certain direction, the requiring areas are defined as demonstrated in Figure 4 and Figure 5. The edge server assigns a weight w τ to each task according to the number of vehicles in the requiring areas of the task. The larger number of vehicles in the requiring areas means a larger weight. The edge server determines the offloading order of the tasks based on their weights. The task with a larger w τ is offloaded with a higher priority to ensure that the task result can be shared with as many vehicles as possible. The process of offloaded task selection is described in Algorithm 1.
Algorithm 1 Offloading Based on Greedy Sharing Strategy (OG).
Input: Task set T all and computing resource F of edge server.
Output: The set of offloaded tasks O .
1:
Initialize the set of offloaded tasks O = ;
2:
Assign weights w τ to each perception task according to Equation (1);
3:
Sort task τ T all in a descending order by w τ ;
4:
for each τ T all  do
5:
       c τ = l τ C ;
6:
      if  c τ < F & & t total Δ  then
7:
             O = O + { τ } ;
8:
             F = F c τ ;
9:
      else if  F = = 0  then
10:
          break;
11:
    end if
12:
end for
13:
return O ;
In Line 1, the set of tasks to be offloaded is initialized. In Line 2, the weights of the tasks are determined according to Equation (1). If the result of the task is required by more CAVs, it has a higher weight. In Line 3, the tasks are sorted in a descending order by weight. Hence, a task with higher a weight has a higher priority to be offloaded. From Line 4 to Line 12, the set of offloaded tasks using greedy strategy is obtained. More specifically, for each task (Line 4), the needed resource of task τ is computed in Line 5. If the edge server can afford the task and the delay of the task is tolerable (Line 6), the task is added into the offloaded set O (Line 7). After that, the remaining resource of the edge server is updated (Line 8). If no more resource is available, no more computation is needed (Lines 9 and 10). In Line 13, the set of selected tasks to be offloaded is returned.
The time complexity of Algorithm 1 is determined by sorting the tasks (Line 3), which is O ( | T all | log | T all | ) .

4.2. Offloading Based on Greedy Sharing Strategy with Load Balance

The above offloading algorithm only considers the task weight as the basis of the offloading decision. However, when the task weights of different vehicles are of a great difference, a phenomenon may occur that all tasks of a vehicle are offloaded, while another vehicle has to process all the perception tasks by itself. Such unbalanced offloading may result in significant perception delays for those vehicles that cannot offload their tasks to the edge server.
Algorithm 2 is an improved version of Algorithm 1. In Line 1, the set of offloaded tasks is initialized as an empty set. For each vehicle (Line 2), its perception tasks are assigned weights (Line 3), and these tasks are sorted in an ascending order by weight (Line 4). In Line 5, the task set T i of the i-th vehicle is split into two subsets. One is denoted as T v i , containing the tasks that can be processed by the vehicle itself. The other subset is denoted as T s i , containing the tasks that have to be offloaded to the edge server. From Line 7 to Line 9, the tasks in T s i are added into the offloaded task set O . In Line 10, the tasks in each T v i are put into a candidate set Ω , and are sorted in descending order. From Line 11 to Line 19, each task in Ω is checked and offloaded if the edge server can bear it.
The computational complexity of Algorithm 2 is also determined by sorting the tasks (Lines 4 and 10), which is O ( | T all | log | T all | ) .
Algorithm 2 Offloading Based Greedy on Sharing Strategy with Load Balance (OG-LB).
Input: Task T all , computing resource of edge server F, the number of tasks that a vehicle can deal with at most in a perception cycle ε
Output: The set of offloaded tasks O .
1:
Initialize the set of offloading tasks O = ;
2:
for each T i  do
3:
      Assign weight w τ to each task τ T i ;
4:
      Sort the tasks in an ascending order by w τ ;
5:
     Split T i into two subsets T v i and T s i , where T v i contains ε tasks with the least weights, and T s i contains the remainder ( 4 ε ) tasks;
6:
end for
7:
for each T s i  do
8:
       O = O T s i ;
9:
end for
10:
Let candidate tasks Ω = U T v i , and sort tasks τ Ω in a descending order by w τ ;
11:
for each τ Ω  do
12:
       c τ = l τ C ;
13:
      if  c τ < F & & t total Δ  then
14:
             O = O + { τ } ;
15:
             F = F c τ ;
16:
      else if  F = = 0  then
17:
            break;
18:
      end if
19:
end for
20:
return O ;

5. Results and Discussion

5.1. Experimental Settings

In order to evaluate the performance of the proposed algorithms, simulation experiments are conducted using Python script and SUMO (Simulation of Urban MObility) as the experimental platform. The coverage range of the AP is set to 200 m. The length of the requiring area is set to 100 m, and its width is set to 4 m (equal to the lane width). The edge server computing frequency is 8 GHz. The channel model follows the Rayleigh fading model. The detailed parameters of the experimental settings are listed in Table 1.
Each contrast scheme contains two issues, i.e., the offloading strategy and the task result sharing scheme.
For the offloading strategy, the following three strategies are compared:
  • Offloading based on greedy algorithm (denoted as OG). As shown in Algorithm 1, the tasks are selected to be offloaded based on the weight w τ .
  • Offloading based on greedy algorithm with load balance (denoted as OG-LB). As shown in Algorithm 2, the computation load of each vehicle is taken into account.
  • Offloading based on the generation order in the vehicle (denoted as OV). In this scheme, the shareability of the tasks are not considered.
For the task result sharing scheme, the following two schemes are compared:
  • The task result is shared by the server (denoted as SS). This is our proposed scheme. In this scheme, the result of the offloaded task is broadcast by the server to all vehicles in the requiring areas through infrastructure-to-vehicle (I2V) communications.
  • The task result is shared by the vehicles (denoted as SV). This is a traditional cooperative perception scheme in vehicular edge computing. In this scheme, the edge server sends the result of the offloaded task to the task-generated vehicle, then the vehicle sends the result to other vehicles through vehicle-to-vehicle (V2V) communications.
Hence, a contrast method is denoted as a combination of the the offloading strategy and the task result sharing scheme, such as OG-SS or OV-SV.
To facilitate the representation of the result delivery delay after offloading a task, an experimental variable (denoted as β ) is introduced as the ratio of the task result size to the originally generated task size.

5.2. Results Analysis

5.2.1. Delay

In the simulation experiment, a task is generated for each direction of each vehicle in a perception cycle. In Figure 6, the solid line indicates the SS scheme and the dashed line represents the SV scheme. Obviously, the average delay increases substantially with β in the SV scheme, while the average delay hardly varies with β by applying the SS scheme, which generally reduce the average delay by 5 ms. Under the same condition, the delay obtained in the OG offloading algorithm is lower than in the OV offloading algorithm.
Since the size of a task is assumed to be fixed, the varying of β means a change in the size of the task result. When the task results are delivered using the sharing strategy by the edge server, it is broadcast to all vehicles in the requiring area by the APs. When the size of the task result increases, the delivery delay of the SS scheme only grows at a low speed.
We also compared the numerical relationship between the number of vehicles and the average delay under these offloading strategies, as shown in Figure 7. The ratio of the result size to the task size is set to 0.05, and the number of vehicles varies from 50 to 100. With the increase in vehicles, the average delay also increases. When the number of vehicles reaches 100, the average delay of the OV-SV method exceeds 100 ms, which may endanger driving safety. In contrast, our proposed method (OG-SS) has the lowest delay, which is about 20% lower compared to that of the traditional method (OV-SV). Generally, the average delay of the SS scheme is obviously lower than that of the SV scheme, and the delay obtained from the OG offloading algorithm is about 10 ms less than the OV offloading algorithm.

5.2.2. Shareability Factor

The shareability factor of the perception task represents how many vehicles need the result of the task. Hence, the higher the shareability factor is, the higher the efficiency achieved. For comparison with the traditional method (i.e., OV-SV), the value of the shareability factor in OV-SV is set to be a constant 1. The shareable feature of the task result is investigated in the intersection scenario and the straight road scenario.
The value of the shareability factor is closely related to traffic flow (in veh/h). Traffic flow is set to 1000–2000 veh/h, and the simulation steps are set to 3600 (representing an hour). According to Figure 4 and Figure 5 in Section 3.3, the number of vehicles in the requiring areas is recorded every 200 steps.
The relationship between the shareability factor and the traffic flow in the intersection scenario is shown in Figure 8. Since it is assumed in Algorithm 2 (OG-LB) that a CAV can process ε ( 0 < ε 4 ) tasks in a perception cycle, the algorithms are compared under four different values of ε . The four subplots in Figure 8 correspond to the values ε = 1 , ε = 2 , ε = 3 , and ε = 4 , respectively. Three observations can be found in Figure 8. First, as the traffic flow becomes higher, the shareability factors of methods OG-SS, OG-LB-SS, and OV-SS all increase, and OG-LB-SS has the fastest growth rate in most cases. For OG-LB-SS, the shareability factors reach 17, 12, 11.9, and 7.2 when ε is set to 1, 2, 3, and 4, respectively. The reason is that the gain of a sharing task result is larger when the traffic flow is higher. Second, when ε is small, OG-LB-SS has obvious advantages. This is because a smaller ε means a lower processing power of the vehicle, and the effect of task offloading with load balance is more remarkable. OG-LB-SS degenerates into OG-SS when ε = 4 . Third, the shareability factor of OV-SS is smaller than that of OG-SS and OG-LB-SS because it does not guarantee that tasks with more requiring vehicles are offloaded to the edge server in the OV-SS strategy.
Figure 9 depicts the variation of the shareability factor for different traffic flows in a straight road scenario. The four subplots in Figure 9 are also related to the values ε = 1 , ε = 2 , ε = 3 , and ε = 4 , respectively. Similar observations can be obtained with Figure 8. In Figure 9, the method OG-LB-SS also has the fastest growth rate in most cases, and the shareability factors are 10.2, 7.8, 5.3, and 5.0 when ε is set to 1, 2, 3, and 4, respectively. The reasons are similar to the analysis in Figure 8.
When comparing Figure 8 and Figure 9, it can be seen that the shareability factor in the intersection scenario is higher than that in a straight road scenario, since there are more vehicles requiring the result of a certain perception task.

6. Conclusions

In this paper, the shareability of the perception task results was considered for cooperative environmental perception, and a novel vehicular edge computing scheme was designed to make full use of the shareability. In the scheme, the shareability factor of the task result was proposed as a new metric, and the tasks were selected to be offloaded based on this metric. Two versions of the task offloading strategies were designed. One was based on a greedy algorithm, and the other one took load balance into consideration. The edge server then delivered the task results to the CAVs in the requiring areas directly, which reduced the result delivery latency. Simulation results showed that our proposed task offloading scheme outperformed traditional schemes in terms of the task result delivery delay and the shareability factor. Based on the proposed scheme, the efficiency of cooperative perception among CAVs was improved remarkably.
The limitations of this research work include the following: (1) The CAVs in adjacent positions may share similar environmental information, which causes transmission redundancy and (2) only a simulation is conducted to verify the proposed scheme.
In the future, we will further explore a scheme to select a portion of CAVs for cooperative environmental perception based on their real-time dynamic features, such as trajectories, speeds, and positions. Hence, the information redundancy will be reduced, and the efficiency of cooperative environmental perception will be improved greatly. A prototype will also be set up in a real transportation context for verification.

Author Contributions

Conceptualization, P.L. and J.H.; methodology, P.L. and J.H.; software, P.L. and J.H.; validation, P.L., J.H. and H.L.; formal analysis, J.H.; investigation, P.L. and J.H.; resources, P.L.; data curation, H.L.; writing—original draft preparation, P.L., J.H. and H.L.; writing—review and editing, P.L., J.H. and H.L.; visualization, J.H.; supervision, P.L.; project administration, P.L. and H.L.; funding acquisition, P.L. and H.L. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by National Natural Science Foundation of China (NSFC) grant numbers 62062008 and 82160217, Guangxi Natural Science Foundation grant numbers 2019JJA170045 and 2020GXNSFAA297235, and Innovation Project of Guangxi Graduate Education grant number YCSW2023044.

Data Availability Statement

Data sharing not applicable. No new data were created or analyzed in this study. Data sharing is not applicable to this article.

Conflicts of Interest

The authors declare no conflict of interest.

Abbreviations

The following abbreviations are used in this manuscript:
CAVConnected and Autonomous Vehicle
VECVehicular Edge Computing
V2VVehicle-to-Vehicle
V2IVehicle-to-Infrastructure
APAccess Point

References

  1. Muhammad, K.; Ullah, A.; Lloret, J.; Del Ser, J.; de Albuquerque, V.H.C. Deep learning for safe autonomous driving: Current challenges and future directions. IEEE Trans. Intell. Transp. Syst. 2020, 22, 4316–4336. [Google Scholar] [CrossRef]
  2. Zhang, J. Sensor data validation and driving safety in autonomous driving systems. arXiv 2022, arXiv:2203.16130. [Google Scholar]
  3. Trager, J.; Kalová, L.; Pagany, R.; Dorner, W. Warning apps for road safety: A technological and economical perspective for autonomous driving–the warning task in the transition from human driver to automated driving. Int. J. Hum.-Comput. Interact. 2021, 37, 363–377. [Google Scholar] [CrossRef]
  4. Kumar, V.R.; Yogamani, S.; Rashed, H.; Sitsu, G.; Witt, C.; Leang, I.; Milz, S.; Mäder, P. Omnidet: Surround view cameras based multi-task visual perception network for autonomous driving. IEEE Robot. Autom. Lett. 2021, 6, 2830–2837. [Google Scholar] [CrossRef]
  5. Parekh, D.; Poddar, N.; Rajpurkar, A.; Chahal, M.; Kumar, N.; Joshi, G.P.; Cho, W. A review on autonomous vehicles: Progress, methods and challenges. Electronics 2022, 11, 2162. [Google Scholar] [CrossRef]
  6. Lopac, N.; Jurdana, I.; Brnelić, A.; Krljan, T. Application of laser systems for detection and ranging in the modern road transportation and maritime sector. Sensors 2022, 22, 5946. [Google Scholar] [CrossRef]
  7. Hou, W.; Li, W.; Li, P. Fault diagnosis of the autonomous driving perception system based on information fusion. Sensors 2023, 23, 5110. [Google Scholar] [CrossRef]
  8. Yang, Q.; Fu, S.; Wang, H.; Fang, H. Machine-learning-enabled cooperative perception for connected autonomous vehicles: Challenges and opportunities. IEEE Netw. 2021, 35, 96–101. [Google Scholar] [CrossRef]
  9. Liu, S.; Liu, L.; Tang, J.; Yu, B.; Wang, Y.; Shi, W. Edge computing for autonomous driving: Opportunities and challenges. Proc. IEEE 2019, 107, 1697–1716. [Google Scholar] [CrossRef]
  10. Lu, S.; Shi, W. The emergence of vehicle computing. IEEE Internet Comput. 2021, 25, 18–22. [Google Scholar] [CrossRef]
  11. Liu, L.; Chen, C.; Pei, Q.; Maharjan, S.; Zhang, Y. Vehicular edge computing and networking: A survey. Mob. Netw. Appl. 2021, 26, 1145–1168. [Google Scholar] [CrossRef]
  12. Zhang, J.; Guo, H.; Liu, J.; Zhang, Y. Task offloading in vehicular edge computing networks: A load-balancing solution. IEEE Trans. Veh. Technol. 2019, 69, 2092–2104. [Google Scholar] [CrossRef]
  13. Guo, H.; Rui, L.; Gao, Z. V2V task offloading algorithm with LSTM-based spatiotemporal trajectory prediction model in SVCNs. IEEE Trans. Veh. Technol. 2022, 71, 11017–11032. [Google Scholar] [CrossRef]
  14. Wang, H.; Lv, T.; Lin, Z.; Zeng, J. Energy-delay minimization of task migration based on game theory in MEC-assisted vehicular networks. IEEE Trans. Veh. Technol. 2022, 71, 8175–8188. [Google Scholar] [CrossRef]
  15. Zhang, D.; Cao, L.; Zhu, H.; Zhang, T.; Du, J.; Jiang, K. Task offloading method of edge computing in internet of vehicles based on deep reinforcement learning. Clust. Comput. 2022, 25, 1175–1187. [Google Scholar] [CrossRef]
  16. Ye, Q.; Shi, W.; Qu, K.; He, H.; Zhuang, W.; Shen, X.S. Learning-based computing task offloading for autonomous driving: A load balancing perspective. In Proceedings of the IEEE International Conference on Communications (ICC), Montreal, QC, Canada, 14–23 June 2021; pp. 1–6. [Google Scholar]
  17. Jang, J.; Tulkinbekov, K.; Kim, D.H. Task offloading of deep learning services for autonomous driving in mobile edge computing. Electronics 2023, 12, 3223. [Google Scholar] [CrossRef]
  18. Pliatsios, D.; Sarigiannidis, P.; Lagkas, T.D.; Argyriou, V.; Boulogeorgos, A.A.A.; Baziana, P. Joint wireless resource and computation offloading optimization for energy efficient internet of vehicles. IEEE Trans. Green Commun. Netw. 2022, 6, 1468–1480. [Google Scholar] [CrossRef]
  19. Ku, Y.J.; Baidya, S.; Dey, S. Uncertainty-aware task offloading for multi-vehicle perception fusion over vehicular edge computing. IEEE Trans. Veh. Technol. 2023, 1–16, early access. [Google Scholar] [CrossRef]
  20. Ghorai, P.; Eskandarian, A.; Kim, Y.K.; Mehr, G. State estimation and motion prediction of vehicles and vulnerable road users for cooperative autonomous driving: A survey. IEEE Trans. Intell. Transp. Syst. 2022, 23, 16983–17002. [Google Scholar] [CrossRef]
  21. Yuan, Y.; Cheng, H.; Sester, M. Keypoints-based deep feature fusion for cooperative vehicle detection of autonomous driving. IEEE Robot. Autom. Lett. 2022, 7, 3054–3061. [Google Scholar] [CrossRef]
  22. Lei, Z.; Ren, S.; Hu, Y.; Zhang, W.; Chen, S. Latency-aware collaborative perception. In Proceedings of the 17th European Conference on Computer Vision (ECCV), Tel Aviv, Israel, 23–27 October 2022; pp. 316–332. [Google Scholar]
  23. Zhou, P.; Kortoçi, P.; Yau, Y.P.; Finley, B.; Wang, X.; Braud, T.; Lee, L.H.; Tarkoma, S.; Kangasharju, J.; Hui, P. AICP: Augmented informative cooperative perception. IEEE Trans. Intell. Transp. Syst. 2022, 23, 22505–22518. [Google Scholar] [CrossRef]
  24. Ahmed, M.; Raza, S.; Mirza, M.A.; Aziz, A.; Khan, M.A.; Khan, W.U.; Li, J.; Han, Z. A survey on vehicular task offloading: Classification, issues, and challenges. J. King Saud Univ. Comput. Inf. Sci. 2022, 34, 4135–4162. [Google Scholar] [CrossRef]
  25. Lv, P.; Xu, W.; Nie, J.; Yuan, Y.; Cai, C.; Chen, Z.; Xu, J. Edge computing task offloading for environmental perception of autonomous vehicles in 6G networks. IEEE Trans. Netw. Sci. Eng. 2023, 10, 1228–1245. [Google Scholar] [CrossRef]
  26. Xiao, Z.; Shu, J.; Jiang, H.; Min, G.; Chen, H.; Han, Z. Perception task offloading with collaborative computation for autonomous driving. IEEE J. Sel. Areas Commun. 2023, 41, 457–473. [Google Scholar] [CrossRef]
  27. Krijestorac, E.; Memedi, A.; Higuchi, T.; Ucar, S.; Altintas, O.; Cabric, D. Hybrid vehicular and cloud distributed computing: A case for cooperative perception. In Proceedings of the IEEE Global Communications Conference (GLOBECOM), Taipei, Taiwan, China, 7–11 December 2020; pp. 1–6. [Google Scholar]
  28. Feng, W.; Zhang, N.; Li, S.; Lin, S.; Ning, R.; Yang, S.; Gao, Y. Latency minimization of reverse offloading in vehicular edge computing. IEEE Trans. Veh. Technol. 2022, 71, 5343–5357. [Google Scholar] [CrossRef]
  29. Jin, Z.; Zhang, C.; Zhao, G.; Jin, Y.; Zhang, L. A context-aware task offloading scheme in collaborative vehicular edge computing systems. KSII Trans. Internet Inf. Syst. 2021, 15, 383–403. [Google Scholar]
  30. Sun, Y.; Guo, X.; Song, J.; Zhou, S.; Jiang, Z.; Liu, X.; Niu, Z. Adaptive learning-based task offloading for vehicular edge computing systems. IEEE Trans. Veh. Technol. 2019, 68, 3061–3074. [Google Scholar] [CrossRef]
  31. Li, M.; Gao, J.; Zhao, L.; Shen, X. Adaptive computing scheduling for edge-assisted autonomous driving. IEEE Trans. Veh. Technol. 2021, 70, 5318–5331. [Google Scholar] [CrossRef]
  32. Qin, Z.; Leng, S.; Zhou, J.; Mao, S. Collaborative edge computing and caching in vehicular networks. In Proceedings of the IEEE Wireless Communications and Networking Conference (WCNC), Seoul, Republic of Korea, 25–28 May 2020; pp. 1–6. [Google Scholar]
  33. Liu, Z.; Dai, P.; Xing, H.; Yu, Z.; Zhang, W. A distributed algorithm for task offloading in vehicular networks with hybrid fog/cloud computing. IEEE Trans. Syst. Man Cybern. Syst. 2021, 52, 4388–4401. [Google Scholar] [CrossRef]
  34. Chen, C.; Zeng, Y.; Li, H.; Liu, Y.; Wan, S. A multihop task offloading decision model in MEC-enabled internet of vehicles. IEEE Internet Things J. 2022, 10, 3215–3230. [Google Scholar] [CrossRef]
  35. Ju, Y.; Chen, Y.; Cao, Z.; Wang, H.; Liu, L.; Pei, Q.; Kumar, N. Learning based and physical-layer assisted secure computation offloading in vehicular spectrum sharing networks. In Proceedings of the IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS), Virtual, 2–5 May 2022; pp. 1–6. [Google Scholar]
  36. Javed, M.A.; Zeadally, S. AI-empowered content caching in vehicular edge computing: Opportunities and challenges. IEEE Netw. 2021, 35, 109–115. [Google Scholar] [CrossRef]
  37. Ma, C.; Zhu, J.; Liu, M.; Zhao, H.; Liu, N.; Zou, X. Parking edge computing: Parked-vehicle-assisted task offloading for urban VANETs. IEEE Internet Things J. 2021, 8, 9344–9358. [Google Scholar] [CrossRef]
Figure 1. System architecture of vehicular edge computing.
Figure 1. System architecture of vehicular edge computing.
Electronics 12 03714 g001
Figure 2. A comparison of the task offloading architecture. (a) Traditional scheme. The offloaded task result is returned to the vehicle that generated the task, and the vehicle is responsible for delivering the results. (b) The proposed scheme. The offloaded task result is delivered by the edge server directly.
Figure 2. A comparison of the task offloading architecture. (a) Traditional scheme. The offloaded task result is returned to the vehicle that generated the task, and the vehicle is responsible for delivering the results. (b) The proposed scheme. The offloaded task result is delivered by the edge server directly.
Electronics 12 03714 g002
Figure 3. Perception task model.
Figure 3. Perception task model.
Electronics 12 03714 g003
Figure 4. The requiring areas for the task offloading result in the straight road scenario. (a) The requiring areas for the front-side environmental information. (b) The requiring areas for the left-side environmental information. (c) The requiring areas for the rear-side environmental information. (d) The requiring areas for the right-side environmental information.
Figure 4. The requiring areas for the task offloading result in the straight road scenario. (a) The requiring areas for the front-side environmental information. (b) The requiring areas for the left-side environmental information. (c) The requiring areas for the rear-side environmental information. (d) The requiring areas for the right-side environmental information.
Electronics 12 03714 g004
Figure 5. The requiring areas for the task offloading result in the intersection scenario. (a) The requiring areas for the front-side environmental information. (b) The requiring areas for the left-side environmental information. (c) The requiring areas for the rear-side environmental information. (d) The requiring areas for the right-side environmental information.
Figure 5. The requiring areas for the task offloading result in the intersection scenario. (a) The requiring areas for the front-side environmental information. (b) The requiring areas for the left-side environmental information. (c) The requiring areas for the rear-side environmental information. (d) The requiring areas for the right-side environmental information.
Electronics 12 03714 g005
Figure 6. Impact of the value of β on average delay.
Figure 6. Impact of the value of β on average delay.
Electronics 12 03714 g006
Figure 7. Impact of the number of vehicles on average delay.
Figure 7. Impact of the number of vehicles on average delay.
Electronics 12 03714 g007
Figure 8. The shareability factor in an intersection scenario.
Figure 8. The shareability factor in an intersection scenario.
Electronics 12 03714 g008
Figure 9. The shareability factor in a straight road scenario.
Figure 9. The shareability factor in a straight road scenario.
Electronics 12 03714 g009
Table 1. Experimental parameters.
Table 1. Experimental parameters.
ParameterValueDenotation
Bandwidth for V2I40 MHz [12] B v 2 i
Bandwidth for V2V10 MHZ [34] B v 2 v
Transmission power for uplink23 dBm [28] P r
Transmission power for downlink33 dBm [28] P d
Transmission power for V2V10 dBm [35] P v
Noise power−100 dBm [12]N
Path loss index3 α
Size of task1–3 MBl
Ratio of result size to task size0.001–0.01 β
Maximum tolerable latency100 ms [36] Δ
Server computing frequency8 GHz [37]F
Compute capacity10 period/bitC
Simulation scenariostraight; intersection
The coverage range of an AP200 m
The size of a requiring area100 m × 4 m
The size of traffic flow { 1000 , 1250 , 1500 , 1750 , 2000 } veh/h
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Lv, P.; Huang, J.; Liu, H. Cooperative Environmental Perception Task Offloading for Connected and Autonomous Vehicles. Electronics 2023, 12, 3714. https://doi.org/10.3390/electronics12173714

AMA Style

Lv P, Huang J, Liu H. Cooperative Environmental Perception Task Offloading for Connected and Autonomous Vehicles. Electronics. 2023; 12(17):3714. https://doi.org/10.3390/electronics12173714

Chicago/Turabian Style

Lv, Pin, Jie Huang, and Heng Liu. 2023. "Cooperative Environmental Perception Task Offloading for Connected and Autonomous Vehicles" Electronics 12, no. 17: 3714. https://doi.org/10.3390/electronics12173714

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop