Next Article in Journal
Fast and Accurate Approximation Methods for Trigonometric and Arctangent Calculations for Low-Performance Computers
Next Article in Special Issue
An Extra-Contrast Affinity Network for Facial Expression Recognition in the Wild
Previous Article in Journal
A Spatio-Temporal Feature Trajectory Clustering Algorithm Based on Deep Learning
Previous Article in Special Issue
Batch-Wise Permutation Feature Importance Evaluation and Problem-Specific Bigraph for Learn-to-Branch
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Driving Intention Inference Based on a Deep Neural Network with Dropout Regularization from Adhesion Coefficients in Active Collision Avoidance Control Systems

1
School of Electrical and Electronic Engineering, Changchun University of Technology, Changchun 130012, China
2
Faculty of Transportation Engineering, Kunming University of Science and Technology, Kunming 650500, China
*
Author to whom correspondence should be addressed.
Electronics 2022, 11(15), 2284; https://doi.org/10.3390/electronics11152284
Submission received: 23 June 2022 / Revised: 12 July 2022 / Accepted: 19 July 2022 / Published: 22 July 2022
(This article belongs to the Special Issue Analog AI Circuits and Systems)

Abstract

:
Driving intention, which can assist drivers to avoid dangerous emergence for the advanced driver assistant systems (ADAS), can be hardly described accurately for complex traffic environments. At present, driving intention can be mainly obtained by deep neural networks with neuromuscular dynamics and electromyography (EMG) signals of drivers. This method needs numerous drivers’ signals and neural networks with a complex structure. This paper proposes a driving intention direct inference method, namely direct inference from the road surface condition. A driving intention safety distance model based on a deep neural network with dropout regularization was built in an active collision avoidance control system of electric vehicles. Driving intention can be inferred by a deep neural network with dropout regularization from adhesion coefficients between the tire and road. Simulations using rapid control prototyping (RCP) and a hardware-in-the-loop (HIL) simulator were performed to demonstrate the effectiveness of the proposed driving intention safety distance model based on a deep neural network with dropout regularization. The proposed driving intention safety distance model can guarantee the safe driving of electric vehicles.

1. Introduction

1.1. Motivation

Vehicle safety is always the primary task and the premise of vehicle research and design in the intelligent transportation system (ITS) [1]. Numerous studies focus on active collision avoidance control systems to improve vehicle safety for the advanced driver assistant system (ADAS). It mainly contains the following modules: perception and processing of driving information [2], safety distance calculation and safety state judgement [3], vehicle dynamics and control [4], and control command execution and power transmission [5]. The overall system architecture of the active collision avoidance control system can be summarized as shown in Figure 1. The safety distance model plays an important role in vehicle safety and traffic utilization for the active collision avoidance control system. Safety distance models can be divided into three types [2], namely the kinematics-based safety distance model, vehicle-to-vehicle distance-based safety distance model, and driver’s characteristics-based safety distance model. Although the safety distance models have been improved continuously, there are still some problems to be solved, such as the low accuracy, the lock of drivers’ characteristics, and the poor adaptability of a complex traffic environment.

1.2. Related Works

In recent years, the driver’s characteristics-based safety distance model was given more and more attention by researchers for active collision avoidance control systems. For the driver’s characteristics-based safety distance model, existing studies mainly focus on driving intention inference [6,7]. Based on different criteria, driving intention inference can be divided two aspects: maneuver input inference and tactical behavior decision inference [6]. Maneuver inputs can be inferred for low-level controllers and tactical behavior decisions can be inferred for high-level controllers in the hierarchical active collision avoidance control system.
This paper mainly focuses on the driving intention inference of tactical behavior decisions. Most approaches were investigated and the technology of the complex sensor fusion and data coordination was used for obtaining driving intention [6]. Driving intention inference has been grouped into three parts [8]: The first part is physics-based intention inference, which describes vehicles with dynamic and kinematic models by the laws of physics. Dynamic models, which can describe vehicle motion with Lagrange mechanics, can become extremely large and involve many internal parameters of the vehicle. By contrast, kinematic models are simpler and use more extensive data for trajectory prediction. Physics-based intention inference is only suitable for short-term motion inference, therefore this kind of model is unable to anticipate any change in the motion of the car without drivers’ characteristics. The second part is maneuver-based intention inference, which describes vehicles as independent maneuvering entities. It can obtain more relevant and reliable trajectories than the ones obtained from physics-based intention inference. The Hidden Markov Model (HMMs) and the model based on fuzzy reasoning are two widely used methods. An intention predication model based on attribute-driven Hidden Markov Model Trees is proposed for intention prediction [9]. An efficient recognition approach based on Non-linear Polynomial Regression (NPR) and the Recurrent Hidden Semi-Markov Model (R-HSMM) is proposed to accurately recognize the driver lane-change intention in the early stage [10]. HMMs can only focus on current driving behaviors rather than past driving behaviors, although they are widely used for driving intention inference. Fuzzy reasoning methods are a class of experience models, therefore they can obtain a well-quantified driving intention. A fuzzy reasoning-based longitudinal minimum safety distance model was designed with the information on drivers’ intentions and driving circumstance [11]. A fuzzy logic inference system has been applied to identify driving intention for hybrid vehicles. The membership functions and rules of the fuzzy logic inference system are built for intention identification and the simulation is done in different driving conditions [12]. Driving intention inference is affected by the compatibility of different membership functions and fuzzy rules comparing to HMMs. In addition to that, Support Vector Machines (SVMs) [13], Artificial Neural Network (ANN) models [14], and the Bayesian Network (BN) [15] have been developed to infer driving intention. Maneuver-based intention inference disregards the dependence between vehicles, resulting in the wrong judgement of situations. The third part is interaction-aware intention inference, which describes vehicle motion combined with the motion of other vehicles. Compared to maneuver-based intention inference, it can infer driving intention more reasonably resulting from the dependence between vehicles. Dynamic Bayesian Networks (DBN) are exploited widely for interaction-aware intention inference [16,17,18]. Coupled Hidden Markov models (CHMMs) can also be used with pairwise dependencies between other vehicles [19,20]. Apart from that, the development of deep neural networks provides a good solution for driving intention inference. The task of driving behavior recognition can be regarded as a multi-class classification problem. A multi-stream Convolutional Neural Network (CNN) was employed to extract multi-scale features by filtering images with receptive fields of different kernel sizes and the final decision is generated with different fusion strategies for driving behavior recognition [21]. A novel data-driven modelling methodology was proposed for the lateral stability description of articulated steering vehicles and a Recurrent Neural Network (RNN) model was built to accurately quantify vehicle lateral stability [22]. A long short-term memory (LSTM) network, which is a time cycle neural network, was used to evaluate real-time bus riding comfort and provide driving suggestions [23]. A CNN-LSTM method was proposed to meet the prediction requirements and provide an effective method for the safe operation of unmanned systems [24]. The information on other vehicles is taken into account in interaction-aware intention inference and the obtained driving intention is more consistent with the actual driving conditions. It also brings some disadvantages considering that multi-information fusion results in increased complexity of the model structure, increased computational load, and poor real-time performance.
This paper proposes a driving intention safety distance model based on a deep neural network with dropout regularization. The deep neural network is designed to obtain driving intention directly from the adhesion coefficients between the tire and road. Dropout regularization is utilized to train deep neural networks to prevent the network overfitting problem. The remaining paper is organized as follows: Section 2 proposes a driving intention safety distance model based on a deep neural network with dropout regularization. The deep neural network is validated with random data. Section 3 designs an active collision avoidance control system based on the driving intention safety distance model. Simulation results are presented and discussed. Finally, there is a conclusion regarding research and future works in Section 4.

2. Deep Neural Network-Based Driving Intention Safety Distance

2.1. Driving Intention Safety Distance Modeling

This paper extends and improves the authors’ previous work. The safety distance model can be expressed as follows [2,5]:
d 0 = k d c d + φ f l + φ f r + φ r l + φ r r 4
where φ f l , φ f r , φ r l , and φ r r are the adhesion coefficients of the four tires, respectively. They can describe the road conditions of vehicle driving. In this work, the safety distance model is modeled with the average of the adhesion coefficients for four tires to evaluate and synthetically describe the whole road condition of the driving vehicle. Constants c and d are safety distance model parameters [2,5]. k d > 0 is used to describe driving intention, which is associated with different road conditions, namely the average of the adhesion coefficients. In previous work, k d was set with a fixed constant in the whole driving process [2,5]. Although it can ensure vehicle safety, it is so conservative that road utilization is reduced due to the excessive safety distance. Indeed, k d should be a non-linear function, which is associated with the average of the adhesion coefficients. Therefore, it should be improved as a function that varies with the average of the adhesion coefficient to conform to the drivers’ driving characteristics.

2.2. Driving Intention Deep Neural Network

In terms of deep learning, a hybrid-learning-based driving intention network was employed with neuromuscular dynamics and electromyography (EMG) signals of drivers collected from far-reaching studies [6]. The predication scheme needs to extract some EMG signals from the upper limb, such as the clavicular portion, deltoid anterior, deltoid posterior, triceps, and so forth. With the large amount of data processing and complex structure of the deep neural network, the inferred driving intention would deviate from the actual intention. In this work, a deep neural network is designed from road conditions rather than drivers.
As is known to all, the safety distance model mainly depends on road conditions. Therefore, the road condition is regarded as the only input of the deep neural network and the driving intention is regarded as the output of the deep neural network, which directly reflects the relationship between the road condition and driving intention. To simplify the deep neural network structure, the biases of the nodes are regarded as 0, and the weights are considered in this work. The deep neural network contains 1 input node, 3 hidden layers, and 1 output node, as shown in Figure 2. Each hidden layer has 20 nodes and the sigmoid function is used as the activation function in the hidden layers. The rectified linear unit (ReLU) function is used as the activation function in the output layer. Apart from that, dropout regularization, which can train only some of the randomly selected nodes rather than the entire neural network, is used to prevent the deep neural network from overfitting. It is the most representative solution to prevent overfitting [25]. Some nodes are randomly selected at a certain percentage and their outputs are set to be 0 to deactivate the nodes.

2.3. Simulation Results and Analysis

Based on the experimental results of Yan’s work [26] and (1) [2], driving intention k d can be calculated as training data, which is between 130 and 110, for training the deep neural network under different driving economies, namely the High Way Fuel Economy Test (HWFET) and Urban Dynamometer Driving Schedule (UDDS). The training data of driving intention must to be normalized to the data between 0 and 1 before training the deep neural network. Since the range of adhesion coefficients is between 0 and 1, the training data of driving intention can be directly regarded as the input of the deep neural network, which can be seen in part of the dotted line. In the deep neural network, 3 hidden layers are all designed with 20 nodes, namely W 1 is a matrix by 20 rows and 1 column, W 2 is a matrix by 20 rows and 20 columns, W 3 is a matrix by 20 rows and 20 columns, and W 4 is a matrix by 1 row and 20 columns. The epoch of the deep neural network is set as 4000. W 1 , W 2 , W 3 , and W 4 are set to random numbers between −1 and 1. The learning time of the deep neural network is 73.0213 s. The output of the deep neural network should be also normalized to the actual driving intention range before providing driving intention information for an active collision avoidance control system.
The deep neural network is validated with 20,000 random data and the random data validation curve is shown in Figure 3. In total, 20,000 random data are all between 0 and 1, and the predictive values of the deep neural network are between 110 and 120. The reaction time of the deep neural network is 0.97037 s. Since biases are ignored in this neural network, the driving intention can be inferred quickly. This reaction time, which is faster than drivers’ reaction time, can timely control vehicle safety driving with the active collision avoidance control system. It is suitable for describing drivers’ characteristics. Predictive values deviate slightly from the training data for this deep neural network, resulting from ignored biases. Although there are deviations between the correct output and actual output, the designed deep neural network could infer driving intention. When the adhesion coefficient is small and the road condition is poor, the value of the driving intention is large enough to increase the vehicle-to-vehicle distance to guarantee vehicle safety. On the contrary, when the adhesion coefficient is large and the road condition is good, the value of the driving intention becomes smaller to reduce the vehicle-to-vehicle distance to improve the road utilization rate.

3. Active Collision Avoidance Control System

3.1. Active Collision Avoidance Control System Structure

A four-in-wheel-motor-driven electric vehicle (FIWMD-EV) simulation platform is presented and shown in Figure 4. MicroAutoBoxII;, which is a rapid control prototyping (RCP) device, is used as the simulator of active collision avoidance controllers. The dSPACE HIL simulator is used as the simulator of vehicle dynamics.
The structure diagram of the active collision avoidance control system is shown in Figure 5 and the following vehicle velocity v 1 and vehicle acceleration a 1 are obtained from CarSim 8.02. Leading vehicle velocity v 2 is obtained from ADVISOR 2002. The braking-critical distance and warn-critical distance, which are used to participate in vehicle safety state judgement; upper and lower-level controllers; and dynamics were proposed and presented in authors’ previous work [2,5,26], and are employed again in this paper. Apart from that, different driving roads are set by road characteristic parameters in LuGre dynamic friction models for the four tires. A LuGre dynamic friction model is expressed as follows [27]:
{ z ˙ = v r θ σ 0 | v r | g ( v r ) z κ r | w e | z F x i , j = μ i , j F z i , j = ( σ 0 z + σ 1 z ˙ + σ 2 v r ) F z i , j g ( v r ) = μ c + ( μ s μ c ) e | v r v s | , ( i = 1 : f r o n t , 2 : r e a r j = 1 : l e f t , 2 : r i g h t )
where v r = w e r v 1 is the relative velocity between the wheel velocity and following vehicle velocity; r is the wheel radius; θ is the road characteristic parameter; v s is the Stribeck relation velocity; F x is the longitudinal tire force; F z is the tire normal force; z is the internal friction state of the tire; σ 0 is the normalized rubber longitudinal-lumped stiffness; σ 1 is the normalized rubber longitudinal-lumped damping; σ 2 is the normalized viscous relative damping; μ c is the normalized coulomb friction; and μ s is the normalized static friction. According to (2), the maximum steady-state value of the friction coefficient, which can be represented by the adhesion coefficients of complex roads, can be obtained as follows:
μ s s m = σ 0 v r m θ σ 0 | v r m | g ( v r m ) + κ | v r m + v 1 | + σ 2 v r m
where v r m can be calculated, as mentioned in [5,27]. In this work, θ is set with changing values to represent complex roads.

3.2. Simulation Results and Analysis

According to literature [2], constants c and d , which are the parameters in (1), are determined with general values [2,5], namely c = 2 and d = 0.3 . The safety distance model can be given by (4). A LuGre dynamic friction model and vehicle dynamics parameters are listed in Table 1 and Table 2, respectively. Simulation experiments were performed under a snow and ice road, and a dry asphalt–snow–ice-mixed road, which was realized by setting road characteristic parameter θ in UDDS and HWFET. According to literature [27], road characteristic parameter θ could be set to 1, which can represent a dry asphalt road, and road characteristic parameter θ could be set to 6, which can represent a snow and ice road. Therefore, the road conditions can be set by road characteristic parameter θ in the LuGre dynamic friction model. UDDS and HWFET were used to represent the velocity of the leading vehicle in simulation experiments.
d 0 = 2 k d 0.3 + φ f l + φ f r + φ r l + φ r r 4

3.2.1. UDDS Simulation Experiments

UDDS was selected as the simulation urban road condition in this work. The cycle time was 1367 s; distance traveled was 11.99 km; maximum speed was 91.28 km/h; average speed was 31.51 km/h; maximum acceleration was 1.48 m/s2; maximum deceleration was −1.48 m/s2; and number of stops was 17 [2,5,28].
(1) Snow and ice road simulation experiments
Road characteristic parameter θ can be set to the same values, namely θ = 6 , in order for the left and right tires to represent the snow and ice road condition. As seen in Figure 6a, the road conditions of the left and right tires were the same. The average adhesion coefficient, which is shown in Figure 6b, ias calculated by four adhesion coefficients from the LuGre dynamic friction models of the four tires. With the average adhesion coefficient, driving intention k d can be inferred by the deep neural network. For a FIWMD-EV, the LuGre dynamic friction model can calculate the adhesion coefficient with the road characteristic parameter θ and PMSM speed. Hence, the calculated adhesion coefficient can vary between 0.0 and 0.2 due to the change of the PMSM speed. The average adhesion coefficient provides road surface information for the deep neural network to infer driving intention. Compared to the change trends in Figure 6b,c, the variation trend of driving intention is opposite to that of the average adhesion coefficient. That is to say, when the average adhesion coefficient is small, the driving intention is large, and vice versa; it conforms to drivers’ driving habits. Acceleration closed-loop curves are shown in Figure 6d and actual acceleration can basically track the desired acceleration in the whole driving process. The actual acceleration curve fluctuated once at about 170 s, which was mainly caused by the average adhesion coefficient fluctuation, resulting in the fluctuation of driving intention. The fluctuation can immediately disappear due to acceleration closed-loop control, namely the adjustment action of the lower-level controller. Longitudinal velocities of the leading and following vehicles are shown in Figure 6e, and the vehicle-to-vehicle distance and safety distance are shown in Figure 6f. Actual vehicle-to-vehicle distance is basically greater than the safe distance and safe distance is greater than 400 m. This demonstrates that electric vehicles can drive safely and the proposed driving intention safety distance model is reasonable, feasible, and effective in UDDS.
(2) Dry asphalt–snow–ice-mixed road simulation experiments
Road characteristic parameter θ can be set to different values in order for the left and right tires to represent the different road conditions. As seen in Figure 7a, the road conditions of the left and right tires had the same situation but also different situations. The road conditions of the left and right tires included a dry asphalt road as well as a snow and ice road. Therefore, they can represent all the road conditions encountered by tires. The average adhesion coefficient, which is shown in Figure 7b, was calculated by the four adhesion coefficients from the LuGre dynamic friction models of the four tires. With the average adhesion coefficient, driving intention k d can be inferred by the deep neural network. The calculated adhesion coefficient can vary between 0.0 and 1.0 due to the change of the PMSM speed. Figure 7c,d show the adhesion coefficients of the four tires. The adhesion coefficients of the left tires are the same as that of the right tires. Furthermore, the values of the adhesion coefficients of the four tires cover all road conditions, namely a dry asphalt road as well as a snow and ice road. They can provide adequate road surface information for the deep neural network to infer driving intention. Compared to the change trends in Figure 7b,e, the variation trend of the driving intention is opposite to that of the average adhesion coefficient. That is to say, when the average adhesion coefficient is small, the driving intention is large, and vice versa; it also conforms to drivers’ driving habits. Acceleration closed-loop curves are shown in Figure 7f and actual acceleration can basically track the desired acceleration in the whole driving process. The actual acceleration curve fluctuated once at about 180 s, which was mainly caused by the road condition changes of the left and right tires. The fluctuation can immediately disappear due to acceleration closed-loop control. Longitudinal velocities of the leading and following vehicles are shown in Figure 7g, and the vehicle-to-vehicle distance and safety distance are shown in Figure 7h. The actual vehicle-to-vehicle distance is greater than the safe distance and the safe distance is greater than 180 m. This also demonstrates that electric vehicles can drive safely and the proposed driving intention safety distance model is reasonable, feasible, and effective in UDDS.

3.2.2. HWFET Simulation Experiments

HWFET was also selected as the simulation highway condition in this work. The cycle time was 765 s; distance traveled was 16.51 km; maximum speed was 96.4 km/h; average speed was 77.58 km/h; maximum acceleration was 1.43 m/s2; maximum deceleration was −1.48 m/s2; and number of stops was 1 [2,5,28].
(1) Snow and ice road simulation experiments
Road characteristic parameter θ can be also set to the same values, namely θ = 6 , for the left and right tires to represent a snow and ice road condition. As seen in Figure 8a, the road conditions of the left and right tires were the same. The average adhesion coefficient, which is shown in Figure 8b, was calculated by four adhesion coefficients from the LuGre dynamic friction models of the four tires. With the average adhesion coefficient, driving intention k d can be inferred by the deep neural network. The calculated adhesion coefficient can vary between 0.0 and 0.2 due to the change of the PMSM speed. The average adhesion coefficient provides road surface information for the deep neural network to infer driving intention. Compared to the change trends in Figure 8b,c, the variation trend of driving intention is opposite to that of the average adhesion coefficient. That is to say, when the average adhesion coefficient is small, the driving intention is large, and vice versa; it also conforms to drivers’ driving habits. Acceleration closed-loop curves are shown in Figure 8d and actual acceleration can basically track the desired acceleration in the whole driving process. Longitudinal velocities of the leading and following vehicles are shown in Figure 8e, and the vehicle-to-vehicle distance and safety distance are shown in Figure 8f. The actual vehicle-to-vehicle distance is greater than the safe distance and the safe distance is greater than 480 m. This demonstrates that electric vehicles can drive safely and the proposed driving intention safety distance model is reasonable, feasible, and effective in HWFET.
(2) Dry asphalt–snow–ice-mixed road simulation experiments
Road characteristic parameter θ can be also set to different values in order for the left and right tires to represent the different road conditions. As seen in Figure 9a, the road conditions of the left and right tires had the same situation but also different situations. The road conditions of the left and right tires included a dry asphalt road as well as a snow and ice road. Therefore, they can represent all the road conditions encountered by tires. The average adhesion coefficient, which is shown in Figure 9b, was calculated by four adhesion coefficients from the LuGre dynamic friction models of the four tires. With the average adhesion coefficient, driving intention k d can be inferred by the deep neural network. The calculated adhesion coefficient can vary between 0.0 and 1.0 due to the change of the PMSM speed. Figure 9c,d show the adhesion coefficients of the four tires. The adhesion coefficients of the left tires are the same as that of the right tires. Furthermore, the values of the adhesion coefficients of the four tires cover all road conditions, namely a dry asphalt road as well as a snow and ice road. They can provide adequate road surface information for the deep neural network to infer driving intention. Compared to the change trends in Figure 9b,e, the variation trend of driving intention is opposite to that of the average adhesion coefficient. That is to say, when the average adhesion coefficient is small, the driving intention is large, and vice versa; it also conforms to drivers’ driving habits. Acceleration closed-loop curves are shown in Figure 9f and actual acceleration can basically track the desired acceleration in the whole driving process. The actual acceleration curve fluctuated once at about 180 s, which was mainly caused by the road condition changes of the left and right tires. The fluctuation can also immediately disappear due to acceleration closed-loop control. Longitudinal velocities of the leading and following vehicles are shown in Figure 9g, and the vehicle-to-vehicle distance and safety distance are shown in Figure 9h. The actual vehicle-to-vehicle distance is basically greater than the safe distance and the safe distance is greater than 180 m. This demonstrates that electric vehicles can drive safely and the proposed driving intention safety distance model is also reasonable, feasible, and effective in HWFET.

4. Conclusions

This paper has presented a driving intention safety distance model based on a deep neural network with dropout regularization in an active collision avoidance system. With the information on the average adhesion coefficient of the four tires, the deep neural network with one input, three hidden, and one output layer can directly infer driving intention. The effectiveness in the control scheme, simplicity in structure, and flexibility in implementation have been verified through simulation experiments under different driving conditions using the RCP and HIL simulator. The proposed driving intention safety distance model can guarantee the safe driving of electric vehicles. In this work, the biases of the nodes were regarded as 0. Therefore, the deep neural network structure is simplified and the computational burden is reduced. Furthermore, driving intention can be calculated by a single control unit, namely the active collision avoidance controller, rather than by an upper-layer network platform.
In addition, to simplify the deep neural network structure, the biases of the nodes were regarded as 0 and the weights were not considered in this work. Although the deep neural network can infer driving intention and the vehicle can drive safely, there is still some deviation between the inferred driving intention and actual driving intention resulting from the ignoring of the bias in the deep neural network. This needs to be further improved. This work will be further improved in future work.

Author Contributions

Conceptualization, Y.L. and S.L.; methodology, Z.S.; software, B.L. and J.H.; validation, Y.L., S.L. and Z.S.; formal analysis, Y.L.; investigation, Z.N.; resources, Z.S.; data curation, Y.L. and J.H.; writing—original draft preparation, Y.L.; writing—review and editing, Y.L.; visualization, Y.L.; supervision, Z.N.; project administration, S.L. and B.L.; funding acquisition, S.L. and B.L. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the National Natural Science Foundation of China, grant number 62106023, Science and Technology Development Project of Jilin Province, grant number 20210201106GX, and Science and Technology Project of Jilin Province Education Department, grant number JJKH20210746KJ.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Yu, K.; Lin, L.; Alazab, M.; Tan, L.; Gu, B. Deep learning-based traffic safety solution for a mixture of autonomous and manual vehicles in a 5G-enabled intelligent transportation system. IEEE Trans. Intell. Transp. Syst. 2021, 22, 4337–4347. [Google Scholar] [CrossRef]
  2. Lian, Y.; Zhao, Y.; Hu, L.; Tian, Y. Longitudinal collision avoidance control of electric vehicles based on a new safety distance model and constrained-regenerative-braking-strength-continuity braking force distribution strategy. IEEE Trans. Veh. Technol. 2016, 65, 4079–4094. [Google Scholar] [CrossRef]
  3. Lian, Y.; Wang, X.; Tian, Y.; Liu, K. Lateral collision avoidance robust control of electric vehicles combining a lane-changing model based on vehicle edge turning trajectory and a vehicle semi-uncertainty dynamic model. Int. J. Automot. Technol. 2018, 19, 331–343. [Google Scholar] [CrossRef]
  4. Noei, S.; Parvizimosaed, M.; Noei, M. Longitudinal control for connected and automated vehicles in contested environments. Electronics 2021, 10, 1994. [Google Scholar] [CrossRef]
  5. Lian, Y.; Liu, S.; Sun, Z.; Liu, K.; Nie, Z.; Tian, C. A braking force distribution strategy for four-in-wheel-motor-driven electric vehicles on roads with different friction coefficients. Int. J. Automot. Technol. 2021, 22, 1057–1073. [Google Scholar] [CrossRef]
  6. Xing, Y.; Lv, C.; Liu, Y.; Zhao, Y.; Cao, D.; Kawahara, S. Hybrid-learning-based driver steering intention prediction using neuromuscular dynamics. IEEE Trans. Ind. Electron. 2022, 69, 1750–1761. [Google Scholar] [CrossRef]
  7. Li, L.; Zhao, W.; Xu, C.; Wang, C.; Chen, Q.; Dai, S. Lane-change intention inference based on RNN for autonomous driving on highways. IEEE Trans. Veh. Technol. 2021, 70, 5499–5510. [Google Scholar] [CrossRef]
  8. Lefèvre, S.; Vasquez, D.; Laugier, C. A survey on motion prediction and risk assessment for intelligent vehicles. Robomech J. 2014, 1, 1. [Google Scholar] [CrossRef] [Green Version]
  9. Antwarg, L.; Rokach, L.; Shapira, B. Attribute-driven hidden Markov model trees for intention prediction. IEEE Trans. Syst. Man Cybern. C Appl. Rev. 2012, 42, 1103–1119. [Google Scholar] [CrossRef] [Green Version]
  10. Liu, Q.; Xu, S.; Lu, C.; Yao, H.; Chen, H. Early recognition of driving intention for lane change based on recurrent hidden semi-Markov model. IEEE Trans. Veh. Technol. 2020, 69, 10545–10557. [Google Scholar] [CrossRef]
  11. Wu, H.; Li, Y.; Wu, C.; Ma, Z.; Zhou, H. A longitudinal minimum safety distance model based on driving intention and fuzzy reasoning. In Proceedings of the 2017 4th International Conference on Transportation Information and Safety (ICTIS), Banff, AB, Canada, 8–10 August 2017; pp. 158–162. [Google Scholar]
  12. Tang, X.; Wang, Q. Driving intention intelligent identification method for hybrid vehicles based on fuzzy logic inference. In Proceedings of the 2010 International Symposium on Computational Intelligence and Design, Hangzhou, China, 29–31 October 2010; pp. 16–19. [Google Scholar]
  13. Gong, X.; Guo, P.; Li, X. Research on key technologies of driving intention identification for commercial vehicle based on HMM-SVM. In Proceedings of the 2019 Chinese Automation Congress (CAC), Hangzhou, China, 22–24 November 2019; pp. 4941–4946. [Google Scholar]
  14. Behbahani, H.; Hosseini, S.M.; Samerei, S.A. Driving time prediction at freeway interchanges using artificial neural network and particle swarm optimization. Iran. J. Sci. Technol. Trans. Civ. Eng. 2020, 44, 975–989. [Google Scholar] [CrossRef]
  15. Zhao, C.; Zhang, B.; He, J. Vision-based classification of driving postures by efficient feature extraction and Bayesian approach. J. Intell. Robot. Syst. 2013, 72, 483–495. [Google Scholar] [CrossRef]
  16. He, G.; Li, X.; Lv, Y.; Gao, B.; Chen, H. Probabilistic intention prediction and trajectory generation based on dynamic bayesian networks. In Proceedings of the 2019 Chinese Automation Congress (CAC), Hangzhou, China, 22–24 November 2019; pp. 2646–2651. [Google Scholar]
  17. Kafai, M.; Bhanu, B. Dynamic Bayesian networks for vehicle classification in video. IEEE Trans. Ind. Inform. 2012, 8, 100–109. [Google Scholar] [CrossRef] [Green Version]
  18. Li, F.; Wang, W.; Feng, G.; Guo, W. Driving Intention Inference Based on Dynamic Bayesian Networks; Springer: Berlin/Heidelberg, Germany, 2014; pp. 1109–1119. [Google Scholar]
  19. Brand, M.; Oliver, N.; Pentland, A. Coupled hidden Markov models for complex action recognition. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Juan, PR, USA, 17–19 June 1997; pp. 994–999. [Google Scholar]
  20. Ren, H.; Xu, G. Human action recognition with primitive-based coupled-HMM. In Proceedings of the 2002 International Conference on Pattern Recognition, Quebec City, QC, Canada, 11–15 August 2002; pp. 494–498. [Google Scholar]
  21. Hu, Y.; Lu, M.; Lu, X. Driving behaviour recognition from still images by using multi-stream fusion CNN. Mach. Vis. Appl. 2019, 30, 851–865. [Google Scholar] [CrossRef]
  22. Chen, X.; Chen, W.; Hou, L.; Hu, H.; Bu, X.; Zhu, Q. A novel data-driven rollover risk assessment for articulated steering vehicles using RNN. J. Mech. Sci. Technol. 2020, 34, 2161–2170. [Google Scholar] [CrossRef]
  23. Zeng, L.; Zhang, H.; Han, Q.; Tang, Y.; Ye, L.; Wu, Y.; Zu, H. An LSTM-based driving operation suggestion method for riding comfort-oriented critical zone. J. Ambient. Intell. Humaniz. Comput. 2021. [Google Scholar] [CrossRef]
  24. Xie, G.; Shangguan, A.; Fei, R.; Ji, W.; Ma, W.; Hei, X. Motion trajectory prediction based on a CNN-LSTM sequential model. Sci. China Inf. Sci. 2020, 63, 212207. [Google Scholar] [CrossRef]
  25. Kim, P. Deep Learning. In MATLAB Deep Learning with Machine Learning, Neural Networks and Artificial Intelligence; Apress: Seoul, Korea, 2017; pp. 103–120. [Google Scholar]
  26. Nam, K.; Fujimoto, H.; Hori, Y. Lateral stability control of in-wheel-motor-driven electric vehicles based on sideslip angle estimation using lateral tire force sensors. IEEE Trans. Veh. Technol. 2012, 61, 1972–1985. [Google Scholar]
  27. Zhao, Y.; Tian, Y.; Lian, Y.; Hu, L. A sliding mode observer of road condition estimation for four-wheel-independent-drive electric vehicles. In Proceeding of the 11th World Congress on Intelligent Control and Automation, Shenyang, China, 29 June–4 July 2014; pp. 4390–4395. [Google Scholar]
  28. Shi, Q. Key Technologies Research on Energy Management Problems of Pure Electric Vehicles. Ph.D. Dissertation, Shandong University, Jinan, China, 2009. [Google Scholar]
Figure 1. The overall system architecture of active collision avoidance control system.
Figure 1. The overall system architecture of active collision avoidance control system.
Electronics 11 02284 g001
Figure 2. Deep neural network with 3 hidden layers.
Figure 2. Deep neural network with 3 hidden layers.
Electronics 11 02284 g002
Figure 3. Random data validation for deep neural network.
Figure 3. Random data validation for deep neural network.
Electronics 11 02284 g003
Figure 4. Hardware platform of the active collision avoidance control system.
Figure 4. Hardware platform of the active collision avoidance control system.
Electronics 11 02284 g004
Figure 5. Structure diagram of the active collision avoidance system.
Figure 5. Structure diagram of the active collision avoidance system.
Electronics 11 02284 g005
Figure 6. Snow and ice road experiments in UDDS with deep neural network. (a) Road characteristic parameter of left and right tires. (b) Average adhesion coefficient. (c) Driving intention. (d) Acceleration of following vehicle. (e) Longitudinal velocities of leading and following vehicles. (f) Vehicle-to-vehicle distance and actual distance.
Figure 6. Snow and ice road experiments in UDDS with deep neural network. (a) Road characteristic parameter of left and right tires. (b) Average adhesion coefficient. (c) Driving intention. (d) Acceleration of following vehicle. (e) Longitudinal velocities of leading and following vehicles. (f) Vehicle-to-vehicle distance and actual distance.
Electronics 11 02284 g006
Figure 7. Dry asphalt–snow–ice-mixed road experiments in UDDS with deep neural network. (a) Road characteristic parameter of left and right tires. (b) Average adhesion coefficient. (c) Adhesion coefficients of front tires. (d) Adhesion coefficients of rear tires. (e) Driving intention. (f) Acceleration of following vehicle. (g) Longitudinal velocities of leading and following vehicles. (h) Vehicle-to-vehicle distance and actual distance.
Figure 7. Dry asphalt–snow–ice-mixed road experiments in UDDS with deep neural network. (a) Road characteristic parameter of left and right tires. (b) Average adhesion coefficient. (c) Adhesion coefficients of front tires. (d) Adhesion coefficients of rear tires. (e) Driving intention. (f) Acceleration of following vehicle. (g) Longitudinal velocities of leading and following vehicles. (h) Vehicle-to-vehicle distance and actual distance.
Electronics 11 02284 g007aElectronics 11 02284 g007b
Figure 8. Snow and ice road experiments in HWFET with deep neural network. (a) Road characteristic parameter of left and right tires. (b) Average adhesion coefficient. (c) Driving intention. (d) Acceleration of following vehicle. (e) Longitudinal velocities of leading and following vehicles. (f) Vehicle-to-vehicle distance and actual distance.
Figure 8. Snow and ice road experiments in HWFET with deep neural network. (a) Road characteristic parameter of left and right tires. (b) Average adhesion coefficient. (c) Driving intention. (d) Acceleration of following vehicle. (e) Longitudinal velocities of leading and following vehicles. (f) Vehicle-to-vehicle distance and actual distance.
Electronics 11 02284 g008
Figure 9. Dry asphalt–snow–ice-mixed road experiments in HWFET with deep neural network. (a) Road characteristic parameter of left and right tires. (b) Average adhesion coefficient. (c) Adhesion coefficients of front tires. (d) Adhesion coefficients of rear tires. (e) Driving intention. (f) Acceleration of following vehicle. (g) Longitudinal velocities of leading and following vehicles. (h) Vehicle-to-vehicle distance and actual distance.
Figure 9. Dry asphalt–snow–ice-mixed road experiments in HWFET with deep neural network. (a) Road characteristic parameter of left and right tires. (b) Average adhesion coefficient. (c) Adhesion coefficients of front tires. (d) Adhesion coefficients of rear tires. (e) Driving intention. (f) Acceleration of following vehicle. (g) Longitudinal velocities of leading and following vehicles. (h) Vehicle-to-vehicle distance and actual distance.
Electronics 11 02284 g009aElectronics 11 02284 g009b
Table 1. LuGre dynamic friction model parameters.
Table 1. LuGre dynamic friction model parameters.
ParameterValueParameterValue
μ c 0.3 L t i r e 0.2 m
μ s 1.4 σ 0 150 1/m
v s 1.5 m/s σ 1 4 s/m
κ 7 6 L t i r e σ 2 0.01 s/m
Table 2. Vehicle dynamics parameters.
Table 2. Vehicle dynamics parameters.
ParameterValueParameterValue
A f  1 1.6 + 0.00056 ( m 765 ) h c e n t e r  80.5 m
C d  20.3 a  91.04 m
D ( 0 )  3100 m b  101.56 m
v 1 ( 0 )  40.0 m/s g 9.8 m/s2
v w i n d  51 km/hEngine typePermanent magnet synchronous motor (PMSM)
ρ  61.225 kg/m3Maximum power10.7 kW
r 0.313 mMaximum speed1500 rpm
m  71159 kgMaximum torque340 Nm
1 Frontal area of the vehicle. 2 Aerodynamic drag coefficient. 3 Initial vehicle-to-vehicle distance. 4 Initial velocity of following vehicle. 5 Wind velocity. 6 Mass density of air. 7 Vehicle mass. 8 Height of the center of gravity (CG). 9 Distance from CG to front axle. 10 Distance from CG to rear axle.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Lian, Y.; Huang, J.; Liu, S.; Sun, Z.; Li, B.; Nie, Z. Driving Intention Inference Based on a Deep Neural Network with Dropout Regularization from Adhesion Coefficients in Active Collision Avoidance Control Systems. Electronics 2022, 11, 2284. https://doi.org/10.3390/electronics11152284

AMA Style

Lian Y, Huang J, Liu S, Sun Z, Li B, Nie Z. Driving Intention Inference Based on a Deep Neural Network with Dropout Regularization from Adhesion Coefficients in Active Collision Avoidance Control Systems. Electronics. 2022; 11(15):2284. https://doi.org/10.3390/electronics11152284

Chicago/Turabian Style

Lian, Yufeng, Jianan Huang, Shuaishi Liu, Zhongbo Sun, Binglin Li, and Zhigen Nie. 2022. "Driving Intention Inference Based on a Deep Neural Network with Dropout Regularization from Adhesion Coefficients in Active Collision Avoidance Control Systems" Electronics 11, no. 15: 2284. https://doi.org/10.3390/electronics11152284

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop