sensors-logo

Journal Browser

Journal Browser

Human Machine Interaction in Automated Vehicles

A special issue of Sensors (ISSN 1424-8220). This special issue belongs to the section "Intelligent Sensors".

Deadline for manuscript submissions: closed (30 September 2023) | Viewed by 12131

Special Issue Editors


E-Mail Website
Guest Editor
LAMIH-CNRS laboratory, INSA Hauts-de-France, Université Polytechnique Hauts-de-France, Valenciennes, France
Interests: vehicle control and estimation; constrained control; robust control and estimation; intelligent vehicles; human-in-the-loop control; human-machine shared control; mechatronics; plz update the interests of Dr. Zhongxu Hu to human-machine interaction; intelligent driving; deep learning; machine learning; computer vision
Special Issues, Collections and Topics in MDPI journals
School of Mechanical and Aerospace Engineering, Nanyang Technological University, Singapore, Singapore
Interests: Human-machine interaction; intelligent driving; deep learning; machine learning; computer vision

E-Mail Website
Guest Editor
School of Mechanical Science and Engineering, Huazhong University of Science and Technology, Wuhan, China
Interests: automated vehicles; connected vehicle network; big data; optimal control; smart mobility systems; robotics systems
Applied Artificial Intelligence for Engineering Centre for Autonomous and Cyberphysical Systems, Cranfield University, Bedfordshire, UK
Interests: rtificial intelligence; deep learning; computer vision; human-autonomy collaboration; autonomous vehicles
Associate Professor, School of Mechanical and Aerospace Engineering, Nanyang Technological University, Singapore 639798, Singapore
Interests: automated driving; human–machine systems; intelligent electric vehicles; human–robot collaboration; cyber–physical systems
Special Issues, Collections and Topics in MDPI journals

Special Issue Information

Dear Colleagues,

Intelligent human-machine interaction (HMI) plays an inseparable role in automated vehicles (AVs). With rapid advancements in the field of AVs, the intelligent HMI has piqued the public considerable interests. As a result, advanced interaction methods and interfaces have been investigated to enhance user experience, acceptance, and trust. A well-established HMI system requires that the AV can correctly infer the explicit and implicit interactive cues according to the cognitive state of the users and the dynamic contextual driving scenario leveraging the growing number of multimodal sensors. Therefore, it is underpinned by the coupling and coordinated developments in various related fields such as intelligent perception and control, artificial intelligence (AI), advanced sensing, wearable systems, and flexible electronics technologies. Although the research on HMI systems has made a remarkable progress in many tasks, there are still many unsettled issues needed to be further explored to attain harmonious interactive AVs. The objective of this Special Issue is to compile recent study and development efforts contributing to advances in intelligent approaches for HMI in AVs.

Dr. Anh-Tu Nguyen
Dr. Zhongxu Hu
Prof. Dr. Xiangrui Zeng
Dr. Yang Xing
Dr. Chen Lv
Guest Editors

Manuscript Submission Information

Manuscripts should be submitted online at www.mdpi.com by registering and logging in to this website. Once you are registered, click here to go to the submission form. Manuscripts can be submitted until the deadline. All submissions that pass pre-check are peer-reviewed. Accepted papers will be published continuously in the journal (as soon as accepted) and will be listed together on the special issue website. Research articles, review articles as well as short communications are invited. For planned papers, a title and short abstract (about 100 words) can be sent to the Editorial Office for announcement on this website.

Submitted manuscripts should not have been published previously, nor be under consideration for publication elsewhere (except conference proceedings papers). All manuscripts are thoroughly refereed through a single-blind peer-review process. A guide for authors and other relevant information for submission of manuscripts is available on the Instructions for Authors page. Sensors is an international peer-reviewed open access semimonthly journal published by MDPI.

Please visit the Instructions for Authors page before submitting a manuscript. The Article Processing Charge (APC) for publication in this open access journal is 2600 CHF (Swiss Francs). Submitted papers should be well formatted and use good English. Authors may use MDPI's English editing service prior to publication or during author revisions.

Keywords

  • human-machine interaction
  • automated vehicles
  • artificial intelligence
  • advanced sensing
  • human-machine shared control
  • personalized driving
  • multimodal interface
  • intelligent driver monitoring
  • driver trustness

Published Papers (8 papers)

Order results
Result details
Select all
Export citation of selected articles as:

Research

20 pages, 8042 KiB  
Article
Lateral Evasive Maneuver with Shared Control Algorithm: A Simulator Study
by Joseba Sarabia, Mauricio Marcano, Sergio Díaz, Asier Zubizarreta and Joshué Pérez
Sensors 2024, 24(2), 562; https://doi.org/10.3390/s24020562 - 16 Jan 2024
Cited by 1 | Viewed by 520
Abstract
Shared control algorithms have emerged as a promising approach for enabling real-time driver automated system cooperation in automated vehicles. These algorithms allow human drivers to actively participate in the driving process while receiving continuous assistance from the automated system in specific scenarios. However, [...] Read more.
Shared control algorithms have emerged as a promising approach for enabling real-time driver automated system cooperation in automated vehicles. These algorithms allow human drivers to actively participate in the driving process while receiving continuous assistance from the automated system in specific scenarios. However, despite the theoretical benefits being analyzed in various works, further demonstrations of the effectiveness and user acceptance of these approaches in real-world scenarios are required due to the involvement of the human driver in the control loop. Given this perspective, this paper presents and analyzes the results of a simulator-based study conducted to evaluate a shared control algorithm for a critical lateral maneuver. The maneuver involves the automated system helping to avoid an oncoming motorcycle that enters the vehicle’s lane. The study’s goal is to assess the algorithm’s performance, safety, and user acceptance within this specific scenario. For this purpose, objective measures, such as collision avoidance and lane departure prevention, as well as subjective measures related to the driver’s sense of safety and comfort are studied. In addition, three levels of assistance (gentle, intermediate, and aggressive) are tested in two driver state conditions (focused and distracted). The findings have important implications for the development and execution of shared control algorithms, paving the way for their incorporation into actual vehicles. Full article
(This article belongs to the Special Issue Human Machine Interaction in Automated Vehicles)
Show Figures

Figure 1

13 pages, 1364 KiB  
Article
Comparison of Experienced and Novice Drivers’ Visual and Driving Behaviors during Warned or Unwarned Near–Forward Collisions
by Jordan Navarro, Emanuelle Reynaud, Marie Claude Ouimet and Damien Schnebelen
Sensors 2023, 23(19), 8150; https://doi.org/10.3390/s23198150 - 28 Sep 2023
Cited by 1 | Viewed by 788
Abstract
Forward collision warning systems (FCWSs) monitor the road ahead and warn drivers when the time to collision reaches a certain threshold. Using a driving simulator, this study compared the effects of FCWSs between novice drivers (unlicensed drivers) and experienced drivers (holding a driving [...] Read more.
Forward collision warning systems (FCWSs) monitor the road ahead and warn drivers when the time to collision reaches a certain threshold. Using a driving simulator, this study compared the effects of FCWSs between novice drivers (unlicensed drivers) and experienced drivers (holding a driving license for at least four years) on near-collision events, as well as visual and driving behaviors. The experimental drives lasted about six hours spread over six consecutive weeks. Visual behaviors (e.g., mean number of fixations) and driving behaviors (e.g., braking reaction times) were collected during unprovoked near-collision events occurring during a car-following task, with (FCWS group) or without FCWS (No Automation group). FCWS presence reduced the number of near-collision events drastically and enhanced visual behaviors during those events. Unexpectedly, brake reaction times were observed to be significantly longer with FCWS, suggesting a cognitive cost associated with the warning process. Still, the FCWS showed a slight safety benefit for novice drivers attributed to the assistance provided for the situation analysis. Outside the warning events, FCWS presence also impacted car-following behaviors. Drivers took an extra safety margin, possibly to prevent incidental triggering of warnings. The data enlighten the nature of the cognitive processes associated with FCWSs. Altogether, the findings support the general efficiency of FCWSs observed through a massive reduction in the number of near-collision events and point toward the need for further investigations. Full article
(This article belongs to the Special Issue Human Machine Interaction in Automated Vehicles)
Show Figures

Figure 1

25 pages, 9812 KiB  
Article
Spatiotemporal Clustering of Parking Lots at the City Level for Efficiently Sharing Occupancy Forecasting Models
by Miratul Khusna Mufida, Abdessamad Ait El Cadi, Thierry Delot, Martin Trépanier and Dorsaf Zekri
Sensors 2023, 23(11), 5248; https://doi.org/10.3390/s23115248 - 31 May 2023
Cited by 2 | Viewed by 1303
Abstract
This study aims to address the challenge of developing accurate and efficient parking occupancy forecasting models at the city level for autonomous vehicles. Although deep learning techniques have been successfully employed to develop such models for individual parking lots, it is a resource-intensive [...] Read more.
This study aims to address the challenge of developing accurate and efficient parking occupancy forecasting models at the city level for autonomous vehicles. Although deep learning techniques have been successfully employed to develop such models for individual parking lots, it is a resource-intensive process that requires significant amounts of time and data for each parking lot. To overcome this challenge, we propose a novel two-step clustering technique that groups parking lots based on their spatiotemporal patterns. By identifying the relevant spatial and temporal characteristics of each parking lot (parking profile) and grouping them accordingly, our approach allows for the development of accurate occupancy forecasting models for a set of parking lots, thereby reducing computational costs and improving model transferability. Our models were built and evaluated using real-time parking data. The obtained correlation rates of 86% for the spatial dimension, 96% for the temporal one, and 92% for both demonstrate the effectiveness of the proposed strategy in reducing model deployment costs while improving model applicability and transfer learning across parking lots. Full article
(This article belongs to the Special Issue Human Machine Interaction in Automated Vehicles)
Show Figures

Figure 1

14 pages, 8310 KiB  
Article
Apollo: Adaptive Polar Lattice-Based Local Obstacle Avoidance and Motion Planning for Automated Vehicles
by Yiqun Li, Zong Chen, Tao Wang, Xiangrui Zeng and Zhouping Yin
Sensors 2023, 23(4), 1813; https://doi.org/10.3390/s23041813 - 06 Feb 2023
Viewed by 1738
Abstract
The motion planning module is the core module of the automated vehicle software system, which plays a key role in connecting its preceding element, i.e., the sensing module, and its following element, i.e., the control module. The design of an adaptive polar lattice-based [...] Read more.
The motion planning module is the core module of the automated vehicle software system, which plays a key role in connecting its preceding element, i.e., the sensing module, and its following element, i.e., the control module. The design of an adaptive polar lattice-based local obstacle avoidance (APOLLO) algorithm proposed in this paper takes full account of the characteristics of the vehicle’s sensing and control systems. The core of our approach mainly consists of three phases, i.e., the adaptive polar lattice-based local search space design, the collision-free path generation and the path smoothing. By adjusting a few parameters, the algorithm can be adapted to different driving environments and different kinds of vehicle chassis. Simulations show that the proposed method owns strong environmental adaptability and low computation complexity. Full article
(This article belongs to the Special Issue Human Machine Interaction in Automated Vehicles)
Show Figures

Figure 1

18 pages, 1567 KiB  
Article
Tire Slip H Control for Optimal Braking Depending on Road Condition
by Miguel Meléndez-Useros, Manuel Jiménez-Salas, Fernando Viadero-Monasterio and Beatriz López Boada
Sensors 2023, 23(3), 1417; https://doi.org/10.3390/s23031417 - 27 Jan 2023
Cited by 6 | Viewed by 1721
Abstract
Tire slip control is one of the most critical topics in vehicle dynamics control, being the basis of systems such the Anti-lock Braking System (ABS), Traction Control System (TCS) or Electronic Stability Program (ESP). The highly nonlinear behavior of tire–road contact makes it [...] Read more.
Tire slip control is one of the most critical topics in vehicle dynamics control, being the basis of systems such the Anti-lock Braking System (ABS), Traction Control System (TCS) or Electronic Stability Program (ESP). The highly nonlinear behavior of tire–road contact makes it challenging to design robust controllers able to find a dynamic stable solution in different working conditions. Furthermore, road conditions greatly affect the braking performance of vehicles, being lower on slippery roads than on roads with a high tire friction coefficient. For this reason, by knowing the value of this coefficient, it is possible to change the slip ratio tracking reference of the tires in order to obtain the optimal braking performance. In this paper, an H controller is proposed to deal with the tire slip control problem and maximize the braking forces depending on the road condition. Simulations are carried out in the vehicular dynamics simulator software CarSim. The proposed controller is able to make the tire slip follow a given reference based on the friction coefficient for the different tested road conditions, resulting in a small reference error and good transient response. Full article
(This article belongs to the Special Issue Human Machine Interaction in Automated Vehicles)
Show Figures

Figure 1

18 pages, 925 KiB  
Article
End-to-End One-Shot Path-Planning Algorithm for an Autonomous Vehicle Based on a Convolutional Neural Network Considering Traversability Cost
by Tongfei Bian, Yang Xing and Argyrios Zolotas
Sensors 2022, 22(24), 9682; https://doi.org/10.3390/s22249682 - 10 Dec 2022
Cited by 1 | Viewed by 1490
Abstract
Path planning plays an important role in navigation and motion planning for robotics and automated driving applications. Most existing methods use iterative frameworks to calculate and plan the optimal path from the starting point to the endpoint. Iterative planning algorithms can be slow [...] Read more.
Path planning plays an important role in navigation and motion planning for robotics and automated driving applications. Most existing methods use iterative frameworks to calculate and plan the optimal path from the starting point to the endpoint. Iterative planning algorithms can be slow on large maps or long paths. This work introduces an end-to-end path-planning algorithm based on a fully convolutional neural network (FCNN) for grid maps with the concept of the traversability cost, and this trains a general path-planning model for 10 × 10 to 80 × 80 square and rectangular maps. The algorithm outputs the lowest-cost path while considering the cost and the shortest path without considering the cost. The FCNN model analyzes the grid map information and outputs two probability maps, which show the probability of each point in the lowest-cost path and the shortest path. Based on the probability maps, the actual optimal path is reconstructed by using the highest probability method. The proposed method has superior speed advantages over traditional algorithms. On test maps of different sizes and shapes, for the lowest-cost path and the shortest path, the average optimal rates were 72.7% and 78.2%, the average success rates were 95.1% and 92.5%, and the average length rates were 1.04 and 1.03, respectively. Full article
(This article belongs to the Special Issue Human Machine Interaction in Automated Vehicles)
Show Figures

Figure 1

24 pages, 16263 KiB  
Article
Can Shared Control Improve Overtaking Performance? Combining Human and Automation Strengths for a Safer Maneuver
by Mauricio Marcano, Fabio Tango, Joseba Sarabia, Silvia Chiesa, Joshué Pérez and Sergio Díaz
Sensors 2022, 22(23), 9093; https://doi.org/10.3390/s22239093 - 23 Nov 2022
Cited by 3 | Viewed by 1557
Abstract
The Shared Control (SC) cooperation scheme, where the driver and automated driving system control the vehicle together, has been gaining attention through the years as a promising option to improve road safety. As a result, advanced interaction methods can be investigated to enhance [...] Read more.
The Shared Control (SC) cooperation scheme, where the driver and automated driving system control the vehicle together, has been gaining attention through the years as a promising option to improve road safety. As a result, advanced interaction methods can be investigated to enhance user experience, acceptance, and trust. Under this perspective, not only the development of algorithms and system applications are needed, but it is also essential to evaluate the system with real drivers, assess its impact on road safety, and understand how drivers accept and are willing to use this technology. In this sense, the contribution of this work is to conduct an experimental study to evaluate if a previously developed shared control system can improve overtaking performance on roads with oncoming traffic. The evaluation is performed in a Driver-in-the-Loop (DiL) simulator with 13 real drivers. The system based on SC is compared against a vehicle with conventional SAE-L2 functionalities. The evaluation includes both objective and subjective assessments. Results show that SC proved to be the best solution for assisting the driver during overtaking in terms of safety and acceptance. The SC’s longer and smoother control transitions provide benefits to cooperative driving. The System Usability Scale (SUS) and the System Acceptance Scale (SAS) questionnaire show that the SC system was perceived as better in terms of usability, usefulness, and satisfaction. Full article
(This article belongs to the Special Issue Human Machine Interaction in Automated Vehicles)
Show Figures

Figure 1

14 pages, 6679 KiB  
Article
An Integrated Framework for Multi-State Driver Monitoring Using Heterogeneous Loss and Attention-Based Feature Decoupling
by Zhongxu Hu, Yiran Zhang, Yang Xing, Qinghua Li and Chen Lv
Sensors 2022, 22(19), 7415; https://doi.org/10.3390/s22197415 - 29 Sep 2022
Cited by 1 | Viewed by 1473
Abstract
Multi-state driver monitoring is a key technique in building human-centric intelligent driving systems. This paper presents an integrated visual-based multi-state driver monitoring framework that incorporates head rotation, gaze, blinking, and yawning. To solve the challenge of head pose and gaze estimation, this paper [...] Read more.
Multi-state driver monitoring is a key technique in building human-centric intelligent driving systems. This paper presents an integrated visual-based multi-state driver monitoring framework that incorporates head rotation, gaze, blinking, and yawning. To solve the challenge of head pose and gaze estimation, this paper proposes a unified network architecture that tackles these estimations as soft classification tasks. A feature decoupling module was developed to decouple the extracted features from different axis domains. Furthermore, a cascade cross-entropy was designed to restrict large deviations during the training phase, which was combined with the other features to form a heterogeneous loss function. In addition, gaze consistency was used to optimize its estimation, which also informed the model architecture design of the gaze estimation task. Finally, the proposed method was verified on several widely used benchmark datasets. Comprehensive experiments were conducted to evaluate the proposed method and the experimental results showed that the proposed method could achieve a state-of-the-art performance compared to other methods. Full article
(This article belongs to the Special Issue Human Machine Interaction in Automated Vehicles)
Show Figures

Figure 1

Back to TopTop