As vehicles transition between driving automation levels, drivers need to be continually aware of the automation mode and the resulting driver responsibilities. This study investigates the impact of visual user interfaces (UIs) on drivers’ mode awareness in SAE Level 2 automated vehicles. It focuses on their understanding of speed and distance control, steering control, and the hands-on steering wheel requirement presented through UIs. Forty-five UIs were generated, presenting the activation of Lane Keeping Assist (LKA) and Adaptive Cruise Control (ACC) and the hands-on steering wheel requirement. Through an online questionnaire with 1080 respondents with experience of SAE Level 2, the study evaluated how these visual UIs influenced users’ understanding of control responsibilities, information usability, and trust in automated vehicles. The results show a limited role of UI in shaping users’ understanding of control. ACC UIs and LKA UIs had no significant effects, and apparently, the understanding of speed and distance control and steering control was independent of the ACC UI and LKA UI. A large variance in responses regarding the understanding of steering control and speed and distance control indicates confusion caused by mode ambiguity, suggesting that drivers do not well understand how the speed and distance control and steering control task is shared between the driver and the automation. However, the hands-on steering wheel UIs significantly improved the understanding of the hands-on steering wheel requirement. The hands-on steering wheel UI combining the hands on the wheel icon and the text “Keep hands on steering wheel” yielded 94.4% correct understanding and outperformed the UI with hands but without text (87.8% correct) or no UI (82.5% correct). In addition, the variation of visual UI did not affect trust. This study contributes to the understanding and design of visual UIs for effective communication of driver responsibilities in automated vehicles.

This paper presents a novel approach integrating motion replanning, path tracking and vehicle stability for collision avoidance using nonlinear Model Predictive Contouring Control. Employing torque vectoring capabilities, the proposed controller is able to stabilise the vehicle in evasive manoeuvres at the limit of handling. A nonlinear double-track vehicle model, together with an extended Fiala tyre model, is used to capture the nonlinear coupled longitudinal and lateral dynamics. The optimised control inputs are the steering angle and the four longitudinal wheel forces to minimise the tracking error in safe situations and maximise the vehicle-to-obstacle distance in emergency manoeuvres. These optimised longitudinal forces generate an additional direct yaw moment, enhancing the vehicle’s lateral agility and aiding in obstacle avoidance and stability maintenance. The longitudinal tyre forces are constrained using the tyre friction cycle. The proposed controller has been tested on rapid prototyping hardware to prove real-time capability. In a high-fidelity simulation environment validated with experimental data, our proposed approach successfully avoids obstacles and maintains vehicle stability. It outperforms two baseline controllers: one without torque vectoring and another one without collision avoidance prioritisation. Furthermore, we demonstrate the robustness of the proposed approach to vehicle parameter variations, road friction, perception, and localisation errors. The influence of each variation is statistically assessed to evaluate its impact on the performance, providing guidelines for future controller design.

Transportation and mobility are experiencing a significant transformation the recent years, which is evident in road (vehicles and bicycles) and rail vehicles. This transformation includes the introduction of automated vehicles (AVs), the increase of active transportation modes (e.g. cycling and walking) and the extended use of trains for commuting to work or travelling. However, despite this great transition, there are significant challenges that can hamper the wide use of these transport means, with comfort being one of them. In this paper, we explore physical comfort in these transport modes, examining ride comfort and motion sickness definitions and assessment, environmental influences, occupant postures, human body dynamics, and postural control strategies for adapting to motion. We conclude that while established comfort guidelines exist for conventional vehicles, substantial gaps persist in understanding and evaluating comfort in emerging modes like bicycles and automated vehicles with varied seating. Further research into modelling human body dynamics and the central nervous system's role in postural control, especially for cyclists and non-conventional postures, is essential for designing future transportation systems that prioritise comfort and health.

As users transition from drivers to passengers in automated vehicles, they often take their eyes off the road to engage in non-driving activities. In driving simulators, visual motion is presented with scaled or without physical motion, leading to a mismatch between expected and perceived motion. Both conditions elicit motion sickness, calling for enhanced vehicle and simulator motion control strategies. Given the large differences in sickness susceptibility between individuals, effective countermeasures must address this at a personal level. This paper combines a group-averaged sensory conflict model with an individualized Accumulation Model (AM) to capture individual differences in motion sickness susceptibility across various conditions. The feasibility of this framework is verified using three datasets involving sickening conditions: (1) vehicle experiments with and without outside vision, (2) corresponding vehicle and driving simulator experiments, and (3) vehicle experiments with various non-driving-related tasks. All datasets involve passive motion, mirroring experience in automated vehicles. The preferred model (AM2) can fit individual motion sickness responses across conditions using only two individualized parameters (gain K1 and time constant T1) instead of the original five, ensuring unique parameters for each participant and generalisability across conditions. An average improvement factor of 1.7 in fitting individual motion sickness responses is achieved with the AM2 model compared to the group-averaged AM0 model. This framework demonstrates robustness by accurately modeling distinct motion and vision conditions. A Gaussian mixture model of the parameter distribution across a population is developed, which predicts motion sickness in an unseen dataset with an average RMSE of 0.47. This model reduces the need for large-scale population experiments, accelerating research and development

Although Unmanned Aircraft Systems (UASs) offer valuable services, they also introduce certain risks—particularly to individuals on the ground—referred to as third-party risk (TPR). In general, ground-level TPR tends to rise alongside the density of people who might use these services, leading current regulations to heavily restrict UAS operations in populated regions. These operational constraints hinder the ability to gather safety insights through the conventional method of learning from real-world incidents. To address this, a promising alternative is to use dynamic simulations that model UAS collisions with humans, providing critical data to inform safer UAS design. In the automotive industry, the modelling and simulation of car crashes has been well developed. For small UAS, this dynamical modelling and simulation approach has focused on the effect of the varying weight and kinetic energy of the UAS, as well as the geometry and location of the impact on a human body. The objective of this research is to quantify the effects of UAS material and shape on-ground TPR through dynamical modelling and simulation. To accomplish this objective, five camera–drone types are selected that have similar weights, although they differ in terms of airframe structure and materials. For each of these camera–drones, a dynamical model is developed to simulate impact, with a biomechanical human body model validated for impact. The injury levels and probability of fatality (PoF) results, obtained through conducting simulations with these integrated dynamical models, are significantly different for the camera–drone types. For the uncontrolled vertical impact of a 1.2 kg UAS at 18 m/s on a model of a human head, differences in UAS designs even yield an order in magnitude difference in PoF values. Moreover, the highest PoF value is a factor of 2 lower than the parametric PoF models used in standing regulation. In the same scenario for UAS types with a weight of 0.4 kg, differences in UAS designs even considered yield an order when regarding the magnitude difference in PoF values. These findings confirm that the material and shape design of a UAS plays an important role in reducing ground TPR, and that these effects can be addressed by using dynamical modelling and simulation during UAS design.

We present a vehicle system capable of navigating safely and efficiently around Vulnerable Road Users (VRUs), such as pedestrians and cyclists. The system comprises key modules for environment perception, localization and mapping, motion planning, and control, integrated into a prototype vehicle. A key innovation is a motion planner based on Topology-driven Model Predictive Control (T-MPC). The guidance layer generates multiple trajectories in parallel, each representing a distinct strategy for obstacle avoidance or non-passing. The underlying trajectory optimization constrains the joint probability of collision with VRUs under generic uncertainties. To address extraordinary situations ('edge cases') that go beyond the autonomous capabilities - such as construction zones or encounters with emergency responders - the system includes an option for remote human operation, supported by visual and haptic guidance. In simulation, our motion planner outperforms three baseline approaches in terms of safety and efficiency. We also demonstrate the full system in prototype vehicle tests on a closed track, both in autonomous and remotely operated modes.

Previous literature suggests that the motion sickness susceptibility questionnaire (MSSQ) is inadequate for prediction of motion sickness under naturalistic driving conditions. In this study, we investigated whether visually induced motion sickness using a virtual reality headset could be used as a quick and reliable way to predict participant susceptibility. We recruited 22 participants to complete a two-part experiment. In randomised order, we determined their susceptibility to visual motion sickness and their susceptibility to car sickness. To determine visual susceptibility, the visual scene was sequentially rotated at constant velocity around an earth-vertical yaw axis and rolled about the nasiooccipital axis, in 30 s intervals. Car sickness, on the other hand, was elicited under completely naturalistic conditions, being driven in the backseat of a car in the city of Delft, performing a visual task on a laptop. Sickness ratings were collected at regular intervals in both parts of the experiment. We found that the frequencies excited by naturalistic driving are very low, which has important consequences for motion sickness modelling and mitigation in automated vehicles. We found that individual car sickness correlated positively with visual motion sickness. This indicates that both are influenced by a common sickness susceptibility factor. Car sickness correlated similarly with visual motion sickness and MSSQ. Overall, our results indicate that combining measurements of sickness responses to a visual stimulus and MSSQ can yield a reliable method for determining individual sickness susceptibility. To this end the visual stimulus and the weighting with MSSQ responses can be refined using a much larger sample and considering additional visual conditions in driving.

A plausible explanation about the acquisition and realization of beliefs by the central nervous system (CNS) when issuing control actions to counteract external perturbations, is to employ mechanisms aiming to minimize sensory conflict and muscle effort while maintaining biomechanical stability. However, existing head–neck postural control models fail to explicitly integrate this plausible CNS objective within their stabilization mechanisms. This study proposes a novel Model Predictive Control (MPC)-based framework to replicate CNS postural stabilization by incorporating the minimization of sensory conflict as a primary control objective through the MPC cost function. The MPC is integrated in a simplified biomechanical head–neck structure, using a prediction model and sensory feedback to optimize control actions over a finite time horizon within biomechanical constraints. Two human experiments measuring head motion with unpredictable seat and trunk perturbations were used to evaluate and validate different configurations of sensory feedback pathways. During anterior–posterior translational trunk perturbations, the results illustrated that the configuration with vestibular feedback improved head position prediction while muscle effort and partial somatosensory feedback alone, achieved superior results in head pitch prediction. Meanwhile, muscle effort and partial somatosensory feedback were sufficient to stabilize the head during trunk rotational (pitch) perturbations. Finally, a multi-scenario optimization demonstrated that a single set of MPC weights could generalize stabilization across both perturbation types. The results demonstrate the effectiveness of MPC in replicating CNS-inspired postural adjustments, indicating that controlling a simplified biomechanical head–neck model provides a computationally efficient and accurate alternative to complex multi-segment approaches.

In automated vehicles, beeps are widely used as alarms and feedback. However, as automation advances, there is a need to explore subtler, contextually sound-based notifications for non-urgent situations. While auditory interfaces for take-over requests have been studied, limited attention has been given to using soundscapes for such alerts. This paper designed and evaluated soundscapes using existing driving-related sounds–amplified road noise and/or dimmed background music–for scheduled take-over situations. A driving simulator study showed that these soundscapes enhanced reaction time, situation awareness, and acceptance without causing annoyance. Particularly, the combined condition (music dimming and road noise amplifying) supported higher driver awareness and responsiveness. These findings suggest that soundscapes can offer safer, more intuitive take-over alerts by embedding information into familiar audio cues. This study contributes to developing soundscapes as novel alert mechanisms that integrate seamlessly with the driving environment to enhance both safety and user experience in automated vehicles.

This paper proposes a novel vehicle sideslip angle estimator, which uses the physical knowledge from an Unscented Kalman Filter (UKF) based on a non-linear single-track vehicle model to enhance the estimation accuracy of a Convolutional Neural Network (CNN). The model-based and data-driven approaches interact mutually, and both use the standard inertial measurement unit and the tyre forces measured by load sensing technology. CNN benefits from the UKF the capacity to leverage the laws of physics. Concurrently, the UKF uses the CNN outputs as sideslip angle pseudo-measurement and adaptive process noise parameters. The back-propagation through time algorithm is applied end-to-end to the CNN and the UKF to employ the mutualistic property. Using a large-scale experimental dataset of 216 manoeuvres containing a great diversity of vehicle behaviours, we demonstrate a significant improvement in the accuracy of the proposed architecture over the current state-of-art hybrid approach combined with model-based and data-driven techniques. In the case that a limited dataset is provided for the training phase, the proposed hybrid approach still guarantees estimation robustness.

This paper presents a novel Learning-based Model Predictive Contouring Control (L-MPCC) algorithm for evasive manoeuvres at the limit of handling. The algorithm uses the Student-t Process (STP) to minimise model mismatches and uncertainties online. The proposed STP captures the mismatches between the prediction model and the measured lateral tyre forces and yaw rate. The mismatches correspond to the posterior means provided to the prediction model to improve its accuracy. Simultaneously, the posterior covariances are propagated to the vehicle lateral velocity and yaw rate along the prediction horizon. The STP posterior covariance directly depends on the variance of observed data, so its variance is more significant when the online measurements differ from the recorded ones in the training set and smaller in the opposite case. Thus, these covariances can be utilised in the L-MPCC’s cost function to minimise the vehicle state uncertainties. In a high-fidelity simulation environment, we demonstrate that the proposed L-MPCC can successfully avoid obstacles, keeping the vehicle stable while driving a double lane change manoeuvre at a higher velocity than an MPCC without STP. Furthermore, the proposed controller yields a significantly lower peak sideslip angle, improving the vehicle’s manoeuvrability compared to an L-MPCC with a Gaussian Process.

Introduction: Augmented reality (AR) has been increasingly studied in transportation, particularly for drivers and pedestrians interacting with automated vehicles (AVs). Previous research evaluated AR interfaces using online video-based questionnaires but lacked human-subject research in immersive environments. This study examined if prior online evaluations of nine AR interfaces could be replicated in an immersive virtual environment and if AR interface effectiveness depends on pedestrian attention allocation. 

Methods: Thirty participants completed 120 trials in a CAVE-based simulator with yielding and non-yielding AVs, rating the interface’s intuitiveness and crossing the road when they felt safe. To emulate visual distraction, participants had to look into an attention-attractor circle that disappeared 1 s after the interface appeared. 

Results: The results showed that intuitiveness ratings from the current CAVE-based study and the previous online study correlated strongly (r ≈ 0.90). Head-locked interfaces and familiar designs (augmented traffic lights, zebra crossing) yielded higher intuitiveness ratings and quicker crossing initiations than vehicle-locked interfaces. Vehicle-locked interfaces were less effective when the attention-attractor was on the environment’s opposite side, while head-locked interfaces were relatively unaffected by attention-attractor position. 

Discussion: In conclusion, this ‘AR in VR’ study shows strong congruence between intuitiveness ratings in a CAVE-based study and online research, and demonstrates the importance of interface placement in relation to user gaze direction.

Users of automated vehicles will engage in other activities and take their eyes off the road, making them prone to motion sickness. To resolve this, the current paper validates models predicting sickness in response to motion and visual conditions. We validate published models of vestibular and visual sensory integration that have been used for predicting motion sickness through sensory conflict. We use naturalistic driving data and laboratory motion (and vection) paradigms, such as sinusoidal translation and rotation at different frequencies, Earth-Vertical Axis Rotation, Off-Vertical Axis Rotation, Centrifugation, Somatogravic Illusion, and Pseudo-Coriolis, to evaluate different models for both motion perception and motion sickness. We investigate the effects of visual motion perception in terms of rotational velocity (visual flow) and verticality. According to our findings, the SVC_I model, a 6DOF model based on the Subjective Vertical Conflict (SVC) theory, with visual rotational velocity input is effective at estimating motion sickness. However, it does not correctly replicate motion perception in paradigms such as roll-tilt perception during centrifuge, pitch perception during somatogravic illusion, and pitch perception during pseudo-Coriolis motions. On the other hand, the Multi-Sensory Observer Model (MSOM) accurately models motion perception in all considered paradigms, but does not effectively capture the frequency sensitivity of motion sickness, and the effects of vision on sickness. For both models (SVC_I and MSOM), the visual perception of rotational velocity strongly affects sickness and perception. Visual verticality perception does not (yet) contribute to sickness prediction, and contributes to perception prediction only for the somatogravic illusion. In conclusion, the SVC_I model with visual rotation velocity feedback is the current preferred option to design vehicle control algorithms for motion sickness reduction, while the MSOM best predicts perception. A unified model that jointly captures perception and motion sickness remains to be developed.

Teleoperation is considered as a viable option to control fully automated vehicles (AVs) of Level 4 and 5 in special conditions. However, by bringing the remote drivers in the loop, their driving experience should be realistic to secure safe and comfortable remote control. Therefore, the remote control tower should be designed such that remote drivers receive high quality cues regarding the vehicle state and the driving environment. In this direction, the steering feedback could be manipulated to provide feedback to the remote drivers regarding how the vehicle reacts to their commands. However, until now, it is unclear how the remote drivers' steering feel could impact occupant's motion comfort. This paper focuses on exploring how the driver feel in remote (RD) and normal driving (ND) are related with occupants' motion comfort. More specifically, different types of steering feedback controllers are applied in (a) the steering system of a Research Concept Vehicle-model E (RCV-E) and (b) the steering system of a remote control tower. An experiment was performed to assess driver feel when the RCV-E is normally and remotely driven. Subjective assessment and objective metrics are employed to assess drivers' feel and occupants' motion comfort in both remote and normal driving scenarios. The results illustrate that motion sickness and ride comfort are dominated by steering velocity variations in remote driving, while throttle input variations dominate in normal driving. The results demonstrate that motion sickness and steering velocity increase both around 25% from normal to remote driving.

Microscopic simulation is an established tool in traffic engineering and research, where aggregated traffic performance measures are inferred from the simulation of individual agents. Additionally, measures describing the safety and efficiency of road user interactions gain importance for recent developments such as automated vehicles and urban cycling. However, current simulation frameworks model interactions including cyclists only with limited realism. To address this issue, we propose to bring bicycle dynamics to traffic simulation. We demonstrate that a novel reformulation of the social force framework can create input signals for a controlled inverted pendulum bicycle model and thereby enable a fully two-dimensional open space simulation of cyclist interactions. The inverted pendulum model introduces the need to stabilize the bicycle as a constraint to the reactive behavior of simulated cyclists. Furthermore, it enables the simulation of countersteering and weaving for stabilization. Our cyclist social forces have anisotropic force fields with respect to relative interaction position and orientation to describe the varying interaction constellations in open space. With these models, we simulate five single- and multi-cyclist test cases and show that the generated trajectories notably differ from results obtained from a 2D bicycle model without lean angle simulation. Measurements of the maximum lateral path deviation and post-encroachment time show that these differences are relevant for typical applications. Our work demonstrates the potential of introducing physics-based realistic bicycle dynamics to the microscopic simulation of individual road user interactions and the fundamental capability of our reformulated cyclist social forces to do so. Going further, we plan to calibrate and validate our model based on naturalistic cycling data to support the initial results of this work.

This paper presents an original approach to vehicle obstacle avoidance. It involves the development of a nonlinear Model Predictive Contouring Control, which uses torque vectoring to stabilise and drive the vehicle in evasive manoeuvres at the limit of handling. The proposed algorithm combines motion planning, path tracking and vehicle stability objectives, prioritising collision avoidance in emergencies. The controller's prediction model is a nonlinear double-track vehicle model based on an extended Fiala tyre to capture the nonlinear coupled longitudinal and lateral dynamics. The controller computes the optimal steering angle and the longitudinal forces per each of the four wheels to minimise tracking error in safe situations and maximise the vehicle-to-obstacle distance in emergencies. Thanks to the optimisation of the longitudinal tyre forces, the proposed controller can produce an extra yaw moment, increasing the vehicle's lateral agility to avoid obstacles while keeping the vehicle stable. The optimal forces are constrained in the tyre friction circle not to exceed the tyres and vehicle capabilities. In a high-fidelity simulation environment, we demonstrate the benefits of torque vectoring, showing that our proposed approach is capable of successfully avoiding obstacles and keeping the vehicle stable while driving a double-lane change manoeuvre, in comparison to baselines lacking torque vectoring or collision avoidance prioritisation.

The driving style of an automated vehicle (AV) needs to be comfortable to encourage the broad acceptance and use of this newly emerging transport mode. However, current research provides limited knowledge about what influences comfort, how this concept is described, and how it is measured. This knowledge is especially lacking when comfort is linked to the AV's driving styles. This paper presents results from an online workshop with nine experts, all with hands-on experience of AVs and a long track record of research in this context. Using online tools, experts were invited to introduce concepts they considered relevant to comfort/discomfort in currently available modes of transport which offer a ride (taxi/bus/train) to users and compare these to the concepts used to define comfort and discomfort in AVs. Results showed that a wide range of terms were used to describe user comfort and discomfort for both modes. Although all terms used for existing vehicles were found to apply to AVs, additional terms were proposed for determining comfort/discomfort of AVs. For example, to enhance comfort in AVs, designers should consider good communication channels, as well as ensuring that the AV's capabilities match users’ expectations. Results also revealed that more terms were used, overall, to define discomfort, and that a comfortable ride in AVs is not just about mitigating discomfort. New concepts specific to AVs were also revealed when considering what increases their discomfort, such as whether riders’ safety and privacy are affected, or if they feel in control. Experts’ input from the workshop was used to enhance and expand a simple conceptual framework, explaining how AV driving styles, as well as other, non-driving-related factors, affect user comfort. It is hoped that this framework provides a more comprehensive list of the concepts affecting user comfort, also allowing more accurate measurement of the concept. As well as allowing for a more accurate comparison between empirical studies measuring comfort in AVs, this study will facilitate the design of more comfortable and acceptable automated driving for future vehicles.

In conditionally automated driving (SAE level 3), drivers may take their eyes off the road but will still need to be ready to take control and will, therefore, benefit from information on automation. This study aims to investigate the effectiveness of automation manoeuvre information provided through spatial sound, traditional notification sound (beep), and a visual interface. Spatial sounds were designed differentiating four distinct driving manoeuvres: overtaking a leading car, slowing down, turning right, and passing a roundabout. The notification sound consisted of one beep being identical for all manoeuvres. The visual interface showed the automation mode with an image and manoeuvre information with text and images. The impact of these interfaces on trust, workload, acceptance, situation awareness, and sense of control was evaluated with questionnaires and visual attention was evaluated with eye tracking while participants engaged in a visual-motor secondary task in a driving simulator. The results indicate that, with all interfaces tested, manoeuvre information enhances trust, acceptance, situation awareness, and sense of control, without significantly affecting the overall workload. These benefits were more profound, adding auditory information and differed marginally between the traditional notification and the spatial sound, as the effectiveness of the different auditory interface types varied depending on the specific manoeuvre. Findings highlight the importance of designing user interfaces for automation manoeuvre information using auditory cues to improve the user experience in automated driving.

Mode awareness is important for the safe use of automated vehicles, yet drivers' understanding of mode transitions has not been sufficiently investigated. In this study, we administered an online survey to 838 respondents to examine their understanding of control responsibilities in partial and conditional driving automation with four types of interventions (brake pedal, steering wheel, gas pedal, and take-over request). Results show that most drivers understand that they are responsible for speed and distance control after brake pedal interventions and steering control after steering wheel interventions. However, drivers have mixed responses regarding the responsibility for speed and distance control after steering wheel interventions and the responsibility for steering control after gas pedal interventions. With a higher automation level (conditional driving automation), drivers expect automation to remain responsible more often compared to a lower automation level (partial driving automation). Regarding Hands-on requirements, more than 99% of respondents answered that drivers would keep their hands on the steering wheel after all intervention types in partial automation, while 60–95% would place their hands on the wheel after various intervention types in conditional automation. A misalignment between actual logic and drivers' expectations regarding control responsibilities is observed by comparing survey responses to the mode transition logic of commercial partially automated vehicles. To resolve confusion about control responsibilities and ensure consistent expectations, we propose implementing a consistent mode design and providing enhanced information to drivers.

Head motion is a key determinant of motion comfort and differs substantially from seat motion due to seat and body compliance and dynamic postural stabilization. This paper compares different human body model fidelities to transmit seat accelerations to the head for the assessment of motion comfort through simulations. Six-degree of freedom dynamics were analyzed using frequency response functions derived from an advanced human model (AHM), a computationally efficient human model (EHM) and experimental studies. Simulations of dynamic driving show that human models strongly affected the predicted ride comfort (increased up to a factor 3). Furthermore, they modestly affected sickness using the available filters from the literature and ISO-2631 (increased up to 30%), but more strongly affected sickness predicted by the subjective vertical conflict (SVC) model (increased up to 70%).