R. Happee
Please Note
181 records found
1
Prolonged exposure to whole-body vibration (WBV) is a key contributor to motion discomfort in vehicles, including motion sickness and ride comfort. This issue becomes more compelling in automated vehicles, where occupants are expected to frequently engage in non-driving-related activities and will expect high comfort levels. Hence, enhancing seat design to mitigate WBV is essential for improving ride comfort across vehicle types. Therefore, this study, which primarily addresses vertical accelerations, optimized an existing seat suspension (K-Seat) and subjectively assessed discomfort using 24 participants (13 males and 11 females) exposed to a 29-minute driving session. The experiment was conducted with a conventional Toyota Yaris seat in a driving simulator, where a K-Seat model was used to emulate the effect of the seat suspension. Thus we evaluated the K-Seat, which has shown great promise for attenuating low-frequency vibrations; however, it had never been tested on human participants. The results show an overall reduction of 50% in reported motion sickness using the motion illness symptoms classification scale (MISC). Subjective discomfort was also alleviated for head and upper back. In addition, perceived discomfort was analyzed based on gender, illustrating a greater effectiveness of the K-Seat in enhancing lower neck comfort for females than for males.
The security of Automated Vehicles (AVs) is an important emerging area of research in traffic safety. Methods have been published and evaluated in experimental vehicles to secure safe AV control in the presence of attacks, but human motion comfort is rarely investigated in such studies. In this paper, we present an innovative optimal-coupling-observer-based framework that rejects the impact of bounded sensor attacks in a network of connected and automated vehicles from safety and comfort point of view. We demonstrate its performance in car following with cooperative adaptive cruise control for platoons with redundant distance and velocity sensors. The error dynamics are formulated as a Linear Time Variant (LTV) system, resulting in complex stability conditions that are investigated using a Linear Matrix Inequality (LMI) approach guaranteeing global asymptotic stability. We prove the capability of the framework to secure occupants’ safety and comfort in the presence of bounded attacks. In the onset of attack, the framework rapidly detects attacked sensors and switches to the most reliable observer eliminating attacked sensors, even with modest attack magnitudes. Without our proposed method, severe (but bounded) attacks result in collisions and major discomfort. With our method, attacks had negligible effects on motion comfort evaluated using ISO-2631 Ride Comfort and Motion Sickness indexes. The results pave the path to bring comfort to the forefront of AVs security.
Occupants' comfort
What about human body dynamics in road and rail vehicles?
Transportation and mobility are experiencing a significant transformation the recent years, which is evident in road (vehicles and bicycles) and rail vehicles. This transformation includes the introduction of automated vehicles (AVs), the increase of active transportation modes (e.g. cycling and walking) and the extended use of trains for commuting to work or travelling. However, despite this great transition, there are significant challenges that can hamper the wide use of these transport means, with comfort being one of them. In this paper, we explore physical comfort in these transport modes, examining ride comfort and motion sickness definitions and assessment, environmental influences, occupant postures, human body dynamics, and postural control strategies for adapting to motion. We conclude that while established comfort guidelines exist for conventional vehicles, substantial gaps persist in understanding and evaluating comfort in emerging modes like bicycles and automated vehicles with varied seating. Further research into modelling human body dynamics and the central nervous system's role in postural control, especially for cyclists and non-conventional postures, is essential for designing future transportation systems that prioritise comfort and health.
As vehicles transition between driving automation levels, drivers need to be continually aware of the automation mode and the resulting driver responsibilities. This study investigates the impact of visual user interfaces (UIs) on drivers’ mode awareness in SAE Level 2 automated vehicles. It focuses on their understanding of speed and distance control, steering control, and the hands-on steering wheel requirement presented through UIs. Forty-five UIs were generated, presenting the activation of Lane Keeping Assist (LKA) and Adaptive Cruise Control (ACC) and the hands-on steering wheel requirement. Through an online questionnaire with 1080 respondents with experience of SAE Level 2, the study evaluated how these visual UIs influenced users’ understanding of control responsibilities, information usability, and trust in automated vehicles. The results show a limited role of UI in shaping users’ understanding of control. ACC UIs and LKA UIs had no significant effects, and apparently, the understanding of speed and distance control and steering control was independent of the ACC UI and LKA UI. A large variance in responses regarding the understanding of steering control and speed and distance control indicates confusion caused by mode ambiguity, suggesting that drivers do not well understand how the speed and distance control and steering control task is shared between the driver and the automation. However, the hands-on steering wheel UIs significantly improved the understanding of the hands-on steering wheel requirement. The hands-on steering wheel UI combining the hands on the wheel icon and the text “Keep hands on steering wheel” yielded 94.4% correct understanding and outperformed the UI with hands but without text (87.8% correct) or no UI (82.5% correct). In addition, the variation of visual UI did not affect trust. This study contributes to the understanding and design of visual UIs for effective communication of driver responsibilities in automated vehicles.
Beyond Beeps
Evaluating Soundscapes for Take-Over Situations in Automated Vehicles
In automated vehicles, beeps are widely used as alarms and feedback. However, as automation advances, there is a need to explore subtler, contextually sound-based notifications for non-urgent situations. While auditory interfaces for take-over requests have been studied, limited attention has been given to using soundscapes for such alerts. This paper designed and evaluated soundscapes using existing driving-related sounds–amplified road noise and/or dimmed background music–for scheduled take-over situations. A driving simulator study showed that these soundscapes enhanced reaction time, situation awareness, and acceptance without causing annoyance. Particularly, the combined condition (music dimming and road noise amplifying) supported higher driver awareness and responsiveness. These findings suggest that soundscapes can offer safer, more intuitive take-over alerts by embedding information into familiar audio cues. This study contributes to developing soundscapes as novel alert mechanisms that integrate seamlessly with the driving environment to enhance both safety and user experience in automated vehicles.
Model Predictive Control-based motion cueing algorithms demonstrate superior specific force tracking and platform workspace utilization. Despite these benefits, MPC algorithms can exhibit pre-positioning, a phenomenon where the platform tilts prematurely in anticipation of future motion, causing perceptible false cues that disrupt immersion. This phenomenon is particularly noticeable in tilt-coordination due to sustained specific forces.
This work proposes a solution to mitigate pre-positioning by introducing a dynamic scaling factor for tilt-coordination. By scaling down the reference signal for tilt coordination, it stays within the simulator’s tilt angle and tilt-rate capabilities, and platform tilt rates are kept below human perception thresholds. The scaling factor is derived from two key parameters: the maximum specific force generated by platform tilt and the tilt rate perception threshold. The reference for specific force is unscaled to optimally use the translational workspace.
This approach enhances driving simulator realism by minimizing the perceptibility of pre-positioning while optimizing specific force recreation. Subjective evaluations also indicate improved immersion, illustrating the effectiveness of the scenario-adaptive Autoscaling MCA. ...
Model Predictive Control-based motion cueing algorithms demonstrate superior specific force tracking and platform workspace utilization. Despite these benefits, MPC algorithms can exhibit pre-positioning, a phenomenon where the platform tilts prematurely in anticipation of future motion, causing perceptible false cues that disrupt immersion. This phenomenon is particularly noticeable in tilt-coordination due to sustained specific forces.
This work proposes a solution to mitigate pre-positioning by introducing a dynamic scaling factor for tilt-coordination. By scaling down the reference signal for tilt coordination, it stays within the simulator’s tilt angle and tilt-rate capabilities, and platform tilt rates are kept below human perception thresholds. The scaling factor is derived from two key parameters: the maximum specific force generated by platform tilt and the tilt rate perception threshold. The reference for specific force is unscaled to optimally use the translational workspace.
This approach enhances driving simulator realism by minimizing the perceptibility of pre-positioning while optimizing specific force recreation. Subjective evaluations also indicate improved immersion, illustrating the effectiveness of the scenario-adaptive Autoscaling MCA.
This paper presents a novel approach integrating motion replanning, path tracking and vehicle stability for collision avoidance using nonlinear Model Predictive Contouring Control. Employing torque vectoring capabilities, the proposed controller is able to stabilise the vehicle in evasive manoeuvres at the limit of handling. A nonlinear double-track vehicle model, together with an extended Fiala tyre model, is used to capture the nonlinear coupled longitudinal and lateral dynamics. The optimised control inputs are the steering angle and the four longitudinal wheel forces to minimise the tracking error in safe situations and maximise the vehicle-to-obstacle distance in emergency manoeuvres. These optimised longitudinal forces generate an additional direct yaw moment, enhancing the vehicle’s lateral agility and aiding in obstacle avoidance and stability maintenance. The longitudinal tyre forces are constrained using the tyre friction cycle. The proposed controller has been tested on rapid prototyping hardware to prove real-time capability. In a high-fidelity simulation environment validated with experimental data, our proposed approach successfully avoids obstacles and maintains vehicle stability. It outperforms two baseline controllers: one without torque vectoring and another one without collision avoidance prioritisation. Furthermore, we demonstrate the robustness of the proposed approach to vehicle parameter variations, road friction, perception, and localisation errors. The influence of each variation is statistically assessed to evaluate its impact on the performance, providing guidelines for future controller design.
Efficient Motion Sickness Assessment
Recreation of On-Road Driving on a Compact Test Track
The ability to engage in other activities during the ride is considered by consumers as one of the key reasons for the adoption of automated vehicles. However, engagement in non-driving activities will provoke occupants’ motion sickness, deteriorating their overall comfort and thereby risking acceptance of automated driving. Therefore, it is critical to extend our understanding of motion sickness and unravel the modulating factors that affect it through experiments with participants. Currently, most experiments are conducted on public roads (realistic but not reproducible) or test tracks (feasible with prototype automated vehicles). This research study develops a method to design an optimal path and speed reference to accurately replicate on-road motion sickness exposure on a small test track. The method uses model predictive control to replicate the longitudinal and lateral accelerations collected from on-road drives on a test track of 70 m by 175 m. A within-subject experiment (47 participants) was conducted comparing the occupants’ motion sickness occurrence in test-track and on-road conditions, with the conditions being cross-randomized. The results illustrate that the subjective (reported) motion sickness is well reproduced with an insignificant reduction on the track. Meanwhile, there is an overall correspondence of individual sickness levels between on-road and test-track. This paves the path for the employment of our method for a simpler, safer and more replicable assessment of motion sickness.
We present a vehicle system capable of navigating safely and efficiently around Vulnerable Road Users (VRUs), such as pedestrians and cyclists. The system comprises key modules for environment perception, localization and mapping, motion planning, and control, integrated into a prototype vehicle. A key innovation is a motion planner based on Topology-driven Model Predictive Control (T-MPC). The guidance layer generates multiple trajectories in parallel, each representing a distinct strategy for obstacle avoidance or non-passing. The underlying trajectory optimization constrains the joint probability of collision with VRUs under generic uncertainties. To address extraordinary situations ('edge cases') that go beyond the autonomous capabilities - such as construction zones or encounters with emergency responders - the system includes an option for remote human operation, supported by visual and haptic guidance. In simulation, our motion planner outperforms three baseline approaches in terms of safety and efficiency. We also demonstrate the full system in prototype vehicle tests on a closed track, both in autonomous and remotely operated modes.
MPC-based postural control
Mimicking CNS strategies for head–neck stabilization under eyes closed conditions
A plausible explanation about the acquisition and realization of beliefs by the central nervous system (CNS) when issuing control actions to counteract external perturbations, is to employ mechanisms aiming to minimize sensory conflict and muscle effort while maintaining biomechanical stability. However, existing head–neck postural control models fail to explicitly integrate this plausible CNS objective within their stabilization mechanisms. This study proposes a novel Model Predictive Control (MPC)-based framework to replicate CNS postural stabilization by incorporating the minimization of sensory conflict as a primary control objective through the MPC cost function. The MPC is integrated in a simplified biomechanical head–neck structure, using a prediction model and sensory feedback to optimize control actions over a finite time horizon within biomechanical constraints. Two human experiments measuring head motion with unpredictable seat and trunk perturbations were used to evaluate and validate different configurations of sensory feedback pathways. During anterior–posterior translational trunk perturbations, the results illustrated that the configuration with vestibular feedback improved head position prediction while muscle effort and partial somatosensory feedback alone, achieved superior results in head pitch prediction. Meanwhile, muscle effort and partial somatosensory feedback were sufficient to stabilize the head during trunk rotational (pitch) perturbations. Finally, a multi-scenario optimization demonstrated that a single set of MPC weights could generalize stabilization across both perturbation types. The results demonstrate the effectiveness of MPC in replicating CNS-inspired postural adjustments, indicating that controlling a simplified biomechanical head–neck model provides a computationally efficient and accurate alternative to complex multi-segment approaches.
This paper proposes a novel vehicle sideslip angle estimator, which uses the physical knowledge from an Unscented Kalman Filter (UKF) based on a non-linear single-track vehicle model to enhance the estimation accuracy of a Convolutional Neural Network (CNN). The model-based and data-driven approaches interact mutually, and both use the standard inertial measurement unit and the tyre forces measured by load sensing technology. CNN benefits from the UKF the capacity to leverage the laws of physics. Concurrently, the UKF uses the CNN outputs as sideslip angle pseudo-measurement and adaptive process noise parameters. The back-propagation through time algorithm is applied end-to-end to the CNN and the UKF to employ the mutualistic property. Using a large-scale experimental dataset of 216 manoeuvres containing a great diversity of vehicle behaviours, we demonstrate a significant improvement in the accuracy of the proposed architecture over the current state-of-art hybrid approach combined with model-based and data-driven techniques. In the case that a limited dataset is provided for the training phase, the proposed hybrid approach still guarantees estimation robustness.
Introduction: Augmented reality (AR) has been increasingly studied in transportation, particularly for drivers and pedestrians interacting with automated vehicles (AVs). Previous research evaluated AR interfaces using online video-based questionnaires but lacked human-subject research in immersive environments. This study examined if prior online evaluations of nine AR interfaces could be replicated in an immersive virtual environment and if AR interface effectiveness depends on pedestrian attention allocation.
Methods: Thirty participants completed 120 trials in a CAVE-based simulator with yielding and non-yielding AVs, rating the interface’s intuitiveness and crossing the road when they felt safe. To emulate visual distraction, participants had to look into an attention-attractor circle that disappeared 1 s after the interface appeared.
Results: The results showed that intuitiveness ratings from the current CAVE-based study and the previous online study correlated strongly (r ≈ 0.90). Head-locked interfaces and familiar designs (augmented traffic lights, zebra crossing) yielded higher intuitiveness ratings and quicker crossing initiations than vehicle-locked interfaces. Vehicle-locked interfaces were less effective when the attention-attractor was on the environment’s opposite side, while head-locked interfaces were relatively unaffected by attention-attractor position.
Discussion: In conclusion, this ‘AR in VR’ study shows strong congruence between intuitiveness ratings in a CAVE-based study and online research, and demonstrates the importance of interface placement in relation to user gaze direction.
Designing user interfaces for partially automated Vehicles
Effects of information and modality on trust and acceptance
Trust and perceived safety are pivotal in the acceptance of automated vehicles and can be enhanced by providing users with automation information on the (safe) operation of the vehicle. This study aims to identify how user interfaces (UI) can enhance drivers' trust and acceptance and reduce perceived risk in partially automated vehicles. Four interfaces were designed with different levels of complexity. These levels were achieved by combining automation information (surrounding information vs surrounding and manoeuvre information) and modality (visual vs visual and auditory). These interfaces were evaluated in a driving simulator in which a partially automated vehicle reacted to an event of a merging and braking vehicle in its front. The criticality of the events was manipulated by the factors merging gap (in meters) and deceleration (m/s2) of the vehicle in front. The reaction of the automation was either to brake or to change lanes. The results show that an optimal combination of automation information and modality enhances drivers' trust and acceptance. More specifically, the most advanced UI, which provided surrounding and manoeuvre information via the visual and auditory modalities, was associated with the highest trust and acceptance ranking and the lowest perceived risk. Manoeuvre information delivered through the auditory modality was particularly effective in enhancing trust and acceptance. The benefits of the UIs were consistent over events. However, in the most critical events, drivers did not feel entirely safe and did not trust the automation completely. This study suggests that the design of UIs for partially automated vehicles shall include automation information via visual and auditory modalities.
Enhancing Motor Learning in Cycling Tasks
The Role of Model Predictive Control and Training Sequence
We evaluated the impact of Model Predictive Control (MPC) robotic-assisted versus unassisted training on motor learning of a complex bicycle steering task. Ten participants were divided into two groups, alternating between MPC-assisted and unassisted training to ride a steer-by-wire bicycle on a treadmill to collect virtual stars. At Baseline, Mid-Training, and Post-Training, motor skills were assessed by the average and standard deviation (SD) of distance to stars, while performance was measured by the mean absolute and SD of the steering rate. We found significant improvements in task skill and steering performance, with notable benefits observed in the performance of the group initially trained unassisted. Our findings suggest that starting the training unassisted could stimulate an internal focus (concentrating on one's own body movements) and intrinsic skill perception. This foundation may then form a basis for later integration of MPC assistance to refine further the gained motor skills. Such a sequential training approach may benefit motor skill acquisition of complex dynamics tasks. Further research is necessary to validate and apply these findings to enhance training methods.
Occupants’ Motion Comfort and Driver’s Feel: An Explorative Study About Their Relation in Remote Driving
An Explorative Study About Their Relation in Remote Driving
Teleoperation is considered as a viable option to control fully automated vehicles (AVs) of Level 4 and 5 in special conditions. However, by bringing the remote drivers in the loop, their driving experience should be realistic to secure safe and comfortable remote control. Therefore, the remote control tower should be designed such that remote drivers receive high quality cues regarding the vehicle state and the driving environment. In this direction, the steering feedback could be manipulated to provide feedback to the remote drivers regarding how the vehicle reacts to their commands. However, until now, it is unclear how the remote drivers' steering feel could impact occupant's motion comfort. This paper focuses on exploring how the driver feel in remote (RD) and normal driving (ND) are related with occupants' motion comfort. More specifically, different types of steering feedback controllers are applied in (a) the steering system of a Research Concept Vehicle-model E (RCV-E) and (b) the steering system of a remote control tower. An experiment was performed to assess driver feel when the RCV-E is normally and remotely driven. Subjective assessment and objective metrics are employed to assess drivers' feel and occupants' motion comfort in both remote and normal driving scenarios. The results illustrate that motion sickness and ride comfort are dominated by steering velocity variations in remote driving, while throttle input variations dominate in normal driving. The results demonstrate that motion sickness and steering velocity increase both around 25% from normal to remote driving.