We present a vehicle system capable of navigating safely and efficiently around Vulnerable Road Users (VRUs), such as pedestrians and cyclists. The system comprises key modules for environment perception, localization and mapping, motion planning, and control, integrated into a prototype vehicle. A key innovation is a motion planner based on Topology-driven Model Predictive Control (T-MPC). The guidance layer generates multiple trajectories in parallel, each representing a distinct strategy for obstacle avoidance or non-passing. The underlying trajectory optimization constrains the joint probability of collision with VRUs under generic uncertainties. To address extraordinary situations ('edge cases') that go beyond the autonomous capabilities - such as construction zones or encounters with emergency responders - the system includes an option for remote human operation, supported by visual and haptic guidance. In simulation, our motion planner outperforms three baseline approaches in terms of safety and efficiency. We also demonstrate the full system in prototype vehicle tests on a closed track, both in autonomous and remotely operated modes.

Ensuring safety remains one of the biggest challenges for the widespread adoption of automated vehicles (AVs). Remote operation of AVs is a promising approach to address this, allowing remote operators to intervene when AVs encounter edge cases. However, remote operators are out-of-the-loop from the conventional driver in vehicle environment interaction, impacting their situation awareness and ability to safely control or assist the vehicle. In the scenario of remote driving, this is more evident since multimodal feedback is required to replicate the conventional driver-vehicle environment-interaction. In addition to visual and auditory modalities, motion feedback has been proposed as a way to bridge the gap between remote driving and in-vehicle driving. However, since motion feedback is cost-intensive, it might hinder rapid upscaling of remote driving systems. Thus, this study evaluated whether motion feedback adds value to driving performance and experience of the remote operator in low-velocity scenarios. Driving performance and experience were assessed and compared using objective and subjective metrics in three conditions (in-vehicle driving, and remote driving with and without motion feedback). The findings show that in remote driving, motion feedback fails to provide significant improvements. When compared to in-vehicle driving, remote driving performance and experience remain significantly worse. This suggests that motion feedback, in its current form, is redundant in low-velocity scenarios and that a simplified Remote Driving Station (RDS) may be sufficient in these scenarios. Future work should optimize simplified RDS designs, enhance feedback and human-machine interfaces and explore different driving scenarios for safe and efficient remote driving.

Users of automated vehicles will engage in other activities and take their eyes off the road, making them prone to motion sickness. To resolve this, the current paper validates models predicting sickness in response to motion and visual conditions. We validate published models of vestibular and visual sensory integration that have been used for predicting motion sickness through sensory conflict. We use naturalistic driving data and laboratory motion (and vection) paradigms, such as sinusoidal translation and rotation at different frequencies, Earth-Vertical Axis Rotation, Off-Vertical Axis Rotation, Centrifugation, Somatogravic Illusion, and Pseudo-Coriolis, to evaluate different models for both motion perception and motion sickness. We investigate the effects of visual motion perception in terms of rotational velocity (visual flow) and verticality. According to our findings, the SVC_I model, a 6DOF model based on the Subjective Vertical Conflict (SVC) theory, with visual rotational velocity input is effective at estimating motion sickness. However, it does not correctly replicate motion perception in paradigms such as roll-tilt perception during centrifuge, pitch perception during somatogravic illusion, and pitch perception during pseudo-Coriolis motions. On the other hand, the Multi-Sensory Observer Model (MSOM) accurately models motion perception in all considered paradigms, but does not effectively capture the frequency sensitivity of motion sickness, and the effects of vision on sickness. For both models (SVC_I and MSOM), the visual perception of rotational velocity strongly affects sickness and perception. Visual verticality perception does not (yet) contribute to sickness prediction, and contributes to perception prediction only for the somatogravic illusion. In conclusion, the SVC_I model with visual rotation velocity feedback is the current preferred option to design vehicle control algorithms for motion sickness reduction, while the MSOM best predicts perception. A unified model that jointly captures perception and motion sickness remains to be developed.

High levels of vehicle automation are expected to increase the risk of motion sickness, which is a major detriment to driving comfort. The exact relation between motion sickness and discomfort is a matter of debate, with recent studies suggesting a relief of discomfort at the onset of nausea. In this study, we investigate whether discomfort increases monotonously with motion sickness and how the relation can best be characterized in a semantic experiment (Experiment 1) and a motion sickness experiment (Experiment 2). In Experiment 1, 15 participants performed pairwise comparisons on the subjective discomfort associated with each item on the popular MIsery SCale (MISC) of motion sickness. In Experiment 2, 17 participants rated motion sickness using the MISC during exposures to four sustained motion stimuli, and provided (1) numerical magnitude estimates of the discomfort experienced for each level of the MISC, and (2) verbal magnitude estimates with seven qualifiers, ranging between feeling ‘excellent’ and ‘terrible’. The data of Experiment 1 show that the items of the MISC are ranked in order of appearance, with the exception of 5 (‘severe dizziness, warmth, headache, stomach awareness, and sweating’) and 6 (‘slight nausea’), which are ranked in opposite order. However, in Experiment 2, we find that discomfort associated with each level of the MISC, as it was used to express motion sickness during exposure to a sickening stimulus, increases monotonously; following a power law with an exponent of 1.206. While the results of Experiment 1 replicate the non-linearity found in recent studies, the results of Experiment 2 suggest that the non-linearity is due to the semantic nature of Experiment 1, and that there is a positive monotonous relation between MISC and discomfort in practice. These results support the suitability of MISC to assess motion sickness.

The relationship between the amplitude of motion and the accumulation of motion sickness in time is unclear. Here, we investigated this relationship at the individual and group level. Seventeen participants were exposed to four oscillatory motion stimuli, in four separate sessions, separated by at least 1 week to prevent habituation. Motion amplitude was varied between sessions at either 1, 1.5, 2, or 2.5 ms⁻². Time evolution was evaluated within sessions applying: an initial motion phase for up to 60 min, a 10-min rest, a second motion phase up to 30 min to quantify hypersensitivity and lastly, a 5-min rest. At both the individual and the group level, motion sickness severity (MISC) increased linearly with respect to acceleration amplitude. To analyze the evolution of sickness over time, we evaluated three variations of the Oman model of nausea. We found that the slow (502 s) and fast (66.2 s) time constants of motion sickness were independent of motion amplitude, but varied considerably between individuals (slow STD = 838 s; fast STD = 79.4 s). We also found that the Oman model with output scaling following a power law with an exponent of 0.4 described our data much better as compared to the exponent of 2 proposed by Oman. Lastly, we showed that the sickness forecasting accuracy of the Oman model depended significantly on whether the participants had divergent or convergent sickness dynamics. These findings have methodological implications for pre-experiment participant screening, as well as online tuning of automated vehicle algorithms based on sickness susceptibility.