Light detection and ranging (LiDAR) plays a crucial role in machine perception for advanced driver assistance systems. Existing LiDARs, however, do not adapt their sensing strategy to complement driver's perception. We demonstrate a novel LiDAR prototype that dynamically adapts its range and resolution over the field of view, according to real-time driver gaze. Our gaze-aware LiDAR emphasizes scanning peripheral zones the driver may overlook, i.e., critical areas during driving. Our demonstration showcases enhanced perception, highlighting the potential of hybrid human-machine sensing for safer driving.

One of the key issues in human-robot collaboration is the development of computational models that allow robots to predict and adapt to human behavior. Much progress has been achieved in developing such models, as well as control techniques that address the autonomy problems of motion planning and decision-making in robotics. However, the integration of computational models of human behavior with such control techniques still poses a major challenge, resulting in a bottleneck for efficient collaborative human-robot teams. In this context, we present a novel architecture for human-robot collaboration: Adaptive Robot Motion for Collaboration with Humans using Adversarial Inverse Reinforcement learning (ARMCHAIR). Our solution leverages adversarial inverse reinforcement learning and model predictive control to compute optimal trajectories and decisions for a mobile multi-robot system that collaborates with a human in an exploration task. During the mission, ARMCHAIR operates without human intervention, autonomously identifying the necessity to support and acting accordingly. Our approach also explicitly addresses the network connectivity requirement of the human-robot team. Extensive simulation-based evaluations demonstrate that ARMCHAIR allows a group of robots to safely support a simulated human in an exploration scenario, preventing collisions and network disconnections, and improving the overall performance of the task.

Partially automated driving systems are designed to perform specific driving tasks—such as steering, accelerating, and braking—while still requiring human drivers to monitor the environment and intervene when necessary. This shift of driving responsibilities from human drivers to automated systems raises concerns about accountability, particularly in scenarios involving unexpected events. To address these concerns, the concept of meaningful human control (MHC) has been proposed. MHC emphasises the importance of humans retaining oversight and responsibility for decisions made by automated systems. Despite extensive theoretical discussion of MHC in driving automation, there is limited empirical research on how real-world partially automated systems align with MHC principles. This study offers two main contributions: (1) an empirical evaluation of MHC in partially automated driving, based on 103 semi-structured interviews with users of Tesla's Autopilot and Full Self-Driving (FSD) Beta systems; and (2) a methodological framework for assessing MHC through qualitative interview data. We operationalise the previously proposed tracking and tracing conditions of MHC using a set of evaluation criteria to determine whether these systems support meaningful human control in practice. Our findings indicate that several factors influence the degree to which MHC is achieved. Failures in tracking—where drivers' expectations regarding system safety are not adequately met—arise from technological limitations, susceptibility to environmental conditions (e.g., adverse weather or inadequate infrastructure), and discrepancies between technical performance and user satisfaction. Tracing performance—the ability to clearly assign responsibility—is affected by inconsistent adherence to safety protocols, varying levels of driver confidence, and the specific driving mode in use (e.g., Autopilot versus FSD Beta). These findings contribute to ongoing efforts to design partially automated driving systems that more effectively support meaningful human control and promote more appropriate use of automation.

Understanding how human drivers handle inter-actions with each other can aid the development of automated vehicles capable of operating in mixed traffic. Interactions between human drivers are often complex, so driver behavior models are needed to better understand them. However, existing models mostly focus on the behavior of one driver, which limits their ability to explain complex reciprocal interactions between multiple drivers. At the same time, the prior research that does focus on interactive behaviors of two or more drivers is typically limited to describing drivers' tactical decisions, limiting the understanding of how these decisions are related to operational aspects of behavior (safety margins and control inputs). In this work, we address this gap, focusing specif-ically on highway merging interactions. We build upon the Communication-Enabled Interactions (CEI) framework - a previously proposed holistic approach to interaction modeling. We develop a CEI-based model of highway merging that captures both tactical and operational aspects of the behavior of two drivers interacting in a highway merging scenario. Our model exhibits human-like behavior aligned with empirical observations of high-level decisions (i.e., who goes first?), safety margins (headways), and position and velocity profiles. Based on our model, we identify key mechanisms regarding drivers' beliefs, velocity perception, and planning, which can potentially generalize beyond highway merging to other interactive human driving behaviors. Our findings highlight the potential of the CEI framework in modeling reciprocal traffic interactions in realistic traffic scenarios, and contribute to understanding the complexities of interactions between human drivers.

Home-based rehabilitation is essential for stroke survivors, facilitating motor recovery and improving activities-of-daily-life performance. Recent advances in wearable technologies and machine learning promise to revolutionize home-based arm rehabilitation by providing detailed movement analysis. However, machine learning algorithms for arm movement identification are predominantly trained and tested in the same environments. Their ability to generalize to novel environments remains largely unknown, hindering practical applications. This paper investigates the ability of two established machine learning models to generalize a structured, lab-based environment to a more realistic, semi-structured kitchen environment. Twelve healthy participants performed various arm activities, involving three arm movement types (reaching, lifting, and pronation/supination). In addition to evaluating the generalization of movement identification, we compared algorithm performance for two different sensor configurations: four Inertial Measurement Units (IMUs) on the arm versus a single IMU on the wrist. We employed a Random Forest (RF) classifier and a hybrid deep learning model combining convolutional and recurrent neural networks, evaluating both subject-specific and group approaches. Trained in the structured environment, the RF classifier predicted activities in the semi-structured environment with 86.54% (subject-specific) and 77.37% (group) balanced accuracy, based on the four-sensor configuration, while the hybrid model reached 87.96% and 82.96% accuracy. The accuracy was lower with a single wrist IMU; the RF classifier showed a smaller decrease than the hybrid model. Our findings demonstrate that the investigated arm movement identification algorithms generalize well across environments even with the minimal sensor configuration, indicating the potential for future applications in home-based stroke rehabilitation.

Detecting abnormal driving behavior is critical for road traffic safety and the evaluation of drivers’ behavior. With the advancement of machine learning (ML) algorithms and the accumulation of naturalistic driving data, many ML models have been adopted for abnormal driving behavior detection (also referred to in this paper as “anomalies”). Most existing ML-based detectors rely on (fully) supervised ML methods, which require substantial labeled data. However, ground truth labels are not always available in the real world, and labeling large amounts of data is tedious. Thus, there is a need to explore unsupervised or semi-supervised methods to make the anomaly detection process more feasible and efficient. To fill this research gap, this study analyzes large-scale real-world data revealing several abnormal driving behaviors (e.g., sudden acceleration, rapid lane-changing) and develops a hierarchical extreme learning machine (HELM)-based semi-supervised ML method using partly labeled data to accurately detect the identified abnormal driving behaviors. Moreover, previous ML-based approaches predominantly utilized basic vehicle motion features (such as velocity and acceleration) to label and detect abnormal driving behaviors, while this study seeks to introduce event-level safety indicators as input features for ML models to improve the detection performance. Results from extensive experiments demonstrate the effectiveness of the proposed semi-supervised ML model with the introduced safety indicators serving as important features. The proposed semi-supervised ML method outperforms other baseline semi-supervised or unsupervised methods as far as various metrics are concerned: for example, it delivers the best accuracy at 99.58% and the best F1-score at 0.9913. The ablation study further highlights the significance of safety indicators for advancing the detection performance of abnormal driving behaviors.

The introduction of automated driving systems (ADS) presents significant regulatory and operational challenges to ensure safe and responsible deployment in mixed traffic environments. Despite much academic work and efforts of practitioners, these challenges remain open, requiring a transdisciplinary integration of perspectives. This paper draws on insights from a recent transdisciplinary workshop, highlighting the key issues in ADS deployment, including misalignment between regulations and system capabilities, emerging accident types, and gaps in driver understanding and training. Current regulations struggle to keep pace with the advancing capabilities of ADS, resulting in unclear accountability frameworks and inadequate safety measures. The concept of meaningful human control was used as a basis to identify issues. Workshop participants agreed that meaningful human control has an essential role to play to address the identified issues by ensuring that humans can adequately interact with ADS and that ADS are designed in a manner that ensures safe and responsible deployment with clear fail-safes and redundancy mechanisms. The paper advocates for meaningful human control through continuous driver and vehicle assessment, dynamic safety certifications, and stronger communication between regulators and manufacturers to ensure safe and responsible design, regulation and deployment of automated vehicles. Implementing these actions will strengthen ADS regulation and help navigate the ethical and operational complexities of automated driving systems.

Background: Robotic devices have shown promise in supporting motor (re)learning. However, there is a limited understanding of how personality traits influence the effectiveness of robot-aided training strategies. Methods: We conducted a motor learning experiment with 40 unimpaired participants who trained to control a virtual pendulum using a robotic haptic device. Before the experiment, we assessed personality traits including the perceived control over life events (Locus of Control), the tendency to turn challenges into engaging activities (Transform of Challenge), and other subscales from Autotelic and Hexad gaming style questionnaires. Participants were divided into two groups, one receiving haptic guidance during training and a second one without assistance. Short- and long-term retention was assessed, and relationships between personality traits, performance metrics, and human-robot interaction metrics were analyzed. Results: Participants with high Transform of Challenge or external Locus of Control characteristics who received physical guidance during training reduced the human-robot interaction forces to a lesser extent compared to the ones who did not receive guidance. Additionally, participants with a high Free Spirit gaming style showed greater sensitivity to how their perception of the guidance affected their performance during the retention phases. Conclusion: Our findings suggest that autotelic personality, Locus of Control, and gaming style modulate motor learning outcomes during robotic-assisted training, affecting both performance and human-robot interaction metrics. This highlights the potential of integrating personality-based adaptations in robot-aided rehabilitation protocols to enhance performance and motor (re)learning. Future works should explore the relationship between personality traits and psychological states (e.g., perceived difficulty, attention) across diverse tasks and guidance methods in clinical populations.

Ensuring safe interactions between autonomous vehicles (AVs) and human drivers in mixed traffic systems remains a major challenge, particularly in complex, high-risk scenarios. This paper presents a cognition-decision framework that integrates individual variability and commonalities in driver behavior to quantify risk cognition and model dynamic decision-making. First, a risk sensitivity model based on a multivariate Gaussian distribution is developed to characterize individual differences in risk cognition. Then, a cognitive decision-making model based on the drift diffusion model (DDM) is introduced to capture common decision-making mechanisms in high-risk environments. The DDM dynamically adjusts decision thresholds by integrating initial bias, drift rate, and boundary parameters, adapting to variations in speed, relative distance, and risk sensitivity to reflect diverse driving styles and risk preferences. By simulating high-risk scenarios with lateral, longitudinal, and multidimensional risk sources in a driving simulator, the proposed model accurately predicts cognitive responses and decision behaviors during emergency maneuvers. Specifically, by incorporating driver-specific risk sensitivity, the model enables dynamic adjustments of key DDM parameters, allowing for personalized decision-making representations in diverse scenarios. Comparative analysis with IDM, Gipps, and MOBIL demonstrates that DDM more precisely captures human cognitive processes and adaptive decision-making in high-risk scenarios. These findings provide a theoretical basis for modeling human driving behavior and offer critical insights for enhancing AV-human interaction in real-world traffic environments.

Understanding behavior of human drivers in interactions with automated vehicles (AV) can aid the development of future AVs. Existing investigations of such behavior have predominantly focused on situations in which an AV a priori needs to take action because the human has the right of way. However, future AVs might need to proactively manage interactions even if they have the right of way over humans, e.g., a human driver taking a left turn in front of the approaching AV. Yet it remains unclear how AVs could behave in such interactions and how humans would react to them. To address this issue, here we investigated behavior of human drivers (N = 19) when interacting with an oncoming AV during unprotected left turns in a driving simulator experiment. We measured the outcomes (Go or Stay) and timing of participants’ decisions when interacting with an AV which performed subtle longitudinal nudging maneuvers, e.g. briefly decelerating and then accelerating back to its original speed. We found that participants’ behavior was sensitive to deceleration nudges but not acceleration nudges. We compared the obtained data to predictions of several variants of a drift-diffusion model of human decision making. The most parsimonious model that captured the data hypothesized noisy integration of dynamic information on time-to-arrival and distance to a fixed decision boundary, with an initial accumulation bias towards the Go decision. Our model not only accounts for the observed behavior but can also flexibly generate predictions of human responses to arbitrary longitudinal AV maneuvers, and can be used for both informing future studies of human behavior and incorporating insights from such studies into computational frameworks for AV interaction planning.

Traffic jams occurring on highways cause increased travel time as well as increased fuel consumption and collisions. So-called phantom traffic jams are traffic jams that do not have a clear cause, such as a merging on-ramp or an accident. Phantom traffic jams make up 50% of all traffic jams and result from instabilities in the traffic flow that are caused by human driving behavior. Automating the longitudinal vehicle motion of only 5% of all cars in the flow can dissipate phantom traffic jams. However, driving automation introduces safety issues when human drivers need to take over the control from the automation. We investigated whether phantom traffic jams can be dissolved using haptic shared control. This keeps humans in the loop and thus bypasses the problem of humans’ limited capacity to take over control, while benefiting from most advantages of automation. In an experiment with 24 participants in a driving simulator, we tested the effect of haptic shared control on the dynamics of traffic flow and compared it with manual control and full automation. We also investigated the effect of two control types on participants’ behavior during simulated silent automation failures. Results show that haptic shared control can help dissipating phantom traffic jams better than fully manual control but worse than full automation. We also found that haptic shared control reduces the occurrence of unsafe situations caused by silent automation failures compared to full automation. Our results suggest that haptic shared control can dissipate phantom traffic jams while preventing safety risks associated with full automation.

Traffic interactions between merging and highway vehicles are a major topic of research, yielding many empirical studies and models of driver behaviour. Most of these studies on merging use naturalistic data. Although this provides insight into human gap acceptance and traffic flow effects, it obscures the operational inputs of interacting drivers. Besides that, researchers have no control over the vehicle kinematics (i.e., positions and velocities) at the start of the interactions. Therefore the relationship between initial kinematics and the outcome of the interaction is difficult to investigate. To address these gaps, we conducted an experiment in a coupled driving simulator with a simplified, top-down view, merging scenario with two vehicles. We found that kinematics can explain the outcome (i.e., which driver merges first) and the duration of the merging conflict. Furthermore, our results show that drivers use key decision moments combined with constant acceleration inputs (intermittent piecewise-constant control) during merging. This indicates that they do not continuously optimise their expected utility. Therefore, these results advocate the development of interaction models based on intermittent piecewise-constant control. We hope our work can contribute to this development and to the fundamental knowledge of interactive driver behaviour.

Predicting the future behavior of human road users is an important aspect for the development of risk-aware autonomous vehicles. While many models have been developed towards this end, effectively capturing and predicting the variability inherent to human behavior still remains an open challenge. This paper proposes TrajFlow - a new approach for probabilistic trajectory prediction based on Normalizing Flows. We reformulate the problem of capturing distributions over trajectories into capturing distributions over abstracted trajectory features using an autoencoder, simplifying the learning task of the Normalizing Flows. TrajFlow outperforms state-of-the-art behavior prediction models in capturing full trajectory distributions in two synthetic benchmarks with known true distributions, and is competitive on the naturalistic datasets ETH/UCY, rounD, and nuScenes. Our results demonstrate the effectiveness of TrajFlow in probabilistic prediction of human behavior.

Autonomous vehicles rely on accurate trajectory prediction to inform decision-making processes related to navigation and collision avoidance. However, current trajectory prediction models show signs of overfitting, which may lead to unsafe or suboptimal behavior. To address these challenges, this paper presents a comprehensive framework that categorizes and assesses the definitions and strategies used in the literature on evaluating and improving the robustness of trajectory prediction models. This involves a detailed exploration of various approaches, including data slicing methods, perturbation techniques, model architecture changes, and post-training adjustments. In the literature, we see many promising methods for increasing robustness, which are necessary for safe and reliable autonomous driving.

This study presents a general optimal trajectory planning (GOTP) framework for autonomous vehicles (AVs) that can effectively avoid obstacles and guide AVs to complete driving tasks safely and efficiently. Firstly, we employ the fifth-order Bezier curve to generate and smooth the reference path along the road centerline. Cartesian coordinates are then transformed to achieve the curvature continuity of the generated curve. Considering the road constraints and vehicle dynamics, limited polynomial candidate trajectories are generated and smoothed in a curvilinear coordinate system. Furthermore, in selecting the optimal trajectory, we develop a unified and auto-tune objective function based on the principle of least action by employing AVs to simulate drivers’ behavior and summarizing their manipulation characteristics of “seeking benefits and avoiding losses.” Finally, by integrating the idea of receding-horizon optimization, the proposed framework is achieved by considering dynamic multi-performance objectives and selecting trajectories that satisfy feasibility, optimality, and adaptability. Extensive simulations and experiments are performed, and the results demonstrate the framework's feasibility and effectiveness, which avoids both dynamic and static obstacles and applies to various scenarios with multi-source interactive traffic participants. Moreover, we prove that the proposed method can guarantee real-time planning and safety requirements compared to drivers’ manipulation.

The use of partially automated driving systems raises concerns about potential responsibility issues, posing risk to the system safety, acceptance, and adoption of these technologies. The concept of meaningful human control has emerged in response to the responsibility gap problem, requiring the fulfillment of two conditions, tracking and tracing. While this concept has provided important philosophical and design insights on automated driving systems, there is currently little knowledge on how meaningful human control relates to subjective experiences of actual users of these systems. To address this gap, our study aimed to investigate the alignment between the degree of meaningful human control and drivers' perceptions of safety and trust in a real-world partially automated driving system. We utilized previously collected data from interviews with Tesla "Full Self-Driving"(FSD) Beta users, investigating the alignment between the user perception and how well the system was tracking the users' reasons. We found that tracking of users' reasons for driving tasks (such as safe maneuvers) correlated with perceived safety and trust, albeit with notable exceptions. Surprisingly, failure to track lane changing and braking reasons was not necessarily associated with negative perceptions of safety. However, the failure of the system to track expected maneuvers in dangerous situations always resulted in low trust and perceived lack of safety. Overall, our analyses highlight alignment points but also possible discrepancies between perceived safety and trust on the one hand, and meaningful human control on the other hand. Our results can help the developers of automated driving technology to design systems under meaningful human control and are perceived as safe and trustworthy.

The provision of robotic assistance during motor training has proven to be effective in enhancing motor learning in some healthy trainee groups as well as patients. Personalizing such robotic assistance can help further improve motor (re)learning outcomes and cater better to the trainee's needs and desires. However, the development of personalized haptic assistance is hindered by the lack of understanding of the link between the trainee's personality and the effects of haptic guidance during human-robot interaction. To address this gap, we ran an experiment with 40 healthy participants who trained with a robotic device to control a virtual pendulum to hit incoming targets, either with or without haptic guidance. We found that certain personal traits affected how users adapt and interact with the guidance during training. In particular, those participants with an 'Achiever gaming style' performed better and applied lower interaction forces to the robotic device than the average participant as the training progressed. Conversely, participants with the 'Free spirit game style' increased the interaction force in the course of training. We also found an interaction between some personal characteristics and haptic guidance. Specifically, participants with a higher 'Transformation of challenge' trait exhibited poorer performance during training while receiving haptic guidance compared to an average participant receiving haptic guidance. Furthermore, individuals with an external Locus of Control tended to increase their interaction force with the device, deviating from the pattern observed in an average participant under the same guidance. These findings suggest that individual characteristics may play a crucial role in the effectiveness of haptic guidance training strategies.

Safe and socially acceptable interactions with human-driven vehicles are a major challenge in automated driving. A good understanding of the underlying principles of such traffic interactions could help address this challenge. Particularly, accurate driver models could be used to inform automated vehicles in interactions. These interactions entail complex dynamic joint behaviors composed of individual driver contributions in terms of high-level decisions, safety margins, and low-level control inputs. Existing driver models typically focus on one of these aspects, limiting our understanding of the underlying principles of traffic interactions. Here, we present a Communication-Enabled Interaction model based on risk perception, that does not assume humans are rational and explicitly accounts for communication between drivers. Our model can explain and reproduce observed human interactions in a simplified merging scenario on all three levels. Thereby improving our understanding of the underlying mechanisms of human traffic interactions and posing a step towards interaction-aware automated driving.

When a person makes a decision, it is automatically accompanied by a subjective probability judgment of the decision being correct, in other words, a confidence judgment. A better understanding of the mechanisms responsible for these confidence judgments could provide novel insights into human behavior. However, so far confidence judgments have been mostly studied in simplistic laboratory tasks while little is known about confidence in naturalistic dynamic tasks such as driving. In this study, we made a first attempt of connecting fundamental research on confidence with naturalistic driver behavior. We investigated the confidence of drivers in left-turn gap acceptance decisions in a driver simulator experiment (N = 17). We found that confidence in these decisions depends on the size of the gap to the oncoming vehicle. Specifically, confidence increased with the gap size for trials in which the gap was accepted, and decreased with the gap size for rejected gaps. Similarly to more basic tasks, confidence was negatively related to the response times and correlated with action dynamics during decision execution. Finally, we found that confidence judgments can be captured with an extended dynamic drift–diffusion model. In the model, the drift rate of the evidence accumulator as well as the decision boundaries are functions of the gap size. Furthermore, we demonstrated that allowing for post-decision evidence accumulation in the model increases its ability to describe confidence judgments in rejected gap decisions. Overall, our study confirmed that principles known from fundamental confidence research extend to confidence judgments in dynamic decisions during a naturalistic task.

In mixed traffic, one of the challenges for autonomous driving technology is how to safe and socially acceptable interaction with human-driven vehicles (HVs). Understanding human cognitive processes during decision-making in interactions with other road users is crucial for enhancing the smooth execution of driving tasks by autonomous vehicles (AVs). This paper proposes a cognitive model of the driver's cumulative information processing based on drift-diffusion model (DDM). By incorporating the initial decision biases, drift rate, and boundary (depending on the initial speed and gaps between ego vehicle and surrounding users) into the existing DDM, our model captures the integrated interaction between individual drivers and other road users. Classic emergency collision avoidance scenarios were constructed based on a driving simulation platform. Our cognitive model accurately described human decision-making in high-risk scenarios, identified key qualitative and quantitative input variables affecting the driver's cognitive processes, and quantified the safety thresholds of the driver's cumulative information processing. Results can support the personalized modeling of human drivers' cognition and facilitate safe and effective interactions between HVs and AVs.