Merging onto a highway is a safety-critical task resulting in a large number of traffic accidents; fundamental research into merging behavior of human drivers can help reduce this toll. Two cognitive processes critical to merging, attention allocation and decision making, have been extensively studied in real-world and simulated driving scenarios. However, how these processes interact during highway merging remains poorly understood. While the relationship between attention and decision making has been widely examined in cognitive science, this work has largely relied on simple decision-making paradigms involving choices between static items on a computer screen, which limits the understanding of more dynamic and naturalistic decisions such as in driving. To address this gap, we investigated the relationship between attention and decision making in a simplified highway merging task. In a video-based experiment, participants (N=24) repeatedly made merging gap acceptance decisions based on the dynamic information about the distance and time-to-arrival to the end of the merging lane and the gap to the target-lane vehicle (available in the front view and the side mirror, respectively). Participants’ decisions, response times, and eye movements were recorded. We found that decisions to accept a gap were considerably faster than decisions to reject a gap. Decision outcomes and timing depended on the distance to and time-to-arrival of the target-lane vehicle, but also on the time pressure due to approaching the end of the merging lane. Most importantly, under high time pressure, a greater proportion of time spent looking at the side mirror was associated with a lower probability of accepting the gap. This finding indicates that differences in visual information sampling can be closely linked to decision outcomes when time budgets are constrained. Our results provide initial empirical insights relevant for future cognitive modeling of the interplay between decision making and attention during highway merging. This work can inform early-stage exploration of driver monitoring and support systems for partially automated driving.

The use of situation awareness (SA) measures to assess relative safety in driving is common, with higher levels of SA being interpreted as safer. These relative interpretations do not allow researchers to determine whether the level of SA could be considered “safe” or “unsafe”. In contrast to such interpretations based on relative performance, the current position paper explores the potential for a normative interpretation of situation awareness with regard to safety assessment in driving. A series of expert interviews yielded viewpoints on the current relation between SA and safe driving, theoretical underpinnings for a normative approach, and potential actions towards an SA criterion for safe or unsafe driving. Methodological challenges regarding a normative approach are discussed together with considerations towards a weighted criterion-based approach to SA. The selection of SA requirements relevant for safety and the differentiation and weighting of these requirements on high and lower importance is presented. A method towards objective determination of relevance and weight of SA requirements may increase the usefulness of SA measures for assessment of safety in a driving context.

Despite extensive prevention, speeding remains a major contributor to traffic casualties. Understanding drivers’ perceived awareness and the subjective reasons for their speed behaviour could improve intervention strategies, and specifically inform the potential of speed feedback. A self-confrontation study was conducted in which 25 regular drivers recorded one of their drives using GoPro cameras, capturing both the road view and their speed, and selected video excerpts were later discussed with these participants. The study explored participants’ awareness and reasons for their speed behaviour, as well as general attitudes towards speeding, perceptions of its problematic nature, the acceptability of exceeding speed limits, and decision-making in speed choice. This study design aimed to provide an objective basis for the interviews and reduce recall biases. The results revealed that drivers show a latent awareness of their speeding behaviour, which they most often justified as usual, normal and safe. This general tolerance towards speeding suggests the normalisation of speed violations. As a result, individual safety interventions, such as feedback on driving behaviour, may not be effective. Prevention efforts should focus on changing norms, common beliefs and systemic factors regarding speeding.

The advent of self-driving cars has sparked discussions about eye contact in traffic, particularly due to challenges that automated vehicles face in non-verbal communication with human road users. In his 1992 book, Turn Signals Are The Facial Expressions Of Automobiles, Don Norman describes how drivers in Mexico City deliberately avoid eye contact when entering a roundabout to create uncertainty in the minds of other drivers, leading the latter to yield right of way. Norman argued that such manipulative or aggressive behavior would not be tolerated in the United States. In the present study, we tested these claims through an online survey involving 3,857 respondents from 20 countries. The results confirmed that Mexican drivers reported a higher frequency of non-speeding ‘aggressive’ violations compared to those from most other countries. Regarding eye contact in the roundabout scenario presented in the survey, national differences were found not so much in the frequency of eye contact but in the reasons behind its use. Mexican drivers tended to avoid eye contact to reduce tension or avoid conflict with other drivers. However, they also frequently reported making eye contact to assert or subtly enforce their right of way. In higher-income countries like the United States, driver-driver eye contact is often deemed unnecessary. In conclusion, our findings partially correspond with Norman's anecdote based on his experiences in 1950s Mexico City. These results may have implications for understanding the stability of traffic cultures and the challenges related to eye contact and non-verbal communication faced by developers of automated vehicles.

Many of the commentators use the opportunity to highlight the value of Ergonomics and Human Factors (EHF) and challenge the notion that the discipline is fading. In response, we argue that EHF science is lagging behind the rapid developments in AI, remains entrenched in past-century achievements, and is in decline. Indices such as membership counts, conference attendance numbers, and new regulations reflect activity, but not necessarily impact. Important questions about human-AI collaboration are being addressed by other disciplines, often without the involvement of EHF. Rather than advocating for systemic frameworks, we advocate for new skill development and the adoption of data-driven AI methods. To illustrate the potential of AI within EHF, we demonstrate how a vision-language model can replicate findings from a classic knobs-and-dials study. In conclusion, we acknowledge EHF’s knowledge base but foresee existential risks unless the field undergoes major reforms to remain relevant in an AI-dominated future.

Recent advancements in AI have accelerated the evolution of versatile robot designs. Chess provides a standardized environment for evaluating the impact of robot behavior on human behavior. This article presents an open-source chess robot for human-robot interaction research, specifically focusing on verbal and non-verbal interactions. The OpenChessRobot recognizes chess pieces using computer vision, executes moves, and interacts with the human player through voice and robotic gestures. We detail the software design, provide quantitative evaluations of the efficacy of the robot, and offer a guide for its reproducibility. An online survey examining people’s views of the robot in three possible scenarios was conducted with 597 participants. The robot received the highest ratings in the robotics education and the chess coach scenarios, while the home entertainment scenario received the lowest scores. The code is accessible on GitHub: https://github.com/renchizhhhh/OpenChessRobot.

BACKGROUND: Head-mounted displays can be used to offer personalized immersive virtual reality (IVR) training for patients who have suffered an Acquired Brain Injury (ABI) by tailoring the complexity of visual and auditory stimuli to the patient's cognitive capabilities. However, it is still an open question how these virtual environments should be designed. METHODS: We used a human-centered design approach to help define the characteristics of suitable virtual training environments for ABI patients. We conducted (i) observations, (ii) interviews with eleven neurorehabilitation experts, and (iii) an online questionnaire with 24 neurorehabilitation experts to examine how therapists modify current training environments to promote patients' recovery in conventional sensorimotor neurorehabilitation settings. Finally, (iv) we involved eight neurorehabilitation experts in a participatory design workshop to co-create examples of IVR training environments. RESULTS: Five phases of the recovery process (Screening, Planning, Training, Reflecting, and Discharging) and six key themes describing the characteristics of suitable (physical) training environments (Specific, Meaningful, Versatile, Educational, Safe, and Supportive) were identified. The experts agreed that modulating the number of elements (e.g., objects, people) or distractions (e.g., background noise) in the physical training environment enables therapists to provide their patients with suitable conditions to execute functional tasks. Additionally, the experts highlighted the importance of developing IVR training environments that are meaningful and realistic. CONCLUSIONS: Through consultations with neurorehabilitation experts, we gained insights into how therapists adjust physical training environments to promote the execution of functional sensorimotor tasks in patients with diverse cognitive capabilities. Their recommendations on how to modulate and make IVR environments meaningful may contribute to increased motivation and skill transfer. Future studies on IVR-based neurorehabilitation should involve patients themselves.

This study describes the impact of ChatGPT use on the nature of work from the perspective of academics and educators. We elucidate six phenomena: (1) the cognitive workload associated with conducting Turing tests to determine if ChatGPT has been involved in work productions; (2) the ethical void and alienation that result from recondite ChatGPT use; (3) insights into the motives of individuals who fail to disclose their ChatGPT use, while, at the same time, the recipient does not reveal their awareness of that use; (4) the sense of ennui as the meanings of texts dissipate and no longer reveal the sender’s state of understanding; (5) a redefinition of utility, wherein certain texts show redundancy with patterns already embedded in the base model, while physical measurements and personal observations are considered as unique and novel; (6) a power dynamic between sender and recipient, inadvertently leaving non-participants as disadvantaged third parties. This paper makes clear that the introduction of AI tools into society has far-reaching effects, initially most prominent in text-related fields, such as academia. Whether these implementations represent beneficial innovations for human prosperity, or a rather different line of social evolution, represents the pith of our present discussion.

To obtain a driver’s licence, one must successfully complete a practical driving test and a theory test. Although the theory test is widely regarded as an important element of driving competence, little is known about the predictors of theory test performance, and in particular the extent to which the acquired knowledge is retained over the years. All individuals who passed a car theory test in the Netherlands between November 2019 and October 2023 were invited to complete a questionnaire, which included a retention test (i.e., a representative retake test) consisting of 20 items not used before. The results based on 50,857 respondents revealed that those with a lower level of education exhibited lower performance on the retention test. Moreover, respondents who took a course with an instructor, an approach mostly used by those with a lower level of education, had a relatively high likelihood of passing the official car theory test on the first attempt. It was also found that the extent to which knowledge increased or decreased over the years was item-dependent, a pattern possibly explained by whether the test item measures functionally relevant driving experiences or if it primarily assesses isolated rules. The results of this study are relevant for training institutes and policymakers.

Attention bias towards social threat has been linked to loneliness and anxiety, though findings are mixed and concerns about measurement reliability persist. This study examined whether state and trait loneliness, along with personality, self-esteem, social anxiety, and life satisfaction, are associated with attention bias towards social threat images (indicating rejection or exclusion) in young adults (N = 241). AI-generated images were used to enhance control over stimulus content and category distinctions. Participants completed an eye-tracking free-viewing task comprising 40 image matrices (four images per matrix, displayed for 6000 ms). We then computed attention bias (dwell time percentage, total fixation duration percentage, and fixation count percentage) and initial orientation of attention (first fixation percentage). The attention bias measures showed adequate-to-good internal consistency (α = 0.61–0.86). No significant associations emerged between loneliness and attention to socially threatening stimuli, suggesting that heightened vigilance to social threat may not be a feature of loneliness in non-clinical young adults. However, it was found that females exhibited greater attention to social positive images, and baseline pupil diameter was associated with social anxiety. Future research should assess whether loneliness-specific attention bias is a replicable phenomenon, ideally by using an extreme-sampling approach with very lonely individuals.

As automated vehicles (AVs) become increasingly popular, the question arises as to how cyclists will interact with such vehicles. This study investigated (1) whether cyclists spontaneously notice if a vehicle is driverless, (2) how well they perform a driver-detection task when explicitly instructed, and (3) how they carry out these tasks. Using a Wizard-of-Oz method, 37 participants cycled a designated route and encountered an AV multiple times in two experimental sessions. In Session 1, participants cycled the route uninstructed, while in Session 2, they were instructed to verbally report whether they detected the presence or absence of a driver. Additionally, we recorded participants’ gaze behaviour with eye-tracking and their responses in post-session interviews. The interviews revealed that 30% of the cyclists spontaneously mentioned the absence of a driver (Session 1), and when instructed (Session 2), they detected the absence and presence of the driver with 93% accuracy. The eye-tracking data showed that cyclists looked more frequently and for longer at the vehicle in Session 2 compared to Session 1. Additionally, participants exhibited intermittent sampling of the vehicle, and they looked at the area in front of the vehicle when it was far away and towards the windshield region when it was closer. The post-session interviews also indicated that participants were curious, but felt safe, and reported a need to receive information about the AV's driving state. In conclusion, cyclists can detect the absence of a driver in the AV, and this detection may influence their perception of safety. Further research is needed to explore these findings in real-world traffic conditions.

This driving simulator study, which focused on supporting drivers through feedback rather than automating the driving task, examined the effect of real-time feedback based on different stages of information processing on driving behaviour. The stages investigated included providing information alone, assessment of that information, and a decision based on that assessment, following Parasuraman, Sheridan, and Wickens’s (2000) model of information-processing automation. The acceptability and effectiveness of the different stages of feedback were assessed on two key driving behaviours: speed and distance from the vehicle ahead. The results indicated that feedback had a limited effect on driving behaviour. However, the stage of information processing in the feedback did affect a number of outcomes, with decision-oriented feedback leading to improved behaviours but less favourable attitudinal results. Future safety interventions should consider altering risk perception and beliefs, or providing external motivation for behavioural change.

Robots are becoming more capable and can autonomously perform tasks such as navigating between locations. However, human oversight remains crucial. This study compared two touchless methods for directing mobile robots: voice control and gesture control, to investigate the efficiency of these methods and the preference of users. We tested these methods in two conditions: one in which participants remained stationary and one in which they walked freely alongside the robot. We hypothesized that walking alongside the robot would result in higher intuitiveness ratings and improved task performance, based on the idea that walking promotes spatial alignment and reduces the effort required for mental rotation. In a 2×2 within-subject design, 218 participants guided the quadruped robot Spot along a circuitous route with multiple 90° turns using rotate left, rotate right, and walk forward commands. After each trial, participants rated the intuitiveness of the command mapping, while post-experiment interviews were used to gather the participants’ preferences. Results showed that voice control combined with walking with Spot was the most favored and intuitive, whereas gesture control while standing caused confusion for left/right commands. Nevertheless, 29% of participants preferred gesture control, citing increased task engagement and visual congruence as reasons. An odometry-based analysis revealed that participants often followed behind Spot, particularly in the gesture control condition, when they were allowed to walk. In conclusion, voice control with walking produced the best outcomes. Improving physical ergonomics and adjusting gesture types could make gesture control more effective.

Neuroscience evidence suggests that personalized, task-specific, high-intensity training is essential for maximizing recovery after acquired brain injury. Robotic devices combined with immersive virtual reality (VR) games, visualized through head-mounted displays (HMDs), can support such intensive training within naturalistic virtual environments with audio-visual stimuli tailored to individual needs. However, the impact of these auditory and visual demands on cognitive load remains an open question. To address this, we conducted an experiment with 22 healthy participants to explore how varying levels of visual, auditory, and cognitive demands affect users’ cognitive load and performance during a shopping task in immersive VR. We found that mental demand had the most significant impact on increasing cognitive load and hampering task performance. Visual demands, although affecting gaze behavior, did not significantly affect cognitive load or performance. Auditory demands showed small effects on cognitive load.

As automated vehicles (AVs) become increasingly popular, the question arises as to how cyclists will interact with such vehicles. This study investigated (1) whether cyclists spontaneously notice if a vehicle is driverless, (2) how well they perform a driver-detection task when explicitly instructed, and (3) how they carry out these tasks. Using a Wizard-of-Oz method, 37 participants cycled a designated route and encountered an AV multiple times in two experimental sessions. In Session 1, participants cycled the route uninstructed, while in Session 2, they were instructed to verbally report whether they detected the presence or absence of a driver. Additionally, we recorded participants' gaze behaviour with eye-tracking and their responses in post-session interviews. The interviews revealed that 30% of the cyclists spontaneously mentioned the absence of a driver (Session 1), and when instructed (Session 2), they detected the absence and presence of the driver with 93% accuracy. The eye-tracking data showed that cyclists looked more frequently and for longer at the vehicle in Session 2 compared to Session 1. Additionally, participants exhibited intermittent sampling of the vehicle, and they looked at the area in front of the vehicle when it was far away and towards the windshield region when it was closer. The post-session interviews also indicated that participants were curious, but felt safe, and reported a need to receive information about the AV's driving state. In conclusion, cyclists can detect the absence of a driver in the AV, and this detection may influence their perception of safety. Further research is needed to explore these findings in real-world traffic conditions.

Automated vehicles pose a unique challenge to the safety of vulnerable road users. Research on cyclist-automated vehicle interaction has received relatively little attention compared to pedestrian safety. This exploratory study aims to bridge this gap by identifying cyclist-automated vehicle scenarios and providing recommendations for future research. In this study, we triangulated three sources: a systematic literature review of previous research on cyclists and automated vehicles, group interviews with eight traffic safety and automation experts, and questionnaire data. The resulting scenario collection comprised 20 prototypical scenarios of cyclist-automated vehicle interaction, grouped into four categories based on the road users’ direction of movement: crossing, passing, overtaking, and merging scenarios. The survey results indicated that right-turning vehicles, dooring scenarios, and more complex situations have the highest likelihood of accidents. Passing and merging scenarios are particularly relevant for studying automated vehicle communication solutions since they involve negotiation. Future research should also consider phantom braking and driving styles of vehicles, as well as programming proactive safety behaviours and designing on-vehicle interfaces that accommodate cyclists.

Marie Skłodowska-Curie Actions; Innovative Training Networks (ITN); SHAPE-IT; Grant number 860410

Publication date: 31 December 2023

DOI: 10.1016/j.trip.2023.100986

Many collisions between pedestrians and cars are caused by poor visibility, such as occlusion by a parked vehicle. Augmented reality (AR) could help to prevent this problem, but it is unknown to what extent the augmented information needs to be embedded into the world. In this virtual reality experiment with a head-mounted display (HMD), 28 participants were exposed to AR designs, in a scenario where a vehicle approached from behind a parked vehicle. The experimental conditions included a head-locked live video feed of the occluded region, meaning it was fixed in a specific location within the view of the HMD (VideoHead), a world-locked video feed displayed across the street (VideoStreet), and two conformal diminished reality designs: a see-through display on the occluding vehicle (VideoSeeThrough) and a solution where the occluding vehicle has been made semi-transparent (TransparentVehicle). A Baseline condition without augmented information served as a reference. Additionally, the VideoHead and VideoStreet conditions were each tested with and without the addition of a guiding arrow indicating the location of the approaching vehicle. Participants performed 42 trials, 6 per condition, during which they had to hold a key when they felt safe to cross. The keypress percentages and responses from additional questionnaires showed that the diminished-reality TransparentVehicle and VideoSeeThrough designs came out most favourably, while the VideoHead solution caused some discomfort and dissatisfaction. An analysis of head yaw angle showed that VideoHead and VideoStreet caused divided attention between the screen and the approaching vehicle. The use of guiding arrows did not contribute demonstrable added value. AR designs with a high level of local embeddedness are beneficial for addressing occlusion problems when crossing. However, the head-locked solutions should not be immediately dismissed because, according to the literature, such solutions can serve tasks where a salient warning or instruction is beneficial.

Marie Skłodowska-Curie Actions; Innovative Training Networks (ITN); SHAPE-IT; Grant number 860410

Publication date: 27 May 2024

DOI: 10.1007/s10055-024-01017-9

The emerging use of automated driving systems introduces novel situations that may affect the safety of vulnerable road users such as cyclists. In this paper, we explain and conceptualise the phenomenon of phantom braking – sudden and unexpected deceleration – in automated vehicles. We apply signal detection theory to interpret phantom braking as a by-product of automated decision-making, with the vehicle favouring the avoidance of accidents at the cost of potentially causing rear-end accidents. To illustrate phantom braking and its effects on cyclists, we used a newly developed cycling simulator. An exploratory measurement conducted with a single cyclist participant revealed a possible complacency effect of the cyclist, with the cyclist’s decision-making mirroring the automated vehicle’s decision-making. The findings provide a testament to using cycling simulators for further exploration of the effects of phantom braking on cyclists.

Marie Skłodowska-Curie Actions; Innovative Training Networks (ITN); SHAPE-IT; Grant number 860410

DOI: 10.54941/ahfe1005212

Personality research has traditionally relied on questionnaires, which bring with them inherent limitations, such as response style bias. With the emergence of large language models such as ChatGPT, the question arises as to what extent these models can be used in personality research. In this study, ChatGPT (GPT-4) generated 2000 text-based personas. Next, for each persona, ChatGPT completed a short form of the Big Five Inventory (BFI-10), the Brief Sensation Seeking Scale (BSSS), and a Short Dark Triad (SD3). The mean scores on the BFI-10 items were found to correlate strongly with means from previously published research, and principal component analysis revealed a clear five-component structure. Certain relationships between traits, such as a negative correlation between the age of the persona and the BSSS score, were clearly interpretable, while some other correlations diverged from the literature. An additional analysis using four new sets of 2000 personas each, including a set of ‘realistic’ personas and a set of cinematic personas, showed that the correlation matrix among personality constructs was affected by the persona set. It is concluded that evaluating questionnaires and research hypotheses prior to engaging with real individuals holds promise.

There is a need to improve the validity of the driving test as a measure of an individual’s ability to drive safely. This paper explores the use of algorithms to analyze acceleration and GPS data from a smartphone and a GoPro to distinguish between different driving styles, as performed by experienced examiners portraying stereotypical driving test candidates. Measures from nine driving tests were analyzed, including (harsh) accelerations, jerk, mean speed, and speeding. Results showed that the type of car, instructed driving style, and driving route impacted the dependent measures. It is concluded that GPS and accelerometer data can effectively distinguish between cautious, normal, and aggressive driving. However, it is important to consider additional sensors, such as cameras, to allow for more context-aware assessments of driving behavior. Furthermore, we demonstrate methods to quantify variations in road conditions and provide suggestions for presenting the data to driving examiners.