As we move towards a future with Automated Vehicles (AVs) incorporated in the current traffic system, it is crucial to understand driver-pedestrian interaction, in order to enhance AV design and optimization. Previous research in this area, which has primarily used naturalistic observations or single-actor virtual reality simulations, has been limited by its inability to draw causal conclusions, also due to a lack of real human–human interactions. Our study addresses these limitations by employing a high-fidelity distributed simulation setup that links drivers in a motion-based simulator with pedestrians in a CAVE-based environment. This method allows for the examination of real-time and reciprocal interactions across a range of road-crossing scenarios. Using thirty-two pairs of drivers and pedestrians, we investigated how different factors, such as the presence of zebra crossings and varying time gaps of the approaching vehicle, influence driver behaviour and pedestrian crossing decisions. The effect of drivers’ control of the vehicle during such crossings (e.g., braking behaviour and lateral deviation) on pedestrians’ crossing decisions were also analysed. We found that the distribution of drivers’ average deceleration values were bimodal, where drivers either markedly yielded to pedestrians, or continued in their path, with very few instances of intermediate behaviour. We also found that pedestrian decisions were seemingly influenced by the different braking strategies adopted by the driver, with pedestrians crossing before the vehicles in response to soft and early, or late and hard braking, while late and soft braking often resulted in the vehicle passing first. We also observed a slight lateral movement of the vehicle away from pedestrians when drivers were not yielding, but more of a lateral deviation towards them when yielding. This may be because drivers subconsciously transfer their walking interaction habits to their driving behaviour, to avoid a collision with pedestrians. Finally, our results showed a stronger influence of these kinematic cues on pedestrian crossing decisions, when compared to zebra crossings. As well as highlighting the value of a novel approach for investigating vehicle–pedestrian interactions, this study illustrates how vehicle cues can assist pedestrian decisions, adding new knowledge in the development of human-like behaviour for future AVs.

@en

The driving style of an automated vehicle (AV) needs to be comfortable to encourage the broad acceptance and use of this newly emerging transport mode. However, current research provides limited knowledge about what influences comfort, how this concept is described, and how it is measured. This knowledge is especially lacking when comfort is linked to the AV's driving styles. This paper presents results from an online workshop with nine experts, all with hands-on experience of AVs and a long track record of research in this context. Using online tools, experts were invited to introduce concepts they considered relevant to comfort/discomfort in currently available modes of transport which offer a ride (taxi/bus/train) to users and compare these to the concepts used to define comfort and discomfort in AVs. Results showed that a wide range of terms were used to describe user comfort and discomfort for both modes. Although all terms used for existing vehicles were found to apply to AVs, additional terms were proposed for determining comfort/discomfort of AVs. For example, to enhance comfort in AVs, designers should consider good communication channels, as well as ensuring that the AV's capabilities match users’ expectations. Results also revealed that more terms were used, overall, to define discomfort, and that a comfortable ride in AVs is not just about mitigating discomfort. New concepts specific to AVs were also revealed when considering what increases their discomfort, such as whether riders’ safety and privacy are affected, or if they feel in control. Experts’ input from the workshop was used to enhance and expand a simple conceptual framework, explaining how AV driving styles, as well as other, non-driving-related factors, affect user comfort. It is hoped that this framework provides a more comprehensive list of the concepts affecting user comfort, also allowing more accurate measurement of the concept. As well as allowing for a more accurate comparison between empirical studies measuring comfort in AVs, this study will facilitate the design of more comfortable and acceptable automated driving for future vehicles.

@en

Introduction: Augmented reality (AR) has been increasingly studied in transportation, particularly for drivers and pedestrians interacting with automated vehicles (AVs). Previous research evaluated AR interfaces using online video-based questionnaires but lacked human-subject research in immersive environments. This study examined if prior online evaluations of nine AR interfaces could be replicated in an immersive virtual environment and if AR interface effectiveness depends on pedestrian attention allocation. 

Methods: Thirty participants completed 120 trials in a CAVE-based simulator with yielding and non-yielding AVs, rating the interface’s intuitiveness and crossing the road when they felt safe. To emulate visual distraction, participants had to look into an attention-attractor circle that disappeared 1 s after the interface appeared. 

Results: The results showed that intuitiveness ratings from the current CAVE-based study and the previous online study correlated strongly (r ≈ 0.90). Head-locked interfaces and familiar designs (augmented traffic lights, zebra crossing) yielded higher intuitiveness ratings and quicker crossing initiations than vehicle-locked interfaces. Vehicle-locked interfaces were less effective when the attention-attractor was on the environment’s opposite side, while head-locked interfaces were relatively unaffected by attention-attractor position. 

Discussion: In conclusion, this ‘AR in VR’ study shows strong congruence between intuitiveness ratings in a CAVE-based study and online research, and demonstrates the importance of interface placement in relation to user gaze direction.

@en

As the introduction of automated vehicles (AVs) into road traffic accelerates, establishing user acceptance is increasingly crucial. User comfort, largely influenced by the AVs' driving styles, is one of the essential factors influencing acceptance. This video submission provides a methodological overview of a qualitative interview study, which used a Wizard-of-Oz method to investigate participants' comfort levels during automated driving on real roads. By understanding the specific comfort experiences of both older and younger users, we can inform the design process for AVs, thereby enhancing user experience and facilitating broader acceptance of technology across a more diverse and inclusive demographic spectrum.

@en

Augmented Reality (AR) technology could be utilised to assist pedestrians in navigating safely through traffic. However, whether potential users would understand and use such AR solutions is currently unknown. Nine novel AR interfaces for pedestrian-vehicle communication, previously developed using an experience-based design method, were evaluated through an online questionnaire study completed by 992 respondents in Germany, the Netherlands, Norway, Sweden, and the United Kingdom. The AR indicated whether it was safe to cross the road in front of an approaching automated vehicle. Each interface was rated for its intuitiveness and convincingness, aesthetics, and usefulness. Moreover, comments were collected for qualitative analysis. The results indicated that interfaces that employed traditional design elements from existing traffic, and head-up displays, received the highest ratings overall. Statistical results also showed that there were no significant effects of country, age, and gender on interface acceptance. Thematic analysis of the textual comments offered detail on each interface design's stronger and weaker points, and revealed unintended effects of certain designs. In particular, some of the interfaces were commented on as being dangerous or scary, or were criticised that they could be misinterpreted in that they signal that something is wrong with the vehicle, or that they could occlude the view of the vehicle. The current findings highlight the limitations of experience-based design, and the importance of applying legacy design principles and involving target users in design and evaluation. Future research should be conducted in scenarios in which pedestrians actually interact with approaching vehicles.

Marie Skłodowska-Curie Actions; Innovative Training Networks (ITN); SHAPE-IT; Grant number 860410

Publication date: 21 February 2023

DOI: 10.1016/j.trf.2023.02.005

@en

Predicting pedestrian behavior when interacting with vehicles is one of the most critical challenges in the field of automated driving. Pedestrian crossing behavior is influenced by various interaction factors, including time to arrival, pedestrian waiting time, the presence of zebra crossing, and the properties and personality traits of both pedestrians and drivers. However, these factors have not been fully explored for use in predicting interaction outcomes. In this paper, we use machine learning to predict pedestrian crossing behavior including pedestrian crossing decision, crossing initiation time (CIT), and crossing duration (CD) when interacting with vehicles at unsignalized crossings. Distributed simulator data are utilized for predicting and analyzing the interaction factors. Compared with the logistic regression baseline model, our proposed neural network model improves the prediction accuracy and F1 score by 4.46% and 3.23%, respectively. Our model also reduces the root mean squared error (RMSE) for CIT and CD by 21.56% and 30.14% compared with the linear regression model. Additionally, we have analyzed the importance of interaction factors, and present the results of models using fewer factors. This provides information for model selection in different scenarios with limited input features.@en

When humans share space in road traffic, as drivers or as vulnerable road users, they draw on their full range of communicative and interactive capabilities. Much remains unknown about these behaviors, but they need to be captured in models if automated vehicles are to coexist successfully with human road users. Empirical studies of human road user behavior implicate a large number of underlying cognitive mechanisms, which taken together are well beyond the scope of existing computational models. Here, we note that for all of these putative mechanisms, computational theories exist in different subdisciplines of psychology, for more constrained tasks. We demonstrate how these separate theories can be generalized from abstract laboratory paradigms and integrated into a computational framework for modeling human road user interaction, combining Bayesian perception, a theory of mind regarding others’ intentions, behavioral game theory, long-term valuation of action alternatives, and evidence accumulation decision-making. We show that a model with these assumptions—but not simpler versions of the same model—can account for a number of previously unexplained phenomena in naturalistic driver–pedestrian road-crossing interactions, and successfully predicts interaction outcomes in an unseen data set. Our modeling results contribute to demonstrating the real-world value of the theories from which we draw, and address calls in psychology for cumulative theory-building, presenting human road use as a suitable setting for work of this nature. Our findings also underscore the formidable complexity of human interaction in road traffic, with strong implications for the requirements to set on development and testing of vehicle automation.@en

Current research on vehicle-pedestrian interactions focuses on the reaction of one actor other than the interaction of two actors, and considering the impact of the real-time behaviour of both actors on each other. To address this issue, the current study replicated a natural vehicle-pedestrian interaction to the virtual environment by connecting a high-fidelity driving simulator to a CAVE-based pedestrians' simulator. Behaviours from both actors in response to each other were observed indifferent situations including two crossing locations and five time gaps. The proposed method enabled simultaneous interaction in a controlled and safe environment as well as provided implications for future AV design.@en

The L3Pilot project tested SAE Level 3 (L3) conditionally automated driving functions addressing driving and travel behavior, impacts on safety, efficiency, environment and socio-economics, and user acceptance. To investigate individual variance in acceptance of conditionally automated cars, an online survey was performed among 18,631 respondents from 17 countries evaluating differences in age, gender, knowledge about the functionality of conditionally automated cars, awareness, information consumption behavior, and expected benefits of conditionally automated cars. Respondents were divided into Enthusiasts, Neutrals, and Sceptics differing in a high, moderate, and low acceptance of conditionally automated cars, respectively. Enthusiasts, Neutrals, and Sceptics differed most with regard to the expected benefits in the productive use of travel time, comfort, and safety of conditionally automated cars. Enthusiasts were male, younger, more knowledgeable about conditionally automated cars, more aware of automated cars, and more likely to receive information about automated cars from different sources, expecting improvements in the productive use of travel time, comfort, and safety due to conditionally automated cars. All groups were most knowledgeable about the lane keeping behavior of conditionally automated cars and least knowledgeable about the operation of conditionally automated cars in dedicated operational design domains. The results indicate that the communication and marketing of automated cars should create a realistic image of the capabilities and limitations of conditionally automated cars where user education programs should be harmonized to calibrate expectations and educate the public.

@en

Nine AR interfaces designed using an experience- based, and theoretically informed design approach, were presented in an online questionnaire for user evaluation.
Statistical analysis of presented measures, and the computation of an overall composite score revealed a preference towards traditional and familiar traffic elements.@en

Automated driving research over the past decades has mostly focused on highway environments. Recent technological developments have drawn researchers and manufacturers to look ahead at introducing automated driving in cities. The current position paper examines this challenge from the viewpoint of scientific experts. Sixteen Human Factors researchers were interviewed about their personal perspectives on automated vehicles (AVs) and the interaction with VRUs in the future urban environment. Aspects such as smart infrastructure, external human-machine interfaces (eHMIs), and the potential of augmented reality (AR) were addressed during the interviews. The interviews showed that the researchers believed that fully autonomous vehicles will not be introduced in the coming decades and that intermediate levels of automation, specific AV services, or shared control will be used instead. The researchers foresaw a large role of smart infrastructure and expressed a need for AV-VRU segregation, but were concerned about corresponding costs and maintenance requirements. The majority indicated that eHMIs will enhance future AV-VRU interaction, but they noted that implicit communication will remain dominant and advised against text-based and instructive eHMIs. AR was commended for its potential in assisting VRUs, but given the technological challenges, its use, for the time being, was believed to be limited to scientific experiments. The present expert perspectives may be instrumental to various stakeholders and researchers concerned with the relationship between VRUs and AVs in future urban traffic.

Marie Skłodowska-Curie Actions; Innovative Training Networks (ITN); SHAPE-IT; Grant number 860410

Publication date: 4 January 2021

DOI: 10.1016/j.trip.2020.100293

@en

The impact of automated vehicles (AV) on pedestrians’ crossing behavior has been the topic of some recent studies, but findings are still scarce and inconclusive. The aim of this study is to determine whether the drivers’ presence and apparent attentiveness in a vehicle influences pedestrians’ crossing behavior, perceived behavioral control, and perceived risk, in a controlled environment, using a Head-mounted Display in an immersive Virtual Reality study. Twenty participants took part in a road-crossing experiment. The VR environment consisted of a single lane one-way road with car traffic approaching from the right-hand side of the participant which travelled at 30 kmph. Participants were asked to cross the road if they felt safe to do so. The effect of three driver conditions on pedestrians’ crossing behavior were studied: Attentive driver, distracted driver, and no driver present. Two vehicles were employed with a fixed time gap (3.5 s and 5.5 s) between them to study the effects of time gaps on pedestrians’ crossing behavior. The manipulated vehicle yielded to the pedestrians in half of the trials, stopping completely before reaching the pedestrian's position. The crossing decision, time to initiate the crossing, crossing duration, and safety margin were measured. The main findings show that the vehicle's motion cues (i.e. the gap between the vehicles, and the yielding behavior of the vehicle) were the most important factors affecting pedestrians’ crossing behavior. Therefore, future research should focus more on investigating how AVs should behave while interacting with pedestrians. Distracted driver condition leads to shorter crossing initiation time but the effect was small. No driver condition leads to smaller safety margin. Findings also showed that perceived behavioral control was higher and perceived risk was significantly lower when the driver appeared attentive. Given that drivers will be allowed to do other tasks while AVs are operating in the future, whether explicit communication will be needed in this situation should be further investigated.

@en

The future urban environment may consist of mixed traffic in which pedestrians interact with automated vehicles (AVs). However, it is still unclear how AVs should communicate their intentions to pedestrians. Augmented reality (AR) technology could transform the future of interactions between pedestrians and AVs by offering targeted and individualized communication. This paper presents nine prototypes of AR concepts for pedestrian-AV interaction that are implemented and demonstrated in a real crossing environment. Each concept was based on expert perspectives and designed using theoretically-informed brainstorming sessions. Prototypes were implemented in Unity MARS and subsequently tested on an unmarked road using a standalone iPad Pro with LiDAR functionality. Despite the limitations of the technology, this paper offers an indication of how future AR systems may support future pedestrian-AV interactions.

Marie Skłodowska-Curie Actions; Innovative Training Networks (ITN); SHAPE-IT; Grant number 860410

Publication date: 20 September 2021

DOI: 10.1145/3409118.3475149

@en

This Deliverable starts with a short overview of the design principles and guidelines developed for current Human Machine Interfaces (HMIs), which are predominantly developed for manually driven vehicles, or those with a number of Advanced Driver Assistance Systems (ADAS), at SAE Levels 0 and 1 (SAE, 2018). It then provides an overview of how the addition of more capable systems, and the move to higher levels of vehicle automation, is changing the role the human inside an Automated Vehicle (AV), and the ways in which future automated vehicles at higher levels of automation (SAE level 4 and 5) must communicate with other road users, in the absence of an “in charge” human driver.

It is argued that such changes in the role of the driver, and more transfer of control to the AV and its different functionalities, means that there will be more emphasis on the roles and responsibilities of HMIs for future AVs. In parallel, the multifaceted nature of these HMI, presented from different locations, both in and outside the vehicles, using a variety of modalities, and engaging drivers in a two-way interaction, means that a new set of design guidelines are required, to ensure that the humans interacting with AVs (inside and outside the vehicle) are not distracted and overloaded, that they remain situation aware and understand the capabilities and limitations of the system, having the right mental model of system capabilities and their responsibilities, as responsible road users, at all times

Following a summary of suggested frameworks and design principles which highlight the significant change needed for new AV HMIs, an overview of results from studies investigating human interaction with internal (or iHMIs), and external (or eHMIs), is provided, with examples of new and innovative methods of communication between humans and their vehicles.

The Deliverable then provides a summary of the innovative approaches that will be tackled by the ESRs of the project, which focus on factors such as use of AI and AR for future design of more intuitive and transparent HMI, studying how HMI can support the long term interaction of humans with AVs, and the use of neuroergonomic methods for developing safer HMIs. The Deliverable concludes by summarising how each ESR’s project contributes to the development of HMIs for future AVs.@en

We investigated public acceptance of conditionally automated (SAE Level 3) passenger cars using a questionnaire study among 9,118 car-drivers in eight European countries, as part of the European L3Pilot project. 71.06% of respondents considered conditionally automated cars easy to use while 28.03% of respondents planned to buy a conditionally automated car once it is available. 41.85% of respondents would like to use the time in the conditionally automated car for secondary activities. Among these 41.85%, respondents plan to talk to fellow travellers (44.76%), surf the internet, watch videos or TV shows (44%), observe the landscape (41.70%), and work (17.06%). The UTAUT2 (Unified Theory of Acceptance and Use of Technology) was applied to investigate the effects of performance and effort expectancy, social influence, facilitating conditions, and hedonic motivation on the behavioural intention to use conditionally automated cars. Structural equation analysis revealed that the UTAUT2 can be applied to conditional automation, with hedonic motivation, social influence, and performance expectancy influencing the behavioural intention to buy and use a conditionally automated car. The present study also found positive effects of facilitating conditions on effort expectancy and hedonic motivation. Social influence was a positive predictor of hedonic motivation, facilitating conditions, and performance expectancy. Age, gender and experience with advanced driver assistance systems had significant, yet small (<0.10), effects on behavioural intention. The implications of these results on the policy and best practices to enable large-scale implementation of conditionally automated cars on public roads are discussed.

@en

The study investigated the interrelationships between the UTAUT2 (Unified Theory of Acceptance and Use of Technology) constructs predicting intentions to use driverless automated shuttles. Survey data was gathered from individuals physically experiencing an automated shuttle in a mixed traffic environment on public roads in Trikala (Greece) as part of the CityMobil2 project. Structural equation modelling showed that intentions to use automated shuttles were most strongly driven by hedonic motivation, followed by performance expectancy and social influence. Performance expectancy mediated the relationship between effort expectancy and behavioural intention. This means that people's expectations of how difficult automated shuttles will be to use and their intentions to use them can be explained through their expectations around how these vehicles will perform. Technology savviness was a negative moderator of the relationship between social influence and performance expectancy and facilitating conditions, respectively. Tech-savvy individuals rely less on their social networks to nurture their beliefs that automated shuttles are useful and to have the necessary resources to use automated shuttles. Car use was a negative predictor of the intention to use automated shuttles. Future research should revisit the interrelationships between the UTAUT2 constructs and apply (quasi-) experimental studies to unravel the temporal interaction between constructs.Relevance to human factors/Relevance to ergonomics theoryThe study investigated the interrelationships between the UTAUT2 (Unified Theory of Acceptance and Use of Technology) constructs predicting intentions to use driverless automated shuttles. Survey data from individuals physically experiencing an automated shuttle in Trikala (Greece) as part of the CityMobil2 project was analysed by structural equation modeling. Examining the interrelationships between the UTAUT2 constructs enables us to identify underlying beliefs and devise adequate strategies to promote automated vehicle acceptance. Supplemental data for this article is available online at https://doi.org/10.1080/1463922X.2020.1814446.

@en

Objective: To investigate pedestrians’ misuse of an automated vehicle (AV) equipped with an external human–machine interface (eHMI). Misuse occurs when a pedestrian enters the road because of uncritically following the eHMI’s message. Background: Human factors research indicates that automation misuse is a concern. However, there is no consensus regarding misuse of eHMIs. Methods: Sixty participants each experienced 50 crossing trials in a Cave Automatic Virtual Environment (CAVE) simulator. The three independent variables were as follows: (1) behavior of the approaching AV (within-subject: yielding at 33 or 43 m distance, no yielding), (2) eHMI presence (within-subject: eHMI on upon yielding, off), and (3) eHMI onset timing (between-subjects: eHMI turned on 1 s before or 1 s after the vehicle started to decelerate). Two failure trials were included where the eHMI turned on, yet the AV did not yield. Dependent measures were the moment of entering the road and perceived risk, comprehension, and trust. Results: Trust was higher with eHMI than without, and the −1 Group crossed earlier than the +1 Group. In the failure trials, perceived risk increased to high levels, whereas trust and comprehension decreased. Thirty-five percent of the participants in the −1 and +1 Groups walked onto the road when the eHMI failed for the first time, but there were no significant differences between the two groups. Conclusion: eHMIs that provide anticipatory information stimulate early crossing. eHMIs may cause people to over-rely on the eHMI and under-rely on the vehicle-intrinsic cues. Application: eHMI have adverse consequences, and education of eHMI capability is required.

@en

If automated vehicles (AVs) are to move efficiently through the traffic environment, there is a need for them to interact and communicate with other road users in a comprehensible and predictable manner. For this reason, an understanding of the interaction requirements of other road users is needed. The current study investigated these requirements through an analysis of 22 h of video footage of the CityMobil2 AV demonstrations in La Rochelle (France) and Trikala (Greece). Manual and automated video-analysis techniques were used to identify typical interaction patterns between AVs and other road users. Results indicate that road infrastructure and road user factors had a major impact on the type of interactions that arose between AVs and other road users. Road infrastructure features such as road width, and the presence or absence of zebra crossings had an impact on road users’ trajectory decisions while approaching an AV. Where possible, pedestrians and cyclists appeared to leave as much space as possible between their trajectories and that of the AV. However, in situations where the infrastructure did not allow for the separation of traffic, risky behaviours were more likely to emerge, with cyclists, in particular, travelling closely alongside the AVs on narrow parts of the road, rather than waiting for the AV to pass. In addition, the types of interaction varied considerably across socio-demographic groups, with females and older users more likely to show cautionary behaviour around the AVs than males, or younger road users. Overall, the results highlight the importance of implementing the correct infrastructure to support the safe introduction of AVs, while also ensuring that the behaviour of the AV matches other road users’ expectations as closely as possible in order to avoid traffic conflicts.

@en

Automated shuttles are now in a prototyping phase in several research projects. However, there is still a paucity of knowledge on the acceptance of these shuttles. This paper presents the results of a questionnaire study among individuals (n = 384) who physically experienced an automated shuttle on an office campus in Berlin-Schöneberg. The findings indicate that the respondents were positive towards automated shuttles and could envision their use as feeders to public transport systems, in both urban and rural areas. The respondents were less satisfied with the effectiveness of the shuttle compared to their existing form of travel, the speed of the shuttle, and the space for luggage. A principal component analysis resulted in the retention of three components: (1) intention to use, (2) shuttle and service characteristics, and (3) shuttle effectiveness compared to existing transport. Older respondents expressed a higher intention to use, but found the shuttle less effective than their existing travel. We argue that automated shuttles are a valued concept, but speed and efficiency have to improve, in order for automated shuttles to become viable on a wide scale. Future research should use more objective measures and establish long-term effects in larger, more representative samples.@en

User acceptance is a vital requirement for the success of automated vehicles that has been extensively addressed in current research in various acceptance studies. These studies have contributed to our understanding of potential acceptance factors of automated vehicles. However, the main focus of these studies has been on conventional vehicles with steer and pedals that were tested in artificial and simulated environments with a focus on in-vehicle technology. Furthermore, these studies list and identify a number of potential acceptance factors, but without making a systematic use of validated models to systematically present previous research. The current research addresses these gaps in research by investigating user acceptance of driverless shuttles in public transport in an open and mixed traffic environment on real semi-public roads in Berlin-Schöneberg. Results indicate that the acceptance and use of these driverless vehicles in public transport is predominantly influenced by their perceived usefulness, ease of use and social influence. @en