Bridging Worlds: Augmented Reality for Pedestrian-Automated Vehicle Interactions

This thesis explores how automated vehicles will interact with pedestrians in the urban environment through augmented reality technology. Nine distinct AR interfaces were designed, developed, and evaluated to assess how different design elements (symbols, text, colour) and distinct mappings of the AR (on the road, on the vehicle, or head-locked)...

Adaptive virtual reality based on eye-gaze behavior

Virtual cognitions are simulated inner thoughts, which are presented as a voice over. Previous research has shown the ability of virtual cognitions to increase the self-efficacy and knowledge of the users. When presenting such VR systems to users, having the VR system adapt to the user can improve their efficacy. For instance, by using eye-gaze...

Evaluating the Tobii Pro Glasses 2 and 3 in static and dynamic conditions

Over the past few decades, there have been significant developments in eye-tracking technology, particularly in the domain of mobile, head-mounted devices. Nevertheless, questions remain regarding the accuracy of these eye-trackers during static and dynamic tasks. In light of this, we evaluated the performance of two widely used devices: Tobii...

Eye tracking-based Sedentary Activity Recognition with Conventional Machine Learning Algorithms

Sedentary activity recognition is an important research field due to its various positive implications in people’s life. This study builds upon previous research which is based on low level features extracted from the gaze signals using a fixation filter and uses a dataset of 24 participants performing 8 different sedentary activities. The main...

Eye Tracking-Based Desktop Activity Recognition with Conventional Machine Learning

Cognitive processes have been used in recent years for context sensing and this has shown promising results. Multiple sets of features have shown good performance but no set of features has been determined the best for classifying gaze data. This paper looks at different feature sets and the heterogeneity of gaze signals from subjects and...

Stopping by looking: A driver-pedestrian interaction study in a coupled simulator using head-mounted displays with eye-tracking

Automated vehicles (AVs) can perform low-level control tasks but are not always capable of proper decision-making. This paper presents a concept of eye-based maneuver control for AV-pedestrian interaction. Previously, it was unknown whether the AV should conduct a stopping maneuver when the driver looks at the pedestrian or looks away from...

Ipsilateral and contralateral warnings: effects on decision-making and eye movements in near-collision scenarios

Cars are increasingly capable of providing drivers with warnings and advice. However, whether drivers should be provided with ipsilateral warnings (signaling the direction to steer towards) or contralateral warnings (signaling the direction to avoid) is inconclusive. Furthermore, how auditory warnings and visual information from the driving...

Recognizing non-native spoken words in background noise increases interference from the native language

Listeners frequently recognize spoken words in the presence of background noise. Previous research has shown that noise reduces phoneme intelligibility and hampers spoken-word recognition – especially for non-native listeners. In the present study, we investigated how noise influences lexical competition in both the non-native and the native...

The Effects of Conformal Navigation Symbology on Drivers' Visual Search

Driving often requires dividing attention between scanning the environment and following navigation instructions. The aim of this study was to investigate the effects of conformal and non-conformal navigation symbology on drivers' visual search. A driving simulator study was conducted where participants drove with conformal and non-conformal...

EyeIDEA: Paving the Way Towards an Augmented Eye-Tracking IDE

Since their invention, the keyboard and mouse are the most used input devices that software developers use to interact with source code. However, these devices have their IDE interaction issues as developers need to spend a significant amount of time learning how to use them efficiently and effectively. To tackle some of these issues, we used an...

External human-machine interfaces: Effects of message perspective

Future automated vehicles may be equipped with external Human-Machine Interfaces (eHMIs). Currently, little is known about the effect of the perspective of the eHMI message on crossing decisions of pedestrians. We performed an experiment to examine the effects of images depicting eHMI messages of different perspectives (egocentric from the...

How do pedestrians distribute their visual attention when walking through a parking garage? An eye-tracking study

We examined what pedestrians look at when walking through a parking garage. Thirty-six participants walked a short route in a parking garage while their eye movements and head rotations were recorded with a Tobii Pro Glasses 2 eye-tracker. The participants’ fixations were then classified into 14 areas of interest. The results showed that...

Design and evaluation of simulated reflective thoughts in virtual reality exposure training

Social skills are often an integral part of functioning in modern society, and therefore, in the past decades, social skills training has received considerable research attraction. Various physical and digital approaches have been developed to improve people’s performance in social interaction. Among these approaches, social skills training...

Algorithmic detection of eye contact in driver-pedestrian interactions

Pedestrians today are very vulnerable on urban roads. Clear communication between drivers and pedestrians is one way to reduce their plight. Non-verbal communication in particular plays an important role in road safety, and eye contact is a kind of non-verbal communication that has the potential to minimize on-road collisions. However, with the...

Take over! A video-clip study measuring attention, situation awareness, and decision-making in the face of an impending hazard

In highly automated driving, drivers occasionally need to take over control of the car due to limitations of the automated driving system. Research has shown that visually distracted drivers need about 7 s to regain situation awareness (SA). However, it is unknown whether the presence of a hazard affects SA. In the present experiment, 32...

Attention distribution while detecting conflicts between converging objects: An eye-tracking study

In many domains, including air traffic control, observers have to detect conflicts between moving objects. However, it is unclear what the effect of conflict angle is on observers’ conflict detection performance. In addition, it has been speculated that observers use specific viewing techniques while performing a conflict detection task, but...

Prediction of effort and eye movement measures from driving scene components

For transitions of control in automated vehicles, driver monitoring systems (DMS) may need to discern task difficulty and driver preparedness. Such DMS require models that relate driving scene components, driver effort, and eye measurements. Across two sessions, 15 participants enacted receiving control within 60 randomly ordered dashcam videos ...

Choosing between hotels: impact of bimodal rating summary statistics and maximizing behavioral tendency

Rating summary statistics are basic aggregations that reflect users’ assessments of experienced products and services in numerical form. Thus far, scholars primarily investigated textual reviews, but dedicated considerably less time and effort exploring the potential impact of plain rating summary statistics on people’s choice behavior....