JV

J.H. Vroon

info

Please Note

9 records found

A Novel Dataset for Better Perceived Appropriateness Detection in Robot Social Navigation with Emotional and Attentional Features

Despite advancements in socially aware navigation, robots still often behave inappropriately in social environments. To ensure successful application, robots must detect the human perceived appropriateness of their navigation behaviors. This paper presents a novel dataset covering a complete range of perceived appropriateness and uniquely incorporates human emotion and attention to facilitate the detection of perceived appropriateness of robot social navigation in pathways (PARSNiP). It is created based on a series of human-robot interaction experiments with 30 participants and a mobile robot. Several typical machine learning models are utilized to evaluate the dataset and analyze the contributions of different features in detecting perceived appropriateness. The results indicate that incorporating emotional and attentional features can significantly improve the accuracy of perceived appropriateness detection. There was an increase from 63% to 68% using algorithm-predicted emotional and attentional features, and a further increase to 79% with the emotion and attention data reported by the participants. With the dataset, researchers could train machine learning models to enable robots to detect perceived appropriateness accurately, fostering adaptations that improve their responsiveness and accuracy in social interactions. The dataset is available for download at https://github.com/duibcuiegiosahxois/PARSNiP.git, and videos will be shared upon request by contacting Y.Zhou-13@tudelft.nl. ...
Journal article (2025) - Marco C. Rozendaal, Jered Vroon, Maaike Bleeker
In this article, we report on methodological insights gained from a workshop in which we collaborated with theater professionals to enact situated encounters between humans and robots on a mixed reality stage combining VR with real-life interaction. We deployed the skills of theater professionals to investigate the behaviors of humans encountering robots to speculate about the kind of interactions that may result from encountering robots in supermarket settings. The mixed reality stage made it possible to adapt the robot’s morphology quickly, as well as its movement and perceptual capacities, to investigate how this together co-determines possibilities for interaction. This setup allowed us to follow the interactions simultaneously from different perspectives, including the robot’s, which provided the basis for a collective phenomenological analysis of the interactions. Our work contributes to approaches to HRI that do not work toward identifying communicative behaviors that can be universally applied but instead work toward insights that can be used to develop HRI that is emergent, and situation- and robot-specific. Furthermore, it supports a more-than-human-design approach that takes the fundamental differences between humans and robots as a starting point for the creative development of new kinds of communication and interaction. ...
Journal article (2024) - Yunzhong Zhou, Jered Vroon, Gerd Kortuem
In social environment navigation, robots inevitably exhibit behaviors that are perceived as inappropriate by humans. Current robots lack the ability to adapt to such human perceptions, leading to repeated inappropriate behaviors. This study employs a mixed-methods approach to explore human-preferred robot adaptations, combining qualitative data from a series of human-robot interactions and a semi-structured interview, and quantitative data from an online survey. 12 participants were recruited to interact with a mobile robot in an indoor setting, reporting 139 instances of inappropriate robot behaviors. The subsequent semi-structured interviews regarding these instances yielded 9 types of inappropriate behaviors and 10 major types of human-preferred robot adaptations, ranging from general ones, such as stopping the motion, to more specific ones, like moving away and then stopping. Additionally, 12 human-preferred adaptations were selected from the interview data and presented to the same participants through an online survey to evaluate their effectiveness in addressing the inappropriate behaviors previously identified. The results reveal the human preference for the robot to move to the side and then stop in most scenarios, which might serve as a general adaptation for addressing inappropriate robot navigation behaviors. ...

Monitoring Hospital Soundscapes for Better Sleep Hygiene

Conference paper (2022) - Elif Özcan, Yiling Liu, Jered Vroon, Daan Kamphuis, Simone Spagnol
Good sleep is conducive to the recovery process of hospital patients - and yet, in many wards, sleep duration and quality can often be suboptimal, in part due to modifiable hospital-related sounds and noises. At the neurological ward of the Reinier de Graaf hospital in Delft, the Netherlands, we developed and evaluated a prototype information exchange system to raise awareness of specific sounds as disturbing patients' sleep. The system both classifies different relevant sound events and tracks sleep quality (using a Fitbit device). This information is then visualized for patients and staff to present the influence of the soundscape on patients' sleep hygiene in a friendly and comprehensive way. We discuss the design process, including a context study and various evaluations of the technology, interface, and created affordances. Our initial findings indicate that visualizing hospital soundscapes may, indeed, support both patients and staff in their efforts towards better sleep hygiene. ...

Full day workshop at DIS 2020

Conference paper (2020) - Jered Vroon, Gerd Kortuem, Cristina Zaga, Marco Rozendaal, Maria Luce Lupetti, Evert Van Beek
Our interactions form an intricate 'dance' - a dance requiring a fluent integration of both expressivity (e.g. to approach someone) and sensitivity (e.g. detect if you 'should' approach someone). Work on behaving artefacts has focused mostly on the social, emotional and aesthetic qualities that can be evoked - expressed - through interactions involving such artefacts. Meanwhile, novel methods from social signal processing and affective computing are beginning to imbue artefacts with a reflective awareness - a sensitivity - to the emergent social aspects of the interaction. Can we empower the expressivity of behaving artefacts by integrating it with such sensitivity? With this workshop we aim to bring together a range of perspectives, on the performative and technological opportunities for such artefacts, as well as on their potential (adverse) social and societal implications; to jointly establish what will be necessary to achieve Expressive\Sensitive artefacts that positively enrich and participate in the 'dance' of social interaction. ...
Conference paper (2020) - Jered Vroon, Zoltán Rusak, Gerd Kortuem
Delivery robots are being deployed on sidewalks, but do we actually know which conflicts we should aim to avoid in the design and creation of these systems? Current approaches to social navigation focus on implementing well-established social norms such as proxemics, but it is dubious if these norms are sufficiently applicable to the context of dynamic interactions between such robots and pedestrians. We argue that, to get rich insight in the actual conflicts, we should confront them within their context. Based on this argument, we outline a new method for user observation that aims to elicit and explore representative social conflicts by ignoring humans: context-confrontation. Our first preliminary observations using this method suggest unexpected and novel conflicts, well outside of what current approaches seem to be focusing on – perhaps we, the designers/engineers of these robotic systems, should get out there a bit more, to find the conflicts that really matter. ...

Ethical Data-Centric Design of Intelligent Behaviour

Conference paper (2020) - Jacky Bourgeois, Jered Vroon, Aaron Yi Ding, Ella Peltonen
The Internet of Things makes human activity data - what people do, how they move, how they socialise - an abundant resource. However, this rich and intimate perspective on people, which uniquely shape and characterise their behaviours, can have tremendous ethical implication if data is handled irresponsibly. Being personal, contextual and accessible, mobile devices are key facilitators of (ir)responsible collection and use of data. In this workshop, we will use the Future Workshop approach to develop a research agenda towards ethical data-centric design of intelligent behaviours. As part of this approach, we will (1) criticise the current mechanisms and infrastructure to frame ethical challenges, (2) fantasise on futures which support user and designer values, and (3) implement a research agenda for the MobileHCI community to emphasise the barriers to tackle. The outcomes of this workshop will foster ethical research and inspire the MobileHCI community. ...
Conference paper (2020) - Jered Vroon, Y. Zhou, Z. Rusak
When mobile urban robots will share the sidewalk with people, the resulting interactions can cause unexpected undesirable outcomes to emerge – from people running away scared to people deliberately teasing and harassing such systems. How can we design such AI systems to aptly handle the unexpected? Directly anticipating and/or detecting these kinds of situations will inherently be unreliable; they are unexpected, after all. And yet, there exists a very clear signal for social slip-ups: the emotional response of people. We thus argue that such systems need to be imbued with a capacity to interpret the socio-emotional reactions to their own behavior. ...
Conference paper (2019) - Jered Vroon, Gwenn Englebienne, Vanessa Evers
What if a robot could detect when you think it got too close to you during its approach? This would allow it to correct or compensate for its social ‘mistake’. It would also allow for a responsive approach, where that robot would reactively find suitable approach behavior through and during the interaction. We investigated if it is possible to automatically detect such social feedback cues in the context of a robot approaching a person.

We collected a dataset in which our robot would repeatedly approach people (n=30) to verbally deliver a message. Approach distance and environmental noise were manipulated, and our participants were tracked (position and orientation of upper body and head). We evaluated their perception of the robot’s behavior through questionnaires and found no single or joint effects of the manipulations. This showed that, in this case, personal differences are more important than contextual cues – thus highlighting the importance of responding to behavioral feedback. This dataset is being made publicly available as part of this publication (http://doi.org/10.4121/uuid:b76c3a6f-f7d5-418e-874a-d6140853e1fa).

On this dataset, we then trained a random forest classifier to infer people’s perception of the robot’s approach behavior from features generated from the response behaviors. This resulted in a set of relevant features that perform significantly better than chance for a participant-dependent classifier; which implies that the behaviors of our participants, even with our relatively limited tracking, contain interpretable information about their perception of the robot’s behavior.

Our findings demonstrate, for this specific context, that the observable behavior of people does indeed contain usable information about their subjective perception of a robot’s behavior. As such they, together with the dataset, provide a stepping stone for future research into the automatic detection of such social feedback cues, e.g. with other or more fine-grained observations of people’s behavior (such as facial expressions), with more sophisticated machine learning techniques, and/or in different contexts. ...