- document
-
Bota, Patrícia (author), Brito, Joana (author), Fred, Ana (author), Cesar, Pablo (author), Silva, Hugo (author)Affective computing has experienced substantial advancements in recognizing emotions through image and facial expression analysis. However, the incorporation of physiological data remains constrained. Emotion recognition with physiological data shows promising results in controlled experiments but lacks generalization to real-world settings....journal article 2024
- document
-
Ooms, Simone (author), Röggla, Thomas (author), Cesar, Pablo (author), El Ali, Abdallah (author)Within our Distributed and Interactive Systems research group, we focus on affective haptics, where we design and develop systems that can enhance human emotional states through the sense of touch. Such artificial haptic sensations can potentially augment and enhance our mind, body, and (virtual) social connections. In three works—voice...journal article 2024
- document
-
Vieira, Romulo (author), Muchaluat-Saade, Debora (author), Cesar, Pablo (author)The Internet of Multisensory, Multimedia and Musical Things (Io3MT) is a new concept that arises from the confluence of several areas of computer science, arts, and humanities, with the objective of grouping in a single place devices and data that explore the five human senses, besides multimedia aspects and music content. In the context of...conference paper 2024
- document
-
Rossi, Silvia (author), Viola, Irene (author), Toni, Laura (author), Cesar, Pablo (author)Immersive reality technologies, such as Virtual and Augmented Reality, have ushered a new era of user-centric systems, in which every aspect of the coding-delivery-rendering chain is tailored to the interaction of the users. Understanding the actual interactivity and behaviour of the users is still an open challenge and a key step to enabling...conference paper 2023
- document
-
Rao, Shruti (author), Ghosh, Surjya (author), Rodriguez, Gerard Pons (author), Röggla, Thomas (author), Cesar, Pablo (author), El Ali, Abdallah (author)Capturing drivers’ affective responses given driving context and driver-pedestrian interactions remains a challenge for designing in-vehicle, empathic interfaces. To address this, we conducted two lab-based studies using camera and physiological sensors. Our first study collected participants’ (N = 21) emotion self-reports and physiological...journal article 2023
- document
-
Smitskamp, Gwennan (author), Viola, Irene (author), Cesar, Pablo (author)The development and widespread adoption of immersive XR applications has led to a renewed interest in representations that are capable of reproducing real-world objects and scenes with high fidelity. Among such representations, point clouds have attracted the interest of industry and academia alike, and new compression solutions have been...conference paper 2023
- document
-
Alexiou, Evangelos (author), Nehmé, Yana (author), Zerman, Emin (author), Viola, Irene (author), Lavoué, Guillaume (author), Ak, Ali (author), Smolic, Aljosa (author), Le Callet, Patrick (author), Cesar, Pablo (author)Volumetric video (VV) is a novel form of video that allows recreation of real-world scenes in 3D with users consuming the content from any viewpoint they desire. This makes VV best suited for augmented reality (AR) or virtual reality (VR) applications. This freedom necessitates increased user interaction with the VV itself, which brings new...book chapter 2023
- document
-
Li, Jie (author), Cesar, Pablo (author)Virtual reality (VR) is the experience in a simulated interactive virtual space. It provides synthetic sensory feedback to users' actions that can physically and mentally immerse the users. Social VR is one type of VR system that allows multiple users to join a collaborative virtual environment and communicate with each other, usually by...book chapter 2023
- document
-
El Ali, Abdallah (author), Ney, R. (author), Van Berlo, Zeph M.C. (author), Cesar, Pablo (author)Measuring interoception ('perceiving internal bodily states') has diagnostic and wellbeing implications. Since heartbeats are distinct and frequent, various methods aim at measuring cardiac interoceptive accuracy (CIAcc). However, the role of exteroceptive modalities for representing heart rate (HR) across screen-based and Virtual Reality (VR...journal article 2023
- document
-
Zhang, T. (author), El Ali, Abdallah (author), Wang, Chen (author), Hanjalic, A. (author), Cesar, Pablo (author)Instead of predicting just one emotion for one activity (e.g., video watching), fine-grained emotion recognition enables more temporally precise recognition. Previous works on fine-grained emotion recognition require segment-by-segment, fine-grained emotion labels to train the recognition algorithm. However, experiments to collect these...journal article 2023
- document
-
El Ali, Abdallah (author), Stepanova, Ekaterina R. (author), Palande, Shalvi (author), Mader, Angelika (author), Cesar, Pablo (author), Jansen, K.M.B. (author)Sharing breathing signals has the capacity to provide insights into hidden experiences and enhance interpersonal communication. However, it remains unclear how the modality of breath signals (visual, haptic) is socially interpreted during collaborative tasks. In this mixed-methods study, we design and evaluate BreatheWithMe, a prototype for...conference paper 2023
- document
-
Ooms, Simone (author), Lee, Minha (author), Cesar, Pablo (author), El Ali, Abdallah (author)Emotion plays a key role in the emerging wave of immersive, multi-sensory audience news engagement experiences. Since emotions can be triggered by somatosensory feedback, in this work we explore how augmenting news video watching with haptics can influence affective perceptions of news. Using a mixed-methods approach, we design and evaluate...conference paper 2023
- document
-
Rao, Shruti (author), Wirjopawiro, Sabrina (author), Pons Rodriguez, Gerard (author), Röggla, Thomas (author), Cesar, Pablo (author), El Ali, Abdallah (author)Eliciting and capturing drivers' affective responses in a realistic outdoor setting with pedestrians poses a challenge when designing in-vehicle, empathic interfaces. To address this, we designed a controlled, outdoor car driving circuit where drivers (N=27) drove and encountered pedestrian confederates who performed non-verbal positive or...conference paper 2023
- document
-
Rossi, Silvia (author), Viola, Irene (author), Cesar, Pablo (author)This work presents an explorative behavioural analysis of users navigating in an immersive space aimed at enabling the next-generation multimedia systems. Our main goal is to understand how the user experience of immersive content with 6-Degrees-of-Freedom (DoF) is affected not only by the visual content and its quality but also by the...conference paper 2022
- document
-
Ghosh, Surjya (author), Pons Rodriguez, Gerard (author), Rao, Shruti (author), El Ali, Abdallah (author), Cesar, Pablo (author)While affective non-verbal communication between pedestrians and drivers has been shown to improve on-road safety and driving experiences, it remains a challenge to design driver assistance systems that can automatically capture these affective cues. In this early work, we identify users' emotional self-report responses towards commonly...conference paper 2022
- document
-
Zhang, T. (author), El Ali, Abdallah (author), Hanjalic, A. (author), Cesar, Pablo (author)Fine-grained emotion recognition can model the temporal dynamics of emotions, which is more precise than predicting one emotion retrospectively for an activity (e.g., video clip watching). Previous works require large amounts of continuously annotated data to train an accurate recognition model, however experiments to collect such large...journal article 2022
- document
-
Rao, Shruti (author), Resendez, Valeria (author), El Ali, Abdallah (author), Cesar, Pablo (author)Voice User Interfaces (VUIs) such as Alexa and Google Home that use human-like design cues are an increasingly popular means for accessing news. Self-disclosure in particular may be used to build relationships of trust with users who may reveal intimate details about themselves. This information can be (mis)used by algorithms to tailor and...conference paper 2022
- document
-
Designing Real-time, Continuous QoE Score Acquisition Techniques for HMD-based 360°VR Video WatchingXue, Tong (author), El Ali, Abdallah (author), Viola, Irene (author), Ding, Gangyi (author), Cesar, Pablo (author)Watching HMD-based 360° video has become in-creasing popular as a medium for immersive viewing of photo-realistic content. To evaluate subjective video quality, researchers typically prompt users to provide an overall Quality of Experience (QoE) score after viewing a stimulus. However, since users can adjust their viewport throughout a 360°...conference paper 2022
- document
-
Subramanyam, S. (author), Viola, Irene (author), Jansen, Jack (author), Alexiou, Evangelos (author), Hanjalic, A. (author), Cesar, Pablo (author)Technological advances in head-mounted displays and novel real-time 3D acquisition and reconstruction solutions have fostered the development of 6 Degrees of Freedom (6DoF) teleimmersive systems for social VR applications. Point clouds have emerged as a popular format for such applications, owing to their simplicity and versatility; yet,...conference paper 2022
- document
-
Lee, Sueyoon (author), Striner, Alina (author), Cesar, Pablo (author)Several social VR platforms support virtual entertainment events, however their value for post-show activities remains unclear. Through a user-centered approach, we design a social VR lobby experience to enrich four motivations of theatre-goers: social, intellectual, emotional, and spiritual engagement. We ran a context-mapping focus group...conference paper 2022