Perceived acoustic environments, or soundscapes, of intensive care units (ICUs) can be stressful for patients. We developed an approach to enhance ICU soundscapes with soundscape interventions. Compositions of Natural, Human, or Technological sounds were designed to establish three types of sonic ambiances: Comfortable, Pleasurable, or Stimulating. The objective was to investigate the approach's effectiveness in a real-world ICU environment. In a controlled experiment conducted in a single-patient, sound-proofed ICU room, 26 healthy participants were exposed to simulated ICU soundscapes, including patient monitor alarm sounds and mechanical ventilator sounds. Nine soundscape interventions were played via speakers. Perceived pleasantness and eventfulness of resulting soundscapes and experienced pleasure and arousal of listeners were evaluated with questionnaires. Physiological indicators of stress were measured using electrocardiograms (ECGs). Pleasurable and Stimulating interventions significantly increased perceived pleasantness and eventfulness when introduced to the simulated ICU soundscape. Comfortable interventions had no significant effect, suggesting that Pleasurable and Stimulating ambiances better aligned with participants’ needs relative to the simulated soundscape. It emphasized the need to tailor ICU interventions to the preexisting acoustic environment and sound-related needs of listeners, such as comfort, distraction or reassurance. Participants reported positive emotional states while listening to the soundscape interventions, indicative of positive listener experiences. Preliminary insights regarding changes in heartrate variability hinted that soundscape interventions could potentially contribute to reduced stress levels. The effectiveness of interventions depended on their featured sound categories, highlighting the importance of personalization. Overall, our approach was found effective, showing promise for creating listener-centric, restorative soundscapes during ICU stays.

In automated vehicles, beeps are widely used as alarms and feedback. However, as automation advances, there is a need to explore subtler, contextually sound-based notifications for non-urgent situations. While auditory interfaces for take-over requests have been studied, limited attention has been given to using soundscapes for such alerts. This paper designed and evaluated soundscapes using existing driving-related sounds–amplified road noise and/or dimmed background music–for scheduled take-over situations. A driving simulator study showed that these soundscapes enhanced reaction time, situation awareness, and acceptance without causing annoyance. Particularly, the combined condition (music dimming and road noise amplifying) supported higher driver awareness and responsiveness. These findings suggest that soundscapes can offer safer, more intuitive take-over alerts by embedding information into familiar audio cues. This study contributes to developing soundscapes as novel alert mechanisms that integrate seamlessly with the driving environment to enhance both safety and user experience in automated vehicles.

As vehicles transition between driving automation levels, drivers need to be continually aware of the automation mode and the resulting driver responsibilities. This study investigates the impact of visual user interfaces (UIs) on drivers’ mode awareness in SAE Level 2 automated vehicles. It focuses on their understanding of speed and distance control, steering control, and the hands-on steering wheel requirement presented through UIs. Forty-five UIs were generated, presenting the activation of Lane Keeping Assist (LKA) and Adaptive Cruise Control (ACC) and the hands-on steering wheel requirement. Through an online questionnaire with 1080 respondents with experience of SAE Level 2, the study evaluated how these visual UIs influenced users’ understanding of control responsibilities, information usability, and trust in automated vehicles. The results show a limited role of UI in shaping users’ understanding of control. ACC UIs and LKA UIs had no significant effects, and apparently, the understanding of speed and distance control and steering control was independent of the ACC UI and LKA UI. A large variance in responses regarding the understanding of steering control and speed and distance control indicates confusion caused by mode ambiguity, suggesting that drivers do not well understand how the speed and distance control and steering control task is shared between the driver and the automation. However, the hands-on steering wheel UIs significantly improved the understanding of the hands-on steering wheel requirement. The hands-on steering wheel UI combining the hands on the wheel icon and the text “Keep hands on steering wheel” yielded 94.4% correct understanding and outperformed the UI with hands but without text (87.8% correct) or no UI (82.5% correct). In addition, the variation of visual UI did not affect trust. This study contributes to the understanding and design of visual UIs for effective communication of driver responsibilities in automated vehicles.

We present a systematic approach for training and testing structural texture similarity metrics (STSIMs) so that they can be used to exploit texture redundancy for structurally lossless image compression. The training and testing is based on a set of image distortions that reflect the characteristics of the perturbations present in natural texture images. We conduct empirical studies to determine the perceived similarity scale across all pairs of original and distorted textures. We then introduce a data-driven approach for training the Mahalanobis formulation of STSIM based on the resulting annotated texture pairs. Experimental results demonstrate that training results in significant improvements in metric performance. We also show that the performance of the trained STSIM metrics is competitive with state of the art metrics based on convolutional neural networks, at substantially lower computational cost.

Intensive Care Unit (ICU) nurses are burdened by excessive number of false and irrelevant alarms generated by patient monitoring systems. Nurses rely on these patient monitoring systems for timely and relevant medical information concerning patients. However, the systems currently in place are not sensitive to the perceptual and cognitive abilities of nurses and thus fail to communicate information efficiently. An efficient communication and an effective collaboration between patient monitoring systems and ICU nurses is only possible by designing systems sensitive to the abilities and preferences of nurses. In order to design these sensitive systems, we need to gain in-depth understanding of the user group through revealing their latent individual characteristics. To this end, we conducted a survey on individual characteristics involving nurses from two IC units. Our results shed light on the personality and other characteristics of ICU nurses. Subsequently, we performed hierarchical cluster analysis to develop data-driven nurse profiles. We suggest design recommendations tailored to four distinct user profiles to address their unique needs. By optimizing the system interactions to match the natural tendencies of nurses, we aspire to alleviate the cognitive burden induced by system use to ensure that healthcare providers receive relevant information, ultimately improving patient safety.

Trust and perceived safety are pivotal in the acceptance of automated vehicles and can be enhanced by providing users with automation information on the (safe) operation of the vehicle. This study aims to identify how user interfaces (UI) can enhance drivers' trust and acceptance and reduce perceived risk in partially automated vehicles. Four interfaces were designed with different levels of complexity. These levels were achieved by combining automation information (surrounding information vs surrounding and manoeuvre information) and modality (visual vs visual and auditory). These interfaces were evaluated in a driving simulator in which a partially automated vehicle reacted to an event of a merging and braking vehicle in its front. The criticality of the events was manipulated by the factors merging gap (in meters) and deceleration (m/s²) of the vehicle in front. The reaction of the automation was either to brake or to change lanes. The results show that an optimal combination of automation information and modality enhances drivers' trust and acceptance. More specifically, the most advanced UI, which provided surrounding and manoeuvre information via the visual and auditory modalities, was associated with the highest trust and acceptance ranking and the lowest perceived risk. Manoeuvre information delivered through the auditory modality was particularly effective in enhancing trust and acceptance. The benefits of the UIs were consistent over events. However, in the most critical events, drivers did not feel entirely safe and did not trust the automation completely. This study suggests that the design of UIs for partially automated vehicles shall include automation information via visual and auditory modalities.

Mode awareness is important for the safe use of automated vehicles, yet drivers' understanding of mode transitions has not been sufficiently investigated. In this study, we administered an online survey to 838 respondents to examine their understanding of control responsibilities in partial and conditional driving automation with four types of interventions (brake pedal, steering wheel, gas pedal, and take-over request). Results show that most drivers understand that they are responsible for speed and distance control after brake pedal interventions and steering control after steering wheel interventions. However, drivers have mixed responses regarding the responsibility for speed and distance control after steering wheel interventions and the responsibility for steering control after gas pedal interventions. With a higher automation level (conditional driving automation), drivers expect automation to remain responsible more often compared to a lower automation level (partial driving automation). Regarding Hands-on requirements, more than 99% of respondents answered that drivers would keep their hands on the steering wheel after all intervention types in partial automation, while 60–95% would place their hands on the wheel after various intervention types in conditional automation. A misalignment between actual logic and drivers' expectations regarding control responsibilities is observed by comparing survey responses to the mode transition logic of commercial partially automated vehicles. To resolve confusion about control responsibilities and ensure consistent expectations, we propose implementing a consistent mode design and providing enhanced information to drivers.

Ensembles of contours arise in various applications like simulation, computer-Aided design, and semantic segmentation. Uncovering ensemble patterns and analyzing individual members is a challenging task that suffers from clutter. Ensemble statistical summarization can alleviate this issue by permitting analyzing ensembles' distributional components like the mean and median, confidence intervals, and outliers. Contour boxplots, powered by Contour Band Depth (CBD), are a popular non-parametric ensemble summarization method that benefits from CBD's generality, robustness, and theoretical properties. In this work, we introduce Inclusion Depth (ID), a new notion of contour depth with three defining characteristics. First, ID is a generalization of functional Half-Region Depth, which offers several theoretical guarantees. Second, ID relies on a simple principle: The inside/outside relationships between contours. This facilitates implementing ID and understanding its results. Third, the computational complexity of ID scales quadratically in the number of members of the ensemble, improving CBD's cubic complexity. This also in practice speeds up the computation enabling the use of ID for exploring large contour ensembles or in contexts requiring multiple depth evaluations like clustering. In a series of experiments on synthetic data and case studies with meteorological and segmentation data, we evaluate ID's performance and demonstrate its capabilities for the visual analysis of contour ensembles.

The contour depth methodology enables non-parametric summarization of contour ensembles by extracting their representatives, confidence bands, and outliers for visualization (via contour boxplots) and robust downstream procedures. We address two shortcomings of these methods. Firstly, we significantly expedite the computation and recomputation of Inclusion Depth (ID), introducing a linear-time algorithm for epsilon ID, a variant used for handling ensembles with contours with multiple intersections. We also present the inclusion matrix, which contains the pairwise inclusion relationships between contours, and leverage it to accelerate the recomputation of ID. Secondly, extending beyond the single distribution assumption, we present the Relative Depth (ReD), a generalization of contour depth for ensembles with multiple modes. Building upon the linear-time eID, we introduce CDclust, a clustering algorithm that untangles ensemble modes of variation by optimizing ReD. Synthetic and real datasets from medical image segmentation and meteorological forecasting showcase the speed advantages, illustrate the use case of progressive depth computation and enable non-parametric multimodal analysis. To promote research and adoption, we offer the contour-depth Python package.

The design of take-over requests in automated vehicles traditionally focuses on safety and reaction time. We are interested in how take-over requests can be designed from a broader user experience perspective while ensuring safety. This paper proposes designs for ambient sound (i.e., soundscape) and driving noise to inform the driver of transition situations. Drivers must take-over control within the time budget, the time from the take-over request to the automation system limit. The time required for a safe transition depends on the complexity of the driving environment. In a scheduled take-over, which is not an emergency, there is an opportunity for an interaction that gradually introduces the driver into the transition process. Ambient sound is expected to lead the driver back to the loop with comfort, creating a novel transition experience as well as safety.

Automation of vehicles not only provides greater safety, but also many previously unimagined opportunities, such as less inequality, less stress, and more meaningful activities while driving. However, the uptake and implementation of automated driving have been falling short of its promise, due to challenges in identifying safe and acceptable ways for humans to interact with automated vehicles. The human-machine interface (HMI) in vehicles plays a more critical role today than ever before. The main research question addrssed in this study, as part of the EU-funded HADRIAN project, is: What steps need to be taken to achieve effective fluid HMI (f-HMI) design for improved driver-vehicle dialogue, especially in critical scenarios?.