End-to-end language diarization for bilingual code-switching speech

We propose two end-to-end neural configurations for language diarization on bilingual code-switching speech. The first, a BLSTM-E2E architecture, includes a set of stacked bidirectional LSTMs to compute embeddings and incorporates the deep clustering loss to enforce grouping of languages belonging to the same class. The second, an XSA-E2E...

R3L: Connecting Deep Reinforcement Learning To Recurrent Neural Networks For Image Denoising Via Residual Recovery

State-of-the-art image denoisers exploit various types of deep neural networks via deterministic training. Alternatively, very recent works utilize deep reinforcement learning for restoring images with diverse or unknown corruptions. Though deep reinforcement learning can generate effective policy networks for operator selection or architecture...

Object Detection and Person Tracking in CathLab with Automatically Calibrated Cameras

Workflow analysis is a young research field that has been gaining traction in recent years. Work in this field aims to improve the efficiency and safety in operating rooms by analysing surgical processes and providing feedback or support, where observations are made and evaluated by algorithms rather than human experts. For our study, we mount...

Image Search Engine by Deep Neural Networks

We typically search for images by keywords, e.g., when looking for images of apples, we would enter the word “apple” as query. However, there are limitations. For example, if users input keywords in a specific language, then they may miss results labeled in other languages. Moreover, users may have an image of the object they want to obtain more...

Extreme Precipitation Nowcasting using Deep Generative Models

Extreme precipitation usually leads to substantial impacts. Floods in the Netherlands, Belgium and Germany in the summer of 2021 have caused loss of lives, destruction of infrastructures, and long-term effect on economics. To avoid such disasters, it is important to develop a reliable and accurate method to predict heavy rain.

Transformer Convolutional Neural Networks for Automated Artifact Detection in Scalp EEG

It is well known that electroencephalograms (EEGs) often contain artifacts due to muscle activity, eye blinks, and various other causes. Detecting such artifacts is an essential first step toward a correct interpretation of EEGs. Although much effort has been devoted to semi-automated and automated artifact detection in EEG, the problem of...

Challenges in Virtual Testing of Autonomous Vehicles

The worldwide development of Autonomous Vehicles (AVs) has also encouraged the use of software simulators for virtual testing of AVs. However, the effectiveness of the AV simulators is constrained by numerous challenges, such as their computational cost and lack of fidelity in specific areas. In this paper, we describe the modality of virtual...

CoPEM: Cooperative Perception Error Models for Autonomous Driving

In this paper, we introduce the notion of Cooperative Perception Error Models (coPEMs) towards achieving an effective and efficient integration of V2X solutions within a virtual test environment. We focus our analysis on the occlusion problem in the (onboard) perception of Autonomous Vehicles (AV), which can manifest as misdetection errors on...

Modeling and Inference of Sparse Neural Dynamic Functional Connectivity Networks Underlying Functional Ultrasound Data

Functional ultrasound (fUS) is a novel neuroimaging technique that measures brain hemodynamics through a time series of Doppler images. The measured spatiotemporal hemodynamic changes reflect changes in neural activity through the neurovascular coupling (NVC). Often, such image time series is used to analyze dynamic functional connectivity ...

Automatic Camera Pose Estimation by Key-Point Matching of Reference Objects

In this paper, we aim to design an automatic camera pose estimation pipeline for clinical spaces such as catheterization laboratories. Our proposed pipeline exploits Scaled-YOLOv4 to detect fixed objects. We adopt the self-supervised key-point detector SuperPoint in combination with SuperGlue, a keypoint matching technique based on graph neural...

Nowcasting of Extreme Precipitation Using Deep Generative Models

Nowcasting is an observation-based method that uses the current state of the atmosphere to forecast future weather conditions over several hours. Recent studies have shown the promising potential of using deep learning models for precipitation nowcasting. In this paper, novel deep generative models are proposed for precipitation nowcasting....

A Dynamic Object Removal and Reconstruction Algorithm for Point Clouds

Autonomous vehicles (AV) are one of the greatest technological advancements of this decade and a giant leap in the transportation industry and mobile robotics. Autonomous vehicles face several major challenges in achieving higher levels of autonomy. One of these is to find a fast and reliable algorithm to process the sensor data so that the...