Temporal Delta Layer: Training Towards Brain Inspired Temporal Sparsity for Energy Efficient Deep Neural Networks

In the recent past, real-time video processing using state-of-the-art deep neural networks (DNN) has achieved human-like accuracy but at the cost of high energy consumption, making them infeasible for edge device deployment. The energy consumed by running DNNs on hardware accelerators is dominated by the number of memory read/writes and...

Matting using a known background and a chroma-key minimization scheme

In this paper, we investigate the problem of segmenting the foreground objects from the known background. The target application is a setting where a large display serves as the backdrop for a scene. The method proposed in this paper solves this problem in two steps. We try to separate the foreground and the background with the modified...

Multi-frame deep learning models for action detection in surveillance videos

Visual surveillance technologies are increasingly being used to monitor public spaces. These technologies process the recordings of surveillance cameras. Such recordings contain depictions of human actions such as "running", "waving", and "aggression". In the field of computer vision, automated detection of human actions in videos is known as...

Gradient-Guided Local Disparity Editing

Stereoscopic 3D technology gives visual content creators a new dimension of design when creating images and movies. While useful for conveying emotion, laying emphasis on certain parts of the scene, or guiding the viewer's attention, editing stereo content is a challenging task. Not respecting comfort zones or adding incorrect depth cues, for...

Processing Upper Airway Endoscopic Videos For Sleep Apnea Diagnostics.

Obstructive sleep apnea (OSA) is a common sleep disorder. Surgery is sometimes recommended, by specialists, for severe OSA. In that case, an endoscopic investigation with the patient under sedation would take place. By automating the detection of upper airway collapsing from the endoscopic video, we hope to assist doctors in their diagnostic of...

Multimodal Surveillance: Behavior analysis for recognizing stress and aggression

Nowadays, camera systems are installed in military areas as well as in public spaces like schools, shopping malls, airports, and football stadiums. Human operators are monitoring the screens, looking for any signs of unwanted behavior and negative incidents. The task requires working personnel 24/7. With the ever increasing number of cameras,...

Efficient Execution of Video Applications on Heterogeneous Multi- and Many-Core Processors

In this dissertation we present methodologies and evaluations aiming at increasing the efficiency of video coding applications for heterogeneous many-core processors composed of SIMD-only, scratchpad memory based cores. Our contributions are spread in three different fronts: thread-level parallelism strategies for many-cores, identification of...

Noise filtering of image sequences

Determining particle size distributions from video images by use of image processing

Recently a lot of research is being done on cohesive sediment. It plays a major role in the shoaling of harbours and waterways, and in some serious environmental problems. To predict cohesive sediment transport, information is needed about the distributions of size and settling velocities. Many methods exist to determine sizes suspended...