Photo2Video: Semantic-Aware Deep Learning-Based Video Generation from Still Content

Applying machine learning (ML), and especially deep learning, to understand visual content is becoming common practice in many application areas. However, little attention has been given to its use within the multimedia creative domain. It is true that ML is already popular for content creation, but the progress achieved so far addresses...

A high-performance and energy-efficient FIR adaptive filter using approximate distributed arithmetic circuits

In this paper, a fixed-point finite impulse response adaptive filter is proposed using approximate distributed arithmetic (DA) circuits. In this design, the radix-8 Booth algorithm is used to reduce the number of partial products in the DA architecture, although no multiplication is explicitly performed. In addition, the partial products are...

Stable image registration for in-vivo fetoscopic panorama reconstruction

A Twin-to-Twin Transfusion Syndrome (TTTS) is a condition that occurs in about 10% of pregnancies involving monochorionic twins. This complication can be treated with fetoscopic laser coagulation. The procedure could greatly benefit from panorama reconstruction to gain an overview of the placenta. In previous work we investigated which steps...

Viewpoint optimization for aiding grasp synthesis algorithms using reinforcement learning

Grasp synthesis for unknown objects is a challenging problem as the algorithms are expected to cope with missing object shape information. This missing information is a function of the vision sensor viewpoint. The majority of the grasp synthesis algorithms in literature synthesize a grasp by using one single image of the target object and...

Tip-on-a-chip: Automatic dotting with glitter ink pen for individual identification of tiny parts

This paper presents a new identification system for tiny parts that have no space for applying conventional ID marking or tagging. The system marks the parts with a single dot using ink containing shiny particles. The particles in a single dot naturally form a unique pattern. The parts are then identified by matching microscopic images of...

Active vision via extremum seeking for robots in unstructured environments: Applications in object recognition and manipulation

In this paper, a novel active vision strategy is proposed for optimizing the viewpoint of a robot's vision sensor for a given success criterion. The strategy is based on extremum seeking control (ESC), which introduces two main advantages: 1) Our approach is model free: It does not require an explicit objective function or any other task...

Simultaneous capture of the color and topography of paintings using fringe encoded stereo vision

Introduction: Paintings are versatile near-planar objects with material characteristics that vary widely. The fact that paint has a material presence is often overlooked, mostly due to the fact that we encounter many of these artworks through two dimensional reproductions. The capture of paintings in the third dimension is not only interesting...

Topographical scanning and reproduction of near-planar surfaces of paintings

Paintings are near-planar objects with material characteristics that vary widely. The fact that paint has a material presence is often overlooked, mostly because we often encounter these artworks in the form of two-dimensional reproductions. Capturing paintings in the third dimension is not only important for study, restoration and conservation,...

Adaptive multi-dimensional data decomposition

A method of decomposing an image or video into a plurality of components. The method comprises: obtaining (10) an intensity signal of the image or video; and decomposing (30) the intensity signal into a component representing the three-dimensional structure shape of one or more objects in the scene and at least one other component. Also provided...

A novel gesture-based interface for crime scene investigation in mediated reality

This paper introduces a novel gesture-based interface for crime scene investigation. The interface is part of a mediated reality system in which remote collaboration is supported. Requirements elicited from interviews and interactive sessions showed that our gesture-based user interface is effective in operating a 3D interface and allows the...

Accelerating reinforcement learning on a robot by using subgoals in a hierarchical framework

Reinforcement learning is a way to learn control tasks by trial and error. Even for simple motor control tasks, however, this can take a long time. We can speed up learning by using prior knowledge, but this is not always available, especially for an autonomous agent. One way to add limited prior knowledge is to use subgoals, defining points...

The Effects of Large Disturbances on On-Line Reinforcement Learning for aWalking Robot

Reinforcement Learning is a promising paradigm for adding learning capabilities to humanoid robots. One of the difficulties of the real world is the presence of disturbances. In Reinforcement Learning, disturbances are typically dealt with stochastically. However, large and infrequent disturbances do not fit well in this framework; essentially,...

Discovery of high-level tasks in the operating room

Recognizing and understanding surgical high-level tasks from sensor readings is important for surgical workflow analysis. Surgical high-level task recognition is also a challenging task in ubiquitous computing because of the inherent uncertainty of sensor data and the complexity of the operating room environment. In this paper, we present a...

Gradient estimation in uncertain data

Morphological image processing: Architecture and VLSI design