Automatic landmark correspondence detection in medical images with an application to deformable image registration

Purpose: Deformable image registration (DIR) can benefit from additional guidance using corresponding landmarks in the images. However, the benefits thereof are largely understudied, especially due to the lack of automatic landmark detection methods for three-dimensional (3D) medical images. Approach: We present a deep convolutional neural...

DeltaConv: Anisotropic Operators for Geometric Deep Learning on Point Clouds

Learning from 3D point-cloud data has rapidly gained momentum, motivated by the success of deep learning on images and the increased availability of 3D~data. In this paper, we aim to construct anisotropic convolution layers that work directly on the surface derived from a point cloud. This is challenging because of the lack of a global...

Deep Vanishing Point Detection: Geometric priors make dataset variations vanish

Deep learning has improved vanishing point detection in images. Yet, deep networks require expensive annotated datasets trained on costly hardware and do not generalize to even slightly different domains, and minor problem variants. Here, we address these issues by injecting deep vanishing point detection networks with prior knowledge. This...

Map-Grasp: A deep learning approach to bin-picking

Automated bin-picking is a difficult task that requires solving multiple robotic vision problems including object detection and grasp proposal generation. Current methods use deep learning to approach each of the vision problems of bin-picking separately with the main focus on generating the grasp proposals. For grasp proposal generation, neural...

CNNs on Surfaces using Rotation-Equivariant Features

This paper is concerned with a fundamental problem in geometric deep learning that arises in the construction of convolutional neural networks on surfaces. Due to curvature, the transport of filter kernels on surfaces results in a rotational ambiguity, which prevents a uniform alignment of these kernels on the surface. We propose a network...

Harmonic Surface Networks

We present a new approach for deep learning on surfaces, combining geometric convolutional networks with rotationally equivariant networks. Existing work either learns rotationally invariant filters, or learns filters in the tangent plane without correctly relating orientations between different tangent planes (orientation ambiguity). We propose...