Harmonic Surface Networks

Harmonic Surface Networks

Wiersma, Ruben (TU Delft Electrical Engineering, Mathematics and Computer Science)

Hildebrandt, Klaus (mentor)
Eisemann, Elmar (mentor)

Delft University of Technology

Computer Science

2019-10-03

We present a new approach for deep learning on surfaces, combining geometric convolutional networks with rotationally equivariant networks. Existing work either learns rotationally invariant filters, or learns filters in the tangent plane without correctly relating orientations between different tangent planes (orientation ambiguity). We propose a solution to both problems by applying Harmonic Networks on surfaces in the tangent plane: Harmonic Surface Networks (HSN).
Harmonic Networks constrain their filters to circular harmonics, which output complexvalued, rotatable feature maps. Considering these complex features as vectors inside the tangent plane, we can use parallel transport along shortest geodesics to transport them along the surface in a natural way. Additionally, Harmonic Networks can be configured so that the output is rotationally invariant, while containing rotationally equivariant filters in hidden layers. This property solves the orientation ambiguity problem, while learning directional filters. We evaluate HSN on three different problems: classification on Rotated MNIST in a plane and mapped to a sphere, correspondence on FAUST, and shape segmentation on FAUST. The results suggest that HSN could improve on state of the art approaches.

Deep learning
Surfaces
Geometry processing
Convolutional Neural Networks
Rotational Equivariance
Machine Learning

http://resolver.tudelft.nl/uuid:931ee653-eb26-40c2-8f54-9c5835fd6fba

Student theses

master thesis

© 2019 Ruben Wiersma