Indoor Scene Reconstruction Using Near-light Photometric Stereo

Journal Article (2017)
Author(s)

Jingtang Liao (TU Delft - Electrical Engineering, Mathematics and Computer Science)

Bert Buchholz (TU Delft - Electrical Engineering, Mathematics and Computer Science)

Jean-Marc Thiery (TU Delft - Electrical Engineering, Mathematics and Computer Science)

Pablo Bauszat (TU Delft - Electrical Engineering, Mathematics and Computer Science)

Elmar Eisemann (TU Delft - Electrical Engineering, Mathematics and Computer Science)

Research Group
Computer Graphics and Visualisation
DOI related publication
https://doi.org/10.1109/TIP.2016.2636661 Final published version
More Info
expand_more
Publication Year
2017
Language
English
Research Group
Computer Graphics and Visualisation
Journal title
IEEE Transactions on Image Processing
Issue number
3
Volume number
26
Pages (from-to)
1089-1101
Downloads counter
208

Abstract

We propose a novel framework for photometric stereo (PS) under low-light conditions using uncalibrated near-light illumination. It operates on free-form video sequences captured with a minimalistic and affordable setup. We address issues such as albedo variations, shadowing, perspective projections, and camera noise. Our method uses specular spheres detected with a perspective-correcting Hough transform to robustly triangulate light positions in the presence of outliers via a least-squares approach. Furthermore, we propose an iterative reweighting scheme in combination with an ℓp-norm minimizer to robustly solve the calibrated near-light PS problem. In contrast to other approaches, our framework reconstructs depth, albedo (relative to light source intensity), and normals simultaneously and is demonstrated on synthetic and real-world scenes.