Real-Time Relighting of Human Faces with a Low-Cost Setup

Master thesis (2021)

Authors

N. Maček Electrical Engineering, Mathematics and Computer Science

Contributors

Ricardo Marroquim Computer Graphics and Visualisation - EEMCS (supervisor 1)
E. Eisemann Computer Graphics and Visualisation - EEMCS (supervisor 2)
J.C. van Gemert Pattern Recognition and Bioinformatics - EEMCS (supervisor 2)
Faculty
Electrical Engineering, Mathematics and Computer Science
Copyright: © 2021 Nejc Maček
Computer graphics Illumination Image registration Relighting Reflection function Face capture
More Info
expand_more

Published Date

25-06-2021

Language

English

Reuse Rights

Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.

Faculty

Electrical Engineering, Mathematics and Computer Science

Abstract

Video-streaming services usually feature post-processing effects to replace the background. However, these often yield inconsistent lighting. Machine-learning-based relighting methods can address this problem, but, at real-time rates, are restricted to a low resolution and can result in an unrealistic skin appearance. Physically-based rendering requires suitable skin models, which require specialised equipment. Our method is lightweight and uses only a standard smartphone. By correcting imperfections during capture, we extract a convincing physically-based skin model. In combination with suitable acceleration techniques, we achieve real-time rates on commodity hardware.