A pipeline for multiparty volumetric video conferencing
Transmission of point clouds over low latency DASH
Jack Jansen (Centrum Wiskunde & Informatica (CWI))
Shishir Subramanyam (Centrum Wiskunde & Informatica (CWI))
Romain Bouqueau (MOTION SPELL)
Gianluca Cernigliaro (I2CAT Foundation)
Marc Martos Cabré (I2CAT Foundation)
Fernando Pérez Oyarzune (Modern Cultural)
Pablo Cesar (TU Delft - Multimedia Computing, Centrum Wiskunde & Informatica (CWI))
More Info
expand_more
Other than for strictly personal use, it is not permitted to download, forward or distribute the text or part of it, without the consent of the author(s) and/or copyright holder(s), unless the work is under an open content license such as Creative Commons.
Abstract
The advent of affordable 3D capture and display hardware is making volumetric videoconferencing feasible. This technology increases the immersion of the participants, breaking the flat restriction of 2D screens, by allowing them to collaborate and interact in shared virtual reality spaces. In this paper we introduce the design and development of an architecture intended for volumetric videoconferencing that provides a highly realistic 3D representation of the participants, based on pointclouds. A pointcloud representation is suitable for real-time applications like video conferencing, due to its low-complexity and because it does not need a time consuming reconstruction process. As transport protocol we selected low latency DASH, due to its popularity and client-based adaptation mechanisms for tiling. This paper presents the architectural design, details the implementation, and provides some referential results. The demo will showcase the system in action, enabling volumetric videoconferencing using pointclouds.