Paper 13.219

L. Lucas et al., "RECOVER3D: A Hybrid Multi-View System for 4D Reconstruction of Moving Actors", in Proc. of 4th Int. Conf. on 3D Body Scanning Technologies, Long Beach CA, USA, 2013, pp. 219-230, https://doi.org/10.15221/13.219.

Title:

RECOVER3D: A Hybrid Multi-View System for 4D Reconstruction of Moving Actors

Authors:

Laurent LUCAS 1, Philippe SOUCHET 2, Muhannad ISMAËL 1, Olivier NOCENT 1, Cédric NIQUIN 2, Céline LOSCOS 1, Ludovic BLACHE 1, Stéphanie PREVOST 1, Yannick REMION 1

1 CReSTIC-SIC, Université de Reims Champagne Ardenne, Reims, France;
2 XD Production, Issy-les-Moulineau, France

Abstract:

4D multi-view reconstruction of moving actors has many applications in the entertainment industry and although studios providing such services become more accessible, efforts have to be done in order to improve the underlying technology and to produce high-quality 3D contents. The RECOVER3D project aim is to elaborate an integrated virtual video system for the broadcast and motion pictures markets. In particular, we present a hybrid acquisition system coupling mono and multiscopic video cameras where actor's performance is captured as 4D data set: a sequence of 3D volumes over time. The visual improvement of the software solutions being implemented relies on "silhouette-based" techniques and (multi-)stereovision, following several hybridization scenarios integrating GPU-based processing. Afterwards, we transform this sequence of independent 3D volumes in a unique dynamic mesh. Our approach is based on a motion estimation procedure. An adaptive signed volume distance function is used as the principal shape descriptor and an optical flow algorithm is adapted to the surface setting with a modification that minimizes the interference between unrelated surface regions.

Keywords:

3D body modeling system, entertainment, multi-view camera, multi-view stereovision and visual hull hybridization, animated model, dynamic mesh

Details:

Full paper: 13.219.pdf
Proceedings: 3DBST 2013, 19-20 Nov. 2013, Long Beach California, USA
Pages: 219-230
DOI: https://doi.org/10.15221/13.219

Copyright notice

© Hometrica Consulting - Dr. Nicola D'Apuzzo, Switzerland, www.hometrica.ch.
Reproduction of the proceedings or any parts thereof (excluding short quotations for the use in the preparation of reviews and technical and scientific papers) may be made only after obtaining the specific approval of the publisher. The papers appearing in the proceedings reflect the author's opinions. Their inclusion in these publications does not necessary constitute endorsement by the editor or by the publisher. Authors retain all rights to individual papers.

Proceedings of 3DBODY.TECH International Conferences on 3D Body Scanning & Processing Technologies, © Hometrica Consulting, Switzerland