Paper 12.247

X. Zhou et al., "A Single-Shot and Real-Time 3D Imaging Technique for Facial Motion Capture Based on Triple-Frequency Color Fringe Projection", in Proc. of 3rd Int. Conf. on 3D Body Scanning Technologies, Lugano, Switzerland, 2012, pp. 247-256, https://doi.org/10.15221/12.247.

Title:

A Single-Shot and Real-Time 3D Imaging Technique for Facial Motion Capture Based on Triple-Frequency Color Fringe Projection

Authors:

Xiang ZHOU 1,2, Tao YANG 1, Zhuangqun YANG 3, Hong ZHAO 1, Adrian Gh. PODOLEANU 2

1 State Key Laboratory Manufacturing Systems Engineering, Xi'an Jiaotong University, Xi'an, Shaanxi, China;
2 School of Physical Sciences, University of Kent, Canterbury, UK;
3 The First Affiliated Hospital of Medical College of Xi'an Jiaotong University, Xi'an, Shaanxi, China

Abstract:

Fast and high-accuracy 3D imaging is playing an important role in scanning human face sunder dynamical change. This paper presents a single-shot technique for real-time surface profiling and texture retrieving of human face. In this technique, three fringe patterns with a carrier frequency ratio of 1:3:9 are encoded in the red (R), green (G) and blue (B) channels of a color fringe pattern and projected onto the object's surface by a 3-LCD projector. The deformed color fringe pattern is captured by color CCD from another angle. The cross talk among color channels of commercial CCD and projector is modeled as the color coupling equations. Then FFT-Spectrum minimization and bi-dimensional empirical mode decomposition (BEMD) are employed to solve the equations, thereby extracting the low, medium and high fundamental frequency components from R, G and B patterns. 2D-FFT is performed to retrieve wrapping phase distributions of three components. Afterwards, a three-step phase unwrapping strategy is formulated to recursively unwrap phases from low, medium and high carrier patterns. Unwrapped phase of the high-frequency component is selected to recover the object's height distribution. Apart from the shape, textures of objects are as well retrieved by solving the color coupling equations, facilitating 3D real construction combined with textures. The algorithm is accelerated by GPU parallel computation, fulfilling so far 1 frame/s 3D real reconstruction.

Keywords:

3d body scanning, facial motion capture, fringe pattern projection, texture extraction

Details:

Full paper: 12.247.pdf
Proceedings: 3DBST 2012, 16-17 Oct. 2012, Lugano, Switzerland
Pages: 247-256
DOI: https://doi.org/10.15221/12.247

Copyright notice

© Hometrica Consulting - Dr. Nicola D'Apuzzo, Switzerland, www.hometrica.ch.
Reproduction of the proceedings or any parts thereof (excluding short quotations for the use in the preparation of reviews and technical and scientific papers) may be made only after obtaining the specific approval of the publisher. The papers appearing in the proceedings reflect the author's opinions. Their inclusion in these publications does not necessary constitute endorsement by the editor or by the publisher. Authors retain all rights to individual papers.

Proceedings of 3DBODY.TECH International Conferences on 3D Body Scanning & Processing Technologies, © Hometrica Consulting, Switzerland