3D Face Reconstruction from RGB-D Data by Morphable Model to Point Cloud Dense Fitting

Claudio Ferrari, Stefano Berretti, Pietro Pala, Alberto Bimbo

2019

Abstract

3D cameras for face capturing are quite common today thanks to their ease of use and affordable cost. The depth information they provide is mainly used to enhance face pose estimation and tracking, and face-background segmentation, while applications that require finer face details are usually not possible due to the low-resolution data acquired by such devices. In this paper, we propose a framework that allows us to derive high-quality 3D models of the face starting from corresponding low-resolution depth sequences acquired with a depth camera. To this end, we start by defining a solution that exploits temporal redundancy in a short-sequence of adjacent depth frames to remove most of the acquisition noise and produce an aggregated point cloud output with intermediate level details. Then, using a 3DMM specifically designed to support local and expression-related deformations of the face, we propose a two-steps 3DMM fitting solution: initially the model is deformed under the effect of landmarks correspondences; subsequently, it is iteratively refined using points closeness updating guided by a mean-square optimization. Preliminary results show that the proposed solution is able to derive 3D models of the face with high visual quality; quantitative results also evidence the superiority of our approach with respect to methods that use one step fitting based on landmarks.

Paper Citation

in Harvard Style

Ferrari C., Berretti S., Pala P. and Bimbo A. (2019). 3D Face Reconstruction from RGB-D Data by Morphable Model to Point Cloud Dense Fitting.In Proceedings of the 8th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM, ISBN 978-989-758-351-3, pages 728-735. DOI: 10.5220/0007521007280735

in Bibtex Style

@conference{icpram19,
author={Claudio Ferrari and Stefano Berretti and Pietro Pala and Alberto Bimbo},
title={3D Face Reconstruction from RGB-D Data by Morphable Model to Point Cloud Dense Fitting},
booktitle={Proceedings of the 8th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,},
year={2019},
pages={728-735},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0007521007280735},
isbn={978-989-758-351-3},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 8th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,
TI - 3D Face Reconstruction from RGB-D Data by Morphable Model to Point Cloud Dense Fitting
SN - 978-989-758-351-3
AU - Ferrari C.
AU - Berretti S.
AU - Pala P.
AU - Bimbo A.
PY - 2019
SP - 728
EP - 735
DO - 10.5220/0007521007280735