Texture-based 3D Face Recognition using Deep Neural Networks for Unconstrained Human-machine Interaction

Michael Danner, Michael Danner, Patrik Huber, Patrik Huber, Muhammad Awais, Zhen-Hua Feng, Josef Kittler, Matthias Raetsch

2020

Abstract

3D assisted 2D face recognition involves the process of reconstructing 3D faces from 2D images and solving the problem of face recognition in 3D. To facilitate the use of deep neural networks, a 3D face, normally represented as a 3D mesh of vertices and its corresponding surface texture, is remapped to image-like square isomaps by a conformal mapping. Based on previous work, we assume that face recognition benefits more from texture. In this work, we focus on the surface texture and its discriminatory information content for recognition purposes. Our approach is to prepare a 3D mesh, the corresponding surface texture and the original 2D image as triple input for the recognition network, to show that 3D data is useful for face recognition. Texture enhancement methods to control the texture fusion process are introduced and we adapt data augmentation methods. Our results show that texture-map-based face recognition can not only compete with state-of-the-art systems under the same preconditions but also outperforms standard 2D methods from recent years.

Paper Citation

in Harvard Style

Danner M., Huber P., Awais M., Feng Z., Kittler J. and Raetsch M. (2020). Texture-based 3D Face Recognition using Deep Neural Networks for Unconstrained Human-machine Interaction. In Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2020) - Volume 5: VISAPP; ISBN 978-989-758-402-2, SciTePress, pages 420-427. DOI: 10.5220/0008982504200427

in Bibtex Style

@conference{visapp20,
author={Michael Danner and Patrik Huber and Muhammad Awais and Zhen-Hua Feng and Josef Kittler and Matthias Raetsch},
title={Texture-based 3D Face Recognition using Deep Neural Networks for Unconstrained Human-machine Interaction},
booktitle={Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2020) - Volume 5: VISAPP},
year={2020},
pages={420-427},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0008982504200427},
isbn={978-989-758-402-2},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2020) - Volume 5: VISAPP
TI - Texture-based 3D Face Recognition using Deep Neural Networks for Unconstrained Human-machine Interaction
SN - 978-989-758-402-2
AU - Danner M.
AU - Huber P.
AU - Awais M.
AU - Feng Z.
AU - Kittler J.
AU - Raetsch M.
PY - 2020
SP - 420
EP - 427
DO - 10.5220/0008982504200427
PB - SciTePress