Mesh Animation Compression using Skinning and Multi-chart Displacement Texture

Andrej Fúsek, Adam Riečický, Adam Riečický, Martin Stuchlík, Martin Madaras, Martin Madaras, Martin Madaras

2021

Abstract

Realistic animations of 3D models are currently very complex, and to stream them over a network in real-time, it is necessary to use compression. Currently, many different methods can be used. Some of them use skeleton transformation as an approximation of the animation, others use remeshing for decreasing mesh complexity. In this paper, a novel method of 3D animation compression is presented. It is based on reconstructing a 3D mesh from a 2D displacement texture and subsequent skeletal skinning enhanced by a surface tuning. The tuning is performed by displacing the skinned vertices according to high-frequency details encoded in a Differential Texture since the output of the skinning is just an approximation of the original animation. Skinning weights are encoded in another new texture type - Skinning Map. In each frame of the streaming animation, just a new skeleton pose and the Differential Texture are needed to be sent. The proposed method has a high compression ratio for various animations because the pose is a small data structure and the Differential Texture contains just high-frequency details and on top of that, it can be compressed as video. Furthermore, differences between original and reconstructed animation are minimal, as evidenced by visual and numerical comparisons.

Paper Citation

in Harvard Style

Fúsek A., Riečický A., Stuchlík M. and Madaras M. (2021). Mesh Animation Compression using Skinning and Multi-chart Displacement Texture. In Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2021) - Volume 1: GRAPP; ISBN 978-989-758-488-6, SciTePress, pages 201-208. DOI: 10.5220/0010244302010208

in Bibtex Style

@conference{grapp21,
author={Andrej Fúsek and Adam Riečický and Martin Stuchlík and Martin Madaras},
title={Mesh Animation Compression using Skinning and Multi-chart Displacement Texture},
booktitle={Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2021) - Volume 1: GRAPP},
year={2021},
pages={201-208},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010244302010208},
isbn={978-989-758-488-6},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2021) - Volume 1: GRAPP
TI - Mesh Animation Compression using Skinning and Multi-chart Displacement Texture
SN - 978-989-758-488-6
AU - Fúsek A.
AU - Riečický A.
AU - Stuchlík M.
AU - Madaras M.
PY - 2021
SP - 201
EP - 208
DO - 10.5220/0010244302010208
PB - SciTePress