You Can Dance! Generating Music-Conditioned Dances on Real 3D Scans

Elona Dupont, Inder Singh, Laura Fuentes, Sk Ali, Anis Kacem, Enjie Ghorbel, Djamila Aouada

2023

Abstract

The generation of realistic body dances that are coherent with music has recently caught the attention of the Computer Vision community, due to its various real-world applications. In this work, we are the first to present a fully automated framework ‘You Can Dance’ that generates a personalized music-conditioned 3D dance sequence, given a piece of music and a real 3D human scan. ‘You Can Dance’ is composed of two modules: (1) The first module fits a parametric body model to an input 3D scan; (2) the second generates realistic dance poses that are coherent with music. These dance poses are injected into the body model to generate animated 3D dancing scans. Furthermore, the proposed framework is used to generate a synthetic dataset consisting of music-conditioned dancing 3D body scans. A human-based evaluation study is conducted to assess the quality and realism of the generated 3D dances. This study along with the qualitative results shows that the proposed framework can generate plausible music-conditioned 3D dances.

Paper Citation

in Harvard Style

Dupont E., Singh I., Fuentes L., Ali S., Kacem A., Ghorbel E. and Aouada D. (2023). You Can Dance! Generating Music-Conditioned Dances on Real 3D Scans. In Proceedings of the 18th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2023) - Volume 4: VISAPP; ISBN 978-989-758-634-7, SciTePress, pages 459-466. DOI: 10.5220/0011790900003417

in Bibtex Style

@conference{visapp23,
author={Elona Dupont and Inder Singh and Laura Fuentes and Sk Ali and Anis Kacem and Enjie Ghorbel and Djamila Aouada},
title={You Can Dance! Generating Music-Conditioned Dances on Real 3D Scans},
booktitle={Proceedings of the 18th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2023) - Volume 4: VISAPP},
year={2023},
pages={459-466},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0011790900003417},
isbn={978-989-758-634-7},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 18th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2023) - Volume 4: VISAPP
TI - You Can Dance! Generating Music-Conditioned Dances on Real 3D Scans
SN - 978-989-758-634-7
AU - Dupont E.
AU - Singh I.
AU - Fuentes L.
AU - Ali S.
AU - Kacem A.
AU - Ghorbel E.
AU - Aouada D.
PY - 2023
SP - 459
EP - 466
DO - 10.5220/0011790900003417
PB - SciTePress