Automated Generation of Synthetic in-Car Dataset for Human Body Pose Detection

João Borges, Bruno Oliveira, Helena Torres, Nelson Rodrigues, Sandro Queirós, Sandro Queirós, Sandro Queirós, Maximilian Shiller, Victor Coelho, Johannes Pallauf, José Henrique Brito, Jaime C. Fonseca

2020

Abstract

In this paper, a toolchain for the generation of realistic synthetic images for human body pose detection in an in-car environment is proposed. The toolchain creates a customized synthetic environment, comprising human models, car, and camera. Poses are automatically generated for each human, taking into account a per-joint axis Gaussian distribution, constrained by anthropometric and range of motion measurements. Scene validation is done through collision detection. Rendering is focused on vision data, supporting time-of-flight (ToF) and RGB cameras, generating synthetic images from these sensors. Ground-truth data is then generated, comprising the car occupants’ body pose (2D/3D), as well as full body RGB segmentation frames with different body parts’ labels. We demonstrate the feasibility of using synthetic data, combined with real data, to train distinct machine learning agorithms, demonstrating the improvement in their algorithmic accuracy for the in-car scenario.

Paper Citation

in Harvard Style

Borges J., Oliveira B., Torres H., Rodrigues N., Queirós S., Shiller M., Coelho V., Pallauf J., Mendes J. and Fonseca J. (2020). Automated Generation of Synthetic in-Car Dataset for Human Body Pose Detection. In Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2020) - Volume 5: VISAPP; ISBN 978-989-758-402-2, SciTePress, pages 550-557. DOI: 10.5220/0009316205500557

in Bibtex Style

@conference{visapp20,
author={João Borges and Bruno Oliveira and Helena Torres and Nelson Rodrigues and Sandro Queirós and Maximilian Shiller and Victor Coelho and Johannes Pallauf and José Henrique Mendes and Jaime C. Fonseca},
title={Automated Generation of Synthetic in-Car Dataset for Human Body Pose Detection},
booktitle={Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2020) - Volume 5: VISAPP},
year={2020},
pages={550-557},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0009316205500557},
isbn={978-989-758-402-2},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2020) - Volume 5: VISAPP
TI - Automated Generation of Synthetic in-Car Dataset for Human Body Pose Detection
SN - 978-989-758-402-2
AU - Borges J.
AU - Oliveira B.
AU - Torres H.
AU - Rodrigues N.
AU - Queirós S.
AU - Shiller M.
AU - Coelho V.
AU - Pallauf J.
AU - Mendes J.
AU - Fonseca J.
PY - 2020
SP - 550
EP - 557
DO - 10.5220/0009316205500557
PB - SciTePress