An Adversarial Training based Framework for Depth Domain Adaptation

Jigyasa Singh Katrolia, Lars Krämer, Jason Rambach, Bruno Mirbach, Didier Stricker, Didier Stricker

2021

Abstract

In absence of sufficient labeled training data, it is common practice to resort to synthetic data with readily available annotations. However, some performance gap still exists between deep learning models trained on synthetic versus on real data. Using adversarial training based generative models, it is possible to translate images from synthetic to real domain and train on them easily generalizable models for real-world datasets, but the efficiency of this method is limited in the presence of large domain shifts such as between synthetic and real depth images characterized by depth sensor and scene dependent artifacts in the image. In this paper, we present an adversarial training based framework for adapting depth images from synthetic to real domain. We use a cyclic loss together with an adversarial loss to bring the two domains of synthetic and real depth images closer by translating synthetic images to real domain, and demonstrate the usefulness of synthetic images modified this way for training deep neural networks that can perform well on real images. We demonstrate our method for the application of person detection and segmentation in real-depth images captured in a car for in-cabin person monitoring. We also show through experiments the effect of using target domain image sets captured using different types of depth sensors on this domain adaptation approach.

Paper Citation

in Harvard Style

Katrolia J., Krämer L., Rambach J., Mirbach B. and Stricker D. (2021). An Adversarial Training based Framework for Depth Domain Adaptation. In Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2021) - Volume 4: VISAPP; ISBN 978-989-758-488-6, SciTePress, pages 353-361. DOI: 10.5220/0010252403530361

in Bibtex Style

@conference{visapp21,
author={Jigyasa Singh Katrolia and Lars Krämer and Jason Rambach and Bruno Mirbach and Didier Stricker},
title={An Adversarial Training based Framework for Depth Domain Adaptation},
booktitle={Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2021) - Volume 4: VISAPP},
year={2021},
pages={353-361},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010252403530361},
isbn={978-989-758-488-6},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2021) - Volume 4: VISAPP
TI - An Adversarial Training based Framework for Depth Domain Adaptation
SN - 978-989-758-488-6
AU - Katrolia J.
AU - Krämer L.
AU - Rambach J.
AU - Mirbach B.
AU - Stricker D.
PY - 2021
SP - 353
EP - 361
DO - 10.5220/0010252403530361
PB - SciTePress