PG-3DVTON: Pose-Guided 3D Virtual Try-on Network

Sanaz Sabzevari, Ali Ghadirzadeh, Mårten Björkman, Danica Kragic

2023

Abstract

Virtual try-on (VTON) eliminates the need for in-store trying of garments by enabling shoppers to wear clothes digitally. For successful VTON, shoppers must encounter a try-on experience on par with in-store trying. We can improve the VTON experience by providing a complete picture of the garment using a 3D visual pre-sentation in a variety of body postures. Prior VTON solutions show promising results in generating such 3D presentations but have never been evaluated in multi-pose settings. Multi-pose 3D VTON is particularly challenging as it often involves tedious 3D data collection to cover a wide variety of body postures. In this paper, we aim to develop a multi-pose 3D VTON that can be trained without the need to construct such a dataset. Our framework aligns in-shop clothes to the desired garment on the target pose by optimizing a consistency loss. We address the problem of generating fine details of clothes in different postures by incorporating multi-scale feature maps. Besides, we propose a coarse-to-fine architecture to remove artifacts inherent in 3D visual presentation. Our empirical results show that the proposed method is capable of generating 3D presentations in different body postures while outperforming existing methods in fitting fine details of the garment.

Paper Citation

in Harvard Style

Sabzevari S., Ghadirzadeh A., Björkman M. and Kragic D. (2023). PG-3DVTON: Pose-Guided 3D Virtual Try-on Network. In Proceedings of the 18th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2023) - Volume 4: VISAPP; ISBN 978-989-758-634-7, SciTePress, pages 819-829. DOI: 10.5220/0011658100003417

in Bibtex Style

@conference{visapp23,
author={Sanaz Sabzevari and Ali Ghadirzadeh and Mårten Björkman and Danica Kragic},
title={PG-3DVTON: Pose-Guided 3D Virtual Try-on Network},
booktitle={Proceedings of the 18th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2023) - Volume 4: VISAPP},
year={2023},
pages={819-829},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0011658100003417},
isbn={978-989-758-634-7},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 18th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2023) - Volume 4: VISAPP
TI - PG-3DVTON: Pose-Guided 3D Virtual Try-on Network
SN - 978-989-758-634-7
AU - Sabzevari S.
AU - Ghadirzadeh A.
AU - Björkman M.
AU - Kragic D.
PY - 2023
SP - 819
EP - 829
DO - 10.5220/0011658100003417
PB - SciTePress