Customized 3D Clothes Modeling for Virtual Try-on System based on Multiple Kinects

Shiyi Huang, Won-sook Lee

2016

Abstract

Most existing 3D virtual try-on systems put clothes designed in one environment on a human captured in another environment, which cause the mismatching brightness problem. And also typical 3D clothes modeling starts with manually designed 2D patterns, deforms them to fit on a human, and applies stitching to sew those patterns together. Such work usually relies on labour work. In this paper, we describe an approach to reconstruct clothes and human that both are from the same space. With multiple Kinects, it models the 3D clothes directly out of a dressed human without the need of the predefined 2D clothes patterns, and fits them to a human user. Our approach has several advantages: (1) a simple hardware setting consisted of multiple Kinects to capture a human model; (2) 3D clothes modeling directly out of captured human model. To the best of our knowledge, our work is the first one which separates clothes out of captured human figures; (3) resizing of clothes adapting to any sized human user; (4) a novel idea of virtual try-on where clothes and human are captured in the same location.

References

  1. Araki, N., and Muraoka, Y. 2008. Follow-the-Trial-Fitter Real-time addressing without undressing. In Third International Conference on Digital Information Management, 33-38.
  2. Besl, P. J., and McKay, N. D. 1992. Method for registration of 3-D shapes. In International Society for Optics and Photonics, Robotics-DL tentative, 586-606.
  3. Deng, Y. and Manjunath, B. S. 2001. Unsupervised segmentation of colour-texture regions in images and video. IEEE Transactions on Pattern Analysis and Machine Intelligence, 800-810.
  4. Furukawa, T. Gu, J., Lee, W., and Magnenat-Thalmann, N. 2000. 3D clothes modeling from photo cloned human body. In Springer Berlin Heidelberg, Virtual Worlds, 159-170.
  5. Giovanni, s., Choi, Y. C., Huang, J., Khoo, E. T., and Yin, K. 2012. Virtual try-on using Kinect and HD camera. In Springer Berlin Heidelberg, Motion in Games, 55- 65.
  6. Hauswiesner, S., Straka, M., and Reitmayr, G. 2013. Virtual try-on through image-based rendering. IEEE Transactions on Visualization and Computer Graphics, 1552-1565.
  7. Isikdogan, F., and Kara, G. 2013. A real time virtual dressing room using Kinect.
  8. Kazhdan, M., Bolitho, M., and Hoppe, H. 2006. Poisson surface reconstruction. In Proceedings of the fourth Eurographics symposium on Geometry processing.
  9. Li, J., Ye, J., Wang, Y., Bai, L., and Lu, G. 2010. Fitting 3D garment models onto individual human models. In Computers and Graphics, 742-755.
  10. Macknojia, R., Chavez-Aragon, A., Payeur, P., and Laganiere, R. 2013. Calibration of a network Kinect sensors for robotic inspection over a large workspace. In IEEE Workshop on Robot Vision, 184-190.
  11. Newcombe, R. A., Izadi, S., Hilliges, O., Molyneaux, D., Kim, D., Davison, A. J., and Fitzgibbon, A. 2011. KinectFusion: Real-time dense surface mapping and tracking. In 10th IEEE international symposium on Mixed and augmented reality, 127-136.
  12. Yuan, M., Khan, I. R., Farbiz, F., Yao, S., Niswar, A., and Foo, M. H. 2013. A mixed reality virtual clothes tryon system. IEEE Transactions on Multimedia, 1958- 1968.
  13. Zhang, Z. 2000. A flexible new technique for camera calibration. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1330-1334.
  14. Zhou, K., Wang, X., Tong, Y., Desbrun, M., Guo, B., and Shum, H. Y. 2005. TextureMontage. In ACM Transactions on Graphics, 1148-1155.
  15. Zhang, Y., Zheng, J., and Magnenat-Thalmann, N. 2014. Clothes Simulation and Virtual Try-on with Kinect Based on Human Body Adaptation. In Spring Singapore Simulation, Serous Games and Their Applications, 31-50.
Download


Paper Citation


in Harvard Style

Huang S. and Lee W. (2016). Customized 3D Clothes Modeling for Virtual Try-on System based on Multiple Kinects . In Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2016) ISBN 978-989-758-175-5, pages 118-123. DOI: 10.5220/0005782001160121


in Bibtex Style

@conference{grapp16,
author={Shiyi Huang and Won-sook Lee},
title={Customized 3D Clothes Modeling for Virtual Try-on System based on Multiple Kinects},
booktitle={Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2016)},
year={2016},
pages={118-123},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005782001160121},
isbn={978-989-758-175-5},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2016)
TI - Customized 3D Clothes Modeling for Virtual Try-on System based on Multiple Kinects
SN - 978-989-758-175-5
AU - Huang S.
AU - Lee W.
PY - 2016
SP - 118
EP - 123
DO - 10.5220/0005782001160121