Virtual Omnidirectional Video Synthesis with Multiple Cameras for Sports Training

Mariko Isogawa, Dan Mikami, Kosuke Takahashi, Akira Kojima

2015

Abstract

This paper proposes a new method to synthesize an omnidirectional video at a viewpoint inside a sports ground, with the goal of sports training. If athletes could virtually experience real games from a player's viewpoint, they might possibly be able to exhibit higher performance in an actual game. A head mounted display, which makes it possible to watch intuitive and interactive omnidirectional video from a 360-degree player's view, together with head direction tracking, leads to further enhanced effectiveness of training. However, it is difficult to put an omnidirectional camera on the field during a real game. Therefore, techniques for synthesizing an omnidirectional video at a player's viewpoint (virtual viewpoint) with the cameras outside the field are required. With this aim in mind, we propose a fast and stable omnidirectional video synthesis technique with image inpainting, which removes unwanted occluders between the virtual viewpoint and the cameras.

References

  1. Criminisi, A., Perez, P., and Toyama, K. (2004). Region filling and object removal by exemplar-based inpainting. IEEE Transactions on Image Processing, 13(9):1200- 1212.
  2. Guillemaut, J.-Y. and Hilton, A. (2011). Joint multi-layer segmentation and reconstruction for free-viewpoint video applications. International Journal of Computer Vision (IJCV), 93(1):73-100.
  3. He, K. and Sun, J. (2014). Image completion approaches using the statistics of similar patches. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 36(12):2423-2435.
  4. Huang, J.-B., Kang, S. B., Ahuja, N., and Kopf, J. (2014). Image completion using planar structure guidance. ACM Transactions on Graphics (Proceedings of SIGGRAPH 2014), 33(4):129:1-129:10.
  5. Inamoto, N. and Saito, H. (2007). Virtual viewpoint replay for a soccer match by view interpolation from multiple cameras. IEEE Transactions on Multimedia, 9(6):1155-1166.
  6. Levoy, M. and Hanrahan, P. (1996). Light field rendering. In Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, pages 31- 42. ACM.
Download


Paper Citation


in Harvard Style

Isogawa M., Mikami D., Takahashi K. and Kojima A. (2015). Virtual Omnidirectional Video Synthesis with Multiple Cameras for Sports Training . In Proceedings of the 3rd International Congress on Sport Sciences Research and Technology Support - Volume 1: icSPORTS, ISBN 978-989-758-159-5, pages 271-275. DOI: 10.5220/0005660602710275


in Bibtex Style

@conference{icsports15,
author={Mariko Isogawa and Dan Mikami and Kosuke Takahashi and Akira Kojima},
title={Virtual Omnidirectional Video Synthesis with Multiple Cameras for Sports Training},
booktitle={Proceedings of the 3rd International Congress on Sport Sciences Research and Technology Support - Volume 1: icSPORTS,},
year={2015},
pages={271-275},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005660602710275},
isbn={978-989-758-159-5},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 3rd International Congress on Sport Sciences Research and Technology Support - Volume 1: icSPORTS,
TI - Virtual Omnidirectional Video Synthesis with Multiple Cameras for Sports Training
SN - 978-989-758-159-5
AU - Isogawa M.
AU - Mikami D.
AU - Takahashi K.
AU - Kojima A.
PY - 2015
SP - 271
EP - 275
DO - 10.5220/0005660602710275