A Mobile AR System for Sports Spectators using Multiple Viewpoint Cameras

Ruiko Miyano, Takuya Inoue, Takuya Minagawa, Yuko Uematsu, Hideo Saito

2013

Abstract

In this paper, we aimto develop an AR system which supports spectators who are watching a sports game using smartphones in a spectators’ stand. The final goal of this system is that a spectator can watch information of players through a smartphone and share experiences with other spectators. For this goal, we propose a system which consists of smartphones and fixed cameras. Fixed cameras are set to cover the whole sports field and used to analyze players. Smartphones held by spectators are used to estimate positions where they are looking on the sports field. We built an AR system which makes annotation of players’ information onto a smartphone image. And we evaluated the accuracy and the processing time of our system and revealed its practicality.

References

  1. Chen, C.-S., Hsieh, W.-T., and Chen, J.-H. (2004). Panoramic appearance-based recognition of video contents using matching graphs. IEEE Transactions on Systems, Man, and Cybernetics, 34(1):179-199.
  2. Delannay, D., Danhier, N., and Vleeschouwer, C. D. (2009). Detection and recognition of sports(wo)men from multiple views. In Third ACM/IEEE International Conference on Distributed Smart Cameras (ICDSC).
  3. Fleuret, F., Berclaz, J., Lengagne, R., and Fua, P. (2008). Multicamera people tracking with a probabilistic occupancy map. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 30(2):267-282.
  4. Kasturi, R., Goldgof, D., Soundararajan, P., Manohar, V., Garofolo, J., Bowers, R., Boonstra, M., Korzhova, V., and Zhang, J. (2009). Framework for performance evaluation of face, text, and vehicle detection and tracking in video: Data, metrics, and protocol. IEEE Transaction on Pattern Analysis and Machine Intelligence (PAMI), 31(2):319-336.
  5. Kasuya, N., Kitahara, I., Kameda, Y., and Ohta, Y. (2010). Real-time soccer player tracking method by utilizing shadow regions. In 18th International Conference on Multimedia.
  6. Khan, S. M. and Shah, M. (2009). A multiview approach to tracking people in crowded scenes using a planar homography constraint. IEEE Transaction on Pattern Analysis and Machine Intelligence (PAMI), 31(3):505-519.
  7. Klein, G. and Murray, D. (2009). Parallel tracking and mapping on a camera phone. In IEEE International Symposium on Mixed and Augmented Reality (ISMAR).
  8. Lee, S.-O., Ahn, S. C., Hwang, J.-I., and Kim, H.-G. (2011). A vision-based mobile augmented reality system for baseball games. In International Conference, Virtual and Mixed Reality.
  9. Liu, J., Tong, X., Li, W., Wang, T., Zhang, Y., Wang, H., Yang, B., Sun, L., and Yang, S. (2009). Automatic player detection, labeling and tracking in broadcast soccer video. Pattern Recognition Letters, 30(2):103- 113.
  10. Microsoft-Research (2011). Image Composite Editor. http://research.microsoft.com/en-us/um/redmond/ groups/ivm/ice/.
  11. Miura, J. and Kubo, H. (2008). Tracking players in highly complex scenes in broadcast soccer video using a constraint satisfaction approach. In International Conference on Content-based Image and Video Retrieval (CIVR).
  12. Miyano, R., Inoue, T., Minagawa, T., Uematsu, Y., and Saito, H. (2012). Camera pose estimation of a smartphone at a field without interest points. In ACCV Workshop on Intelligent Mobile Vision (IMV).
  13. Oe, M., Sato, T., and Yokoya, N. (2005). Estimating camera position and posture by using feature landmark database. In 14th Scandinavian Conference on Image Analysis (SCIA2005), pages 171-181.
  14. Shitrit, H. B., Berclaz, J., Fleuret, F., and Fua, P. (2011). Tracking multiple people under global appearance constraints. In International Conference on Computer Vision (ICCV).
  15. Swain, M. J. and Ballard, D. H. (1991). Color indexing. International Journal of Computer Vision, 7(1):11-32.
  16. Tokusho, Y. and Feiner, S. (2009). Prototyping an outdoor mobile augmented reality street view application. In IEEE International Symposium on Mixed and Augmented Reality (ISMAR).
  17. Tonchidot (2009). Sekai Camera. http://sekaicamera.com/.
Download


Paper Citation


in Harvard Style

Miyano R., Inoue T., Minagawa T., Uematsu Y. and Saito H. (2013). A Mobile AR System for Sports Spectators using Multiple Viewpoint Cameras . In Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2013) ISBN 978-989-8565-47-1, pages 23-32. DOI: 10.5220/0004292800230032


in Bibtex Style

@conference{visapp13,
author={Ruiko Miyano and Takuya Inoue and Takuya Minagawa and Yuko Uematsu and Hideo Saito},
title={A Mobile AR System for Sports Spectators using Multiple Viewpoint Cameras},
booktitle={Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2013)},
year={2013},
pages={23-32},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004292800230032},
isbn={978-989-8565-47-1},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2013)
TI - A Mobile AR System for Sports Spectators using Multiple Viewpoint Cameras
SN - 978-989-8565-47-1
AU - Miyano R.
AU - Inoue T.
AU - Minagawa T.
AU - Uematsu Y.
AU - Saito H.
PY - 2013
SP - 23
EP - 32
DO - 10.5220/0004292800230032