Sensing Immersive 360º Mobile Interactive Video

João Ramalho, Teresa Chambel

2014

Abstract

Video has the potential for a strong impact on viewers, their sense of presence and engagement, due to its immersive capacities. Multimedia sensing and the flexibility of mobility may be considered as options to further extend the video’s immersive capacities. Mobile devices are becoming ubiquitous and the range of sensors and actuators they incorporate is ever increasing, which creates the potential to capture and display 360º video and metadata and to support more powerful and immersive video user experiences. In this paper, we explore the immersion potential of mobile interactive video augmented with visual, auditory and tactile multisensing. User evaluation revealed advantages in using a multisensory approach to increase immersion and user satisfaction. Also, several properties and parameters that worked better in different conditions were identified, which may help to inform design of future mobile immersive video environments.

References

  1. Amselem D. (1995). A Window on Shared Virtual Environments. Presence: Teleoperators and Virtual Environments, 4(2):130-145.
  2. Bleumers, L., Broeck, W., Lievens, B., Pierson, J. (2012) Seeing the Bigger Picture: A User Perspective on 360° TV. In Proc. of EuroiTV'12, 115-124
  3. Cardin, S., Thalmann, D., and Vexo, F. (2007) Head Mounted Wind. In Proc. of Computer Animation and Social Agents. Hasselt, Belgium, Jun 11-13. 101-108.
  4. Courtois, C., D'heer, E. (2012) Second screen applications and tablet users: constellation, awareness, experience, and interest. EuroiTV'12, 153-156.
  5. Dobler, D., and Stampfl, P. (2004) Enhancing Threedimensional Vision with Three-dimensional Sound. In ACM Siggraph'04 Course Notes.
  6. Douglas, Y., and Hargadon, A. (2000) The Pleasure Principle: Immersion, Engagement, Flow. ACM Hypertext'00, 153-160.
  7. Ekman, P. (1992) Are there basic emotions? Psychological Review, 99(3):550-553.
  8. Lehmann, A., Geiger, C., Wöldecke, B. and Stöcklein, J. (2009) Poster: Design and Evaluation of 3D Content with Wind Output. In Proc. of 3DUI.
  9. Mendes, M. (2010) RTiVISS | Real-Time Video Interactive Systems for Sustainability. Artech, 29-38.
  10. Merer, A., Aramaki, M., Ystad, S., and KronlandMartinet, R. (2013) Perceptual Characterization of Motion Evoked by Sounds for Synthesis Control Purposes. In Trans. on Applied Perception, 10(1),1-23.
  11. Moon, T., Kim, G. J., and Vexo, F. (2004) Design and evaluation of a wind display for virtual reality. In Proceedings of the ACM Symposium on Virtual Reality Software and Technology.
  12. Mourão, A., Borges, P., Correia, N., Magalhães, J. (2013) Facial Expression Recognition by Sparse Reconstruction with Robust Features. In Image Analysis and Recognition. ICIAR'2013, LNCS, vol 7950, pp.107- 115.
  13. Namezi, M., and Gromala, D. (2012) Sound Design: A Procedural Communication Model for VE. In Proc. of 7th Audio Mostly Conference, Greece, 16-23.
  14. Neng, L., and Chambel, T. (2010) Get Around 360º Hypervideo. In Proc. of MindTrek, Tampere, Finland. 119-122.
  15. Noronha, G., Álvares, C., and Chambel, T. (2012) Sight Surfers: 360º Videos and Maps Navigation. In Proc.of Geo MM'12 ACM Multimedia'12. Nara, Japan. 19-22.
  16. Oliveira, E., Martins, P., and Chambel, T. (2011) iFelt: Accessing Movies Through Our Emotions. In Proc. of EuroITV'2011, Lisbon, Portugal, Jun 29-Jul 1. 105- 114.
  17. Ramalho, J. and Chambel, T. (2013) Windy Sight Surfers: sensing and awareness of 360º immersive videos on the move. In Proc. of EuroITV 2013, Como, Italy. 107-116.
  18. Ramalho, J. and Chambel, T. (2013) Immersive 360° mobile video with an emotional perspective. In Proc. of the 2013 ACM international workshop on Immersive media experiences at ACM Multimedia 2013, Barcelona, Spain. 35-40.
  19. Slater, M., Lotto, B., Arnold, M.M., Sanchez-Vives, M.M. (2009) How we experience immersive virtual environments: the concept of presence and its measurement, Anuario de Psicología, 40(2), Fac. Psicologia, Univ. Barcelona, 193-210.
  20. Slater, M. (1999) Measuring Presence: A Response to the Witmer and Singer Presence Questionnaire, Presence 8(5), Oct. 560-565.
  21. Slater, M., & Wilbur, S. (1997) A framework for immersive virtual environments (five): Speculations on the role of presence in virtual environments. Presence, 6, 603-616.
  22. Visch, T., Tan, S., and Molenaar, D. (2010) The emotional and cognitive effect of immersion in film viewing. Cognition & Emotion, 24: 8, pp.1439-1445.
  23. Wirth, W., Hartmann, T., Bocking, S., Vorderer, P.,Klimmt, Ch., Schramm, H., et al. (2007) A process model of the formation of spatial presence experiences. Media Psychology, 9, 493-525.
  24. Witmer, B., Singer, M. J. (1998) Measuring Presence in Virtual, Environments: A Presence Questionnaire. Presence, 7(3), Jun. (1998), MIT, 225-240.
Download


Paper Citation


in Harvard Style

Ramalho J. and Chambel T. (2014). Sensing Immersive 360º Mobile Interactive Video . In Proceedings of the 9th International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2014) ISBN 978-989-758-002-4, pages 397-406. DOI: 10.5220/0004701603970406


in Bibtex Style

@conference{grapp14,
author={João Ramalho and Teresa Chambel},
title={Sensing Immersive 360º Mobile Interactive Video},
booktitle={Proceedings of the 9th International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2014)},
year={2014},
pages={397-406},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004701603970406},
isbn={978-989-758-002-4},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 9th International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2014)
TI - Sensing Immersive 360º Mobile Interactive Video
SN - 978-989-758-002-4
AU - Ramalho J.
AU - Chambel T.
PY - 2014
SP - 397
EP - 406
DO - 10.5220/0004701603970406