3D Interaction Assistance in Virtual Reality: A Semantic Reasoning Engine for Context-awareness - From Interests and Objectives Detection to Adaptations

Yannick Dennemont, Guillaume Bouyer, Samir Otmane, Malik Mallem

2013

Abstract

This work aims to provide 3D interaction assistance in virtual environments depending on context. We designed and implemented a generic decision engine that can connect to our existing virtual reality applications through a set of tools. It uses an ontology and Conceptual Graphs (CGs) to represent knowledge, and First Order Logic to conduct semantic reasoning. Context information are gathered by virtual sensors in the application and interpreted by the engine. Multimodal assistance is provided by virtual actuators. Our first test scenario is about assistance to selection of objects or navigation towards objects: the engine automatically detects user’s interests and manages adaptations depending on user’s hand gestures, interactions history and type of task.

References

  1. Bettini, C., Brdiczka, O., Henricksen, K., Indulska, J., Nicklas, D., Ranganathan, A., and Riboni, D. (2010). Pervasive and Mobile Computing.
  2. Bonis, B., Stamos, J., Vosinakis, S., Andreou, I., and Panayiotopoulos, T. (2008). A platform for virtual museums with personalized content. Multimedia Tools and Applications, 42(2):139-159.
  3. Boudoin, P., Otmane, S., and Mallem, M. (2008). Fly Over , a 3D Interaction Technique for Navigation in Virtual Environments Independent from Tracking Devices. Virtual Reality, (Vric).
  4. Bouyer, G., Bourdot, P., and Ammi, M. (2007). Supervision of Task-Oriented Multimodal Rendering for VR Applications. Communications.
  5. Bowman, D. A., Chen, J., Wingrave, C. A., Lucas, J., Ray, A., Polys, N. F., Li, Q., Haciahmetoglu, Y., Kim, J.-s., Kim, S., Boehringer, R., and Ni, T. (2006). New Directions in 3D User Interfaces. International Journal, 5.
  6. Brézillon, P. (2011). From expert systems to context-based intelligent assistant systems : a testimony. Engineering, 26:19-24.
  7. Celentano, A. and Nodari, M. (2004). Adaptive interaction in Web3D virtual worlds. Proceedings of the ninth international conference on 3D Web technology - Web3D 7804, 1(212):41.
  8. Chein, M. and Mugnier, M. (2009). Graph-bases Knowledge Representation: Computational Foundations of Conceptual Graphs. Springer.
  9. Coppola, P., Mea, V. D., Gaspero, L. D., Lomuscio, R., Mischis, D., Mizzaro, S., Nazzi, E., Scagnetto, I., and Vassena, L. (2009). AI Techniques in a Context-Aware Ubiquitous Environment, pages 150-180.
  10. Dey, A. and Abowd, G. (2000). Towards a better understanding of context and context-awareness. In CHI 2000 workshop on the what, who, where, when, and how of context-awareness, volume 4.
  11. Dey, A., Abowd, G., and Salber, D. (2001). A conceptual framework and a toolkit for supporting the rapid prototyping of context-aware applications. HumanComputer Interaction, pages 1-67.
  12. Frees, S. (2010). Context-driven interaction in immersive virtual environments. Virtual Reality, Volume 14(4):1-14.
  13. Gu, T., Wang, X., Pung, H., and Zhang, D. (2004). An ontology-based context model in intelligent environments. In Proceedings of Communication Networks and Distributed Systems Modeling and Simulation Conference, volume 2004. Citeseer.
  14. Irawati, S., Calderón, D., and Ko, H. (2005). Semantic 3D object manipulation using object ontology in multimodal interaction framework. In Proceedings of the 2005 international conference on Augmented teleexistence, pages 35-39. ACM.
  15. Kabbaj, A. (2006). Development of Intelligent Systems and Multi-Agents Systems with Amine Platform. Intelligence, pages 1-14.
  16. Latoschik, M. E., Biermann, P., and Wachsmuth, I. (2005). Knowledge in the Loop : Semantics Representation for Multimodal Simulative Environments (2005). pages 25 - 39.
  17. Latoschik, M. E., Blach, R., and Iao, F. (2008). Semantic Modelling for Virtual Worlds A Novel Paradigm for Realtime Interactive Systems ? In ACM symposium on Virtual reality software and technology.
  18. Lee, S., Lee, Y., Jang, S., and Woo, W. (2004). vr-UCAM: Unified context-aware application module for virtual reality. Conference on Artificial Reality.
  19. Lugrin, J.-l. and Cavazza, M. (2007). Making Sense of Virtual Environments : Action Representation , Grounding and Common Sense. In 12th International conference on intelligent user interfaces.
  20. Octavia, J., Coninx, K., and Raymaekers, C. (2010). Enhancing User Interaction in Virtual Environments through Adaptive Personalized 3D Interaction Techniques. In UMAP.
  21. Otterlo, M. (2009). The logic of adaptive behavior.
  22. Peters, S. and Shrobe, H. E. (2003). Using Semantic Networks for Knowledge Representation in an Intelligent Environment. In 1st International Conference on Pervasive Computing and Communications.
  23. Poupyrev, I., Billinghurst, M., Weghorst, S., and Ichikawa, T. (1996). The go-go interaction technique: non-linear mapping for direct manipulation in VR. In Proceedings of the 9th annual ACM symposium on User interface software and technology, pages 79-80. ACM.
  24. Ranganathan, A. and Campbell, R. H. (2003). An infrastructure for context-awareness based on first order logic. Personal and Ubiquitous Computing, 7(6):353- 364.
  25. Sowa, J. F. (2008). Conceptual Graphs, pages 213-217. Elsevier.
  26. Wingrave, C. A., Bowman, D. A., and Ramakrishnan, N. (2002). Towards Preferences in Virtual Environment Interfaces. Interfaces.
Download


Paper Citation


in Harvard Style

Dennemont Y., Bouyer G., Otmane S. and Mallem M. (2013). 3D Interaction Assistance in Virtual Reality: A Semantic Reasoning Engine for Context-awareness - From Interests and Objectives Detection to Adaptations . In Proceedings of the International Conference on Computer Graphics Theory and Applications and International Conference on Information Visualization Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2013) ISBN 978-989-8565-46-4, pages 349-358. DOI: 10.5220/0004207503490358


in Bibtex Style

@conference{grapp13,
author={Yannick Dennemont and Guillaume Bouyer and Samir Otmane and Malik Mallem},
title={3D Interaction Assistance in Virtual Reality: A Semantic Reasoning Engine for Context-awareness - From Interests and Objectives Detection to Adaptations},
booktitle={Proceedings of the International Conference on Computer Graphics Theory and Applications and International Conference on Information Visualization Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2013)},
year={2013},
pages={349-358},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004207503490358},
isbn={978-989-8565-46-4},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Computer Graphics Theory and Applications and International Conference on Information Visualization Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2013)
TI - 3D Interaction Assistance in Virtual Reality: A Semantic Reasoning Engine for Context-awareness - From Interests and Objectives Detection to Adaptations
SN - 978-989-8565-46-4
AU - Dennemont Y.
AU - Bouyer G.
AU - Otmane S.
AU - Mallem M.
PY - 2013
SP - 349
EP - 358
DO - 10.5220/0004207503490358