3D INTERACTION ASSISTANCE THROUGH CONTEXT-AWARENESS - A Semantic Reasoning Engine for Classic Virtual Environment

Dennemont Yannick, Guillaume Bouyer, Samir Otmane, Malik Mallem

Abstract

This work focuses on 3D interaction assistance by adding adaptivity depending on the tasks, the objectives, and the general interaction context. The context is modelled with Conceptual Graphs (CG) based on an ontology. Including CG in our scene manager (Virtools) allows us to add semantic information and to describe the available tools. Adaptation result from rules handled with a logic programming layer (Prolog+CG) included in the Amine platform. This project is a step towards Intelligent Virtual Environments, which proposes a hybrid solution by adding a separate semantic reasoning to classic environments. The first experiment automatically manages few modalities depending on the distance to objects, user movement, available tools and modalities.

References

  1. Aylett, R. and Luck, M. (2000). Applying artificial intelligence to virtual reality: Intelligent virtual environments. Applied Artificial Intelligence, 14(1):3-32.
  2. Bettini, C., Brdiczka, O., Henricksen, K., Indulska, J., Nicklas, D., Ranganathan, A., and Riboni, D. (2010). A survey of context modelling and reasoning techniques. Pervasive and Mobile Computing, 6.
  3. Bonis, B., Stamos, J., Vosinakis, S., Andreou, I., and Panayiotopoulos, T. (2008). A platform for virtual museums with personalized content. Multimedia Tools and Applications, 42(2):139-159.
  4. Boudoin, P., Otmane, S., and Mallem, M. (2008). Fly Over , a 3D Interaction Technique for Navigation in Virtual Environments Independent from Tracking Devices. Virtual Reality.
  5. Bouyer, G., Bourdot, P., and Ammi, M. (2007). Supervision of Task-Oriented Multimodal Rendering for VR Applications. Communications.
  6. Bowman, D. A., Chen, J., Wingrave, C. A., Lucas, J., Ray, A., Polys, N. F., Li, Q., Haciahmetoglu, Y., Kim, J.-s., Kim, S., Boehringer, R., and Ni, T. (2006). New Directions in 3D User Interfaces. International Journal, 5.
  7. Brézillon, P. (2011). From expert systems to context-based intelligent assistant systems : a testimony. Engineering, 26:19-24.
  8. Celentano, A. and Nodari, M. (2004). Adaptive interaction in Web3D virtual worlds. Proceedings of the ninth international conference on 3D Web technology - Web3D 7804, 1(212):41.
  9. Chein, M. and Mugnier, M. (2009). Graph-bases Knowledge Representation: Computational Foundations of Conceptual Graphs. Springer.
  10. Coppola, P., Mea, V. D., Gaspero, L. D., Lomuscio, R., Mischis, D., Mizzaro, S., Nazzi, E., Scagnetto, I., and Vassena, L. (2009). AI Techniques in a Context-Aware Ubiquitous Environment, pages 150-180. Mendeley.
  11. Dey, A. and Abowd, G. (2000). Towards a better understanding of context and context-awareness. In CHI 2000 workshop on the what, who, where, when, and how of context-awareness, volume 4.
  12. Frees, S. (2010). Context-driven interaction in immersive virtual environments. Virtual Reality, Volume 14(4):1-14.
  13. Irawati, S., Calderó n, D., and Ko, H. (2005). Semantic 3D object manipulation using object ontology in multimodal interaction framework. In Proceedings of the 2005 international conference on Augmented teleexistence, pages 35-39. ACM.
  14. Kabbaj, A. (2006). Development of Intelligent Systems and Multi-Agents Systems with Amine Platform. Intelligence, pages 1-14.
  15. Latoschik, M. E., Biermann, P., and Wachsmuth, I. (2005). Knowledge in the Loop: Semantics Representation for Multimodal Simulative Environments. In Smart Graphics, pages 25 - 39.
  16. Latoschik, M. E., Blach, R., and Iao, F. (2008). Semantic Modelling for Virtual Worlds A Novel Paradigm for Realtime Interactive Systems ? In ACM symposium on Virtual reality software and technology.
  17. Lee, S., Lee, Y., Jang, S., and Woo, W. (2004). vr-UCAM: Unified context-aware application module for virtual reality. Conference on Artificial Reality.
  18. Lugrin, J.-l. and Cavazza, M. (2007). Making Sense of Virtual Environments : Action Representation , Grounding and Common Sense. In 12th International conference on intelligent user interfaces.
  19. Octavia, J., Coninx, K., and Raymaekers, C. (2010). Enhancing User Interaction in Virtual Environments through Adaptive Personalized 3D Interaction Techniques. In UMAP.
  20. Otterlo, M. (2009). The logic of adaptive behavior. Mendeley.
  21. Paramythis, A. (2009). Adaptive Systems: Development, Evaluation and Evolution. PhD thesis.
  22. Peters, S. and Shrobe, H. E. (2003). Using Semantic Networks for Knowledge Representation in an Intelligent Environment. In 1st International Conference on Pervasive Computing and Communications.
  23. Poupyrev, I., Billinghurst, M., Weghorst, S., and Ichikawa, T. (1996). The go-go interaction technique: non-linear mapping for direct manipulation in VR. In Proceedings of the 9th annual ACM symposium on User interface software and technology, pages 79-80. ACM.
  24. Preuveneers, D. (2009). Support for context-driven applications in Ambient Intelligence environments. PhD thesis, KUL.
  25. Soto, M., Allongue, S., Lip, L., Place, C., Cedex, P., Soto, M., and Allongue, S. (1997). A Semantic Approach of Virtual Worlds Interoperability. In Proceedings Sixth IEEE workshops on Enabling Technologies: Infrastructure for Collaborative Enterprises.
  26. Sowa, J. F. (2008). Conceptual Graphs, pages 213-217. Elsevier.
  27. Wingrave, C. A., Bowman, D. A., and Ramakrishnan, N. (2002). Towards Preferences in Virtual Environment Interfaces. Interfaces.
Download


Paper Citation


in Harvard Style

Yannick D., Bouyer G., Otmane S. and Mallem M. (2012). 3D INTERACTION ASSISTANCE THROUGH CONTEXT-AWARENESS - A Semantic Reasoning Engine for Classic Virtual Environment . In Proceedings of the International Conference on Computer Graphics Theory and Applications and International Conference on Information Visualization Theory and Applications - Volume 1: SIMIE, (VISIGRAPP 2012) ISBN 978-989-8565-02-0, pages 562-567. DOI: 10.5220/0003946205620567


in Bibtex Style

@conference{simie12,
author={Dennemont Yannick and Guillaume Bouyer and Samir Otmane and Malik Mallem},
title={3D INTERACTION ASSISTANCE THROUGH CONTEXT-AWARENESS - A Semantic Reasoning Engine for Classic Virtual Environment},
booktitle={Proceedings of the International Conference on Computer Graphics Theory and Applications and International Conference on Information Visualization Theory and Applications - Volume 1: SIMIE, (VISIGRAPP 2012)},
year={2012},
pages={562-567},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003946205620567},
isbn={978-989-8565-02-0},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Computer Graphics Theory and Applications and International Conference on Information Visualization Theory and Applications - Volume 1: SIMIE, (VISIGRAPP 2012)
TI - 3D INTERACTION ASSISTANCE THROUGH CONTEXT-AWARENESS - A Semantic Reasoning Engine for Classic Virtual Environment
SN - 978-989-8565-02-0
AU - Yannick D.
AU - Bouyer G.
AU - Otmane S.
AU - Mallem M.
PY - 2012
SP - 562
EP - 567
DO - 10.5220/0003946205620567