Authors:
Davy Vanacken
;
Joan De Boeck
;
Chris Raymaekers
and
Karin Coninx
Affiliation:
Hasselt University, Belgium
Keyword(s):
Multimodal Interaction, Interaction Technique, Interactive Virtual Environment, Metaphors, Model-Based Design.
Related
Ontology
Subjects/Areas/Topics:
Advanced User Interfaces
;
Computer Vision, Visualization and Computer Graphics
;
Interactive Environments
Abstract:
The past few years, multimodal interaction has been gaining importance in virtual environments. Although multimodality makes interaction with the environment more intuitive and natural, the development cycle of such an environment is often a long and expensive process. In our overall field of research, we investigate how
model-based design can help shorten this process by designing the application with the use of high-level diagrams. In this scope, we present ‘NiMMiT’, a graphical notation suitable for expressing multimodal user interaction. We elaborate on the NiMMiT primitives and illustrate the notation in practice with a comprehensive example.