TOWARDS A PROCESS OF BUILDING SEMANTIC MULTIMODAL DIALOGUE DEMONSTRATORS

Daniel Sonntag, Norbert Reithinger

2010

Abstract

A generic integration framework should allow us to build practical dialogue systems for specific use case scenarios. While domain-specific dialogue systems are simpler to achieve than more general, open-domain conversational dialogue systems, the integration into use cases and demonstration scenarios requires a lot of difficult integration work, especially in multimodal settings where different user devices such as touchscreens and PDAs are used. The challenges for those systems include, apart from the dialogue modelling task, the integration modelling for specific use case and demonstration scenarios. This paper reports on dialogue system prototype development based on ontology communication structures and we draw special attention to the process of how to build demonstration systems that include a task-oriented, information-seeking, or advicegiving dialogue as an important fragment of practical dialogue system development.

References

  1. Allen, J., Byron, D., Dzikovska, M., Ferguson, G., Galescu, L., and Stent, A. (2000). An Architecture for a Generic Dialogue Shell. Natural Language Engineering, 6(3):1-16.
  2. Cronholm, S. (2009). The usability of usability guidelines. In Proceedings of the 19th Australasian conference on Computer-Human Interaction Conference.
  3. Fensel, D., Hendler, J. A., Lieberman, H., and Wahlster, W., editors (2003). Spinning the Semantic Web: Bringing the World Wide Web to Its Full Potential. MIT Press.
  4. Garrett, J. J. (2002). The Elements of User Experience. American Institute of Graphic Arts, New York.
  5. Häkkilä, J. and Mäntyjärvi, J. (2006). Developing design guidelines for context-aware mobile applications. In Mobility 7806: Proceedings of the 3rd international conference on Mobile technology, applications & systems, page 24, New York, NY, USA. ACM.
  6. Hitzler, P., Krtzsch, M., and Rudolph, S. (2009). Foundations of Semantic Web Technologies. Chapman & Hall/CRC.
  7. Juran, J. M. & Gryna, F. M. (1993). Quality planning and analysis : from product development through use. McGraw-Hill, New York.
  8. Martin, D., Cheyer, A., and Moran, D. (1999). The Open Agent Architecture: a framework for building distributed software systems. Applied Artificial Intelligence, 13(1/2):91-128.
  9. Muller, M. J., Matheson, L., Page, C., and Gallup, R. (1998). Methods & tools: participatory heuristic evaluation. interactions, 5(5):13-18.
  10. Nielsen, J. (1994). Heuristic evaluation. pages 25-62.
  11. Nyberg, E., Burger, J. D., Mardis, S., and Ferrucci, D. A. (2004). Software Architectures for Advanced QA. In Maybury, M. T., editor, New Directions in Question Answering, pages 19-30. AAAI Press.
  12. Pieraccini, R. and Huerta, J. (2005). Where do we go from here? research and commercial spoken dialog systems. In Proceeedings of the 6th SIGDdial Worlshop on Discourse and Dialogue, pages 1-10.
  13. Reithinger, N. and Sonntag, D. (2005). An integration framework for a mobile multimodal dialogue system accessing the Semantic Web. In Proceedings of INTERSPEECH, pages 841-844, Lisbon, Portugal.
  14. Seneff, S., Lau, R., and Polifroni, J. (1999). Organization, Communication, and Control in the Galaxy-II Conversational System. In Proceedings of Eurospeech'99, pages 1271-1274, Budapest, Hungary.
  15. Shneiderman, B. (1998). Designing the user interface: strategies for effective human-computer interaction. Addison-Wesley Longman Publishing Co., Inc., Boston, MA, USA, third edition.
  16. Sonntag, D. (2010). Ontologies and Adaptivity in Dialogue for Question Answering. AKA and IOS Press, Heidelberg.
  17. Suchanek, F. M., Kasneci, G., and Weikum, G. (2007). Yago: A Core of Semantic Knowledge. In 16th international World Wide Web conference (WWW 2007), New York, NY, USA. ACM Press.
  18. Wahlster, W. (2003). SmartKom: Symmetric Multimodality in an Adaptive and Reusable Dialogue Shell. In Krahl, R. and Günther, D., editors, Proceedings of the Human Computer Interaction Status Conference 2003, pages 47-62, Berlin, Germany. DLR.
Download


Paper Citation


in Harvard Style

Sonntag D. and Reithinger N. (2010). TOWARDS A PROCESS OF BUILDING SEMANTIC MULTIMODAL DIALOGUE DEMONSTRATORS . In Proceedings of the International Conference on Knowledge Management and Information Sharing - Volume 1: KMIS, (IC3K 2010) ISBN 978-989-8425-30-0, pages 322-331. DOI: 10.5220/0003089503220331


in Bibtex Style

@conference{kmis10,
author={Daniel Sonntag and Norbert Reithinger},
title={TOWARDS A PROCESS OF BUILDING SEMANTIC MULTIMODAL DIALOGUE DEMONSTRATORS},
booktitle={Proceedings of the International Conference on Knowledge Management and Information Sharing - Volume 1: KMIS, (IC3K 2010)},
year={2010},
pages={322-331},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003089503220331},
isbn={978-989-8425-30-0},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Knowledge Management and Information Sharing - Volume 1: KMIS, (IC3K 2010)
TI - TOWARDS A PROCESS OF BUILDING SEMANTIC MULTIMODAL DIALOGUE DEMONSTRATORS
SN - 978-989-8425-30-0
AU - Sonntag D.
AU - Reithinger N.
PY - 2010
SP - 322
EP - 331
DO - 10.5220/0003089503220331