ENABLING VOCAL INTERACTION IN A WEB PORTAL ENVIRONMENT

Federico Bergenti, Lorenzo Lazzari, Marco Mari, Agostino Poggi

2006

Abstract

The growing request of innovative, multimodal interfaces for mobile users and the need of different navigation paradigms for impaired Internet users are promoting and driving nowadays research on multimodal interactions. In this paper we present our experiences in the integration of vocal components in a portal engine, namely Apache Jetspeed. First, we discuss the reasons why the integration of a full-featured portal brings significant advantages to the development of a vocal platform. Then, we describe two complementary approaches for enhancing portals with vocal capabilities, and we compare them under various standpoints. The first approach that we investigate is based on a server-side speech synthesizer, while the second relies on client-side technologies, X+V and the SALT markup languages. For each of these approaches we present some examples and we discuss advantages and drawbacks.

References

  1. Multimodal Interaction Activity Home Page. Available from http://www.w3.org/2002/mmi/
  2. EMMA Working Draft Home Page. Available from http://www.w3.org/TR/emma/
  3. X+V Specification. Available from http://www.voicexml.org/specs/multimodal/x+v/12/
  4. Cohen, P. R.., 1992: The Role of Natural Language in a Multimodal Interface. In Proc.of the 5th annual ACM symposium on User interface software and technology pp. 143-149, Monteray, California, United States.
  5. Sharma, R., Pavlovic, V. I., Huang, T. S., 1998: Toward Multimodal Human-Computer Interface. In Proc. IEEE special issue on Multimedia Signal Processing, 86(5):853-859
  6. Baber, C., Mellor, B., 2001: Using Critical Path Analysis to Model Multimodal Human-Computer Interaction. In Int. Journal Human-Computer Studies, 54, 613-636
  7. Moran, D. B., Cheyer, A. J., Julia, L. E., Martin, D. L., Park, S., 1997: Multimodal User Interfaces in the Open Agent Architecture. In Proc. of the 1997 International Conference on Intelligent User Interfaces (IUI97), 61-68
  8. Wahlster, W., Reithinger, N., Blocher, A., 2001: SmartKom: Towards Multimodal Dialogues with Anthropomorphic Interface Agents. In Proc. of International Status Conference, Human Computer Interaction, 23-34
  9. Lisetti, C., Nasoz, F., LeRouge, C., Ozyer, O., Alvarez, K., 2003: Developing Multimodal Intelligent Affective Interfaces for Tele-Home Health Care. In Int. Journal Human-Computer Studies, 59, 245-255
  10. Bellik, Y., 1997: Multimodal Text Editor Interface Including Speech for the Blind. In Speech Communication, 23
  11. Mari, M., Poggi, A., 2004: A Transcoding Based Approach for Multi-Device Portal Contents Adaptation. In Proc. WWW/Internet 2004 (IADIS International Conference 2004), pp. 107-114, Madrid, Spain
  12. Dybkjaer, L., Bernsen, N. O., Minker, W., 2004: Evaluation and Usability of Multimodal Spoken Language Dialogue Systems. In Speech Communication, 43, 33-54
  13. Walker, M. A., Whittaker, S. J., Stent, A., Maloor, P., Moore, J., Johnston, M., Vasireddy, G., 2004: Generation and Evaluation of User Tailored Responses in Multimodal Dialogue. In Cognitive Sciences, 28, 811-840
  14. Apache Jetspeed 1 Home Page. Available from: http://portals.apache.org/jetspeed-1/
  15. JSR 168 Specification, 2003. Available from: http://www.jcp.org/en/jsr/detail?id=168
Download


Paper Citation


in Harvard Style

Bergenti F., Lazzari L., Mari M. and Poggi A. (2006). ENABLING VOCAL INTERACTION IN A WEB PORTAL ENVIRONMENT . In Proceedings of WEBIST 2006 - Second International Conference on Web Information Systems and Technologies - Volume 1: WEBIST, ISBN 978-972-8865-46-7, pages 318-324. DOI: 10.5220/0001239203180324


in Bibtex Style

@conference{webist06,
author={Federico Bergenti and Lorenzo Lazzari and Marco Mari and Agostino Poggi},
title={ENABLING VOCAL INTERACTION IN A WEB PORTAL ENVIRONMENT},
booktitle={Proceedings of WEBIST 2006 - Second International Conference on Web Information Systems and Technologies - Volume 1: WEBIST,},
year={2006},
pages={318-324},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001239203180324},
isbn={978-972-8865-46-7},
}


in EndNote Style

TY - CONF
JO - Proceedings of WEBIST 2006 - Second International Conference on Web Information Systems and Technologies - Volume 1: WEBIST,
TI - ENABLING VOCAL INTERACTION IN A WEB PORTAL ENVIRONMENT
SN - 978-972-8865-46-7
AU - Bergenti F.
AU - Lazzari L.
AU - Mari M.
AU - Poggi A.
PY - 2006
SP - 318
EP - 324
DO - 10.5220/0001239203180324