drawbacks, we believe that both approaches can
coexist in the same portal: the user selects his
preferred method, according to the characteristics of
the client device and of the connection.
Our future research includes the extension of this
work to the EMMA language, as soon as EMMA-
enabled browsers would be available. We also
intend to provide portal users with other interaction
modalities, e.g., pen input and gesture recognition.
Moreover, we want to include in the portal engine
some tools that can facilitate the multimodal
interaction, e.g., an enhanced user profiling system
and an improved procedure for adapting contents
and interface to mobile devices. Finally, we are
planning to port all our work to the new released
Jetspeed 2 portal. Jetspeed 2 is compliant with JSR
(Java Specification Request) 168, a standard that has
enabled interoperability between portal servers and
portlets (JSR 168, 2003). In this way, most of our
work won’t be hooked on Jetspeed, but it will be
available to all portals that follow the JSR 168
specification.
ACKNOWLEDGEMENTS
This work is partially supported by MIUR
(Ministero dell'Istruzione, dell'Università e della
Ricerca) through the FIRB WEB-MINDS project.
REFERENCES
UMTS Forum Home Page. Available from
http://www.umts-forum.org
Multimodal Interaction Activity Home Page. Available
from http://www.w3.org/2002/mmi/
EMMA Working Draft Home Page. Available from
http://www.w3.org/TR/emma/
X+V Specification. Available from
http://www.voicexml.org/specs/multimodal/x+v/12/
SALT Forum Home Page. Available from
http://www.saltforum.org/
Cohen, P. R.., 1992: The Role of Natural Language in a
Multimodal Interface. In Proc.of the 5
th
annual ACM
symposium on User interface software and technology
pp. 143-149, Monteray, California, United States.
Sharma, R., Pavlovic, V. I., Huang, T. S., 1998: Toward
Multimodal Human-Computer Interface. In Proc.
IEEE special issue on Multimedia Signal Processing,
86(5):853-859
Baber, C., Mellor, B., 2001: Using Critical Path Analysis
to Model Multimodal Human-Computer Interaction.
In Int. Journal Human-Computer Studies, 54, 613-636
Moran, D. B., Cheyer, A. J., Julia, L. E., Martin, D. L.,
Park, S., 1997: Multimodal User Interfaces in the
Open Agent Architecture. In Proc. of the 1997
International Conference on Intelligent User
Interfaces (IUI97), 61-68
Wahlster, W., Reithinger, N., Blocher, A., 2001:
SmartKom: Towards Multimodal Dialogues with
Anthropomorphic Interface Agents. In Proc. of
International Status Conference, Human Computer
Interaction, 23-34
Lisetti, C., Nasoz, F., LeRouge, C., Ozyer, O., Alvarez,
K., 2003: Developing Multimodal Intelligent Affective
Interfaces for Tele-Home Health Care. In Int. Journal
Human-Computer Studies, 59, 245-255
Bellik, Y., 1997: Multimodal Text Editor Interface
Including Speech for the Blind. In Speech
Communication, 23
Mari, M., Poggi, A., 2004: A Transcoding Based
Approach for Multi-Device Portal Contents
Adaptation. In Proc. WWW/Internet 2004 (IADIS
International Conference 2004), pp. 107-114, Madrid,
Spain
Dybkjaer, L., Bernsen, N. O., Minker, W., 2004:
Evaluation and Usability of Multimodal Spoken
Language Dialogue Systems. In Speech
Communication, 43, 33-54
Walker, M. A., Whittaker, S. J., Stent, A., Maloor, P.,
Moore, J., Johnston, M., Vasireddy, G., 2004:
Generation and Evaluation of User Tailored
Responses in Multimodal Dialogue. In Cognitive
Sciences, 28, 811-840
Apache Jetspeed 1 Home Page. Available from:
http://portals.apache.org/jetspeed-1/
I-Mode Home Page. Available from:
http://www.nttdocomo.com/corebiz/imode/index.html
FreeTTS Home Page. Available from:
http://freetts.sourceforge.net/docs/index.php
Flite Home Page. Available from:
http://www.speech.cs.cmu.edu/flite/
JSAPI Home Page. Available from:
http://java.sun.com/products/java-media/speech/
Apache Turbine Home Page. Available from:
http://jakarta.apache.org/turbine/
Apache Velocity Home Page. Available from:
http://jakarta.apache.org/velocity/
Opera Browser Home Page. Available from:
http://www.opera.com
Access NetFront Home Page. Available from:
http://www.access.co.jp/english/
OpenSALT Home Page. Available from:
http://hap.speech.cs.cmu.edu/salt/
JSR 168 Specification, 2003. Available from:
http://www.jcp.org/en/jsr/detail?id=168
WEBIST 2006 - WEB INTERFACES AND APPLICATIONS
324