INTEGRATING POINTING GESTURES INTO A SPANISH–SPOKEN DIALOG SYSTEM FOR CONVERSATIONAL SERVICE ROBOTS

Héctor Avilés, Iván Meza, Wendy Aguilar, Luis Pineda

Abstract

In this paper we present our work on the integration of human pointing gestures into a spoken dialog system in Spanish for conversational service robots. The dialog system is composed by a dialog manager, an interpreter that guides the spoken dialog and robot actions, in terms of user intentions and relevant environment stimuli associated to the current conversational situation. We demonstrate our approach by developing a tour–guide robot that is able to move around its environment, visually recognize informational posters, and explain sections of the poster selected by the user via pointing gestures. This robot also incorporates simple methods to qualify confidence in its visual outcomes, to inform about its internal state, and to start error–prevention dialogs whenever necessary. Our results show the reliability of the overall approach to model complex multimodal human–robot interactions.

References

  1. Aguilar, W. and Pineda, L. (2009). Integrationg GraphBased Vision Perception to Spoken Conversation in Human-Robot interaction. In 10th International Work-Conference on Artificial Neural Networks, pages 789-796.
  2. Aviles, H., Sucar, E., Vargas, B., Sanchez, J., and Corona, E. (2009). Markovito: A Flexible and General Service Robot, chapter 19, pages 401-423. Studies in Computational Intelligence. Springer Berlin / Heidelberg.
  3. Burger, B., Lerasle, F., Ferrane, I., and Clodic, A. (2008). Mutual assistance between speech and vision for human-robot interaction. In IEEE/RSJ International Conference on Intelligent Robotics and Systems, pages 4011-4016.
  4. Pineda, A., Villasen˜or, L., Cuetara, J., Castellanos, H., and Lopez, I. (2004). Dimex100: A new phonetic and speech corpus for Mexican Spanish. In Iberamia2004, Lectures Notes in Artificial Intelligence 3315, pages 974-983.
  5. Rogalla, O., Ehrenmann, O., Zoellner, M., Becher, R., and Dillmann, R. (2002). Using gesture and speech control for commanding a robot assistant. In Proceedings of the 11th IEEE Workshop on Robot and Human interactive Communication, pages 454-459.
  6. Stiefelhagen, R., Ekenel, H., C. Fugen, P. G., Holzapfel, H., Kraft, F., Nickel, K., Voit, M., and Waibel, A. (2006). Enabling multimodal human-robot interaction for the karlsruhe humanoid robot. In Proceedings of the IEEE Transactions on Robotics: Special Issue on HumanRobot Interaction, pages 1-11.
  7. Tojo, T., Matsusaka, Y., and Ishii, T. (2000). A Conversational Robot Utilizing Facial and Body Expressions. In International Conference on Systems, Man and Cybernetics, (SMC2000), pages 858-863.
  8. Toptsis, I., Haasch, A., Hüwel, S., Fritsch, J., and Fink, G. (2005). Modality integration and dialog management for a robotic assistant. In European Conference on Speech Communication and Technology, Lisboa, Portugal.
Download


Paper Citation


in Harvard Style

Avilés H., Meza I., Aguilar W. and Pineda L. (2010). INTEGRATING POINTING GESTURES INTO A SPANISH–SPOKEN DIALOG SYSTEM FOR CONVERSATIONAL SERVICE ROBOTS . In Proceedings of the 2nd International Conference on Agents and Artificial Intelligence - Volume 1: ICAART, ISBN 978-989-674-021-4, pages 585-588. DOI: 10.5220/0002722605850588


in Bibtex Style

@conference{icaart10,
author={Héctor Avilés and Iván Meza and Wendy Aguilar and Luis Pineda},
title={INTEGRATING POINTING GESTURES INTO A SPANISH–SPOKEN DIALOG SYSTEM FOR CONVERSATIONAL SERVICE ROBOTS},
booktitle={Proceedings of the 2nd International Conference on Agents and Artificial Intelligence - Volume 1: ICAART,},
year={2010},
pages={585-588},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0002722605850588},
isbn={978-989-674-021-4},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 2nd International Conference on Agents and Artificial Intelligence - Volume 1: ICAART,
TI - INTEGRATING POINTING GESTURES INTO A SPANISH–SPOKEN DIALOG SYSTEM FOR CONVERSATIONAL SERVICE ROBOTS
SN - 978-989-674-021-4
AU - Avilés H.
AU - Meza I.
AU - Aguilar W.
AU - Pineda L.
PY - 2010
SP - 585
EP - 588
DO - 10.5220/0002722605850588