Spoken Communication with CAMBADA@Home Service Robot

Ciro Martins, António Teixeira, Eurico Pedrosa, Nuno Almeida

2012

Abstract

Spoken language is a natural way to control the human-robot interaction, especially for mobile service robots. It has some important advantages over other communication approaches: eyes and hands free, communication from a distance, even without being in line of sight and no need for additional learning for humans. In this paper, we present the spoken dialog framework integrated in our mobile service robot CAMBADA@Home, a robotic platform aimed at move into a living space and interact with users of that space. The proposed framework comprises three major spoken and natural language processing components: an Automatic Speech Recognition component to process the human requests, a Text-to-Speech component to generate more natural responses from the robot side, and a dialog manager to control how these two components work together.

References

  1. EUROP Executive Board Committee: Robotic Visions (To 2020 and Beyond). The Strategic Research Agenda for Robotics in Europe, July 2009
  2. Tapus, A., Mataric, M. and Scassellati, B.: The grand challenges in socially assistive robotics. IEEE Robotics and Automation Magazine, vol. 14, no. 1, March 2007
  3. Lopes, L.: Carl: from Situated Activity to Language Level Interaction and Learning, Proc. IEEE Int'l Conf. on Intelligent Robots and Systems (IROS), Lausanne, Switzerland, p. 890- 896, 2002
  4. Neves, A., Azevedo, J., Cunha, B., Lau, N., Silva, J., Santos, F., Corrente, G., Martins, D., Figueiredo, N., Pereira, A., Almeida, L., Lopes, L., Pinho, A., Rodrigues, J. and Pedreiras, P.: CAMBADA soccer team - from robot architecture to multiagent coordination. In Robot Soccer. INTECH, January 2010
  5. Cunha, J., Neves, A., Azevedo, J., Cunha, B., Lau, N. and Pereira, A.: A Mobile Robotic Platform for Elderly Care. AAL Workshop, BIOSTEC 2011, Rome, Italy, 2011
  6. RoboCup@Home League main page [Online] [Visited on 15 Oct. 2011]. Available at http://www.robocupathome.org/
  7. Goodrich, M. and Schultz, A.: Human-Robot Interaction - A Survey. Foundations and Trends R in Human-Computer Interaction, vol. 1, no. 3 (2007) 203-275
  8. Breuer, T.: Advanced Speech-based HRI for a Mobile Manipulator. B-IT Master Studies Autonomous Systems, Bonn-Rhein-Sieg University of Applied Sciences, September 2008
  9. Bohus, D. and Rudnicky, A.: The RavenClaw dialog management framework - Architecture and systems". Computer Speech and Language 23 (2009) 332-361
  10. Bohus, D., Raux, A. Harris, T., Eskenazi, M. and Rudnicky, A.: Olympus - an open-source framework for conversational spoken language interface research. Bridging the Gap: Academic and Industrial Research in Dialog Technology Workshop at HLT/NAACL, 2007
  11. Bohus, D., Grau, S., Huggins-Danes, D., Keri, V., Krishna, G., Kumar, R., Raux, A. and Tomko, A.: Conquest - an Open-Source Dialog System for Conferences. HLT-NAACL, 2007
  12. Stenchikova, S., Mucha, B., Hoffman, S. and Stent, A.: RavenCalendar - A Multimodal Dialog System for Managing a Personal Calendar. HLT-NAACL, 2007
  13. Harris, T., Banerjee, S., Rudnicky, A., Sison, J., Bodine, K., and Black, A.: A Research Platform for Multi-Agent Dialogue Dynamics. Proceedings of the IEEE International Workshop on Robotics and Human Interactive Communications, (2004) 497-502
  14. Huang, X., Alleva, F., Hon, H.-W., Hwang, M.-Y., Lee, K.-F., Rosenfeld, R.: The SPHINX-II speech recognition system: an overview. Computer Speech and Language 7 (1992) 137-148
  15. The CMU Pronouncing Dictionary [Online] [Visited on 15 Oct. 2011]. Available at http://www.speech.cs.cmu.edu/cgi-bin/cmudict
  16. Microsoft Speech Platform [Online] [Visited on 15 Oct. 2011]. Available at http://msdn.microsoft.com/en-us/library/hh361572.aspx
  17. Ward, W. and Issar, S.: Recent improvements in the CMU spoken language understanding system, in Proc. of the ARPA Human Language Technology Workshop, pages 213-216, Plainsboro, NJ, 1994
  18. Bohus, D. and Rudnicky, A.: Integrating multiple knowlege sources for utterance-level confidence annotation in the CMU Communicator spoken dialog system. (Tech. Rep. No. CMU-CS-02-190). Pittsburgh, Pennsylvania: School of Computer Science, Carnegie Mellon University, 2002
  19. Oh, A. H. and Rudnicky, A.: Stocastic language generation for spoken dialogue systems. Proceedings of the ANLP/NAACL workshop on conversational systems, (2000) 27-32
Download


Paper Citation


in Harvard Style

Martins C., Teixeira A., Pedrosa E. and Almeida N. (2012). Spoken Communication with CAMBADA@Home Service Robot . In Proceedings of the 2nd International Living Usability Lab Workshop on AAL Latest Solutions, Trends and Applications - Volume 1: AAL, (BIOSTEC 2012) ISBN 978-989-8425-93-5, pages 27-36. DOI: 10.5220/0003878900270036


in Bibtex Style

@conference{aal12,
author={Ciro Martins and António Teixeira and Eurico Pedrosa and Nuno Almeida},
title={Spoken Communication with CAMBADA@Home Service Robot},
booktitle={Proceedings of the 2nd International Living Usability Lab Workshop on AAL Latest Solutions, Trends and Applications - Volume 1: AAL, (BIOSTEC 2012)},
year={2012},
pages={27-36},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003878900270036},
isbn={978-989-8425-93-5},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 2nd International Living Usability Lab Workshop on AAL Latest Solutions, Trends and Applications - Volume 1: AAL, (BIOSTEC 2012)
TI - Spoken Communication with CAMBADA@Home Service Robot
SN - 978-989-8425-93-5
AU - Martins C.
AU - Teixeira A.
AU - Pedrosa E.
AU - Almeida N.
PY - 2012
SP - 27
EP - 36
DO - 10.5220/0003878900270036