Leveraging Cloud-based Tools to Talk with Robots

Enas Altarawneh, Michael Jenkin

2019

Abstract

Although there has been significant advances in human-machine interaction systems in recent years, cloud-based advances are not easily integrated in autonomous machines. Here we describe a toolkit that supports interactive avatar animation and modeling for human-computer interaction. The avatar toolkit utilizes cloud-based speech-to-text software that provides active listening by detecting sound and reducing noise, a cloud-based AI to generate appropriate textual responses to user queries, and a cloud-based text-to-speech generation engine to generate utterances for this text. This output is combined with a cloud-based 3D avatar animation synchronized to the spoken response. Generated text responses are embedded within an XML structure that allows for tuning the nature of the avatar animation to simulate different emotional states. An expression package controls the avatar’s facial expressions. Latency is minimized and obscured through parallel processing in the cloud and an idle loop process that animates the avatar between utterances.

Paper Citation

in Harvard Style

Altarawneh E. and Jenkin M. (2019). Leveraging Cloud-based Tools to Talk with Robots.In Proceedings of the 16th International Conference on Informatics in Control, Automation and Robotics - Volume 1: ICINCO, ISBN 978-989-758-380-3, pages 360-367. DOI: 10.5220/0007947003600367

in Bibtex Style

@conference{icinco19,
author={Enas Altarawneh and Michael Jenkin},
title={Leveraging Cloud-based Tools to Talk with Robots},
booktitle={Proceedings of the 16th International Conference on Informatics in Control, Automation and Robotics - Volume 1: ICINCO,},
year={2019},
pages={360-367},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0007947003600367},
isbn={978-989-758-380-3},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 16th International Conference on Informatics in Control, Automation and Robotics - Volume 1: ICINCO,
TI - Leveraging Cloud-based Tools to Talk with Robots
SN - 978-989-758-380-3
AU - Altarawneh E.
AU - Jenkin M.
PY - 2019
SP - 360
EP - 367
DO - 10.5220/0007947003600367