EMPHASIZING ON THE TIMING AND TYPE - Enhancing the Backchannel Performance of Virtual Agent

Xia Mao, Na Luo, Yuli Xue

Abstract

Addressing backchannel feedbacks to virtual agent listener gives the agent human-like conversation skills and creates rapport in Human-Computer Interaction. We argue the limitations of current approaches in predicting and generating backchannel. Following two hypotheses emphasizing on the timing and type of backchannel, we introduce an improved system to enhance the agent listener’s performance. By using Newcastle Personality Assessor before parasocial consensus sampling and then neural networks, we can obtain the personality rules and select different backchannel timing thresholds for specific agent listener according to its own personality. After a context-free perceptual study, we will build two emotional backchannel lexicons showing positive affection and negative affection respectively. In accordance with the empathy strategy, the system will select one type of backchannel from the corresponding emotional backchannel lexicon. The improved system will be more suitable for different conversation occasions and greatly increase the naturalness between the human speaker and the virtual agent listener in the future.

References

  1. Bavelas, J. B., Coates, L., Johnson, T. (2002). Listener responses as a collaborative process: The role of gaze. Journal of Communication, 52(3), 566-580.
  2. Bavelas, J. B., Coates, L., Johnson, T. (2000). Listeners as conarrators. Journal of Personality and Social Psychology, 79(6), 941-952.
  3. Cathcart, N., Carletta, J., Klein, E. (2003). A shallow model of backchannel continuers in spoken dialogue. Proceedings of the Conference of the European chapter of the Association for Computational Linguistics, 51-58.
  4. Duncan, Starkey, Jr. and Fiske D. (1977). Face-to-face Interaction. New York: Halsted Press.
  5. Duncan, Starkey, Jr. (1974). On the structure of speakerauditor interaction during speaking turns. Language in Society, 3(2): 161-180.
  6. Gratch, J., Okhmatovskaia, A., Lamothe, F., Marsella, S., Morales, M., Werf, R. J. V. D., Morency, L. (2006). Virtual Rapport. Proceedings of the International Conference in Intelligent Virtual Agent, 14-27.
  7. Huang L., Morency, L., Gratch, J. (2010a). Parasocial Consensus Sampling: Combining Multiple Perspectives to Learn Virtual Human Behaviour. Proceedings of AAMAS 2010, 1265-1272.
  8. Huang L., Morency, L., Gratch, J. (2010b). Learning backchannel prediction model from parasocial consensus sampling. Proceedings of the International Conference in Intelligent Virtual Agent, 159-172.
  9. Kendon, A. (1967). Some functions of gaze direction in social interaction. Acta Psychologica, 26(1), 22-63.
  10. Maatman, M., Gratch, J., Marsella, S. (2005). Natural behaviour of a listening agent. Proceedings of the International Conference in Intelligent Virtual Agent, 25-36.
  11. McRorie, M., Sneddon, I., Sevin, E. D., Bevacqua, E., and Pelachaud, C. (2009). A Model of Personality and Emotional Traits. Proceedings of the International Conference in Intelligent Virtual Agent, 27-33.
  12. Morency, L., Kok, I. D., Gratch, J. (2008). Predicting Listener Backchannels: A Probabilistic Multimodal Approach. Proceedings of the International Conference in Intelligent Virtual Agent, 176-190.
  13. Poppe, R., Truong, K. P., Reidsma, D., et al. (2010). Backchannel strategies for artificial listeners. Proceedings of the International Conference in Intelligent Virtual Agent, 146-158.
  14. Prendinger, H., Mori, J., Ishizuka, M. (2005). Using human physiology to evaluate subtle expressivity of a virtual quizmaster in a mathematical game. International Journal of Human Computer Studies, 62(2), 231-245.
  15. Ward, N., Tsukahara, W. (2000). Prosodic features which cue backchannel responses in English and Japanese. Journal of Pragmatics, 32(8), 1177-1207.
  16. Yngve, V. (1970). On getting a word in edgewise. Papers from the Sixth Regional Meeting of the Chicago Linguistic Society, 567-577.
Download


Paper Citation


in Harvard Style

Mao X., Luo N. and Xue Y. (2012). EMPHASIZING ON THE TIMING AND TYPE - Enhancing the Backchannel Performance of Virtual Agent . In Proceedings of the 4th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART, ISBN 978-989-8425-96-6, pages 259-263. DOI: 10.5220/0003833102590263


in Bibtex Style

@conference{icaart12,
author={Xia Mao and Na Luo and Yuli Xue},
title={EMPHASIZING ON THE TIMING AND TYPE - Enhancing the Backchannel Performance of Virtual Agent},
booktitle={Proceedings of the 4th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART,},
year={2012},
pages={259-263},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003833102590263},
isbn={978-989-8425-96-6},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 4th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART,
TI - EMPHASIZING ON THE TIMING AND TYPE - Enhancing the Backchannel Performance of Virtual Agent
SN - 978-989-8425-96-6
AU - Mao X.
AU - Luo N.
AU - Xue Y.
PY - 2012
SP - 259
EP - 263
DO - 10.5220/0003833102590263