Constructing a Non-task-oriented Dialogue Agent using Statistical Response Method and Gamification

Michimasa Inaba, Naoyuki Iwata, Fujio Toriumi, Takatsugu Hirayama, Yu Enokibori, Kenichi Takahashi, Kenji Mase

2014

Abstract

This paper provides a novel method for building non-task-oriented dialogue agents such as chatbots. The dialogue agent constructed using our method automatically selects a suitable utterance depending on a context from a set of candidate utterances prepared in advance. To realize automatic utterance selection, we rank the candidate utterances in order of suitability by application of a machine learning algorithm. We employed both right and wrong dialogue data to learn relative suitability to rank the utterances. Additionally, we provide a low-cost and quality-assured learning data acquisition environment using crowdsourcing and gamification. The results of an experiment using learning data obtained via the environment demonstrate that the appropriate utterance is ranked on the top in 82.6% of cases and within the top 3 at 95.0% of cases. Results show that using context information that is not used in most existing agents is necessary for appropriate responses.

References

  1. Banchs, R. E. and Li, H. (2012). Iris: a chat-oriented dialogue system based on the vector space model. In Proceedings of the ACL 2012 System Demonstrations, pages 37-42. Association for Computational Linguistics.
  2. Bickmore, T. and Cassell, J. (2001). Relational agents: a model and implementation of building user trust. In Proceedings of the SIGCHI conference on Human factors in computing systems, pages 396-403.
  3. Cao, Z., Qin, T., Liu, T., Tsai, M., and Li, H. (2007). Learning to rank: from pairwise approach to listwise approach. In Proceedings of the 24th international conference on Machine learning, pages 129-136.
  4. Chu-Carroll, J. and Nickerson, J. (2000). Evaluating automatic dialogue strategy adaptation for a spoken dialogue system. In Proceedings of the 1st North American chapter of the Association for Computational Linguistics conference, pages 202-209.
  5. Deterding, S., Sicart, M., Nacke, L., O'Hara, K., and Dixon, D. (2011). Gamification. using game-design elements in non-gaming contexts. In Proceedings of the 2011 annual conference extended abstracts on Human factors in computing systems, pages 2425-2428. ACM.
  6. Isomura, N., Toriumi, F., and Ishii, K. (2009). Statistical Utterance Selection using Word Co-occurrence for a Dialogue Agent. Lecture Notes in Computer Science, 5925/2009:68-79.
  7. Luce, R. (1959). Individual choice behavior: A theoretical analysis. New York: Wiley.
  8. Murao, H., Kawaguchi, N., Matsubara, S., Yamaguchi, Y., and Inagaki, Y. (2003). Example-based spoken dialogue system using woz system log. In SIGdial Workshop on Discourse and Dialogue, pages 140-148.
  9. Plackett, R. (1975). The analysis of permutations. Applied Statistics, pages 193-202.
  10. Platt, J. et al. (1999). Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods. Advances in large margin classifiers, 10(3):61-74.
  11. Ritter, A., Cherry, C., and Dolan, W. B. (2011). Datadriven response generation in social media. In Proceedings of the conference on empirical methods in natural language processing, pages 583-593. Association for Computational Linguistics.
  12. Von Ahn, L. and Dabbish, L. (2004). Labeling images with a computer game. In Proceedings of the SIGCHI conference on Human factors in computing systems, pages 319-326. ACM.
  13. Wallace, R. (2009). The anatomy of alice. Parsing the Turing Test, pages 181-210.
  14. Weizenbaum, J. (1966). ELIZA-a computer program for the study of natural language communication between man and machine. Communications of the ACM, 9(1):36-45.
  15. Worswick, S. (2013). http://www.mitsuku.com/.
  16. Zue, V., Seneff, S., Polifroni, J., Phillips, M., Pao, C., Goodine, D., Goddeau, D., and Glass, J. (1994). Pegasus: A spoken dialogue interface for on-line air travel planning. Speech Communication, 15(3-4):331-340.
Download


Paper Citation


in Harvard Style

Inaba M., Iwata N., Toriumi F., Hirayama T., Enokibori Y., Takahashi K. and Mase K. (2014). Constructing a Non-task-oriented Dialogue Agent using Statistical Response Method and Gamification . In Proceedings of the 6th International Conference on Agents and Artificial Intelligence - Volume 1: ICAART, ISBN 978-989-758-015-4, pages 14-21. DOI: 10.5220/0004722000140021


in Bibtex Style

@conference{icaart14,
author={Michimasa Inaba and Naoyuki Iwata and Fujio Toriumi and Takatsugu Hirayama and Yu Enokibori and Kenichi Takahashi and Kenji Mase},
title={Constructing a Non-task-oriented Dialogue Agent using Statistical Response Method and Gamification},
booktitle={Proceedings of the 6th International Conference on Agents and Artificial Intelligence - Volume 1: ICAART,},
year={2014},
pages={14-21},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004722000140021},
isbn={978-989-758-015-4},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 6th International Conference on Agents and Artificial Intelligence - Volume 1: ICAART,
TI - Constructing a Non-task-oriented Dialogue Agent using Statistical Response Method and Gamification
SN - 978-989-758-015-4
AU - Inaba M.
AU - Iwata N.
AU - Toriumi F.
AU - Hirayama T.
AU - Enokibori Y.
AU - Takahashi K.
AU - Mase K.
PY - 2014
SP - 14
EP - 21
DO - 10.5220/0004722000140021