Conversation Management in Task-oriented Turkish Dialogue Agents with Dialogue Act Classification

O. Fatih Kilic, Enes B. Dundar, Yusufcan Manav, Tolga Cekic, Onur Deniz

2020

Abstract

We study the problem of dialogue act classification to be used in conversation management of goal-oriented dialogue systems. Online chat behavior in human-machine dialogue systems differs from human-human spoken conversations. To this end, we develop 9 dialogue act classes by observing real-life human conversations from a banking domain Turkish dialogue agent. We then propose a dialogue policy based on these classes to correctly direct the users to their goals in a chatbot-human support hybrid dialogue system. To train a dialogue act classifier, we annotate a corpus of human-machine dialogues consisting of 426 conversations and 5020 sentences. Using the annotated corpus, we train a self-attentive bi-directional LSTM dialogue act classifier, which achieves 0.90 weighted F1-score on a sentence level classification performance. We deploy the trained model in the conversation manager to maintain the designed dialogue policy.

Paper Citation

in Harvard Style

Kilic O., Dundar E., Manav Y., Cekic T. and Deniz O. (2020). Conversation Management in Task-oriented Turkish Dialogue Agents with Dialogue Act Classification. In Proceedings of the 12th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management (IC3K 2020) - Volume 1: KDIR; ISBN 978-989-758-474-9, SciTePress, pages 29-35. DOI: 10.5220/0010020700290035

in Bibtex Style

@conference{kdir20,
author={O. Fatih Kilic and Enes B. Dundar and Yusufcan Manav and Tolga Cekic and Onur Deniz},
title={Conversation Management in Task-oriented Turkish Dialogue Agents with Dialogue Act Classification},
booktitle={Proceedings of the 12th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management (IC3K 2020) - Volume 1: KDIR},
year={2020},
pages={29-35},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010020700290035},
isbn={978-989-758-474-9},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 12th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management (IC3K 2020) - Volume 1: KDIR
TI - Conversation Management in Task-oriented Turkish Dialogue Agents with Dialogue Act Classification
SN - 978-989-758-474-9
AU - Kilic O.
AU - Dundar E.
AU - Manav Y.
AU - Cekic T.
AU - Deniz O.
PY - 2020
SP - 29
EP - 35
DO - 10.5220/0010020700290035
PB - SciTePress