INTENTION-BASED CORRECTIVE FEEDBACK GENERATION USING CONTEXT-AWARE MODEL

Sungjin Lee, Cheongjae Lee, Jonghoon Lee, Hyungjong Noh, Gary Geunbae Lee

Abstract

In order to facilitate language acquisition, when language learners speak incomprehensible utterances, a Dialog-based Computer Assisted Language Learning (DB-CALL) system should provide matching fluent utterances by inferring the actual learner’s intention both from the utterance itself and from the dialog context as human tutors do. We propose a hybrid inference model that allows a practical and principled way of separating the utterance model and the dialog context model so that only the utterance model needs to be adjusted for each fluency level. Also, we propose a feedback generation method that provides native-like utterances by searching Example Expression Database using the inferred intention. In experiments, our hybrid model outperformed the utterance only model. Also, from the increased dialog completion rate, we can conclude that our method is suitable to produce appropriate feedback even when the learner's utterances are highly incomprehensible. This is because the dialog context model effectively confines candidate intentions within the given context.

References

  1. Ai, H., Roque, A., Leuski, A., Traum, D. 2007. Using Information State to Improve Dialog Move Identification in a Spoken Dialog System In Proc. Interspeech 2007, Antwerp
  2. Bohus, D. and Rudnicky, A. 2003. RavenClaw: Dialog Management Using Hierarchical Task Decomposition and an Expectation Agenda. In Proc. Eurospeech 2003, Geneva.
  3. Carroll, D. 2003. The Psychology of Language Wadsworth Publishing Co Inc. 4th edition
  4. Dasarathy, B. V. 1990. Nearest neighbor (NN) norms: NN pattern classification techniques Los Alamitos: IEEE Computer Society Press
  5. Foster J. 2007. Treebanks Gone Bad: Parser evaluation and retraining using a treebank of ungrammatical sentences. International Journal on Document Analysis and Recognition, 10(3-4), 129--145.
  6. Foster J. 2005. Good Reasons for Noting Bad Grammar: Empirical Investigations into the Parsing of Ungrammatical Written English. PhD Dissertation, Department of Computer Science, Trinity College, University of Dublin
  7. Jung S., Lee C., Kim K., Lee G. G. 2009. Data-driven user simulation for automated evaluation of spoken dialog systems. Computer Speech and Language. 23(4):479- 509, Oct 2009
  8. Lee C., Jung S., Kim S., Lee G. G. 2009. Example-based Dialog Modeling for Practical Multi-domain Dialog System. Speech Communication. 51(5):466-484, May 2009.
  9. Lee S., Lee G. G. 2009. Realistic grammar error simulation using markov logic. To be published in Proceedings of the ACL 2009, Singapore, August 2009
  10. Long, M. H. 2005. The role of the linguistic environment in second language acquisition in W. C. Ritchie and T. K. Bhatia (eds): Handbook of Second Language Acquisition. New York: Academic Press, pp. 413-68.
  11. McClelland, D. C. 1961. The achieving society New York: Van Nostrand
  12. Michaud L. N. 2002. Modeling User Interlanguage in a Second Language Tutoring System for Deaf Users of American Sign Language. PhD Dissertation, Department of Computer and Information Sciences, University of Delaware
  13. Morton, H. and Jack, M. A. 2005. Scenario-Based Spoken Interaction with Virtual Agents, Computer Assisted Language Learning, 18:3 pp. 171-191.
  14. Poesio, M. and Mikheev, A. 1998. The Predictive Power of Game Structure in Dialog Act Recognition: Experimental Results Using Maximum Entropy Estimation. In Proceedings of ICSLP-98.
  15. Ratnaparkhi, A. 1998. Maximum Entropy Models for Natural Language Ambiguity Resolution, PhD thesis, University of Pennsylvania, 1998.
  16. Raux, A. and Eskenazi, M. 2004. Using Task-Oriented Spoken Dialog Systems for Language Learning. Potential, Practical Applications and Challenges, Proceedings INSTIL.
  17. Schneider, D. and McCoy K. F. 1998. Recognizing Syntactic Errors in the Writing of Second Language Learners. In Proceedings of the Thirty-Sixth Annual Meeting of the Association for Computational Linguistics and the Seventeenth International Conference on Computational Linguistics (COLINGACL), Volume 2
  18. Swain, M. 1996. The output hypothesis: Theory and research in E. Hinkel (ed.): Handbook of Research in Second Language Teaching and Learning. Mahwah, NJ: Lawrence Erlbaum Associates, pp. 471-83.
Download


Paper Citation


in Harvard Style

Lee S., Lee C., Lee J., Noh H. and Geunbae Lee G. (2010). INTENTION-BASED CORRECTIVE FEEDBACK GENERATION USING CONTEXT-AWARE MODEL . In Proceedings of the 2nd International Conference on Computer Supported Education - Volume 1: CSEDU, ISBN 978-989-674-023-8, pages 11-18. DOI: 10.5220/0002773200110018


in Bibtex Style

@conference{csedu10,
author={Sungjin Lee and Cheongjae Lee and Jonghoon Lee and Hyungjong Noh and Gary Geunbae Lee},
title={INTENTION-BASED CORRECTIVE FEEDBACK GENERATION USING CONTEXT-AWARE MODEL},
booktitle={Proceedings of the 2nd International Conference on Computer Supported Education - Volume 1: CSEDU,},
year={2010},
pages={11-18},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0002773200110018},
isbn={978-989-674-023-8},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 2nd International Conference on Computer Supported Education - Volume 1: CSEDU,
TI - INTENTION-BASED CORRECTIVE FEEDBACK GENERATION USING CONTEXT-AWARE MODEL
SN - 978-989-674-023-8
AU - Lee S.
AU - Lee C.
AU - Lee J.
AU - Noh H.
AU - Geunbae Lee G.
PY - 2010
SP - 11
EP - 18
DO - 10.5220/0002773200110018