Detection of Student Teacher's Intention using Multimodal Features in a Virtual Classroom

Masato Fukuda, Hung-Hsuan Huang, Toyoaki Nishida

2019

Abstract

The training program for high school teachers in Japan has less opportunity to practice teaching skills. As a new practice platform, we are running a project to develop a simulation platform of school environment with computer graphics animated virtual students for students’ teachers. In order to interact with virtual students and teachers, it is necessary to estimate the intention of the teacher’s behavior and utterance. However, it is difficult to detection the teacher’s intention at the classroom only by verbal information, such as whether to ask for a response or seek a response. In this paper, we propose an automatic detection model of teacher’s intention using multimodal features including linguistic, prosodic, and gestural features. For the linguistic features, we consider the models with and without lecture contents specific information. As a result, it became clear that estimating the intention of the teacher is better when using prosodic / non-verbal information together than using only verbal information. Also, the models with contents specific information perform better.

Paper Citation

in Harvard Style

Fukuda M., Huang H. and Nishida T. (2019). Detection of Student Teacher's Intention using Multimodal Features in a Virtual Classroom.In Proceedings of the 11th International Conference on Agents and Artificial Intelligence - Volume 1: ICAART, ISBN 978-989-758-350-6, pages 170-177. DOI: 10.5220/0007379901700177

in Bibtex Style

@conference{icaart19,
author={Masato Fukuda and Hung-Hsuan Huang and Toyoaki Nishida},
title={Detection of Student Teacher's Intention using Multimodal Features in a Virtual Classroom},
booktitle={Proceedings of the 11th International Conference on Agents and Artificial Intelligence - Volume 1: ICAART,},
year={2019},
pages={170-177},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0007379901700177},
isbn={978-989-758-350-6},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 11th International Conference on Agents and Artificial Intelligence - Volume 1: ICAART,
TI - Detection of Student Teacher's Intention using Multimodal Features in a Virtual Classroom
SN - 978-989-758-350-6
AU - Fukuda M.
AU - Huang H.
AU - Nishida T.
PY - 2019
SP - 170
EP - 177
DO - 10.5220/0007379901700177