Question Difficulty Decision for Automated Interview in Foreign Language Test

Minghao Lin, Koichiro Ito, Shigeki Matsubara, Shigeki Matsubara

2023

Abstract

As globalization continues to progress all over the world, demand is growing for objective and rapid assessment of language proficiency in foreign language learners. While automated assessment of listening, reading, and writing skills has been proposed, little research has been done to automate assessment of speaking skills. In this paper, we propose a method of deciding the difficulty of questions generated for interview tests of skills assessment in speaking a foreign language. To address question difficulty flexibly according to the abilities of test takers, our method considers the appropriateness of responses from test takers. We implemented this method using the large-scale pre-trained language model BERT (Bidirectional Encoder Representation from Transformers). Experiments were conducted using simulated test data from the Japanese Learner’s Conversation Database to confirm the effectiveness of our method in deciding difficulty.

Paper Citation

in Harvard Style

Lin M., Ito K. and Matsubara S. (2023). Question Difficulty Decision for Automated Interview in Foreign Language Test. In Proceedings of the 15th International Conference on Agents and Artificial Intelligence - Volume 3: ICAART, ISBN 978-989-758-623-1, pages 760-767. DOI: 10.5220/0011774900003393

in Bibtex Style

@conference{icaart23,
author={Minghao Lin and Koichiro Ito and Shigeki Matsubara},
title={Question Difficulty Decision for Automated Interview in Foreign Language Test},
booktitle={Proceedings of the 15th International Conference on Agents and Artificial Intelligence - Volume 3: ICAART,},
year={2023},
pages={760-767},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0011774900003393},
isbn={978-989-758-623-1},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 15th International Conference on Agents and Artificial Intelligence - Volume 3: ICAART,
TI - Question Difficulty Decision for Automated Interview in Foreign Language Test
SN - 978-989-758-623-1
AU - Lin M.
AU - Ito K.
AU - Matsubara S.
PY - 2023
SP - 760
EP - 767
DO - 10.5220/0011774900003393