Test Quality Assessment and Adaptive Algorithm Based on IRT Models

Alexander Kostikov, Kateryna Vlasenko, Kateryna Vlasenko, Iryna Lovianova, Vadim Khoroshailo, Natalia Hrudkina

2021

Abstract

In this paper the algorithm for adaptive testing of students’ knowledge in distance learning and an assessment of its effectiveness in the educational process has been proposed. The results of the study are based on the achievements of modern testing theory IRT. The objective of the study was to build test items that allow adequately assessing the student’s achievements and automating the assessment process using an adaptive algorithm. To achieve this goal, mathematical models of modern testing theory IRT were used, namely, the Rasch model, 2-PL and 3-PL Birnbaum models. The important outcomes of this work are a thorough analysis of the developed test tasks, identification of their shortcomings and automation of the process of assessing students’ knowledge using an adaptive algorithm based on the methods of modern testing theory IRT. The paper provides an overview of the results of the application of modern test theory, a description and block diagram of the proposed algorithm and the results of its application in the real educational process. The effectiveness of using this algorithm for the objective assessment of students’ knowledge has been experimentally shown. The test quality has been assessed using the IRT models.

Paper Citation

in Harvard Style

Kostikov A., Vlasenko K., Lovianova I., Khoroshailo V. and Hrudkina N. (2021). Test Quality Assessment and Adaptive Algorithm Based on IRT Models. In Proceedings of the 2nd Myroslav I. Zhaldak Symposium on Advances in Educational Technology - Volume 1: AET; ISBN 978-989-758-662-0, SciTePress, pages 103-117. DOI: 10.5220/0012061900003431

in Bibtex Style

@conference{aet21,
author={Alexander Kostikov and Kateryna Vlasenko and Iryna Lovianova and Vadim Khoroshailo and Natalia Hrudkina},
title={Test Quality Assessment and Adaptive Algorithm Based on IRT Models},
booktitle={Proceedings of the 2nd Myroslav I. Zhaldak Symposium on Advances in Educational Technology - Volume 1: AET},
year={2021},
pages={103-117},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0012061900003431},
isbn={978-989-758-662-0},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 2nd Myroslav I. Zhaldak Symposium on Advances in Educational Technology - Volume 1: AET
TI - Test Quality Assessment and Adaptive Algorithm Based on IRT Models
SN - 978-989-758-662-0
AU - Kostikov A.
AU - Vlasenko K.
AU - Lovianova I.
AU - Khoroshailo V.
AU - Hrudkina N.
PY - 2021
SP - 103
EP - 117
DO - 10.5220/0012061900003431
PB - SciTePress