Comparison of Electronic Examinations using Adaptive Multiple-choice Questions and Constructed-response Questions

Peter Stavroulakis, Panagiotis Photopoulos, Errikos Ventouras, Dimos Triantis

2020

Abstract

The use of computer-based examination systems offers advantages related to the reduction of human resource allocation and to gains in objectivity for the scoring process. Multiple-choice questions (MCQs) are widely used in such systems; one of the main reasons that hamper their effectiveness, in comparison with constructed response questions (CRQ), is the influence of guessing. Considering limitations within previously proposed MCQs examination methods and scoring rules, in the present work a novel MCQs examination method is presented, termed ‘adaptive’ MCQs method. MCQs are divided into 3 categories, per difficulty level. The ‘path’ that an examinee will follow is constituted by 3 phases, wherein a set of questions belonging to one of the three difficulty-categories, is appointed. The exact path followed is selected per the success level of the examinee in the preceding phase. The scoring provided by the adaptive MCQs examination method produced results that were statistically indistinguishable to the scoring produced by a traditional CRQ examination method. At the same time, both the scoring results of the adaptive MCQs examination and the scoring results of the CRQ examination differed significantly from those obtained by a generic ‘non-adaptive’ MCQs examination.

Paper Citation

in Harvard Style

Stavroulakis P., Photopoulos P., Ventouras E. and Triantis D. (2020). Comparison of Electronic Examinations using Adaptive Multiple-choice Questions and Constructed-response Questions.In Proceedings of the 12th International Conference on Computer Supported Education - Volume 1: CSEDU, ISBN 978-989-758-417-6, pages 358-365. DOI: 10.5220/0009341603580365

in Bibtex Style

@conference{csedu20,
author={Peter Stavroulakis and Panagiotis Photopoulos and Errikos Ventouras and Dimos Triantis},
title={Comparison of Electronic Examinations using Adaptive Multiple-choice Questions and Constructed-response Questions},
booktitle={Proceedings of the 12th International Conference on Computer Supported Education - Volume 1: CSEDU,},
year={2020},
pages={358-365},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0009341603580365},
isbn={978-989-758-417-6},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 12th International Conference on Computer Supported Education - Volume 1: CSEDU,
TI - Comparison of Electronic Examinations using Adaptive Multiple-choice Questions and Constructed-response Questions
SN - 978-989-758-417-6
AU - Stavroulakis P.
AU - Photopoulos P.
AU - Ventouras E.
AU - Triantis D.
PY - 2020
SP - 358
EP - 365
DO - 10.5220/0009341603580365