A Method for Generating Testlets

Mark Gierl, Tahereh Firoozi

2024

Abstract

A testlet is a set of two or more items based on the same scenario. A testlet can be used to measure complex problem-solving skills that require a series or sequence of steps. A testlet is challenging to write because it requires one unique scenario and two or more items. Despite this challenge, large numbers of testlets are often required to support formative and summative computerized testing. The purpose of our study is to address the testlet item writing challenge by describing and demonstrating a systematic method that can be used to create large numbers of testlets. Our method is grounded in the three-step process associated with template-based automatic item generation. To begin, we describe a testlet-based item model. The model contains global and local variables. Global variables are unique to testlet generation because they can be used throughout the testlet, meaning that these variables can be used to place content anywhere in the testlet. Local variables, on the other hand, are specific to each item model in the testlet and can only be used in the same item model. Next, we present four cases that demonstrate how global and local variables can be combined to generate testlets. Each case provides a practical example of how the testlet item model can be used to structure global and local variables in order to generate diverse sets of test items. We conclude by highlighting the benefits of testlet-based automatic item generation for computerized testing.

Paper Citation

in Harvard Style

Gierl M. and Firoozi T. (2024). A Method for Generating Testlets. In Proceedings of the 16th International Conference on Computer Supported Education - Volume 1: AIG; ISBN 978-989-758-697-2, SciTePress, pages 799-806. DOI: 10.5220/0012749500003693

in Bibtex Style

@conference{aig24,
author={Mark Gierl and Tahereh Firoozi},
title={A Method for Generating Testlets},
booktitle={Proceedings of the 16th International Conference on Computer Supported Education - Volume 1: AIG},
year={2024},
pages={799-806},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0012749500003693},
isbn={978-989-758-697-2},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 16th International Conference on Computer Supported Education - Volume 1: AIG
TI - A Method for Generating Testlets
SN - 978-989-758-697-2
AU - Gierl M.
AU - Firoozi T.
PY - 2024
SP - 799
EP - 806
DO - 10.5220/0012749500003693
PB - SciTePress