ADAPTING MULTIPLE-CHOICE ITEM-WRITING GUIDELINES TO AN INDUSTRIAL CONTEXT

Robert Michael Foster

Abstract

This paper proposes a guideline for writing MCQ items for our domain which promotes the use of Multiple Alternative Choice (MAC) items. This guideline is derived from one of the guidelines from the Taxonomy of item-writing guidelines reviewed by Haladyna et al, 2002. The new guideline is tested by delivering two sets of MCQ test items to a representative sample of candidates from the domain. One set of items complies with the proposed guideline and the other set of items does not. Evaluation of the relative effectiveness of the items in the experiment is achieved using established methods of item response analysis. The experiment shows that the new guideline is more applicable to the featured domain than the original guideline.

References

  1. Foster, R.M. 2009 Improving the Output from Software that Generates Multiple Choice Question (MCQ) Test Items Automatically using Controlled Rhetorical Structure Theory RANLP 2009, Borovets, Bulgaria (Student Conference)
  2. Haladyna, T.M., Downing, S.M., Rodriguez, M.C., 2002 A Review of Multiple-Choice Item-Writing Guidelines for Classroom Assessment In Applied Measurement in Education, 15(3), 309-334
  3. Mitkov, R., and Ha, L. A., 2003. Computer-Aided Generation of Multiple-Choice Tests. In Proceedings of HLT-NAACL 2003 Workshop on Building Educational Applications Using Natural Language Processing, pp. 17-22. Edmonton, Canada.
  4. Mitkov, R., Ha, L. A., and Karamanis, N.,. 2006. A computer-aided environment for generating multiplechoice test items. Natural Language Engineering 12(2): 177-194.
  5. Swanson D.B., Holtzman, K.Z.,Allbee K.,Clauser, B.E., (2006) - Psychometric Characteristics and Response Times for Content-Parallel Extended-Matching and One-Best-Answer Items in Relation to Number of Options. Academic Medicine: October 2006 - Volume 81 - Issue 10 - pp S52-S55 doi: 10.1097/01.ACM.0000236518.87708.9d
Download


Paper Citation


in Harvard Style

Michael Foster R. (2010). ADAPTING MULTIPLE-CHOICE ITEM-WRITING GUIDELINES TO AN INDUSTRIAL CONTEXT . In Proceedings of the 12th International Conference on Enterprise Information Systems - Volume 4: ICEIS, ISBN 978-989-8425-07-2, pages 71-74. DOI: 10.5220/0002871400710074


in Bibtex Style

@conference{iceis10,
author={Robert Michael Foster},
title={ADAPTING MULTIPLE-CHOICE ITEM-WRITING GUIDELINES TO AN INDUSTRIAL CONTEXT},
booktitle={Proceedings of the 12th International Conference on Enterprise Information Systems - Volume 4: ICEIS,},
year={2010},
pages={71-74},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0002871400710074},
isbn={978-989-8425-07-2},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 12th International Conference on Enterprise Information Systems - Volume 4: ICEIS,
TI - ADAPTING MULTIPLE-CHOICE ITEM-WRITING GUIDELINES TO AN INDUSTRIAL CONTEXT
SN - 978-989-8425-07-2
AU - Michael Foster R.
PY - 2010
SP - 71
EP - 74
DO - 10.5220/0002871400710074