Comparing Feature Engineering and Deep Learning Methods for Automated Essay Scoring of Brazilian National High School Examination

Aluizio Filho, Fernando Concatto, Hércules Antonio do Prado, Edilson Ferneda

2021

Abstract

The National High School Exam (ENEM) in Brazil is a test applied annually to assess students before entering higher education. On average, over 7.5 million students participate in this test. In the same sense, large educational groups need to conduct tests for students preparing for ENEM. For correcting each essay, it is necessary at least two evaluators, which makes the process time consuming and very expensive. One alternative for substantially reducing the cost and speed up the correction of essays is to replace one human evaluator by an automated process. This paper presents a computational approach for essays correction able to replace one human evaluator. Techniques based on feature engineering and deep learning were compared, aiming to obtain the best accuracy among them. It was found that is possible to reach accuracy indexes close to 100% in the most frequent classes that comprise near 80% of the essays set.

Paper Citation

in Harvard Style

Filho A., Concatto F., Antonio do Prado H. and Ferneda E. (2021). Comparing Feature Engineering and Deep Learning Methods for Automated Essay Scoring of Brazilian National High School Examination. In Proceedings of the 23rd International Conference on Enterprise Information Systems - Volume 1: ICEIS, ISBN 978-989-758-509-8, pages 575-583. DOI: 10.5220/0010377505750583

in Bibtex Style

@conference{iceis21,
author={Aluizio Filho and Fernando Concatto and Hércules Antonio do Prado and Edilson Ferneda},
title={Comparing Feature Engineering and Deep Learning Methods for Automated Essay Scoring of Brazilian National High School Examination},
booktitle={Proceedings of the 23rd International Conference on Enterprise Information Systems - Volume 1: ICEIS,},
year={2021},
pages={575-583},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010377505750583},
isbn={978-989-758-509-8},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 23rd International Conference on Enterprise Information Systems - Volume 1: ICEIS,
TI - Comparing Feature Engineering and Deep Learning Methods for Automated Essay Scoring of Brazilian National High School Examination
SN - 978-989-758-509-8
AU - Filho A.
AU - Concatto F.
AU - Antonio do Prado H.
AU - Ferneda E.
PY - 2021
SP - 575
EP - 583
DO - 10.5220/0010377505750583