Automatic Evaluation of Textual Cohesion in Essays

Aluizio Filho, Filipe Porto de Lima, Hércules Antônio do Prado, Edilson Ferneda, Adson Esteves, Rudimar Dazzi

2022

Abstract

Aiming to contribute to studies on the evaluation of textual cohesion in Brazilian Portuguese, this paper presents an approach based on machine learning for automated scoring of textual cohesion, according to the evaluation model adopted in Brazil. The purpose is to verify the mastery of skills and abilities of students who have completed high school. Based on features groups such as lexicon diversity, connectives, readability indexes and overlap of sentences and paragraphs, 91 features, based in TAACO (Tool for the Automatic Analysis of Cohesion), were adopted. Beyond features specifically related to textual cohesion, other were defined for capturing general aspects of the text. The efficiency of the classification model based on Support Vector Machines was measured. It was also demonstrated how normalization and class balancing techniques are essential to improve results using the small dataset available for this task.

Paper Citation

in Harvard Style

Filho A., Porto de Lima F., Antônio do Prado H., Ferneda E., Esteves A. and Dazzi R. (2022). Automatic Evaluation of Textual Cohesion in Essays. In Proceedings of the 24th International Conference on Enterprise Information Systems - Volume 2: ICEIS, ISBN 978-989-758-569-2, pages 634-640. DOI: 10.5220/0011113600003179

in Bibtex Style

@conference{iceis22,
author={Aluizio Filho and Filipe Porto de Lima and Hércules Antônio do Prado and Edilson Ferneda and Adson Esteves and Rudimar Dazzi},
title={Automatic Evaluation of Textual Cohesion in Essays},
booktitle={Proceedings of the 24th International Conference on Enterprise Information Systems - Volume 2: ICEIS,},
year={2022},
pages={634-640},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0011113600003179},
isbn={978-989-758-569-2},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 24th International Conference on Enterprise Information Systems - Volume 2: ICEIS,
TI - Automatic Evaluation of Textual Cohesion in Essays
SN - 978-989-758-569-2
AU - Filho A.
AU - Porto de Lima F.
AU - Antônio do Prado H.
AU - Ferneda E.
AU - Esteves A.
AU - Dazzi R.
PY - 2022
SP - 634
EP - 640
DO - 10.5220/0011113600003179