Different Metrics Results in Text Summarization Approaches

Marcello Barbella, Michele Risi, Genoveffa Tortora, Alessia Auriemma Citarella

2022

Abstract

Automatic Text Summarization is the result of more than 50 years of research. Several methods for creating a summary from a single document or a group of related documents have been proposed over time, all of which have shown very efficient results. Artificial intelligence has enabled advancement in generating summaries that include other words compared to the original text. Instead, the issue is identifying how a summary may be regarded as ideal compared to a reference summary, which is still a topic of research that is open to new answers. How can the outcomes of the numerous new algorithms that appear year after year be assessed? This research aims to see if the ROUGE metric, widely used in the literature to evaluate the results of Text Summarization algorithms, helps deal with these new issues, mainly when the original reference dataset is limited to a small field of interest. Furthermore, an in-depth experiment is conducted by comparing the results of the ROUGE metric with other metrics. In conclusion, determining an appropriate metric to evaluate the summaries produced by a machine is still a long way off.

Paper Citation

in Harvard Style

Barbella M., Risi M., Tortora G. and Auriemma Citarella A. (2022). Different Metrics Results in Text Summarization Approaches. In Proceedings of the 11th International Conference on Data Science, Technology and Applications - Volume 1: DATA, ISBN 978-989-758-583-8, pages 31-39. DOI: 10.5220/0011144000003269

in Bibtex Style

@conference{data22,
author={Marcello Barbella and Michele Risi and Genoveffa Tortora and Alessia Auriemma Citarella},
title={Different Metrics Results in Text Summarization Approaches},
booktitle={Proceedings of the 11th International Conference on Data Science, Technology and Applications - Volume 1: DATA,},
year={2022},
pages={31-39},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0011144000003269},
isbn={978-989-758-583-8},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 11th International Conference on Data Science, Technology and Applications - Volume 1: DATA,
TI - Different Metrics Results in Text Summarization Approaches
SN - 978-989-758-583-8
AU - Barbella M.
AU - Risi M.
AU - Tortora G.
AU - Auriemma Citarella A.
PY - 2022
SP - 31
EP - 39
DO - 10.5220/0011144000003269