loading
Papers Papers/2022 Papers Papers/2022

Research.Publish.Connect.

Paper

Author: Victor Margallo

Affiliation: PublicSonar, Zuid Hollandlaan 7, The Hague, The Netherlands

Keyword(s): NLP, Extractive Summarisation, Evaluation, Summary Quality Modelling.

Abstract: In the task of providing extracted summaries, the assessment of quality evaluation has been traditionally tackled with n-gram, word sequences, and word pairs overlapping metrics with human annotated summaries for theoretical benchmarking. This approach does not provide an end solution for extractive summarising algorithms as output summaries are not evaluated for new texts. Our solution proposes the expansion of a graph extraction method together with an understanding layer before delivering the final summary. With this technique we strive to achieve a categorisation of acceptable output summaries. Our understanding layer judges correct summaries with 91% accuracy and is in line with experts’ labelling providing a strong inter-rater reliability (0.73 Kappa statistic).

CC BY-NC-ND 4.0

Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 3.15.228.32

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Margallo, V. (2022). Understanding Summaries: Modelling Evaluation in Extractive Summarisation Techniques. In Proceedings of the 14th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART; ISBN 978-989-758-547-0; ISSN 2184-433X, SciTePress, pages 605-611. DOI: 10.5220/0010954300003116

@conference{icaart22,
author={Victor Margallo},
title={Understanding Summaries: Modelling Evaluation in Extractive Summarisation Techniques},
booktitle={Proceedings of the 14th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART},
year={2022},
pages={605-611},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010954300003116},
isbn={978-989-758-547-0},
issn={2184-433X},
}

TY - CONF

JO - Proceedings of the 14th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART
TI - Understanding Summaries: Modelling Evaluation in Extractive Summarisation Techniques
SN - 978-989-758-547-0
IS - 2184-433X
AU - Margallo, V.
PY - 2022
SP - 605
EP - 611
DO - 10.5220/0010954300003116
PB - SciTePress

- Science and Technology Publications, Lda.
RESOURCES

Proceedings

Papers

Authors

Ontology

CONTACTS

Science and Technology Publications, Lda
Avenida de S. Francisco Xavier, Lote 7 Cv. C,
2900-616 Setúbal, Portugal.

Phone: +351 265 520 185 (National fixed network call)
Fax: +351 265 520 186
Email: info@scitepress.org

EXTERNAL LINKS

PRIMORIS

INSTICC

SCITEVENTS

CROSSREF

PROCEEDINGS SUBMITTED FOR INDEXATION BY:

dblp

Ei Compendex

SCOPUS

Semantic Scholar

Google Scholar

Microsoft Academic