Use of Language Models for Document Stream Segmentation

Chems Neche, Yolande Belaíd, Abdel Belaíd

2020

Abstract

Page stream segmentation into single documents is a very common task which is practiced in companies and administrations when processing their incoming mail. It is not a straightforward task because the limits of the documents are not always obvious, and it is not always easy to find common features between the pages of the same document. In this paper, we seek to compare existing segmentation models and propose a new segmentation one based on GRUs (Gated Recurrent Unit) and an attention mechanism, named AGRU. This model uses the text content of the previous page and the current page to determine if both pages belong to the same document. So, due to its attention mechanism, this model is capable to recognize words that define the first page of a document. Training and evaluation are carried out on two datasets: Tobacco-800 and READ-Corpus. The former is a public dataset on which our model reaches an F1 score equal to 90%, and the later is private for which our model reaches an F1 score equal to 96%.

Paper Citation

in Harvard Style

Neche C., Belaíd Y. and Belaíd A. (2020). Use of Language Models for Document Stream Segmentation. In Proceedings of the 9th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM, ISBN 978-989-758-397-1, pages 220-227. DOI: 10.5220/0009146402200227

in Bibtex Style

@conference{icpram20,
author={Chems Neche and Yolande Belaíd and Abdel Belaíd},
title={Use of Language Models for Document Stream Segmentation},
booktitle={Proceedings of the 9th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,},
year={2020},
pages={220-227},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0009146402200227},
isbn={978-989-758-397-1},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 9th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,
TI - Use of Language Models for Document Stream Segmentation
SN - 978-989-758-397-1
AU - Neche C.
AU - Belaíd Y.
AU - Belaíd A.
PY - 2020
SP - 220
EP - 227
DO - 10.5220/0009146402200227