Dense Information Retrieval on a Latin Digital Library via LaBSE and LatinBERT Embeddings

Federico Galatolo, Gabriele Martino, Mario Cimino, Chiara Tommasi

2023

Abstract

Dense Information Retrieval (DIR) has recently gained attention due to the advances in deep learning-based word embedding. In particular, for historical languages such as Latin, a DIR task is appropriate although challenging, due to: (i) the complexity of managing searches using traditional Natural Language Processing (NLP); (ii) the availability of fewer resources with respect to modern languages; (iii) the large variation in usage among different eras. In this research, pre-trained transformer models are used as features extractors, to carry out a search on a Latin Digital Library. The system computes embeddings of sentences using state-of-the-art models, i.e., Latin BERT and LaBSE, and uses cosine distance to retrieve the most similar sentences. The paper delineates the system development and summarizes an evaluation of its performance using a quantitative metric based on expert’s per-query documents ranking. The proposed design is suitable for other historical languages. Early results show the higher potential of the LabSE model, encouraging further comparative research. To foster further development, the data and source code have been publicly released.

Paper Citation

in Harvard Style

Galatolo F., Martino G., Cimino M. and Tommasi C. (2023). Dense Information Retrieval on a Latin Digital Library via LaBSE and LatinBERT Embeddings. In Proceedings of the 12th International Conference on Data Science, Technology and Applications - Volume 1: DATA; ISBN 978-989-758-664-4, SciTePress, pages 518-523. DOI: 10.5220/0012134700003541

in Bibtex Style

@conference{data23,
author={Federico Galatolo and Gabriele Martino and Mario Cimino and Chiara Tommasi},
title={Dense Information Retrieval on a Latin Digital Library via LaBSE and LatinBERT Embeddings},
booktitle={Proceedings of the 12th International Conference on Data Science, Technology and Applications - Volume 1: DATA},
year={2023},
pages={518-523},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0012134700003541},
isbn={978-989-758-664-4},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 12th International Conference on Data Science, Technology and Applications - Volume 1: DATA
TI - Dense Information Retrieval on a Latin Digital Library via LaBSE and LatinBERT Embeddings
SN - 978-989-758-664-4
AU - Galatolo F.
AU - Martino G.
AU - Cimino M.
AU - Tommasi C.
PY - 2023
SP - 518
EP - 523
DO - 10.5220/0012134700003541
PB - SciTePress