Relevance of Similarity Measures Usage for Paraphrase Detection

Tedo Vrbanec, Tedo Vrbanec, Ana Meštrović

2021

Abstract

The article describes the experiments and their results using two Deep Learning (DL) models and four measures of similarity/distance, determining the similarity of documents from the three publicly available corpora of paraphrased documents. As DL models, Word2Vec was used in two variants and FastText in one. The article explains the existence of a multitude of hyperparameters and defines their values, selection of effective ways of text processing, the use of some non-standard parameters in Natural Language Processing (NLP), the characteristics of the corpora used, the results of the pairs (DL model, similarity measure) processing corpora, and tries to determine combinations of conditions under which use of exactly certain pairs yields the best results (presented in the article), measured by standard evaluation measures Accuracy, Precision, Recall and primarily F-measure.

Paper Citation

in Harvard Style

Vrbanec T. and Meštrović A. (2021). Relevance of Similarity Measures Usage for Paraphrase Detection. In Proceedings of the 13th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management (IC3K 2021) - Volume 1: KDIR; ISBN 978-989-758-533-3, SciTePress, pages 129-138. DOI: 10.5220/0010649800003064

in Bibtex Style

@conference{kdir21,
author={Tedo Vrbanec and Ana Meštrović},
title={Relevance of Similarity Measures Usage for Paraphrase Detection},
booktitle={Proceedings of the 13th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management (IC3K 2021) - Volume 1: KDIR},
year={2021},
pages={129-138},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010649800003064},
isbn={978-989-758-533-3},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 13th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management (IC3K 2021) - Volume 1: KDIR
TI - Relevance of Similarity Measures Usage for Paraphrase Detection
SN - 978-989-758-533-3
AU - Vrbanec T.
AU - Meštrović A.
PY - 2021
SP - 129
EP - 138
DO - 10.5220/0010649800003064
PB - SciTePress