A Comparative Study between Possibilistic and Probabilistic Approaches for Query Translation Disambiguation

Wiem Ben Romdhane, Bilel Elayeb, Narjès Ben Saoud

2019

Abstract

We propose in this paper a new hybrid possibilistic query translation disambiguation approach combining a probability-to-possibility transformation-based approach with a discriminative possibilistic one in order to take advantage of their strengths. The disambiguation process in this approach requires a bilingual lexicon and a parallel text corpus. Given a source query terms, the first step consists of selecting the existing noun phrases (NPs) and the remaining single terms which are not included in any NPs. We have translated these identified NPs as units through the probability-to-possibility transformation-based approach, as a mean to introduce further tolerance, using a language model and translation patterns. Then, the remaining single source query terms are translated via the discriminative possibilistic approach. We have modelled in this step the translation relevance of a given single source query term via two measures: the possible relevance excludes irrelevant translations, while the necessary relevance reinforces the translations not removed by the possibility. We have developed a set of experiments using the CLEF-2003 French-English CLIR test collection and the French-English parallel text corpus Europarl. The reported results highlight some statistically significant improvements of the hybrid possibilistic approach in the CLIR effectiveness using diverse evaluation metrics and scenarios for both long and short queries.

Paper Citation

in Harvard Style

Ben Romdhane W., Elayeb B. and Ben Saoud N. (2019). A Comparative Study between Possibilistic and Probabilistic Approaches for Query Translation Disambiguation.In Proceedings of the 11th International Conference on Agents and Artificial Intelligence - Volume 2: NLPinAI, ISBN 978-989-758-350-6, pages 932-943. DOI: 10.5220/0007697209320943

in Bibtex Style

@conference{nlpinai19,
author={Wiem Ben Romdhane and Bilel Elayeb and Narjès Ben Saoud},
title={A Comparative Study between Possibilistic and Probabilistic Approaches for Query Translation Disambiguation},
booktitle={Proceedings of the 11th International Conference on Agents and Artificial Intelligence - Volume 2: NLPinAI,},
year={2019},
pages={932-943},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0007697209320943},
isbn={978-989-758-350-6},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 11th International Conference on Agents and Artificial Intelligence - Volume 2: NLPinAI,
TI - A Comparative Study between Possibilistic and Probabilistic Approaches for Query Translation Disambiguation
SN - 978-989-758-350-6
AU - Ben Romdhane W.
AU - Elayeb B.
AU - Ben Saoud N.
PY - 2019
SP - 932
EP - 943
DO - 10.5220/0007697209320943