Interpretability in Word Sense Disambiguation using Tsetlin Machine

Rohan Yadav, Lei Jiao, Ole-Christoffer Granmo, Morten Goodwin

2021

Abstract

Word Sense Disambiguation (WSD) is a longstanding unresolved task in Natural Language Processing. The challenge lies in the fact that words with the same spelling can have completely different senses, sometimes depending on subtle characteristics of the context. A weakness of the state-of-the-art supervised models, however, is that it can be difficult to interpret them, making it harder to check if they capture senses accurately or not. In this paper, we introduce a novel Tsetlin Machine (TM) based supervised model that distinguishes word senses by means of conjunctive clauses. The clauses are formulated based on contextual cues, represented in propositional logic. Our experiments on CoarseWSD-balanced dataset indicate that the learned word senses can be relatively effortlessly interpreted by analyzing the converged model of the TM. Additionally, the classification accuracy is higher than that of FastText-Base and similar to that of FastText-CommonCrawl.

Paper Citation

in Harvard Style

Yadav R., Jiao L., Granmo O. and Goodwin M. (2021). Interpretability in Word Sense Disambiguation using Tsetlin Machine.In Proceedings of the 13th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART, ISBN 978-989-758-484-8, pages 402-409. DOI: 10.5220/0010382104020409

in Bibtex Style

@conference{icaart21,
author={Rohan Yadav and Lei Jiao and Ole-Christoffer Granmo and Morten Goodwin},
title={Interpretability in Word Sense Disambiguation using Tsetlin Machine},
booktitle={Proceedings of the 13th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART,},
year={2021},
pages={402-409},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010382104020409},
isbn={978-989-758-484-8},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 13th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART,
TI - Interpretability in Word Sense Disambiguation using Tsetlin Machine
SN - 978-989-758-484-8
AU - Yadav R.
AU - Jiao L.
AU - Granmo O.
AU - Goodwin M.
PY - 2021
SP - 402
EP - 409
DO - 10.5220/0010382104020409