An Effective Method to Answer Multi-hop Questions by Single-hop QA System

Kong Yuntao, Nguyen Phuong, Teeradaj Racharak, Tung Le, Nguyen Minh

2022

Abstract

Multi-hop question answering (QA) requires a model to aggregate information from multiple paragraphs to predict the answer. Recent research on multi-hop QA has attempted this task by utilizing graph neural networks (GNNs) with sophisticated graph structures. While such models can achieve good performance, their computation is rather expensive. In this paper, we explore an alternative method that leverages a single-hop QA model to deal with multi-hop questions. Our system called ‘Answer Multi-hop questions by Single-hop QA’ (AMS) consists of three main parts that first filter a document and then conduct prediction using the attention-based single-hop QA model with multi-task learning. Specifically, AMS is constructed based on the co-attention and self-attention architecture. Lastly, consider that BERT-based model is pre-trained in a general domain and the data distribution can be different from multi-hop QA task. We propose two-step tuning mechanism to enhance the model’s performance, which is based on transfer learning from other QA datasets. To verify AMS effectiveness, we consider the previous state-of-the-art Hierarchical Graph Network (HGN) with the same document filter as our baseline. Experiments on HotpotQA show that AMS can outperform HGN by 1.78 points and 0.56 points for Joint EM and Joint F1, respectively. Meanwhile, it has smaller model’s size and uses less computational resource. We also experiment with other GNN-based models and achieve better results.

Paper Citation

in Harvard Style

Yuntao K., Phuong N., Racharak T., Le T. and Minh N. (2022). An Effective Method to Answer Multi-hop Questions by Single-hop QA System. In Proceedings of the 14th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART, ISBN 978-989-758-547-0, pages 244-253. DOI: 10.5220/0010824200003116

in Bibtex Style

@conference{icaart22,
author={Kong Yuntao and Nguyen Phuong and Teeradaj Racharak and Tung Le and Nguyen Minh},
title={An Effective Method to Answer Multi-hop Questions by Single-hop QA System},
booktitle={Proceedings of the 14th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART,},
year={2022},
pages={244-253},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010824200003116},
isbn={978-989-758-547-0},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 14th International Conference on Agents and Artificial Intelligence - Volume 2: ICAART,
TI - An Effective Method to Answer Multi-hop Questions by Single-hop QA System
SN - 978-989-758-547-0
AU - Yuntao K.
AU - Phuong N.
AU - Racharak T.
AU - Le T.
AU - Minh N.
PY - 2022
SP - 244
EP - 253
DO - 10.5220/0010824200003116