Natural Language-based User Guidance for Knowledge Graph Exploration: A User Study

Hans Friedrich Witschel, Kaspar Riesen, Loris Grether

2021

Abstract

Large knowledge graphs hold the promise of helping knowledge workers in their tasks by answering simple and complex questions in specialised domains. However, searching and exploring knowledge graphs in current practice still requires knowledge of certain query languages such as SPARQL or Cypher, which many untrained end users do not possess. Approaches for more user-friendly exploration have been proposed and range from natural language querying over visual cues up to query-by-example mechanisms, often enhanced with recommendation mechanisms offering guidance. We observe, however, a lack of user studies indicating which of these approaches lead to a better user experience and optimal exploration outcomes. In this work, we make a step towards closing this gap by conducting a qualitative user study with a system that relies on formulating queries in natural language and providing answers in the form of subgraph visualisations. Our system is able to offer guidance via query recommendations based on a current context. The user study evaluates the impact of this guidance in terms of both efficiency and effectiveness (recall) of user sessions. We find that both aspects are improved, especially since query recommendations provide inspiration, leading to a larger number of insights discovered in roughly the same time.

Paper Citation

in Harvard Style

Witschel H., Riesen K. and Grether L. (2021). Natural Language-based User Guidance for Knowledge Graph Exploration: A User Study. In Proceedings of the 13th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management (IC3K 2021) - Volume 1: KDIR; ISBN 978-989-758-533-3, SciTePress, pages 95-102. DOI: 10.5220/0010640500003064

in Bibtex Style

@conference{kdir21,
author={Hans Friedrich Witschel and Kaspar Riesen and Loris Grether},
title={Natural Language-based User Guidance for Knowledge Graph Exploration: A User Study},
booktitle={Proceedings of the 13th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management (IC3K 2021) - Volume 1: KDIR},
year={2021},
pages={95-102},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010640500003064},
isbn={978-989-758-533-3},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 13th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management (IC3K 2021) - Volume 1: KDIR
TI - Natural Language-based User Guidance for Knowledge Graph Exploration: A User Study
SN - 978-989-758-533-3
AU - Witschel H.
AU - Riesen K.
AU - Grether L.
PY - 2021
SP - 95
EP - 102
DO - 10.5220/0010640500003064
PB - SciTePress