Toward Crowdsourced Knowledge Graph Construction: Interleaving Collection and Verification of Triples

Helun Bu, Kazuhiro Kuwabara

2022

Abstract

This paper presents a method for building a knowledge graph using crowdsourcing. The collection and verification of pieces of knowledge are essential components of building a high-quality knowledge graph. We introduce fill-in-the-blank-type of quizzes to collect knowledge as triples and true-or-false-type quizzes to verify the collected triples. We also present score functions to evaluate and select a quiz for efficient knowledge graph construction based on the workers’ past inputs. The collection and verification processes are dynamically interleaved using weights in the score function. Simulation results show that the proposed approach can collect and verify distributed knowledge among casual workers.

Download


Paper Citation


in Harvard Style

Bu H. and Kuwabara K. (2022). Toward Crowdsourced Knowledge Graph Construction: Interleaving Collection and Verification of Triples. In Proceedings of the 14th International Conference on Agents and Artificial Intelligence - Volume 1: ICAART, ISBN 978-989-758-547-0, pages 375-382. DOI: 10.5220/0010902700003116


in Bibtex Style

@conference{icaart22,
author={Helun Bu and Kazuhiro Kuwabara},
title={Toward Crowdsourced Knowledge Graph Construction: Interleaving Collection and Verification of Triples},
booktitle={Proceedings of the 14th International Conference on Agents and Artificial Intelligence - Volume 1: ICAART,},
year={2022},
pages={375-382},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010902700003116},
isbn={978-989-758-547-0},
}


in EndNote Style

TY - CONF

JO - Proceedings of the 14th International Conference on Agents and Artificial Intelligence - Volume 1: ICAART,
TI - Toward Crowdsourced Knowledge Graph Construction: Interleaving Collection and Verification of Triples
SN - 978-989-758-547-0
AU - Bu H.
AU - Kuwabara K.
PY - 2022
SP - 375
EP - 382
DO - 10.5220/0010902700003116