Hierarchical Relation Networks: Exploiting Categorical Structure in Neural Relational Reasoning

Ruomu Zou, Constantine Dovrolis

2021

Abstract

Organizing objects in the world into conceptual hierarchies is a key part of human cognition and general intelligence. It allows us to efficiently reason about complex and novel situations relying on relationships between object categories and hierarchies. Learning relationships among sets of objects from data is known as relation learning. Recent developments in this area using neural networks have enabled answering complex questions posed on sets of objects. Previous approaches operate directly on objects – instead of categories of objects. In this position paper, we make the case for reasoning at the level of object categories, and we propose the Hierarchical Relation Network (HRN) framework. HRNs first infer a category for each object to drastically decrease the number of relationships that need to be learned. An HRN consists of a number of distinct modules, each of which can be initialized as a simple arithmetic operation, a supervised or unsupervised model, or as part of a fully differentiable network. This approach demonstrates that categories in relational reasoning can allow for major reductions in training time, increased data efficiency, and better interpretability of the network’s reasoning process.

Paper Citation

in Harvard Style

Zou R. and Dovrolis C. (2021). Hierarchical Relation Networks: Exploiting Categorical Structure in Neural Relational Reasoning. In Proceedings of the 13th International Joint Conference on Computational Intelligence (IJCCI 2021) - Volume 1: NCTA; ISBN 978-989-758-534-0, SciTePress, pages 359-365. DOI: 10.5220/0010690500003063

in Bibtex Style

@conference{ncta21,
author={Ruomu Zou and Constantine Dovrolis},
title={Hierarchical Relation Networks: Exploiting Categorical Structure in Neural Relational Reasoning},
booktitle={Proceedings of the 13th International Joint Conference on Computational Intelligence (IJCCI 2021) - Volume 1: NCTA},
year={2021},
pages={359-365},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010690500003063},
isbn={978-989-758-534-0},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 13th International Joint Conference on Computational Intelligence (IJCCI 2021) - Volume 1: NCTA
TI - Hierarchical Relation Networks: Exploiting Categorical Structure in Neural Relational Reasoning
SN - 978-989-758-534-0
AU - Zou R.
AU - Dovrolis C.
PY - 2021
SP - 359
EP - 365
DO - 10.5220/0010690500003063
PB - SciTePress