Using Abstraction Graphs to Promote Exploration in Curiosity-Inspired Intrinsic Motivation

Mahtab Mohtasham Khani, Kathryn Kasmarik, Shadi Abpeikar, Michael Barlow

2023

Abstract

This paper proposes a new approach to modelling IM using abstraction graphs to create a novel curiosity model. An abstraction graph can model the topology of a physical environment in a manner that is not captured by typical curiosity models that use self-organising or adaptive resonance theory networks. We hypothesise that this can permit more systematic exploration and skill development in a motivated reinforcement learning setting. To evaluate the proposed model, we have compared our agent’s behaviour with an existing curiosity model in the same environment and the same configuration. For this evaluation, we examined each agent’s behaviour at different life stages and characterised the exploration and attention focus of each agent in each life stage. We concluded the best uses of each approach.

Paper Citation

in Harvard Style

Mohtasham Khani M., Kasmarik K., Abpeikar S. and Barlow M. (2023). Using Abstraction Graphs to Promote Exploration in Curiosity-Inspired Intrinsic Motivation. In Proceedings of the 15th International Joint Conference on Computational Intelligence - Volume 1: NCTA; ISBN 978-989-758-674-3, SciTePress, pages 505-513. DOI: 10.5220/0012181400003595

in Bibtex Style

@conference{ncta23,
author={Mahtab Mohtasham Khani and Kathryn Kasmarik and Shadi Abpeikar and Michael Barlow},
title={Using Abstraction Graphs to Promote Exploration in Curiosity-Inspired Intrinsic Motivation},
booktitle={Proceedings of the 15th International Joint Conference on Computational Intelligence - Volume 1: NCTA},
year={2023},
pages={505-513},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0012181400003595},
isbn={978-989-758-674-3},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 15th International Joint Conference on Computational Intelligence - Volume 1: NCTA
TI - Using Abstraction Graphs to Promote Exploration in Curiosity-Inspired Intrinsic Motivation
SN - 978-989-758-674-3
AU - Mohtasham Khani M.
AU - Kasmarik K.
AU - Abpeikar S.
AU - Barlow M.
PY - 2023
SP - 505
EP - 513
DO - 10.5220/0012181400003595
PB - SciTePress