World-Map Misalignment Detection for Visual Navigation Systems

Rosario Forte, Michele Mazzamuto, Michele Mazzamuto, Francesco Ragusa, Francesco Ragusa, Giovanni Farinella, Giovanni Farinella, Antonino Furnari, Antonino Furnari

2024

Abstract

We consider the problem of inferring when the internal map of an indoor navigation system is misaligned with respect to the real world (world-map misalignment), which can lead to misleading directions given to the user. We note that world-map misalignment can be predicted from an RGB image of the environment and the floor segmentation mask obtained from the internal map of the navigation system. Since collecting and labelling large amounts of real data is expensive, we developed a tool to simulate human navigation, which is used to generate automatically labelled synthetic data from 3D models of environments. Thanks to this tool, we generate a dataset considering 15 different environments, which is complemented by a small set of videos acquired in a real-world scenario and manually labelled for validation purposes. We hence benchmark an approach based on different ResNet18 configurations and compare their results on both synthetic and real images. We achieved an F1 score of 92.37% in the synthetic domain and 75.42% on the proposed real dataset using our best approach. While the results are promising, we also note that the proposed problem is challenging, due to the domain shift between synthetic and real data, and the difficulty in acquiring real data. The dataset and the developed tool are publicly available to encourage research on the topic at the following URL: https://github.com/fpv-iplab/WMM-detection-for-visual-navigation-systems.

Paper Citation

in Harvard Style

Forte R., Mazzamuto M., Ragusa F., Farinella G. and Furnari A. (2024). World-Map Misalignment Detection for Visual Navigation Systems. In Proceedings of the 19th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP; ISBN 978-989-758-679-8, SciTePress, pages 324-332. DOI: 10.5220/0012410400003660

in Bibtex Style

@conference{visapp24,
author={Rosario Forte and Michele Mazzamuto and Francesco Ragusa and Giovanni Farinella and Antonino Furnari},
title={World-Map Misalignment Detection for Visual Navigation Systems},
booktitle={Proceedings of the 19th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP},
year={2024},
pages={324-332},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0012410400003660},
isbn={978-989-758-679-8},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 19th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP
TI - World-Map Misalignment Detection for Visual Navigation Systems
SN - 978-989-758-679-8
AU - Forte R.
AU - Mazzamuto M.
AU - Ragusa F.
AU - Farinella G.
AU - Furnari A.
PY - 2024
SP - 324
EP - 332
DO - 10.5220/0012410400003660
PB - SciTePress