Wearable RGB Camera-based Navigation System for the Visually Impaired

Reham Abobeah, Mohamed Hussein, Moataz Abdelwahab, Amin Shoukry

2018

Abstract

This paper proposes a wearable RGB camera-based system for sightless people through which they can easily and independently navigate their surrounding environment. The system uses a single head or chest mounted RGB camera to capture the visual information from the current user’s path, and an auditory system to inform the user about the right direction to follow. This information is obtained through a novel alignment technique which takes as input a visual snippet from the current user’s path and responds with the corresponding location on the training path. Then, assuming that the wearable camera pose reflects the user’s pose, the system corrects the current user’s pose to align with the corresponding pose in the training location. As a result, the user receives periodically an acoustic instruction to assist him in reaching his destination safely. The experiments conducted to test the system, in various collected indoor and outdoor paths, have shown that it satisfies its design specifications in terms of correctly generating the instructions for guiding the visually impaired along these paths, in addition to its ability to detect and correct deviations from the predefined paths.

Paper Citation

in Harvard Style

Abobeah R., Hussein M., Abdelwahab M. and Shoukry A. (2018). Wearable RGB Camera-based Navigation System for the Visually Impaired. In Proceedings of the 13th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2018) - Volume 5: VISAPP; ISBN 978-989-758-290-5, SciTePress, pages 555-562. DOI: 10.5220/0006617505550562

in Bibtex Style

@conference{visapp18,
author={Reham Abobeah and Mohamed Hussein and Moataz Abdelwahab and Amin Shoukry},
title={Wearable RGB Camera-based Navigation System for the Visually Impaired},
booktitle={Proceedings of the 13th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2018) - Volume 5: VISAPP},
year={2018},
pages={555-562},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006617505550562},
isbn={978-989-758-290-5},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 13th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2018) - Volume 5: VISAPP
TI - Wearable RGB Camera-based Navigation System for the Visually Impaired
SN - 978-989-758-290-5
AU - Abobeah R.
AU - Hussein M.
AU - Abdelwahab M.
AU - Shoukry A.
PY - 2018
SP - 555
EP - 562
DO - 10.5220/0006617505550562
PB - SciTePress