A Haptic Interface for Guiding People with Visual Impairment using Three Dimensional Computer Vision

Kevin Swingler, Chris Grigson

2022

Abstract

Computer vision technology has the potential to provide life changing assistance to blind or visually impaired (BVI) people. This paper presents a technique for locating objects in three dimensions and guiding a person’s hand to the object. Computer vision algorithms are used to locate both objects of interest and the user’s hand. Their relative locations are used to calculate the movement required to take the hand closer to the object. The required direction is signaled to the user via a haptic wrist band, which consists of four haptic motors worn at the four compass points on the wrist. Guidance works both in two and three dimensions, making use of both colour and depth map inputs from a camera. User testing found that people were able to follow the haptic instructions and move their hand to locations on vertical or horizontal surfaces. This work is part of the Artificial Intelligence Sight Loss Assistant (AISLA) project.

Paper Citation

in Harvard Style

Swingler K. and Grigson C. (2022). A Haptic Interface for Guiding People with Visual Impairment using Three Dimensional Computer Vision. In Proceedings of the 14th International Joint Conference on Computational Intelligence (IJCCI 2022) - Volume 1: NCTA; ISBN 978-989-758-611-8, SciTePress, pages 315-322. DOI: 10.5220/0011307800003332

in Bibtex Style

@conference{ncta22,
author={Kevin Swingler and Chris Grigson},
title={A Haptic Interface for Guiding People with Visual Impairment using Three Dimensional Computer Vision},
booktitle={Proceedings of the 14th International Joint Conference on Computational Intelligence (IJCCI 2022) - Volume 1: NCTA},
year={2022},
pages={315-322},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0011307800003332},
isbn={978-989-758-611-8},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 14th International Joint Conference on Computational Intelligence (IJCCI 2022) - Volume 1: NCTA
TI - A Haptic Interface for Guiding People with Visual Impairment using Three Dimensional Computer Vision
SN - 978-989-758-611-8
AU - Swingler K.
AU - Grigson C.
PY - 2022
SP - 315
EP - 322
DO - 10.5220/0011307800003332
PB - SciTePress