Authors:
Jacobus C. Lock
;
Grzegorz Cielniak
and
Nicola Bellotto
Affiliation:
Lincoln Centre for Autonomous Systems (L-CAS), University of Lincoln, Lincoln and U.K.
Keyword(s):
Active Vision, Object Search, Visual Impairment, Markov Decision Process.
Related
Ontology
Subjects/Areas/Topics:
Active and Robot Vision
;
Applications and Services
;
Computer Vision, Visualization and Computer Graphics
;
Enterprise Information Systems
;
Human and Computer Interaction
;
Human-Computer Interaction
;
Motion, Tracking and Stereo Vision
Abstract:
Modern smartphones can provide a multitude of services to assist people with visual impairments, and their cameras in particular can be useful for assisting with tasks, such as reading signs or searching for objects in unknown environments. Previous research has looked at ways to solve these problems by processing the camera’s video feed, but very little work has been done in actively guiding the user towards specific points of interest, maximising the effectiveness of the underlying visual algorithms. In this paper, we propose a control algorithm based on a Markov Decision Process that uses a smartphone’s camera to generate real-time instructions to guide a user towards a target object. The solution is part of a more general active vision application for people with visual impairments. An initial implementation of the system on a smartphone was experimentally evaluated with participants with healthy eyesight to determine the performance of the control algorithm. The results show the
effectiveness of our solution and its potential application to help people with visual impairments find objects in unknown environments.
(More)