Design of Multimodal Interaction with Mobile Devices - Challenges for Visually Impaired and Elderly Users

Michela Ferron, Nadia Mana, Ornella Mich, Christopher Reeves

2018

Abstract

This paper presents two early studies aimed at investigating issues concerning the design of multimodal interaction - based on voice commands and mid-air gestures - with mobile technology specifically designed for visually impaired and elderly users. These studies have been carried out on a new device allowing enhanced speech recognition (interpreting lip movements) and mid-air gesture interaction on Android devices (smartphone and tablet PC). The initial findings and challenges raised by these novel interaction modalities are discussed. These mainly centre on issues of feedback and feedforward, the avoidance of false positives and point of reference or orientation issues regarding the device and the mid-air gestures.

Paper Citation

in Harvard Style

Ferron M., Mana N., Mich O. and Reeves C. (2018). Design of Multimodal Interaction with Mobile Devices - Challenges for Visually Impaired and Elderly Users. In Proceedings of the 13th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2018) - Volume 3: HUCAPP; ISBN 978-989-758-288-2, SciTePress, pages 140-146. DOI: 10.5220/0006638901400146

in Bibtex Style

@conference{hucapp18,
author={Michela Ferron and Nadia Mana and Ornella Mich and Christopher Reeves},
title={Design of Multimodal Interaction with Mobile Devices - Challenges for Visually Impaired and Elderly Users},
booktitle={Proceedings of the 13th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2018) - Volume 3: HUCAPP},
year={2018},
pages={140-146},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006638901400146},
isbn={978-989-758-288-2},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 13th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2018) - Volume 3: HUCAPP
TI - Design of Multimodal Interaction with Mobile Devices - Challenges for Visually Impaired and Elderly Users
SN - 978-989-758-288-2
AU - Ferron M.
AU - Mana N.
AU - Mich O.
AU - Reeves C.
PY - 2018
SP - 140
EP - 146
DO - 10.5220/0006638901400146
PB - SciTePress