Towards Elderly Social Integration using a Multimodal Human-computer Interface

Vítor Teixeira, Carlos Pires, Fernando Pinto, João Freitas, Miguel Sales Dias, Eduarda Mendes Rodrigues

2012

Abstract

This paper presents a multimodal prototype application that aims to promote the social integration of the elderly. The application enables communication with their social network through conferencing and social media services, using natural interaction modalities, like speech, touch and gestures. We begin by discussing the requirements and design guidelines that were taken into account for the development of the prototype. We also present the key elements of the development stage and the results of a usability study conducted with ten elderly volunteers. The usability study reveals that such a multimodal solution can simplify accessibility to the considered services. Results indicate that this system is simpler, more natural and more enjoyable than the current user interfaces. Furthermore, the natural interaction modalities of the proposed prototype, allow elderly to be more efficient and have a better user experience, thus contributing with an easier and faster way for this population to join the information era.

References

  1. Cisek, E. and Triche, K. (2005). Depression and Social Support Among Older Adult Computer Users, August 18, 2005, 113th Annual Convention of the American Psychological Assoc.
  2. D'Andrea, A., D'Ulizia A., Ferri, F. and Grifoni, P., (2009). A multimodal pervasive framework for ambient assisted living. New York, NY, USA, PETRA 7809: Proceedings of the 2nd International Conference on PErvsive Technologies Related to Assistive Environments.
  3. Dix, A., Finlay, J., Abowd, G.D. and Beale, R. (2003). Human-Computer Interaction (3rd ed.). Essex: Prentice Hall
  4. Europe's Information Society (2010). e-Inclusion Visited July 14, 2011, at http://ec.europa.eu/information_society/activities/einclusion/index_en.htm
  5. European Commission (2010), Europe in figures - Eurostat yearbook 2010, Retrieved July 10, 2011, from http://epp.eurostat.ec.europa.eu/portal/page/portal/product_details/ publication?p_product_code=KS-CD-10-220
  6. Facebook (2011), Press Room - statistics, Visited July 15, 2011, at http:// www.facebook.com/ press/info.php?statistics
  7. Júdice, A., Freitas, J., Braga, D., Calado, A., Dias, M.S., Teixeira, A., Oliveira, C. (2010). Elderly Speech Collection for Speech Recognition Based on Crowd Sourcing. In Gnanayutham, P., Paredes, H., Rekanos, I. T. (Eds), Proceedings of DSAI2010 International Conference (pp. 103-110).
  8. LUL, Lab Living Usability Lab for Next Generation Networks, www.livinglab.pt, visited July 15, 2011
  9. Makover, M.E., Zieve, D., (2011), Arthritis - Joint inflammation, visited July 15, 2011, at http://www.ncbi.nlm.nih.gov/pubmedhealth/PMH0002223/
  10. Oviatt, S. (2001). Designing robust multimodal systems for universal access, Proceedings of the 2001 EC/NSF workshop on Universal accessibility of ubiquitous computing: providing for the elderly event report. p. 71-74.
  11. Oviatt S., Cohen, P., Wu, L., Vergo, J., Duncan, L., Suhm B., Bers, B., Holzman, T., Winograd, T., Landay. J., Larson, J., and Ferro, D. (2000). Designing the user interface for multimodal speech and pen-based gesture applications: state-of-the-art systems and future research directions. Hum.-Comput. Interact. 15, 4 (December 2000)
  12. Pew Internet & American Life (2006), Are Wired Seniors Sitting Ducks?, Retrieved July 10, 2011, from: http://www.pewinternet.org/Reports/2006/Are-Wired-Seniors-SittingDucks.aspx
  13. Pires, C., Pinto, F., Rodrigues, E. M. and Dias, M. S. (2011). On the benefits of speech and touch interaction with communication services for mobility impaired users. 28-29 January, 2011, Rome, Italy, 1st International Living Usability Lab Workshop on AAL Latest Solutions, Trends and Applications - AAL 2011
  14. Preece, J., Rogers, Y. and Sharp, H. (2002). Interaction Design: Beyond Human-Computer Interaction. Wiley, First edition.
  15. Quillen, D.A., (1999). Common Causes of Vision Loss in Elderly Patients, Retrieved July 10, 2011, from: http://www.aafp.org/afp/990700ap/99.html
  16. Richter, K. and Hellenschmidt, M. (2004) Interacting with the ambience: Multimodal interaction and ambient intelligence. France, W3C Workshop on Multi-modal Interaction
  17. Salces, F.J.S.d., D. England, and D. Llewellyn-Jones (2005). Designing for all in the house. CLIHC 7805: 2005 Latin American conference on HCI. 2005. p. 283-288.
  18. Sfyrakis, S.A., Stephanidis, C., Akoumianakis D., Sfyrakis M., Paramythis A. and Crete H. (1998). Universal accessibility in HCI: Process-oriented design guidelines and tool requirements. 4th ERCIM Workshop on "User Interfaces for All". p. 19-21.
Download


Paper Citation


in Harvard Style

Teixeira V., Pires C., Pinto F., Freitas J., Sales Dias M. and Mendes Rodrigues E. (2012). Towards Elderly Social Integration using a Multimodal Human-computer Interface . In Proceedings of the 2nd International Living Usability Lab Workshop on AAL Latest Solutions, Trends and Applications - Volume 1: AAL, (BIOSTEC 2012) ISBN 978-989-8425-93-5, pages 3-13. DOI: 10.5220/0003852800030013


in Bibtex Style

@conference{aal12,
author={Vítor Teixeira and Carlos Pires and Fernando Pinto and João Freitas and Miguel Sales Dias and Eduarda Mendes Rodrigues},
title={Towards Elderly Social Integration using a Multimodal Human-computer Interface},
booktitle={Proceedings of the 2nd International Living Usability Lab Workshop on AAL Latest Solutions, Trends and Applications - Volume 1: AAL, (BIOSTEC 2012)},
year={2012},
pages={3-13},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003852800030013},
isbn={978-989-8425-93-5},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 2nd International Living Usability Lab Workshop on AAL Latest Solutions, Trends and Applications - Volume 1: AAL, (BIOSTEC 2012)
TI - Towards Elderly Social Integration using a Multimodal Human-computer Interface
SN - 978-989-8425-93-5
AU - Teixeira V.
AU - Pires C.
AU - Pinto F.
AU - Freitas J.
AU - Sales Dias M.
AU - Mendes Rodrigues E.
PY - 2012
SP - 3
EP - 13
DO - 10.5220/0003852800030013