A MOBILE CONVERSATION ASSISTANT TO ENHANCE COMMUNICATIONS FOR HEARING-IMPAIRED CHILDREN

Toon De Pessemier, Laurens Van Acker, Emilie Van Dijck, Karin Slegers, Wout Joseph, Luc Martens

Abstract

Children and young people who are deaf or have hearing impairments do not master the spoken and written language well. Moreover, their friends and relatives do not always speak sign language. In this research, a communication aid is developed on the Google Android mobile operating system to reduce these barriers by converting text into relevant images and movies thereby clarifying the meaning of the text. Users can select text from webpages, e-mail and SMS messages, or text can be generated using speech recognition or optical character recognition as input source. The communication tool analyzes the sentences and tries to understand the context and meaning of the text in order to select the most appropriate visual content originating from online sources like YouTube, Flickr, Google Images, and Vimeo. User tests and focus groups with deaf children and interviews with experts in the field of deaf and hard hearing people confirmed the need for a communication aid and proved the utility of the proposed tool.

References

  1. Brière, M. (1995). Consultation sur les technologies de l'information: Résultats de sondage auprès des organismes et des personnes sourdes et malentendantes. Centre Québécois de la deficience auditive. Médias Adaptés Communications, Montréal.
  2. Dubuisson, C. and Daigle, D. (1998). Lecture, écriture et surditeé: visions actuelles et nouvelles perspectives. Ó ditions Logiques, Outremont, QC.
  3. Fortnum, H., Marshall, D., Bamford, J., and Summerfield, A. (2002). Hearing-impaired children in the uk: education setting and communication approach. Deafness and Education International, 4(3):123-141.
  4. Frog (2011). Dutch morpho-syntactic analyzer and dependency parser. Available at http://ilk.uvt.nl/frog/ .
  5. Hotton, M. (2004). Le comité sur les nouvelles technologies en d'éficience auditive de l'i.r.d.p.q.: projet de recherche sur les appareils de télécommunications pour les personnes sourdes et malentendantes. Différences, Magazine de l'Institut de réadaptation en déficience physique de Québec, 5:32-38.
  6. Johnston, T. A. (2006). W(h)ither the deaf community? population, genetics, and the future of australian sign language. Sign Language Studies, 6(2):137-173.
  7. Opentaal (2011). Welkom bij OpenTaal. Available at http:// www.opentaal.org/.
  8. Oralys (2011). Mobile Communicator. Available at http:// www.oralys.ca/en/solutions/talk/mobile communicator.htm.
  9. Sorrell, C. A., Bell, S. M., and McCallum, R. S. (2007). Reading rate and comprehension as a function of computerized versus traditional presentation mode: A preliminary study. Journal of Special Education Technology, 22(1):1-12.
  10. Vincent, C., Deaudelin, I., and Hotton, M. (2007). Pilot on evaluating social participation following the use of an assistive technology designed to facilitate faceto-face communication between deaf and hearing persons. Technology and Disability, 19(4):153-167.
  11. WiseTREND (2011). Online OCR API Guide. Available at http://www.wisetrend.com/WiseTREND Online OCR API v2.0.htm.
Download


Paper Citation


in Harvard Style

De Pessemier T., Van Acker L., Van Dijck E., Slegers K., Joseph W. and Martens L. (2012). A MOBILE CONVERSATION ASSISTANT TO ENHANCE COMMUNICATIONS FOR HEARING-IMPAIRED CHILDREN . In Proceedings of the 8th International Conference on Web Information Systems and Technologies - Volume 1: WEBIST, ISBN 978-989-8565-08-2, pages 775-780. DOI: 10.5220/0003934607750780


in Bibtex Style

@conference{webist12,
author={Toon De Pessemier and Laurens Van Acker and Emilie Van Dijck and Karin Slegers and Wout Joseph and Luc Martens},
title={A MOBILE CONVERSATION ASSISTANT TO ENHANCE COMMUNICATIONS FOR HEARING-IMPAIRED CHILDREN},
booktitle={Proceedings of the 8th International Conference on Web Information Systems and Technologies - Volume 1: WEBIST,},
year={2012},
pages={775-780},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003934607750780},
isbn={978-989-8565-08-2},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 8th International Conference on Web Information Systems and Technologies - Volume 1: WEBIST,
TI - A MOBILE CONVERSATION ASSISTANT TO ENHANCE COMMUNICATIONS FOR HEARING-IMPAIRED CHILDREN
SN - 978-989-8565-08-2
AU - De Pessemier T.
AU - Van Acker L.
AU - Van Dijck E.
AU - Slegers K.
AU - Joseph W.
AU - Martens L.
PY - 2012
SP - 775
EP - 780
DO - 10.5220/0003934607750780