Paper Unlock

Authors: Paula Escudeiro 1 ; Nuno Escudeiro 2 ; Marcelo Norberto 1 ; Jorge Lopes 1 and Fernando Soares 1

Affiliations: 1 Instituto Superior de Engenharia do Porto, GILT – Games and Interaction and Learning Technologies, Portugal ; 2 Instituto Superior de Engenharia do Porto and INESC TEC - Laboratory of Artificial Intelligence and Decision Support, Portugal

ISBN: 978-989-758-246-2

Keyword(s): Sign Language, Blind, Deaf, Kinect, Sensor Gloves, Translator.

Related Ontology Subjects/Areas/Topics: Multimedia and User Interfaces ; Web Information Systems and Technologies ; Web Interfaces and Applications

Abstract: The communication with the deaf community can prove to be very challenging without the use of sign language. There is a considerable difference between sign and written language as they differ in both syntax and semantics. The work described in this paper addresses the development of a bidirectional translator between several sign languages and their respective text, as well as the evaluation methods and results of those tools. A multiplayer game is using the translator is also described on this paper. The translator from sign language to text employs two devices, namely the Microsoft Kinect and 5DT Sensor Gloves in order to gather data about the motion and shape of the hands. This translator is being adapted to allow the communication with the blind as well. The Quantitative Evaluation Framework (QEF) and the ten-fold cross-validation methods were used to evaluate the project and show promising results. Also, the product goes through a validation process by sign language experts and deaf users who provide their feedback answering a questionnaire. The translator exhibits a precision higher than 90% and the projects overall quality rates are close to 90% based on the QEF. (More)

PDF ImageFull Text


Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Escudeiro, P.; Escudeiro, N.; Norberto, M.; Lopes, J. and Soares, F. (2017). Digital Assisted Communication.In Proceedings of the 13th International Conference on Web Information Systems and Technologies - Volume 1: WEBIST, ISBN 978-989-758-246-2, pages 395-402. DOI: 10.5220/0006377903950402

author={Paula Escudeiro. and Nuno Escudeiro. and Marcelo Norberto. and Jorge Lopes. and Fernando Soares.},
title={Digital Assisted Communication},
booktitle={Proceedings of the 13th International Conference on Web Information Systems and Technologies - Volume 1: WEBIST,},


JO - Proceedings of the 13th International Conference on Web Information Systems and Technologies - Volume 1: WEBIST,
TI - Digital Assisted Communication
SN - 978-989-758-246-2
AU - Escudeiro, P.
AU - Escudeiro, N.
AU - Norberto, M.
AU - Lopes, J.
AU - Soares, F.
PY - 2017
SP - 395
EP - 402
DO - 10.5220/0006377903950402

Login or register to post comments.

Comments on this Paper: Be the first to review this paper.