loading
Papers Papers/2022 Papers Papers/2022

Research.Publish.Connect.

Paper

Paper Unlock

Authors: Paula Escudeiro 1 ; Nuno Escudeiro 1 ; Rosa Reis 1 ; Pedro Rodrigues 1 ; Jorge Lopes 1 ; Marcelo Norberto 1 ; Ana Bela Baltasar 1 ; Maciel Barbosa 2 and José Bidarra 3

Affiliations: 1 Instituto Superior de Engenharia do Porto, Portugal ; 2 Faculdade de Engenharia da Universidade do Porto, Portugal ; 3 Universidade Aberta, Portugal

Keyword(s): Portuguese Sign Language, Education, Deaf, Kinect, Sensor Gloves, Translator, Machine Learning, OpenCv, Support Vector Machines, Dynamic Time Warping, Avatar, Serious Games.

Related Ontology Subjects/Areas/Topics: Multimedia and User Interfaces ; Web Information Systems and Technologies ; Web Interfaces and Applications

Abstract: The communication with deaf by means of written text is not as efficient as it might seem. In fact, there is a very deep gap between sign language and spoken/written language. The deployment of tools to assist the daily communication between deaf people and the rest may be a significant contribution to the social inclusion of the deaf community. The work described in this paper addresses the development of a bidirectional translator between Portuguese Sign Language and Portuguese text and a serious game to promote the learning of the Portuguese Sign Language. The translator from sign language to text employs two devices, namely the Microsoft Kinect and 5DT Sensor Gloves in order to gather data about the motion and shape of the hands. The hands configurations are classified using Support Vector Machines. The classification of the movement and orientation of the hands is achieved through the use of Dynamic Time Warping algorithm. The translator exhibits a precision higher than 90%. In the other direction, the translation of Portuguese text to Portuguese Sign Language is supported by a 3D avatar which interprets the entered text and performs the corresponding animations. As a complement, we also present a serious game directed to assist in the difficult task of learning the Portuguese Sign Language. (More)

CC BY-NC-ND 4.0

Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 18.209.66.87

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Escudeiro, P.; Escudeiro, N.; Reis, R.; Rodrigues, P.; Lopes, J.; Norberto, M.; Baltasar, A.; Barbosa, M. and Bidarra, J. (2015). Real Time Bidirectional Translator of Portuguese Sign Language. In Proceedings of the 11th International Conference on Web Information Systems and Technologies - WEBIST; ISBN 978-989-758-106-9; ISSN 2184-3252, SciTePress, pages 203-213. DOI: 10.5220/0005448502030213

@conference{webist15,
author={Paula Escudeiro. and Nuno Escudeiro. and Rosa Reis. and Pedro Rodrigues. and Jorge Lopes. and Marcelo Norberto. and Ana Bela Baltasar. and Maciel Barbosa. and José Bidarra.},
title={Real Time Bidirectional Translator of Portuguese Sign Language},
booktitle={Proceedings of the 11th International Conference on Web Information Systems and Technologies - WEBIST},
year={2015},
pages={203-213},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005448502030213},
isbn={978-989-758-106-9},
issn={2184-3252},
}

TY - CONF

JO - Proceedings of the 11th International Conference on Web Information Systems and Technologies - WEBIST
TI - Real Time Bidirectional Translator of Portuguese Sign Language
SN - 978-989-758-106-9
IS - 2184-3252
AU - Escudeiro, P.
AU - Escudeiro, N.
AU - Reis, R.
AU - Rodrigues, P.
AU - Lopes, J.
AU - Norberto, M.
AU - Baltasar, A.
AU - Barbosa, M.
AU - Bidarra, J.
PY - 2015
SP - 203
EP - 213
DO - 10.5220/0005448502030213
PB - SciTePress