Authors:
Domenico Amalfitano
;
Vincenzo D’Angelo
;
Antonio M. Rinaldi
and
Cristiano Russo
Affiliation:
Department of Electrical Engineering and Information Technology University of Naples Federico II, Via Claudio, 21, Naples 80125, Italy
Keyword(s):
Gesture Recognition, Sign Language, Deep Learning, Real-Time Translation, Accessibility.
Abstract:
Gesture recognition systems have gained popularity as an effective means of communication, leveraging the simplicity and effectiveness of gestures. With the absence of a universal sign language due to regional variations and limited dissemination in schools and media, there is a need for real-time translation systems to bridge the communication gap. The proposed system aims to translate American Sign Language (ASL), the predominant sign language used by deaf communities in real-time in North America, West Africa, and Southeast Asia. The system utilizes SSD Mobilenet FPN architecture, known for its real-time performance on low-power devices, and leverages transfer learning techniques for efficient training. Data augmentation and preprocessing procedures are applied to improve the quality of training data. The system’s detection capability is enhanced by adapting color space conversions, such as RGB to YCbCr and HSV, to improve the segmentation for varying lighting conditions. Experime
ntal results demonstrate the system’s Accessibility and non-invasiveness, achieving high accuracy in recognizing ASL signs.
(More)