Real Time Indonesian Sign Language Hand Gesture Phonology Translation Using Deep Learning Model

Denny Pribadi, Mochamad Wahyudi, Diah Puspitasari, Agung Wibowo, Rizal Amegia Saputra, Rofi Saefurrohman

2023

Abstract

In the era of Society 5.0, technology and computerization are almost applied to everything in this world. The advance- ment of computers is increasingly sophisticated, presenting so many software that helps a lot of human activities. Such as the image recognition feature that can be used to recognize and read sign language. The shape of the hand being sign language is a feature of phonology because the meaning of each sign can be distinguished according to the shape and gesture of the hand. SIBI (Indonesian Sign System) became the official language to be taught in extraordinary schools (SLB). In this study, the introduction of the A-Z alphabet as a SIBI sign language became the research material as the target language of translation applied to the application. The algorithms used are Deep Learning Convolutional Neural Network (CNN) and the Hand Gesture Recognition method, the training process in data processing experiments using 50 and 100 epoch experiments with a batch size of sixteen and a speed of 0.001 with a total of twenty-six classes. The resulting model is applied to build applications that can be used to detect and classify hand gestures on SIBI, resulting in outputs in the form of alphabetical and SIBI vocabulary. Researchers have previously conducted studies with a smaller number of classes. The results of the experiment on the application that has been built have a fast response time and have a higher accuracy rate than the earlier study, which was 85.3%.

Paper Citation

in Harvard Style

Pribadi D., Wahyudi M., Puspitasari D., Wibowo A., Amegia Saputra R. and Saefurrohman R. (2023). Real Time Indonesian Sign Language Hand Gesture Phonology Translation Using Deep Learning Model. In Proceedings of the 3rd International Conference on Advanced Information Scientific Development - Volume 1: ICAISD; ISBN 978-989-758-678-1, SciTePress, pages 172-176. DOI: 10.5220/0012446000003848

in Bibtex Style

@conference{icaisd23,
author={Denny Pribadi and Mochamad Wahyudi and Diah Puspitasari and Agung Wibowo and Rizal Amegia Saputra and Rofi Saefurrohman},
title={Real Time Indonesian Sign Language Hand Gesture Phonology Translation Using Deep Learning Model},
booktitle={Proceedings of the 3rd International Conference on Advanced Information Scientific Development - Volume 1: ICAISD},
year={2023},
pages={172-176},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0012446000003848},
isbn={978-989-758-678-1},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 3rd International Conference on Advanced Information Scientific Development - Volume 1: ICAISD
TI - Real Time Indonesian Sign Language Hand Gesture Phonology Translation Using Deep Learning Model
SN - 978-989-758-678-1
AU - Pribadi D.
AU - Wahyudi M.
AU - Puspitasari D.
AU - Wibowo A.
AU - Amegia Saputra R.
AU - Saefurrohman R.
PY - 2023
SP - 172
EP - 176
DO - 10.5220/0012446000003848
PB - SciTePress