Jurnal Informatika Kesatuan
Vol 1 No 1 (2021): JIKES Edisi Agustus 2021

Real-time BISINDO Hand Gesture Detection and Recognition with Deep Learning CNN

Febri Damatraseta (Institut Bisnis dan Informatika Kesatuan)
Rani Novariany (Institut Bisnis dan Informatika Kesatuan)
Muhammad Adlan Ridhani (Institut Bisnis dan Informatika Kesatuan)



Article Info

Publish Date
13 Jul 2021

Abstract

BISINDO is one of Indonesian sign language, which do not have many facilities to implement. Because it can cause deaf people have difficulty to live their daily life. Therefore, this research tries to offer an recognition or translation system of the BISINDO alphabet into a text. The system is expected to help deaf people to communicate in two directions. In this study the problems encountered is small datasets. Therefore this research will do the testing of hand gesture recognition, by comparing two model CNN algorithms, that is LeNet-5 and Alexnet. This test will look for which classification technique is better if the dataset conditions in an amount that does not reach 1000 images in each class. After testing, the results found that the CNN technique on the Alexnet architectural model is better to used, this is because when doing the testing process by using still-image and Alexnet model data which has been released in training process, Alexnet model data gives greater prediction results that is equal to 76%. While the LeNet model is only able to predict with the percentage of 19%. When that Alexnet data model used on the system offered, only able to predict correcly by 60%. Keywords: Sign language, BISINDO, Computer Vision, Hand Gesture Recognition, Skin Segmentation, CIELab, Deep Learning, CNN.

Copyrights © 2021






Journal Info

Abbrev

jikes

Publisher

Subject

Computer Science & IT Languange, Linguistic, Communication & Media Library & Information Science

Description

Jurnal Informatika Kesatuan diterbitkan dan dikelola oleh Fakultas Informatika dan Pariwisata bekerjasama dengan LPPM IBI Kesatuan. Jurnal Informatika Kesatuan merupakan media ilmiah yang independen bagi para Dosen dan Peneliti di bidang ilmu Informatika. Terbit dua kali dalam setahun, pada bulan ...