JUTI: Jurnal Ilmiah Teknologi Informasi
Vol 15, No. 1, Januari 2017

ALPHABET SIGN LANGUAGE RECOGNITION USING LEAP MOTION TECHNOLOGY AND RULE BASED BACKPROPAGATION-GENETIC ALGORITHM NEURAL NETWORK (RBBPGANN)

Khotimah, Wijayanti Nurul (Department of Informatics, Institut Teknologi Sepuluh Nopember)
Saputra, Risal Andika (Department of Informatics, Institut Teknologi Sepuluh Nopember)
Suciati, Nanik (Department of Informatics, Institut Teknologi Sepuluh Nopember)
Hariadi, Ridho Rahman (Department of Informatics, Institut Teknologi Sepuluh Nopember)



Article Info

Publish Date
01 Jan 2017

Abstract

Sign Language recognition was used to help people with normal hearing communicate effectively with the deaf and hearing-impaired. Based on survey that conducted by Multi-Center Study in Southeast Asia, Indonesia was on the top four position in number of patients with hearing disability (4.6%). Therefore, the existence of Sign Language recognition is important. Some research has been conducted on this field. Many neural network types had been used for recognizing many kinds of sign languages. However, their performance are need to be improved. This work focuses on the ASL (Alphabet Sign Language) in SIBI (Sign System of Indonesian Language) which uses one hand and 26 gestures. Here, thirty four features were extracted by using Leap Motion. Further, a new method, Rule Based-Backpropagation Genetic Al-gorithm Neural Network (RB-BPGANN), was used to recognize these Sign Languages. This method is combination of Rule and Back Propagation Neural Network (BPGANN). Based on experiment this pro-posed application can recognize Sign Language up to 93.8% accuracy. It was very good to recognize large multiclass instance and can be solution of overfitting problem in Neural Network algorithm.

Copyrights © 2017