Bulletin of Electrical Engineering and Informatics
Vol 9, No 2: April 2020

Recognition of sign language hand gestures using leap motion sensor based on threshold and ANN models

Muhammad Ilhamdi Rusydi (Universitas Andalas)
Syafii Syafii (Universitas Andalas)
Rizka Hadelina (Universitas Andalas)
Elmiyasna Kimin (Sekolah Tinggi Ilmu Kesehatan Mercubaktijaya)
Agung W. Setiawan (Bandung Institute of Technology)
Andrivo Rusydi (National University of Singapore)



Article Info

Publish Date
01 Apr 2020

Abstract

Hand gesture recognition is a topic that is still investigated by many scientists for numerous useful aspects. This research investigated hand gestures for sign language number zero to nine. The hand gesture recognition was based on finger direction patterns. The finger directions were detected by a Leap Motion Controller. Finger direction pattern modeling was based on two methods: threshold and artificial neural network. Threshold model 1 contained 15 rules based on the range of finger directions on each axis. Threshold model 2 was developed from model 1 based on the behavior of finger movements when the subject performed hand gestures. The ANN model of the system was designed with four neurons at the output layer, 15 neurons at the input layer, seven neurons at the first hidden layer and 5 neurons at the second hidden layer. The artificial neural network used the logsig as the activation function. The result shows that the first threshold model has the lowest accuracy because the rule is too complicated and rigid. The threshold model 2 can improve the threshold model, but it still needs development to reach better accuracy. The ANN model gave the best result among the developed model with 98% accuracy. LMC produces useful biometric data for hand gesture recognition.

Copyrights © 2020






Journal Info

Abbrev

EEI

Publisher

Subject

Electrical & Electronics Engineering

Description

Bulletin of Electrical Engineering and Informatics (Buletin Teknik Elektro dan Informatika) ISSN: 2089-3191, e-ISSN: 2302-9285 is open to submission from scholars and experts in the wide areas of electrical, electronics, instrumentation, control, telecommunication and computer engineering from the ...