Proceeding of the Electrical Engineering Computer Science and Informatics
Vol 7, No 1: EECSI 2020

Dynamic Hand Gesture Recognition Using Temporal-Stream Convolutional Neural Networks

Fladio Armandika (Universitas Jenderal Achmad Yani)
Esmeralda Contessa Djamal (Universitas Jenderal Achmad Yani)
Fikri Nugraha (Universitas Jenderal Achmad Yani)
Fatan Kasyidi (Universitas Jenderal Achmad Yani)



Article Info

Publish Date
23 Nov 2020

Abstract

Movement recognition is a hot issue in machine learning. The gesture recognition is related to video processing, which gives problems in various aspects. Some of them are separating the image against the background firmly. This problem has consequences when there are incredibly different settings from the training data. The next challenge is the number of images processed at a time that forms motion. Previous studies have conducted experiments on the Deep Convolutional Neural Network architecture to detect actions on sequential model balancing each other on frames and motion between frames. The challenge of identifying objects in a temporal video image is the number of parameters needed to do a simple video classification so that the estimated motion of the object in each picture frame is needed. This paper proposed the classification of hand movement patterns with the Single Stream Temporal Convolutional Neural Networks approach. This model was robust against extreme non-training data, giving an accuracy of up to 81,7%. The model used a 50 layers ResNet architecture with recorded video training.

Copyrights © 2020






Journal Info

Abbrev

EECSI

Publisher

Subject

Computer Science & IT Electrical & Electronics Engineering

Description

Proceeding of the Electrical Engineering Computer Science and Informatics publishes papers of the "International Conference on Electrical Engineering Computer Science and Informatics (EECSI)" Series in high technical standard. The Proceeding is aimed to bring researchers, academicians, scientists, ...