Proceeding of the Electrical Engineering Computer Science and Informatics
Vol 7, No 1: EECSI 2020

Hand Movement Identification Using Single-Stream Spatial Convolutional Neural Networks

Aldi Sidik Permana (Universitas Jenderal Achmad Yani)
Esmeralda Contessa Djamal (Universitas Jenderal Achmad Yani)
Fikri Nugraha (Universitas Jenderal Achmad Yani)
Fatan Kasyidi (Universitas Jenderal Achmad Yani)



Article Info

Publish Date
23 Nov 2020

Abstract

Human-robot interaction can be through several ways, such as through device control, sounds, brain, and body, or hand gesture. There are two main issues: the ability to adapt to extreme settings and the number of frames processed concerning memory capabilities. Although it is necessary to be careful with the selection of the number of frames so as not to burden the memory, this paper proposed identifying hand gesture of video using Spatial Convolutional Neural Networks (CNN). The sequential image's spatial arrangement is extracted from the frames contained in the video so that each frame can be identified as part of one of the hand movements. The research used VGG16, as CNN architecture is concerned with the depth of learning where there are 13 layers of convolution and three layers of identification. Hand gestures can only be identified into four movements, namely 'right', 'left', 'grab', and 'phone'. Hand gesture identification on the video using Spatial CNN with an initial accuracy of 87.97%, then the second training increased to 98.05%. Accuracy was obtained after training using 5600 training data and 1120 test data, and the improvement occurred after manual noise reduction was performed.

Copyrights © 2020






Journal Info

Abbrev

EECSI

Publisher

Subject

Computer Science & IT Electrical & Electronics Engineering

Description

Proceeding of the Electrical Engineering Computer Science and Informatics publishes papers of the "International Conference on Electrical Engineering Computer Science and Informatics (EECSI)" Series in high technical standard. The Proceeding is aimed to bring researchers, academicians, scientists, ...