Journal of Information Technology and Computer Engineering
Vol 7 No 01 (2023): Journal of Information Technology and Computer Engineering

Hand Gesture to Control Virtual Keyboard using Neural Network

Arrya Anandika (Universitas Andalas)
Muhammad Ilhamdi Rusydi (Universitas Andalas)
Pepi Putri Utami (Universitas Andalas)
Rizka Hadelina (Universitas Andalas)
Minoru Sasaki (Unknown)



Article Info

Publish Date
31 Mar 2023

Abstract

Disability is one of a person's physical and mental conditions that can inhibit normal daily activities. One of the disabilities that can be found in disability is speech without fingers. Persons with disabilities have obstacles in communicating with people around both verbally and in writing. Communication tools to help people with disabilities without finger fingers continue to be developed, one of them is by creating a virtual keyboard using a Leap Motion sensor. The hand gestures are captured using the Leap Motion sensor so that the direction of the hand gesture in the form of pitch, yaw, and roll is obtained. The direction values are grouped into normal, right, left, up, down, and rotating gestures to control the virtual keyboard. The amount of data used for gesture recognition in this study was 5400 data consisting of 3780 training data and 1620 test data. The results of data testing conducted using the Artificial Neural Network method obtained an accuracy value of 98.82%. This study also performed a virtual keyboard performance test directly by typing 20 types of characters conducted by 15 respondents three times. The average time needed by respondents in typing is 5.45 seconds per character.

Copyrights © 2023






Journal Info

Abbrev

JITCE

Publisher

Subject

Computer Science & IT Control & Systems Engineering Electrical & Electronics Engineering Engineering

Description

Journal of Information Technology and Computer Engineering (JITCE) is a scholarly periodical. JITCE will publish research papers, technical papers, conceptual papers, and case study reports. This journal is organized by Computer System Department at Universitas Andalas, Padang, West Sumatra, ...