Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi)
Vol 5 No 3 (2021): Juni 2021

Analisis Perbandingan Algoritma Klasifikasi MLP dan CNN pada Dataset American Sign Language

Mohammad Farid Naufal (Universitas Surabaya)
Sesilia Shania (Universitas Surabaya)
Jessica Millenia (Universitas Surabaya)
Stefan Axel (Universitas Surabaya)
Juan Timothy Soebroto (Universitas Surabaya)
Rizka Febrina P. (Universitas Surabaya)
Mirella Mercifia (Universitas Surabaya)



Article Info

Publish Date
19 Jun 2021

Abstract

People who have hearing loss (deafness) or speech impairment (hearing impairment) usually use sign language to communicate. One of the most basic and flexible sign languages ​​is the Alphabet Sign Language to spell out the words you want to pronounce. Sign language uses hand, finger, and face movements to speak the user's thoughts. However, for alphabetical sign language, facial expressions are not used but only gestures or symbols formed using fingers and hands. In fact, there are still many people who don't understand the meaning of sign language. The use of image classification can help people more easily learn and translate sign language. Image classification accuracy is the main problem in this case. This research conducted a comparison of image classification algorithms, namely Convolutional Neural Network (CNN) and Multilayer Perceptron (MLP) to recognize American Sign Language (ASL) except the letters "J" and "Z" because movement is required for both. This is done to see the effect of the convolution and pooling stages on CNN on the resulting accuracy value and F1 Score in the ASL dataset. Based on the comparison, the use of CNN which begins with Gaussian Low Pass Filtering preprocessing gets the best accuracy of 96.93% and F1 Score 96.97%

Copyrights © 2021






Journal Info

Abbrev

RESTI

Publisher

Subject

Computer Science & IT Engineering

Description

Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi) dimaksudkan sebagai media kajian ilmiah hasil penelitian, pemikiran dan kajian analisis-kritis mengenai penelitian Rekayasa Sistem, Teknik Informatika/Teknologi Informasi, Manajemen Informatika dan Sistem Informasi. Sebagai bagian dari semangat ...