Article Per Year (5 Year)
p-Index From 2019 - 2024
0.23
P-Index
This Author published in this journals
All Journal Indonesian Journal of Information System
Sesilia Shania
Unknown Affiliation
Computer Science & IT

Published : 1 Documents Claim Missing Document
Claim Missing Document
Check
Articles

Found 1 Documents
Search

 1 
Translator of Indonesian Sign Language Video using Convolutional Neural Network with Transfer Learning Sesilia Shania; Mohammad Farid Naufal; Vincentius Riandaru Prasetyo; Mohd Sanusi Bin Azmi
Indonesian Journal of Information Systems Vol. 5 No. 1 (2022): August 2022
Publisher : Program Studi Sistem Informasi Universitas Atma Jaya Yogyakarta

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.24002/ijis.v5i1.5865

Abstract

Sign language is a language used to communicate by utilizing gestures and facial expressions. This study focuses on classification of Bahasa Isyarat Indonesia (BISINDO). There are still many people who have difficulty communicating with the deaf people. This study builds video-based translator system using Convolutional Neural Network (CNN) with transfer learning which is commonly used in computer vision especially in image classification. Transfer learning used in this study are a MobileNetV2, ResNet50V2, and Xception. This study uses 11 different commonly used vocabularies in BISINDO. Predictions will be made in real-time scenario using a webcam. In addition, the system given good results in the experiment with an interaction approach between one pair of deaf and normal people. From all the experiments, it was found that the Xception architectures has the best F1 Score of 98.5%.
Co-Authors Mohammad Farid Naufal, Mohammad Farid Mohd Sanusi Bin Azmi Vincentius Riandaru Prasetyo