Journal of Technology and Informatics (JoTI)
Vol. 5 No. 1 (2023): Vol. 5 No.1 (2023)

Indonesian Sign Language (SIBI) Learning Media Application Based on Deep Learning Technology for Deaf Children

Martianda Anggraeni (Politeknik Elektronika Negeri Surabaya)
Harum Andhika F. R. (Politeknik Elektronika Negeri Surabaya)
Hestiasari Rante (Politeknik Elektronika Negeri Surabaya)
Sritrusta Sukaridhoto (Politeknik Elektronika Negeri Surabaya)



Article Info

Publish Date
24 Oct 2023

Abstract

One of the main methods in teaching deaf children effectively is through visualization of learning materials. Previous research has developed augmented reality-based interactive learning media for deaf children. However, these learning media have limitations related to smartphone memory, dependence on certain flashcards, and limited amount of material due to flashcard limitations. Here, researchers innovate to develop SIBI learning media applications based on deep learning technology that material does not depend on a specific flashcard, but the application is able to detect real objects and various images. TensorFlow Lite is considered lighter but still allows the system to run deep learning on mobile devices with low latency. This application is designed to capture a real object or image through the camera, then the object or image will be processed and recognized using TensorFlow Lite. The object recognition process is carried out at the classification layer using switch-case syntax and global class synchronization with the YouTube API. After the image or object is recognized, the system will issue an output in the form of an Indonesian sign language video link from the object.

Copyrights © 2023






Journal Info

Abbrev

joti

Publisher

Subject

Computer Science & IT Control & Systems Engineering Electrical & Electronics Engineering Engineering Mechanical Engineering

Description

1. Teknologi Informasi : Rekayasaperangkat lunak, Pengetahuan data maining, Mobile Computing, Parallel/Distributed Computing, Kecerdasan Buatan, Tata Kelola dan Manajemen Sistem Informasi, User Interface/ User Experience, Process Management, IT Security, IS Adoption and Evaluation. 2. Sistem ...