IJCCS (Indonesian Journal of Computing and Cybernetics Systems)
Vol 15, No 3 (2021): July

Transfer Learning of Pre-trained Transformers for Covid-19 Hoax Detection in Indonesian Language

Lya Hulliyyatus Suadaa (Politeknik Statistika STIS)
Ibnu Santoso (Politeknik Statistika STIS)
Amanda Tabitha Bulan Panjaitan (Politeknik Statistika STIS)



Article Info

Publish Date
31 Jul 2021

Abstract

Nowadays, internet has become the most popular source of news. However, the validity of the online news articles is difficult to assess, whether it is a fact or a hoax. Hoaxes related to Covid-19 brought a problematic effect to human life. An accurate hoax detection system is important to filter abundant information on the internet.  In this research, a Covid-19 hoax detection system was proposed by transfer learning of pre-trained transformer models. Fine-tuned original pre-trained BERT, multilingual pre-trained mBERT, and monolingual pre-trained IndoBERT were used to solve the classification task in the hoax detection system. Based on the experimental results, fine-tuned IndoBERT models trained on monolingual Indonesian corpus outperform fine-tuned original and multilingual BERT with uncased versions. However, the fine-tuned mBERT cased model trained on a larger corpus achieved the best performance.

Copyrights © 2021






Journal Info

Abbrev

ijccs

Publisher

Subject

Computer Science & IT Control & Systems Engineering

Description

Indonesian Journal of Computing and Cybernetics Systems (IJCCS), a two times annually provides a forum for the full range of scholarly study . IJCCS focuses on advanced computational intelligence, including the synergetic integration of neural networks, fuzzy logic and eveolutionary computation, so ...