Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi)
Vol 7 No 1 (2023): February 2023

Comparison of Sentiment Analysis Methods Based on Accuracy Value Case Study: Twitter Mentions of Academic Article

Muhamad Fahmi Fakhrezi (Universitas Diponegoro)
Adian Fatchur Rochim (Universitas Diponegoro)
Dinar Mutiara Kusomo Nugraheni (Universitas Diponegoro)



Article Info

Publish Date
05 Feb 2023

Abstract

The assessment of academic articles is based on the number of citations, but the number only is not enough. So now there is Altmetric which can measure the impact of academic articles from the number of citations and using social media, usually Twitter. Still, the number of mentions on Twitter is not enough because the expressions of the sentences vary. Mentions must be classified according to neutral, positive, and negative criteria. Sentiment analysis is performed on tweets to measure social media volume and attention related to research findings from academic articles. There are many sentiment analysis methods, so this study aims to compare sentiment analysis methods using Decision Tree, K-NN, Naïve Bayes, and Random Forest to get the most suitable methods. The evaluation method in this study uses the Confusion Matrix by searching for Accuracy, Precision, and Recall values. The results show that the most suitable sentiment analysis method is Naïve Bayes by obtaining the highest classification suitability value of the other methods, which has an actual positive sentiment value of neutral 2056, positive 1200, and negative 1292. In addition, Naïve Bayes gets the highest accuracy score of 95, 45%.

Copyrights © 2023






Journal Info

Abbrev

RESTI

Publisher

Subject

Computer Science & IT Engineering

Description

Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi) dimaksudkan sebagai media kajian ilmiah hasil penelitian, pemikiran dan kajian analisis-kritis mengenai penelitian Rekayasa Sistem, Teknik Informatika/Teknologi Informasi, Manajemen Informatika dan Sistem Informasi. Sebagai bagian dari semangat ...