Journal of Soft Computing Exploration
Vol. 5 No. 2 (2024): June 2024

Comparison of the performance of naive bayes and support vector machine in sirekap sentiment analysis with the lexicon-based approach

Ramadhana Setiyawan (Universitas Negeri Yogyakarta, Indonesia)
Zaenal Mustofa (Universitas Negeri Yogyakarta, Indonesia)



Article Info

Publish Date
10 Jun 2024

Abstract

The general public often uses the SiRekap application to see the progress of the election and to provide critical statements. Policies made by the government have good and bad outcomes, and users end up leaving their reviews and ratings on the Google Play Store, where the app can be downloaded. These reviews can be collected and processed into useful information such as sentiment analysis using Naïve Bayes and Support Vector Machine methods. Both methods have differences during training and during evaluation. The difference in results from the various scenarios tested was not much different. When training the Support Vector Machine model is able to process comment data labeled with a lexicon 10% better than the Naïve Bayes model by looking at the results of the accuracy of the two models. During the accuracy evaluation process, the two models produce the same accuracy of 72%. Although both models get the same accuracy during the evaluation process, there are differences in precision, recall, and f1 score. The difference is that the Support Vector Machine model is 5% better for precision, 8% for recall, and 3% for f1-score compared to the Naïve Bayes model. This research is limited to only knowing the performance of two machine learning models, namely the use of naive bayes and svm by using a label lexicon. The results obtained can be improved for the better. Improving the evaluation results can be done by adding data or using text data augmentation and there is creation from experts related to language sentiment.

Copyrights © 2024






Journal Info

Abbrev

joscex

Publisher

Subject

Computer Science & IT

Description

Journal of Soft Computing Exploration is a journal that publishes manuscripts of scientific research papers related to soft computing. The scope of research can be from the theory and scientific applications as well as the novelty of related knowledge insights. Soft Computing: Artificial ...