Jurnal Teknik Informatika (JUTIF)
Vol. 4 No. 6 (2023): JUTIF Volume 4, Number 6, Desember 2023

PERFORMANCE OF TEXT SIMILARITY ALGORITHMS FOR ESSAY ANSWER SCORING IN ONLINE EXAMINATIONS

Muhammad Riza Radyaka Susanto (Faculty of Informatics Engineering, Universitas Muhammadiyah Surakarta, Indonesia)
Husni Thamrin (Faculty of Informatics Engineering, Universitas Muhammadiyah Surakarta, Indonesia)
Naufal Azmi Verdikha (Faculty of Informatics Engineering, Universitas Muhammadiyah Kalimantan Timur, Indonesia)



Article Info

Publish Date
23 Dec 2023

Abstract

The purpose of assessment is to determine learning success. Exams with question descriptions have several advantages, including ease of preparation and the ability to reveal student comprehension and originality. The problem with space is that it takes time to fix. Therefore, it is important to develop algorithms and software that automatically evaluate space. With the help of this algorithm and this software, you can solve some exam and assessment problems. This study aims to investigate similarity algorithms that approximate human patterns in evaluating ambiguous answers. This study examines his five similarity algorithms, including TF-IDF and LSA. The data was a collection of correct answers with a total of 371 texts. The similarity algorithm's performance was compared with human correction results. Evaluation was performed using Root Mean Square Error (RMSE). This study shows that his TF-IDF algorithm like Jaccard has the lowest his RMSE compared to human judgement. However, the LSA algorithm tended better to follow human rating patterns for descriptive tests..

Copyrights © 2023






Journal Info

Abbrev

jurnal

Publisher

Subject

Computer Science & IT

Description

Jurnal Teknik Informatika (JUTIF) is an Indonesian national journal, publishes high-quality research papers in the broad field of Informatics, Information Systems and Computer Science, which encompasses software engineering, information system development, computer systems, computer network, ...