Scientific Journal of Informatics
Vol 10, No 2 (2023): May 2023

Automatic Scoring Using Term Frequency Inverse Document Frequency Document Frequency and Cosine Similarity

Winda Yulita (Department of Informatics Engineering, Institut Teknologi Sumatera, Indonesia)
Meida Cahyo Untoro (Department of Informatics Engineering, Institut Teknologi Sumatera, Indonesia)
Mugi Praseptiawan (Department of Informatics Engineering, Institut Teknologi Sumatera, Indonesia)
Ilham Firman Ashari (Department of Informatics Engineering, Institut Teknologi Sumatera, Indonesia)
Aidil Afriansyah (Department of Informatics Engineering, Institut Teknologi Sumatera, Indonesia)
Ahmad Naim Bin Che Pee (Faculty of Information and Communication Technology, Universiti Teknikal Malaysia Melaka, Malaysia)



Article Info

Publish Date
20 Apr 2023

Abstract

Purpose: In the learning process, most of the tests to assess learning achievement have been carried out by providing questions in the form of short answers or essay questions. The variety of answers given by students makes a teacher have to focus on reading them. This scoring process is difficult to guarantee quality if done manually. In addition, each class is taught by a different teacher, which can lead to unequal grades obtained by students due to the influence of differences in teacher experience. Therefore the purpose of this study is to develop an assessment of the answers. Automated short answer scoring is designed to automatically grade and evaluate students' answers based on a series of trained answer documents.Methods: This is ‘how’ you did it. Let readers know exactly what you did to reach your results. For example, did you undertake interviews? Did you carry out an experiment in the lab? What tools, methods, protocols or datasets did you use The method used is TF-IDF-DF and Similarity and scoring computation.  Theword weight used is the term Frequency-Inverse Documents Frequency -Document Frequency (TF-IDF-DF) method. The data used is 5 questions with each question answered by 30 students, while the students' answers are assessed by teachers/experts to determine the real score. The study was evaluated by Mean Absolute Error (MAE).Result: The evaluation results obtained Mean Absolute Error (MAE) with a resulting value of 0.123.Value: The word weighting method used is the Term Frequency Inverse Document Frequency DocumentFrequency (TF-IDF-DF) which is an improvement over the Term Frequency Inverse Document Frequency (TF-IDF) method. This method is a method of weighting words that will be applied before calculating the similarity of sentences between teachers and students.

Copyrights © 2023






Journal Info

Abbrev

SJI

Publisher

Subject

Computer Science & IT

Description

Scientific Journal of Informatics published by the Department of Computer Science, Semarang State University, a scientific journal of Information Systems and Information Technology which includes scholarly writings on pure research and applied research in the field of information systems and ...