International Journal of Evaluation and Research in Education (IJERE)
Vol 13, No 3: June 2024

Which one is more accurate, BILOG or R program? (a comparison for score test equating)

Dian Normalitasari Purnama (Universitas Negeri Yogyakarta)
Samsul Hadi (Universitas Negeri Yogyakarta)
Sukirno Sukirno (Universitas Negeri Yogyakarta)
Heri Retnawati (Universitas Negeri Yogyakarta)
Rizki Nor Amelia (Universitas Negeri Semarang)



Article Info

Publish Date
01 Jun 2024

Abstract

Evaluation may be carried out using different tests that are not necessarily parallel. Students with lower abilities may get higher scores while those with higher abilities get lower scores. Measurement errors caused by this condition require test equating. Several computer programs, including Bilog and the R program, can be used for test equating. Each program has a different level of accuracy, and the accuracy of the equating results will affect the standard errors of equating. This study aimed to find out the most accurate equating test method and the accuracy of the estimated BILOG and R program. This research used two sets of tests with equivalent group designs. The determination of the most accurate equating method was based on the root mean square deviation (RMSD) value. Equating test packages, A to package B with BILOG program estimation on the mean and Sigma method resulted in RMSD value of 0.320. In the mean and mean method, RMSD value is 0.250. Meanwhile, equating package A to package B using R program on the mean and sigma resulted in RMSD value of 0.300, and the mean and mean method with the RMSD value is 0.272. The mean and mean yield RMSD values smaller than the mean and sigma methods. Therefore, the mean and mean method is more accurate and applicable. Moreover, the estimation results of the BILOG program are more accurate and can be used in test equating.

Copyrights © 2024






Journal Info

Abbrev

IJERE

Publisher

Subject

Education

Description

The International Journal of Evaluation and Research in Education (IJERE) is an interdisciplinary publication of original research and writing on education which publishes papers to international audiences of educational researchers. The IJERE aims to provide a forum for scholarly understanding of ...