Article Per Year (5 Year)
p-Index From 2019 - 2024
1.037
P-Index
This Author published in this journals
All Journal REiD (Research and Evaluation in Education) Jurnal Tadris Matematika Psychology, Evaluation, and Technology in Educational Research Jurnal Kependidikan: Jurnal Hasil Penelitian dan Kajian Kepustakaan di Bidang Pendidikan, Pengajaran dan Pembelajaran
Ibnu Rafi
Universitas Negeri Yogyakarta
Computer Science & IT Education Languange, Linguistic, Communication & Media Mathematics Social Sciences Other

Published : 5 Documents Claim Missing Document
Claim Missing Document
Check
Articles

Found 2 Documents
Search
Journal : REiD (Research and Evaluation in Education)

 1 
The effect of scoring correction and model fit on the estimation of ability parameter and person fit on polytomous item response theory Agus Santoso; Timbul Pardede; Hasan Djidu; Ezi Apino; Ibnu Rafi; Munaya Nikma Rosyada; Harris Shah Abd Hamid
REID (Research and Evaluation in Education) Vol 8, No 2 (2022)
Publisher : Sekolah Pascasarjana Universitas Negeri Yogyakarta & HEPI

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.21831/reid.v8i2.54429

Abstract

Scoring quality has been recognized as one of the important aspects that should be of concern to both test developers and users. This study aimed to investigate the effect of scoring correction and model fit on the estimation of ability parameters and person fit in the polytomous item response theory. The result of 165 students in the Statistics course (SATS4410) test at one of the universities in Indonesia was used to answer the problems in this study. The polytomous data obtained from scoring the test results were analyzed using the Item Response Theory (IRT) approach with the Partial Credit Model (PCM), Graded Response Model (GRM), and Generalized Partial Credit Model (GPCM). The effect of scoring correction and model fit on the estimation of ability and person fit was tested using multivariate analysis. Among the three models used, GRM showed the best fit based on p-value and RSMEA. The results of the analysis also showed that there was no significant effect of scoring correction and model fit on the estimation of the test taker’s ability and person fit. From the results of this study, we recommend the importance of evaluating the levels or categories used in scoring student work on a test.
Gaining a deeper understanding of the meaning of the carelessness parameter in the 4PL IRT model and strategies for estimating it Timbul Pardede; Agus Santoso; Diki Diki; Heri Retnawati; Ibnu Rafi; Ezi Apino; Munaya Nikma Rosyada
REID (Research and Evaluation in Education) Vol 9, No 1 (2023)
Publisher : Sekolah Pascasarjana Universitas Negeri Yogyakarta & HEPI

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.21831/reid.v9i1.63230

Abstract

Three popular models are used to describe the characteristics of the test items and estimate the ability of examinees under the dichotomous IRT model, namely the one-, two-, and three-parameter logistic models. The three-item parameters are discriminating power, difficulty, and pseudo-guessing. In the development of the dichotomous IRT model, carelessness or upper asymptote parameter was proposed, which forms a four-parameter logistic (4PL) model to accommodate a condition where a high-ability examinee gives an incorrect response to a test item when he/she should be able to respond to the test item correctly. However, the carelessness parameter and the 4PL model have not been widely accepted and used due to several factors, and people’s understanding of that parameter and strategies for estimating it is still inadequate. Therefore, this study aims to shed light on ideas underlying the 4PL model, the meaning of the carelessness parameter, and strategies used to estimate that parameter based on the extant literature. The focus of this study was then extended to demonstrating practical examples of estimating item and person parameters using the 4PL model using empirical data on responses of 1,000 students from the Indonesia Open University (Universitas Terbuka) on 21 of 30 multiple-choice items on the Business English test, a paper-and-pencil test. We mainly analyzed empirical data using the ‘mirt’ package in RStudio. We present the analysis results coherently so that IRT users would have a sufficient understanding of the 4PL model and the carelessness parameter, and they can estimate item and person parameters under the 4PL model.
Co-Authors Agus Santoso Aigul Dauletkulova Diki Diki Djidu, Hasan Ezi Apino Fina Fitri Nurjannah Gulzhaina K. Kassymova Harris Shah Abd Hamid Heri Retnawati Iqlima Ramadhani Fabella Kartianom Kartianom Munaya Nikma Rosyada Sri Andayani Timbul Pardede