Article Per Year (5 Year)
p-Index From 2019 - 2024
0.408
P-Index
This Author published in this journals
All Journal Parole: Journal of Linguistics and Education LLT Journal: A Journal on Language and Language Teaching
Rose Acen Upor
University of Dar es Salaam
Arts Humanities Education Languange, Linguistic, Communication & Media Social Sciences

Published : 2 Documents Claim Missing Document
Claim Missing Document
Check
Articles

Found 1 Documents
Search
Journal : LLT Journal: A Journal on Language and Language Teaching

 1 
RATER AGREEMENT AND DISAGREEMENT IN THE MEASUREMENT OF ENGLISH ARTICLE ACQUISITION SUPPLIANCE AND ACCURACY Rose Acen Upor
LLT Journal: A Journal on Language and Language Teaching Vol 24, No 1 (2021): April 2021
Publisher : English Education Study Programme of Sanata Dharma University, Yogyakarta, Indonesia

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.24071/llt.v24i1.2603

Abstract

This study combines language assessment processes and interlanguage analysis techniques to determine rater agreement and disagreement in assessing English article acquisition. Employing native English speaking and non-native English speaking raters, picture sequence narratives that were written by English as a Foreign Language (EFL) learners (n=97) were coded and scored for suppliance-in-obligatory context (SOC) and target-like utterance (TLU). Although the kappa statistic revealed a fair agreement between raters (0.17 – 0.33), content analysis methods revealed much higher agreement (88.29% - 94.07%). Furthermore, language background effects between the raters could not be substantiated however the results demonstrated a discernable disagreement pattern between them. Thus, the study recommends the inclusion of a foreign language teaching background as a factor for rater selection to minimize language background effects on rating language assessments.
Co-Authors Joseph J. Olomy