LLT Journal: A Journal on Language and Language Teaching
Vol 24, No 2 (2021): October 2021

THE EFFECTS OF RATING EXPERIENCE AND DISCOURSE MODES ON ASSESSING EFL LEARNERS WRITING PERFORMANCES

Rania Zribi (Sfax University)
Chokri Smaoui (Sfax University)



Article Info

Publish Date
05 Nov 2021

Abstract

This study aims at investigating the effects of discourse modes on assessing EFL learners written performances. A total of fifty raters judged sixty essays (30 narratives and 30 argumentative writing modes) written by third-year English students from the Faculty of Letters and Humanities. Raters not only scored the compositions but also justified their scores assignments based on written explanations. Raters rating behaviors were diagnosed based on a variety of quantitative and qualitative tools. Essay scores were analyzed based on the statistical model FACETS to measure raters severity and internal consistency, task difficulty, and the scale functioning across writing modes. Qualitative data (gathered from interviews and report forms) were also analyzed in order to examine which aspects of writing were deemed more important than others across task types. The analysis revealed that the discourse mode was substantially an influential factor. The narrative task was more difficult than the argumentative one. Narrative essays were judged harsher than argumentative essays. Less consistent ratings could be detected from the narrative mode, compared to the argumentative one. Qualitative findings showed that the two writing modes were different in their qualitative judgments due to their different genre requirements and norms.

Copyrights © 2021






Journal Info

Abbrev

LLT

Publisher

Subject

Arts Humanities Education Languange, Linguistic, Communication & Media Social Sciences

Description

LLT Journal: A Journal on Language and Language Teaching, to be published twice a year, namely in April and October, is a scientific peer-reviewed journal published by the English Language Education Study Program, Faculty of Teacher Training and Education, Sanata Dharma University, Yogyakarta. The ...