English

Exploring Automated Essay Scoring for Nonnative English Speakers

Computation and Language 2018-02-02 v3

Abstract

Automated Essay Scoring (AES) has been quite popular and is being widely used. However, lack of appropriate methodology for rating nonnative English speakers' essays has meant a lopsided advancement in this field. In this paper, we report initial results of our experiments with nonnative AES that learns from manual evaluation of nonnative essays. For this purpose, we conducted an exercise in which essays written by nonnative English speakers in test environment were rated both manually and by the automated system designed for the experiment. In the process, we experimented with a few features to learn about nuances linked to nonnative evaluation. The proposed methodology of automated essay evaluation has yielded a correlation coefficient of 0.750 with the manual evaluation.

Keywords

Cite

@article{arxiv.1706.03335,
  title  = {Exploring Automated Essay Scoring for Nonnative English Speakers},
  author = {Amber Nigam},
  journal= {arXiv preprint arXiv:1706.03335},
  year   = {2018}
}

Comments

Accepted for publication at EUROPHRAS 2017

R2 v1 2026-06-22T20:15:14.147Z