Cognitively Aided Zero-Shot Automatic Essay Grading

Sandeep Mathias; Rudra Murthy; Diptesh Kanojia; Pushpak Bhattacharyya

Cognitively Aided Zero-Shot Automatic Essay Grading

Computation and Language 2021-02-23 v1 Artificial Intelligence

Authors: Sandeep Mathias , Rudra Murthy , Diptesh Kanojia , Pushpak Bhattacharyya

Abstract

Automatic essay grading (AEG) is a process in which machines assign a grade to an essay written in response to a topic, called the prompt. Zero-shot AEG is when we train a system to grade essays written to a new prompt which was not present in our training data. In this paper, we describe a solution to the problem of zero-shot automatic essay grading, using cognitive information, in the form of gaze behaviour. Our experiments show that using gaze behaviour helps in improving the performance of AEG systems, especially when we provide a new essay written in response to a new prompt for scoring, by an average of almost 5 percentage points of QWK.

Keywords

grammatical error correction

Cite

@article{arxiv.2102.11258,
  title  = {Cognitively Aided Zero-Shot Automatic Essay Grading},
  author = {Sandeep Mathias and Rudra Murthy and Diptesh Kanojia and Pushpak Bhattacharyya},
  journal= {arXiv preprint arXiv:2102.11258},
  year   = {2021}
}

Comments

This paper was accepted for publication at ICON 2020: The 17th International Conference on Natural Language Processing, on December 20, 2021

Cognitively Aided Zero-Shot Automatic Essay Grading

Abstract

Keywords

Cite

Comments

Related papers