English
Related papers

Related papers: Toward Educator-focused Automated Scoring Systems …

200 papers

Automated Text Scoring (ATS) provides a cost-effective and consistent alternative to human marking. However, in order to achieve good performance, the predictive features of the system need to be manually engineered by human experts. We…

Computation and Language · Computer Science 2017-07-18 Dimitrios Alikaniotis , Helen Yannakoudakis , Marek Rei

Automatic scoring engines have been used for scoring approximately fifteen million test-takers in just the last three years. This number is increasing further due to COVID-19 and the associated automation of education and testing. Despite…

Computation and Language · Computer Science 2021-11-16 Anubha Kabra , Mehar Bhatia , Yaman Kumar , Junyi Jessy Li , Rajiv Ratn Shah

While automated essay scoring (AES) can reliably grade essays at scale, automated writing evaluation (AWE) additionally provides formative feedback to guide essay revision. However, a neural AES typically does not provide useful feature…

Computation and Language · Computer Science 2020-08-06 Haoran Zhang , Diane Litman

Automatic essay scoring (AES) refers to the process of scoring free text responses to given prompts, considering human grader scores as the gold standard. Writing such essays is an essential component of many language and aptitude exams.…

Computation and Language · Computer Science 2017-02-09 Sowmya Vajjala

This paper presents a novel Automatic Essay Scoring (AES) algorithm tailored for the Portuguese-language essays of Brazil's Exame Nacional do Ensino M\'edio (ENEM), addressing the challenges in traditional human grading systems. Our…

Computation and Language · Computer Science 2024-01-02 Felipe Akio Matsuoka

Automatic Essay Scoring (AES) is widely used to evaluate candidates for educational purposes. However, due to the lack of representative data, most existing AES systems are not robust, and their scoring predictions are biased towards the…

Computation and Language · Computer Science 2024-09-10 Haddad Philip , Tsegaye Misikir Tashu

Automated Essay Scoring (AES) has been quite popular and is being widely used. However, lack of appropriate methodology for rating nonnative English speakers' essays has meant a lopsided advancement in this field. In this paper, we report…

Computation and Language · Computer Science 2018-02-02 Amber Nigam

Automatic essay grading (AEG) has attracted the the attention of the NLP community because of its applications to several educational applications, such as scoring essays, short answers, etc. AEG systems can save significant time and money…

Computation and Language · Computer Science 2024-10-15 Maisha Maliha , Vishal Pramanik

Automated essay scoring (AES) aims to score essays written for a given prompt, which defines the writing topic. Most existing AES systems assume to grade essays of the same prompt as used in training and assign only a holistic score.…

Computation and Language · Computer Science 2023-08-30 Heejin Do , Yunsu Kim , Gary Geunbae Lee

Automated Essay Scoring (AES) holds significant promise in the field of education, helping educators to mark larger volumes of essays and provide timely feedback. However, Arabic AES research has been limited by the lack of publicly…

Computation and Language · Computer Science 2024-07-17 Rayed Ghazawi , Edwin Simpson

Significant progress has been made in deep-learning based Automatic Essay Scoring (AES) systems in the past two decades. However, little research has been put to understand and interpret the black-box nature of these deep-learning based…

Computation and Language · Computer Science 2020-12-29 Swapnil Parekh , Yaman Kumar Singla , Changyou Chen , Junyi Jessy Li , Rajiv Ratn Shah

Recent advances in large language models (LLMs) have enabled zero-shot automated essay scoring (AES), providing a promising way to reduce the cost and effort of essay scoring in comparison with manual grading. However, most existing…

Computation and Language · Computer Science 2025-09-23 Takumi Shibata , Yuichi Miyamura

Automated essay scoring (AES) is a useful tool in English as a Foreign Language (EFL) writing education, offering real-time essay scores for students and instructors. However, previous AES models were trained on essays and scores irrelevant…

Computation and Language · Computer Science 2025-06-12 Haneul Yoo , Jieun Han , So-Yeon Ahn , Alice Oh

The first automated essay scoring system was developed 50 years ago. Automated essay scoring systems are developing into systems with richer functions than the previous simple scoring systems. Its purpose is not only to score essays but…

Computation and Language · Computer Science 2023-07-13 You-Jin Jong , Yong-Jin Kim , Ok-Chol Ri

In this paper, we present a new comparative study on automatic essay scoring (AES). The current state-of-the-art natural language processing (NLP) neural network architectures are used in this work to achieve above human-level accuracy on…

Computation and Language · Computer Science 2019-09-23 Pedro Uria Rodriguez , Amir Jafari , Christopher M. Ormerod

Automated Essay scoring has been explored as a research and industry problem for over 50 years. It has drawn a lot of attention from the NLP community because of its clear educational value as a research area that can engender the creation…

Computation and Language · Computer Science 2023-11-14 Yann Hicke , Tonghua Tian , Karan Jha , Choong Hee Kim

This study examines the effect of grammatical features in automatic essay scoring (AES). We use two kinds of grammatical features as input to an AES model: (1) grammatical items that writers used correctly in essays, and (2) the number of…

Computation and Language · Computer Science 2024-06-14 Kosuke Doi , Katsuhito Sudoh , Satoshi Nakamura

The objective of this study is to improve automated feedback tools designed for English Language Learners (ELLs) through the utilization of data science techniques encompassing machine learning, natural language processing, and educational…

Computation and Language · Computer Science 2024-01-12 Jiaxin Huang , Xinyu Zhao , Chang Che , Qunwei Lin , Bo Liu

This paper surveys and organizes research works in an under-studied area, which we call automated evaluation for student argumentative writing. Unlike traditional automated writing evaluation that focuses on holistic essay scoring, this…

Computation and Language · Computer Science 2022-05-10 Xinyu Wang , Yohan Lee , Juneyoung Park

We study the effects of data size and quality on the performance on Automated Essay Scoring (AES) engines that are designed in accordance with three different paradigms; A frequency and hand-crafted feature-based model, a recurrent neural…

Computation and Language · Computer Science 2021-08-31 Christopher Ormerod , Amir Jafari , Susan Lottridge , Milan Patel , Amy Harris , Paul van Wamelen