English
Related papers

Related papers: Get It Scored Using AutoSAS -- An Automated System…

200 papers

Sentiment Analysis Systems (SASs) are data-driven Artificial Intelligence (AI) systems that, given a piece of text, assign one or more numbers conveying the polarity and emotional intensity expressed in the input. Like other automatic…

Artificial Intelligence · Computer Science 2023-02-07 Kausik Lakkaraju , Biplav Srivastava , Marco Valtorta

Grading of examination papers is a hectic, time-labor intensive task and is often subjected to inefficiency and bias in checking. This research project is a primitive experiment in the automation of grading of theoretical answers written in…

Machine Learning · Computer Science 2020-04-21 Rahul Kr Chauhan , Ravinder Saharan , Siddhartha Singh , Priti Sharma

Automated essay scoring (AES) aims to score essays written for a given prompt, which defines the writing topic. Most existing AES systems assume to grade essays of the same prompt as used in training and assign only a holistic score.…

Computation and Language · Computer Science 2023-08-30 Heejin Do , Yunsu Kim , Gary Geunbae Lee

Automated answer grading is a critical challenge in educational technology, with the potential to streamline assessment processes, ensure grading consistency, and provide timely feedback to students. However, existing approaches are often…

Computation and Language · Computer Science 2025-06-02 Masoud Safilian , Amin Beheshti , Stephen Elbourn

Effective and timely feedback in educational assessments is essential but labor-intensive, especially for complex tasks. Recent developments in automated feedback systems, ranging from deterministic response grading to the evaluation of…

History and Overview · Mathematics 2024-08-22 Tianyi Liu , Julia Chatain , Laura Kobel-Keller , Gerd Kortemeyer , Thomas Willwacher , Mrinmaya Sachan

Automated essay scoring plays an important role in judging students' language abilities in education. Traditional approaches use handcrafted features to score and are time-consuming and complicated. Recently, neural network approaches have…

Computation and Language · Computer Science 2022-03-08 You-Jin Jong , Yong-Jin Kim , Ok-Chol Ri

Large language models (LLMs) enable rapid and consistent automated evaluation of open-ended exam responses, including dimensions of content and argumentation that have traditionally required human judgment. This is particularly important in…

Computation and Language · Computer Science 2026-01-26 Andres Karjus , Kais Allkivi , Silvia Maine , Katarin Leppik , Krister Kruusmaa , Merilin Aruvee

Automatic Speech Scoring (ASS) is the computer-assisted evaluation of a candidate's speaking proficiency in a language. ASS systems face many challenges like open grammar, variable pronunciations, and unstructured or semi-structured…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-07 Yaman Kumar Singla , Avykat Gupta , Shaurya Bagga , Changyou Chen , Balaji Krishnamurthy , Rajiv Ratn Shah

This study examines the effect of grammatical features in automatic essay scoring (AES). We use two kinds of grammatical features as input to an AES model: (1) grammatical items that writers used correctly in essays, and (2) the number of…

Computation and Language · Computer Science 2024-06-14 Kosuke Doi , Katsuhito Sudoh , Satoshi Nakamura

We present an efficient end-to-end approach for holistic Automatic Speaking Assessment (ASA) of multi-part second-language tests, developed for the 2025 Speak & Improve Challenge. Our system's main novelty is the ability to process all four…

Computation and Language · Computer Science 2025-10-07 Nhan Phan , Anusha Porwal , Yaroslav Getman , Ekaterina Voskoboinik , Tamás Grósz , Mikko Kurimo

Providing explainable and faithful feedback is crucial for automated student answer assessment. In this paper, we introduce a novel framework that explores using ChatGPT, a cutting-edge large language model, for the concurrent tasks of…

Computation and Language · Computer Science 2023-10-25 Jiazheng Li , Lin Gui , Yuxiang Zhou , David West , Cesare Aloisi , Yulan He

Recent advances in large language models (LLMs) have enabled zero-shot automated essay scoring (AES), providing a promising way to reduce the cost and effort of essay scoring in comparison with manual grading. However, most existing…

Computation and Language · Computer Science 2025-09-23 Takumi Shibata , Yuichi Miyamura

We explore the use of deep reinforcement learning to audit an automatic short answer grading (ASAG) model. Automatic grading may decrease the time burden of rating open-ended items for educators, but a lack of robust evaluation methods for…

Artificial Intelligence · Computer Science 2024-05-14 Aubrey Condor , Zachary Pardos

Automatic Essay Scoring (AES) is defined as the computer technology that evaluates and scores the written essays, aiming to provide computational models to grade essays either automatically or with minimal human involvement. While there are…

Computation and Language · Computer Science 2021-05-20 Jeziel C. Marinho , Rafael T. Anchieta , Raimundo S. Moura

Automated scoring of open-ended student responses has the potential to significantly reduce human grader effort. Recent advances in automated scoring often leverage textual representations based on pre-trained language models such as BERT…

Machine Learning · Computer Science 2023-06-16 Nigel Fernandez , Aritra Ghosh , Naiming Liu , Zichao Wang , Benoît Choffin , Richard Baraniuk , Andrew Lan

Automated scoring plays a crucial role in education by reducing the reliance on human raters, offering scalable and immediate evaluation of student work. While large language models (LLMs) have shown strong potential in this task, their use…

Computation and Language · Computer Science 2026-03-26 Yun Wang , Zhaojun Ding , Xuansheng Wu , Siyue Sun , Ninghao Liu , Xiaoming Zhai

Automated speaking assessment (ASA) typically involves automatic speech recognition (ASR) and hand-crafted feature extraction from the ASR transcript of a learner's speech. Recently, self-supervised learning (SSL) has shown stellar…

Sound · Computer Science 2025-03-04 Tien-Hong Lo , Fu-An Chao , Tzu-I Wu , Yao-Ting Sung , Berlin Chen

Digital technologies are increasingly used in education to reduce the workload of teachers and students. However, creating open-ended study or examination questions and grading their answers is still a tedious task. This thesis presents the…

Computation and Language · Computer Science 2025-06-17 Gérôme Meyer , Philip Breuer

The assessment of source code in university education is a central and important task for lecturers of programming courses. In doing so, educators are confronted with growing numbers of students having increasingly diverse prerequisites, a…

Software Engineering · Computer Science 2023-06-09 Clemens Sauerwein , Tobias Antensteiner , Stefan Oppl , Iris Groher , Alexander Meschtscherjakov , Philipp Zech , Ruth Breu

In recent years, large language models (LLMs) achieve remarkable success across a variety of tasks. However, their potential in the domain of Automated Essay Scoring (AES) remains largely underexplored. Moreover, compared to English data,…

Computation and Language · Computer Science 2025-04-09 Yida Cai , Kun Liang , Sanwoo Lee , Qinghan Wang , Yunfang Wu