English
Related papers

Related papers: Beyond Scores: A Modular RAG-Based System for Auto…

200 papers

Automated Short Answer Scoring (ASAS) is a critical component in educational assessment. While traditional ASAS systems relied on rule-based algorithms or complex deep learning methods, recent advancements in Generative Language Models…

Computation and Language · Computer Science 2024-08-08 Zifan Wang , Christopher Ormerod

In the era of MOOCs, online exams are taken by millions of candidates, where scoring short answers is an integral part. It becomes intractable to evaluate them by human graders. Thus, a generic automated system capable of grading these…

Artificial Intelligence · Computer Science 2020-12-22 Yaman Kumar , Swati Aggarwal , Debanjan Mahata , Rajiv Ratn Shah , Ponnurangam Kumaraguru , Roger Zimmermann

Individual feedback can help students improve their essay writing skills. However, the manual effort required to provide such feedback limits individualization in practice. Automatically-generated essay feedback may serve as an alternative…

Computation and Language · Computer Science 2024-04-25 Maja Stahl , Leon Biermann , Andreas Nehring , Henning Wachsmuth

Subjective Answer Grading (SAG) plays a crucial role in education, standardized testing, and automated assessment systems, particularly for evaluating short-form responses in Short Answer Scoring (SAS). However, existing approaches often…

Computation and Language · Computer Science 2025-05-16 Peichao Lai , Kexuan Zhang , Yi Lin , Linyihan Zhang , Feiyang Ye , Jinhao Yan , Yanwei Xu , Conghui He , Yilei Wang , Wentao Zhang , Bin Cui

In this study, we developed an automated short answer grading (ASAG) model that provided both analytic scores and final holistic scores. Short answer items typically consist of multiple sub-questions, and providing an analytic score and the…

Computation and Language · Computer Science 2023-05-31 Su-Youn Yoon

Automated grading has become an essential tool in education technology due to its ability to efficiently assess large volumes of student work, provide consistent and unbiased evaluations, and deliver immediate feedback to enhance learning.…

Computers and Society · Computer Science 2025-01-27 Calvin Yeung , Jeff Yu , King Chau Cheung , Tat Wing Wong , Chun Man Chan , Kin Chi Wong , Keisuke Fujii

Automatic short answer grading (ASAG), which autonomously score student answers according to reference answers, provides a cost-effective and consistent approach to teaching professionals and can reduce their monotonous and tedious grading…

Artificial Intelligence · Computer Science 2019-09-27 Tiaoqiao Liu , Wenbiao Ding , Zhiwei Wang , Jiliang Tang , Gale Yan Huang , Zitao Liu

Automated Short Answer Scoring (SAS) is the task of automatically scoring a given input to a prompt based on rubrics and reference answers. Although SAS is useful in real-world applications, both rubrics and reference answers differ between…

Computation and Language · Computer Science 2024-08-27 Hiroaki Funayama , Yuya Asazuma , Yuichiroh Matsubayashi , Tomoya Mizumoto , Kentaro Inui

Providing evaluations to student work is a critical component of effective student learning, and automating its process can significantly reduce the workload on human graders. Automatic Short Answer Grading (ASAG) systems, enabled by…

Computation and Language · Computer Science 2025-02-20 Chenyan Zhao , Mariana Silva , Seth Poulsen

In recent years, there has been a growing interest in using Artificial Intelligence (AI) to automate student assessment in education. Among different types of assessments, summative assessments play a crucial role in evaluating a student's…

Computation and Language · Computer Science 2025-06-24 Dishank Aggarwal , Pritam Sil , Bhaskaran Raman , Pushpak Bhattacharyya

Short answer assessment is a vital component of science education, allowing evaluation of students' complex three-dimensional understanding. Large language models (LLMs) that possess human-like ability in linguistic tasks are increasingly…

Computation and Language · Computer Science 2025-06-05 Yucheng Chu , Peng He , Hang Li , Haoyu Han , Kaiqi Yang , Yu Xue , Tingting Li , Joseph Krajcik , Jiliang Tang

Automatic Short Answer Grading (ASAG) with generative large language models (LLMs) has recently demonstrated strong performance without task-specific fine-tuning, while also enabling the generation of synthetic feedback for educational…

Computation and Language · Computer Science 2026-05-14 Longwei Cong , Sonja Hahn , Sebastian Gombert , Leon Camus , Hendrik Drachsler , Ulf Kroehne

Automatic assessment needs short answer based evaluation and automated assessment. Various techniques used are Ontology, Semantic similarity matching and Statistical methods. An automatic short answer assessment system is attempted in this…

Other Computer Science · Computer Science 2010-11-09 P. Selvi , A. K. Bnerjee

Large language models (LLMs) have been proposed as scalable tools to address the gap between the importance of individualized written feedback and the practical challenges of providing it at scale. However, concerns persist regarding the…

Other Statistics · Statistics 2025-11-12 Niklas Ippisch , Markus Herklotz , Anna-Carolina Haensch , Carsten Schwemmer

Automatic Essay Scoring (AES) assigns scores to student essays, reducing the grading workload for instructors. Developing a scoring system capable of handling essays across diverse prompts is challenging due to the flexibility and diverse…

Computation and Language · Computer Science 2025-02-14 Zhaoyi Joey Hou , Alejandro Ciuba , Xiang Lorraine Li

Providing timely, consistent, and high-quality feedback in large-scale higher education courses remains a persistent challenge, often constrained by instructor workload and resource limitations. This study presents an LLM-powered, agentic…

Computers and Society · Computer Science 2026-01-13 Reza Vatankhah Barenji , Nazila Salimi , Sina Khoshgoftar

Assessing soft skills such as empathy, ethical judgment, and communication is essential in competitive selection processes, yet human scoring is often inconsistent and biased. While Large Language Models (LLMs) have improved Automated Essay…

Computation and Language · Computer Science 2026-02-03 Ryan Huynh , Frank Guerin , Alison Callwood

The advent of large language models (LLMs) in the education sector has provided impetus to automate grading short answer questions. LLMs make evaluating short answers very efficient, thus addressing issues like staff shortage. However, in…

Computation and Language · Computer Science 2025-04-03 Niharika Dadu , Harsh Vardhan Singh , Romi Banerjee

The grading of open-ended questions is a high-effort, high-impact task in education. Automating this task promises a significant reduction in workload for education professionals, as well as more consistent grading outcomes for students, by…

Artificial Intelligence · Computer Science 2024-05-08 Alexandra Gobrecht , Felix Tuma , Moritz Möller , Thomas Zöller , Mark Zakhvatkin , Alexandra Wuttig , Holger Sommerfeldt , Sven Schütt

This study illustrates how incorporating feedback-oriented annotations into the scoring pipeline can enhance the accuracy of automated essay scoring (AES). This approach is demonstrated with the Persuasive Essays for Rating, Selecting, and…

Computation and Language · Computer Science 2025-09-03 Christopher Ormerod
‹ Prev 1 2 3 10 Next ›