English
Related papers

Related papers: Beyond Static Scoring: Enhancing Assessment Validi…

200 papers

The influence of Artificial Intelligence (AI), and specifically Large Language Models (LLM), on education is continuously increasing. These models are frequently used by students, giving rise to the question whether current forms of…

Human-Computer Interaction · Computer Science 2025-07-02 Patrick Stokkink

The importance of managing feedback practices in higher education has been widely recognised, as they play a crucial role in enhancing teaching, learning, and assessment processes. In today's educational landscape, feedback practices are…

Computers and Society · Computer Science 2026-02-04 Daniele Agostini , Federica Picasso

Grading exams is an important, labor-intensive, subjective, repetitive, and frequently challenging task. The feasibility of autograding textual responses has greatly increased thanks to the availability of large language models (LLMs) such…

Computation and Language · Computer Science 2024-07-09 Johannes Schneider , Bernd Schenk , Christina Niklaus

The emergence of large language models (LLMs) has brought a new paradigm to automated essay scoring (AES), a long-standing and practical application of natural language processing in education. However, achieving human-level…

Computation and Language · Computer Science 2025-09-22 Jinhee Jang , Ayoung Moon , Minkyoung Jung , YoungBin Kim , Seung Jin Lee

Grading assessments is time-consuming and prone to human bias. Students may experience delays in receiving feedback that may not be tailored to their expectations or needs. Harnessing AI in education can be effective for grading…

Physics Education · Physics 2025-12-01 Ryan Mok , Faraaz Akhtar , Louis Clare , Christine Li , Jun Ida , Lewis Ross , Mario Campanelli

Automated Essay Scoring (AES) systems now reach near human agreement on some public benchmarks, yet real-world adoption, especially in high-stakes examinations, remains limited. A principal obstacle is that most models output a single score…

Computation and Language · Computer Science 2025-09-22 Ahmed Karim , Qiao Wang , Zheng Yuan

Student responses in STEM assessments are often handwritten and combine symbolic expressions, calculations, and diagrams, creating substantial variation in format and interpretation. Despite their importance for evaluating students'…

Artificial Intelligence · Computer Science 2026-04-15 Xiuxiu Tang , G. Alex Ambrose , Ying Cheng

Grading project reports are increasingly significant in today's educational landscape, where they serve as key assessments of students' comprehensive problem-solving abilities. However, it remains challenging due to the multifaceted…

Human-Computer Interaction · Computer Science 2025-08-19 Zixin Chen , Jiachen Wang , Yumeng Li , Haobo Li , Chuhan Shi , Rong Zhang , Huamin Qu

This perspective paper proposes a series of interactive scenarios that utilize Artificial Intelligence (AI) to enhance classroom teaching, such as dialogue auto-completion, knowledge and style transfer, and assessment of AI-generated…

Artificial Intelligence · Computer Science 2023-06-13 Kehui Tan , Tianqi Pang , Chenyou Fan , Song Yu

The rapid rise in popularity of Large Language Models (LLMs) with emerging capabilities has spurred public curiosity to evaluate and compare different LLMs, leading many researchers to propose their own LLM benchmarks. Noticing preliminary…

Artificial Intelligence · Computer Science 2025-05-15 Timothy R. McIntosh , Teo Susnjak , Nalin Arachchilage , Tong Liu , Paul Watters , Malka N. Halgamuge

In the domain of education, the integration of,technology has led to a transformative era, reshaping traditional,learning paradigms. Central to this evolution is the automation,of grading processes, particularly within the STEM domain…

Artificial Intelligence · Computer Science 2024-09-25 Rajlaxmi Patil , Aditya Ashutosh Kulkarni , Ruturaj Ghatage , Sharvi Endait , Geetanjali Kale , Raviraj Joshi

We investigate whether contemporary multimodal LLMs can assist with grading open-ended calculus at scale without eroding validity. In a large first-year exam, students' handwritten work was graded by GPT-5 against the same rubric used by…

Computers and Society · Computer Science 2025-11-14 Gerd Kortemeyer , Alexander Caspar , Daria Horica

Objective and scalable measurement of teaching quality is a persistent challenge in education. While Large Language Models (LLMs) offer potential, general-purpose models have struggled to reliably apply complex, authentic classroom…

Computation and Language · Computer Science 2025-11-07 Michael Hardy

Providing students with individualized feedback through assignments is a cornerstone of education that supports their learning and development. Studies have shown that timely, high-quality feedback plays a critical role in improving…

Machine Learning · Computer Science 2025-01-27 Pavlin G. Poličar , Martin Špendl , Tomaž Curk , Blaž Zupan

The current paper presents the development and validation of SelfScore, a novel benchmark designed to assess the performance of automated Large Language Model (LLM) agents on help desk and professional consultation tasks. Given the…

Computers and Society · Computer Science 2024-10-23 John Mavi , Nathan Summers , Sergio Coronado

Large Language Models (LLMs) offer a promising solution to complement traditional teaching and address global teacher shortages that affect hundreds of millions of children, but they fail to provide grade-appropriate responses for students…

Computers and Society · Computer Science 2026-03-09 Jio Oh , Steven Euijong Whang , James Evans , Jindong Wang

Automatic Short Answer Grading (ASAG) with generative large language models (LLMs) has recently demonstrated strong performance without task-specific fine-tuning, while also enabling the generation of synthetic feedback for educational…

Computation and Language · Computer Science 2026-05-14 Longwei Cong , Sonja Hahn , Sebastian Gombert , Leon Camus , Hendrik Drachsler , Ulf Kroehne

Peer review remains the central quality-control mechanism of science, yet its ability to fulfill this role is increasingly strained. Empirical studies document serious shortcomings: long publication delays, escalating reviewer burden…

Automated Essay Scoring systems have traditionally focused on holistic scores, limiting their pedagogical usefulness, especially in the case of complex essay genres such as argumentative writing. In educational contexts, teachers and…

Computation and Language · Computer Science 2026-02-05 Lucile Favero , Juan Antonio Pérez-Ortiz , Tanja Käser , Nuria Oliver

Formative feedback is widely recognized as one of the most effective drivers of student learning, yet it remains difficult to implement equitably at scale. In large or low-resource courses, instructors often lack the time, staffing, and…

Computers and Society · Computer Science 2025-12-01 Chenyu Zhang , Xiaohang Luo