English
Related papers

Related papers: Algebra Error Classification with Large Language M…

200 papers

People use large language models (LLMs) when they should not. This is partly because they see LLMs compose poems and answer intricate questions, so they understandably, but incorrectly, assume LLMs won't stumble on basic tasks like simple…

Computation and Language · Computer Science 2025-12-29 Nathan Stringham , Fateme Hashemi Chaleshtori , Xinyuan Yan , Zhichao Xu , Bei Wang , Ana Marasović

The evaluation of Large Language Models (LLMs) increasingly relies on other LLMs acting as judges. However, current evaluation paradigms typically yield a single score or ranking, answering which model is better but not why. While essential…

Computation and Language · Computer Science 2025-07-25 Asaf Yehudai , Lilach Eden , Yotam Perlitz , Roy Bar-Haim , Michal Shmueli-Scheuer

Automated grading has become an essential tool in education technology due to its ability to efficiently assess large volumes of student work, provide consistent and unbiased evaluations, and deliver immediate feedback to enhance learning.…

Computers and Society · Computer Science 2025-01-27 Calvin Yeung , Jeff Yu , King Chau Cheung , Tat Wing Wong , Chun Man Chan , Kin Chi Wong , Keisuke Fujii

Grammatical error classification plays a crucial role in language learning systems, but existing classification taxonomies often lack rigorous validation, leading to inconsistencies and unreliable feedback. In this paper, we revisit…

Computation and Language · Computer Science 2025-02-19 Deqing Zou , Jingheng Ye , Yulu Liu , Yu Wu , Zishan Xu , Yinghui Li , Hai-Tao Zheng , Bingxu An , Zhao Wei , Yong Xu

This study examines the feasibility and potential advantages of using large language models, in particular GPT-4o, to perform partial credit grading of large numbers of student written responses to introductory level physics problems.…

Physics Education · Physics 2025-08-21 Zhongzhou Chen , Tong Wan

Human feedback is increasingly used to steer the behaviours of Large Language Models (LLMs). However, it is unclear how to collect and incorporate feedback in a way that is efficient, effective and unbiased, especially for highly subjective…

Computation and Language · Computer Science 2023-10-12 Hannah Rose Kirk , Andrew M. Bean , Bertie Vidgen , Paul Röttger , Scott A. Hale

This paper proposes a system that uses large language models to provide immediate feedback to students in flipped classroom preparation learning. This study aimed to solve challenges in the flipped classroom model, such as ensuring that…

Human-Computer Interaction · Computer Science 2023-07-24 Shintaro Uchiyama , Kyoji Umemura , Yusuke Morita

We explore contemporary, data-driven techniques for solving math word problems over recent large-scale datasets. We show that well-tuned neural equation classifiers can outperform more sophisticated models such as sequence to sequence and…

Artificial Intelligence · Computer Science 2018-05-01 Benjamin Robaidek , Rik Koncel-Kedziorski , Hannaneh Hajishirzi

Many recent advances in natural language generation have been fueled by training large language models on internet-scale data. However, this paradigm can lead to models that generate toxic, inaccurate, and unhelpful content, and automatic…

While large language models (LLMs) have been used for automated grading, they have not yet achieved the same level of performance as humans, especially when it comes to grading complex questions. Existing research on this topic focuses on a…

Artificial Intelligence · Computer Science 2024-05-31 Wenjing Xie , Juxin Niu , Chun Jason Xue , Nan Guan

Undergraduate students of artificial intelligence often struggle with representing knowledge as logical sentences. This is a skill that seems to require extensive practice to obtain, suggesting a teaching strategy that involves the…

Computers and Society · Computer Science 2015-07-15 Angelo Kyrilov , David Noelle

Automatic grading is not a new approach but the need to adapt the latest technology to automatic grading has become very important. As the technology has rapidly became more powerful on scoring exams and essays, especially from the 1990s…

Computation and Language · Computer Science 2020-04-20 Neslihan Suzen , Alexander Gorban , Jeremy Levesley , Evgeny Mirkes

In this paper, we propose a new system design framework for large vocabulary automatic chord estimation. Our approach is based on an integration of traditional sequence segmentation processes and deep learning chord classification…

Sound · Computer Science 2017-09-25 Junqi Deng , Yu-Kwong Kwok

Automated feedback systems have become increasingly integral to programming education, where learners engage in iterative cycles of code construction, testing, and refinement. Despite its wider integration in practices and technical…

Computers and Society · Computer Science 2026-02-03 Yeonji Jung , Yunseo Lee , Jiyeong Bae , DoYong Kim , Heungsoo Choi , Minji Kang , Unggi Lee

Large Language Models have introduced new possibilities for programming education through personalized support, content creation, and automated feedback. While recent studies have demonstrated the potential for feedback generation, many…

Software Engineering · Computer Science 2026-05-14 Smitha S Kumar , Michael A Lones , Manuel Maarek , Hind Zantout

Students in introductory physics courses often rely on ineffective strategies, focusing on final answers rather than understanding underlying principles. Integrating scientific argumentation into problem-solving fosters critical thinking…

Physics Education · Physics 2025-08-21 Winter Allen , Anand Shanker , N. Sanjay Rebello

The rapid development of large language models (LLMs) has not only provided numerous opportunities but also presented significant challenges. This becomes particularly evident when LLMs inadvertently generate harmful or toxic content,…

Computation and Language · Computer Science 2024-02-20 Kai Chen , Chunwei Wang , Kuo Yang , Jianhua Han , Lanqing Hong , Fei Mi , Hang Xu , Zhengying Liu , Wenyong Huang , Zhenguo Li , Dit-Yan Yeung , Lifeng Shang , Xin Jiang , Qun Liu

Ensuring data quality in large tabular datasets is a critical challenge, typically addressed through data wrangling tasks. Traditional statistical methods, though efficient, cannot often understand the semantic context and deep learning…

Machine Learning · Computer Science 2025-02-25 Ashlesha Akella , Krishnasuri Narayanam

Providing rich, constructive feedback to students is essential for supporting and enhancing their learning. Recent advancements in Generative Artificial Intelligence (AI), particularly with large language models (LLMs), present new…

Computers and Society · Computer Science 2025-07-11 Euan D Lindsay , Mike Zhang , Aditya Johri , Johannes Bjerva

Feedback on student answers and even during intermediate steps in their solutions to open-ended questions is an important element in math education. Such feedback can help students correct their errors and ultimately lead to improved…

Machine Learning · Computer Science 2021-04-27 Mengxue Zhang , Zichao Wang , Richard Baraniuk , Andrew Lan