English
Related papers

Related papers: A Survey on Feedback Types in Automated Programmin…

200 papers

Evaluation of large language model (LLM) outputs requires users to make critical judgments about the best outputs across various configurations. This process is costly and takes time given the large amounts of data. LLMs are increasingly…

The growing ubiquity of artificial intelligence (AI), in particular large language models (LLMs), has profoundly altered the way in which learners gain knowledge and interact with learning material, with many claiming that AI positively…

Artificial Intelligence · Computer Science 2025-07-18 Jarosław A. Chudziak , Adam Kostka

Large Language Models (LLMs) now excel at generative skills and can create content at impeccable speeds. However, they are imperfect and still make various mistakes. In a Computer Science education context, as these models are widely…

Human-Computer Interaction · Computer Science 2024-10-11 Qianou Ma , Hua Shen , Kenneth Koedinger , Tongshuang Wu

Recent advances in large language models (LLMs) have introduced new paradigms in software development, including vibe coding, AI-assisted coding, and agentic coding, fundamentally reshaping how software is designed, implemented, and…

Software Engineering · Computer Science 2026-01-01 Hung-Fu Chang , MohammadShokrolah Shirazi , Lizhou Cao , Supannika Koolmanojwong Mobasser

Providing students with flexible and timely academic support is a challenge at most colleges and universities, leaving many students without help outside scheduled hours. Large language models (LLMs) are promising for bridging this gap, but…

Computers and Society · Computer Science 2025-09-12 Chang Liu , Loc Hoang , Andrew Stolman , Rene F. Kizilcec , Bo Wu

Using large language models (LLMs) for automatic evaluation has become an important evaluation method in NLP research. However, it is unclear whether these LLM-based evaluators can be applied in real-world classrooms to assess student…

Computation and Language · Computer Science 2024-09-24 Cheng-Han Chiang , Wei-Chih Chen , Chun-Yi Kuan , Chienchou Yang , Hung-yi Lee

The development in Artificial Intelligence (AI) offers transformative potential for redefining student assessment methodologies. This paper aims to establish the idea of the advancement of Artificial Intelligence (AI) and its prospect in…

Computers and Society · Computer Science 2025-03-10 Pushpalatha K S , Abhishek Mangalur , Ketan Hegde , Chetan Badachi , Mohammad Aamir

AI-supported tools can help learners overcome challenges in programming education by providing adaptive assistance. However, existing research often focuses on individual tools rather than deriving broader design recommendations. A key…

Human-Computer Interaction · Computer Science 2025-03-04 Zihan Wu , Yicheng Tang , Barbara Ericson

Automatically generating feedback via large language models (LLMs) in intelligent tutoring systems and online learning platforms has the potential to improve the learning outcomes of many students. However, both feedback generation and…

Computation and Language · Computer Science 2024-12-13 Alexander Scarlatos , Digory Smith , Simon Woodhead , Andrew Lan

Generative AI has the potential to enhance education by providing personalized feedback to students at scale. Recent work has proposed techniques to improve AI-generated programming hints and has evaluated their performance based on…

Computers and Society · Computer Science 2025-09-04 Tung Phung , Mengyan Wu , Heeryung Choi , Gustavo Soares , Sumit Gulwani , Adish Singla , Christopher Brooks

With the proliferation of large language model (LLM) applications since 2022, their use in education has sparked both excitement and concern. Recent studies consistently highlight students' (mis)use of LLMs can hinder learning outcomes.…

Human-Computer Interaction · Computer Science 2025-07-01 Ruiwei Xiao , Xinying Hou , Runlong Ye , Majeed Kazemitabaar , Nicholas Diana , Michael Liut , John Stamper

Providing timely, targeted, and multimodal feedback helps students quickly correct errors, build deep understanding and stay motivated, yet making it at scale remains a challenge. This study introduces a real-time AI-facilitated multimodal…

Human-Computer Interaction · Computer Science 2026-05-14 Chloe Qianhui Zhao , Jie Cao , Jionghao Lin , Kenneth R. Koedinger

While large language models (LLMs) have been used for automated grading, they have not yet achieved the same level of performance as humans, especially when it comes to grading complex questions. Existing research on this topic focuses on a…

Artificial Intelligence · Computer Science 2024-05-31 Wenjing Xie , Juxin Niu , Chun Jason Xue , Nan Guan

In feedback generation for logical errors in programming assignments, large language model (LLM)-based methods have shown great promise. These methods ask the LLM to generate feedback given the problem statement and a student's (buggy)…

Computation and Language · Computer Science 2024-05-10 Hasnain Heickal , Andrew Lan

Peer review remains the central quality-control mechanism of science, yet its ability to fulfill this role is increasingly strained. Empirical studies document serious shortcomings: long publication delays, escalating reviewer burden…

Large Language Model (LLM) tools have demonstrated their potential to deliver high-quality assistance by providing instant, personalized feedback that is crucial for effective programming education. However, many of these tools operate…

Human-Computer Interaction · Computer Science 2025-04-08 Huiyong Li , Boxuan Ma

In recent years, there has been a growing interest in using Artificial Intelligence (AI) to automate student assessment in education. Among different types of assessments, summative assessments play a crucial role in evaluating a student's…

Computation and Language · Computer Science 2025-06-24 Dishank Aggarwal , Pritam Sil , Bhaskaran Raman , Pushpak Bhattacharyya

The rapid advancement of large language models (LLMs) is fundamentally reshaping software engineering (SE), driving a paradigm shift in both academic research and industrial practice. While top-tier SE venues continue to show sustained or…

Software Engineering · Computer Science 2025-12-18 Hang Yu , Yuzhou Lai , Li Zhang , Xiaoli Lian , Fang Liu , Yanrui Dong , Ting Zhang , Zhi Jin , David Lo

The emergence of large language models (LLMs) has transformed research and practice across a wide range of domains. Within the computing education research (CER) domain, LLMs have garnered significant attention, particularly in the context…

Artificial Intelligence · Computer Science 2024-11-25 Charles Koutcheme , Nicola Dainese , Arto Hellas , Sami Sarsa , Juho Leinonen , Syed Ashraf , Paul Denny

Generative AI and large language models hold great promise in enhancing programming education by generating individualized feedback and hints for learners. Recent works have primarily focused on improving the quality of generated feedback…

Machine Learning · Computer Science 2025-03-10 Nachiket Kotalwar , Alkis Gotovos , Adish Singla