English
Related papers

Related papers: Evaluating Generative AI for CS1 Code Grading: Dir…

200 papers

Instructor's feedback plays a critical role in students' development of conceptual understanding and reasoning skills. However, grading student written responses and providing personalized feedback can take a substantial amount of time. In…

Physics Education · Physics 2024-06-17 Tong Wan , Zhongzhou Chen

Automatically generating feedback via large language models (LLMs) in intelligent tutoring systems and online learning platforms has the potential to improve the learning outcomes of many students. However, both feedback generation and…

Computation and Language · Computer Science 2024-12-13 Alexander Scarlatos , Digory Smith , Simon Woodhead , Andrew Lan

Automatic assessment of code, in particular to support education, is an important feature included in several Learning Management Systems (LMS), at least to some extent. Several kinds of assessments can be designed, such as exercises asking…

Software Engineering · Computer Science 2019-11-28 Sébastien Combéfis , Guillaume de Moffarts

Formative assessment is a cornerstone of effective teaching and learning, providing students with feedback to guide their learning. While there has been an exponential growth in the application of generative AI in scaling various aspects of…

Computers and Society · Computer Science 2025-06-03 Sapolnach Prompiengchai , Charith Narreddy , Steve Joordens

Providing timely and individualised feedback on handwritten student work is highly beneficial for learning but difficult to achieve at scale. This challenge has become more pressing as generative AI undermines the reliability of take-home…

As large language models (LLMs) are increasingly deployed as automated graders in educational settings, concerns about fairness and bias in their evaluations have become critical. This study investigates whether LLMs exhibit implicit…

Computation and Language · Computer Science 2026-03-20 Rudra Jadhav , Janhavi Danve , Sonalika Shaw

Generative AI is changing the way that many disciplines are taught, including computer science. Researchers have shown that generative AI tools are capable of solving programming problems, writing extensive blocks of code, and explaining…

Human-Computer Interaction · Computer Science 2024-02-14 Bailey Kimmel , Austin Geisert , Lily Yaro , Brendan Gipson , Taylor Hotchkiss , Sidney Osae-Asante , Hunter Vaught , Grant Wininger , Chase Yamaguchi

In this study, I explored the impact of Generative AI on learning efficacy in academic reading materials using experimental methods. College-educated participants engaged in three cycles of reading and writing tasks. After each cycle, they…

Computers and Society · Computer Science 2023-11-13 Qirui Ju

Plagiarism in programming courses remains a persistent challenge, especially in competitive programming contexts where assignments often have unique, known solutions. This paper examines why traditional code plagiarism detection methods…

Computers and Society · Computer Science 2025-05-14 Ethan Dickey

Providing effective feedback is important for student learning in programming problem-solving. In this sense, Large Language Models (LLMs) have emerged as potential tools to automate feedback generation. However, their reliability and…

Software Engineering · Computer Science 2025-03-20 Priscylla Silva , Evandro Costa

Generative AI systems have revolutionized human interaction by enabling natural language-based coding and problem solving. However, the inherent ambiguity of natural language often leads to imprecise instructions, forcing users to…

Artificial Intelligence · Computer Science 2025-07-02 Fabrizio Marozzo

Generative Artificial Intelligence (GAI) can be seen as a double-edged weapon in education. Indeed, it may provide personalized, interactive and empowering pedagogical sequences that could favor students' intrinsic motivation, active…

Computers and Society · Computer Science 2023-11-13 Rania Abdelghani , Hélène Sauzéon , Pierre-Yves Oudeyer

Large language models have demonstrated great potential to assist programmers in generating code. For such human-AI pair programming scenarios, we empirically demonstrate that while generated code is most often evaluated in terms of their…

Software Engineering · Computer Science 2023-06-14 Victor Dibia , Adam Fourney , Gagan Bansal , Forough Poursabzi-Sangdeh , Han Liu , Saleema Amershi

Consider the following task taught in introductory optimization courses which addresses challenges articulated by the community at the intersection of (generative) AI and OR: generate the dual of a linear program. LLMs, being trained at…

Machine Learning · Computer Science 2025-05-29 Michael Klamkin , Arnaud Deza , Sikai Cheng , Haoruo Zhao , Pascal Van Hentenryck

Developing interactive software, such as websites or games, is a particularly engaging way to learn computer science. However, teaching and giving feedback on such software is time-consuming -- standard approaches require instructors to…

Machine Learning · Computer Science 2022-11-17 Evan Zheran Liu , Moritz Stephan , Allen Nie , Chris Piech , Emma Brunskill , Chelsea Finn

We find that large language models (LLMs) are more likely to modify human-written text than AI-generated text when tasked with rewriting. This tendency arises because LLMs often perceive AI-generated text as high-quality, leading to fewer…

Computation and Language · Computer Science 2024-04-16 Chengzhi Mao , Carl Vondrick , Hao Wang , Junfeng Yang

Various studies have studied the impact of Generative AI on Computing Education. However, they have focused on the implications for novice programmers. In this experience report, we analyze the use of GenAI as a support tool for learning,…

Computers and Society · Computer Science 2025-03-21 Isaac Alpizar-Chacon , Hieke Keuning

Code review is a standard practice for ensuring the quality of software projects, and recent research has focused extensively on automated code review. While significant advancements have been made in generating code reviews, the automated…

Software Engineering · Computer Science 2025-01-10 Yanjie Jiang , Hui Liu , Tianyi Chen , Fu Fan , Chunhao Dong , Kui Liu , Lu Zhang

In the contemporary landscape of computing education, the ubiquity of Generative Artificial Intelligence has significantly disrupted traditional assessment methods, rendering them obsolete and prompting educators to seek innovative…

Human-Computer Interaction · Computer Science 2024-01-10 Stephen MacNeil , Scott Spurlock , Ian Applebaum

As AI capabilities increasingly surpass human proficiency in complex tasks, current alignment techniques, including SFT and RLHF, face fundamental challenges in ensuring reliable oversight. These methods rely on direct human assessment and…

Artificial Intelligence · Computer Science 2026-01-16 Xueru Wen , Jie Lou , Xinyu Lu , Junjie Yang , Yanjiang Liu , Yaojie Lu , Debing Zhang , Xing Yu