English
Related papers

Related papers: Evaluating Generative AI for CS1 Code Grading: Dir…

200 papers

Despite growing interest in using LLMs to generate feedback on students' writing, little is known about how students respond to AI-mediated versus human-provided feedback. We address this gap through a randomized controlled trial in a large…

Human-Computer Interaction · Computer Science 2026-02-25 Xinyi Lu , Kexin Phyllis Ju , Mitchell Dudley , Larissa Sano , Xu Wang

How can we use generative AI to design tools that augment rather than replace human cognition? In this position paper, we review our own research on AI-assisted decision-making for lessons to learn. We observe that in both AI-assisted…

Human-Computer Interaction · Computer Science 2025-04-07 Zelun Tony Zhang , Leon Reicherts

This study investigates the optimization of Generative AI (GenAI) systems through human feedback, focusing on how varying feedback mechanisms influence the quality of GenAI outputs. We devised a Human-AI training loop where 32 students,…

Human-Computer Interaction · Computer Science 2024-04-25 Jacob Sherson , Florent Vinchon

Providing feedback on programming assignments manually is a tedious, error prone, and time-consuming task. In this paper, we motivate and address the problem of generating feedback on performance aspects in introductory programming…

Programming Languages · Computer Science 2014-09-18 Sumit Gulwani , Ivan Radiček , Florian Zuleger

Generative AI technologies have demonstrated significant potential across diverse applications. This study provides a comparative analysis of credit score modeling techniques, contrasting traditional approaches with those leveraging…

Machine Learning · Computer Science 2025-06-10 Nicola Lavecchia , Sid Fadanelli , Federico Ricciuti , Gennaro Aloe , Enrico Bagli , Pietro Giuffrida , Daniele Vergari

Generative AI (GenAI) and large language models in particular, are disrupting Computer Science Education. They are proving increasingly capable at more and more challenges. Some educators argue that they pose a serious threat to computing…

Computers and Society · Computer Science 2024-07-15 Brent N. Reeves , James Prather , Paul Denny , Juho Leinonen , Stephen MacNeil , Brett A. Becker , Andrew Luxton-Reilly

Commonly, introductory programming courses in higher education institutions have hundreds of participating students eager to learn to program. The manual effort for reviewing the submitted source code and for providing feedback can no…

Human-Computer Interaction · Computer Science 2023-07-26 Gerhard Johann Hagerer , Laura Lahesoo , Miriam Anschütz , Stephan Krusche , Georg Groh

Generative AI has the potential to enhance education by providing personalized feedback to students at scale. Recent work has proposed techniques to improve AI-generated programming hints and has evaluated their performance based on…

Computers and Society · Computer Science 2025-09-04 Tung Phung , Mengyan Wu , Heeryung Choi , Gustavo Soares , Sumit Gulwani , Adish Singla , Christopher Brooks

Research on how the popularization of generative Artificial Intelligence (AI) tools impacts learning environments has led to hesitancy among educators to teach these tools in classrooms, creating two observed disconnects. Generative AI…

Computers and Society · Computer Science 2025-11-18 Anya Bardach , Hamilton Murrah

Generative AI enables students to produce plausible code quickly. Producing working code is therefore no longer a reliable indicator of understanding. This is particularly problematic in non-computer-science programmes, where time…

Computers and Society · Computer Science 2026-04-09 Christina Maria Mayr

Artificial Intelligence (AI) techniques, especially Large Language Models (LLMs), have started gaining popularity among researchers and software developers for generating source code. However, LLMs have been shown to generate code with…

Software Engineering · Computer Science 2024-11-08 Hyunjae Suh , Mahan Tafreshipour , Jiawei Li , Adithya Bhattiprolu , Iftekhar Ahmed

Investigation of students' perceptions and opinions on the use of generative artificial intelligence (GenAI) in education is a topic gaining much interest. Studies addressing this are typically conducted with large heterogeneous groups, at…

We investigate whether contemporary multimodal LLMs can assist with grading open-ended calculus at scale without eroding validity. In a large first-year exam, students' handwritten work was graded by GPT-5 against the same rubric used by…

Computers and Society · Computer Science 2025-11-14 Gerd Kortemeyer , Alexander Caspar , Daria Horica

Introductory programming courses often emphasize mastering syntax and basic constructs before progressing to more complex and interesting programs. This bottom-up approach can be frustrating for novices, shifting the focus away from problem…

Computers and Society · Computer Science 2024-10-07 Chris Kerslake , Paul Denny , David H Smith , James Prather , Juho Leinonen , Andrew Luxton-Reilly , Stephen MacNeil

The rapid advancement of Generative Artificial Intelligence (GenAI) has introduced new opportunities for transforming higher education, particularly in fields that require analytical reasoning and regulatory compliance, such as…

Computers and Society · Computer Science 2025-02-24 Mahmoud Elkhodr , Ergun Gide

Generative Artificial Intelligence (GenAI) has demonstrated its capabilities in the present world that reduce human effort significantly. It utilizes deep learning techniques to create original and realistic content in terms of text,…

Artificial Intelligence · Computer Science 2025-12-11 Aman Kumar , Deepak Narayan Gadde

The integration of AI assistants, especially through the development of Large Language Models (LLMs), into computer science education has sparked significant debate. An emerging body of work has looked into using LLMs in education, but few…

Human-Computer Interaction · Computer Science 2024-05-06 Wenhan Lyu , Yimeng Wang , Tingting , Chung , Yifan Sun , Yixuan Zhang

The rapid growth of programming education has outpaced traditional assessment tools, leaving faculty with limited means to provide meaningful, scalable feedback. Conventional autograders, while efficient, act as black-box systems that…

Artificial Intelligence · Computer Science 2025-10-31 Vikrant Sahu , Gagan Raj Gupta , Raghav Borikar , Nitin Mane

Evaluating natural language generation systems is challenging due to the diversity of valid outputs. While human evaluation is the gold standard, it suffers from inconsistencies, lack of standardisation, and demographic biases, limiting…

Computation and Language · Computer Science 2025-09-11 Hanhua Hong , Chenghao Xiao , Yang Wang , Yiqi Liu , Wenge Rong , Chenghua Lin

Modern computing students often rely on both natural-language prompting and manual code editing to solve programming tasks. Yet we still lack a clear understanding of how these two modes are combined in practice, and how their usage varies…