English
Related papers

Related papers: A Survey on Feedback Types in Automated Programmin…

200 papers

With the rapid advancement of artificial intelligence (AI) in various domains, the education sector is set for transformation. The potential of AI-driven tools in enhancing the learning experience, especially in programming, is immense.…

Software Engineering · Computer Science 2024-04-08 Eduard Frankford , Clemens Sauerwein , Patrick Bassner , Stephan Krusche , Ruth Breu

Text-based open-ended questions in academic formative and summative assessments help students become deep learners and prepare them to understand concepts for a subsequent conceptual assessment. However, grading text-based questions,…

Computers and Society · Computer Science 2024-01-17 Rujun Gao , Hillary E. Merzdorf , Saira Anwar , M. Cynthia Hipwell , Arun Srinivasa

Generative AI (GenAI) models have broad implications for education in general, impacting the foundations of what we teach and how we assess. This is especially true in computing, where LLMs tuned for coding have demonstrated shockingly good…

Identifying logical errors in complex, incomplete or even contradictory and overall heterogeneous data like students' experimentation protocols is challenging. Recognizing the limitations of current evaluation methods, we investigate the…

Artificial Intelligence · Computer Science 2024-09-20 Arne Bewersdorff , Kathrin Seßler , Armin Baur , Enkelejda Kasneci , Claudia Nerdel

AI tools, particularly large language modules, have recently proven their effectiveness within learning management systems and online education programmes. As feedback continues to play a crucial role in learning and assessment in schools,…

Human-Computer Interaction · Computer Science 2024-10-17 Ievgeniia Kuzminykh , Tareita Nawaz , Shihao Shenzhang , Bogdan Ghita , Jeffery Raphael , Hannan Xiao

The rapid integration of Large Language Models (LLMs) into software engineering practice is reshaping how software testing activities are performed. LLMs are increasingly used to support software testing. Consequently, software testing…

Software Engineering · Computer Science 2026-03-30 Peng Yang , Yunfeng Zhu , Chao Chang , Shengcheng Yu , Zhenyu Chen , Yong Tang

The integration of AI assistants, especially through the development of Large Language Models (LLMs), into computer science education has sparked significant debate. An emerging body of work has looked into using LLMs in education, but few…

Human-Computer Interaction · Computer Science 2024-05-06 Wenhan Lyu , Yimeng Wang , Tingting , Chung , Yifan Sun , Yixuan Zhang

Grading assessments is time-consuming and prone to human bias. Students may experience delays in receiving feedback that may not be tailored to their expectations or needs. Harnessing AI in education can be effective for grading…

Physics Education · Physics 2025-12-01 Ryan Mok , Faraaz Akhtar , Louis Clare , Christine Li , Jun Ida , Lewis Ross , Mario Campanelli

The field of Artificial Intelligence in Education (AIED) focuses on the intersection of technology, education, and psychology, placing a strong emphasis on supporting learners' needs with compassion and understanding. The growing prominence…

Human-Computer Interaction · Computer Science 2024-05-14 John Stamper , Ruiwei Xiao , Xinying Hou

Advancements in Large Language Models (LLMs), such as ChatGPT, offer significant opportunities to enhance instructional support in introductory programming courses. While extensive research has explored the effectiveness of LLMs in…

Human-Computer Interaction · Computer Science 2025-05-09 Muntasir Hoq , Jessica Vandenberg , Shuyin Jiao , Seung Lee , Bradford Mott , Narges Norouzi , James Lester , Bita Akram

Students in introductory physics courses often rely on ineffective strategies, focusing on final answers rather than understanding underlying principles. Integrating scientific argumentation into problem-solving fosters critical thinking…

Physics Education · Physics 2025-08-21 Winter Allen , Anand Shanker , N. Sanjay Rebello

Providing effective feedback is important for student learning in programming problem-solving. In this sense, Large Language Models (LLMs) have emerged as potential tools to automate feedback generation. However, their reliability and…

Software Engineering · Computer Science 2025-03-20 Priscylla Silva , Evandro Costa

Providing feedback on programming assignments manually is a tedious, error prone, and time-consuming task. In this paper, we motivate and address the problem of generating feedback on performance aspects in introductory programming…

Programming Languages · Computer Science 2014-09-18 Sumit Gulwani , Ivan Radiček , Florian Zuleger

Traditional end-of-quarter surveys often fail to provide instructors with timely, detailed, and actionable feedback about their teaching. In this paper, we explore how Large Language Model (LLM)-powered chatbots can reimagine the classroom…

Computers and Society · Computer Science 2025-08-19 Sai Siddartha Maram , Ulia Zaman , Magy Seif El-Nasr

The assessment of program functionality can generally be accomplished with straight-forward unit tests. However, assessing the design quality of a program is a much more difficult and nuanced problem. Design quality is an important…

Software Engineering · Computer Science 2021-06-04 J. Walker Orr , Nathaniel Russell

Recent advances in AI, machine learning, and NLP have led to the development of a new generation of Large Language Models (LLMs) that are trained on massive amounts of data and often have trillions of parameters. Commercial applications…

Computation and Language · Computer Science 2024-04-05 Nishat Raihan , Dhiman Goswami , Sadiya Sayara Chowdhury Puspo , Christian Newman , Tharindu Ranasinghe , Marcos Zampieri

This study investigates the use of generative AI and multi-agent systems to provide automatic feedback in educational contexts, particularly for student constructed responses in science assessments. The research addresses a key gap in the…

Computation and Language · Computer Science 2024-11-13 Shuchen Guo , Ehsan Latif , Yifan Zhou , Xuan Huang , Xiaoming Zhai

The effectiveness of feedback in enhancing learning outcomes is well documented within Educational Data Mining (EDM). Various prior research has explored methodologies to enhance the effectiveness of feedback. Recent developments in Large…

Computers and Society · Computer Science 2024-11-15 Sami Baral , Eamon Worden , Wen-Chiang Lim , Zhuang Luo , Christopher Santorelli , Ashish Gurung , Neil Heffernan

This Innovative Practice full paper explores how Large Language Models (LLMs) can enhance the teaching of code refactoring in software engineering courses through real-time, context-aware feedback. Refactoring improves code quality but is…

Software Engineering · Computer Science 2025-08-14 Anshul Khairnar , Aarya Rajoju , Edward F. Gehringer

Large language models (LLMs) can act as evaluators, a role studied by methods like LLM-as-a-Judge and fine-tuned judging LLMs. In the field of education, LLMs have been studied as assistant tools for students and teachers. Our research…

Computation and Language · Computer Science 2025-09-26 Valeria Ramirez-Garcia , David de-Fitero-Dominguez , Antonio Garcia-Cabot , Eva Garcia-Lopez