English
Related papers

Related papers: Zero Shot Learning for Code Education: Rubric Samp…

200 papers

Current methods for prompt learning in zeroshot scenarios widely rely on a development set with sufficient human-annotated data to select the best-performing prompt template a posteriori. This is not ideal because in a realworld zero-shot…

Computation and Language · Computer Science 2023-05-17 Jinghui Lu , Dongsheng Zhu , Weidong Han , Rui Zhao , Brian Mac Namee , Fei Tan

In programming education, providing manual feedback is essential but labour-intensive, posing challenges in consistency and timeliness. We introduce ECHO, a machine learning method to automate the reuse of feedback in educational code…

Software Engineering · Computer Science 2024-05-06 Charlotte Van Petegem , Kasper Demeyere , Rien Maertens , Niko Strijbol , Bram De Wever , Bart Mesuere , Peter Dawyndt

In shared autonomy, user input is combined with semi-autonomous control to achieve a common goal. The goal is often unknown ex-ante, so prior work enables agents to infer the goal from user input and assist with the task. Such methods tend…

Machine Learning · Computer Science 2018-05-24 Siddharth Reddy , Anca D. Dragan , Sergey Levine

Automated feedback systems have become increasingly integral to programming education, where learners engage in iterative cycles of code construction, testing, and refinement. Despite its wider integration in practices and technical…

Computers and Society · Computer Science 2026-02-03 Yeonji Jung , Yunseo Lee , Jiyeong Bae , DoYong Kim , Heungsoo Choi , Minji Kang , Unggi Lee

The growing need for automated and personalized feedback in programming education has led to recent interest in leveraging generative AI for feedback generation. However, current approaches tend to rely on prompt engineering techniques in…

Computers and Society · Computer Science 2025-09-16 Victor-Alexandru Pădurean , Tung Phung , Nachiket Kotalwar , Michael Liut , Juho Leinonen , Paul Denny , Adish Singla

A major challenge in Natural Language Processing is obtaining annotated data for supervised learning. An option is the use of crowdsourcing platforms for data annotation. However, crowdsourcing introduces issues related to the annotator's…

Recent successes combine reinforcement learning algorithms and deep neural networks, despite reinforcement learning not being widely applied to robotics and real world scenarios. This can be attributed to the fact that current…

Machine Learning · Computer Science 2020-09-01 Vinicius G. Goecks

Deep reinforcement learning (RL) has shown great empirical successes, but suffers from brittleness and sample inefficiency. A potential remedy is to use a previously-trained policy as a source of supervision. In this work, we refer to these…

Machine Learning · Computer Science 2021-09-16 Daniel Seita , Abhinav Gopal , Zhao Mandi , John Canny

We present a new method for automatically providing feedback for introductory programming problems. In order to use this method, we need a reference implementation of the assignment, and an error model consisting of potential corrections to…

Programming Languages · Computer Science 2012-11-19 Rishabh Singh , Sumit Gulwani , Armando Solar-Lezama

The feedback provided by current testing education tools about the deficiencies in a student's test suite either mimics industry code coverage tools or lists specific instructor test cases that are missing from the student's test suite.…

Software Engineering · Computer Science 2020-11-30 Lucas Cordova , Jeffrey Carver , Gursimran Walia , Noah Gershmel

Providing feedback is an integral part of teaching. Most open online courses on programming make use of automated grading systems to support programming assignments and give real-time feedback. These systems usually rely on test results to…

Software Engineering · Computer Science 2019-05-30 Rahul Gupta , Aditya Kanade , Shirish Shevade

In this paper we consider a version of the zero-shot learning problem where seen class source and target domain data are provided. The goal during test-time is to accurately predict the class label of an unseen target domain instance based…

Computer Vision and Pattern Recognition · Computer Science 2015-09-29 Ziming Zhang , Venkatesh Saligrama

Predicting the runtime complexity of a programming code is an arduous task. In fact, even for humans, it requires a subtle analysis and comprehensive knowledge of algorithms to predict time complexity with high fidelity, given any code. As…

Machine Learning · Computer Science 2019-11-05 Jagriti Sikka , Kushal Satya , Yaman Kumar , Shagun Uppal , Rajiv Ratn Shah , Roger Zimmermann

In this article, we introduce and evaluate the concept of robosourcing for creating educational content. Robosourcing lies in the intersection of crowdsourcing and large language models, where instead of a crowd of humans, requests to large…

Human-Computer Interaction · Computer Science 2022-11-10 Paul Denny , Sami Sarsa , Arto Hellas , Juho Leinonen

Learning program representations has been the core prerequisite of code intelligent tasks such as code search and code clone detection. The state-of-the-art pre-trained models such as CodeBERT require the availability of large-scale code…

Software Engineering · Computer Science 2022-04-19 Nan Cui , Yuze Jiang , Xiaodong Gu , Beijun Shen

Rubrics and oral feedback are approaches to help students improve performance and meet learning outcomes. However, their effect on the actual improvement achieved is inconclusive. This paper evaluates the effect of rubrics and oral feedback…

Software Engineering · Computer Science 2023-07-25 Sebastian Barney , Mahvish Khurum , Kai Petersen , Michael Unterkalmsteiner , Ronald Jabangwe

Providing feedback on programming assignments is a tedious task for the instructor, and even impossible in large Massive Open Online Courses with thousands of students. Previous research has suggested that program repair techniques can be…

Programming Languages · Computer Science 2018-06-21 Sumit Gulwani , Ivan Radiček , Florian Zuleger

Robots are extending their presence in domestic environments every day, being more common to see them carrying out tasks in home scenarios. In the future, robots are expected to increasingly perform more complex tasks and, therefore, be…

Artificial Intelligence · Computer Science 2020-09-22 Ithan Moreira , Javier Rivas , Francisco Cruz , Richard Dazeley , Angel Ayala , Bruno Fernandes

Understanding students' misconceptions is important for effective teaching and assessment. However, discovering such misconceptions manually can be time-consuming and laborious. Automated misconception discovery can address these challenges…

Machine Learning · Computer Science 2021-03-09 Yang Shi , Krupal Shah , Wengran Wang , Samiha Marwan , Poorvaja Penmetsa , Thomas W. Price

Developing models to automatically score students' written responses to science problems is critical for science education. However, collecting and labeling sufficient student responses for training models is time and cost-consuming. Recent…

Computation and Language · Computer Science 2023-11-21 Xuansheng Wu , Xinyu He , Tianming Liu , Ninghao Liu , Xiaoming Zhai