English
Related papers

Related papers: RePair: Automated Program Repair with Process-base…

200 papers

Large language models (LLMs) inevitably make mistakes when performing step-by-step mathematical reasoning. Process Reward Models (PRMs) have emerged as a promising solution by evaluating each reasoning step. However, existing PRMs typically…

Computation and Language · Computer Science 2025-03-28 Shuaijie She , Junxiao Liu , Yifeng Liu , Jiajun Chen , Xin Huang , Shujian Huang

Retrieval-Augmented Generation (RAG) systems for Large Language Models (LLMs) hold promise in knowledge-intensive tasks but face limitations in complex multi-step reasoning. While recent methods have integrated RAG with chain-of-thought…

Computation and Language · Computer Science 2025-01-15 Zhongxiang Sun , Qipeng Wang , Weijie Yu , Xiaoxue Zang , Kai Zheng , Jun Xu , Xiao Zhang , Song Yang , Han Li

Program repair is an integral part of every software system's life-cycle but can be extremely challenging. To date, researchers have proposed various automated program repair (APR) techniques to reduce efforts of manual debugging. However,…

Software Engineering · Computer Science 2021-04-13 Samuel Benton , Mengshi Zhang , Xia Li , Lingming Zhang

The advance in machine learning (ML)-driven natural language process (NLP) points a promising direction for automatic bug fixing for software programs, as fixing a buggy program can be transformed to a translation task. While software…

Software Engineering · Computer Science 2021-07-20 Wenshuo Wang , Chen Wu , Liang Cheng , Yang Zhang

Fine-tuning and inference with large Language Models (LM) are generally known to be expensive. Parameter-efficient fine-tuning over pretrained LMs reduces training memory by updating a small number of LM parameters but does not improve…

Computation and Language · Computer Science 2024-06-05 Bowen Zhao , Hannaneh Hajishirzi , Qingqing Cao

In introductory programming courses, it is challenging for instructors to provide debugging feedback on students' incorrect programs. Some recent tools automatically offer program repair feedback by identifying any differences between…

Software Engineering · Computer Science 2021-07-15 Yunlong Lu , Na Meng , Wenxin Li

This work investigates the performance of Large Language Models (LLMs) in generating ABAP code. Despite successful applications of generative AI in many programming languages, there are hardly any systematic analyses of ABAP code generation…

Software Engineering · Computer Science 2026-01-22 Stephan Wallraven , Tim Köhne , Hartmut Westenberger , Andreas Moser

Learning-based automated vulnerability repair (AVR) techniques that utilize fine-tuned language models have shown promise in generating vulnerability patches. However, questions remain about their ability to repair unseen vulnerabilities.…

Software Engineering · Computer Science 2025-12-30 Woorim Han , Yeongjun Kwak , Miseon Yu , Kyeongmin Kim , Younghan Lee , Hyungon Moon , Yunheung Paek

Large language models (LLMs) exhibit remarkable performance across various NLP tasks. However, they often generate incorrect or hallucinated information, which hinders their practical applicability in real-world scenarios. Human feedback…

Computation and Language · Computer Science 2023-05-24 Wenhao Yu , Zhihan Zhang , Zhenwen Liang , Meng Jiang , Ashish Sabharwal

Properly benchmarking Automated Program Repair (APR) systems should contribute to the development and adoption of the research outputs by practitioners. To that end, the research community must ensure that it reaches significant milestones…

Software Engineering · Computer Science 2019-02-18 Kui Liu , Anil Koyuncu , Tegawendé F. Bissyandé , Dongsun Kim , Jacques Klein , Yves Le Traon

Current automated program repair (APR) techniques are far from being practical and useful enough to be considered for realistic debugging. They rely on unrealistic assumptions including the requirement of a comprehensive suite of test cases…

Software Engineering · Computer Science 2024-07-15 Qi Xin , Haojun Wu , Steven P. Reiss , Jifeng Xuan

The existing deep learning (DL)-based automated program repair (APR) models are limited in fixing general software defects. % We present {\tool}, a DL-based approach that supports fixing for the general bugs that require dependent changes…

Software Engineering · Computer Science 2022-05-05 Yi Li , Shaohua Wang , Tien N. Nguyen

Code generation is a core application of large language models (LLMs), yet LLMs still frequently fail on complex programming tasks. Given its success in mathematical reasoning, test-time scaling approaches such as Process Reward Model…

Machine Learning · Computer Science 2026-02-02 Ruiyi Zhang , Peijia Qin , Qi Cao , Eric Xue , Pengtao Xie

The emergence of large language models (LLMs) has sparked enormous interest due to their potential application across a range of educational tasks. For example, recent work in programming education has used LLMs to generate learning…

Software Engineering · Computer Science 2024-05-10 Charles Koutcheme , Nicola Dainese , Sami Sarsa , Juho Leinonen , Arto Hellas , Paul Denny

Automatic program repair (APR) is crucial to reduce manual debugging efforts for developers and improve software reliability. While conventional search-based techniques typically rely on heuristic rules or a redundancy assumption to mine…

Software Engineering · Computer Science 2023-09-13 Weishi Wang , Yue Wang , Shafiq Joty , Steven C. H. Hoi

Large Language Models (LLMs) have revolutionized automated program repair (APR) but current benchmarks like SWE-Bench predominantly focus on userspace applications and overlook the complexities of kernel-space debugging and repair. The…

Software Engineering · Computer Science 2025-11-21 Kareem Shehada , Yifan Wu , Wyatt D. Feng , Adithya Iyer , Gryphon Kumfert , Yangruibo Ding , Zhiyun Qian

Automated program repair (APR) aims to fix software bugs automatically without human debugging efforts and plays a crucial role in software development and maintenance. Despite promising, APR is still challenged by a long-standing…

Software Engineering · Computer Science 2024-01-17 Quanjun Zhang , Chunrong Fang , Weisong Sun , Yan Liu , Tieke He , Xiaodong Hao , Zhenyu Chen

Automated program repair has emerged as a powerful technique to mitigate the impact of software bugs on system reliability and user experience. This paper introduces RepairAgent, the first work to address the program repair challenge…

Software Engineering · Computer Science 2024-10-29 Islem Bouzenia , Premkumar Devanbu , Michael Pradel

To date, over 40 Automated Program Repair (APR) tools have been designed with varying bug-fixing strategies, which have been demonstrated to have complementary performance in terms of being effective for different bug classes. Intuitively,…

Software Engineering · Computer Science 2023-09-18 Wenkang Zhong , Chuanyi Li , Kui Liu , Tongtong Xu , Tegawendé F. Bissyandé , Jidong Ge , Bin Luo , Vincent Ng

Large Language Models (LLMs) demonstrate strong potential for automated code generation, yet their ability to iteratively refine solutions using execution feedback remains underexplored. Competitive programming offers an ideal testbed for…

Software Engineering · Computer Science 2026-05-19 Anika Tabassum , Md Sifat Hossain , Md. Fahim Arefin , Tariqul Islam , Tarannum Shaila Zaman