English
Related papers

Related papers: Practical Program Repair in the Era of Large Pre-t…

200 papers

Automated Program Repair (APR) has evolved significantly with the advent of Large Language Models (LLMs). Fine-tuning LLMs for program repair is a recent avenue of research, with many dimensions which have not been explored. Existing work…

Software Engineering · Computer Science 2025-09-08 André Silva , Sen Fang , Martin Monperrus

Automated Program Repair (APR) aims to fix bugs by generating patches. And existing work has demonstrated that "pre-training and fine-tuning" paradigm enables Large Language Models (LLMs) improve fixing capabilities on APR. However,…

Software Engineering · Computer Science 2024-09-13 Guochang Li , Chen Zhi , Jialiang Chen , Junxiao Han , Shuiguang Deng

Bug fixing and code generation have been core research topics in software development for many years. The recent explosive growth in Large Language Models has completely transformed these spaces, putting in reach incredibly powerful tools…

Artificial Intelligence · Computer Science 2024-11-13 Avinash Anand , Akshit Gupta , Nishchay Yadav , Shaurya Bajaj

Automatic Program Repair (APR) has garnered significant attention as a practical research domain focused on automatically fixing bugs in programs. While existing APR techniques primarily target imperative programming languages like C and…

Software Engineering · Computer Science 2025-06-13 Mohannad Alhanahnah , Md Rashedul Hasan , Lisong Xu , Hamid Bagheri

Large language models such as Codex, have shown the capability to produce code for many programming tasks. However, the success rate of existing models is low, especially for complex programming tasks. One of the reasons is that language…

Software Engineering · Computer Science 2023-01-03 Zhiyu Fan , Xiang Gao , Martin Mirchev , Abhik Roychoudhury , Shin Hwei Tan

Recently, multiple Automated Program Repair (APR) techniques based on Large Language Models (LLMs) have been proposed to enhance the repair performance. While these techniques mainly focus on the single-line or hunk-level repair, they face…

Software Engineering · Computer Science 2024-11-01 Jiahong Xiang , Xiaoyang Xu , Fanchu Kong , Mingyuan Wu , Zizheng Zhang , Haotian Zhang , Yuqun Zhang

Students often make mistakes on their introductory programming assignments as part of their learning process. Unfortunately, providing custom repairs for these mistakes can require a substantial amount of time and effort from class…

Software Engineering · Computer Science 2022-09-30 Jialu Zhang , José Cambronero , Sumit Gulwani , Vu Le , Ruzica Piskac , Gustavo Soares , Gust Verbruggen

Automated Program Repair (APR) aims to automatically fix bugs in the source code. Recently, as advances in Deep Learning (DL) field, there is a rise of Neural Program Repair (NPR) studies, which formulate APR as a translation task from…

Software Engineering · Computer Science 2022-09-22 Wenkang Zhong , Chuanyi Li , Jidong Ge , Bin Luo

The gap between the trepidation of program reliability and the expense of repairs underscores the indispensability of Automated Program Repair (APR). APR is instrumental in transforming vulnerable programs into more robust ones, bolstering…

Software Engineering · Computer Science 2024-08-22 Yuze Zhao , Zhenya Huang , Yixiao Ma , Rui Li , Kai Zhang , Hao Jiang , Qi Liu , Linbo Zhu , Yu Su

Automatic program repair (APR) has recently gained attention because it proposes to fix software defects with no human intervention. To automatically fix defects, most APR tools use the developer-written tests to (a) localize the defect,…

Software Engineering · Computer Science 2021-04-19 Manish Motwani

APR (Automated Program Repair) aims to automatically locate program defects, generate patches and validate the repairs. Existing techniques for APR are often combined with LLMs (Large Language Models), which leverages the code-related…

Software Engineering · Computer Science 2025-07-31 Haichuan Hu , Xiaochen Xie , Quanjun Zhang

Automated Program Repair (APR) aims to enhance software reliability by automatically generating bug-fixing patches. Recent work has improved the state-of-the-art of APR by fine-tuning pre-trained large language models (LLMs), such as…

Software Engineering · Computer Science 2025-04-03 Xuemeng Cai , Lingxiao Jiang

Large language models (LLMs) have achieved decent results on automated program repair (APR). However, the next token prediction training objective of decoder-only LLMs (e.g., GPT-4) is misaligned with the masked span prediction objective of…

Software Engineering · Computer Science 2025-02-24 Junjielong Xu , Ying Fu , Shin Hwei Tan , Pinjia He

Software defects are an inherent part of software development and maintenance. To address these defects, Automated Program Repair (APR) has been developed to fix bugs automatically. With the advent of Large Language Models, Code Language…

Software Engineering · Computer Science 2024-08-27 Yunan Wang , Tingyu Guo , Zilong Huang , Yuan Yuan

Sequence-to-sequence models have been used to transform erroneous programs into correct ones when trained with a large enough dataset. Some recent studies also demonstrated strong empirical evidence that code review could improve the…

Machine Learning · Computer Science 2023-07-25 Rishov Paul , Md. Mohib Hossain , Mohammed Latif Siddiq , Masum Hasan , Anindya Iqbal , Joanna C. S. Santos

Large Language Model (LLM) - based Automated Program Repair (APR) systems are increasingly integrated into modern software development workflows, offering automated patches in response to natural language bug reports. However, this reliance…

Software Engineering · Computer Science 2026-05-26 Piotr Przymus , Andreas Happe , Jürgen Cito

Research shows that errors in natural language can be corrected by translating texts to another language and back using language models. We explore to what extent this latent correction capability extends to Automated Program Repair (APR)…

Software Engineering · Computer Science 2025-10-16 Fernando Vallecillos Ruiz , Anastasiia Grishina , Max Hort , Leon Moonen

Automated generation of feedback on programming assignments holds significant benefits for programming education, especially when it comes to advanced assignments. Automated Program Repair techniques, especially Large Language Model based…

Software Engineering · Computer Science 2024-04-03 Qianhui Zhao , Fang Liu , Li Zhang , Yang Liu , Zhen Yan , Zhenghao Chen , Yufei Zhou , Jing Jiang , Ge Li

In recent years, Automated Program Repair (APR) has been extensively studied in academia and even drawn wide attention from industry. However, APR techniques can be extremely time consuming since (1) a large number of patches can be…

Software Engineering · Computer Science 2024-07-03 Yiling Lou , Jun Yang , Samuel Benton , Dan Hao , Lin Tan , Zhenpeng Chen , Lu Zhang , Lingming Zhang

Background: Large language models (LLMs) have greatly improved the accuracy of automated program repair (APR) methods. However, LLMs are constrained by high computational resource requirements. Aims: We focus on small language models…

Software Engineering · Computer Science 2025-08-25 Kazuki Kusama , Honglin Shu , Masanari Kondo , Yasutaka Kamei