English
Related papers

Related papers: Leveraging Mutation Analysis for LLM-based Repair …

200 papers

Multi-agent frameworks with Large Language Models (LLMs) have become promising tools for generating general-purpose programming languages using test-driven development, allowing developers to create more accurate and robust code. However,…

Quantum Physics · Physics 2025-07-04 Charlie Campbell , Hao Mark Chen , Wayne Luk , Hongxiang Fan

Fine-tuning and inference with large Language Models (LM) are generally known to be expensive. Parameter-efficient fine-tuning over pretrained LMs reduces training memory by updating a small number of LM parameters but does not improve…

Computation and Language · Computer Science 2024-06-05 Bowen Zhao , Hannaneh Hajishirzi , Qingqing Cao

Large Language Models (LLMs) achieve strong program repair performance but often suffer from over-editing, where excessive modifications overwrite correct code and hinder bug localization. We systematically quantify its impact and introduce…

Software Engineering · Computer Science 2026-04-08 Changxin Ke , Rui Zhang , Jiaming Guo , Yuanbo Wen , Li Ding , Shuo Wang , Xuyuan Zhu , Xiong Peng , Di Huang , Zidong Du , Xing Hu , Qi Guo , Yunji Chen

In this paper, we propose shifting the focus of robustness evaluation for Neural Program Repair (NPR) techniques toward naturally-occurring data transformations. To accomplish this, we first examine the naturalness of semantic-preserving…

Software Engineering · Computer Science 2024-11-14 Thanh Le-Cong , Dat Nguyen , Bach Le , Toby Murray

Programming is increasingly taught using block-based languages like Scratch. While the use of blocks prevents syntax errors, learners can still make semantic mistakes, requiring feedback and help. As teachers may be overwhelmed by help…

Software Engineering · Computer Science 2025-04-18 Sebastian Schweikl , Gordon Fraser

Recently, multiple Automated Program Repair (APR) techniques based on Large Language Models (LLMs) have been proposed to enhance the repair performance. While these techniques mainly focus on the single-line or hunk-level repair, they face…

Software Engineering · Computer Science 2024-11-01 Jiahong Xiang , Xiaoyang Xu , Fanchu Kong , Mingyuan Wu , Zizheng Zhang , Haotian Zhang , Yuqun Zhang

Large language models (LLMs) are reshaping automated program repair. We present a unified taxonomy that groups 62 recent LLM-based repair systems into four paradigms defined by parameter adaptation and control authority over the repair…

Software Engineering · Computer Science 2025-12-05 Boyang Yang , Zijian Cai , Fengling Liu , Bach Le , Lingming Zhang , Tegawendé F. Bissyandé , Yang Liu , Haoye Tian

Automated generation of feedback on programming assignments holds significant benefits for programming education, especially when it comes to advanced assignments. Automated Program Repair techniques, especially Large Language Model based…

Software Engineering · Computer Science 2024-04-03 Qianhui Zhao , Fang Liu , Li Zhang , Yang Liu , Zhen Yan , Zhenghao Chen , Yufei Zhou , Jing Jiang , Ge Li

In recent years, Automated Program Repair (APR) has been extensively studied in academia and even drawn wide attention from industry. However, APR techniques can be extremely time consuming since (1) a large number of patches can be…

Software Engineering · Computer Science 2024-07-03 Yiling Lou , Jun Yang , Samuel Benton , Dan Hao , Lin Tan , Zhenpeng Chen , Lu Zhang , Lingming Zhang

In this paper, we first show that increases in beam size, even for small-sized LLMs (1B-7B params), require extensive GPU usage, leading to up to 80% of recurring crashes due to memory overloads in LLM-based APR. Seemingly simple solutions…

Software Engineering · Computer Science 2025-10-20 Thanh Le-Cong , Bach Le , Toby Murray

Correcting bugs using modern Automated Program Repair (APR) can be both time-consuming and resource-expensive. We describe a program repair approach that aims to improve the scalability of modern APR tools. The approach leverages program…

Software Engineering · Computer Science 2024-08-05 Linas Vidziunas , David Binkley , Leon Moonen

Automated program repair techniques aim to aid software developers with the challenging task of fixing bugs. In heuristic-based program repair, a search space of program variants, created via mutations on software, is explored to find…

Software Engineering · Computer Science 2024-05-07 Carol Hanna , Aymeric Blot , Justyna Petke

Large Language Model (LLM) - based Automated Program Repair (APR) systems are increasingly integrated into modern software development workflows, offering automated patches in response to natural language bug reports. However, this reliance…

Software Engineering · Computer Science 2026-05-26 Piotr Przymus , Andreas Happe , Jürgen Cito

Large language models (LLMs) have achieved decent results on automated program repair (APR). However, the next token prediction training objective of decoder-only LLMs (e.g., GPT-4) is misaligned with the masked span prediction objective of…

Software Engineering · Computer Science 2025-02-24 Junjielong Xu , Ying Fu , Shin Hwei Tan , Pinjia He

Large Language Models (LLMs) have recently shown strong potential in automatic program repair (APR), especially in repository-level settings where the goal is to generate patches based on natural language issue descriptions, large…

Software Engineering · Computer Science 2025-10-07 Anvith Pabba , Simin Chen , Alex Mathai , Anindya Chakraborty , Baishakhi Ray

This research addresses the complex challenge of automated repair of code vulnerabilities, vital for enhancing digital security in an increasingly technology-driven world. The study introduces a novel and efficient format for the…

Software Engineering · Computer Science 2024-10-04 David de-Fitero-Dominguez , Eva Garcia-Lopez , Antonio Garcia-Cabot , Jose-Javier Martinez-Herraiz

Code review is a critical practice in software engineering, yet the growing scale and frequency of code patches in modern projects, together with the widespread adoption of AI code assistants, make manual review increasingly challenging.…

Software Engineering · Computer Science 2026-05-26 Bar Weiss , Antonio Abu-Nassar , Adi Sosnovich , Karen Yorav

Automated program repair (APR) has attracted great research attention, and various techniques have been proposed. Search-based APR is one of the most important categories among these techniques. Existing researches focus on the design of…

Software Engineering · Computer Science 2017-07-18 Ming Wen , Junjie Chen , Rongxin Wu , Dan Hao , Shing-Chi Cheung

Automated program repair (APR) aims to fix software bugs without human intervention and template-based APR has been widely investigated with promising results. However, it is challenging for template-based APR to select the appropriate…

Software Engineering · Computer Science 2023-09-19 Quanjun Zhang , Chunrong Fang , Tongke Zhang , Bowen Yu , Weisong Sun , Zhenyu Chen

Automated Program Repair (APR) techniques aim to automatically fix buggy programs. Among these, Large Language Model-based (LLM-based) approaches have shown great promise. Recent advances demonstrate that directly leveraging LLMs can…

Software Engineering · Computer Science 2025-07-01 Jiayi Zhang , Kai Huang , Jian Zhang , Yang Liu , Chunyang Chen