English
Related papers

Related papers: Evaluating Pre-trained Language Models for Repairi…

200 papers

Automated Program Repair (APR) is defined as the process of fixing a bug/defect in the source code, by an automated tool. APR tools have recently experienced promising results by leveraging state-of-the-art Neural Language Processing (NLP)…

Software Engineering · Computer Science 2023-01-13 Armin Zirak , Hadi Hemmati

The exponential increase in software vulnerabilities has created an urgent need for automatic vulnerability repair (AVR) solutions. Recent research has formulated AVR as a sequence generation problem and has leveraged large language models…

Artificial Intelligence · Computer Science 2025-10-08 Xin-Cheng Wen , Zirui Lin , Yijun Yang , Cuiyun Gao , Deheng Ye

Programming is increasingly taught using block-based languages like Scratch. While the use of blocks prevents syntax errors, learners can still make semantic mistakes, requiring feedback and help. As teachers may be overwhelmed by help…

Software Engineering · Computer Science 2025-04-18 Sebastian Schweikl , Gordon Fraser

Large language models (LLMs) have achieved decent results on automated program repair (APR). However, the next token prediction training objective of decoder-only LLMs (e.g., GPT-4) is misaligned with the masked span prediction objective of…

Software Engineering · Computer Science 2025-02-24 Junjielong Xu , Ying Fu , Shin Hwei Tan , Pinjia He

Recent breakthroughs in pre-trained code models, such as CodeBERT and Codex, have shown their superior performance in various downstream tasks. The correctness and unambiguity of API usage among these code models are crucial for achieving…

Software Engineering · Computer Science 2023-09-15 Terry Yue Zhuo , Xiaoning Du , Zhenchang Xing , Jiamou Sun , Haowei Quan , Li Li , Liming Zhu

[...] Since then, various APR approaches, especially those leveraging the power of large language models (LLMs), have been rapidly developed to fix general software bugs. Unfortunately, the effectiveness of these advanced techniques in the…

Software Engineering · Computer Science 2025-06-17 Anh Ho , Thanh Le-Cong , Bach Le , Christine Rizkallah

Automated program repair (APR) aims to fix software bugs without human intervention and template-based APR has been widely investigated with promising results. However, it is challenging for template-based APR to select the appropriate…

Software Engineering · Computer Science 2023-09-19 Quanjun Zhang , Chunrong Fang , Tongke Zhang , Bowen Yu , Weisong Sun , Zhenyu Chen

In supporting the development of high-quality software, especially necessary in the era of LLMs, automated program repair (APR) tools aim to improve code quality by automatically addressing violations detected by static analysis profilers.…

Software Engineering · Computer Science 2025-08-22 Sumudu Liyanage , Sherlock A. Licorish , Markus Wagner , Stephen G. MacDonell

Automatic program repair (APR) has recently gained attention because it proposes to fix software defects with no human intervention. To automatically fix defects, most APR tools use the developer-written tests to (a) localize the defect,…

Software Engineering · Computer Science 2021-04-19 Manish Motwani

Various Deep Learning-based approaches with pre-trained language models have been proposed for automatically repairing software vulnerabilities. However, these approaches are limited to a specific programming language (C/C++). Recent…

Software Engineering · Computer Science 2025-08-06 Dong wang , Junji Yu , Honglin Shu , Michael Fu , Chakkrit Tantithamthavorn , Yasutaka Kamei , Junjie Chen

Large Language Models (LLMs) perform well on automatic program repair (APR) for high-resource programming languages (HRPLs), but their effectiveness drops sharply in low-resource programming languages (LRPLs), due to a lack of sufficient…

Software Engineering · Computer Science 2026-05-26 Zhipeng Wang , Boyang Yang , Yidong Wan , Liuye Guo , You Lv , Tao Zheng , Zhuowei Wang , Tieke He

LLM-based automated program repair methods have attracted significant attention for their state-of-the-art performance. However, they were primarily evaluated on a few well known datasets like Defects4J, raising questions about their…

Software Engineering · Computer Science 2025-03-13 Fengjie Li , Jiajun Jiang , Jiajun Sun , Hongyu Zhang

Automated Program Repair (APR) plays a critical role in enhancing the quality and reliability of software systems. While substantial progress has been made in Java-based APR, largely facilitated by benchmarks like Defects4J, there remains a…

Software Engineering · Computer Science 2025-12-03 Jian Wang , Xiaofei Xie , Qiang Hu , Shangqing Liu , Jiongchi Yu , Jiaolong Kong , Yi Li

Program repair techniques offer cost-saving benefits for debugging within software development and programming education scenarios. With the proven effectiveness of Large Language Models (LLMs) in code-related tasks, researchers have…

Software Engineering · Computer Science 2024-07-09 Boyang Yang , Haoye Tian , Weiguo Pian , Haoran Yu , Haitao Wang , Jacques Klein , Tegawendé F. Bissyandé , Shunfu Jin

Language models have improved by orders of magnitude with the recent emergence of Transformer-based Large Language Models (LLMs). LLMs have demonstrated their ability to generate natural code that is highly similar to code written by…

Software Engineering · Computer Science 2024-04-24 Aidan Z. H. Yang , Sophia Kolak , Vincent J. Hellendoorn , Ruben Martins , Claire Le Goues

Automated Program Repair (APR) aims to automatically generate patches for rectifying software bugs. Recent strides in Large Language Models (LLM), such as ChatGPT, have yielded encouraging outcomes in APR, especially within the…

Software Engineering · Computer Science 2025-11-25 Jiaolong Kong , Mingfei Cheng , Xiaofei Xie , Shangqing Liu , Xiaoning Du , Qi Guo

Automated Program Repair (APR) aims to automatically fix bugs in the source code. Recently, as advances in Deep Learning (DL) field, there is a rise of Neural Program Repair (NPR) studies, which formulate APR as a translation task from…

Software Engineering · Computer Science 2022-09-22 Wenkang Zhong , Chuanyi Li , Jidong Ge , Bin Luo

Learning-based automated vulnerability repair (AVR) techniques that utilize fine-tuned language models have shown promise in generating vulnerability patches. However, questions remain about their ability to repair unseen vulnerabilities.…

Software Engineering · Computer Science 2025-12-30 Woorim Han , Yeongjun Kwak , Miseon Yu , Kyeongmin Kim , Younghan Lee , Hyungon Moon , Yunheung Paek

Large language models (LLMs) for code are increasingly used in software development, but they remain static after pretraining while APIs and software libraries continue to evolve. Model editing offers a lightweight alternative to retraining…

Software Engineering · Computer Science 2026-05-11 Vinaik Chhetri , Moghis Fereidouni , A. B Siddique , Umar Farooq

Recent advances in leveraging LLMs for APR have demonstrated impressive capabilities in fixing software defects. However, current LLM-based approaches predominantly focus on mainstream programming languages like Java and Python, neglecting…

Software Engineering · Computer Science 2026-03-31 Wenqiang Luo , Jacky Wai Keung , Boyang Yang , Jacques Klein , Tegawende F. Bissyande , Haoye Tian , Bach Le