English
Related papers

Related papers: Copiloting the Copilots: Fusing Large Language Mod…

200 papers

Automated Program Repair (APR) agents leverage Large Language Models (LLMs) to autonomously diagnose and fix software bugs through reasoning, planning, and tool use. Despite impressive leaderboard gains on benchmarks such as SWE-bench,…

Software Engineering · Computer Science 2026-05-28 Ira Ceka , Hailie Mitchell , Saurabh Pujar , Luca Buratti , Shyam Ramji , Junfeng Yang , Gail Kaiser , Baishakhi Ray

Code reproduction is a cornerstone of scientific validity, yet it remains a formidable challenge in computer networking research due to the scarcity of open-source implementations and the complexity of heterogeneous system architectures.…

Networking and Internet Architecture · Computer Science 2026-02-17 Yining Jiang , Yunxin Xu , Wenyun Xu , Yufan Zhu , Tangtang He , Haiying Huang , Letian Zhu , Qingyu Song , Qiang Su , Lizhao You , Lu Tang , Wanjin Feng , Yuchao Zhang , Linghe Kong , Qiao Xiang , Jiwu Shu

LLM-based assistants, such as GitHub Copilot and ChatGPT, have the potential to generate code that fulfills a programming task described in a natural language description, referred to as a prompt. The widespread accessibility of these…

Software Engineering · Computer Science 2024-05-24 Sylvain Kouemo Ngassom , Arghavan Moradi Dakhel , Florian Tambon , Foutse Khomh

Large language models (LLMs) have shown impressive effectiveness in various software engineering tasks, including automated program repair (APR). In this study, we take a deep dive into automated bug fixing utilizing LLMs. In contrast to…

Software Engineering · Computer Science 2024-05-13 Soneya Binta Hossain , Nan Jiang , Qiang Zhou , Xiaopeng Li , Wen-Hao Chiang , Yingjun Lyu , Hoan Nguyen , Omer Tripp

Large Language Models (LLMs) have become powerful tools for automated code generation. However, these models often overlook critical security practices, which can result in the generation of insecure code that contains…

Software Engineering · Computer Science 2025-07-01 Hao Yan , Swapneel Suhas Vaidya , Xiaokuan Zhang , Ziyu Yao

Large Language Models (LLMs) for code generation evolve rapidly through fine-tuning, merging, or new model releases. However, such updates can introduce regressions, not only in correctness but also in code quality and performance. To…

Software Engineering · Computer Science 2025-07-28 Altaf Allah Abbassi , Leuson Da Silva , Amin Nikanjam , Foutse Khomh

With the emergence of Large Language Models (LLMs), there has been a significant improvement in the programming capabilities of models, attracting growing attention from researchers. Evaluating the programming capabilities of LLMs is…

A significant portion of student programming submissions in CS1 learning environments are uncompilable, limiting their use in student modeling and downstream knowledge tracing. Traditional modeling pipelines often exclude these cases,…

Software Engineering · Computer Science 2025-12-24 Griffin Pitts , Aum Pandya , Darsh Rank , Tirth Bhatt , Muntasir Hoq , Bita Akram

The gap between the trepidation of program reliability and the expense of repairs underscores the indispensability of Automated Program Repair (APR). APR is instrumental in transforming vulnerable programs into more robust ones, bolstering…

Software Engineering · Computer Science 2024-08-22 Yuze Zhao , Zhenya Huang , Yixiao Ma , Rui Li , Kai Zhang , Hao Jiang , Qi Liu , Linbo Zhu , Yu Su

LLM-based automated program repair methods have attracted significant attention for their state-of-the-art performance. However, they were primarily evaluated on a few well known datasets like Defects4J, raising questions about their…

Software Engineering · Computer Science 2025-03-13 Fengjie Li , Jiajun Jiang , Jiajun Sun , Hongyu Zhang

Automated Program Repair (APR) has benefited from the code understanding and generation capabilities of Large Language Models (LLMs). Existing feedback-based APR methods iteratively refine candidate patches using test execution feedback and…

Software Engineering · Computer Science 2026-04-22 Linhao Wu , Yifei Pei , Zhen Yang , Kainan Li , Zhonghang Lu , Hao Tan , Xiran Lyu , Jia Li , Yizhou Chen , Pengyu Xue , Kunwu Zheng , Dan Hao

Bug fixing holds significant importance in software development and maintenance. Recent research has made substantial strides in exploring the potential of large language models (LLMs) for automatically resolving software bugs. However, a…

Software Engineering · Computer Science 2025-02-18 Yuwei Zhang , Zhi Jin , Ying Xing , Ge Li , Fang Liu , Jiaxin Zhu , Wensheng Dou , Jun Wei

State-of-the-art large language models (LLMs) have demonstrated impressive code generation capabilities but struggle with real-world software engineering tasks, such as revising source code to address code reviews, hindering their practical…

Software Engineering · Computer Science 2025-06-03 Hong Yi Lin , Chunhua Liu , Haoyu Gao , Patanamon Thongtanunam , Christoph Treude

While there has been a lot of research recently on robots in household environments, at the present time, most robots in existence can be found on shop floors, and most interactions between humans and robots happen there. ``Collaborative…

Computation and Language · Computer Science 2025-09-09 Chalamalasetti Kranti , Sherzod Hakimov , David Schlangen

Large Language Models (LLMs) are increasingly being used as autonomous agents capable of performing complicated tasks. However, they lack the ability to perform reliable long-horizon planning on their own. This paper bridges this gap by…

Artificial Intelligence · Computer Science 2025-09-17 Yarin Benyamin , Argaman Mordoch , Shahaf S. Shperberg , Roni Stern

This paper provides a comprehensive review of the literature concerning the utilization of Natural Language Processing (NLP) techniques, with a particular focus on transformer-based large language models (LLMs) trained using Big Code,…

Software Engineering · Computer Science 2023-07-07 Man Fai Wong , Shangxin Guo , Ching Nam Hang , Siu Wai Ho , Chee Wei Tan

Software defects are an inherent part of software development and maintenance. To address these defects, Automated Program Repair (APR) has been developed to fix bugs automatically. With the advent of Large Language Models, Code Language…

Software Engineering · Computer Science 2024-08-27 Yunan Wang , Tingyu Guo , Zilong Huang , Yuan Yuan

Recent advances in large language models (LLMs) have demonstrated impressive capabilities in code-related tasks, such as code generation and automated program repair. Despite their promising performance, most existing approaches for code…

Software Engineering · Computer Science 2025-09-03 Yicong Zhao , Shisong Chen , Jiacheng Zhang , Zhixu Li

Large Language Models (LLMs) show promising performance on various programming tasks, including Automatic Program Repair (APR). However, most approaches to LLM-based APR are limited to the static analysis of the programs, while disregarding…

Machine Learning · Computer Science 2025-05-09 Mirazul Haque , Petr Babkin , Farima Farmahinifarahani , Manuela Veloso

Effective prompt engineering is critical to realizing the promised productivity gains of large language models (LLMs) in knowledge-intensive tasks. Yet, many users struggle to craft prompts that yield high-quality outputs, limiting the…

Human-Computer Interaction · Computer Science 2025-10-02 Niklas Gutheil , Valentin Mayer , Leopold Müller , Jörg Rommelt , Niklas Kühl