English
Related papers

Related papers: Where Do AI Coding Agents Fail? An Empirical Study…

200 papers

Software logging is essential for maintaining and debugging complex systems, yet it remains unclear how AI coding agents handle this non-functional requirement. While prior work characterizes human logging practices, the behaviors of AI…

Software Engineering · Computer Science 2026-04-13 Youssef Esseddiq Ouatiti , Mohammed Sayagh , Hao Li , Ahmed E. Hassan

AI coding agents such as Codex and Claude Code are increasingly used to autonomously contribute to software repositories. However, little is known about how repository-level configuration artifacts affect operational efficiency of the…

Software Engineering · Computer Science 2026-03-31 Jai Lal Lulla , Seyedmoein Mohsenimofidi , Matthias Galster , Jie M. Zhang , Sebastian Baltes , Christoph Treude

The rapid adoption of AI coding agents is fundamentally shifting software developers' roles from code authors to code reviewers. While developers spend a significant portion of their time reading and comprehending code, the linguistic…

Software engineering agents have shown significant promise in writing code. As AI agents permeate code writing, and generate huge volumes of code automatically -- the matter of code quality comes front and centre. As the automatically…

Software Engineering · Computer Science 2026-04-08 Yuntong Zhang , Zhiyuan Pan , Imam Nur Bani Yusuf , Haifeng Ruan , Ridwan Shariffdeen , Abhik Roychoudhury

Existing datasets for coding agents evaluate performance on isolated, single pull request (PR) tasks in a stateless manner, failing to capture the reality of real-world software development where code changes accumulate, technical debt…

Software Engineering · Computer Science 2026-04-06 KN Ajay Shastry , Ganesh Senrayan , Shrey Satapara , Pranoy Panda , Chaitanya Devaguptapu

Given the increasing number of unsuccessful pull requests in GitHub projects, insights into the success and failure of these requests are essential for the developers. In this paper, we provide a comparative study between successful and…

Software Engineering · Computer Science 2018-07-06 Mohammad Masudur Rahman , Chanchal K. Roy

Continuous Integration (CI) is a software development practice that builds and tests software frequently (e.g., at every push). One main motivator to adopt CI is the potential to deliver software functionalities more quickly than not using…

Software Engineering · Computer Science 2023-05-29 João Helis Bernardo , Daniel Alencar da Costa , Uirá Kulesza , Christoph Treude

Reproducing computational research is often assumed to be as simple as rerunning the original code with provided data. In practice, missing packages, fragile file paths, version conflicts, or incomplete logic frequently cause analyses to…

Software Engineering · Computer Science 2026-04-24 Syed Mehtab Hussain Shah , Frank Hopfgartner , Arnim Bleier

ChatGPT has significantly impacted software development practices, providing substantial assistance to developers in a variety of tasks, including coding, testing, and debugging. Despite its widespread adoption, the impact of ChatGPT as an…

Software Engineering · Computer Science 2024-03-18 Huizi Hao , Kazi Amit Hasan , Hong Qin , Marcos Macedo , Yuan Tian , Steven H. H. Ding , Ahmed E. Hassan

Large language model (LLM)-based coding agents achieve impressive results on controlled benchmarks yet routinely produce pull requests that real maintainers reject. The root cause is not functional incorrectness but a lack of organicity:…

Software Engineering · Computer Science 2026-03-30 Mo Li , L. H. Xu , Qitai Tan , Ting Cao , Yunxin Liu

As Software Engineering enters its new era (SE 3.0), AI coding agents increasingly automate software development workflows. However, it remains unclear how exactly these agents recognize and address software energy concerns-an issue growing…

Software Engineering · Computer Science 2026-01-01 Tanjum Motin Mitul , Md. Masud Mazumder , Md Nahidul Islam Opu , Shaiful Chowdhury

Agent-based coding tools have transformed software development practices. Unlike prompt-based approaches that require developers to manually integrate generated code, these agent-based tools autonomously interact with repositories to…

Software Engineering · Computer Science 2026-03-17 Suzuka Yoshimoto , Shun Fujita , Kosei Horikawa , Daniel Feitosa , Yutaro Kashiwa , Hajimu Iida

Artificial Intelligence systems, which benefit from the availability of large-scale datasets and increasing computational power, have become effective solutions to various critical tasks, such as natural language understanding, speech…

Software Engineering · Computer Science 2023-03-20 Zhou Yang , Chenyu Wang , Jieke Shi , Thong Hoang , Pavneet Kochhar , Qinghua Lu , Zhenchang Xing , David Lo

Software bots have been facilitating several development activities in Open Source Software (OSS) projects, including code review. However, these bots may bring unexpected impacts to group dynamics, as frequently occurs with new technology…

Software Engineering · Computer Science 2024-01-24 Mairieli Wessel , Alexander Serebrenik , Igor Wiese , Igor Steinmacher , Marco A. Gerosa

With the rapid development of AI technologies, thousands of AI papers are being published each year. Many of these papers have released sample code to facilitate follow-up researchers. This paper presents an explorative study of over 1700…

Digital Libraries · Computer Science 2019-03-06 Boyang Zhang

LLM-based software engineering is influencing modern software development. In addition to correctness, prior studies have also examined the performance of software artifacts generated by AI agents. However, it is unclear how exactly the…

Software Engineering · Computer Science 2026-01-01 Md Nahidul Islam Opu , Shahidul Islam , Muhammad Asaduzzaman , Shaiful Chowdhury

AI coding agents allow software developers to generate code quickly, which raises a practical question for project managers and open source maintainers: can vibe coders with less development experience substitute for expert developers? To…

Software Engineering · Computer Science 2026-03-02 Syed Ammar Asdaque , Imran Haider , Muhammad Umar Malik , Maryam Abdul Ghafoor , Abdul Ali Bangash

Coding agents have received significant adoption in software development recently. Unlike traditional LLM-based code completion tools, coding agents work with autonomy (e.g., invoking external tools) and leave visible traces in software…

Software Engineering · Computer Science 2026-02-03 Andre Hora , Romain Robbes

The rapid adoption of AI coding agents and AI assistant web services is fundamentally changing how developers discover, consume, and interact with technical documentation. This paper studies that transformation across three interconnected…

Software Engineering · Computer Science 2026-04-06 Oleksii Borysenko

The emergence of Large Language Models (LLMs), such as ChatGPT, has introduced a new set of tools to support software developers in solving pro- gramming tasks. However, our understanding of the interactions (i.e., prompts) between…

Software Engineering · Computer Science 2025-08-26 Julyanara R. Silva , Carlos Eduardo C. Dantas , Marcelo A. Maia