English
Related papers

Related papers: Where Do AI Coding Agents Fail? An Empirical Study…

200 papers

Autonomous AI agents are transforming software development and redefining how developers collaborate with AI. Prior research shows that the adoption and use of AI-powered tools differ between core and peripheral developers. However, it…

Software Engineering · Computer Science 2026-01-29 Shamse Tasnim Cynthia , Joy Krishan Das , Banani Roy

Autonomous coding agents are generating code at an unprecedented scale, with OpenAI Codex alone creating over 400,000 pull requests (PRs) in two months. As agentic PR volumes increase, code review agents (CRAs) have become routine…

Software Engineering · Computer Science 2026-04-06 Kowshik Chowdhury , Dipayan Banik , K M Ferdous , Shazibul Islam Shamim

The rapid adoption of AI coding agents for software development has raised important questions about the quality and maintainability of the code they produce. While prior studies have examined AI-generated source code, the impact of AI…

Software Engineering · Computer Science 2026-01-26 Anwar Ghammam , Mohamed Almukhtar

In this paper, we present a comparative study of five autonomous coding agents using AIDev-pop, which is a public dataset containing thousands of AI-generated pull requests (PRs) across popular open-source repositories. We evaluate agents'…

Software Engineering · Computer Science 2026-02-03 Shojibur Rahman , Md Fazle Rabbi , Minhaz Zibran

AI coding agents are rapidly transforming software engineering by performing tasks such as feature development, debugging, and testing. Despite their growing impact, the research community lacks a comprehensive dataset capturing how these…

Software Engineering · Computer Science 2026-02-11 Hao Li , Haoxiang Zhang , Ahmed E. Hassan

Performance optimization is a critical yet challenging aspect of software development, often requiring a deep understanding of system behavior, algorithmic tradeoffs, and careful code modifications. Although recent advances in AI coding…

Software Engineering · Computer Science 2025-12-29 Huiyun Peng , Antonio Zhong , Ricardo Andrés Calvo Méndez , Kelechi G. Kalu , James C. Davis

AI agents are increasingly used in software development, yet their interaction with CI/CD configurations is not well studied. We analyze 8,031 agentic pull requests (PRs) from 1,605 GitHub repositories where AI agents touch YAML…

Software Engineering · Computer Science 2026-01-27 Taher A. Ghaleb

We analyze code review interactions for AI-generated pull requests (PRs) on GitHub using the AIDev dataset and compare them to human-authored PRs within the same repositories. We find that most AI-generated PRs receive no review and, when…

Software Engineering · Computer Science 2026-05-05 Kacper Duma , Patryk Wróblewski , Jagoda Bobińska , Julia Winiarska , Piotr Przymus

Code review is a critical software engineering practice where developers review code changes before integration to ensure code quality, detect defects, and improve maintainability. In recent years, AI agents that can understand code…

Software Engineering · Computer Science 2026-03-18 Suzhen Zhong , Shayan Noei , Ying Zou , Bram Adams

AI coding agents are increasingly integrated into modern software engineering workflows, actively collaborating with human developers to create pull requests (PRs) in open-source repositories. Although coding agents improve developer…

Software Engineering · Computer Science 2026-03-31 K M Ferdous , Dipayan Banik , Kowshik Chowdhury , Shazibul Islam Shamim

As AI agents increasingly contribute to code development and maintenance, there is still limited empirical evidence on the quality and risk characteristics of their changes in real-world projects, particularly for refactoring-oriented…

Software Engineering · Computer Science 2026-05-21 Mohamed Almukhtar , Anwar Ghammam , Hua Ming

When AI coding agents open branches and submit pull requests (PRs), two questions co-determine oversight design: who starts the work (operational agency) and who authorizes its completion (merge governance). We characterize tools along a…

Software Engineering · Computer Science 2026-05-14 Young Jo , Chung , Safwat Hassan

The rapid adoption of AI-powered coding assistants is transforming software development practices, yet systematic comparisons of their effectiveness across different task types and over time remain limited. This paper presents an empirical…

Software Engineering · Computer Science 2026-05-08 Giovanni Pinna , Jingzhi Gong , David Williams , Federica Sarro

AI-based coding agents are increasingly integrated into software development workflows, collaborating with developers to create pull requests (PRs). Despite their growing adoption, the role of human-agent collaboration in software testing…

Software Engineering · Computer Science 2026-01-30 Roberto Milanese , Francesco Salzano , Angelica Spina , Antonio Vitale , Remo Pareschi , Fausto Fasano , Mattia Fazzini

AI coding agents are reshaping software development through both autonomous and human-mediated pull requests (PRs). When developers use AI agents to generate code under their own accounts, code authorship attribution becomes critical for…

Software Engineering · Computer Science 2026-01-27 Taher A. Ghaleb

AI coding agents can autonomously generate pull requests (PRs), yet little is known about how their contributions compare to those of humans. We analyze 33,596 agent-generated PRs (APRs) and 6,618 human PRs (HPRs) to compare code-change…

Software Engineering · Computer Science 2026-01-27 Dung Pham , Taher A. Ghaleb

Coding agents are becoming increasingly capable of completing end-to-end software engineering workflows that previously required a human developer, including raising pull requests (PRs) to propose their changes. However, we still know…

Software Engineering · Computer Science 2026-01-28 Lukas Twist , Jie M. Zhang

As AI coding agents evolve from autocomplete tools to autonomous "AI workforce" teammates, they introduce a critical new bottleneck: human maintainers must now manage complex interaction loops rather than just reviewing code. Analyzing…

Large Language Model (LLM) Agents are advancing quickly, with the increasing leveraging of LLM Agents to assist in development tasks such as code generation. While LLM Agents accelerate code generation, studies indicate they may introduce…

Software Engineering · Computer Science 2026-01-30 Haoming Huang , Pongchai Jaisri , Shota Shimizu , Lingfeng Chen , Sota Nakashima , Gema Rodríguez-Pérez

Pull Requests (PRs) are a mechanism on modern collaborative coding platforms, such as GitHub. PRs allow developers to tell others that their code changes are available for merging into another branch in a repository. A PR needs to be…

Software Engineering · Computer Science 2022-07-01 Ting Zhang , Ivana Clairine Irsan , Ferdian Thung , DongGyun Han , David Lo , Lingxiao Jiang