English
Related papers

Related papers: Where Do AI Coding Agents Fail? An Empirical Study…

200 papers

AI coding agents increasingly submit pull requests (Agentic-PRs) to open-source repositories, yet their performance is commonly assessed using merge and rejection outcomes alone. We hypothesized that these outcome labels do not reliably…

Autonomous coding agents (e.g., OpenAI Codex, Devin, GitHub Copilot) are increasingly used to generate fix-related pull requests (PRs) in real world software repositories. However, their practical effectiveness depends on whether these…

Software Engineering · Computer Science 2026-02-03 Khairul Alam , Saikat Mondal , Banani Roy

Autonomous coding agents are increasingly deployed as AI teammates in modern software engineering, independently authoring pull requests (PRs) that modify production code at scale. This study aims to systematically characterize how…

Cryptography and Security · Computer Science 2026-01-05 Mohammed Latif Siddiq , Xinye Zhao , Vinicius Carvalho Lopes , Beatrice Casey , Joanna C. S. Santos

Large language models (LLMs) are increasingly being integrated into software development processes. The ability to generate code and submit pull requests with minimal human intervention, through the use of autonomous AI agents, is poised to…

Software Engineering · Computer Science 2026-02-10 Miku Watanabe , Hao Li , Yutaro Kashiwa , Brittany Reid , Hajimu Iida , Ahmed E. Hassan

AI coding agents are increasingly acting as autonomous contributors by generating and submitting pull requests (PRs). However, we lack empirical evidence on how these agent-generated PRs differ from human contributions, particularly in how…

Software Engineering · Computer Science 2026-04-07 Daniel Ogenrwot , John Businge

The automatic generation of pull requests (PRs) using AI agents has become increasingly common. Although AI-generated PRs are fast and easy to create, their merge rates have been reported to be lower than those created by humans. In this…

Software Engineering · Computer Science 2026-01-27 Haruhiko Yoshioka , Takahiro Monno , Haruka Tokumasu , Taiki Wakamatsu , Yuki Ota , Nimmi Weeraddana , Kenichi Matsumoto

The increasing adoption of AI coding agents has increased the number of agent-generated pull requests (PRs) merged with little or no human intervention. Although such PRs promise productivity gains, their post-merge code quality remains…

Software Engineering · Computer Science 2026-01-29 Shamse Tasnim Cynthia , Al Muttakin , Banani Roy

The rapid adoption of large language models has led to the emergence of AI coding agents that autonomously create pull requests on GitHub. However, how these agents differ in their pull request description characteristics, and how human…

Artificial Intelligence · Computer Science 2026-02-20 Kan Watanabe , Rikuto Tsuchida , Takahiro Monno , Bin Huang , Kazuma Yamasaki , Youmei Fan , Kazumasa Shimari , Kenichi Matsumoto

Autonomous coding agents increasingly contribute to software development by submitting pull requests on GitHub; yet, little is known about how these contributions integrate into human-driven review workflows. We present a large empirical…

Software Engineering · Computer Science 2026-02-24 Costain Nachuma , Minhaz Zibran

Agentic coding -- software development workflows in which autonomous coding agents plan, implement, and submit code changes with minimal human involvement -- is rapidly gaining traction. Prior work has shown that Pull Requests (PRs)…

Software Engineering · Computer Science 2026-02-05 Sota Nakashima , Yuta Ishimoto , Masanari Kondo , Shane Mclntosh , Yasutaka Kamei

Software Engineering 3.0 marks a paradigm shift in software development, in which AI coding agents are no longer just assistive tools but active contributors. While prior empirical studies have examined productivity gains and acceptance…

Software Engineering · Computer Science 2026-05-14 Daniel Ogenrwot , John Businge

Pull request (PR) descriptions generated by AI coding agents are the primary channel for communicating code changes to human reviewers. However, the alignment between these messages and the actual changes remains unexplored, raising…

Software Engineering · Computer Science 2026-01-27 Jingzhi Gong , Giovanni Pinna , Yixin Bian , Jie M. Zhang

Testing is a critical practice for ensuring software correctness and long-term maintainability. As agentic coding tools increasingly submit pull requests (PRs), it becomes essential to understand how testing appears in these agent-driven…

Software Engineering · Computer Science 2026-01-08 Sabrina Haque , Sarvesh Ingale , Christoph Csallner

Recent years have experienced growing contributions of AI coding agents that assist human developers in various software engineering tasks. However, this growing AI-assisted autonomy raises questions about security and trust. In this paper,…

Software Engineering · Computer Science 2026-04-23 Md Fazle Rabbi , Asif K. Turzo , Arifa I. Champa , Minhaz F. Zibran

Large Language Models (LLMs) increasingly automate software engineering tasks. While recent studies highlight the accelerated adoption of ``AI as a teammate'' in Open Source Software (OSS), developer interaction patterns remain…

Software Engineering · Computer Science 2026-01-21 Haoyu Gao , Peerachai Banyongrakkul , Hao Guan , Mansooreh Zahedi , Christoph Treude

Autonomous coding agents are reshaping software development by creating pull requests (PRs) on GitHub, referred to as agentic PRs. In parallel, the review process is also becoming autonomous, thereby making reviewer bots key actors in the…

Software Engineering · Computer Science 2026-04-28 Syeda Kaneez Fatima , Yousuf Abrar , Abdul Rehman Tahir , Amelia Nawaz , Shamsa Abid , Abdul Ali Bangash

Although coding agents have introduced new coordination dynamics in collaborative software development, detailed interactions in practice remain underexplored, especially for the code review process. In this study, we mine agent-authored PR…

Software Engineering · Computer Science 2026-04-07 Islem Khemissi , Moataz Chouchen , Dong Wang , Raula Gaikovina Kula

AI coding agents are increasingly contributing to software development, yet their impact on mobile development has received little empirical attention. In this paper, we present the first category-level empirical study of agent-generated…

Software Engineering · Computer Science 2026-02-13 Muhammad Ahmad Khan , Hasnain Ali , Muneeb Rana , Muhammad Saqib Ilyas , Abdul Ali Bangash

Continuous Integration and Deployment (CI/CD) workflows are central to modern software delivery, yet the reliability of agentic AI bots operating within these workflows remain underexplored. Using pull requests (PRs), commits, and…

Software Engineering · Computer Science 2026-04-21 Syed Muhammad Ashhar Shah , Sehrish Habib , Muizz Hussain , Maryam Abdul Ghafoor , Abdul Ali Bangash

AI-agents help developers in different coding tasks, such as developing new features, fixing bugs, and reviewing code. Developers can write a Github issue and assign it to an AI-agent like Copilot for implementation. Based on the issue and…

Software Engineering · Computer Science 2025-12-29 Mohammed Sayagh
‹ Prev 1 2 3 10 Next ›