English
Related papers

Related papers: A Task-Level Evaluation of AI Agents in Open-Sourc…

200 papers

The rapid adoption of AI-powered coding assistants is transforming software development practices, yet systematic comparisons of their effectiveness across different task types and over time remain limited. This paper presents an empirical…

Software Engineering · Computer Science 2026-05-08 Giovanni Pinna , Jingzhi Gong , David Williams , Federica Sarro

AI coding agents increasingly submit pull requests (Agentic-PRs) to open-source repositories, yet their performance is commonly assessed using merge and rejection outcomes alone. We hypothesized that these outcome labels do not reliably…

AI coding agents are increasingly contributing to software development, yet their impact on mobile development has received little empirical attention. In this paper, we present the first category-level empirical study of agent-generated…

Software Engineering · Computer Science 2026-02-13 Muhammad Ahmad Khan , Hasnain Ali , Muneeb Rana , Muhammad Saqib Ilyas , Abdul Ali Bangash

AI coding agents are increasingly acting as autonomous contributors by generating and submitting pull requests (PRs). However, we lack empirical evidence on how these agent-generated PRs differ from human contributions, particularly in how…

Software Engineering · Computer Science 2026-04-07 Daniel Ogenrwot , John Businge

Autonomous coding agents are increasingly deployed as AI teammates in modern software engineering, independently authoring pull requests (PRs) that modify production code at scale. This study aims to systematically characterize how…

Cryptography and Security · Computer Science 2026-01-05 Mohammed Latif Siddiq , Xinye Zhao , Vinicius Carvalho Lopes , Beatrice Casey , Joanna C. S. Santos

The rise of large language models for code has reshaped software development. Autonomous coding agents, able to create branches, open pull requests, and perform code reviews, now actively contribute to real-world projects. Their growing…

Software Engineering · Computer Science 2026-04-02 Razvan Mihai Popescu , David Gros , Andrei Botocan , Rahul Pandita , Prem Devanbu , Maliheh Izadi

The rapid adoption of large language models has led to the emergence of AI coding agents that autonomously create pull requests on GitHub. However, how these agents differ in their pull request description characteristics, and how human…

Artificial Intelligence · Computer Science 2026-02-20 Kan Watanabe , Rikuto Tsuchida , Takahiro Monno , Bin Huang , Kazuma Yamasaki , Youmei Fan , Kazumasa Shimari , Kenichi Matsumoto

AI coding agents are now submitting pull requests (PRs) to software projects, acting not just as assistants but as autonomous contributors. As these agentic contributions are rapidly increasing across real repositories, little is known…

Software Engineering · Computer Science 2026-01-22 Ramtin Ehsani , Sakshi Pathak , Shriya Rawal , Abdullah Al Mujahid , Mia Mohammad Imran , Preetha Chatterjee

Large Language Models (LLMs) increasingly automate software engineering tasks. While recent studies highlight the accelerated adoption of ``AI as a teammate'' in Open Source Software (OSS), developer interaction patterns remain…

Software Engineering · Computer Science 2026-01-21 Haoyu Gao , Peerachai Banyongrakkul , Hao Guan , Mansooreh Zahedi , Christoph Treude

AI coding agents can autonomously generate pull requests (PRs), yet little is known about how their contributions compare to those of humans. We analyze 33,596 agent-generated PRs (APRs) and 6,618 human PRs (HPRs) to compare code-change…

Software Engineering · Computer Science 2026-01-27 Dung Pham , Taher A. Ghaleb

AI coding agents are rapidly transforming software engineering by performing tasks such as feature development, debugging, and testing. Despite their growing impact, the research community lacks a comprehensive dataset capturing how these…

Software Engineering · Computer Science 2026-02-11 Hao Li , Haoxiang Zhang , Ahmed E. Hassan

AI coding agents are reshaping software development through both autonomous and human-mediated pull requests (PRs). When developers use AI agents to generate code under their own accounts, code authorship attribution becomes critical for…

Software Engineering · Computer Science 2026-01-27 Taher A. Ghaleb

Autonomous coding agents increasingly contribute to software development by submitting pull requests on GitHub; yet, little is known about how these contributions integrate into human-driven review workflows. We present a large empirical…

Software Engineering · Computer Science 2026-02-24 Costain Nachuma , Minhaz Zibran

When AI coding agents open branches and submit pull requests (PRs), two questions co-determine oversight design: who starts the work (operational agency) and who authorizes its completion (merge governance). We characterize tools along a…

Software Engineering · Computer Science 2026-05-14 Young Jo , Chung , Safwat Hassan

The automatic generation of pull requests (PRs) using AI agents has become increasingly common. Although AI-generated PRs are fast and easy to create, their merge rates have been reported to be lower than those created by humans. In this…

Software Engineering · Computer Science 2026-01-27 Haruhiko Yoshioka , Takahiro Monno , Haruka Tokumasu , Taiki Wakamatsu , Yuki Ota , Nimmi Weeraddana , Kenichi Matsumoto

Agentic coding -- software development workflows in which autonomous coding agents plan, implement, and submit code changes with minimal human involvement -- is rapidly gaining traction. Prior work has shown that Pull Requests (PRs)…

Software Engineering · Computer Science 2026-02-05 Sota Nakashima , Yuta Ishimoto , Masanari Kondo , Shane Mclntosh , Yasutaka Kamei

AI-based coding agents are increasingly integrated into software development workflows, collaborating with developers to create pull requests (PRs). Despite their growing adoption, the role of human-agent collaboration in software testing…

Software Engineering · Computer Science 2026-01-30 Roberto Milanese , Francesco Salzano , Angelica Spina , Antonio Vitale , Remo Pareschi , Fausto Fasano , Mattia Fazzini

Autonomous coding agents (e.g., OpenAI Codex, Devin, GitHub Copilot) are increasingly used to generate fix-related pull requests (PRs) in real world software repositories. However, their practical effectiveness depends on whether these…

Software Engineering · Computer Science 2026-02-03 Khairul Alam , Saikat Mondal , Banani Roy

Autonomous coding agents are generating code at an unprecedented scale, with OpenAI Codex alone creating over 400,000 pull requests (PRs) in two months. As agentic PR volumes increase, code review agents (CRAs) have become routine…

Software Engineering · Computer Science 2026-04-06 Kowshik Chowdhury , Dipayan Banik , K M Ferdous , Shazibul Islam Shamim

Autonomous coding agents are reshaping software development by creating pull requests (PRs) on GitHub, referred to as agentic PRs. In parallel, the review process is also becoming autonomous, thereby making reviewer bots key actors in the…

Software Engineering · Computer Science 2026-04-28 Syeda Kaneez Fatima , Yousuf Abrar , Abdul Rehman Tahir , Amelia Nawaz , Shamsa Abid , Abdul Ali Bangash
‹ Prev 1 2 3 10 Next ›