English
Related papers

Related papers: Let's Make Every Pull Request Meaningful: An Empir…

200 papers

As AI coding agents evolve from autocomplete tools to autonomous "AI workforce" teammates, they introduce a critical new bottleneck: human maintainers must now manage complex interaction loops rather than just reviewing code. Analyzing…

As software engineering moves toward SE3.0, AI agents are increasingly used to carry out development tasks and contribute changes to software projects. It is therefore important to understand the extent of these contributions and how human…

Software Engineering · Computer Science 2026-01-29 Kazuma Yamasaki , Joseph Ayobami Joshua , Tasha Settewong , Mahmoud Alfadel , Kazumasa Shimari , Kenichi Matsumoto

GitHub's Copilot for Pull Requests (PRs) is a promising service aiming to automate various developer tasks related to PRs, such as generating summaries of changes or providing complete walkthroughs with links to the relevant code. As this…

Software Engineering · Computer Science 2024-02-15 Tao Xiao , Hideaki Hata , Christoph Treude , Kenichi Matsumoto

Software Engineering 3.0 marks a paradigm shift in software development, in which AI coding agents are no longer just assistive tools but active contributors. While prior empirical studies have examined productivity gains and acceptance…

Software Engineering · Computer Science 2026-05-14 Daniel Ogenrwot , John Businge

Performance optimization is a critical yet challenging aspect of software development, often requiring a deep understanding of system behavior, algorithmic tradeoffs, and careful code modifications. Although recent advances in AI coding…

Software Engineering · Computer Science 2025-12-29 Huiyun Peng , Antonio Zhong , Ricardo Andrés Calvo Méndez , Kelechi G. Kalu , James C. Davis

The rapid adoption of AI coding agents for software development has raised important questions about the quality and maintainability of the code they produce. While prior studies have examined AI-generated source code, the impact of AI…

Software Engineering · Computer Science 2026-01-26 Anwar Ghammam , Mohamed Almukhtar

Autonomous coding agents are reshaping software development by creating pull requests (PRs) on GitHub, referred to as agentic PRs. In parallel, the review process is also becoming autonomous, thereby making reviewer bots key actors in the…

Software Engineering · Computer Science 2026-04-28 Syeda Kaneez Fatima , Yousuf Abrar , Abdul Rehman Tahir , Amelia Nawaz , Shamsa Abid , Abdul Ali Bangash

In this paper, we present a comparative study of five autonomous coding agents using AIDev-pop, which is a public dataset containing thousands of AI-generated pull requests (PRs) across popular open-source repositories. We evaluate agents'…

Software Engineering · Computer Science 2026-02-03 Shojibur Rahman , Md Fazle Rabbi , Minhaz Zibran

Coding agents are becoming increasingly capable of completing end-to-end software engineering workflows that previously required a human developer, including raising pull requests (PRs) to propose their changes. However, we still know…

Software Engineering · Computer Science 2026-01-28 Lukas Twist , Jie M. Zhang

Pull Requests (PRs) are central to collaborative coding, summarizing code changes for reviewers. However, many PR descriptions are incomplete, uninformative, or have out-of-context content, compromising developer workflows and hindering…

Software Engineering · Computer Science 2025-05-05 Kutay Tire , Berk Çakar , Eray Tüzün

Pull Requests (PRs) are a mechanism on modern collaborative coding platforms, such as GitHub. PRs allow developers to tell others that their code changes are available for merging into another branch in a repository. A PR needs to be…

Software Engineering · Computer Science 2022-07-01 Ting Zhang , Ivana Clairine Irsan , Ferdian Thung , DongGyun Han , David Lo , Lingxiao Jiang

Enabled by the pull-based development model, developers can easily contribute to a project through pull requests (PRs). When creating a PR, developers can add a free-form description to describe what changes are made in this PR and/or why.…

Software Engineering · Computer Science 2019-09-17 Zhongxin Liu , Xin Xia , Christoph Treude , David Lo , Shanping Li

Large Language Model (LLM) Agents are advancing quickly, with the increasing leveraging of LLM Agents to assist in development tasks such as code generation. While LLM Agents accelerate code generation, studies indicate they may introduce…

Software Engineering · Computer Science 2026-01-30 Haoming Huang , Pongchai Jaisri , Shota Shimizu , Lingfeng Chen , Sota Nakashima , Gema Rodríguez-Pérez

When AI coding agents open branches and submit pull requests (PRs), two questions co-determine oversight design: who starts the work (operational agency) and who authorizes its completion (merge governance). We characterize tools along a…

Software Engineering · Computer Science 2026-05-14 Young Jo , Chung , Safwat Hassan

AI coding agents are rapidly transforming software engineering by performing tasks such as feature development, debugging, and testing. Despite their growing impact, the research community lacks a comprehensive dataset capturing how these…

Software Engineering · Computer Science 2026-02-11 Hao Li , Haoxiang Zhang , Ahmed E. Hassan

Autonomous AI agents are transforming software development and redefining how developers collaborate with AI. Prior research shows that the adoption and use of AI-powered tools differ between core and peripheral developers. However, it…

Software Engineering · Computer Science 2026-01-29 Shamse Tasnim Cynthia , Joy Krishan Das , Banani Roy

As AI agents increasingly contribute to code development and maintenance, there is still limited empirical evidence on the quality and risk characteristics of their changes in real-world projects, particularly for refactoring-oriented…

Software Engineering · Computer Science 2026-05-21 Mohamed Almukhtar , Anwar Ghammam , Hua Ming

Here we examine how AI agent "personalities" interact with human personalities to shape human-AI collaboration and performance. In a large-scale, preregistered randomized experiment, we paired 1,258 participants with AI agents prompted to…

Human-Computer Interaction · Computer Science 2026-04-14 Harang Ju , Sinan Aral

As a maintainer of an open source software project, you are usually happy about contributions in the form of pull requests that bring the project a step forward. Past studies have shown that when reviewing a pull request, not only its…

Software Engineering · Computer Science 2021-03-08 Marvin Wyrich , Raoul Ghit , Tobias Haller , Christian Müller

In the pull-based development model, code contributions are submitted as pull requests (PRs) to undergo reviews and approval by other developers with the goal of being merged into the code base. A PR can be supported by a description, whose…

Software Engineering · Computer Science 2026-02-17 Shirin Pirouzkhah , Pavlína Wurzel Gonçalves , Alberto Bacchelli