English
Related papers

Related papers: On the Footprints of Reviewer Bots Feedback on Age…

200 papers

Pull Requests (PRs) are central to collaborative coding, summarizing code changes for reviewers. However, many PR descriptions are incomplete, uninformative, or have out-of-context content, compromising developer workflows and hindering…

Software Engineering · Computer Science 2025-05-05 Kutay Tire , Berk Çakar , Eray Tüzün

The automatic generation of pull requests (PRs) using AI agents has become increasingly common. Although AI-generated PRs are fast and easy to create, their merge rates have been reported to be lower than those created by humans. In this…

Software Engineering · Computer Science 2026-01-27 Haruhiko Yoshioka , Takahiro Monno , Haruka Tokumasu , Taiki Wakamatsu , Yuki Ota , Nimmi Weeraddana , Kenichi Matsumoto

Development bots are used on Github to automate repetitive activities. Such bots communicate with human actors via issue comments and pull request comments. Identifying such bot comments allows preventing bias in socio-technical studies…

Software Engineering · Computer Science 2021-03-11 Mehdi Golzadeh , Alexandre Decan , Eleni Constantinou , Tom Mens

Continuous Integration and Deployment (CI/CD) workflows are central to modern software delivery, yet the reliability of agentic AI bots operating within these workflows remain underexplored. Using pull requests (PRs), commits, and…

Software Engineering · Computer Science 2026-04-21 Syed Muhammad Ashhar Shah , Sehrish Habib , Muizz Hussain , Maryam Abdul Ghafoor , Abdul Ali Bangash

In this paper, we present a comparative study of five autonomous coding agents using AIDev-pop, which is a public dataset containing thousands of AI-generated pull requests (PRs) across popular open-source repositories. We evaluate agents'…

Software Engineering · Computer Science 2026-02-03 Shojibur Rahman , Md Fazle Rabbi , Minhaz Zibran

AI coding agents are increasingly contributing to software development, yet their impact on mobile development has received little empirical attention. In this paper, we present the first category-level empirical study of agent-generated…

Software Engineering · Computer Science 2026-02-13 Muhammad Ahmad Khan , Hasnain Ali , Muneeb Rana , Muhammad Saqib Ilyas , Abdul Ali Bangash

Pull request (PR) descriptions generated by AI coding agents are the primary channel for communicating code changes to human reviewers. However, the alignment between these messages and the actual changes remains unexplored, raising…

Software Engineering · Computer Science 2026-01-27 Jingzhi Gong , Giovanni Pinna , Yixin Bian , Jie M. Zhang

Autonomous coding agents are generating code at an unprecedented scale, with OpenAI Codex alone creating over 400,000 pull requests (PRs) in two months. As agentic PR volumes increase, code review agents (CRAs) have become routine…

Software Engineering · Computer Science 2026-04-06 Kowshik Chowdhury , Dipayan Banik , K M Ferdous , Shazibul Islam Shamim

Pull Requests (PRs) are a mechanism on modern collaborative coding platforms, such as GitHub. PRs allow developers to tell others that their code changes are available for merging into another branch in a repository. A PR needs to be…

Software Engineering · Computer Science 2022-07-01 Ting Zhang , Ivana Clairine Irsan , Ferdian Thung , DongGyun Han , David Lo , Lingxiao Jiang

Large Language Models (LLMs) increasingly automate software engineering tasks. While recent studies highlight the accelerated adoption of ``AI as a teammate'' in Open Source Software (OSS), developer interaction patterns remain…

Software Engineering · Computer Science 2026-01-21 Haoyu Gao , Peerachai Banyongrakkul , Hao Guan , Mansooreh Zahedi , Christoph Treude

Code review has evolved for decades, from informal peer checking to today's pull request (PR) workflows, yet it remains a largely manual, uneven, and cognitively demanding process. The rise of Artificial Intelligence (AI) coding assistants…

Software Engineering · Computer Science 2026-05-19 Hüseyin Özgür Kamalı , Erdem Tuna , Vahid Haratian , Eray Tüzün

AI coding agents are increasingly integrated into modern software engineering workflows, actively collaborating with human developers to create pull requests (PRs) in open-source repositories. Although coding agents improve developer…

Software Engineering · Computer Science 2026-03-31 K M Ferdous , Dipayan Banik , Kowshik Chowdhury , Shazibul Islam Shamim

AI coding agents can autonomously generate pull requests (PRs), yet little is known about how their contributions compare to those of humans. We analyze 33,596 agent-generated PRs (APRs) and 6,618 human PRs (HPRs) to compare code-change…

Software Engineering · Computer Science 2026-01-27 Dung Pham , Taher A. Ghaleb

In the pull-based development model, code contributions are submitted as pull requests (PRs) to undergo reviews and approval by other developers with the goal of being merged into the code base. A PR can be supported by a description, whose…

Software Engineering · Computer Science 2026-02-17 Shirin Pirouzkhah , Pavlína Wurzel Gonçalves , Alberto Bacchelli

As AI coding agents evolve from autocomplete tools to autonomous "AI workforce" teammates, they introduce a critical new bottleneck: human maintainers must now manage complex interaction loops rather than just reviewing code. Analyzing…

AI coding agents allow software developers to generate code quickly, which raises a practical question for project managers and open source maintainers: can vibe coders with less development experience substitute for expert developers? To…

Software Engineering · Computer Science 2026-03-02 Syed Ammar Asdaque , Imran Haider , Muhammad Umar Malik , Maryam Abdul Ghafoor , Abdul Ali Bangash

Background: Despite a growing body of literature on the impact of software bots on open source software development teams, their effects on team communication, coordination, and collaboration practices are not well understood. Bots can have…

Software Engineering · Computer Science 2023-05-29 Leonore Röseler , Ingo Scholtes , Christoph Gote

Code review is central to software engineering education but hard to scale in capstone projects due to tight deadlines, uneven peer feedback, and limited prior experience. We investigate an LLM-as-reviewer integrated directly into GitHub…

Software Engineering · Computer Science 2026-04-28 Eduardo Oliveira , Michael Fu , Patanamon Thongtanunam , Sonsoles López-Pernas , Mohammed Saqr

Testing is a critical practice for ensuring software correctness and long-term maintainability. As agentic coding tools increasingly submit pull requests (PRs), it becomes essential to understand how testing appears in these agent-driven…

Software Engineering · Computer Science 2026-01-08 Sabrina Haque , Sarvesh Ingale , Christoph Csallner

AI coding agents are rapidly transforming software engineering by performing tasks such as feature development, debugging, and testing. Despite their growing impact, the research community lacks a comprehensive dataset capturing how these…

Software Engineering · Computer Science 2026-02-11 Hao Li , Haoxiang Zhang , Ahmed E. Hassan