English
Related papers

Related papers: On the Footprints of Reviewer Bots Feedback on Age…

200 papers

Context: Open source software development has become more social and collaborative, especially with the rise of social coding platforms like GitHub. Since 2016, GitHub started to support more informal methods such as emoji reactions, with…

Software Engineering · Computer Science 2021-08-19 Teyon Son , Tao Xiao , Dong Wang , Raula Gaikovina Kula , Takashi Ishio , Kenichi Matsumoto

Large Language Model (LLM) Agents are advancing quickly, with the increasing leveraging of LLM Agents to assist in development tasks such as code generation. While LLM Agents accelerate code generation, studies indicate they may introduce…

Software Engineering · Computer Science 2026-01-30 Haoming Huang , Pongchai Jaisri , Shota Shimizu , Lingfeng Chen , Sota Nakashima , Gema Rodríguez-Pérez

Code review is a widespread practice to improve software quality and transfer knowledge. It is often seen as time-consuming due to the need for manual effort and potential delays. Several AI-assisted tools, such as Qodo, GitHub Copilot, and…

As AI agents increasingly contribute to code development and maintenance, there is still limited empirical evidence on the quality and risk characteristics of their changes in real-world projects, particularly for refactoring-oriented…

Software Engineering · Computer Science 2026-05-21 Mohamed Almukhtar , Anwar Ghammam , Hua Ming

Peer review at AI conferences is stressed by rapidly rising submission volumes, leading to deteriorating review quality and increased author dissatisfaction. To address these issues, we developed Review Feedback Agent, a system leveraging…

Artificial Intelligence · Computer Science 2025-04-15 Nitya Thakkar , Mert Yuksekgonul , Jake Silberg , Animesh Garg , Nanyun Peng , Fei Sha , Rose Yu , Carl Vondrick , James Zou

Automated code review (ACR) bots are increasingly used in industrial software development to assist developers during pull request (PR) review. As adoption grows, a key challenge is how to evaluate the usefulness of bot-generated comments…

Software Engineering · Computer Science 2026-04-28 Veli Karakaya , Utku Boran Torun , Baykal Mehmet Uçar , Eray Tüzün

Recent years have experienced growing contributions of AI coding agents that assist human developers in various software engineering tasks. However, this growing AI-assisted autonomy raises questions about security and trust. In this paper,…

Software Engineering · Computer Science 2026-04-23 Md Fazle Rabbi , Asif K. Turzo , Arifa I. Champa , Minhaz F. Zibran

The rapid adoption of AI coding agents for software development has raised important questions about the quality and maintainability of the code they produce. While prior studies have examined AI-generated source code, the impact of AI…

Software Engineering · Computer Science 2026-01-26 Anwar Ghammam , Mohamed Almukhtar

Agentic coding -- software development workflows in which autonomous coding agents plan, implement, and submit code changes with minimal human involvement -- is rapidly gaining traction. Prior work has shown that Pull Requests (PRs)…

Software Engineering · Computer Science 2026-02-05 Sota Nakashima , Yuta Ishimoto , Masanari Kondo , Shane Mclntosh , Yasutaka Kamei

Pull-based development has enabled numerous volunteers to contribute to open-source projects with fewer barriers. Nevertheless, a considerable amount of pull requests (PRs) with valid contributions are abandoned by their contributors,…

Software Engineering · Computer Science 2024-08-23 SayedHassan Khatoonabadi , Diego Elias Costa , Rabe Abdalkareem , Emad Shihab

Agentic Coding, powered by autonomous agents such as GitHub Copilot and Cursor, enables developers to generate code, tests, and pull requests from natural language instructions alone. While this accelerates implementation, it produces…

Software Engineering · Computer Science 2026-02-20 Kan Watanabe , Tatsuya Shirai , Yutaro Kashiwa , Hajimu Iida

LLM-based software engineering is influencing modern software development. In addition to correctness, prior studies have also examined the performance of software artifacts generated by AI agents. However, it is unclear how exactly the…

Software Engineering · Computer Science 2026-01-01 Md Nahidul Islam Opu , Shahidul Islam , Muhammad Asaduzzaman , Shaiful Chowdhury

Bots are frequently used in Github repositories to automate repetitive activities that are part of the distributed software development process. They communicate with human actors through comments. While detecting their presence is…

Software Engineering · Computer Science 2021-01-29 Mehdi Golzadeh , Alexandre Decan , Damien Legay , Tom Mens

The ever-increasing complexity of modern software engineering projects makes the usage of automated assistants imperative. Bots can be used to complete repetitive tasks during development and testing, as well as promoting communication…

Software Engineering · Computer Science 2021-03-18 Samaneh Saadat , Natalia Colmenares , Gita Sukthankar

The success of a Pull Request (PR) depends on the responsiveness of the maintainers and the contributor during the review process. Being aware of the expected waiting times can lead to better interactions and managed expectations for both…

Software Engineering · Computer Science 2024-08-23 SayedHassan Khatoonabadi , Ahmad Abdellatif , Diego Elias Costa , Emad Shihab

Large language models are increasingly discussed and used as tools that may assist with scholarly peer review, but empirical evidence regarding how authors use and perceive AI-based feedback remains limited. This paper reports findings from…

Computers and Society · Computer Science 2026-05-19 César Leblanc , Lukas Picek

The increasing adoption of AI coding agents has increased the number of agent-generated pull requests (PRs) merged with little or no human intervention. Although such PRs promise productivity gains, their post-merge code quality remains…

Software Engineering · Computer Science 2026-01-29 Shamse Tasnim Cynthia , Al Muttakin , Banani Roy

Several Deep Learning (DL)-based techniques have been proposed to automate code review. Still, it is unclear the extent to which these approaches can recommend quality improvements as a human reviewer. We study the similarities and…

Software Engineering · Computer Science 2026-02-13 Giuseppe Crupi , Rosalia Tufano , Gabriele Bavota

GitHub introduced the suggestion feature to enable reviewers to explicitly suggest code modifications in pull requests. These suggestions make the reviewers' feedback more actionable for the submitters and represent a valuable knowledge for…

Software Engineering · Computer Science 2025-02-10 Abir Bouraffa , Yen Dieu Pham , Walid Maalej

The use of large language models like ChatGPT in code review offers promising efficiency gains but also raises concerns about correctness and safety. Existing evaluation methods for code review generation either rely on automatic…

Software Engineering · Computer Science 2025-12-18 Robert Heumüller , Frank Ortmeier