English
Related papers

Related papers: Novice Developers Produce Larger Review Overhead f…

200 papers

We present a comprehensive real-world evaluation of AI-assisted software development tools deployed at enterprise scale. Over one year, 300 engineers across multiple teams integrated an in-house AI platform (DeputyDev) that combines code…

Developers now have access to a growing array of increasingly autonomous AI tools for software development. While many studies examine copilots that provide chat assistance or code completions, evaluations of coding agents -- which can…

Software Engineering · Computer Science 2025-09-16 Valerie Chen , Ameet Talwalkar , Robert Brennan , Graham Neubig

The rise of large language models for code has reshaped software development. Autonomous coding agents, able to create branches, open pull requests, and perform code reviews, now actively contribute to real-world projects. Their growing…

Software Engineering · Computer Science 2026-04-02 Razvan Mihai Popescu , David Gros , Andrei Botocan , Rahul Pandita , Prem Devanbu , Maliheh Izadi

Pull Requests (PRs) are central to collaborative coding, summarizing code changes for reviewers. However, many PR descriptions are incomplete, uninformative, or have out-of-context content, compromising developer workflows and hindering…

Software Engineering · Computer Science 2025-05-05 Kutay Tire , Berk Çakar , Eray Tüzün

Although coding agents have introduced new coordination dynamics in collaborative software development, detailed interactions in practice remain underexplored, especially for the code review process. In this study, we mine agent-authored PR…

Software Engineering · Computer Science 2026-04-07 Islem Khemissi , Moataz Chouchen , Dong Wang , Raula Gaikovina Kula

Large language models (LLMs) are increasingly being integrated into software development processes. The ability to generate code and submit pull requests with minimal human intervention, through the use of autonomous AI agents, is poised to…

Software Engineering · Computer Science 2026-02-10 Miku Watanabe , Hao Li , Yutaro Kashiwa , Brittany Reid , Hajimu Iida , Ahmed E. Hassan

Reviewing source code from a security perspective has proven to be a difficult task. Indeed, previous research has shown that developers often miss even popular and easy-to-detect vulnerabilities during code review. Initial evidence…

Software Engineering · Computer Science 2022-02-15 Larissa Braz , Christian Aeberhard , Gül Çalikli , Alberto Bacchelli

Recent advances in large language models have enabled developers to generate software by conversing with artificial intelligence systems rather than writing code directly. This paper introduces vibe coding, an emerging AI-native programming…

Software Engineering · Computer Science 2025-10-22 Vinay Bamil

Recent advancements in generative artificial intelligence (GenAI), particularly large language models, have introduced new possibilities for software development practices. In our paper we investigate the emerging Vibe Coding (VC) paradigm…

Software Engineering · Computer Science 2025-10-16 Kevin Krings , Nino S. Bohn , Thomas Ludwig

AI-based coding agents are increasingly integrated into software development workflows, collaborating with developers to create pull requests (PRs). Despite their growing adoption, the role of human-agent collaboration in software testing…

Software Engineering · Computer Science 2026-01-30 Roberto Milanese , Francesco Salzano , Angelica Spina , Antonio Vitale , Remo Pareschi , Fausto Fasano , Mattia Fazzini

This study investigates the implementation and efficacy of DeputyDev, an AI-powered code review assistant developed to address inefficiencies in the software development process. The process of code review is highly inefficient for several…

Software Engineering · Computer Science 2025-08-14 Vishal Khare , Vijay Saini , Deepak Sharma , Anand Kumar , Ankit Rana , Anshul Yadav

Background and Context. Chat-based and inline-coding-based GenAI has already had substantial impact on the CS Education community. The recent introduction of ``vibe coding'' may further transform how students program, as it introduces a new…

Human-Computer Interaction · Computer Science 2025-11-05 Francis Geng , Anshul Shah , Haolin Li , Nawab Mulla , Steven Swanson , Gerald Soosai Raj , Daniel Zingaro , Leo Porter

Testing is a critical practice for ensuring software correctness and long-term maintainability. As agentic coding tools increasingly submit pull requests (PRs), it becomes essential to understand how testing appears in these agent-driven…

Software Engineering · Computer Science 2026-01-08 Sabrina Haque , Sarvesh Ingale , Christoph Csallner

Code reviews are popular in both industrial and open source projects. The benefits of code reviews are widely recognized and include better code quality and lower likelihood of introducing bugs. However, since code review is a manual…

Software Engineering · Computer Science 2021-05-20 Rosalia Tufano , Luca Pascarella , Michele Tufano , Denys Poshyvanyk , Gabriele Bavota

In a real-world social network, weak ties (reflecting low-intensity, infrequent interactions) act as bridges and connect people to different social circles, giving them access to diverse information and opportunities that are not available…

Software Engineering · Computer Science 2025-10-30 Hongbo Fang , Patrick Park , James Evans , James Herbsleb , Bogdan Vasilescu

Large language model (LLM) based coding agents increasingly act as autonomous contributors that generate and merge pull requests, yet their real-world effects on software projects are unclear-especially compared with widely adopted…

Software Engineering · Computer Science 2026-01-28 Shyam Agarwal , Hao He , Bogdan Vasilescu

In the pull-based development model, code contributions are submitted as pull requests (PRs) to undergo reviews and approval by other developers with the goal of being merged into the code base. A PR can be supported by a description, whose…

Software Engineering · Computer Science 2026-02-17 Shirin Pirouzkhah , Pavlína Wurzel Gonçalves , Alberto Bacchelli

Agentic coding -- software development workflows in which autonomous coding agents plan, implement, and submit code changes with minimal human involvement -- is rapidly gaining traction. Prior work has shown that Pull Requests (PRs)…

Software Engineering · Computer Science 2026-02-05 Sota Nakashima , Yuta Ishimoto , Masanari Kondo , Shane Mclntosh , Yasutaka Kamei

Performance optimization is a critical yet challenging aspect of software development, often requiring a deep understanding of system behavior, algorithmic tradeoffs, and careful code modifications. Although recent advances in AI coding…

Software Engineering · Computer Science 2025-12-29 Huiyun Peng , Antonio Zhong , Ricardo Andrés Calvo Méndez , Kelechi G. Kalu , James C. Davis

AI-powered coding assistants are rapidly becoming fixtures in professional IDEs, yet their sustained influence on everyday development remains poorly understood. Prior research has focused on short-term use or self-reported perceptions,…

Software Engineering · Computer Science 2026-03-31 Agnia Sergeyuk , Eric Huang , Dariia Karaeva , Anastasiia Serova , Yaroslav Golubev , Iftekhar Ahmed