English
Related papers

Related papers: Let's Make Every Pull Request Meaningful: An Empir…

200 papers

We examined the mechanisms underlying productivity and performance gains from AI agents using a large-scale experiment on Pairit, a platform we developed to study human-AI collaboration. We randomly assigned 2,234 participants to…

Computers and Society · Computer Science 2026-02-06 Harang Ju , Sinan Aral

The rapid adoption of AI-powered coding assistants is transforming software development practices, yet systematic comparisons of their effectiveness across different task types and over time remain limited. This paper presents an empirical…

Software Engineering · Computer Science 2026-05-08 Giovanni Pinna , Jingzhi Gong , David Williams , Federica Sarro

AI coding agents are increasingly contributing to software development, yet their impact on mobile development has received little empirical attention. In this paper, we present the first category-level empirical study of agent-generated…

Software Engineering · Computer Science 2026-02-13 Muhammad Ahmad Khan , Hasnain Ali , Muneeb Rana , Muhammad Saqib Ilyas , Abdul Ali Bangash

LLM-based software engineering is influencing modern software development. In addition to correctness, prior studies have also examined the performance of software artifacts generated by AI agents. However, it is unclear how exactly the…

Software Engineering · Computer Science 2026-01-01 Md Nahidul Islam Opu , Shahidul Islam , Muhammad Asaduzzaman , Shaiful Chowdhury

As Software Engineering enters its new era (SE 3.0), AI coding agents increasingly automate software development workflows. However, it remains unclear how exactly these agents recognize and address software energy concerns-an issue growing…

Software Engineering · Computer Science 2026-01-01 Tanjum Motin Mitul , Md. Masud Mazumder , Md Nahidul Islam Opu , Shaiful Chowdhury

Despite the growing interest in collaborative AI, designing systems that seamlessly integrate human input remains a major challenge. In this study, we developed a task to systematically examine human preferences for collaborative agents. We…

Artificial Intelligence · Computer Science 2025-10-28 Lukas William Mayer , Sheer Karny , Jackie Ayoub , Miao Song , Danyang Tian , Ehsan Moradi-Pari , Mark Steyvers

Developers create pull request (PR) descriptions to provide an overview of their changes and explain the motivations behind them. These descriptions help reviewers and fellow developers quickly understand the updates. Despite their…

Machine Learning · Computer Science 2024-08-05 Md Nazmus Sakib , Md Athikul Islam , Md Mashrur Arifin

While prior work has examined the generation capabilities of Agentic AI systems, little is known about how reviewers respond to AI-authored code in practice. In this paper, we present a large-scale empirical study of code review dynamics in…

Software Engineering · Computer Science 2026-01-28 Md. Asif Haider , Thomas Zimmermann

We present the first empirical study of AI-generated pull requests that are 'silent,' meaning no comments or discussions accompany them. This absence of any comments or discussions associated with such silent AI pull requests (SPRs) poses a…

Software Engineering · Computer Science 2026-01-30 S M Mahedy Hasan , Md Fazle Rabbi , Minhaz Zibran

Agent-based coding tools have transformed software development practices. Unlike prompt-based approaches that require developers to manually integrate generated code, these agent-based tools autonomously interact with repositories to…

Software Engineering · Computer Science 2026-03-17 Suzuka Yoshimoto , Shun Fujita , Kosei Horikawa , Daniel Feitosa , Yutaro Kashiwa , Hajimu Iida

Large language model (LLM) based coding agents increasingly act as autonomous contributors that generate and merge pull requests, yet their real-world effects on software projects are unclear-especially compared with widely adopted…

Software Engineering · Computer Science 2026-01-28 Shyam Agarwal , Hao He , Bogdan Vasilescu

AI agents are increasingly used in software development, yet their interaction with CI/CD configurations is not well studied. We analyze 8,031 agentic pull requests (PRs) from 1,605 GitHub repositories where AI agents touch YAML…

Software Engineering · Computer Science 2026-01-27 Taher A. Ghaleb

Pull-based development has enabled numerous volunteers to contribute to open-source projects with fewer barriers. Nevertheless, a considerable amount of pull requests (PRs) with valid contributions are abandoned by their contributors,…

Software Engineering · Computer Science 2024-08-23 SayedHassan Khatoonabadi , Diego Elias Costa , Rabe Abdalkareem , Emad Shihab

AI coding agents are reshaping software development through both autonomous and human-mediated pull requests (PRs). When developers use AI agents to generate code under their own accounts, code authorship attribution becomes critical for…

Software Engineering · Computer Science 2026-01-27 Taher A. Ghaleb

This paper develops AI agents that help job seekers write effective requests for job referrals in a professional online community. The basic workflow consists of an improver agent that rewrites the referral request and an evaluator agent…

Artificial Intelligence · Computer Science 2026-01-19 Ross Chu , Yuting Huang

We analyzed 83 persona prompts from 27 research articles that used large language models (LLMs) to generate user personas. Findings show that the prompts predominantly generate single personas. Several prompts express a desire for short or…

Human-Computer Interaction · Computer Science 2026-03-04 Joni Salminen , Danial Amin , Bernard Jansen

AI research agents can now generate research ideas, design experiments, run code, and draft papers, raising the possibility of large-scale AI-assisted scientific discovery. Many current agent frameworks explicitly encourage the generation…

Computation and Language · Computer Science 2026-05-28 Yixuan Tang , Yi Yang

Artificial Intelligence (AI) increasingly automates various parts of the software development tasks. Although AI has enhanced the productivity of development tasks, it remains unstudied whether AI essentially outperforms humans in…

Software Engineering · Computer Science 2026-04-24 Imgyeong Lee , Tayyib Ul Hassan , Abram Hindle

The rapid adoption of large language models (LLMs) like ChatGPT has introduced new dynamics in software development, particularly within pull request workflows. While prior research has examined the quality of AI-generated code, less is…

Software Engineering · Computer Science 2026-04-07 Daniel Ogenrwot , John Businge

Background: Pull Request (PR) Integrators often face challenges in terms of multiple concurrent PRs, so the ability to gauge which of the PRs will get accepted can help them balance their workload. PR creators would benefit from knowing if…

Software Engineering · Computer Science 2020-03-04 Tapajit Dey , Audris Mockus