English

Early-Stage Prediction of Review Effort in AI-Generated Pull Requests

Software Engineering 2026-01-28 v2

Abstract

As AI coding agents evolve from autocomplete tools to autonomous "AI workforce" teammates, they introduce a critical new bottleneck: human maintainers must now manage complex interaction loops rather than just reviewing code. Analyzing 33,707 agent-authored PRs, we uncover a stark two-regime reality: agents excel at narrow automation (28.3% of PRs merge instantly), but frequently fail at iterative refinement, leading to "ghosting" (abandonment) when faced with subjective feedback. This creates a hidden "attention tax" on maintainers. We introduce a creation-time Circuit Breaker model to predict high-maintenance PRs before human review begins. By leveraging simple static complexity cues (e.g., file types, patch size), our model identifies the "expensive tail" of contributions with AUC 0.96, enabling a gated triage process. At a 20% review budget, this approach captures 69% of the high-effort PRs, effectively allowing maintainers to fast-fail costly, low-quality agent contributions while fast-tracking simple fixes.

Keywords

Cite

@article{arxiv.2601.00753,
  title  = {Early-Stage Prediction of Review Effort in AI-Generated Pull Requests},
  author = {Dao Sy Duy Minh and Huynh Trung Kiet and Nguyen Lam Phu Quy and Pham Phu Hoa and Tran Chi Nguyen and Nguyen Dinh Ha Duong and Truong Bao Tran},
  journal= {arXiv preprint arXiv:2601.00753},
  year   = {2026}
}

Comments

5 pages, 4 figures. Accepted to the 23rd International Conference on Mining Software Repositories (MSR '26)