English

Novice Developers Produce Larger Review Overhead for Project Maintainers while Vibe Coding

Software Engineering 2026-03-02 v1

Abstract

AI coding agents allow software developers to generate code quickly, which raises a practical question for project managers and open source maintainers: can vibe coders with less development experience substitute for expert developers? To explore whether developer experience still matters in AI-assisted development, we study 22,95322,953 Pull Requests (PRs) from 1,7191,719 vibe coders in the GitHub repositories of the AIDev dataset. We split vibe coders into lower experience vibe coders (ExpLow\mathit{Exp}_{Low}) and higher experience vibe coders (ExpHigh\mathit{Exp}_{High}) and compare contribution magnitude and PR acceptance rates across PR categories. We find that ExpLow\mathit{Exp}_{Low} submits PRs with larger volume (2.15×2.15\times more commits and 1.47×1.47\times more files changed) than ExpHigh\mathit{Exp}_{High}. Moreover, ExpLow\mathit{Exp}_{Low} PRs, when compared to ExpHigh\mathit{Exp}_{High}, receive 4.52×4.52\times more review comments, and have 31%31\% lower acceptance rates, and remain open 5.16×5.16\times longer before resolution. Our results indicate that low-experienced vibe coders focus on generating more code while shifting verification burden onto reviewers. For practice, project managers may not be able to safely replace experienced developers with low-experience vibe coders without increasing review capacity. Development teams should therefore combine targeted training for novices with adaptive PR review cycles.

Keywords

Cite

@article{arxiv.2602.23905,
  title  = {Novice Developers Produce Larger Review Overhead for Project Maintainers while Vibe Coding},
  author = {Syed Ammar Asdaque and Imran Haider and Muhammad Umar Malik and Maryam Abdul Ghafoor and Abdul Ali Bangash},
  journal= {arXiv preprint arXiv:2602.23905},
  year   = {2026}
}

Comments

Accepted to MSR 2026 Mining Challenge

R2 v1 2026-07-01T10:55:25.242Z