English

Using Pre-Trained Models to Boost Code Review Automation

Software Engineering 2022-01-19 v1

Abstract

Code review is a practice widely adopted in open source and industrial projects. Given the non-negligible cost of such a process, researchers started investigating the possibility of automating specific code review tasks. We recently proposed Deep Learning (DL) models targeting the automation of two tasks: the first model takes as input a code submitted for review and implements in it changes likely to be recommended by a reviewer; the second takes as input the submitted code and a reviewer comment posted in natural language and automatically implements the change required by the reviewer. While the preliminary results we achieved are encouraging, both models had been tested in rather simple code review scenarios, substantially simplifying the targeted problem. This was also due to the choices we made when designing both the technique and the experiments. In this paper, we build on top of that work by demonstrating that a pre-trained Text-To-Text Transfer Transformer (T5) model can outperform previous DL models for automating code review tasks. Also, we conducted our experiments on a larger and more realistic (and challenging) dataset of code review activities.

Keywords

Cite

@article{arxiv.2201.06850,
  title  = {Using Pre-Trained Models to Boost Code Review Automation},
  author = {Rosalia Tufano and Simone Masiero and Antonio Mastropaolo and Luca Pascarella and Denys Poshyvanyk and Gabriele Bavota},
  journal= {arXiv preprint arXiv:2201.06850},
  year   = {2022}
}

Comments

Accepted for publication at ICSE 2022

R2 v1 2026-06-24T08:53:22.980Z