A major problem with user-written bug reports, indicated by developers and documented by researchers, is the (lack of high) quality of the reported steps to reproduce the bugs. Low-quality steps to reproduce lead to excessive manual effort spent on bug triage and resolution. This paper proposes Euler, an approach that automatically identifies and assesses the quality of the steps to reproduce in a bug report, providing feedback to the reporters, which they can use to improve the bug report. The feedback provided by Euler was assessed by external evaluators and the results indicate that Euler correctly identified 98% of the existing steps to reproduce and 58% of the missing ones, while 73% of its quality annotations are correct.
@article{arxiv.1906.07107,
title = {Assessing the Quality of the Steps to Reproduce in Bug Reports},
author = {Oscar Chaparro and Carlos Bernal-Cardenas and Jing Lu and Kevin Moran and Andrian Marcus and Massimiliano Di Penta and Denys Poshyvanyk and Vincent Ng},
journal= {arXiv preprint arXiv:1906.07107},
year = {2019}
}
Comments
In Proceedings of the 27th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE '19), August 26-30, 2019, Tallinn, Estonia