English

Defectors: A Large, Diverse Python Dataset for Defect Prediction

Software Engineering 2023-07-26 v4

Abstract

Defect prediction has been a popular research topic where machine learning (ML) and deep learning (DL) have found numerous applications. However, these ML/DL-based defect prediction models are often limited by the quality and size of their datasets. In this paper, we present Defectors, a large dataset for just-in-time and line-level defect prediction. Defectors consists of \approx 213K source code files (\approx 93K defective and \approx 120K defect-free) that span across 24 popular Python projects. These projects come from 18 different domains, including machine learning, automation, and internet-of-things. Such a scale and diversity make Defectors a suitable dataset for training ML/DL models, especially transformer models that require large and diverse datasets. We also foresee several application areas of our dataset including defect prediction and defect explanation. Dataset link: https://doi.org/10.5281/zenodo.7708984

Keywords

Cite

@article{arxiv.2303.04738,
  title  = {Defectors: A Large, Diverse Python Dataset for Defect Prediction},
  author = {Parvez Mahbub and Ohiduzzaman Shuvo and Mohammad Masudur Rahman},
  journal= {arXiv preprint arXiv:2303.04738},
  year   = {2023}
}
R2 v1 2026-06-28T09:07:50.763Z