Leveraging XP and CRISP-DM for Agile Data Science Projects
Abstract
This study explores the integration of eXtreme Programming (XP) and the Cross-Industry Standard Process for Data Mining (CRISP-DM) in agile Data Science projects. We conducted a case study at the e-commerce company Elo7 to answer the research question: How can the agility of the XP method be integrated with CRISP-DM in Data Science projects? Data was collected through interviews and questionnaires with a Data Science team consisting of data scientists, ML engineers, and data product managers. The results show that 86% of the team frequently or always applies CRISP-DM, while 71% adopt XP practices in their projects. Furthermore, the study demonstrates that it is possible to combine CRISP-DM with XP in Data Science projects, providing a structured and collaborative approach. Finally, the study generated improvement recommendations for the company.
Keywords
Cite
@article{arxiv.2505.21603,
title = {Leveraging XP and CRISP-DM for Agile Data Science Projects},
author = {Andre Massahiro Shimaoka and Renato Cordeiro Ferreira and Alfredo Goldman},
journal= {arXiv preprint arXiv:2505.21603},
year = {2025}
}