Evaluating machine unlearning methods remains technically challenging, with recent benchmarks requiring complex setups and significant engineering overhead. We introduce a unified and extensible benchmarking suite that simplifies the evaluation of unlearning algorithms using the KLoM (KL divergence of Margins) metric. Our framework provides precomputed model ensembles, oracle outputs, and streamlined infrastructure for running evaluations out of the box. By standardizing setup and metrics, it enables reproducible, scalable, and fair comparison across unlearning methods. We aim for this benchmark to serve as a practical foundation for accelerating research and promoting best practices in machine unlearning. Our code and data are publicly available.
@article{arxiv.2602.16400,
title = {Easy Data Unlearning Bench},
author = {Roy Rinberg and Pol Puigdemont and Martin Pawelczyk and Volkan Cevher},
journal= {arXiv preprint arXiv:2602.16400},
year = {2026}
}
Comments
ICML 2025 Workshop on Machine Unlearning for Generative AI