Structural pruning has emerged as a promising approach for producing more efficient models. Nevertheless, the community suffers from a lack of standardized benchmarks and metrics, leaving the progress in this area not fully comprehended. To fill this gap, we present the first comprehensive benchmark, termed PruningBench, for structural pruning. PruningBench showcases the following three characteristics: 1) PruningBench employs a unified and consistent framework for evaluating the effectiveness of diverse structural pruning techniques; 2) PruningBench systematically evaluates 16 existing pruning methods, encompassing a wide array of models (e.g., CNNs and ViTs) and tasks (e.g., classification and detection); 3) PruningBench provides easily implementable interfaces to facilitate the implementation of future pruning methods, and enables the subsequent researchers to incorporate their work into our leaderboards. We provide an online pruning platform for customizing pruning tasks and reproducing all results in this paper. Leaderboard results can also be available.
@article{arxiv.2406.12315,
title = {A Comprehensive Study of Structural Pruning for Vision Models},
author = {Changhao Li and Haoling Li and Mengqi Xue and Gongfan Fang and Sheng Zhou and Zunlei Feng and Huiqiong Wang and Mingli Song and Jie Song},
journal= {arXiv preprint arXiv:2406.12315},
year = {2025}
}
Comments
This paper aims to introduce an evaluation benchmark for structural pruning. The complete text spans 25 pages