English

Multimodal-Guided Dynamic Dataset Pruning for Robust and Efficient Data-Centric Learning

Machine Learning 2025-07-18 v1 Computer Vision and Pattern Recognition

Abstract

Modern deep models are trained on large real-world datasets, where data quality varies and redundancy is common. Data-centric approaches such as dataset pruning have shown promise in improving training efficiency and model performance. However, most existing methods rely on static heuristics or task-specific metrics, limiting their robustness and generalizability across domains. In this work, we introduce a dynamic dataset pruning framework that adaptively selects training samples based on both task-driven difficulty and cross-modality semantic consistency. By incorporating supervision from pretrained multimodal foundation models, our approach captures training dynamics while effectively filtering out uninformative samples. Our work highlights the potential of integrating cross-modality alignment for robust sample selection, advancing data-centric learning toward more efficient and robust practices across application domains.

Keywords

Cite

@article{arxiv.2507.12750,
  title  = {Multimodal-Guided Dynamic Dataset Pruning for Robust and Efficient Data-Centric Learning},
  author = {Suorong Yang and Peijia Li and Yujie Liu and Zhiming Xu and Peng Ye and Wanli Ouyang and Furao Shen and Dongzhan Zhou},
  journal= {arXiv preprint arXiv:2507.12750},
  year   = {2025}
}
R2 v1 2026-07-01T04:05:23.469Z