English

Topology-Aware Revival for Efficient Sparse Training

Machine Learning 2026-02-05 v1 Artificial Intelligence

Abstract

Static sparse training is a promising route to efficient learning by committing to a fixed mask pattern, yet the constrained structure reduces robustness. Early pruning decisions can lock the network into a brittle structure that is difficult to escape, especially in deep reinforcement learning (RL) where the evolving policy continually shifts the training distribution. We propose Topology-Aware Revival (TAR), a lightweight one-shot post-pruning procedure that improves static sparsity without dynamic rewiring. After static pruning, TAR performs a single revival step by allocating a small reserve budget across layers according to topology needs, randomly uniformly reactivating a few previously pruned connections within each layer, and then keeping the resulting connectivity fixed for the remainder of training. Across multiple continuous-control tasks with SAC and TD3, TAR improves final return over static sparse baselines by up to +37.9% and also outperforms dynamic sparse training baselines with a median gain of +13.5%.

Keywords

Cite

@article{arxiv.2602.04166,
  title  = {Topology-Aware Revival for Efficient Sparse Training},
  author = {Meiling Jin and Fei Wang and Xiaoyun Yuan and Chen Qian and Yuan Cheng},
  journal= {arXiv preprint arXiv:2602.04166},
  year   = {2026}
}
R2 v1 2026-07-01T09:35:18.365Z