English

Sparse by Rule: Probability-Based N:M Pruning for Spiking Neural Networks

Computer Vision and Pattern Recognition 2025-11-18 v1

Abstract

Brain-inspired Spiking neural networks (SNNs) promise energy-efficient intelligence via event-driven, sparse computation, but deeper architectures inflate parameters and computational cost, hindering their edge deployment. Recent progress in SNN pruning helps alleviate this burden, yet existing efforts fall into only two families: \emph{unstructured} pruning, which attains high sparsity but is difficult to accelerate on general hardware, and \emph{structured} pruning, which eases deployment but lack flexibility and often degrades accuracy at matched sparsity. In this work, we introduce \textbf{SpikeNM}, the first SNN-oriented \emph{semi-structured} N:MN{:}M pruning framework that learns sparse SNNs \emph{from scratch}, enforcing \emph{at most NN} non-zeros per MM-weight block. To avoid the combinatorial space complexity k=1N(Mk)\sum_{k=1}^{N}\binom{M}{k} growing exponentially with MM, SpikeNM adopts an MM-way basis-logit parameterization with a differentiable top-kk sampler, \emph{linearizing} per-block complexity to O(M)\mathcal O(M) and enabling more aggressive sparsification. Further inspired by neuroscience, we propose \emph{eligibility-inspired distillation} (EID), which converts temporally accumulated credits into block-wise soft targets to align mask probabilities with spiking dynamics, reducing sampling variance and stabilizing search under high sparsity. Experiments show that at 2:42{:}4 sparsity, SpikeNM maintains and even with gains across main-stream datasets, while yielding hardware-amenable patterns that complement intrinsic spike sparsity.

Keywords

Cite

@article{arxiv.2511.12097,
  title  = {Sparse by Rule: Probability-Based N:M Pruning for Spiking Neural Networks},
  author = {Shuhan Ye and Yi Yu and Qixin Zhang and Chenqi Kong and Qiangqiang Wu and Xudong Jiang and Dacheng Tao},
  journal= {arXiv preprint arXiv:2511.12097},
  year   = {2025}
}
R2 v1 2026-07-01T07:38:51.410Z