English

$SpikePack$: Enhanced Information Flow in Spiking Neural Networks with High Hardware Compatibility

Neural and Evolutionary Computing 2025-02-04 v2

Abstract

Spiking Neural Networks (SNNs) hold promise for energy-efficient, biologically inspired computing. We identify substantial informatio loss during spike transmission, linked to temporal dependencies in traditional Leaky Integrate-and-Fire (LIF) neuron-a key factor potentially limiting SNN performance. Existing SNN architectures also underutilize modern GPUs, constrained by single-bit spike storage and isolated weight-spike operations that restrict computational efficiency. We introduce SpikePack{SpikePack}, a neuron model designed to reduce transmission loss while preserving essential features like membrane potential reset and leaky integration. SpikePack{SpikePack} achieves constant O(1)\mathcal{O}(1) time and space complexity, enabling efficient parallel processing on GPUs and also supporting serial inference on existing SNN hardware accelerators. Compatible with standard Artificial Neural Network (ANN) architectures, SpikePack{SpikePack} facilitates near-lossless ANN-to-SNN conversion across various networks. Experimental results on tasks such as image classification, detection, and segmentation show SpikePack{SpikePack} achieves significant gains in accuracy and efficiency for both directly trained and converted SNNs over state-of-the-art models. Tests on FPGA-based platforms further confirm cross-platform flexibility, delivering high performance and enhanced sparsity. By enhancing information flow and rethinking SNN-ANN integration, SpikePack{SpikePack} advances efficient SNN deployment across diverse hardware platforms.

Keywords

Cite

@article{arxiv.2501.14484,
  title  = {$SpikePack$: Enhanced Information Flow in Spiking Neural Networks with High Hardware Compatibility},
  author = {Guobin Shen and Jindong Li and Tenglong Li and Dongcheng Zhao and Yi Zeng},
  journal= {arXiv preprint arXiv:2501.14484},
  year   = {2025}
}