$SpikePack$: Enhanced Information Flow in Spiking Neural Networks with High Hardware Compatibility
Abstract
Spiking Neural Networks (SNNs) hold promise for energy-efficient, biologically inspired computing. We identify substantial informatio loss during spike transmission, linked to temporal dependencies in traditional Leaky Integrate-and-Fire (LIF) neuron-a key factor potentially limiting SNN performance. Existing SNN architectures also underutilize modern GPUs, constrained by single-bit spike storage and isolated weight-spike operations that restrict computational efficiency. We introduce , a neuron model designed to reduce transmission loss while preserving essential features like membrane potential reset and leaky integration. achieves constant time and space complexity, enabling efficient parallel processing on GPUs and also supporting serial inference on existing SNN hardware accelerators. Compatible with standard Artificial Neural Network (ANN) architectures, facilitates near-lossless ANN-to-SNN conversion across various networks. Experimental results on tasks such as image classification, detection, and segmentation show achieves significant gains in accuracy and efficiency for both directly trained and converted SNNs over state-of-the-art models. Tests on FPGA-based platforms further confirm cross-platform flexibility, delivering high performance and enhanced sparsity. By enhancing information flow and rethinking SNN-ANN integration, advances efficient SNN deployment across diverse hardware platforms.
Keywords
Cite
@article{arxiv.2501.14484,
title = {$SpikePack$: Enhanced Information Flow in Spiking Neural Networks with High Hardware Compatibility},
author = {Guobin Shen and Jindong Li and Tenglong Li and Dongcheng Zhao and Yi Zeng},
journal= {arXiv preprint arXiv:2501.14484},
year = {2025}
}