English
Related papers

Related papers: Directly Training Temporal Spiking Neural Network …

200 papers

The highly sparse activations in Spiking Neural Networks (SNNs) can provide tremendous energy efficiency benefits when carefully exploited in hardware. The behavior of sparsity in SNNs is uniquely shaped by the dataset and training…

Neural and Evolutionary Computing · Computer Science 2024-02-12 Ilkin Aliyev , Tosiron Adegbija

Spiking Neural Networks (SNNs) are being explored for their potential energy efficiency resulting from sparse, event-driven computations. Many recent works have demonstrated effective backpropagation for deep Spiking Neural Networks (SNNs)…

Neural and Evolutionary Computing · Computer Science 2020-03-04 Jason M. Allred , Steven J. Spencer , Gopalakrishnan Srinivasan , Kaushik Roy

Spiking neural networks (SNNs) have emerged as a promising direction in both computational neuroscience and artificial intelligence, offering advantages such as strong biological plausibility and low energy consumption on neuromorphic…

Neural and Evolutionary Computing · Computer Science 2025-12-04 Luu Trong Nhan , Luu Trung Duong , Pham Ngoc Nam , Truong Cong Thang

Surrogate gradients are a standard tool for training spiking neural networks (SNNs), but conventional hard forward or surrogate backward training couples a nonsmooth forward model with a biased gradient estimator. We study sharpness aware…

Neural and Evolutionary Computing · Computer Science 2026-03-20 Maximilian Nicholson

Spiking neural networks (SNNs) are promising in a bio-plausible coding for spatio-temporal information and event-driven signal processing, which is very suited for energy-efficient implementation in neuromorphic hardware. However, the…

Neural and Evolutionary Computing · Computer Science 2020-12-21 Hanle Zheng , Yujie Wu , Lei Deng , Yifan Hu , Guoqi Li

Spiking Neural Networks (SNNs) have recently emerged as the low-power alternative to Artificial Neural Networks (ANNs) because of their sparse, asynchronous, and binary event-driven processing. Due to their energy efficiency, SNNs have a…

Computer Vision and Pattern Recognition · Computer Science 2021-10-18 Youngeun Kim , Joshua Chough , Priyadarshini Panda

Spiking neural networks (SNNs) are different from the classical networks used in deep learning: the neurons communicate using electrical impulses called spikes, just like biological neurons. SNNs are appealing for AI technology, because…

Neural and Evolutionary Computing · Computer Science 2022-01-10 Nandan Meda

As the scales of neural networks increase, techniques that enable them to run with low computational cost and energy efficiency are required. From such demands, various efficient neural network paradigms, such as spiking neural networks…

Machine Learning · Computer Science 2023-02-06 Kazuma Suetake , Shin-ichi Ikegawa , Ryuji Saiin , Yoshihide Sawada

Spiking Neural Networks (SNNs) are recognized as the candidate for the next-generation neural networks due to their bio-plausibility and energy efficiency. Recently, researchers have demonstrated that SNNs are able to achieve nearly…

Machine Learning · Computer Science 2023-04-27 Yuhang Li , Youngeun Kim , Hyoungseob Park , Priyadarshini Panda

Spiking neural networks (SNNs) represent a promising approach in machine learning, combining the hierarchical learning capabilities of deep neural networks with the energy efficiency of spike-based computations. Traditional end-to-end…

Neural and Evolutionary Computing · Computer Science 2024-11-12 Ruyin Wan , Qian Zhang , George Em Karniadakis

The surrogate gradient (SG) method has shown significant promise in enhancing the performance of deep spiking neural networks (SNNs), but it also introduces vulnerabilities to adversarial attacks. Although spike coding strategies and neural…

Machine Learning · Computer Science 2025-11-19 Runhao Jiang , Chengzhi Jiang , Rui Yan , Huajin Tang

Spiking neural networks (SNNs) are promising brain-inspired energy-efficient models. Recent progress in training methods has enabled successful deep SNNs on large-scale tasks with low latency. Particularly, backpropagation through time…

Neural and Evolutionary Computing · Computer Science 2023-01-03 Mingqing Xiao , Qingyan Meng , Zongpeng Zhang , Di He , Zhouchen Lin

Spiking Neural Networks (SNNs) have attracted growing interest in both computational neuroscience and artificial intelligence, primarily due to their inherent energy efficiency and compact memory footprint. However, achieving adversarial…

Neural and Evolutionary Computing · Computer Science 2025-12-04 Luu Trong Nhan , Luu Trung Duong , Pham Ngoc Nam , Truong Cong Thang

Spiking neural networks (SNNs) promise low-power event-driven computation for temporally rich tasks, but commonly used neuron models often trade off gradient-based trainability, dynamical richness, and high activity sparsity. These…

Neural and Evolutionary Computing · Computer Science 2026-05-13 Alex Fulleda-Garcia , Saray Soldado-Magraner , Josep Maria Margarit-Taulé

Spiking Neural Networks (SNNs) are promising energy-efficient models for neuromorphic computing. For training the non-differentiable SNN models, the backpropagation through time (BPTT) with surrogate gradients (SG) method has achieved high…

Neural and Evolutionary Computing · Computer Science 2023-08-08 Qingyan Meng , Mingqing Xiao , Shen Yan , Yisen Wang , Zhouchen Lin , Zhi-Quan Luo

Brain-inspired spiking neural networks (SNNs) are recognized as a promising avenue for achieving efficient, low-energy neuromorphic computing. Direct training of SNNs typically relies on surrogate gradient (SG) learning to estimate…

Neural and Evolutionary Computing · Computer Science 2025-11-18 Jiaqiang Jiang , Wenfeng Xu , Jing Fan , Rui Yan

State-of-the-art neural network training methods depend on the gradient of the network function. Therefore, they cannot be applied to networks whose activation functions do not have useful derivatives, such as binary and discrete-time…

Machine Learning · Statistics 2025-06-24 Luke Eilers , Raoul-Martin Memmesheimer , Sven Goedeke

In recent years, spiking neural networks (SNNs) have gained momentum due to their high potential in time-series processing combined with minimal energy consumption. However, they still lack a dedicated and efficient training algorithm. The…

Machine Learning · Computer Science 2026-01-21 Giovanni Perin , Cesare Bidini , Riccardo Mazzieri , Michele Rossi

Spiking Neural Networks (SNNs) have been proposed as biologically plausible and energy-efficient alternatives to conventional Artificial Neural Networks (ANNs). However, the training of SNN usually relies on surrogate gradients due to the…

Neural and Evolutionary Computing · Computer Science 2026-05-11 Himanshu Udupi , Xiaocong Yang , ChengXiang Zhai

Inspired by the operation of biological brains, Spiking Neural Networks (SNNs) have the unique ability to detect information encoded in spatio-temporal patterns of spiking signals. Examples of data types requiring spatio-temporal processing…

Neural and Evolutionary Computing · Computer Science 2021-04-27 Nicolas Skatchkovsky , Hyeryung Jang , Osvaldo Simeone