English
Related papers

Related papers: Fine-Tuning Surrogate Gradient Learning for Optima…

200 papers

Spiking Neural Networks (SNNs) have been proposed as biologically plausible and energy-efficient alternatives to conventional Artificial Neural Networks (ANNs). However, the training of SNN usually relies on surrogate gradients due to the…

Neural and Evolutionary Computing · Computer Science 2026-05-11 Himanshu Udupi , Xiaocong Yang , ChengXiang Zhai

Computation using brain-inspired spiking neural networks (SNNs) with neuromorphic hardware may offer orders of magnitude higher energy efficiency compared to the current analog neural networks (ANNs). Unfortunately, training SNNs with the…

Neural and Evolutionary Computing · Computer Science 2020-06-09 Eimantas Ledinauskas , Julius Ruseckas , Alfonsas Juršėnas , Giedrius Buračas

Spiking neural networks are nature's versatile solution to fault-tolerant and energy efficient signal processing. To translate these benefits into hardware, a growing number of neuromorphic spiking neural network processors attempt to…

Neural and Evolutionary Computing · Computer Science 2019-05-06 Emre O. Neftci , Hesham Mostafa , Friedemann Zenke

Spiking Neural Networks (SNNs) promise orders-of-magnitude lower power consumption and low-latency inference on neuromorphic hardware for a wide range of robotic tasks. In this work, we present an energy-efficient implementation of a…

Machine Learning · Computer Science 2025-08-01 Sirine Arfa , Bernhard Vogginger , Christian Mayr

Spiking Neural Networks (SNNs) operate with asynchronous discrete events (or spikes) which can potentially lead to higher energy-efficiency in neuromorphic hardware implementations. Many works have shown that an SNN for inference can be…

Machine Learning · Computer Science 2020-05-06 Nitin Rathi , Gopalakrishnan Srinivasan , Priyadarshini Panda , Kaushik Roy

Spiking neural networks (SNNs) promise orders-of-magnitude efficiency gains by communicating with sparse, event-driven spikes rather than dense numerical activations. However, most training pipelines either rely on surrogate-gradient…

Neural and Evolutionary Computing · Computer Science 2025-12-17 Arman Ferdowsi , Atakan Aral

Spiking Neural Networks (SNNs) are one of the most promising bio-inspired neural networks models and have drawn increasing attention in recent years. The event-driven communication mechanism of SNNs allows for sparse and theoretically…

Neural and Evolutionary Computing · Computer Science 2025-10-29 Andrea Castagnetti , Alain Pegatoquet , Benoît Miramond

Spiking Neural Networks (SNNs) have emerged as a promising paradigm, offering event-driven and energy-efficient computation. In recent studies, various devices tailored for SNN synapses and neurons have been proposed, leveraging the unique…

Other Condensed Matter · Physics 2024-03-01 Debasis Das , Xuanyao Fong

Inspired by more detailed modeling of biological neurons, Spiking neural networks (SNNs) have been investigated both as more biologically plausible and potentially more powerful models of neural computation, and also with the aim of…

Neural and Evolutionary Computing · Computer Science 2021-03-24 Bojian Yin , Federico Corradi , Sander M. Bohte

Spiking Neural Networks (SNNs) have become popular for their more bio-realistic behavior than Artificial Neural Networks (ANNs). However, effectively leveraging the intrinsic, unstructured sparsity of SNNs in hardware is challenging,…

Hardware Architecture · Computer Science 2024-02-12 Ilkin Aliyev , Tosiron Adegbija

There is an increasing interest in emulating Spiking Neural Networks (SNNs) on neuromorphic computing devices due to their low energy consumption. Recent advances have allowed training SNNs to a point where they start to compete with…

Neural and Evolutionary Computing · Computer Science 2022-01-14 Nicolas Perez-Nieves , Dan F. M. Goodman

Low-latency deep spiking neural networks (SNNs) have become a promising alternative to conventional artificial neural networks (ANNs) because of their potential for increased energy efficiency on event-driven neuromorphic hardware. Neural…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Souvik Kundu , Massoud Pedram , Peter A. Beerel

Spiking Neural Networks (SNN). SNNs are based on a more biologically inspired approach than usual artificial neural networks. Such models are characterized by complex dynamics between neurons and spikes. These are very sensitive to the…

Neural and Evolutionary Computing · Computer Science 2024-09-06 Thomas Firmin , Pierre Boulet , El-Ghazali Talbi

Recently, brain-inspired spiking neuron networks (SNNs) have attracted widespread research interest because of their event-driven and energy-efficient characteristics. Still, it is difficult to efficiently train deep SNNs due to the…

Neural and Evolutionary Computing · Computer Science 2022-05-17 Shikuang Deng , Yuhang Li , Shanghang Zhang , Shi Gu

Spiking neural networks (SNNs) communicate via discrete spikes in time rather than continuous activations. Their event-driven nature offers advantages for temporal processing and energy efficiency on resource-constrained hardware, but…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Karol C. Jurzec , Tomasz Szydlo , Maciej Wielgosz

Spiking Neural Networks (SNNs) utilize spike-based activations to mimic the brain's energy-efficient information processing. However, the binary and discontinuous nature of spike activations causes vanishing gradients, making adversarial…

Machine Learning · Computer Science 2026-02-10 Jihang Wang , Dongcheng Zhao , Ruolin Chen , Qian Zhang , Yi Zeng

Spiking neural networks have gained significant attention due to their brain-like information processing capabilities. The use of surrogate gradients has made it possible to train spiking neural networks with backpropagation, leading to…

Neural and Evolutionary Computing · Computer Science 2023-05-24 Dongcheng Zhao , Guobin Shen , Yiting Dong , Yang Li , Yi Zeng

Spiking neural networks (SNNs) have been widely used due to their strong biological interpretability and high energy efficiency. With the introduction of the backpropagation algorithm and surrogate gradient, the structure of spiking neural…

Neural and Evolutionary Computing · Computer Science 2023-06-07 Jindong Li , Guobin Shen , Dongcheng Zhao , Qian Zhang , Yi Zeng

Spiking neural networks (SNNs) exhibit superior energy efficiency but suffer from limited performance. In this paper, we consider SNNs as ensembles of temporal subnetworks that share architectures and weights, and highlight a crucial issue…

Machine Learning · Computer Science 2025-02-21 Yongqi Ding , Lin Zuo , Mengmeng Jing , Pei He , Hanpu Deng

Spiking Neural Networks (SNNs) that operate in an event-driven manner and employ binary spike representation have recently emerged as promising candidates for energy-efficient computing. However, a cost bottleneck arises in obtaining…

Neural and Evolutionary Computing · Computer Science 2024-01-22 Yunpeng Yao , Man Wu , Zheng Chen , Renyuan Zhang