English
Related papers

Related papers: Beyond Rate Coding: Surrogate Gradients Enable Spi…

200 papers

Understanding cognitive processes in the brain demands sophisticated models capable of replicating neural dynamics at large scales. We present a physiologically inspired speech recognition architecture, compatible and scalable with deep…

Computation and Language · Computer Science 2024-09-26 Alexandre Bittar , Philip N. Garner

Adaptive "life-long" learning at the edge and during online task performance is an aspirational goal of AI research. Neuromorphic hardware implementing Spiking Neural Networks (SNNs) are particularly attractive in this regard, as their…

Neural and Evolutionary Computing · Computer Science 2022-01-27 Kenneth Stewart , Emre Neftci

Biological neurons use spikes to process and learn temporally dynamic inputs in an energy and computationally efficient way. However, applying the state-of-the-art gradient-based supervised algorithms to spiking neural networks (SNN) is a…

Computer Vision and Pattern Recognition · Computer Science 2020-01-14 Aref Moqadam Mehr , Saeed Reza Kheradpisheh , Hadi Farahani

We propose a novel backpropagation algorithm for training spiking neural networks (SNNs) that encodes information in the relative multiple spike timing of individual neurons without single-spike restrictions. The proposed algorithm inherits…

Neural and Evolutionary Computing · Computer Science 2026-05-15 Kakei Yamamoto , Yusuke Sakemi , Kazuyuki Aihara

The information of spiking neural networks (SNNs) are propagated between the adjacent biological neuron by spikes, which provides a computing paradigm with the promise of simulating the human brain. Recent studies have found that the time…

Neural and Evolutionary Computing · Computer Science 2022-05-05 Pengfei Sun , Longwei Zhu , Dick Botteldooren

Spiking neural networks have gained significant attention due to their brain-like information processing capabilities. The use of surrogate gradients has made it possible to train spiking neural networks with backpropagation, leading to…

Neural and Evolutionary Computing · Computer Science 2023-05-24 Dongcheng Zhao , Guobin Shen , Yiting Dong , Yang Li , Yi Zeng

Spiking neural network is a type of artificial neural network in which neurons communicate between each other with spikes. Spikes are identical Boolean events characterized by the time of their arrival. A spiking neuron has internal…

Neural and Evolutionary Computing · Computer Science 2016-02-16 Oleg Y. Sinyavskiy

There is an increasing demand to process streams of temporal data in energy-limited scenarios such as embedded devices, driven by the advancement and expansion of Internet of Things (IoT) and Cyber-Physical Systems (CPS). Spiking neural…

Neural and Evolutionary Computing · Computer Science 2020-07-08 Haowen Fang , Amar Shrestha , Qinru Qiu

Spiking Neural Networks (SNNs) are recognized as the candidate for the next-generation neural networks due to their bio-plausibility and energy efficiency. Recently, researchers have demonstrated that SNNs are able to achieve nearly…

Machine Learning · Computer Science 2023-04-27 Yuhang Li , Youngeun Kim , Hyoungseob Park , Priyadarshini Panda

For the gradient computation across the time domain in Spiking Neural Networks (SNNs) training, two different approaches have been independently studied. The first is to compute the gradients with respect to the change in spike activation…

Neural and Evolutionary Computing · Computer Science 2020-10-26 Jinseok Kim , Kyungsu Kim , Jae-Joon Kim

One of the key challenges in training Spiking Neural Networks (SNNs) is that target outputs typically come in the form of natural signals, such as labels for classification or images for generative models, and need to be encoded into…

Neural and Evolutionary Computing · Computer Science 2021-09-30 Nicolas Skatchkovsky , Osvaldo Simeone , Hyeryung Jang

Spiking neural networks (SNNs) are investigated as biologically inspired models of neural computation, distinguished by their computational capability and energy efficiency due to precise spiking times and sparse spikes with event-driven…

Neural and Evolutionary Computing · Computer Science 2024-05-28 Mingqing Xiao , Yixin Zhu , Di He , Zhouchen Lin

Spiking Neural Networks (SNNs) offer inherent advantages for low-power inference through sparse, event-driven computation. However, the theoretical energy benefits of SNNs are often decoupled from real hardware performance due to the opaque…

Hardware Architecture · Computer Science 2026-03-27 Ilkin Aliyev , Jesus Lopez , Tosiron Adegbija

The timing of individual neuronal spikes is essential for biological brains to make fast responses to sensory stimuli. However, conventional artificial neural networks lack the intrinsic temporal coding ability present in biological…

Neural and Evolutionary Computing · Computer Science 2020-11-18 Iulia M. Comsa , Krzysztof Potempa , Luca Versari , Thomas Fischbacher , Andrea Gesmundo , Jyrki Alakuijala

There is extensive evidence that biological neural networks encode information in the precise timing of the spikes generated and transmitted by neurons, which offers several advantages over rate-based codes. Here we adopt a vector space…

Neurons and Cognition · Quantitative Biology 2019-07-16 Dorian Florescu , Daniel Coca

Spiking neural networks (SNN) are a promising research avenue for building accurate and efficient automatic speech recognition systems. Recent advances in audio-to-spike encoding and training algorithms enable SNN to be applied in practical…

Neural and Evolutionary Computing · Computer Science 2023-02-20 Pengfei Sun , Ehsan Eqlimi , Yansong Chua , Paul Devos , Dick Botteldooren

A vast majority of computation in the brain is performed by spiking neural networks. Despite the ubiquity of such spiking, we currently lack an understanding of how biological spiking neural circuits learn and compute in-vivo, as well as…

Neurons and Cognition · Quantitative Biology 2018-05-31 Friedemann Zenke , Surya Ganguli

The spiking neural network (SNN), as a promising brain-inspired computational model with binary spike information transmission mechanism, rich spatially-temporal dynamics, and event-driven characteristics, has received extensive attention.…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Yufei Guo , Xuhui Huang , Zhe Ma

Spiking neural networks (SNNs) are rapidly gaining momentum as an alternative to conventional artificial neural networks in resource constrained edge systems. In this work, we continue a recent research line on recurrent SNNs where axonal…

Neural and Evolutionary Computing · Computer Science 2026-04-20 Lúcio Folly Sanches Zebendo , Eleonora Cicciarella , Michele Rossi

Spiking neural networks (SNN) distinguish themselves from artificial neural networks (ANN) because of their inherent temporal processing and spike-based computations, enabling a power-efficient implementation in neuromorphic hardware. In…

Neural and Evolutionary Computing · Computer Science 2023-11-29 Lucas Deckers , Laurens Van Damme , Ing Jyh Tsang , Werner Van Leekwijck , Steven Latré