English
Related papers

Related papers: Desire Backpropagation: A Lightweight Training Alg…

200 papers

The adaptive changes in synaptic efficacy that occur between spiking neurons have been demonstrated to play a critical role in learning for biological neural networks. Despite this source of inspiration, many learning focused applications…

Neural and Evolutionary Computing · Computer Science 2022-05-30 Samuel Schmidgall , Julia Ashkanazy , Wallace Lawson , Joe Hays

Recent advances in Voice Activity Detection (VAD) are driven by artificial and Recurrent Neural Networks (RNNs), however, using a VAD system in battery-operated devices requires further power efficiency. This can be achieved by neuromorphic…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-01 Flavio Martinelli , Giorgia Dellaferrera , Pablo Mainar , Milos Cernak

Spiking neural networks (SNNs) are good candidates to produce ultra-energy-efficient hardware. However, the performance of these models is currently behind traditional methods. Introducing multi-layered SNNs is a promising way to reduce…

Computer Vision and Pattern Recognition · Computer Science 2019-04-04 Pierre Falez , Pierre Tirilly , Ioan Marius Bilasco , Philippe Devienne , Pierre Boulet

Spiking Neural Networks (SNNs) are promising brain-inspired models known for low power consumption and superior potential for temporal processing, but identifying suitable learning mechanisms remains a challenge. Despite the presence of…

Neural and Evolutionary Computing · Computer Science 2025-08-20 Yuzhe Liu , Xin Deng , Qiang Yu

Spiking Neural Networks (SNNs), as an emerging biologically inspired computational model, demonstrate significant energy efficiency advantages due to their event-driven information processing mechanism. Compared to traditional Artificial…

Neural and Evolutionary Computing · Computer Science 2025-08-18 Changqing Xu , Buxuan Song , Yi Liu , Xinfang Liao , Wenbin Zheng , Yintang Yang

Recent advances in event-based neuromorphic systems have resulted in significant interest in the use and development of spiking neural networks (SNNs). However, the non-differentiable nature of spiking neurons makes SNNs incompatible with…

Neural and Evolutionary Computing · Computer Science 2020-07-10 Ali Lotfi Rezaabad , Sriram Vishwanath

Spiking Neural Networks (SNNs) are being explored for their potential energy efficiency benefits due to sparse, event-driven computation. Non-spiking artificial neural networks are typically trained with stochastic gradient descent using…

Neural and Evolutionary Computing · Computer Science 2021-11-19 Jason Allred , Kaushik Roy

Spiking neural networks (SNNs) offer a promising energy-efficient alternative to artificial neural networks (ANNs), in virtue of their high biological plausibility, rich spatial-temporal dynamics, and event-driven computation. The direct…

Neural and Evolutionary Computing · Computer Science 2024-07-12 Chenlin Zhou , Han Zhang , Liutao Yu , Yumin Ye , Zhaokun Zhou , Liwei Huang , Zhengyu Ma , Xiaopeng Fan , Huihui Zhou , Yonghong Tian

We propose a new supervised learning rule for multilayer spiking neural networks (SNNs) that use a form of temporal coding known as rank-order-coding. With this coding scheme, all neurons fire exactly one spike per stimulus, but the firing…

Neural and Evolutionary Computing · Computer Science 2020-06-16 Saeed Reza Kheradpisheh , Timothée Masquelier

Recent insights have revealed that rate-coding is a primary form of information representation captured by surrogate-gradient-based Backpropagation Through Time (BPTT) in training deep Spiking Neural Networks (SNNs). Motivated by these…

Machine Learning · Computer Science 2024-10-23 Chengting Yu , Lei Liu , Gaoang Wang , Erping Li , Aili Wang

Spiking Neural Networks (SNNs) have emerged as a popular spatio-temporal computing paradigm for complex vision tasks. Recently proposed SNN training algorithms have significantly reduced the number of time steps (down to 1) for improved…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Gourav Datta , Zeyu Liu , Anni Li , Peter A. Beerel

In this work we propose a new supervised learning method for temporally-encoded multilayer spiking networks to perform classification. The method employs a reinforcement signal that mimics backpropagation but is far less computationally…

Neural and Evolutionary Computing · Computer Science 2020-07-28 Andrew Stephan , Brian Gardner , Steven J. Koester , Andre Gruning

Spiking Neural Networks (SNNs) have been attached great importance due to their biological plausibility and high energy-efficiency on neuromorphic chips. As these chips are usually resource-constrained, the compression of SNNs is thus…

Neural and Evolutionary Computing · Computer Science 2021-08-19 Yanqi Chen , Zhaofei Yu , Wei Fang , Tiejun Huang , Yonghong Tian

As the scales of neural networks increase, techniques that enable them to run with low computational cost and energy efficiency are required. From such demands, various efficient neural network paradigms, such as spiking neural networks…

Machine Learning · Computer Science 2023-02-06 Kazuma Suetake , Shin-ichi Ikegawa , Ryuji Saiin , Yoshihide Sawada

Spiking Neural Network (SNN) is considered more biologically realistic and power-efficient as it imitates the fundamental mechanism of the human brain. Recently, backpropagation (BP) based SNN learning algorithms that utilize deep learning…

Neural and Evolutionary Computing · Computer Science 2022-10-11 Chengting Yu , Yangkai Du , Mufeng Chen , Aili Wang , Gaoang Wang , Erping Li

Spiking Neural Networks (SNNs) are distributed trainable systems whose computing elements, or neurons, are characterized by internal analog dynamics and by digital and sparse synaptic communications. The sparsity of the synaptic spiking…

Signal Processing · Electrical Eng. & Systems 2019-10-22 Hyeryung Jang , Osvaldo Simeone , Brian Gardner , André Grüning

Spiking Neural Network (SNN) is the third generation of Neural Network (NN) mimicking the natural behavior of the brain. By processing based on binary input/output, SNNs offer lower complexity, higher density and lower power consumption.…

Neural and Evolutionary Computing · Computer Science 2020-03-24 Khanh N. Dang , Abderazek Ben Abdallah

Spiking Neural Networks (SNNs) contain more biologically realistic structures and biologically-inspired learning principles than those in standard Artificial Neural Networks (ANNs). SNNs are considered the third generation of ANNs, powerful…

Neural and Evolutionary Computing · Computer Science 2021-06-01 Tielin Zhang , Shuncheng Jia , Xiang Cheng , Bo Xu

Recently, spiking neural networks (SNNs) have demonstrated substantial potential in computer vision tasks. In this paper, we present an Efficient Spiking Deraining Network, called ESDNet. Our work is motivated by the observation that rain…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Tianyu Song , Guiyue Jin , Pengpeng Li , Kui Jiang , Xiang Chen , Jiyu Jin

Spiking Neural Networks (SNNs) are biologically plausible models that have been identified as potentially apt for deploying energy-efficient intelligence at the edge, particularly for sequential learning tasks. However, training of SNNs…

Neural and Evolutionary Computing · Computer Science 2025-01-09 Marco Paul E. Apolinario , Kaushik Roy