English
Related papers

Related papers: Training Deep Spiking Neural Networks using Backpr…

200 papers

Biologically-inspired Spiking Neural Networks (SNNs), processing information using discrete-time events known as spikes rather than continuous values, have garnered significant attention due to their hardware-friendly and energy-efficient…

Neural and Evolutionary Computing · Computer Science 2023-08-21 Bin Lei , Sheng Lin , Pei-Hung Lin , Chunhua Liao , Caiwen Ding

Computation using brain-inspired spiking neural networks (SNNs) with neuromorphic hardware may offer orders of magnitude higher energy efficiency compared to the current analog neural networks (ANNs). Unfortunately, training SNNs with the…

Neural and Evolutionary Computing · Computer Science 2020-06-09 Eimantas Ledinauskas , Julius Ruseckas , Alfonsas Juršėnas , Giedrius Buračas

Spiking Neural Networks (SNNs) may offer an energy-efficient alternative for implementing deep learning applications. In recent years, there have been several proposals focused on supervised (conversion, spike-based gradient descent) and…

Computer Vision and Pattern Recognition · Computer Science 2019-10-31 Priyadarshini Panda , Aparna Aketi , Kaushik Roy

Spiking neural networks (SNNs) have garnered a great amount of interest for supervised and unsupervised learning applications. This paper deals with the problem of training multi-layer feedforward SNNs. The non-linear integrate-and-fire…

Neural and Evolutionary Computing · Computer Science 2019-07-30 Navin Anwani , Bipin Rajendran

Configuring deep Spiking Neural Networks (SNNs) is an exciting research avenue for low power spike event based computation. However, the spike generation function is non-differentiable and therefore not directly compatible with the standard…

Neural and Evolutionary Computing · Computer Science 2018-10-23 Sumit Bam Shrestha , Garrick Orchard

We present a new back propagation based training algorithm for discrete-time spiking neural networks (SNN). Inspired by recent deep learning algorithms on binarized neural networks, binary activation with a straight-through gradient…

Neural and Evolutionary Computing · Computer Science 2017-09-20 Shihui Yin , Shreyas K. Venkataramanaiah , Gregory K. Chen , Ram Krishnamurthy , Yu Cao , Chaitali Chakrabarti , Jae-sun Seo

Spiking neural networks have gained significant attention due to their brain-like information processing capabilities. The use of surrogate gradients has made it possible to train spiking neural networks with backpropagation, leading to…

Neural and Evolutionary Computing · Computer Science 2023-05-24 Dongcheng Zhao , Guobin Shen , Yiting Dong , Yang Li , Yi Zeng

Spiking neural networks (SNNs) transmit information through discrete spikes, which performs well in processing spatial-temporal information. Due to the non-differentiable characteristic, there still exist difficulties in designing…

Neural and Evolutionary Computing · Computer Science 2021-05-28 Dongcheng Zhao , Yi Zeng , Yang Li

Deep spiking neural networks (SNNs) are promising neural networks for their model capacity from deep neural network architecture and energy efficiency from SNNs' operations. To train deep SNNs, recently, spatio-temporal backpropagation…

Neural and Evolutionary Computing · Computer Science 2023-08-02 Seongsik Park , Jeonghee Jo , Jongkil Park , Yeonjoo Jeong , Jaewook Kim , Suyoun Lee , Joon Young Kwak , Inho Kim , Jong-Keuk Park , Kyeong Seok Lee , Gye Weon Hwang , Hyun Jae Jang

Spiking neural networks (SNNs) exhibit superior energy efficiency but suffer from limited performance. In this paper, we consider SNNs as ensembles of temporal subnetworks that share architectures and weights, and highlight a crucial issue…

Machine Learning · Computer Science 2025-02-21 Yongqi Ding , Lin Zuo , Mengmeng Jing , Pei He , Hanpu Deng

Spiking Neural Networks (SNNs) have emerged with promising energy-efficient property, yet a substantial performance gap persists compared to Artificial Neural Networks (ANNs). This gap stems from at least two key limitations: first,…

Neural and Evolutionary Computing · Computer Science 2026-05-28 Feifan Zhou , Xiang Wei , Yang Liu , Qiang Yu

Spiking neural network (SNN) is interesting both theoretically and practically because of its strong bio-inspiration nature and potentially outstanding energy efficiency. Unfortunately, its development has fallen far behind the conventional…

Computer Vision and Pattern Recognition · Computer Science 2021-09-20 Shibo Zhou , Xiaohua LI , Ying Chen , Sanjeev T. Chandrasekaran , Arindam Sanyal

The spiking neural network (SNN), as a promising brain-inspired computational model with binary spike information transmission mechanism, rich spatially-temporal dynamics, and event-driven characteristics, has received extensive attention.…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Yufei Guo , Xuhui Huang , Zhe Ma

Spiking neural networks (SNNs) represent a promising approach in machine learning, combining the hierarchical learning capabilities of deep neural networks with the energy efficiency of spike-based computations. Traditional end-to-end…

Neural and Evolutionary Computing · Computer Science 2024-11-12 Ruyin Wan , Qian Zhang , George Em Karniadakis

Spiking Neural Networks (SNNs) exhibit exceptional energy efficiency on neuromorphic hardware due to their sparse activation patterns. However, conventional training methods based on surrogate gradients and Backpropagation Through Time…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Xiaochen Zhao , Chengting Yu , Kairong Yu , Lei Liu , Aili Wang

Spiking Neural Networks (SNNs) are highly energy-efficient due to event-driven, sparse computation, but their training is challenged by spike non-differentiability and trade-offs among performance, efficiency, and biological plausibility.…

Neural and Evolutionary Computing · Computer Science 2026-01-30 Zihan Huang , Zijie Xu , Yihan Huang , Shanshan Jia , Tong Bu , Yiting Dong , Wenxuan Liu , Jianhao Ding , Zhaofei Yu , Tiejun Huang

Spiking neural networks (SNNs) offer a promising pathway to implement deep neural networks (DNNs) in a more energy-efficient manner since their neurons are sparsely activated and inferences are event-driven. However, there have been very…

Neural and Evolutionary Computing · Computer Science 2024-06-28 Changze Lv , Jianhan Xu , Xiaoqing Zheng

Spiking neural networks (SNNs) are positioned to enable spatio-temporal information processing and ultra-low power event-driven neuromorphic hardware. However, SNNs are yet to reach the same performances of conventional deep artificial…

Neural and Evolutionary Computing · Computer Science 2019-01-23 Yingyezhe Jin , Wenrui Zhang , Peng Li

Spiking Neural Networks (SNNs) have emerged as an attractive alternative to traditional deep learning frameworks, since they provide higher computational efficiency in event driven neuromorphic hardware. However, the state-of-the-art (SOTA)…

Neural and Evolutionary Computing · Computer Science 2021-09-05 Gourav Datta , Souvik Kundu , Peter A. Beerel

Neuromorphic computing aims to replicate the brain's capabilities for energy efficient and parallel information processing, promising a solution to the increasing demand for faster and more efficient computational systems. Efficient…

Neural and Evolutionary Computing · Computer Science 2025-03-20 Gabriel Béna , Timo Wunderlich , Mahmoud Akl , Bernhard Vogginger , Christian Mayr , Hector Andres Gonzalez