English
Related papers

Related papers: Towards Memory- and Time-Efficient Backpropagation…

200 papers

Inspired by the operation of biological brains, Spiking Neural Networks (SNNs) have the unique ability to detect information encoded in spatio-temporal patterns of spiking signals. Examples of data types requiring spatio-temporal processing…

Neural and Evolutionary Computing · Computer Science 2021-04-27 Nicolas Skatchkovsky , Hyeryung Jang , Osvaldo Simeone

Spiking neural networks (SNNs) offer a promising alternative to current artificial neural networks to enable low-power event-driven neuromorphic hardware. Spike-based neuromorphic applications require processing and extracting meaningful…

Neural and Evolutionary Computing · Computer Science 2019-06-24 Deboleena Roy , Priyadarshini Panda , Kaushik Roy

The efficiency of modern machine intelligence depends on high accuracy with minimal computational cost. In spiking neural networks (SNNs), synaptic delays are crucial for encoding temporal structure, yet existing models treat them as fully…

Neural and Evolutionary Computing · Computer Science 2025-12-19 Lennart P. L. Landsmeer , Amirreza Movahedin , Mario Negrello , Said Hamdioui , Christos Strydis

Spiking neural networks (SNNs) are bio-inspired neural networks with asynchronous discrete and sparse characteristics, which have increasingly manifested their superiority in low energy consumption. Recent research is devoted to utilizing…

Neural and Evolutionary Computing · Computer Science 2023-04-20 Lang Feng , Qianhui Liu , Huajin Tang , De Ma , Gang Pan

Neuromorphic computing systems are set to revolutionize energy-constrained robotics by achieving orders-of-magnitude efficiency gains, while enabling native temporal processing. Spiking Neural Networks (SNNs) represent a promising…

Artificial Intelligence · Computer Science 2025-10-29 Korneel Van den Berghe , Stein Stroobants , Vijay Janapa Reddi , G. C. H. E. de Croon

Brain-inspired Spiking Neural Networks (SNNs) have attracted much attention due to their event-based computing and energy-efficient features. However, the spiking all-or-none nature has prevented direct training of SNNs for various…

Neural and Evolutionary Computing · Computer Science 2024-07-01 Yang Li , Feifei Zhao , Dongcheng Zhao , Yi Zeng

Ensuring energy-efficient design in neuromorphic computing systems necessitates a tailored architecture combined with algorithmic approaches. This manuscript focuses on enhancing brain-inspired perceptual computing machines through a novel…

Neural and Evolutionary Computing · Computer Science 2024-08-15 Ali Shiri Sichani , Sai Kankatala

In this article, we propose a new paradigm for training spiking neural networks (SNNs), spike accumulation forwarding (SAF). It is known that SNNs are energy-efficient but difficult to train. Consequently, many researchers have proposed…

Neural and Evolutionary Computing · Computer Science 2024-07-01 Ryuji Saiin , Tomoya Shirakawa , Sota Yoshihara , Yoshihide Sawada , Hiroyuki Kusumoto

Truncated backpropagation through time (TBPTT) is a popular method for learning in recurrent neural networks (RNNs) that saves computation and memory at the cost of bias by truncating backpropagation after a fixed number of lags. In…

Machine Learning · Computer Science 2019-07-03 Christopher Aicher , Nicholas J. Foti , Emily B. Fox

Neuromorphic object recognition with spiking neural networks (SNNs) is the cornerstone of low-power neuromorphic computing. However, existing SNNs suffer from significant latency, utilizing 10 to 40 timesteps or more, to recognize…

Computer Vision and Pattern Recognition · Computer Science 2024-01-05 Yongqi Ding , Lin Zuo , Mengmeng Jing , Pei He , Yongjun Xiao

Spiking Neural Networks (SNNs) are energy efficient alternatives to commonly used deep neural networks (DNNs). Through event-driven information processing, SNNs can reduce the expensive compute requirements of DNNs considerably, while…

Neural and Evolutionary Computing · Computer Science 2021-10-13 Sayeed Shafayet Chowdhury , Nitin Rathi , Kaushik Roy

Deep spiking neural networks (SNNs) support asynchronous event-driven computation, massive parallelism and demonstrate great potential to improve the energy efficiency of its synchronous analog counterpart. However, insufficient attention…

Neural and Evolutionary Computing · Computer Science 2019-02-18 Jibin Wu , Yansong Chua , Malu Zhang , Qu Yang , Guoqi Li , Haizhou Li

Spiking Neural Networks (SNNs) have gained popularity due to their high energy efficiency. Prior works have proposed various methods for training SNNs, including backpropagation-based methods. Training SNNs is computationally expensive…

Signal Processing · Electrical Eng. & Systems 2024-11-18 Sai Sanjeet , Bibhu Datta Sahoo , Keshab K. Parhi

Recurrent neural networks trained with the backpropagation through time (BPTT) algorithm have led to astounding successes in various temporal tasks. However, BPTT introduces severe limitations, such as the requirement to propagate…

Neural and Evolutionary Computing · Computer Science 2023-04-28 Thomas Ortner , Lorenzo Pes , Joris Gentinetta , Charlotte Frenkel , Angeliki Pantazi

Recent research has shown the vulnerability of Spiking Neural Networks (SNNs) under adversarial examples that are nearly indistinguishable from clean data in the context of frame-based and event-based information. The majority of these…

Machine Learning · Computer Science 2025-09-01 Jiaqi Lin , Abhronil Sengupta

A semi-supervised learning method for spiking neural networks is proposed. The proposed method consists of supervised learning by backpropagation and subsequent unsupervised learning by spike-timing-dependent plasticity (STDP), which is a…

Neural and Evolutionary Computing · Computer Science 2021-06-23 Kotaro Furuya , Jun Ohkubo

Spiking Neural Networks (SNNs) represent the latest generation of neural computation, offering a brain-inspired alternative to conventional Artificial Neural Networks (ANNs). Unlike ANNs, which depend on continuous-valued signals, SNNs…

Neural and Evolutionary Computing · Computer Science 2025-11-03 Sales G. Aribe

Spiking Neural Networks (SNNs) have emerged as a popular spatio-temporal computing paradigm for complex vision tasks. Recently proposed SNN training algorithms have significantly reduced the number of time steps (down to 1) for improved…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Gourav Datta , Zeyu Liu , Anni Li , Peter A. Beerel

Spiking neural networks (SNNs) have emerged as a promising direction in both computational neuroscience and artificial intelligence, offering advantages such as strong biological plausibility and low energy consumption on neuromorphic…

Neural and Evolutionary Computing · Computer Science 2025-12-04 Luu Trong Nhan , Luu Trung Duong , Pham Ngoc Nam , Truong Cong Thang

Recurrent Neural Networks (RNNs) have become an integral part of modeling and forecasting frameworks in areas like natural language processing and high-dimensional dynamical systems such as turbulent fluid flows. To improve the accuracy of…

Machine Learning · Computer Science 2023-02-23 Pantelis R. Vlachas , Petros Koumoutsakos