English
Related papers

Related papers: Towards Memory- and Time-Efficient Backpropagation…

200 papers

Spiking Neural Networks (SNNs), as an emerging biologically inspired computational model, demonstrate significant energy efficiency advantages due to their event-driven information processing mechanism. Compared to traditional Artificial…

Neural and Evolutionary Computing · Computer Science 2025-08-18 Changqing Xu , Buxuan Song , Yi Liu , Xinfang Liao , Wenbin Zheng , Yintang Yang

Spiking neural networks (SNNs) are brain-inspired models that enable energy-efficient implementation on neuromorphic hardware. However, the supervised training of SNNs remains a hard problem due to the discontinuity of the spiking neuron…

Neural and Evolutionary Computing · Computer Science 2021-12-20 Mingqing Xiao , Qingyan Meng , Zongpeng Zhang , Yisen Wang , Zhouchen Lin

Spiking neural networks (SNNs), that operate via binary spikes distributed over time, have emerged as a promising energy efficient ML paradigm for resource-constrained devices. However, the current state-of-the-art (SOTA) SNNs require…

Computer Vision and Pattern Recognition · Computer Science 2021-12-23 Gourav Datta , Peter A. Beerel

The emergence of brain-inspired neuromorphic computing as a paradigm for edge AI is motivating the search for high-performance and efficient spiking neural networks to run on this hardware. However, compared to classical neural networks in…

Neural and Evolutionary Computing · Computer Science 2020-06-17 Bojian Yin , Federico Corradi , Sander M. Bohté

Spiking Neural Networks are often touted as brain-inspired learning models for the third wave of Artificial Intelligence. Although recent SNNs trained with supervised backpropagation show classification accuracy comparable to deep networks,…

Neural and Evolutionary Computing · Computer Science 2022-11-09 Biswadeep Chakraborty , Saibal Mukhopadhyay

Spiking neural networks (SNNs) promise orders-of-magnitude efficiency gains by communicating with sparse, event-driven spikes rather than dense numerical activations. However, most training pipelines either rely on surrogate-gradient…

Neural and Evolutionary Computing · Computer Science 2025-12-17 Arman Ferdowsi , Atakan Aral

Spiking neural networks (SNNs) are brain-inspired mathematical models with the ability to process information in the form of spikes. SNNs are expected to provide not only new machine-learning algorithms, but also energy-efficient…

Neural and Evolutionary Computing · Computer Science 2020-01-16 Yusuke Sakemi , Kai Morino , Takashi Morie , Kazuyuki Aihara

Spiking Neural Networks (SNNs) may offer an energy-efficient alternative for implementing deep learning applications. In recent years, there have been several proposals focused on supervised (conversion, spike-based gradient descent) and…

Computer Vision and Pattern Recognition · Computer Science 2019-10-31 Priyadarshini Panda , Aparna Aketi , Kaushik Roy

We present a fully memristive spiking neural network (MSNN) consisting of novel memristive neurons trained using the backpropagation through time (BPTT) learning rule. Gradient descent is applied directly to the memristive…

Neural and Evolutionary Computing · Computer Science 2022-03-11 Peng Zhou , Jason K. Eshraghian , Dong-Uk Choi , Sung-Mo Kang

We examine the efficiency of Recurrent Neural Networks in forecasting the spatiotemporal dynamics of high dimensional and reduced order complex systems using Reservoir Computing (RC) and Backpropagation through time (BPTT) for gated network…

Signal Processing · Electrical Eng. & Systems 2020-02-19 Pantelis R. Vlachas , Jaideep Pathak , Brian R. Hunt , Themistoklis P. Sapsis , Michelle Girvan , Edward Ott , Petros Koumoutsakos

Speech Emotion Recognition (SER) is widely deployed in Human-Computer Interaction, yet the high computational cost of conventional models hinders their implementation on resource-constrained edge devices. Spiking Neural Networks (SNNs)…

Artificial Intelligence · Computer Science 2026-02-10 Xun Su , Huamin Wang , Qi Zhang

The vast majority of natural sensory data is temporally redundant. Video frames or audio samples which are sampled at nearby points in time tend to have similar values. Typically, deep learning algorithms take no advantage of this…

Neural and Evolutionary Computing · Computer Science 2017-06-14 Peter O'Connor , Efstratios Gavves , Max Welling

Spiking neural networks (SNNs) are widely applied in various fields due to their energy-efficient and fast-inference capabilities. Applying SNNs to reinforcement learning (RL) can significantly reduce the computational resource requirements…

Neural and Evolutionary Computing · Computer Science 2024-04-25 Lang Qin , Ziming Wang , Runhao Jiang , Rui Yan , Huajin Tang

Accumulated detailed knowledge about the neuronal activities in human brains has brought more attention to bio-inspired spiking neural networks (SNNs). In contrast to non-spiking deep neural networks (DNNs), SNNs can encode and transmit…

Neural and Evolutionary Computing · Computer Science 2024-10-22 Yi Yang , Richard M. Voyles , Haiyan H. Zhang , Robert A. Nawrocki

Adaptive "life-long" learning at the edge and during online task performance is an aspirational goal of AI research. Neuromorphic hardware implementing Spiking Neural Networks (SNNs) are particularly attractive in this regard, as their…

Neural and Evolutionary Computing · Computer Science 2022-01-27 Kenneth Stewart , Emre Neftci

The spiking neural network (SNN), as a promising brain-inspired computational model with binary spike information transmission mechanism, rich spatially-temporal dynamics, and event-driven characteristics, has received extensive attention.…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Yufei Guo , Xuhui Huang , Zhe Ma

Known as low energy consumption networks, spiking neural networks (SNNs) have gained a lot of attention within the past decades. While SNNs are increasing competitive with artificial neural networks (ANNs) for vision tasks, they are rarely…

Computation and Language · Computer Science 2024-12-25 Shuaijie Shen , Chao Wang , Renzhuo Huang , Yan Zhong , Qinghai Guo , Zhichao Lu , Jianguo Zhang , Luziwei Leng

Spiking Neural Networks (SNNs) offer a biologically plausible framework for energy-efficient neuromorphic computing. However, it is a challenge to train SNNs due to their non-differentiability, efficiently. Existing gradient approximation…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Changqing Xu , Ziqiang Yang , Yi Liu , Xinfang Liao , Guiqi Mo , Hao Zeng , Yintang Yang

Spiking neural networks have shown great promise for the design of low-power sensory-processing and edge-computing hardware platforms. However, implementing on-chip learning algorithms on such architectures is still an open challenge,…

Neural and Evolutionary Computing · Computer Science 2021-04-13 Matteo Cartiglia , Germain Haessig , Giacomo Indiveri

Artificial Neural Networks (ANN) have gained significant popularity thanks to their ability to learn using the well-known backpropagation algorithm. Conversely, Spiking Neural Networks (SNNs), despite having broader capabilities than ANNs,…

Neural and Evolutionary Computing · Computer Science 2024-06-26 Sergio Davies , Andrew Gait , Andrew Rowley , Alessandro Di Nuovo