English
Related papers

Related papers: Towards Memory- and Time-Efficient Backpropagation…

200 papers

Spiking Neural Networks (SNNs) are considered to have enormous potential in the future development of Artificial Intelligence due to their brain-inspired and energy-efficient properties. Compared to vanilla Spatial-Temporal Back-propagation…

Neural and Evolutionary Computing · Computer Science 2026-03-10 Zecheng Hao , Yifan Huang , Zijie Xu , Wenxuan Liu , Yuanhong Tang , Zhaofei Yu , Tiejun Huang

Spiking Neural Networks (SNNs) offer a more energy-efficient alternative to Artificial Neural Networks (ANNs) by mimicking biological neural principles, establishing them as a promising approach to mitigate the increasing energy demands of…

Machine Learning · Computer Science 2025-02-24 Velibor Bojković , Xiaofeng Wu , Bin Gu

Spiking Neural Networks (SNNs) are distinguished from Artificial Neural Networks (ANNs) for their complex neuronal dynamics and sparse binary activations (spikes) inspired by the biological neural system. Traditional neuron models use…

Neural and Evolutionary Computing · Computer Science 2025-10-31 Peng Xue , Wei Fang , Zhengyu Ma , Zihan Huang , Zhaokun Zhou , Yonghong Tian , Timothée Masquelier , Huihui Zhou

Spiking Neural Networks (SNNs) that operate in an event-driven manner and employ binary spike representation have recently emerged as promising candidates for energy-efficient computing. However, a cost bottleneck arises in obtaining…

Neural and Evolutionary Computing · Computer Science 2024-01-22 Yunpeng Yao , Man Wu , Zheng Chen , Renyuan Zhang

Spiking Neural Networks (SNNs) have recently emerged as the low-power alternative to Artificial Neural Networks (ANNs) because of their sparse, asynchronous, and binary event-driven processing. Due to their energy efficiency, SNNs have a…

Computer Vision and Pattern Recognition · Computer Science 2021-10-18 Youngeun Kim , Joshua Chough , Priyadarshini Panda

The brain is the perfect place to look for inspiration to develop more efficient neural networks. The inner workings of our synapses and neurons provide a glimpse at what the future of deep learning might look like. This paper serves as a…

Neural and Evolutionary Computing · Computer Science 2023-08-15 Jason K. Eshraghian , Max Ward , Emre Neftci , Xinxin Wang , Gregor Lenz , Girish Dwivedi , Mohammed Bennamoun , Doo Seok Jeong , Wei D. Lu

Spiking neural networks (SNN) are delivering energy-efficient, massively parallel, and low-latency solutions to AI problems, facilitated by the emerging neuromorphic chips. To harness these computational benefits, SNN need to be trained by…

Neural and Evolutionary Computing · Computer Science 2021-10-28 Guangzhi Tang , Neelesh Kumar , Ioannis Polykretis , Konstantinos P. Michmizos

Spiking neural networks (SNNs) promise energy-efficient computation by mimicking biological neural dynamics, yet existing plasticity rules focus on isolated spike pairs and fail to leverage the synchronous activity patterns that drive…

Neural and Evolutionary Computing · Computer Science 2025-08-26 Yuchen Tian , Assel Kembay , Samuel Tensingh , Nhan Duy Truong , Jason K. Eshraghian , Omid Kavehei

The demand for low-power inference and training of deep neural networks (DNNs) on edge devices has intensified the need for algorithms that are both scalable and energy-efficient. While spiking neural networks (SNNs) allow for efficient…

Neural and Evolutionary Computing · Computer Science 2025-11-18 Marco Paul E. Apolinario , Kaushik Roy , Charlotte Frenkel

Spiking neural networks (SNNs) are promising for neuromorphic computing, but high-performing models still rely on dense multilayer architectures with substantial communication and state-storage costs. Inspired by autapses, we propose…

Neural and Evolutionary Computing · Computer Science 2026-03-27 Wuque Cai , Hongze Sun , Quan Tang , Shifeng Mao , Zhenxing Wang , Jiayi He , Duo Chen , Dezhong Yao , Daqing Guo

In this work we propose a new supervised learning method for temporally-encoded multilayer spiking networks to perform classification. The method employs a reinforcement signal that mimics backpropagation but is far less computationally…

Neural and Evolutionary Computing · Computer Science 2020-07-28 Andrew Stephan , Brian Gardner , Steven J. Koester , Andre Gruning

Spiking Neural Networks (SNNs) often suffer from high time complexity $O(T)$ due to the sequential processing of $T$ spikes, making training computationally expensive. In this paper, we propose a novel Fixed-point Parallel Training (FPT)…

Neural and Evolutionary Computing · Computer Science 2025-06-17 Wanjin Feng , Xingyu Gao , Wenqian Du , Hailong Shi , Peilin Zhao , Pengcheng Wu , Chunyan Miao

We present a new back propagation based training algorithm for discrete-time spiking neural networks (SNN). Inspired by recent deep learning algorithms on binarized neural networks, binary activation with a straight-through gradient…

Neural and Evolutionary Computing · Computer Science 2017-09-20 Shihui Yin , Shreyas K. Venkataramanaiah , Gregory K. Chen , Ram Krishnamurthy , Yu Cao , Chaitali Chakrabarti , Jae-sun Seo

Spiking Neural Networks (SNNs) are a promising approach to low-power applications on neuromorphic hardware due to their energy efficiency. However, training SNNs is challenging because of the non-differentiable spike generation function. To…

Neural and Evolutionary Computing · Computer Science 2025-08-19 Qingyan Meng , Mingqing Xiao , Zhengyu Ma , Huihui Zhou , Yonghong Tian , Zhouchen Lin

Brain-inspired spiking neural networks (SNNs) have gained prominence in the field of neuromorphic computing owing to their low energy consumption during feedforward inference on neuromorphic hardware. However, it remains an open challenge…

Neural and Evolutionary Computing · Computer Science 2024-03-04 Wenjie Wei , Malu Zhang , Jilin Zhang , Ammar Belatreche , Jibin Wu , Zijing Xu , Xuerui Qiu , Hong Chen , Yang Yang , Haizhou Li

Spiking neural networks (SNN) have recently emerged as alternatives to traditional neural networks, owing to energy efficiency benefits and capacity to better capture biological neuronal mechanisms. However, the classic backpropagation…

Neural and Evolutionary Computing · Computer Science 2023-03-13 Jane H. Lee , Saeid Haghighatshoar , Amin Karbasi

Spiking Neural Networks (SNNs) have emerged as an attractive spatio-temporal computing paradigm for complex vision tasks. However, most existing works yield models that require many time steps and do not leverage the inherent temporal…

Neural and Evolutionary Computing · Computer Science 2022-10-25 Gourav Datta , Haoqin Deng , Robert Aviles , Peter A. Beerel

Spiking Neural Networks (SNNs) have received widespread attention due to their event-driven and low-power characteristics, making them particularly effective for processing neuromorphic data. Recent studies have shown that directly trained…

Neural and Evolutionary Computing · Computer Science 2026-01-13 Boxuan Zhang , Zhen Xu , Kuan Tao

We introduce Backpropagation Through Time and Space (BPTTS), a method for training a recurrent spatio-temporal neural network, that is used in a homogeneous multi-agent reinforcement learning (MARL) setting to learn numerical methods for…

Machine Learning · Computer Science 2022-03-30 Elliot Way , Dheeraj S. K. Kapilavai , Yiwei Fu , Lei Yu

Spiking Neural Networks (SNNs) offer a biologically inspired foundation for low-power, event-driven intelligence, yet their direct on-chip supervised training remains a key hardware challenge. This paper presents a multiplication-free,…

Neural and Evolutionary Computing · Computer Science 2026-04-28 Maryam Mirsadeghi , Mojtaba Mirbagheri , Saeed Reza Kheradpisheh