English
Related papers

Related papers: Hybrid Macro/Micro Level Backpropagation for Train…

200 papers

Spiking neural networks (SNNs) have garnered a great amount of interest for supervised and unsupervised learning applications. This paper deals with the problem of training multi-layer feedforward SNNs. The non-linear integrate-and-fire…

Neural and Evolutionary Computing · Computer Science 2019-07-30 Navin Anwani , Bipin Rajendran

We present a new back propagation based training algorithm for discrete-time spiking neural networks (SNN). Inspired by recent deep learning algorithms on binarized neural networks, binary activation with a straight-through gradient…

Neural and Evolutionary Computing · Computer Science 2017-09-20 Shihui Yin , Shreyas K. Venkataramanaiah , Gregory K. Chen , Ram Krishnamurthy , Yu Cao , Chaitali Chakrabarti , Jae-sun Seo

Hardware-based spiking neural networks (SNNs) are regarded as promising candidates for the cognitive computing system due to low power consumption and highly parallel operation. In this work, we train the SNN in which the firing time…

Neural and Evolutionary Computing · Computer Science 2022-03-17 Seongbin Oh , Dongseok Kwon , Gyuho Yeom , Won-Mook Kang , Soochang Lee , Sung Yun Woo , Jang Saeng Kim , Min Kyu Park , Jong-Ho Lee

In this work, we propose ReStoCNet, a residual stochastic multilayer convolutional Spiking Neural Network (SNN) composed of binary kernels, to reduce the synaptic memory footprint and enhance the computational efficiency of SNNs for complex…

Computer Vision and Pattern Recognition · Computer Science 2019-02-13 Gopalakrishnan Srinivasan , Kaushik Roy

Spiking Neural Networks (SNNs) may offer an energy-efficient alternative for implementing deep learning applications. In recent years, there have been several proposals focused on supervised (conversion, spike-based gradient descent) and…

Computer Vision and Pattern Recognition · Computer Science 2019-10-31 Priyadarshini Panda , Aparna Aketi , Kaushik Roy

There is an increasing interest in emulating Spiking Neural Networks (SNNs) on neuromorphic computing devices due to their low energy consumption. Recent advances have allowed training SNNs to a point where they start to compete with…

Neural and Evolutionary Computing · Computer Science 2022-01-14 Nicolas Perez-Nieves , Dan F. M. Goodman

Spiking neural networks (SNNs) are bio-inspired neural networks with asynchronous discrete and sparse characteristics, which have increasingly manifested their superiority in low energy consumption. Recent research is devoted to utilizing…

Neural and Evolutionary Computing · Computer Science 2023-04-20 Lang Feng , Qianhui Liu , Huajin Tang , De Ma , Gang Pan

Spiking Neural Networks (SNNs) are brain-inspired, event-driven machine learning algorithms that have been widely recognized in producing ultra-high-energy-efficient hardware. Among existing SNNs, unsupervised SNNs based on synaptic…

Neural and Evolutionary Computing · Computer Science 2022-09-20 Mingyuan Meng , Xingyu Yang , Lei Bi , Jinman Kim , Shanlin Xiao , Zhiyi Yu

Neuromorphic computing aims to replicate the brain's capabilities for energy efficient and parallel information processing, promising a solution to the increasing demand for faster and more efficient computational systems. Efficient…

Neural and Evolutionary Computing · Computer Science 2025-03-20 Gabriel Béna , Timo Wunderlich , Mahmoud Akl , Bernhard Vogginger , Christian Mayr , Hector Andres Gonzalez

Biologically-inspired Spiking Neural Networks (SNNs), processing information using discrete-time events known as spikes rather than continuous values, have garnered significant attention due to their hardware-friendly and energy-efficient…

Neural and Evolutionary Computing · Computer Science 2023-08-21 Bin Lei , Sheng Lin , Pei-Hung Lin , Chunhua Liao , Caiwen Ding

Spiking neural networks are efficient computation models for low-power environments. Spike-based BP algorithms and ANN-to-SNN (ANN2SNN) conversions are successful techniques for SNN training. Nevertheless, the spike-base BP training is slow…

Neural and Evolutionary Computing · Computer Science 2023-08-31 Jianxiong Tang , Jianhuang Lai , Xiaohua Xie , Lingxiao Yang , Wei-Shi Zheng

Memristor-based Spiking Neural Networks (SNNs) with temporal spike encoding enable ultra-low-energy computation, making them ideal for battery-powered intelligent devices. This paper presents a circuit-level memristive spiking neural…

Emerging Technologies · Computer Science 2025-07-29 Santlal Prajapati , Susmita Sur-Kolay , Soumyadeep Dutta

Spiking Neural Networks (SNNs) are being explored for their potential energy efficiency resulting from sparse, event-driven computations. Many recent works have demonstrated effective backpropagation for deep Spiking Neural Networks (SNNs)…

Neural and Evolutionary Computing · Computer Science 2020-03-04 Jason M. Allred , Steven J. Spencer , Gopalakrishnan Srinivasan , Kaushik Roy

Spiking Neural Networks (SNNs) are a promising approach to low-power applications on neuromorphic hardware due to their energy efficiency. However, training SNNs is challenging because of the non-differentiable spike generation function. To…

Neural and Evolutionary Computing · Computer Science 2025-08-19 Qingyan Meng , Mingqing Xiao , Zhengyu Ma , Huihui Zhou , Yonghong Tian , Zhouchen Lin

Despite the rapid progress of neuromorphic computing, inadequate capacity and insufficient representation power of spiking neural networks (SNNs) severely restrict their application scope in practice. Residual learning and shortcuts have…

Neural and Evolutionary Computing · Computer Science 2023-03-13 Yifan Hu , Lei Deng , Yujie Wu , Man Yao , Guoqi Li

Deep spiking neural networks (SNNs) are promising neural networks for their model capacity from deep neural network architecture and energy efficiency from SNNs' operations. To train deep SNNs, recently, spatio-temporal backpropagation…

Neural and Evolutionary Computing · Computer Science 2023-08-02 Seongsik Park , Jeonghee Jo , Jongkil Park , Yeonjoo Jeong , Jaewook Kim , Suyoun Lee , Joon Young Kwak , Inho Kim , Jong-Keuk Park , Kyeong Seok Lee , Gye Weon Hwang , Hyun Jae Jang

Spiking Neural Networks are often touted as brain-inspired learning models for the third wave of Artificial Intelligence. Although recent SNNs trained with supervised backpropagation show classification accuracy comparable to deep networks,…

Neural and Evolutionary Computing · Computer Science 2022-11-09 Biswadeep Chakraborty , Saibal Mukhopadhyay

Spiking Neural Networks (SNNs) exhibit exceptional energy efficiency on neuromorphic hardware due to their sparse activation patterns. However, conventional training methods based on surrogate gradients and Backpropagation Through Time…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Xiaochen Zhao , Chengting Yu , Kairong Yu , Lei Liu , Aili Wang

Spiking Neural Network (SNN), as a brain-inspired and energy-efficient network, is currently facing the pivotal challenge of exploring a suitable and efficient learning framework. The predominant training methodologies, namely…

Neural and Evolutionary Computing · Computer Science 2025-05-27 Zecheng Hao , Qichao Ma , Kang Chen , Yi Zhang , Zhaofei Yu , Tiejun Huang

Spiking neural networks (SNN) are delivering energy-efficient, massively parallel, and low-latency solutions to AI problems, facilitated by the emerging neuromorphic chips. To harness these computational benefits, SNN need to be trained by…

Neural and Evolutionary Computing · Computer Science 2021-10-28 Guangzhi Tang , Neelesh Kumar , Ioannis Polykretis , Konstantinos P. Michmizos