English
Related papers

Related papers: Take A Shortcut Back: Mitigating the Gradient Vani…

200 papers

Spiking Neural Networks (SNNs) have been attached great importance due to their biological plausibility and high energy-efficiency on neuromorphic chips. As these chips are usually resource-constrained, the compression of SNNs is thus…

Neural and Evolutionary Computing · Computer Science 2021-08-19 Yanqi Chen , Zhaofei Yu , Wei Fang , Tiejun Huang , Yonghong Tian

The spiking neural network (SNN), as a promising brain-inspired computational model with binary spike information transmission mechanism, rich spatially-temporal dynamics, and event-driven characteristics, has received extensive attention.…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Yufei Guo , Xuhui Huang , Zhe Ma

Configuring deep Spiking Neural Networks (SNNs) is an exciting research avenue for low power spike event based computation. However, the spike generation function is non-differentiable and therefore not directly compatible with the standard…

Neural and Evolutionary Computing · Computer Science 2018-10-23 Sumit Bam Shrestha , Garrick Orchard

Event-based neuromorphic systems promise to reduce the energy consumption of deep learning tasks by replacing expensive floating point operations on dense matrices by low power sparse and asynchronous operations on spike events. While these…

Neural and Evolutionary Computing · Computer Science 2019-06-04 Johannes Christian Thiele , Olivier Bichler , Antoine Dupret

Nowadays deep learning is dominating the field of machine learning with state-of-the-art performance in various application areas. Recently, spiking neural networks (SNNs) have been attracting a great deal of attention, notably owning to…

Machine Learning · Computer Science 2019-02-28 Seongsik Park , Sang-gil Lee , Hyunha Nam , Sungroh Yoon

Spiking Neural Networks (SNNs) operate with asynchronous discrete events (or spikes) which can potentially lead to higher energy-efficiency in neuromorphic hardware implementations. Many works have shown that an SNN for inference can be…

Machine Learning · Computer Science 2020-05-06 Nitin Rathi , Gopalakrishnan Srinivasan , Priyadarshini Panda , Kaushik Roy

Spiking Neural Networks (SNNs) utilize spike-based activations to mimic the brain's energy-efficient information processing. However, the binary and discontinuous nature of spike activations causes vanishing gradients, making adversarial…

Machine Learning · Computer Science 2026-02-10 Jihang Wang , Dongcheng Zhao , Ruolin Chen , Qian Zhang , Yi Zeng

Brain-inspired Spiking Neural Networks (SNNs) have attracted much attention due to their event-based computing and energy-efficient features. However, the spiking all-or-none nature has prevented direct training of SNNs for various…

Neural and Evolutionary Computing · Computer Science 2024-07-01 Yang Li , Feifei Zhao , Dongcheng Zhao , Yi Zeng

Spiking Neural Networks (SNNs) have emerged as a hardware efficient architecture for classification tasks. The challenge of spike-based encoding has been the lack of a universal training mechanism performed entirely using spikes. There have…

Neural and Evolutionary Computing · Computer Science 2023-08-25 Anmol Biswas , Vivek Saraswat , Udayan Ganguly

Spiking neural networks (SNNs) have emerged as prominent candidates for embedded and edge AI. Their inherent low power consumption makes them far more efficient than conventional ANNs in scenarios where energy budgets are tightly…

Machine Learning · Computer Science 2025-11-27 Dogukan Aksu , Jesus Martinez del Rincon , Ihsen Alouani

Spiking Neural Networks (SNNs) have been proposed as biologically plausible and energy-efficient alternatives to conventional Artificial Neural Networks (ANNs). However, the training of SNN usually relies on surrogate gradients due to the…

Neural and Evolutionary Computing · Computer Science 2026-05-11 Himanshu Udupi , Xiaocong Yang , ChengXiang Zhai

Spiking neural networks (SNNs) offer a promising energy-efficient alternative to artificial neural networks (ANNs), in virtue of their high biological plausibility, rich spatial-temporal dynamics, and event-driven computation. The direct…

Neural and Evolutionary Computing · Computer Science 2024-07-12 Chenlin Zhou , Han Zhang , Liutao Yu , Yumin Ye , Zhaokun Zhou , Liwei Huang , Zhengyu Ma , Xiaopeng Fan , Huihui Zhou , Yonghong Tian

Spiking Neural Networks (SNNs) have recently emerged as the low-power alternative to Artificial Neural Networks (ANNs) because of their sparse, asynchronous, and binary event-driven processing. Due to their energy efficiency, SNNs have a…

Computer Vision and Pattern Recognition · Computer Science 2021-10-18 Youngeun Kim , Joshua Chough , Priyadarshini Panda

Spiking neural networks are nature's versatile solution to fault-tolerant and energy efficient signal processing. To translate these benefits into hardware, a growing number of neuromorphic spiking neural network processors attempt to…

Neural and Evolutionary Computing · Computer Science 2019-05-06 Emre O. Neftci , Hesham Mostafa , Friedemann Zenke

We present a new back propagation based training algorithm for discrete-time spiking neural networks (SNN). Inspired by recent deep learning algorithms on binarized neural networks, binary activation with a straight-through gradient…

Neural and Evolutionary Computing · Computer Science 2017-09-20 Shihui Yin , Shreyas K. Venkataramanaiah , Gregory K. Chen , Ram Krishnamurthy , Yu Cao , Chaitali Chakrabarti , Jae-sun Seo

With the rapid development of artificial intelligence technology, the field of reinforcement learning has continuously achieved breakthroughs in both theory and practice. However, traditional reinforcement learning algorithms often entail…

Artificial Intelligence · Computer Science 2024-06-21 Yuhao Pan , Xiucheng Wang , Nan Cheng , Qi Qiu

Spiking Neural Networks (SNNs) offer a biologically inspired computational paradigm that emulates neuronal activity through discrete spike-based processing. Despite their advantages, training SNNs with traditional backpropagation (BP)…

Neural and Evolutionary Computing · Computer Science 2025-05-28 Mohammadnavid Ghader , Saeed Reza Kheradpisheh , Bahar Farahani , Mahmood Fazlali

The spiking neural network (SNN) mimics the information processing operation in the human brain, represents and transmits information in spike trains containing wealthy spatial and temporal information, and shows superior performance on…

Neural and Evolutionary Computing · Computer Science 2021-10-25 Guobin Shen , Dongcheng Zhao , Yi Zeng

The brain is the perfect place to look for inspiration to develop more efficient neural networks. The inner workings of our synapses and neurons provide a glimpse at what the future of deep learning might look like. This paper serves as a…

Neural and Evolutionary Computing · Computer Science 2023-08-15 Jason K. Eshraghian , Max Ward , Emre Neftci , Xinxin Wang , Gregor Lenz , Girish Dwivedi , Mohammed Bennamoun , Doo Seok Jeong , Wei D. Lu

Recently, brain-inspired spiking neuron networks (SNNs) have attracted widespread research interest because of their event-driven and energy-efficient characteristics. Still, it is difficult to efficiently train deep SNNs due to the…

Neural and Evolutionary Computing · Computer Science 2022-05-17 Shikuang Deng , Yuhang Li , Shanghang Zhang , Shi Gu