English
Related papers

Related papers: Adaptive Gradient Learning for Spiking Neural Netw…

200 papers

For the gradient computation across the time domain in Spiking Neural Networks (SNNs) training, two different approaches have been independently studied. The first is to compute the gradients with respect to the change in spike activation…

Neural and Evolutionary Computing · Computer Science 2020-10-26 Jinseok Kim , Kyungsu Kim , Jae-Joon Kim

Accumulated detailed knowledge about the neuronal activities in human brains has brought more attention to bio-inspired spiking neural networks (SNNs). In contrast to non-spiking deep neural networks (DNNs), SNNs can encode and transmit…

Neural and Evolutionary Computing · Computer Science 2024-10-22 Yi Yang , Richard M. Voyles , Haiyan H. Zhang , Robert A. Nawrocki

Spiking Neural Networks (SNNs) operate with asynchronous discrete events (or spikes) which can potentially lead to higher energy-efficiency in neuromorphic hardware implementations. Many works have shown that an SNN for inference can be…

Machine Learning · Computer Science 2020-05-06 Nitin Rathi , Gopalakrishnan Srinivasan , Priyadarshini Panda , Kaushik Roy

Much of studies on neural computation are based on network models of static neurons that produce analog output, despite the fact that information processing in the brain is predominantly carried out by dynamic neurons that produce discrete…

Neurons and Cognition · Quantitative Biology 2017-06-21 Dongsung Huh , Terrence J. Sejnowski

The Spiking Neural Network (SNN) is a biologically inspired neural network infrastructure that has recently garnered significant attention. It utilizes binary spike activations to transmit information, thereby replacing multiplications with…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Yufei Guo , Yuanpei Chen , Zecheng Hao , Weihang Peng , Zhou Jie , Yuhan Zhang , Xiaode Liu , Zhe Ma

In the domain of dynamic graph representation learning (DGRL), the efficient and comprehensive capture of temporal evolution within real-world networks is crucial. Spiking Neural Networks (SNNs), known as their temporal dynamics and…

Neural and Evolutionary Computing · Computer Science 2024-04-12 Dong Chen , Shuai Zheng , Muhao Xu , Zhenfeng Zhu , Yao Zhao

As neural interfaces become more advanced, there has been an increase in the volume and complexity of neural data recordings. These interfaces capture rich information about neural dynamics that call for efficient, real-time processing…

Neural and Evolutionary Computing · Computer Science 2024-08-26 Sai Deepesh Pokala , Marie Bernert , Takuya Nanami , Takashi Kohno , Timothée Lévi , Blaise Yvert

Spiking Neural Networks (SNNs) offer a promising and energy-efficient alternative to conventional neural networks, thanks to their sparse binary activation. However, they face challenges regarding memory and computation overhead due to…

Neural and Evolutionary Computing · Computer Science 2026-01-06 Donghyun Lee , Abhishek Moitra , Youngeun Kim , Ruokai Yin , Priyadarshini Panda

Neuromorphic data carries information in spatio-temporal patterns encoded by spikes. Accordingly, a central problem in neuromorphic computing is training spiking neural networks (SNNs) to reproduce spatio-temporal spiking patterns in…

Machine Learning · Computer Science 2021-11-03 Bleema Rosenfeld , Osvaldo Simeone , Bipin Rajendran

Spiking neural networks (SNNs) are gaining increasing attention as potential computationally efficient alternatives to traditional artificial neural networks(ANNs). However, the unique information propagation mechanisms and the complexity…

Neural and Evolutionary Computing · Computer Science 2024-06-19 Shuaijie Shen , Rui Zhang , Chao Wang , Renzhuo Huang , Aiersi Tuerhong , Qinghai Guo , Zhichao Lu , Jianguo Zhang , Luziwei Leng

Spiking neural networks (SNNs), known for their low-power, event-driven computation and intrinsic temporal dynamics, are emerging as promising solutions for processing dynamic, asynchronous signals from event-based sensors. Despite their…

Computer Vision and Pattern Recognition · Computer Science 2024-08-05 Rui Zhang , Luziwei Leng , Kaiwei Che , Hu Zhang , Jie Cheng , Qinghai Guo , Jiangxing Liao , Ran Cheng

Spiking neural networks (SNNs) promise energy-efficient computation by mimicking biological neural dynamics, yet existing plasticity rules focus on isolated spike pairs and fail to leverage the synchronous activity patterns that drive…

Neural and Evolutionary Computing · Computer Science 2025-08-26 Yuchen Tian , Assel Kembay , Samuel Tensingh , Nhan Duy Truong , Jason K. Eshraghian , Omid Kavehei

Low-latency deep spiking neural networks (SNNs) have become a promising alternative to conventional artificial neural networks (ANNs) because of their potential for increased energy efficiency on event-driven neuromorphic hardware. Neural…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Souvik Kundu , Massoud Pedram , Peter A. Beerel

Spiking Neural Networks (SNNs) are distributed trainable systems whose computing elements, or neurons, are characterized by internal analog dynamics and by digital and sparse synaptic communications. The sparsity of the synaptic spiking…

Signal Processing · Electrical Eng. & Systems 2019-10-22 Hyeryung Jang , Osvaldo Simeone , Brian Gardner , André Grüning

Gradient descent prevails in artificial neural network training, but seems inept for spiking neural networks as small parameter changes can cause sudden, disruptive (dis-)appearances of spikes. Here, we demonstrate exact gradient descent…

Neurons and Cognition · Quantitative Biology 2025-01-29 Christian Klos , Raoul-Martin Memmesheimer

Communication by rare, binary spikes is a key factor for the energy efficiency of biological brains. However, it is harder to train biologically-inspired spiking neural networks (SNNs) than artificial neural networks (ANNs). This is…

Neural and Evolutionary Computing · Computer Science 2023-11-21 Ana Stanojevic , Stanisław Woźniak , Guillaume Bellec , Giovanni Cherubini , Angeliki Pantazi , Wulfram Gerstner

Spiking Neural Networks (SNNs) have attracted great attention for their energy-efficient operations and biologically inspired structures, offering potential advantages over Artificial Neural Networks (ANNs) in terms of energy efficiency and…

Neural and Evolutionary Computing · Computer Science 2024-06-03 Yujia Liu , Tong Bu , Jianhao Ding , Zecheng Hao , Tiejun Huang , Zhaofei Yu

Biological neurons use spikes to process and learn temporally dynamic inputs in an energy and computationally efficient way. However, applying the state-of-the-art gradient-based supervised algorithms to spiking neural networks (SNN) is a…

Computer Vision and Pattern Recognition · Computer Science 2020-01-14 Aref Moqadam Mehr , Saeed Reza Kheradpisheh , Hadi Farahani

Neuromorphic computing has recently gained momentum with the emergence of various neuromorphic processors. As the field advances, there is an increasing focus on developing training methods that can effectively leverage the unique…

Emerging Technologies · Computer Science 2025-04-15 Sanaz Mahmoodi Takaghaj , Jack Sampson

Brain-inspired Spiking Neural Networks (SNNs) have attracted much attention due to their event-based computing and energy-efficient features. However, the spiking all-or-none nature has prevented direct training of SNNs for various…

Neural and Evolutionary Computing · Computer Science 2024-07-01 Yang Li , Feifei Zhao , Dongcheng Zhao , Yi Zeng