English
Related papers

Related papers: Spatio-Temporal Backpropagation for Training High-…

200 papers

Gradient descent computed by backpropagation (BP) is a widely used learning method for training artificial neural networks but has several limitations: it is computationally demanding, requires frequent manual tuning of the network…

Signal Processing · Electrical Eng. & Systems 2024-10-02 Jiaqi Xing , Libo Chen , ZeZheng Zhang , Mohammed Nazibul Hasan , Zhi-Bin Zhang

Spiking Neural Networks (SNNs) offer a biologically plausible framework for energy-efficient neuromorphic computing. However, it is a challenge to train SNNs due to their non-differentiability, efficiently. Existing gradient approximation…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Changqing Xu , Ziqiang Yang , Yi Liu , Xinfang Liao , Guiqi Mo , Hao Zeng , Yintang Yang

The field of neuromorphic computing promises extremely low-power and low-latency sensing and processing. Challenges in transferring learning algorithms from traditional artificial neural networks (ANNs) to spiking neural networks (SNNs)…

Computer Vision and Pattern Recognition · Computer Science 2021-10-27 Jesse Hagenaars , Federico Paredes-Vallés , Guido de Croon

Spiking neural networks (SNNs) are widely applied in various fields due to their energy-efficient and fast-inference capabilities. Applying SNNs to reinforcement learning (RL) can significantly reduce the computational resource requirements…

Neural and Evolutionary Computing · Computer Science 2024-04-25 Lang Qin , Ziming Wang , Runhao Jiang , Rui Yan , Huajin Tang

Recent insights have revealed that rate-coding is a primary form of information representation captured by surrogate-gradient-based Backpropagation Through Time (BPTT) in training deep Spiking Neural Networks (SNNs). Motivated by these…

Machine Learning · Computer Science 2024-10-23 Chengting Yu , Lei Liu , Gaoang Wang , Erping Li , Aili Wang

Inspired by the brain's spike-based computation, spiking neural networks (SNNs) inherently possess temporal activation sparsity. However, when it comes to the sparse training of SNNs in the structural connection domain, existing methods…

Neural and Evolutionary Computing · Computer Science 2025-11-11 Yuan Hua , Jilin Zhang , Yingtao Zhang , Wenqi Gu , Leyi You , Baobo Xiong , Carlo Vittorio Cannistraci , Hong Chen

Spiking Neural Networks (SNN). SNNs are based on a more biologically inspired approach than usual artificial neural networks. Such models are characterized by complex dynamics between neurons and spikes. These are very sensitive to the…

Neural and Evolutionary Computing · Computer Science 2024-09-06 Thomas Firmin , Pierre Boulet , El-Ghazali Talbi

While Spiking Neural Networks (SNNs) have been gaining in popularity, it seems that the algorithms used to train them are not powerful enough to solve the same tasks as those tackled by classical Artificial Neural Networks (ANNs). In this…

Neural and Evolutionary Computing · Computer Science 2021-10-14 Karen Adam

In recent years, there has been increasing interest in developing models and tools to address the complex patterns of connectivity found in brain tissue. Specifically, this is due to a need to understand how emergent properties emerge from…

Neurons and Cognition · Quantitative Biology 2022-04-15 Sean Knight , Navjot Gadda

Spiking Neural Networks (SNNs) are bio-inspired networks that process information conveyed as temporal spikes rather than numeric values. A spiking neuron of an SNN only produces a spike whenever a significant number of spikes occur within…

Neural and Evolutionary Computing · Computer Science 2020-03-06 Mathias Gehrig , Sumit Bam Shrestha , Daniel Mouritzen , Davide Scaramuzza

The prevailing of artificial intelligence-of-things calls for higher energy-efficient edge computing paradigms, such as neuromorphic agents leveraging brain-inspired spiking neural network (SNN) models based on spatiotemporally sparse…

Neural and Evolutionary Computing · Computer Science 2024-11-28 Haoran Gao , Xichuan Zhou , Yingcheng Lin , Min Tian , Liyuan Liu , Cong Shi

The spiking neural network (SNN) computes and communicates information through discrete binary events. It is considered more biologically plausible and more energy-efficient than artificial neural networks (ANN) in emerging neuromorphic…

Neural and Evolutionary Computing · Computer Science 2021-05-28 Yang Li , Yi Zeng , Dongcheng Zhao

The primate visual cortex exhibits topographic organization, where functionally similar neurons are spatially clustered, a structure widely believed to enhance neural processing efficiency. While prior works have demonstrated that…

Neural and Evolutionary Computing · Computer Science 2025-11-24 Deming Zhou , Yuetong Fang , Zhaorui Wang , Renjing Xu

Spiking Neural Networks (SNNs) are distributed trainable systems whose computing elements, or neurons, are characterized by internal analog dynamics and by digital and sparse synaptic communications. The sparsity of the synaptic spiking…

Signal Processing · Electrical Eng. & Systems 2019-10-22 Hyeryung Jang , Osvaldo Simeone , Brian Gardner , André Grüning

Spiking Neural Networks (SNNs) that operate in an event-driven manner and employ binary spike representation have recently emerged as promising candidates for energy-efficient computing. However, a cost bottleneck arises in obtaining…

Neural and Evolutionary Computing · Computer Science 2024-01-22 Yunpeng Yao , Man Wu , Zheng Chen , Renyuan Zhang

Spiking Neural Networks (SNNs) have gained significant attention as a potentially energy-efficient alternative for standard neural networks with their sparse binary activation. However, SNNs suffer from memory and computation overhead due…

Neural and Evolutionary Computing · Computer Science 2026-03-09 Donghyun Lee , Ruokai Yin , Youngeun Kim , Abhishek Moitra , Yuhang Li , Priyadarshini Panda

Video analysis is a major computer vision task that has received a lot of attention in recent years. The current state-of-the-art performance for video analysis is achieved with Deep Neural Networks (DNNs) that have high computational costs…

Computer Vision and Pattern Recognition · Computer Science 2023-09-25 Mireille El-Assal , Pierre Tirilly , Ioan Marius Bilasco

Spiking neural networks (SNN) distinguish themselves from artificial neural networks (ANN) because of their inherent temporal processing and spike-based computations, enabling a power-efficient implementation in neuromorphic hardware. In…

Neural and Evolutionary Computing · Computer Science 2023-11-29 Lucas Deckers , Laurens Van Damme , Ing Jyh Tsang , Werner Van Leekwijck , Steven Latré

Large Language Models (LLMs) present significant challenges for deployment in energy-constrained environments due to their large model sizes and high inference latency. Spiking Neural Networks (SNNs), inspired by the sparse event-driven…

Neural and Evolutionary Computing · Computer Science 2025-08-29 Yi Jiang , Malyaban Bal , Brian Matejek , Susmit Jha , Adam Cobb , Abhronil Sengupta

The Spiking Neural Network (SNN) is a biologically inspired neural network infrastructure that has recently garnered significant attention. It utilizes binary spike activations to transmit information, thereby replacing multiplications with…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Yufei Guo , Yuanpei Chen , Zecheng Hao , Weihang Peng , Zhou Jie , Yuhan Zhang , Xiaode Liu , Zhe Ma