English
Related papers

Related papers: Training Spiking Neural Networks Using Lessons Fro…

200 papers

Spiking neural networks (SNNs) take inspiration from the brain to enable energy-efficient computations. Since the advent of Transformers, SNNs have struggled to compete with artificial networks on modern sequential tasks, as they inherit…

Neural and Evolutionary Computing · Computer Science 2024-01-03 Matei Ioan Stan , Oliver Rhodes

Recently, spiking neural networks (SNNs) have demonstrated substantial potential in computer vision tasks. In this paper, we present an Efficient Spiking Deraining Network, called ESDNet. Our work is motivated by the observation that rain…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Tianyu Song , Guiyue Jin , Pengpeng Li , Kui Jiang , Xiang Chen , Jiyu Jin

The brain is known to be a highly complex, asynchronous dynamical system that is highly tailored to encode temporal information. However, recent deep learning approaches to not take advantage of this temporal coding. Spiking Neural Networks…

Neural and Evolutionary Computing · Computer Science 2020-09-02 Matthew Evanusa , Cornelia Fermuller , Yiannis Aloimonos

Despite the notable success of deep neural networks (DNNs) in solving complex tasks, the training process still remains considerable challenges. A primary obstacle is the substantial time required for training, particularly as high…

Machine Learning · Computer Science 2025-09-09 Viet Hoang Pham , Hyo-Sung Ahn

Neural networks have become the standard model for various computer vision tasks in automated driving including semantic segmentation, moving object detection, depth estimation, visual odometry, etc. The main flavors of neural networks…

Neural and Evolutionary Computing · Computer Science 2019-03-07 Sambit Mohapatra , Heinrich Gotzig , Senthil Yogamani , Stefan Milz , Raoul Zollner

Spiking neural networks (SNNs) are a viable alternative to conventional artificial neural networks when resource efficiency and computational complexity are of importance. A major advantage of SNNs is their binary information transfer…

Neural and Evolutionary Computing · Computer Science 2023-10-18 Daniel Gerlinghoff , Tao Luo , Rick Siow Mong Goh , Weng-Fai Wong

The rapid expansion of spiking neural networks (SNNs) has led to a proliferation of training algorithms that differ widely in biological inspiration, computational structure, and hardware suitability. Despite this progress, the field lacks…

Neural and Evolutionary Computing · Computer Science 2026-05-15 Alessio Caviglia , Filippo Marostica , Roberta Bardini , Alessandro Savino , Stefano Di Carlo

Spiking Neural Networks (SNNs) are a promising research direction for building power-efficient information processing systems, especially for temporal tasks such as speech recognition. In SNNs, delays refer to the time needed for one spike…

Neural and Evolutionary Computing · Computer Science 2024-08-13 Ilyass Hammouamri , Ismail Khalfaoui-Hassani , Timothée Masquelier

The spiking neural network, known as the third generation neural network, is an important network paradigm. Due to its mode of information propagation that follows biological rationality, the spiking neural network has strong energy…

Neural and Evolutionary Computing · Computer Science 2025-05-21 Zihan Dai , Huanfei Ma

Spiking Neural Networks (SNNs) have emerged as an attractive alternative to traditional deep learning frameworks, since they provide higher computational efficiency in event driven neuromorphic hardware. However, the state-of-the-art (SOTA)…

Neural and Evolutionary Computing · Computer Science 2021-09-05 Gourav Datta , Souvik Kundu , Peter A. Beerel

Drawing on the intricate structures of the brain, Spiking Neural Networks (SNNs) emerge as a transformative development in artificial intelligence, closely emulating the complex dynamics of biological neural networks. While SNNs show…

Artificial Intelligence · Computer Science 2024-08-02 Yanchen Li , Jiachun Li , Kebin Sun , Luziwei Leng , Ran Cheng

Brain-inspired spiking neural networks (SNNs) are recognized as a promising avenue for achieving efficient, low-energy neuromorphic computing. Direct training of SNNs typically relies on surrogate gradient (SG) learning to estimate…

Neural and Evolutionary Computing · Computer Science 2025-11-18 Jiaqiang Jiang , Wenfeng Xu , Jing Fan , Rui Yan

Spiking neural networks (SNNs) are brain-inspired mathematical models with the ability to process information in the form of spikes. SNNs are expected to provide not only new machine-learning algorithms, but also energy-efficient…

Neural and Evolutionary Computing · Computer Science 2020-01-16 Yusuke Sakemi , Kai Morino , Takashi Morie , Kazuyuki Aihara

Brain-computer interfaces (BCIs), transform neural signals in the brain into in-structions to control external devices. However, obtaining sufficient training data is difficult as well as limited. With the advent of advanced machine…

Neurons and Cognition · Quantitative Biology 2024-07-02 Shengjie Zheng , Wenyi Li , Lang Qian , Chenggang He , Xiaojian Li

Brain-inspired spiking neural networks (SNNs) have recently drawn more and more attention due to their event-driven and energy-efficient characteristics. The integration of storage and computation paradigm on neuromorphic hardwares makes…

Neural and Evolutionary Computing · Computer Science 2022-10-14 Yufei Guo , Liwen Zhang , Yuanpei Chen , Xinyi Tong , Xiaode Liu , YingLei Wang , Xuhui Huang , Zhe Ma

In recent years, spiking neural networks (SNNs) have been used in reinforcement learning (RL) due to their low power consumption and event-driven features. However, spiking reinforcement learning (SRL), which suffers from fixed coding…

Machine Learning · Computer Science 2024-04-25 Lang Qin , Rui Yan , Huajin Tang

The human brain can self-organize rich and diverse sparse neural pathways to incrementally master hundreds of cognitive tasks. However, most existing continual learning algorithms for deep artificial and spiking neural networks are unable…

Neural and Evolutionary Computing · Computer Science 2026-05-06 Bing Han , Feifei Zhao , Wenxuan Pan , Zhuoya Zhao , Xianqi Li , Qingqun Kong , Yi Zeng

The backpropagation algorithm has promoted the rapid development of deep learning, but it relies on a large amount of labeled data and still has a large gap with how humans learn. The human brain can quickly learn various conceptual…

Neural and Evolutionary Computing · Computer Science 2023-04-25 Yiting Dong , Dongcheng Zhao , Yang Li , Yi Zeng

Spiking neural networks (SNNs), inspired by the spiking behavior of biological neurons, provide a unique pathway for capturing the intricacies of temporal data. However, applying SNNs to time-series forecasting is challenging due to…

Neural and Evolutionary Computing · Computer Science 2024-05-30 Changze Lv , Yansen Wang , Dongqi Han , Xiaoqing Zheng , Xuanjing Huang , Dongsheng Li

Despite the rapid progress of neuromorphic computing, inadequate capacity and insufficient representation power of spiking neural networks (SNNs) severely restrict their application scope in practice. Residual learning and shortcuts have…

Neural and Evolutionary Computing · Computer Science 2023-03-13 Yifan Hu , Lei Deng , Yujie Wu , Man Yao , Guoqi Li