English
Related papers

Related papers: Stabilizing Spiking Neuron Training

200 papers

Spiking neural networks (SNNs) are energy-efficient neural networks because of their spiking nature. However, as the spike firing rate of SNNs increases, the energy consumption does as well, and thus, the advantage of SNNs diminishes. Here,…

Machine Learning · Computer Science 2024-01-15 Kazuma Suetake , Takuya Ushimaru , Ryuji Saiin , Yoshihide Sawada

Concurrent estimation and control of robotic systems remains an ongoing challenge, where controllers rely on data extracted from states/parameters riddled with uncertainties and noises. Framework suitability hinges on task complexity and…

Robotics · Computer Science 2023-10-09 Reza Ahmadvand , Sarah Safura Sharif , Yaser Mike Banad

Neuromorphic computing and, in particular, spiking neural networks (SNNs) have become an attractive alternative to deep neural networks for a broad range of signal processing applications, processing static and/or temporal inputs from…

Hardware Architecture · Computer Science 2023-12-05 Souvik Kundu , Rui-Jie Zhu , Akhilesh Jaiswal , Peter A. Beerel

Spiking neural networks (SNNs) promise orders-of-magnitude efficiency gains by communicating with sparse, event-driven spikes rather than dense numerical activations. However, most training pipelines either rely on surrogate-gradient…

Neural and Evolutionary Computing · Computer Science 2025-12-17 Arman Ferdowsi , Atakan Aral

Spiking neural networks are a promising approach towards next-generation models of the brain in computational neuroscience. Moreover, compared to classic artificial neural networks, they could serve as an energy-efficient deployment of AI…

Neural and Evolutionary Computing · Computer Science 2021-09-24 Justus F. Hübotter , Pablo Lanillos , Jakub M. Tomczak

As a foundational architecture of artificial intelligence models, Transformer has been recently adapted to spiking neural networks with promising performance across various tasks. However, existing spiking Transformer(ST)-based models…

Machine Learning · Computer Science 2026-01-06 Hongze Sun , Wuque Cai , Duo Chen , Quan Tang , Shifeng Mao , Jiayi He , Zhenxing Wang , Yan Cui , Dezhong Yao , Daqing Guo

Spiking Neural Networks (SNNs) are gaining significant traction in machine learning tasks where energy-efficiency is of utmost importance. Training such networks using the state-of-the-art back-propagation through time (BPTT) is, however,…

Neural and Evolutionary Computing · Computer Science 2022-05-23 Felix Christian Bauer , Gregor Lenz , Saeid Haghighatshoar , Sadique Sheik

$\textbf{Formal version available at}$ https://cell.com/patterns/fulltext/S2666-3899(23)00200-3 Networks of spiking neurons underpin the extraordinary information-processing capabilities of the brain and have become pillar models in…

Neural and Evolutionary Computing · Computer Science 2023-09-18 Gehua Ma , Rui Yan , Huajin Tang

Deep Neural Networks (DNNs) are the current state-of-the-art models in many speech related tasks. There is a growing interest, though, for more biologically realistic, hardware friendly and energy efficient models, named Spiking Neural…

Machine Learning · Computer Science 2020-11-16 Thomas Pellegrini , Romain Zimmer , Timothée Masquelier

Implementations of spiking neural networks on neuromorphic hardware promise orders of magnitude less power consumption than their non-spiking counterparts. The standard neuron model for spike-based computation on such systems has long been…

Neural and Evolutionary Computing · Computer Science 2025-07-11 Maximilian Baronig , Romain Ferrand , Silvester Sabathiel , Robert Legenstein

Spiking Neural Networks (SNNs) use discrete spike sequences to transmit information, which significantly mimics the information transmission of the brain. Although this binarized form of representation dramatically enhances the energy…

Neural and Evolutionary Computing · Computer Science 2023-01-31 Guobin Shen , Dongcheng Zhao , Yi Zeng

Spiking neural networks (SNNs) that enables energy efficient implementation on emerging neuromorphic hardware are gaining more attention. Yet now, SNNs have not shown competitive performance compared with artificial neural networks (ANNs),…

Neural and Evolutionary Computing · Computer Science 2018-11-26 Yujie Wu , Lei Deng , Guoqi Li , Jun Zhu , Luping Shi

Recently, brain-inspired spiking neuron networks (SNNs) have attracted widespread research interest because of their event-driven and energy-efficient characteristics. Still, it is difficult to efficiently train deep SNNs due to the…

Neural and Evolutionary Computing · Computer Science 2022-05-17 Shikuang Deng , Yuhang Li , Shanghang Zhang , Shi Gu

Spiking Neural Networks (SNNs) have shown great potential in solving deep learning problems in an energy-efficient manner. However, they are still limited to simple classification tasks. In this paper, we propose Spiking-GAN, the first…

Neural and Evolutionary Computing · Computer Science 2021-06-30 Vineet Kotariya , Udayan Ganguly

Spiking Neural Networks (SNNs) have attracted enormous research interest due to temporal information processing capability, low power consumption, and high biological plausibility. However, the formulation of efficient and high-performance…

Neural and Evolutionary Computing · Computer Science 2021-08-18 Wei Fang , Zhaofei Yu , Yanqi Chen , Timothee Masquelier , Tiejun Huang , Yonghong Tian

Spiking neural networks (SNNs) are promising in a bio-plausible coding for spatio-temporal information and event-driven signal processing, which is very suited for energy-efficient implementation in neuromorphic hardware. However, the…

Neural and Evolutionary Computing · Computer Science 2020-12-21 Hanle Zheng , Yujie Wu , Lei Deng , Yifan Hu , Guoqi Li

Biologically plausible and energy-efficient frameworks such as Spiking Neural Networks (SNNs) have not been sufficiently explored in low-level vision tasks. Taking image deraining as an example, this study addresses the representation of…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Shuang Chen , Tomas Krajnik , Farshad Arvin , Amir Atapour-Abarghouei

Spiking Neural Networks (SNNs) operate with asynchronous discrete events (or spikes) which can potentially lead to higher energy-efficiency in neuromorphic hardware implementations. Many works have shown that an SNN for inference can be…

Machine Learning · Computer Science 2020-05-06 Nitin Rathi , Gopalakrishnan Srinivasan , Priyadarshini Panda , Kaushik Roy

Spiking neural networks (SNNs) have attracted much attention due to their ability to process temporal information, low power consumption, and higher biological plausibility. However, it is still challenging to develop efficient and…

Neural and Evolutionary Computing · Computer Science 2023-02-21 Chunming Jiang , Yilei Zhang

Spiking neural networks (SNNs) provide an energy-efficient solution by utilizing the spike-based and sparse nature of biological systems. Since the advent of Transformers, SNNs have struggled to compete with artificial networks on long…

Neural and Evolutionary Computing · Computer Science 2024-10-24 Yan Zhong , Ruoyu Zhao , Chao Wang , Qinghai Guo , Jianguo Zhang , Zhichao Lu , Luziwei Leng