English
Related papers

Related papers: Direct Training Needs Regularisation: Anytime Opti…

200 papers

Spiking Neural Networks (SNNs) have gained significant attention due to their biological plausibility and energy efficiency, making them promising alternatives to Artificial Neural Networks (ANNs). However, the performance gap between SNNs…

Computer Vision and Pattern Recognition · Computer Science 2025-04-30 Tianqing Zhang , Kairong Yu , Xian Zhong , Hongwei Wang , Qi Xu , Qiang Zhang

Spiking Neural Network (SNN) has been recognized as one of the next generation of neural networks. Conventionally, SNN can be converted from a pre-trained ANN by only replacing the ReLU activation to spike activation while keeping the…

Machine Learning · Computer Science 2021-06-15 Yuhang Li , Shikuang Deng , Xin Dong , Ruihao Gong , Shi Gu

Spiking neural network (SNN) is a brain-inspired model which has more spatio-temporal information processing capacity and computational energy efficiency. However, with the increasing depth of SNNs, the memory problem caused by the weights…

Neural and Evolutionary Computing · Computer Science 2022-08-02 Changqing Xu , Yijian Pei , Zili Wu , Yi Liu , Yintang Yang

Spiking Neural Networks (SNNs) are a class of network models capable of processing spatiotemporal information, with event-driven characteristics and energy efficiency advantages. Recently, directly trained SNNs have shown potential to match…

Artificial Intelligence · Computer Science 2024-12-24 Huaxu He

Spiking neural networks (SNNs) represent the most prominent biologically inspired computing model for neuromorphic computing (NC) architectures. However, due to the non-differentiable nature of spiking neuronal functions, the standard error…

Neural and Evolutionary Computing · Computer Science 2020-07-01 Jibin Wu , Yansong Chua , Malu Zhang , Guoqi Li , Haizhou Li , Kay Chen Tan

Spiking neural networks (SNNs) promise energy-efficient computation by mimicking biological neural dynamics, yet existing plasticity rules focus on isolated spike pairs and fail to leverage the synchronous activity patterns that drive…

Neural and Evolutionary Computing · Computer Science 2025-08-26 Yuchen Tian , Assel Kembay , Samuel Tensingh , Nhan Duy Truong , Jason K. Eshraghian , Omid Kavehei

Multi-bit spiking neural networks (SNNs) have recently become a heated research spot, pursuing energy-efficient and high-accurate AI. However, with more bits involved, the associated memory and computation demands escalate to the point…

Neural and Evolutionary Computing · Computer Science 2025-12-02 Xingting Yao , Qinghao Hu , Fei Zhou , Tielong Liu , Gang Li , Peisong Wang , Jian Cheng

Spiking Neural Networks (SNNs) emerged as a promising solution in the field of Artificial Neural Networks (ANNs), attracting the attention of researchers due to their ability to mimic the human brain and process complex information with…

Neural and Evolutionary Computing · Computer Science 2023-09-12 Pavithra Koralalage , Ireoluwa Fakeye , Pedro Machado , Jason Smith , Isibor Kennedy Ihianle , Salisu Wada Yahaya , Andreas Oikonomou , Ahmad Lotfi

Spiking neural networks (SNNs) have made great progress on both performance and efficiency over the last few years,but their unique working pattern makes it hard to train a high-performance low-latency SNN.Thus the development of SNNs still…

Neural and Evolutionary Computing · Computer Science 2022-11-22 Yudong Li , Yunlin Lei , Xu Yang

Spiking Neural Networks (SNNs) are inherently suited for continuous learning due to their event-driven temporal dynamics; however, their application to Class-Incremental Learning (CIL) has been hindered by catastrophic forgetting and the…

Neural and Evolutionary Computing · Computer Science 2026-01-30 Matteo Gianferrari , Omayma Moussadek , Riccardo Salami , Cosimo Fiorini , Lorenzo Tartarini , Daniela Gandolfi , Simone Calderara

There is an increasing interest in emulating Spiking Neural Networks (SNNs) on neuromorphic computing devices due to their low energy consumption. Recent advances have allowed training SNNs to a point where they start to compete with…

Neural and Evolutionary Computing · Computer Science 2022-01-14 Nicolas Perez-Nieves , Dan F. M. Goodman

Spiking neural networks (SNNs) promise orders-of-magnitude efficiency gains by communicating with sparse, event-driven spikes rather than dense numerical activations. However, most training pipelines either rely on surrogate-gradient…

Neural and Evolutionary Computing · Computer Science 2025-12-17 Arman Ferdowsi , Atakan Aral

Spiking neural networks (SNNs) show great potential due to their energy efficiency, fast processing capabilities, and robustness. There are two main approaches to constructing SNNs. Direct training methods require much memory, while…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Zihan Huang , Xinyu Shi , Zecheng Hao , Tong Bu , Jianhao Ding , Zhaofei Yu , Tiejun Huang

We propose a novel backpropagation algorithm for training spiking neural networks (SNNs) that encodes information in the relative multiple spike timing of individual neurons without single-spike restrictions. The proposed algorithm inherits…

Neural and Evolutionary Computing · Computer Science 2026-05-15 Kakei Yamamoto , Yusuke Sakemi , Kazuyuki Aihara

Spiking Neural Networks (SNNs), models inspired by neural mechanisms in the brain, allow for energy-efficient implementation on neuromorphic hardware. However, SNNs trained with current direct training approaches are constrained to a…

Machine Learning · Computer Science 2025-03-25 Kangrui Du , Yuhang Wu , Shikuang Deng , Shi Gu

Spiking neural networks (SNNs) have advantages in latency and energy efficiency over traditional artificial neural networks (ANNs) due to its event-driven computation mechanism and replacement of energy-consuming weight multiplications with…

Neural and Evolutionary Computing · Computer Science 2023-11-03 Zhehui Wang , Xiaozhe Gu , Rick Goh , Joey Tianyi Zhou , Tao Luo

Drawing on the intricate structures of the brain, Spiking Neural Networks (SNNs) emerge as a transformative development in artificial intelligence, closely emulating the complex dynamics of biological neural networks. While SNNs show…

Artificial Intelligence · Computer Science 2024-08-02 Yanchen Li , Jiachun Li , Kebin Sun , Luziwei Leng , Ran Cheng

Spiking neural networks (SNNs) exhibit superior energy efficiency but suffer from limited performance. In this paper, we consider SNNs as ensembles of temporal subnetworks that share architectures and weights, and highlight a crucial issue…

Machine Learning · Computer Science 2025-02-21 Yongqi Ding , Lin Zuo , Mengmeng Jing , Pei He , Hanpu Deng

Spiking Neural Networks (SNNs) compute using sparse communication and are attracting increased attention as a more energy-efficient alternative to traditional Artificial Neural Networks~(ANNs). While standard ANNs are stateless, spiking…

Neural and Evolutionary Computing · Computer Science 2025-06-27 Balázs Mészáros , James C. Knight , Thomas Nowotny

Machine learning with artificial neural networks (ANNs), provides solutions for the growing complexity of modern communication systems. This complexity, however, increases power consumption, making the systems energy-intensive. Spiking…

Signal Processing · Electrical Eng. & Systems 2026-01-26 Eike-Manuel Edelmann