English
Related papers

Related papers: Towards Zero Memory Footprint Spiking Neural Netwo…

200 papers

Deep learning has revolutionized artificial intelligence (AI), achieving remarkable progress in fields such as computer vision, speech recognition, and natural language processing. Moreover, the recent success of large language models…

Machine Learning · Computer Science 2024-09-05 Yangfan Hu , Qian Zheng , Guoqi Li , Huajin Tang , Gang Pan

We propose a new supervised learning rule for multilayer spiking neural networks (SNNs) that use a form of temporal coding known as rank-order-coding. With this coding scheme, all neurons fire exactly one spike per stimulus, but the firing…

Neural and Evolutionary Computing · Computer Science 2020-06-16 Saeed Reza Kheradpisheh , Timothée Masquelier

Spiking neural networks (SNNs) have closer dynamics to the brain than current deep neural networks. Their low power consumption and sample efficiency make these networks interesting. Recently, several deep convolutional spiking neural…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Shahriar Rezghi Shirsavar , Mohammad-Reza A. Dehaqani

Embedded AI systems are expected to incur low power/energy consumption for solving machine learning tasks, as these systems are usually power constrained (e.g., object recognition task in autonomous mobile agents with portable batteries).…

Neural and Evolutionary Computing · Computer Science 2025-07-04 Rachmad Vidya Wicaksana Putra , Muhammad Shafique

Spiking neural networks (SNNs) with event-based computation are promising brain-inspired models for energy-efficient applications on neuromorphic hardware. However, most supervised SNN training methods, such as conversion from artificial…

Neural and Evolutionary Computing · Computer Science 2023-02-02 Mingqing Xiao , Qingyan Meng , Zongpeng Zhang , Yisen Wang , Zhouchen Lin

Inspired by the connectivity mechanisms in the brain, neuromorphic computing architectures model Spiking Neural Networks (SNNs) in silicon. As such, neuromorphic architectures are designed and developed with the goal of having small, low…

Neural and Evolutionary Computing · Computer Science 2020-02-05 Mihaela Dimovska , Travis Johnston , Catherine D. Schuman , J. Parker Mitchell , Thomas E. Potok

Spiking Neural Networks (SNNs) have emerged as an attractive spatio-temporal computing paradigm for complex vision tasks. However, most existing works yield models that require many time steps and do not leverage the inherent temporal…

Neural and Evolutionary Computing · Computer Science 2022-10-25 Gourav Datta , Haoqin Deng , Robert Aviles , Peter A. Beerel

Over the past decade Spiking Neural Networks (SNN) have emerged as one of the popular architectures to emulate the brain. In SNN, information is temporally encoded and communication between neurons is accomplished by means of spikes. In…

Emerging Technologies · Computer Science 2016-12-14 Abhronil Sengupta , Aparajita Banerjee , Kaushik Roy

With the rapid development of deep learning, Deep Spiking Neural Networks (DSNNs) have emerged as promising due to their unique spike event processing and asynchronous computation. When deployed on neuromorphic chips, DSNNs offer…

Neural and Evolutionary Computing · Computer Science 2024-07-15 Hui Xie , Ge Yang , Wenjuan Gao

Agent-based Transformers have been widely adopted in recent reinforcement learning advances due to their demonstrated ability to solve complex tasks. However, the high computational complexity of Transformers often results in significant…

Machine Learning · Computer Science 2025-05-21 Mohammad Irfan Uddin , Nishad Tasnim , Md Omor Faruk , Zejian Zhou

Spiking neural networks (SNNs) have superb characteristics in sensory information recognition tasks due to their biological plausibility. However, the performance of some current spiking-based models is limited by their structures which…

Neural and Evolutionary Computing · Computer Science 2023-04-20 Qi Xu , Yaxin Li , Xuanye Fang , Jiangrong Shen , Jian K. Liu , Huajin Tang , Gang Pan

Spiking Neural Networks (SNNs) are a promising research direction for building power-efficient information processing systems, especially for temporal tasks such as speech recognition. In SNNs, delays refer to the time needed for one spike…

Neural and Evolutionary Computing · Computer Science 2024-08-13 Ilyass Hammouamri , Ismail Khalfaoui-Hassani , Timothée Masquelier

Spiking Neural Networks (SNNs) compute in an event-based matter to achieve a more efficient computation than standard Neural Networks. In SNNs, neuronal outputs (i.e. activations) are not encoded with real-valued activations but with…

Hardware Architecture · Computer Science 2023-08-08 Jan Sommer , M. Akif Özkan , Oliver Keszocze , Jürgen Teich

Despite the rapid progress of neuromorphic computing, inadequate capacity and insufficient representation power of spiking neural networks (SNNs) severely restrict their application scope in practice. Residual learning and shortcuts have…

Neural and Evolutionary Computing · Computer Science 2023-03-13 Yifan Hu , Lei Deng , Yujie Wu , Man Yao , Guoqi Li

Communication by rare, binary spikes is a key factor for the energy efficiency of biological brains. However, it is harder to train biologically-inspired spiking neural networks (SNNs) than artificial neural networks (ANNs). This is…

Neural and Evolutionary Computing · Computer Science 2023-11-21 Ana Stanojevic , Stanisław Woźniak , Guillaume Bellec , Giovanni Cherubini , Angeliki Pantazi , Wulfram Gerstner

Spiking Neural Networks (SNNs), recognized as the third generation of neural networks, are known for their bio-plausibility and energy efficiency, especially when implemented on neuromorphic hardware. However, the majority of existing…

Neural and Evolutionary Computing · Computer Science 2024-07-02 Yi Jiang , Sen Lu , Abhronil Sengupta

In the field of image recognition, spiking neural networks (SNNs) have achieved performance comparable to conventional artificial neural networks (ANNs). In such applications, SNNs essentially function as traditional neural networks with…

Neural and Evolutionary Computing · Computer Science 2025-05-27 Enqi Zhang

Deep neural networks (DNNs) excel in computer vision tasks, especially, few-shot learning (FSL), which is increasingly important for generalizing from limited examples. However, DNNs are computationally expensive with scalability issues in…

Machine Learning · Computer Science 2025-05-16 Qi Xu , Junyang Zhu , Dongdong Zhou , Hao Chen , Yang Liu , Jiangrong Shen , Qiang Zhang

Spiking neural networks have gained significant attention due to their brain-like information processing capabilities. The use of surrogate gradients has made it possible to train spiking neural networks with backpropagation, leading to…

Neural and Evolutionary Computing · Computer Science 2023-05-24 Dongcheng Zhao , Guobin Shen , Yiting Dong , Yang Li , Yi Zeng

Machine learning has emerged as the dominant tool for implementing complex cognitive tasks that require supervised, unsupervised, and reinforcement learning. While the resulting machines have demonstrated in some cases even super-human…

Emerging Technologies · Computer Science 2019-08-06 Bipin Rajendran , Abu Sebastian , Michael Schmuker , Narayan Srinivasa , Evangelos Eleftheriou