English
Related papers

Related papers: Reinforcement Learning with Low-Complexity Liquid …

200 papers

Inspired by the brain's information processing using binary spikes, spiking neural networks (SNNs) offer significant reductions in energy consumption and are more adept at incorporating multi-scale biological characteristics. In SNNs,…

Neural and Evolutionary Computing · Computer Science 2025-02-26 Yinqian Sun , Feifei Zhao , Zhuoya Zhao , Yi Zeng

Recurrent spiking neural networks (RSNNs) are notoriously difficult to train because of the vanishing gradient problem that is enhanced by the binary nature of the spikes. In this paper, we review the ability of the current state-of-the-art…

Neural and Evolutionary Computing · Computer Science 2023-10-31 Ismael Balafrej , Fabien Alibart , Jean Rouat

The spiking neural network, known as the third generation neural network, is an important network paradigm. Due to its mode of information propagation that follows biological rationality, the spiking neural network has strong energy…

Neural and Evolutionary Computing · Computer Science 2025-05-21 Zihan Dai , Huanfei Ma

We describe a method to train spiking deep networks that can be run using leaky integrate-and-fire (LIF) neurons, achieving state-of-the-art results for spiking LIF networks on five datasets, including the large ImageNet ILSVRC-2012…

Neural and Evolutionary Computing · Computer Science 2016-11-17 Eric Hunsberger , Chris Eliasmith

Spiking neural networks (SNNs), particularly the single-spike variant in which neurons spike at most once, are considerably more energy efficient than standard artificial neural networks (ANNs). However, single-spike SSNs are difficult to…

Neural and Evolutionary Computing · Computer Science 2022-10-13 Luke Taylor , Andrew King , Nicol Harper

Networks of interconnected neurons communicating through spiking signals offer the bedrock of neural computations. Our brains spiking neural networks have the computational capacity to achieve complex pattern recognition and cognitive…

Neural and Evolutionary Computing · Computer Science 2024-12-06 Naresh Ravichandran , Anders Lansner , Pawel Herman

Spiking Neural Networks (SNNs) as Machine Learning (ML) models have recently received a lot of attention as a potentially more energy-efficient alternative to conventional Artificial Neural Networks. The non-differentiability and sparsity…

Machine Learning · Computer Science 2025-12-05 Maximilian Gollwitzer , Felix Dietrich

Artificial neural networks are promising for general function approximation but challenging to train on non-independent or non-identically distributed data due to catastrophic forgetting. The experience replay buffer, a standard component…

Machine Learning · Computer Science 2023-04-12 Qingfeng Lan , Yangchen Pan , Jun Luo , A. Rupam Mahmood

The human brain constantly learns and rapidly adapts to new situations by integrating acquired knowledge and experiences into memory. Developing this capability in machine learning models is considered an important goal of AI research since…

Artificial Intelligence · Computer Science 2023-06-08 Arsham Gholamzadeh Khoee , Alireza Javaheri , Saeed Reza Kheradpisheh , Mohammad Ganjtabesh

Spiking Neural Networks are a recent and new neural network design approach that promises tremendous improvements in power efficiency, computation efficiency, and processing latency. They do so by using asynchronous spike-based data flow,…

Computer Vision and Pattern Recognition · Computer Science 2022-06-08 Sambit Mohapatra , Thomas Mesquida , Mona Hodaei , Senthil Yogamani , Heinrich Gotzig , Patrick Mader

Spiking neural networks (SNNs) promise low-power event-driven computation for temporally rich tasks, but commonly used neuron models often trade off gradient-based trainability, dynamical richness, and high activity sparsity. These…

Neural and Evolutionary Computing · Computer Science 2026-05-13 Alex Fulleda-Garcia , Saray Soldado-Magraner , Josep Maria Margarit-Taulé

Spiking neural networks are biologically plausible counterparts of the artificial neural networks, artificial neural networks are usually trained with stochastic gradient descent and spiking neural networks are trained with spike timing…

Neural and Evolutionary Computing · Computer Science 2019-09-26 Ruthvik Vaila , John Chiasson , Vishal Saxena

Spiking neural networks (SNNs) communicate via discrete spikes in time rather than continuous activations. Their event-driven nature offers advantages for temporal processing and energy efficiency on resource-constrained hardware, but…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Karol C. Jurzec , Tomasz Szydlo , Maciej Wielgosz

Spiking neural networks, also often referred to as the third generation of neural networks, carry the potential for a massive reduction in memory and energy consumption over traditional, second-generation neural networks. Inspired by the…

Neural and Evolutionary Computing · Computer Science 2022-10-27 Alexander Henkes , Jason K. Eshraghian , Henning Wessels

Spiking Neural Networks (SNNs) have recently emerged as a prominent neural computing paradigm. However, the typical shallow SNN architectures have limited capacity for expressing complex representations while training deep SNNs using input…

Neural and Evolutionary Computing · Computer Science 2020-03-26 Chankyu Lee , Syed Shakib Sarwar , Priyadarshini Panda , Gopalakrishnan Srinivasan , Kaushik Roy

Spiking Neural Networks (SNNs) offer a promising alternative to conventional Artificial Neural Networks (ANNs) for the implementation of on-device low-power online learning and inference. On-device training is, however, constrained by the…

Machine Learning · Computer Science 2019-10-24 Nicolas Skatchkovsky , Hyeryung Jang , Osvaldo Simeone

In this paper, we derive a new model of synaptic plasticity, based on recent algorithms for reinforcement learning (in which an agent attempts to learn appropriate actions to maximize its long-term average reward). We show that these direct…

Machine Learning · Computer Science 2019-11-19 Peter L. Bartlett , Jonathan Baxter

As the third-generation neural networks, Spiking Neural Networks (SNNs) have great potential on neuromorphic hardware because of their high energy-efficiency. However, Deep Spiking Reinforcement Learning (DSRL), i.e., the Reinforcement…

Neural and Evolutionary Computing · Computer Science 2023-04-12 Guisong Liu , Wenjie Deng , Xiurui Xie , Li Huang , Huajin Tang

In recent years deep reinforcement learning (RL) systems have attained superhuman performance in a number of challenging task domains. However, a major limitation of such applications is their demand for massive amounts of training data. A…

In the reinforcement learning (RL) tasks, the ability to predict receiving reward in the near or more distant future means the ability to evaluate the current state as more or less close to the target state (labelled by the reward signal).…

Neural and Evolutionary Computing · Computer Science 2023-11-10 Mikhail Kiselev