English
Related papers

Related papers: Reinforcement Learning with Low-Complexity Liquid …

200 papers

Recurrent spiking neural networks (RSNN) in the human brain learn to perform a wide range of perceptual, cognitive and motor tasks very efficiently in terms of energy consumption and requires very few examples. This motivates the search for…

Neurons and Cognition · Quantitative Biology 2021-03-22 Paolo Muratore , Cristiano Capone , Pier Stanislao Paolucci

Tasks in which rewards depend upon past information not available in the current observation set can only be solved by agents that are equipped with short-term memory. Usual choices for memory modules include trainable recurrent hidden…

Machine Learning · Computer Science 2024-12-18 Kevin McKee

There has recently been an increased interest in reinforcement learning for nonlinear control problems. However standard reinforcement learning algorithms can often struggle even on seemingly simple set-point control problems. This paper…

Systems and Control · Electrical Eng. & Systems 2023-04-21 Ruoqi Zhang , Per Mattsson , Torbjörn Wigren

Deep feedforward and recurrent rate-based neural networks have become successful functional models of the brain, but they neglect obvious biological details such as spikes and Dale's law. Here we argue that these details are crucial in…

Neurons and Cognition · Quantitative Biology 2023-12-29 William F. Podlaski , Christian K. Machens

Spiking neural networks are nature's versatile solution to fault-tolerant and energy efficient signal processing. To translate these benefits into hardware, a growing number of neuromorphic spiking neural network processors attempt to…

Neural and Evolutionary Computing · Computer Science 2019-05-06 Emre O. Neftci , Hesham Mostafa , Friedemann Zenke

Recurrent neural networks (RNNs) for reinforcement learning (RL) have shown distinct advantages, e.g., solving memory-dependent tasks and meta-learning. However, little effort has been spent on improving RNN architectures and on…

Machine Learning · Computer Science 2019-11-27 Dongqi Han , Kenji Doya , Jun Tani

Spiking neural networks (SNNs) have shown clear advantages over traditional artificial neural networks (ANNs) for low latency and high computational efficiency, due to their event-driven nature and sparse communication. However, the…

Neural and Evolutionary Computing · Computer Science 2020-07-03 Jibin Wu , Chenglin Xu , Daquan Zhou , Haizhou Li , Kay Chen Tan

Spiking neural networks (SNNs) are brain-inspired models that enable energy-efficient implementation on neuromorphic hardware. However, the supervised training of SNNs remains a hard problem due to the discontinuity of the spiking neuron…

Neural and Evolutionary Computing · Computer Science 2021-12-20 Mingqing Xiao , Qingyan Meng , Zongpeng Zhang , Yisen Wang , Zhouchen Lin

Embedded systems acquire information about the real world from sensors and process it to make decisions and/or for transmission. In some situations, the relationship between the data and the decision is complex and/or the amount of data to…

Machine Learning · Computer Science 2021-06-29 Florian Bacho , Dominique Chu

Spiking Neural Networks (SNNs) have emerged as an attractive spatio-temporal computing paradigm for complex vision tasks. However, most existing works yield models that require many time steps and do not leverage the inherent temporal…

Neural and Evolutionary Computing · Computer Science 2022-10-25 Gourav Datta , Haoqin Deng , Robert Aviles , Peter A. Beerel

Using precise times of every spike, spiking supervised learning has more effects on complex spatial-temporal pattern than supervised learning only through neuronal firing rates. The purpose of spiking supervised learning after…

Neural and Evolutionary Computing · Computer Science 2019-02-12 Guojun Chen , Xianghong Lin , Guoen Wang

Spiking neural networks (SNNs) can utilize spatio-temporal information and have a nature of energy efficiency which is a good alternative to deep neural networks(DNNs). The event-driven information processing makes SNNs can reduce the…

Neural and Evolutionary Computing · Computer Science 2021-12-15 Changqing Xu , Yi Liu , Yintang Yang

Neurons communicate with downstream systems via sparse and incredibly brief electrical pulses, or spikes. Using these events, they control various targets such as neuromuscular units, neurosecretory systems, and other neurons in connected…

Neurons and Cognition · Quantitative Biology 2026-03-17 Paolo Agliati , André Urbano , Pablo Lanillos , Nasir Ahmad , Marcel van Gerven , Sander Keemink

Spiking Neural Networks (SNNs) have emerged with promising energy-efficient property, yet a substantial performance gap persists compared to Artificial Neural Networks (ANNs). This gap stems from at least two key limitations: first,…

Neural and Evolutionary Computing · Computer Science 2026-05-28 Feifan Zhou , Xiang Wei , Yang Liu , Qiang Yu

This study proposes a novel biologically plausible mechanism for generating low-dimensional spike-based text representation. First, we demonstrate how to transform documents into series of spikes spike trains which are subsequently used as…

Neural and Evolutionary Computing · Computer Science 2022-08-23 Marcin Białas , Marcin Michał Mirończuk , Jacek Mańdziuk

Understanding how the dynamics of neural networks is shaped by the computations they perform is a fundamental question in neuroscience. Recently, the framework of efficient coding proposed a theory of how spiking neural networks can compute…

Neurons and Cognition · Quantitative Biology 2022-10-25 Veronika Koren , Stefano Panzeri

Neuromorphic computing has recently gained momentum with the emergence of various neuromorphic processors. As the field advances, there is an increasing focus on developing training methods that can effectively leverage the unique…

Emerging Technologies · Computer Science 2025-04-15 Sanaz Mahmoodi Takaghaj , Jack Sampson

Recurrent networks have achieved great success on various sequential tasks with the assistance of complex recurrent units, but suffer from severe computational inefficiency due to weak parallelization. One direction to alleviate this issue…

Computation and Language · Computer Science 2019-06-03 Biao Zhang , Rico Sennrich

Spiking Neural Networks (SNNs) have attracted enormous research interest due to temporal information processing capability, low power consumption, and high biological plausibility. However, the formulation of efficient and high-performance…

Neural and Evolutionary Computing · Computer Science 2021-08-18 Wei Fang , Zhaofei Yu , Yanqi Chen , Timothee Masquelier , Tiejun Huang , Yonghong Tian

Despite recent progress in training spiking neural networks (SNNs) for classification, their application to continuous motor control remains limited. Here, we demonstrate that fully spiking architectures can be trained end-to-end to control…

Robotics · Computer Science 2026-02-04 Justus Huebotter , Pablo Lanillos , Marcel van Gerven , Serge Thill