English
Related papers

Related papers: Training spiking neural networks using reinforceme…

200 papers

We consider artificial neurons which will update their weight coefficients with an internal rule based on backpropagation, rather than using it as an external training procedure. To achieve this we include the backpropagation error estimate…

Neural and Evolutionary Computing · Computer Science 2018-08-07 M. N. Nazarov

Training neural networks with reinforcement learning (RL) typically relies on backpropagation (BP), necessitating storage of activations from the forward pass for subsequent backward updates. Furthermore, backpropagating error signals…

Machine Learning · Computer Science 2025-07-16 Daniel Tanneberg

Spiking neural networks (SNNs) have garnered a great amount of interest for supervised and unsupervised learning applications. This paper deals with the problem of training multi-layer feedforward SNNs. The non-linear integrate-and-fire…

Neural and Evolutionary Computing · Computer Science 2019-07-30 Navin Anwani , Bipin Rajendran

The bio-inspired integrate-fire-reset mechanism of spiking neurons constitutes the foundation for efficient processing in Spiking Neural Networks (SNNs). Recent progress in large models demands that spiking neurons support highly parallel…

Neural and Evolutionary Computing · Computer Science 2026-02-03 Yanbin Huang , Man Yao , Yuqi Pan , Changze Lv , Siyuan Xu , Xiaoqing Zheng , Bo Xu , Guoqi Li

In this paper, the question how spiking neural network (SNN) learns and fixes in its internal structures a model of external world dynamics is explored. This question is important for implementation of the model-based reinforcement learning…

Neural and Evolutionary Computing · Computer Science 2022-09-21 Mikhail Kiselev

We introduce a new supervised learning algorithm based to train spiking neural networks for classification. The algorithm overcomes a limitation of existing multi-spike learning methods: it solves the problem of interference between…

Neural and Evolutionary Computing · Computer Science 2021-08-12 Huy Le Nguyen , Dominique Chu

With the help of special neuromorphic hardware, spiking neural networks (SNNs) are expected to realize artificial intelligence (AI) with less energy consumption. It provides a promising energy-efficient way for realistic control tasks by…

Neural and Evolutionary Computing · Computer Science 2024-01-12 Ding Chen , Peixi Peng , Tiejun Huang , Yonghong Tian

Spiking Neural Networks (SNNs) are distributed trainable systems whose computing elements, or neurons, are characterized by internal analog dynamics and by digital and sparse synaptic communications. The sparsity of the synaptic spiking…

Signal Processing · Electrical Eng. & Systems 2019-10-22 Hyeryung Jang , Osvaldo Simeone , Brian Gardner , André Grüning

Applications that generate huge amounts of data in the form of fast streams are becoming increasingly prevalent, being therefore necessary to learn in an online manner. These conditions usually impose memory and processing time…

Neural and Evolutionary Computing · Computer Science 2019-08-22 Jesus L. Lobo , Javier Del Ser , Albert Bifet , Nikola Kasabov

Emergence of deep neural networks (DNNs) has raised enormous attention towards artificial neural networks (ANNs) once again. They have become the state-of-the-art models and have won different machine learning challenges. Although these…

Neural and Evolutionary Computing · Computer Science 2022-12-09 Shahriar Rezghi Shirsavar , Abdol-Hossein Vahabie , Mohammad-Reza A. Dehaqani

Spiking recurrent neural networks (RNNs) are a promising tool for solving a wide variety of complex cognitive and motor tasks, due to their rich temporal dynamics and sparse processing. However training spiking RNNs on dedicated…

Neural and Evolutionary Computing · Computer Science 2021-09-28 Yigit Demirag , Charlotte Frenkel , Melika Payvand , Giacomo Indiveri

Deep Reinforcement Learning (RL) demonstrates excellent performance on tasks that can be solved by trained policy. It plays a dominant role among cutting-edge machine learning approaches using multi-layer Neural networks (NNs). At the same…

Machine Learning · Computer Science 2019-08-20 Devdhar Patel , Hananel Hazan , Daniel J. Saunders , Hava Siegelmann , Robert Kozma

Feedback-driven recurrent spiking neural networks (RSNNs) are powerful computational models that can mimic dynamical systems. However, the presence of a feedback loop from the readout to the recurrent layer de-stabilizes the learning…

Artificial Intelligence · Computer Science 2022-05-30 Ankita Paul , Stefan Wagner , Anup Das

Spiking Neural Networks (SNNs) have emerged with promising energy-efficient property, yet a substantial performance gap persists compared to Artificial Neural Networks (ANNs). This gap stems from at least two key limitations: first,…

Neural and Evolutionary Computing · Computer Science 2026-05-28 Feifan Zhou , Xiang Wei , Yang Liu , Qiang Yu

The adaptive changes in synaptic efficacy that occur between spiking neurons have been demonstrated to play a critical role in learning for biological neural networks. Despite this source of inspiration, many learning focused applications…

Neural and Evolutionary Computing · Computer Science 2022-05-30 Samuel Schmidgall , Julia Ashkanazy , Wallace Lawson , Joe Hays

Third-generation neural networks, or Spiking Neural Networks (SNNs), aim at harnessing the energy efficiency of spike-domain processing by building on computing elements that operate on, and exchange, spikes. In this paper, the problem of…

Machine Learning · Statistics 2018-02-23 Alireza Bagheri , Osvaldo Simeone , Bipin Rajendran

This paper extends the reinforcement learning ideas into the multi-agents system, which is far more complicated than the previously studied single-agent system. We studied two different multi-agents systems. One is the fully-connected…

Artificial Intelligence · Computer Science 2015-05-18 Zhipeng Wang , Mingbo Cai

Spiking neural networks (SNNs), the models inspired by the mechanisms of real neurons in the brain, transmit and represent information by employing discrete action potentials or spikes. The sparse, asynchronous properties of information…

Neural and Evolutionary Computing · Computer Science 2024-09-13 Yongbo Zhang , Katsuma Inoue , Mitsumasa Nakajima , Toshikazu Hashimoto , Yasuo Kuniyoshi , Kohei Nakajima

Spiking neural networks (SNNs) represent a promising approach in machine learning, combining the hierarchical learning capabilities of deep neural networks with the energy efficiency of spike-based computations. Traditional end-to-end…

Neural and Evolutionary Computing · Computer Science 2024-11-12 Ruyin Wan , Qian Zhang , George Em Karniadakis

Reinforcement learning (RL) has a rich history in neuroscience, from early work on dopamine as a reward prediction error signal (Schultz et al., 1997) to recent work proposing that the brain could implement a form of 'distributional…

Neurons and Cognition · Quantitative Biology 2024-12-19 Kristopher T. Jensen