English
Related papers

Related papers: Reinforcement Learning with Feedback-modulated TD-…

200 papers

The human brain constantly learns and rapidly adapts to new situations by integrating acquired knowledge and experiences into memory. Developing this capability in machine learning models is considered an important goal of AI research since…

Artificial Intelligence · Computer Science 2023-06-08 Arsham Gholamzadeh Khoee , Alireza Javaheri , Saeed Reza Kheradpisheh , Mohammad Ganjtabesh

Previous studies have shown that spike-timing-dependent plasticity (STDP) can be used in spiking neural networks (SNN) to extract visual features of low or intermediate complexity in an unsupervised manner. These studies, however, used…

Computer Vision and Pattern Recognition · Computer Science 2018-03-12 Saeed Reza Kheradpisheh , Mohammad Ganjtabesh , Simon J Thorpe , Timothée Masquelier

Spike-Timing-Dependent Plasticity (STDP) is an unsupervised learning mechanism for Spiking Neural Networks (SNNs) that has received significant attention from the neuromorphic hardware community. However, scaling such local learning…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Sen Lu , Abhronil Sengupta

Spiking Neural Networks (SNNs), recognized for their biological plausibility and energy efficiency, employ sparse and asynchronous spikes for communication. However, the training of SNNs encounters difficulties coming from…

Neurons and Cognition · Quantitative Biology 2024-05-09 Sushant Yadav , Santosh Chaudhary , Rajesh Kumar

This study explores the design and control of the behaviour of agents and robots using simple circuits of spiking neurons and Spike Timing Dependent Plasticity (STDP) as a mechanism of associative and unsupervised learning. Based on a…

Robotics · Computer Science 2015-09-25 Cristian Jimenez-Romero , David Sousa-Rodrigues , Jeffrey H. Johnson

Spike-timing dependent plasticity (STDP) which observed in the brain has proven to be important in biological learning. On the other hand, artificial neural networks use a different way to learn, such as Back-Propagation or Contrastive…

Neural and Evolutionary Computing · Computer Science 2021-06-10 Shiyuan Li

Compared with rate-based artificial neural networks, Spiking Neural Networks (SNN) provide a more biological plausible model for the brain. But how they perform supervised learning remains elusive. Inspired by recent works of Bengio et al.,…

Neural and Evolutionary Computing · Computer Science 2022-03-08 Zhanhao Hu , Tao Wang , Xiaolin Hu

This paper presents a vehicle lateral controller based on spiking neural networks capable of replicating the behavior of a model-based controller but with the additional ability to perform online adaptation. By making use of neural…

Systems and Control · Electrical Eng. & Systems 2022-07-06 Javier Pérez , Manuel A. Vargas , Juan A. Cabrera , Juan J. Castillo , Barys Shyrokau

Spiking neural networks (SNNs) possess energy-efficient potential due to event-based computation. However, supervised training of SNNs remains a challenge as spike activities are non-differentiable. Previous SNNs training methods can be…

Neural and Evolutionary Computing · Computer Science 2019-10-08 Yunzhe Hao , Xuhui Huang , Meng Dong , Bo Xu

Feedback-driven recurrent spiking neural networks (RSNNs) are powerful computational models that can mimic dynamical systems. However, the presence of a feedback loop from the readout to the recurrent layer de-stabilizes the learning…

Artificial Intelligence · Computer Science 2022-05-30 Ankita Paul , Stefan Wagner , Anup Das

A common view in the neuroscience community is that memory is encoded in the connection strength between neurons. This perception led artificial neural network models to focus on connection weights as the key variables to modulate learning.…

Neural and Evolutionary Computing · Computer Science 2022-02-22 Hananel Hazan , Simon Caby , Christopher Earl , Hava Siegelmann , Michael Levin

The primate visual system has inspired the development of deep artificial neural networks, which have revolutionized the computer vision domain. Yet these networks are much less energy-efficient than their biological counterparts, and they…

Computer Vision and Pattern Recognition · Computer Science 2019-05-30 Milad Mozafari , Mohammad Ganjtabesh , Abbas Nowzari-Dalini , Simon J. Thorpe , Timothée Masquelier

In this study, we propose and analyze in simulations a new, highly flexible method of implementing synaptic plasticity in a wafer-scale, accelerated neuromorphic hardware system. The study focuses on globally modulated STDP, as a special…

Neurons and Cognition · Quantitative Biology 2013-08-21 Simon Friedmann , Nicolas Frémaux , Johannes Schemmel , Wulfram Gerstner , Karlheinz Meier

In timing-based neural codes, neurons have to emit action potentials at precise moments in time. We use a supervised learning paradigm to derive a synaptic update rule that optimizes via gradient ascent the likelihood of postsynaptic firing…

Neurons and Cognition · Quantitative Biology 2007-05-23 Jean-Pascal Pfister , Taro Toyoizumi , David Barber , Wulfram Gerstner

Thought to be responsible for memory, synaptic plasticity has been widely studied in the past few decades. One example of plasticity models is the popular Spike Timing Dependent Plasticity (STDP). The huge litterature of STDP models are…

Probability · Mathematics 2018-03-02 Pascal Helson

The modular and hierarchical organization of the brain is believed to support the coexistence of segregated (specialization) and integrated (binding) information processes. A relevant question is yet to understand how such architecture…

Neurons and Cognition · Quantitative Biology 2025-06-19 Raphaël Bergoin , Alessandro Torcini , Gustavo Deco , Mathias Quoy , Gorka Zamora-López

Spike-timing dependent plasticity (STDP) is an organizing principle of biological neural networks. While synchronous firing of neurons is considered to be an important functional block in the brain, how STDP shapes neural networks possibly…

Neurons and Cognition · Quantitative Biology 2009-05-20 Yuko K. Takahashi , Hiroshi Kori , Naoki Masuda

One stream of reinforcement learning research is exploring biologically plausible models and algorithms to simulate biological intelligence and fit neuromorphic hardware. Among them, reward-modulated spike-timing-dependent plasticity…

Neural and Evolutionary Computing · Computer Science 2022-10-25 Zhile Yang , Shangqi Guo , Ying Fang , Jian K. Liu

Spiking neural networks (SNN) are considered as a perspective basis for performing all kinds of learning tasks - unsupervised, supervised and reinforcement learning. Learning in SNN is implemented through synaptic plasticity - the rules…

Neural and Evolutionary Computing · Computer Science 2021-11-15 Mikhail Kiselev

We suggest a mechanism based on spike time dependent plasticity (STDP) of synapses to store, retrieve and predict temporal sequences. The mechanism is demonstrated in a model system of simplified integrate-and-fire type neurons densely…

Adaptation and Self-Organizing Systems · Physics 2009-11-07 Thomas Nowotny , Misha I. Rabinovich , Henry D. I. Abarbanel