English
Related papers

Related papers: Learning as filtering: implications for spike-base…

200 papers

Thought to be responsible for memory, synaptic plasticity has been widely studied in the past few decades. One example of plasticity models is the popular Spike Timing Dependent Plasticity (STDP). The huge litterature of STDP models are…

Probability · Mathematics 2018-03-02 Pascal Helson

Spike-Timing-Dependent Plasticity (STDP) provides a biologically grounded learning rule for spiking neural networks (SNNs), but its reliance on precise spike timing and pairwise updates limits fast learning of weights. We introduce a…

Neural and Evolutionary Computing · Computer Science 2026-01-14 Gouri Lakshmi S , Athira Chandrasekharan , Harshit Kumar , Muhammed Sahad E , Bikas C Das , Saptarshi Bej

Hebbian learning is a key principle underlying learning in biological neural networks. We relate a Hebbian spike-timing-dependent plasticity rule to noisy gradient descent with respect to a non-convex loss function on the probability…

Machine Learning · Computer Science 2026-01-14 Niklas Dexheimer , Sascha Gaudlitz , Johannes Schmidt-Hieber

Information measures are often used to assess the efficacy of neural networks, and learning rules can be derived through optimization procedures on such measures. In biological neural networks, computation is restricted by the amount of…

Neurons and Cognition · Quantitative Biology 2021-03-12 Dmytro Grytskyy , Renaud B. Jolivet

We study associative memory neural networks based on the Hodgkin-Huxley type of spiking neurons. We introduce the spike-timing-dependent learning rule, in which the time window with the negative part as well as the positive part is used to…

Disordered Systems and Neural Networks · Physics 2009-11-07 Masahiko Yoshioka

Continuous adaptation allows survival in an ever-changing world. Adjustments in the synaptic coupling strength between neurons are essential for this capability, setting us apart from simpler, hard-wired organisms. How these changes can be…

Neurons and Cognition · Quantitative Biology 2021-01-06 Jakob Jordan , Maximilian Schmidt , Walter Senn , Mihai A. Petrovici

A semi-supervised learning method for spiking neural networks is proposed. The proposed method consists of supervised learning by backpropagation and subsequent unsupervised learning by spike-timing-dependent plasticity (STDP), which is a…

Neural and Evolutionary Computing · Computer Science 2021-06-23 Kotaro Furuya , Jun Ohkubo

Spiking neural networks are nature's versatile solution to fault-tolerant and energy efficient signal processing. To translate these benefits into hardware, a growing number of neuromorphic spiking neural network processors attempt to…

Neural and Evolutionary Computing · Computer Science 2019-05-06 Emre O. Neftci , Hesham Mostafa , Friedemann Zenke

The brain is a biological system comprising nerve cells and orchestrates its embodied agent's perception, behavior, and learning in the dynamic environment. The free energy principle (FEP) advocated by Karl Friston explicates the local,…

Neurons and Cognition · Quantitative Biology 2024-10-07 Chang Sub Kim

We introduce Spike Agreement Dependent Plasticity (SADP), a biologically inspired synaptic learning rule for Spiking Neural Networks (SNNs) that relies on the agreement between pre- and post-synaptic spike trains rather than precise…

Neural and Evolutionary Computing · Computer Science 2025-08-25 Saptarshi Bej , Muhammed Sahad E , Gouri Lakshmi , Harshit Kumar , Pritam Kar , Bikas C Das

Short-term synaptic plasticity (STP) is often regarded as a presynaptic filter of spikes, independent of postsynaptic activity. Recent experiments, however, indicate an associative STP that depends on pre- and postsynaptic coactivation. We…

Neurons and Cognition · Quantitative Biology 2026-05-20 Genki Shimizu , Taro Toyoizumi

We consider the problem of sequentially making decisions that are rewarded by "successes" and "failures" which can be predicted through an unknown relationship that depends on a partially controllable vector of attributes for each instance.…

Machine Learning · Statistics 2017-09-18 Yingfei Wang , Chu Wang , Warren Powell

We introduce a weight update formula that is expressed only in terms of firing rates and their derivatives and that results in changes consistent with those associated with spike-timing dependent plasticity (STDP) rules and biological…

Neural and Evolutionary Computing · Computer Science 2016-03-22 Yoshua Bengio , Thomas Mesnard , Asja Fischer , Saizheng Zhang , Yuhuai Wu

Understanding how the brain learns to compute functions reliably, efficiently and robustly with noisy spiking activity is a fundamental challenge in neuroscience. Most sensory and motor tasks can be described as dynamical systems and could…

Neurons and Cognition · Quantitative Biology 2017-05-24 Sophie Denève , Alireza Alemi , Ralph Bourdoukan

Neuroscientists have long criticised deep learning algorithms as incompatible with current knowledge of neurobiology. We explore more biologically plausible versions of deep representation learning, focusing here mostly on unsupervised…

Machine Learning · Computer Science 2016-08-10 Yoshua Bengio , Dong-Hyun Lee , Jorg Bornschein , Thomas Mesnard , Zhouhan Lin

This study introduces a novel supervised learning approach for spiking neural networks that does not rely on traditional backpropagation. Instead, it employs spike-timing-dependent plasticity (STDP) within a supervised framework for image…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Wei Xie

Spiking neural networks (SNNs) are distributed trainable systems whose computing elements, or neurons, are characterized by internal analog dynamics and by digital and sparse synaptic communications. The sparsity of the synaptic spiking…

Machine Learning · Computer Science 2020-01-08 Hyeryung Jang , Osvaldo Simeone , Brian Gardner , André Grüning

For energy-efficient computation in specialized neuromorphic hardware, we present spiking neural coding, an instantiation of a family of artificial neural models grounded in the theory of predictive coding. This model, the first of its…

Neural and Evolutionary Computing · Computer Science 2022-08-09 Alexander Ororbia

To learn useful dynamics on long time scales, neurons must use plasticity rules that account for long-term, circuit-wide effects of synaptic changes. In other words, neural circuits must solve a credit assignment problem to appropriately…

Neurons and Cognition · Quantitative Biology 2019-05-30 Owen Marschall , Kyunghyun Cho , Cristina Savin

We show that the local Spike Timing-Dependent Plasticity (STDP) rule has the effect of regulating the trans-synaptic weights of loops of any length within a simulated network of neurons. We show that depending on STDP's polarity, functional…

Neurons and Cognition · Quantitative Biology 2010-03-23 James R. Kozloski , Guillermo A. Cecchi