English
Related papers

Related papers: A novel stochastic Hebb-like learning rule for neu…

200 papers

Adaptation plays a pivotal role in the evolution of natural and artificial complex systems, and in the determination of their functionality. Here, we investigate the impact of adaptive inter-layer processes on intra-layer synchronization in…

Adaptation and Self-Organizing Systems · Physics 2020-10-20 Ajay Deep Kachhvah , Xiangfeng Dai , Stefano Boccaletti , Sarika Jalan

Grounding autonomous behavior in the nervous system is a fundamental challenge for neuroscience. In particular, the self-organized behavioral development provides more questions than answers. Are there special functional units for…

Robotics · Computer Science 2016-06-16 Ralf Der , Georg Martius

Synaptic plasticity depends on the interaction between electrical activity in neurons and the synaptic proteome, the collection of over 1000 proteins in the post-synaptic density (PSD) of synapses. To construct models of synaptic plasticity…

Neurons and Cognition · Quantitative Biology 2014-11-19 David C. Sterratt , Oksana Sorokina , J. Douglas Armstrong

How can neural networks learn to efficiently represent complex and high-dimensional inputs via local plasticity mechanisms? Classical models of representation learning assume that input weights are learned via pairwise Hebbian-like…

Neurons and Cognition · Quantitative Biology 2022-10-04 Fabian Alexander Mikulasch , Lucas Rudelt , Viola Priesemann

Backpropagation is widely used to train artificial neural networks, but its relationship to synaptic plasticity in the brain is unknown. Some biological models of backpropagation rely on feedback projections that are symmetric with…

Neurons and Cognition · Quantitative Biology 2023-02-08 Navid Shervani-Tabar , Robert Rosenbaum

Learning and memory in the brain are implemented by complex, time-varying changes in neural circuitry. The computational rules according to which synaptic weights change over time are the subject of much research, and are not precisely…

Machine Learning · Statistics 2014-11-18 Scott W. Linderman , Christopher H. Stock , Ryan P. Adams

Learning and the ability to learn are important factors in development and evolutionary processes [1]. Depending on the level, the complexity of learning can strongly vary. While associative learning can explain simple learning behaviour…

Neurons and Cognition · Quantitative Biology 2007-05-23 Reimer Kuehn , Ion-Olimpiu Stamatescu

Despite its great success, backpropagation has certain limitations that necessitate the investigation of new learning methods. In this study, we present a biologically plausible local learning rule that improves upon Hebb's well-known…

Neural and Evolutionary Computing · Computer Science 2022-12-27 Hongchao Zhou

A semi-supervised learning method for spiking neural networks is proposed. The proposed method consists of supervised learning by backpropagation and subsequent unsupervised learning by spike-timing-dependent plasticity (STDP), which is a…

Neural and Evolutionary Computing · Computer Science 2021-06-23 Kotaro Furuya , Jun Ohkubo

Biological systems have to build models from their sensory data that allow them to efficiently process previously unseen inputs. Here, we study a neural network learning a linearly separable rule using examples provided by a teacher. We…

Statistical Mechanics · Physics 2017-11-22 Sebastian Goldt , Udo Seifert

In the present paper, I describe a spiking neural network (SNN) architecture which, can be used in wide range of supervised learning classification tasks. It is assumed, that all participating signals (the classified object description,…

Neural and Evolutionary Computing · Computer Science 2025-03-13 Mikhail Kiselev

Large networks of spiking neurons show abrupt changes in their collective dynamics resembling phase transitions studied in statistical physics. An example of this phenomenon is the transition from irregular, noise-driven dynamics to…

Adaptation and Self-Organizing Systems · Physics 2008-11-25 Vicenç Gómez , Andreas Kaltenbrunner , Vicente López , Hilbert J. Kappen

We propose a particularly structured Boltzmann machine, which we refer to as a dynamic Boltzmann machine (DyBM), as a stochastic model of a multi-dimensional time-series. The DyBM can have infinitely many layers of units but allows exact…

Neural and Evolutionary Computing · Computer Science 2015-09-30 Takayuki Osogami , Makoto Otsuka

Self-organized structures in networks with spike-timing dependent plasticity (STDP) are likely to play a central role for information processing in the brain. In the present study we derive a reaction-diffusion-like formalism for plastic…

Disordered Systems and Neural Networks · Physics 2016-06-15 Dmytro Grytskyy , Markus Diesmann , Moritz Helias

Recent studies have proposed that the diffusion of messenger molecules, such as monoamines, can mediate the plastic adaptation of synapses in supervised learning of neural networks. Based on these findings we developed a model for neural…

Neurons and Cognition · Quantitative Biology 2017-09-21 Damian L. Berger , Lucilla de Arcangelis , Hans J. Herrmann

We introduce Spike Agreement Dependent Plasticity (SADP), a biologically inspired synaptic learning rule for Spiking Neural Networks (SNNs) that relies on the agreement between pre- and post-synaptic spike trains rather than precise…

Neural and Evolutionary Computing · Computer Science 2025-08-25 Saptarshi Bej , Muhammed Sahad E , Gouri Lakshmi , Harshit Kumar , Pritam Kar , Bikas C Das

This paper shows that the heterogeneity in neuronal and synaptic dynamics reduces the spiking activity of a Recurrent Spiking Neural Network (RSNN) while improving prediction performance, enabling spike-efficient (unsupervised) learning. We…

Artificial Intelligence · Computer Science 2023-08-08 Biswadeep Chakraborty , Saibal Mukhopadhyay

Backpropagation algorithm has driven the remarkable success of deep neural networks, but its lack of biological plausibility and high computational costs have motivated the ongoing search for alternative training methods. Hebbian learning…

Artificial Intelligence · Computer Science 2026-04-23 Wenjia Hua , Kejie Zhao , Luziwei Leng , Ran Cheng , Yuxin Ma , Qinghai Guo

In this paper, we propose a learning rule based on a back-propagation (BP) algorithm that can be applied to a hardware-based deep neural network (HW-DNN) using electronic devices that exhibit discrete and limited conductance…

Neural and Evolutionary Computing · Computer Science 2018-08-02 Suhwan Lim , Jong-Ho Bae , Jai-Ho Eum , Sungtae Lee , Chul-Heung Kim , Dongseok Kwon , Byung-Gook Park , Jong-Ho Lee

Cortical populations of neurons develop sparse representations adapted to the statistics of the environment. While existing synaptic plasticity models reproduce some of the observed receptive-field properties, a major obstacle is the…

Neurons and Cognition · Quantitative Biology 2022-09-16 Carlos Stein N. Brito , Wulfram Gerstner