English
Related papers

Related papers: Synaptic plasticity as Bayesian inference

200 papers

The dynamics of local cortical networks are irregular, but correlated. Dynamic excitatory--inhibitory balance is a plausible mechanism that generates such irregular activity, but it remains unclear how balance is achieved and maintained in…

Neurons and Cognition · Quantitative Biology 2020-04-28 Alan Eric Akil , Robert Rosenbaum , Krešimir Josić

Among the main features of biological intelligence are energy efficiency, capacity for continual adaptation, and risk management via uncertainty quantification. Neuromorphic engineering has been thus far mostly driven by the goal of…

Neural and Evolutionary Computing · Computer Science 2022-11-02 Nicolas Skatchkovsky , Hyeryung Jang , Osvaldo Simeone

The brain modifies its synaptic strengths during learning in order to better adapt to its environment. However, the underlying plasticity rules that govern learning are unknown. Many proposals have been suggested, including Hebbian…

Neurons and Cognition · Quantitative Biology 2020-12-09 Aran Nayebi , Sanjana Srivastava , Surya Ganguli , Daniel L. K. Yamins

Learning and memory relies on synapses changing their strengths in response to neural activity. However there is a substantial gap between the timescales of neural electrical dynamics (1-100 ms) and organism behaviour during learning…

Neurons and Cognition · Quantitative Biology 2023-08-08 Cian O'Donnell

How can we build agents that keep learning from experience, quickly and efficiently, after their initial training? Here we take inspiration from the main mechanism of learning in biological brains: synaptic plasticity, carefully tuned by…

Neural and Evolutionary Computing · Computer Science 2018-08-01 Thomas Miconi , Jeff Clune , Kenneth O. Stanley

Biological synaptic transmission is unreliable, and this unreliability likely degrades neural circuit performance. While there are biophysical mechanisms that can increase reliability, for instance by increasing vesicle release probability,…

Neurons and Cognition · Quantitative Biology 2024-07-02 James Malkin , Cian O'Donnell , Conor Houghton , Laurence Aitchison

A growing literature in computational neuroscience leverages gradient descent and learning algorithms that approximate it to study synaptic plasticity in the brain. However, the vast majority of this work ignores a critical underlying…

Neurons and Cognition · Quantitative Biology 2024-03-06 Roman Pogodin , Jonathan Cornford , Arna Ghosh , Gauthier Gidel , Guillaume Lajoie , Blake Richards

Synaptic plasticity poses itself as a powerful method of self-regulated unsupervised learning in neural networks. A recent resurgence of interest has developed in utilizing Artificial Neural Networks (ANNs) together with synaptic plasticity…

Neural and Evolutionary Computing · Computer Science 2021-11-09 Samuel Schmidgall , Joe Hays

The plasticity of the conduction delay between neurons plays a fundamental role in learning. However, the exact underlying mechanisms in the brain for this modulation is still an open problem. Understanding the precise adjustment of…

Neural and Evolutionary Computing · Computer Science 2020-11-19 Alireza Nadafian , Mohammad Ganjtabesh

Biological neurons and their in-silico emulations for neuromorphic artificial intelligence (AI) use extraordinarily energy-efficient mechanisms, such as spike-based communication and local synaptic plasticity. It remains unclear whether…

Neural and Evolutionary Computing · Computer Science 2021-06-17 Timoleon Moraitis , Abu Sebastian , Evangelos Eleftheriou

Asynchrony, overlaps and delays in sensory-motor signals introduce ambiguity as to which stimuli, actions, and rewards are causally related. Only the repetition of reward episodes helps distinguish true cause-effect relationships from…

Neural and Evolutionary Computing · Computer Science 2014-09-10 Andrea Soltoggio

Synaptic plasticity is the capacity of a preexisting connection between two neurons to change in strength as a function of neural activity. Because synaptic plasticity is the major candidate mechanism for learning and memory, the…

Neurons and Cognition · Quantitative Biology 2015-05-05 Maurizio De Pittà , Nicolas Brunel , Andrea Volterra

Understanding how the brain learns to compute functions reliably, efficiently and robustly with noisy spiking activity is a fundamental challenge in neuroscience. Most sensory and motor tasks can be described as dynamical systems and could…

Neurons and Cognition · Quantitative Biology 2017-05-24 Sophie Denève , Alireza Alemi , Ralph Bourdoukan

A steadily increasing body of evidence suggests that the brain performs probabilistic inference to interpret and respond to sensory input and that trial-to-trial variability in neural activity plays an important role. The neural sampling…

Neurons and Cognition · Quantitative Biology 2017-07-07 Ilja Bytschok , Dominik Dold , Johannes Schemmel , Karlheinz Meier , Mihai A. Petrovici

The plasticity property of biological neural networks allows them to perform learning and optimize their behavior by changing their configuration. Inspired by biology, plasticity can be modeled in artificial neural networks by using Hebbian…

Neural and Evolutionary Computing · Computer Science 2020-12-21 Anil Yaman , Giovanni Iacca , Decebal Constantin Mocanu , George Fletcher , Mykola Pechenizkiy

We formulate the search for phenomenological models of synaptic plasticity as an optimization problem. We employ Cartesian genetic programming to evolve biologically plausible human-interpretable plasticity rules that allow a given network…

Neural and Evolutionary Computing · Computer Science 2021-02-09 Henrik D. Mettler , Maximilian Schmidt , Walter Senn , Mihai A. Petrovici , Jakob Jordan

Learning and memory in the brain are implemented by complex, time-varying changes in neural circuitry. The computational rules according to which synaptic weights change over time are the subject of much research, and are not precisely…

Machine Learning · Statistics 2014-11-18 Scott W. Linderman , Christopher H. Stock , Ryan P. Adams

The adaptive changes in synaptic efficacy that occur between spiking neurons have been demonstrated to play a critical role in learning for biological neural networks. Despite this source of inspiration, many learning focused applications…

Neural and Evolutionary Computing · Computer Science 2022-05-30 Samuel Schmidgall , Julia Ashkanazy , Wallace Lawson , Joe Hays

In this article we intoduce a novel stochastic Hebb-like learning rule for neural networks that is neurobiologically motivated. This learning rule combines features of unsupervised (Hebbian) and supervised (reinforcement) learning and is…

Disordered Systems and Neural Networks · Physics 2009-11-11 Frank Emmert-Streib

Bayesian inference allows machine learning models to express uncertainty. Current machine learning models use only a single learnable parameter combination when making predictions, and as a result are highly overconfident when their…

Machine Learning · Computer Science 2022-02-23 Andrew Wood , Moshik Hershcovitch , Daniel Waddington , Sarel Cohen , Peter Chin