English
Related papers

Related papers: Biologically inspired learning in a layered neural…

200 papers

A recurrent neural net is described that learns a set of patterns in the presence of noise. The learning rule is of Hebbian type, and, if noise would be absent during the learning process, the resulting final values of the weights would…

Disordered Systems and Neural Networks · Physics 2009-11-07 W A van Leeuwen , B Wemmenhove

Hebbian theory seeks to explain how the neurons in the brain adapt to stimuli, to enable learning. An interesting feature of Hebbian learning is that it is an unsupervised method and as such, does not require feedback, making it suitable in…

Neurons and Cognition · Quantitative Biology 2022-06-07 Jakub Fil , Neil Dalchau , Dominique Chu

Humans can learn languages from remarkably little experience. Developing computational models that explain this ability has been a major challenge in cognitive science. Bayesian models that build in strong inductive biases - factors that…

Computation and Language · Computer Science 2023-05-25 R. Thomas McCoy , Thomas L. Griffiths

How can we build agents that keep learning from experience, quickly and efficiently, after their initial training? Here we take inspiration from the main mechanism of learning in biological brains: synaptic plasticity, carefully tuned by…

Neural and Evolutionary Computing · Computer Science 2018-08-01 Thomas Miconi , Jeff Clune , Kenneth O. Stanley

Learning to follow human instructions is a long-pursued goal in artificial intelligence. The task becomes particularly challenging if no prior knowledge of the employed language is assumed while relying only on a handful of examples to…

Computation and Language · Computer Science 2019-04-03 Rezka Leonandya , Elia Bruni , Dieuwke Hupkes , Germán Kruszewski

Convolutional networks are ubiquitous in deep learning. They are particularly useful for images, as they reduce the number of parameters, reduce training time, and increase accuracy. However, as a model of the brain they are seriously…

Machine Learning · Computer Science 2022-01-19 Roman Pogodin , Yash Mehta , Timothy P. Lillicrap , Peter E. Latham

The fundamental `plasticity' of the nervous system (i.e high adaptability at different structural levels) is primarily based on Hebbian learning mechanisms that modify the synaptic connections. The modifications rely on neural activity and…

Adaptation and Self-Organizing Systems · Physics 2008-06-24 Gabor Szirtes , Zsolt Palotai , Andras Lorincz

The research presented in this paper advances the integration of Hebbian learning into Convolutional Neural Networks (CNNs) for image processing, systematically exploring different architectures to build an optimal configuration, adhering…

Neural and Evolutionary Computing · Computer Science 2026-05-05 Julian Jimenez Nimmo , Esther Mondragon

Animals can learn efficiently from a single experience and change their future behavior in response. However, in other instances, animals learn very slowly, requiring thousands of experiences. Here I survey tasks involving fast and slow…

Neurons and Cognition · Quantitative Biology 2022-05-05 Markus Meister

Learning in the brain is poorly understood and learning rules that respect biological constraints, yet yield deep hierarchical representations, are still unknown. Here, we propose a learning rule that takes inspiration from neuroscience and…

Neural and Evolutionary Computing · Computer Science 2021-10-27 Bernd Illing , Jean Ventura , Guillaume Bellec , Wulfram Gerstner

Learning based on networks of real neurons, and by extension biologically inspired models of neural networks, has yet to find general learning rules leading to widespread applications. In this paper, we argue for the existence of a…

Neural and Evolutionary Computing · Computer Science 2019-02-19 Lana Sinapayen , Atsushi Masumori , Takashi Ikegami

Materials and machines are often designed with particular goals in mind, so that they exhibit desired responses to given forces or constraints. Here we explore an alternative approach, namely physical coupled learning. In this paradigm, the…

Soft Condensed Matter · Physics 2021-09-07 Menachem Stern , Daniel Hexner , Jason W. Rocks , Andrea J. Liu

Neural networks that can capture key principles underlying brain computation offer exciting new opportunities for developing artificial intelligence and brain-like computing algorithms. Such networks remain biologically plausible while…

Neural and Evolutionary Computing · Computer Science 2025-01-10 Naresh Ravichandran , Anders Lansner , Pawel Herman

Neural networks with synaptic weights constructed according to the weighted Hebb rule, a variant of the familiar Hebb rule, are studied in the presence of noise(finite temperature), when the number of stored patterns is finite and in the…

Condensed Matter · Physics 2009-10-22 Caren Marzban , Raju Viswanathan

We present a mathematical analysis of the effects of Hebbian learning in random recurrent neural networks, with a generic Hebbian learning rule including passive forgetting and different time scales for neuronal activity and learning…

Chaotic Dynamics · Physics 2008-04-07 Benoit Siri , Hugues Berry , Bruno Cessac , Bruno Delord , Mathias Quoy

Physical networks, such as biological neural networks, can learn desired functions without a central processor, using local learning rules in space and time to learn in a fully distributed manner. Learning approaches such as equilibrium…

Disordered Systems and Neural Networks · Physics 2022-05-17 Menachem Stern , Sam Dillavou , Marc Z. Miskin , Douglas J. Durian , Andrea J. Liu

We show that deep networks can be trained using Hebbian updates yielding similar performance to ordinary back-propagation on challenging image datasets. To overcome the unrealistic symmetry in connections between layers, implicit in…

Neural and Evolutionary Computing · Computer Science 2019-03-14 Yali Amit

We study a simple learning model based on the Hebb rule to cope with "delayed", unspecific reinforcement. In spite of the unspecific nature of the information-feedback, convergence to asymptotically perfect generalization is observed, with…

Statistical Mechanics · Physics 2009-10-31 Reimer Kuehn , Ion-Olimpiu Stamatescu

The plasticity property of biological neural networks allows them to perform learning and optimize their behavior by changing their configuration. Inspired by biology, plasticity can be modeled in artificial neural networks by using Hebbian…

Neural and Evolutionary Computing · Computer Science 2020-12-21 Anil Yaman , Giovanni Iacca , Decebal Constantin Mocanu , George Fletcher , Mykola Pechenizkiy

A recent breakthrough in biologically-plausible normative frameworks for dimensionality reduction is based upon the similarity matching cost function and the low-rank matrix approximation problem. Despite clear biological interpretation,…

Neurons and Cognition · Quantitative Biology 2025-06-09 Veronica Centorrino , Francesco Bullo , Giovanni Russo