English
Related papers

Related papers: Hebbian Attractor Networks for Robot Locomotion

200 papers

Rich, spontaneous brain activity has been observed across a range of different temporal and spatial scales. These dynamics are thought to be important t for efficient neural functioning. Experimental evidence suggests that these neural…

Neurons and Cognition · Quantitative Biology 2015-01-21 Peter J. Hellyer , Barbara Jachs , Robert Leech , Claudia Clopath

This work studies how brain-inspired neural ensembles equipped with local Hebbian plasticity can perform active inference (AIF) in order to control dynamical agents. A generative model capturing the environment dynamics is learned by a…

Neural and Evolutionary Computing · Computer Science 2023-06-23 Ali Safa , Tim Verbelen , Lars Keuninckx , Ilja Ocket , André Bourdoux , Francky Catthoor , Georges Gielen , Gert Cauwenberghs

Advances in neural computation have predominantly relied on the gradient backpropagation algorithm (BP). However, the recent shift towards non-stationary data modeling has highlighted the limitations of this heuristic, exposing that its…

Neural and Evolutionary Computing · Computer Science 2024-06-25 Erik B. Terres-Escudero , Javier Del Ser , Pablo García-Bringas

In this paper, we derive a new model of synaptic plasticity, based on recent algorithms for reinforcement learning (in which an agent attempts to learn appropriate actions to maximize its long-term average reward). We show that these direct…

Machine Learning · Computer Science 2019-11-19 Peter L. Bartlett , Jonathan Baxter

Learning in the brain is poorly understood and learning rules that respect biological constraints, yet yield deep hierarchical representations, are still unknown. Here, we propose a learning rule that takes inspiration from neuroscience and…

Neural and Evolutionary Computing · Computer Science 2021-10-27 Bernd Illing , Jean Ventura , Guillaume Bellec , Wulfram Gerstner

We introduce a model of generalized Hebbian learning and retrieval in oscillatory neural networks modeling cortical areas such as hippocampus and olfactory cortex. Recent experiments have shown that synaptic plasticity depends on spike…

Disordered Systems and Neural Networks · Physics 2007-05-23 Silvia Scarpetta , Zhaoping Li , John Hertz

Artificial neural networks have successfully tackled a large variety of problems by training extremely deep networks via back-propagation. A direct application of back-propagation to spiking neural networks contains biologically implausible…

Neural and Evolutionary Computing · Computer Science 2021-11-29 Kyle Daruwalla , Mikko Lipasti

We have recently shown that the statistical properties of goal directed reaching in human subjects depends on recent experience in a way that is consistent with the presence of adaptive Bayesian priors (Verstynen and Sabes, 2011). We also…

Disordered Systems and Neural Networks · Physics 2011-06-16 Timothy Verstynen , Philip N. Sabes

We show that deep networks can be trained using Hebbian updates yielding similar performance to ordinary back-propagation on challenging image datasets. To overcome the unrealistic symmetry in connections between layers, implicit in…

Neural and Evolutionary Computing · Computer Science 2019-03-14 Yali Amit

Attractor networks are an influential theory for memory storage in brain systems. This theory has recently been challenged by the observation of strong temporal variability in neuronal recordings during memory tasks. In this work, we study…

Neurons and Cognition · Quantitative Biology 2021-12-02 Ulises Pereira-Obilinovic , Johnatan Aljadeff , Nicolas Brunel

The research presented in this paper advances the integration of Hebbian learning into Convolutional Neural Networks (CNNs) for image processing, systematically exploring different architectures to build an optimal configuration, adhering…

Neural and Evolutionary Computing · Computer Science 2026-05-05 Julian Jimenez Nimmo , Esther Mondragon

The brain modifies its synaptic strengths during learning in order to better adapt to its environment. However, the underlying plasticity rules that govern learning are unknown. Many proposals have been suggested, including Hebbian…

Neurons and Cognition · Quantitative Biology 2020-12-09 Aran Nayebi , Sanjana Srivastava , Surya Ganguli , Daniel L. K. Yamins

Hebbian plasticity in winner-take-all (WTA) networks is highly attractive for neuromorphic on-chip learning, owing to its efficient, local, unsupervised, and on-line nature. Moreover, its biological plausibility may help overcome important…

Machine Learning · Computer Science 2023-08-03 Timoleon Moraitis , Dmitry Toichkin , Adrien Journé , Yansong Chua , Qinghai Guo

Modeling self-organization of neural networks for unsupervised learning using Hebbian and anti-Hebbian plasticity has a long history in neuroscience. Yet, derivations of single-layer networks with such local learning rules from principled…

Neurons and Cognition · Quantitative Biology 2017-12-22 Cengiz Pehlevan , Anirvan Sengupta , Dmitri B. Chklovskii

We present a mathematical analysis of the effects of Hebbian learning in random recurrent neural networks, with a generic Hebbian learning rule including passive forgetting and different time scales for neuronal activity and learning…

Chaotic Dynamics · Physics 2008-04-07 Benoit Siri , Hugues Berry , Bruno Cessac , Bruno Delord , Mathias Quoy

Since humans still outperform artificial neural networks on many tasks, drawing inspiration from the brain may help to improve current machine learning algorithms. Contrastive Hebbian Learning (CHL) and Equilibrium Propagation (EP) are…

Neural and Evolutionary Computing · Computer Science 2022-05-02 Yoshimasa Kubo , Eric Chalmers , Artur Luczak

The increasing penetration of wearable and implantable devices necessitates energy-efficient and robust ways of connecting them to each other and to the cloud. However, the wireless channel around the human body poses unique challenges such…

Networking and Internet Architecture · Computer Science 2020-06-25 Ali Moin , Arno Thielens , Alvaro Araujo , Alberto Sangiovanni-Vincentelli , Jan M. Rabaey

Recurrent neural networks in the chaotic regime exhibit complex dynamics reminiscent of high-level cortical activity during behavioral tasks. However, existing training methods for such networks are either biologically implausible, or…

Neurons and Cognition · Quantitative Biology 2015-12-09 Thomas Miconi

Brain plasticity refers to brain's ability to change neuronal connections, as a result of environmental stimuli, new experiences, or damage. In this work, we study the effects of the synaptic delay on both the coupling strengths and…

Neurons and Cognition · Quantitative Biology 2018-11-14 E. L. Lameu , E. E. N. Macau , F. S. Borges , K. C. Iarosz , I. L. Caldas , R. R. Borges , P. R. Protachevicz , R. L. Viana , A. M. Batista

The rapid growth of research in exploiting machine learning to predict chaotic systems has revived a recent interest in Hamiltonian Neural Networks (HNNs) with physical constraints defined by the Hamilton's equations of motion, which…

Machine Learning · Computer Science 2021-06-02 Chen-Di Han , Bryan Glaz , Mulugeta Haile , Ying-Cheng Lai