English
Related papers

Related papers: A Backpropagation-Free Feedback-Hebbian Network fo…

200 papers

Deep Convolutional Neural Networks (CNNs) achieve high accuracy but often rely on purely global, gradient-based optimisation, which can lead to overfitting, redundant filters, and reduced interpretability. To address these limitations, we…

Machine Learning · Computer Science 2025-08-28 Davorin Miličević , Ratko Grbić

Understanding how biological neural networks are shaped via local plasticity mechanisms can lead to energy-efficient and self-adaptive information processing systems, which promises to mitigate some of the current roadblocks in edge…

Neural and Evolutionary Computing · Computer Science 2025-04-10 Willian Soares Girão , Nicoletta Risi , Elisabetta Chicca

It has been demonstrated that one of the most striking features of the nervous system, the so called 'plasticity' (i.e high adaptability at different structural levels) is primarily based on Hebbian learning which is a collection of…

Adaptation and Self-Organizing Systems · Physics 2007-05-23 G. Szirtes , Zs. Palotai , A. Lorincz

Modeling self-organization of neural networks for unsupervised learning using Hebbian and anti-Hebbian plasticity has a long history in neuroscience. Yet, derivations of single-layer networks with such local learning rules from principled…

Neurons and Cognition · Quantitative Biology 2017-12-22 Cengiz Pehlevan , Anirvan Sengupta , Dmitri B. Chklovskii

The current leading computer vision models are typically feed forward neural models, in which the output of one computational block is passed to the next one sequentially. This is in sharp contrast to the organization of the primate visual…

Computer Vision and Pattern Recognition · Computer Science 2019-10-25 Barak Battash , Lior Wolf

Much has been learned about plasticity of biological synapses from empirical studies. Hebbian plasticity is driven by correlated activity of presynaptic and postsynaptic neurons. Synapses that converge onto the same neuron often behave as…

Neural and Evolutionary Computing · Computer Science 2017-04-04 H. Sebastian Seung , Jonathan Zung

Advances in neural computation have predominantly relied on the gradient backpropagation algorithm (BP). However, the recent shift towards non-stationary data modeling has highlighted the limitations of this heuristic, exposing that its…

Neural and Evolutionary Computing · Computer Science 2024-06-25 Erik B. Terres-Escudero , Javier Del Ser , Pablo García-Bringas

Biological neural networks learn complex behaviors from sparse, delayed feedback using local synaptic plasticity, yet the mechanisms enabling structured credit assignment remain elusive. In contrast, artificial recurrent networks solving…

Neurons and Cognition · Quantitative Biology 2025-12-12 Dimitra Maoutsa

While advances in artificial intelligence and neuroscience have enabled the emergence of neural networks capable of learning a wide variety of tasks, our understanding of the temporal dynamics of these networks remains limited. Here, we…

Neurons and Cognition · Quantitative Biology 2023-11-13 Shi Gu , Marcelo G Mattar , Huajin Tang , Gang Pan

State-of-the-art backpropagation-free learning methods employ local error feedback to direct iterative optimisation via gradient descent. Here, we examine the more restrictive setting where retrograde communication from neuronal outputs is…

Machine Learning · Computer Science 2025-12-19 Robert O'Shea , Bipin Rajendran

Continual Learning aims to bring machine learning into a more realistic scenario, where tasks are learned sequentially and the i.i.d. assumption is not preserved. Although this setting is natural for biological systems, it proves very…

Neural and Evolutionary Computing · Computer Science 2022-07-12 Paweł Morawiecki , Andrii Krutsylo , Maciej Wołczyk , Marek Śmieja

Backpropagation of error (backprop) is a powerful algorithm for training machine learning architectures through end-to-end differentiation. However, backprop is often criticised for lacking biological plausibility. Recently, it has been…

Machine Learning · Computer Science 2020-10-07 Beren Millidge , Alexander Tschantz , Christopher L. Buckley

When an object moves smoothly across a field of view, the identify of the object is unchanged, but the activation pattern of the photoreceptors on the retina changes drastically. One of the major computational roles of our visual system is…

Neurons and Cognition · Quantitative Biology 2014-04-23 Minjoon Kouh

Imagine a robot controller with the ability to adapt like human synapses, dynamically rewiring itself to overcome unforeseen challenges in real time. This paper proposes a novel zero-shot adaptation mechanism for evolutionary robotics,…

Robotics · Computer Science 2025-08-06 Hamze Hammami , Eva Denisa Barbulescu , Talal Shaikh , Mouayad Aldada , Muhammad Saad Munawar

How can neural networks learn to efficiently represent complex and high-dimensional inputs via local plasticity mechanisms? Classical models of representation learning assume that input weights are learned via pairwise Hebbian-like…

Neurons and Cognition · Quantitative Biology 2022-10-04 Fabian Alexander Mikulasch , Lucas Rudelt , Viola Priesemann

Reservoir computing is a powerful tool to explain how the brain learns temporal sequences, such as movements, but existing learning schemes are either biologically implausible or too inefficient to explain animal performance. We show that a…

Neurons and Cognition · Quantitative Biology 2019-10-24 Roman Pogodin , Dane Corneil , Alexander Seeholzer , Joseph Heng , Wulfram Gerstner

A feed-forward neural net with adaptable synaptic weights and fixed, zero or non-zero threshold potentials is studied, in the presence of a global feedback signal that can only have two values, depending on whether the output of the network…

Disordered Systems and Neural Networks · Physics 2009-11-10 J. Bedaux , W. A. van Leeuwen

Learning in artificial neural networks usually relies on continuous, externally driven weight updates, in which parameters are modified at every step in response to incoming data, error signals or reward feedback. In this setting, routine…

Neurons and Cognition · Quantitative Biology 2026-05-13 Arturo Tozzi

Many mathematical models of synaptic plasticity have been proposed to explain the diversity of plasticity phenomena observed in biological organisms. These models range from simple interpretations of Hebb's postulate, which suggests that…

Neurons and Cognition · Quantitative Biology 2025-08-05 Danil Tyulmankov

Humans can learn several tasks in succession with minimal mutual interference but perform more poorly when trained on multiple tasks at once. The opposite is true for standard deep neural networks. Here, we propose novel computational…

Neurons and Cognition · Quantitative Biology 2022-09-07 Timo Flesch , David G. Nagy , Andrew Saxe , Christopher Summerfield