English
Related papers

Related papers: Evolving Decomposed Plasticity Rules for Informati…

200 papers

In this paper, we derive a new model of synaptic plasticity, based on recent algorithms for reinforcement learning (in which an agent attempts to learn appropriate actions to maximize its long-term average reward). We show that these direct…

Machine Learning · Computer Science 2019-11-19 Peter L. Bartlett , Jonathan Baxter

Theoretical models of neuronal function consider different mechanisms through which networks learn, classify and discern inputs. A central focus of these models is to understand how associations are established amongst neurons, in order to…

Neurons and Cognition · Quantitative Biology 2015-05-19 Harold P. de Vladar , Eörs Szathmáry

Modern deep-learning systems are specialized to problem settings in which training occurs once and then never again, as opposed to continual-learning settings in which training occurs continually. If deep-learning systems are applied in a…

Machine Learning · Computer Science 2024-04-11 Shibhansh Dohare , J. Fernando Hernandez-Garcia , Parash Rahman , A. Rupam Mahmood , Richard S. Sutton

We present a novel stochastic Hebb-like learning rule for neural networks. This learning rule is stochastic with respect to the selection of the time points when a synaptic modification is induced by pre- and postsynaptic activation.…

Disordered Systems and Neural Networks · Physics 2007-05-23 Frank Emmert-Streib

Continual learning algorithms strive to acquire new knowledge while preserving prior information. Often, these algorithms emphasise stability and restrict network updates upon learning new tasks. In many cases, such restrictions come at a…

Machine Learning · Computer Science 2024-06-21 Daniel Anthes , Sushrut Thorat , Peter König , Tim C. Kietzmann

Learning and the ability to learn are important factors in development and evolutionary processes [1]. Depending on the level, the complexity of learning can strongly vary. While associative learning can explain simple learning behaviour…

Neurons and Cognition · Quantitative Biology 2007-05-23 Reimer Kuehn , Ion-Olimpiu Stamatescu

Plasticity, the ability of a neural network to quickly change its predictions in response to new information, is essential for the adaptability and robustness of deep reinforcement learning systems. Deep neural networks are known to lose…

Machine Learning · Computer Science 2023-11-28 Clare Lyle , Zeyu Zheng , Evgenii Nikishin , Bernardo Avila Pires , Razvan Pascanu , Will Dabney

Catastrophic forgetting/interference is a critical problem for lifelong learning machines, which impedes the agents from maintaining their previously learned knowledge while learning new tasks. Neural networks, in particular, suffer plenty…

Neural and Evolutionary Computing · Computer Science 2019-03-15 Soheil Kolouri , Nicholas Ketz , Xinyun Zou , Jeffrey Krichmar , Praveen Pilly

The state-of-the art machine learning approach to training deep neural networks, backpropagation, is implausible for real neural networks: neurons need to know their outgoing weights; training alternates between a bottom-up forward pass…

Machine Learning · Computer Science 2020-10-26 Roman Pogodin , Peter E. Latham

Existing adaptive bias techniques, which seek to estimate free energies and physical properties from molecular simulations, are limited by their reliance on fixed kernels or basis sets which hinder their ability to efficiently conform to…

Statistical Mechanics · Physics 2018-04-04 Hythem Sidky , Jonathan K. Whitmer

Plasticity Loss is an increasingly important phenomenon that refers to the empirical observation that as a neural network is continually trained on a sequence of changing tasks, its ability to adapt to a new task diminishes over time. We…

Machine Learning · Computer Science 2025-09-30 Vivek F. Farias , Adam D. Jozefiak

Behavioral changes in animals and humans, as a consequence of an error or a verbal instruction, can be extremely rapid. Improvement in behavioral performances are usually associated in machine learning and reinforcement learning to synaptic…

Neurons and Cognition · Quantitative Biology 2025-03-12 Cristiano Capone , Luca Falorsi

Continual learning has become a trending topic in machine learning. Recent studies have discovered an interesting phenomenon called loss of plasticity, referring to neural networks gradually losing the ability to learn new tasks. However,…

Machine Learning · Computer Science 2026-02-11 Tianhui Liu , Lili Mou

Associative networks theory is increasingly providing tools to interpret update rules of artificial neural networks. At the same time, deriving neural learning rules from a solid theory remains a fundamental challenge. We make some steps in…

Neurons and Cognition · Quantitative Biology 2025-03-27 Daniele Lotito

Sleep plays an important role in incremental learning and consolidation of memories in biological systems. Motivated by the processes that are known to be involved in sleep generation in biological networks, we developed an algorithm that…

Neural and Evolutionary Computing · Computer Science 2019-08-07 Giri P Krishnan , Timothy Tadros , Ramyaa Ramyaa , Maxim Bazhenov

Humans and other animals are capable of improving their learning performance as they solve related tasks from a given problem domain, to the point of being able to learn from extremely limited data. While synaptic plasticity is generically…

Machine Learning · Computer Science 2022-10-04 Nicolas Zucchet , Simon Schug , Johannes von Oswald , Dominic Zhao , João Sacramento

The loss of plasticity in learning agents, analogous to the solidification of neural pathways in biological brains, significantly impedes learning and adaptation in reinforcement learning due to its non-stationary nature. To address this…

Machine Learning · Computer Science 2025-06-03 Jiashun Liu , Johan Obando-Ceron , Aaron Courville , Ling Pan

Efficient representation learning is essential for optimal information storage and classification. However, it is frequently overlooked in artificial neural networks (ANNs). This neglect results in networks that can become overparameterized…

Machine Learning · Computer Science 2026-03-03 Patrick Stricker , Florian Röhrbein , Andreas Knoblauch

Lifelong learning capabilities are crucial for artificial autonomous agents operating on real-world data, which is typically non-stationary and temporally correlated. In this work, we demonstrate that dynamically grown networks outperform…

Neural and Evolutionary Computing · Computer Science 2018-12-03 German I. Parisi , Xu Ji , Stefan Wermter

The plasticity of the conduction delay between neurons plays a fundamental role in learning. However, the exact underlying mechanisms in the brain for this modulation is still an open problem. Understanding the precise adjustment of…

Neural and Evolutionary Computing · Computer Science 2020-11-19 Alireza Nadafian , Mohammad Ganjtabesh