English
Related papers

Related papers: Novelty Producing Synaptic Plasticity

200 papers

Lifelong learning and adaptability are two defining aspects of biological agents. Modern reinforcement learning (RL) approaches have shown significant progress in solving complex tasks, however once training is concluded, the found…

Neural and Evolutionary Computing · Computer Science 2022-04-20 Elias Najarro , Sebastian Risi

Brain-inspired machine intelligence research seeks to develop computational models that emulate the information processing and adaptability that distinguishes biological systems of neurons. This has led to the development of spiking neural…

Neural and Evolutionary Computing · Computer Science 2024-10-28 Alexander Ororbia

Short-term synaptic plasticity (STP) is often regarded as a presynaptic filter of spikes, independent of postsynaptic activity. Recent experiments, however, indicate an associative STP that depends on pre- and postsynaptic coactivation. We…

Neurons and Cognition · Quantitative Biology 2026-05-20 Genki Shimizu , Taro Toyoizumi

Plasticity, the ability of a neural network to quickly change its predictions in response to new information, is essential for the adaptability and robustness of deep reinforcement learning systems. Deep neural networks are known to lose…

Machine Learning · Computer Science 2023-11-28 Clare Lyle , Zeyu Zheng , Evgenii Nikishin , Bernardo Avila Pires , Razvan Pascanu , Will Dabney

The brain modifies its synaptic strengths during learning in order to better adapt to its environment. However, the underlying plasticity rules that govern learning are unknown. Many proposals have been suggested, including Hebbian…

Neurons and Cognition · Quantitative Biology 2020-12-09 Aran Nayebi , Sanjana Srivastava , Surya Ganguli , Daniel L. K. Yamins

The endeavor to understand the brain involves multiple collaborating research fields. Classically, synaptic plasticity rules derived by theoretical neuroscientists are evaluated in isolation on pattern classification tasks. This contrasts…

Spiking neural networks (SNN) are considered as a perspective basis for performing all kinds of learning tasks - unsupervised, supervised and reinforcement learning. Learning in SNN is implemented through synaptic plasticity - the rules…

Neural and Evolutionary Computing · Computer Science 2021-11-15 Mikhail Kiselev

Neural plasticity is an important functionality of human brain, in which number of neurons and synapses can shrink or expand in response to stimuli throughout the span of life. We model this dynamic learning process as an $L_0$-norm…

Neural and Evolutionary Computing · Computer Science 2021-05-04 Yang Li , Shihao Ji

Artificial neural networks (ANNs) are typically confined to accomplishing pre-defined tasks by learning a set of static parameters. In contrast, biological neural networks (BNNs) can adapt to various new tasks by continually updating the…

Artificial Intelligence · Computer Science 2022-09-20 Fan Wang , Hao Tian , Haoyi Xiong , Hua Wu , Jie Fu , Yang Cao , Yu Kang , Haifeng Wang

Many mathematical models of synaptic plasticity have been proposed to explain the diversity of plasticity phenomena observed in biological organisms. These models range from simple interpretations of Hebb's postulate, which suggests that…

Neurons and Cognition · Quantitative Biology 2025-08-05 Danil Tyulmankov

How do humans and animals perform trial-and-error learning when the space of possibilities is infinite? In a previous study, we used an interval timing production task and discovered an updating strategy in which the agent adjusted the…

Neurons and Cognition · Quantitative Biology 2022-05-10 Jing Wang , Yousuf El-Jayyousi , Ilker Ozden

To learn useful dynamics on long time scales, neurons must use plasticity rules that account for long-term, circuit-wide effects of synaptic changes. In other words, neural circuits must solve a credit assignment problem to appropriately…

Neurons and Cognition · Quantitative Biology 2019-05-30 Owen Marschall , Kyunghyun Cho , Cristina Savin

Biological neural networks are characterized by their high degree of plasticity, a core property that enables the remarkable adaptability of natural organisms. Importantly, this ability affects both the synaptic strength and the topology of…

Neural and Evolutionary Computing · Computer Science 2024-06-17 Erwan Plantec , Joachin W. Pedersen , Milton L. Montero , Eleni Nisioti , Sebastian Risi

Reinforcement Learning (RL) has made remarkable achievements, but it still suffers from inadequate exploration strategies, sparse reward signals, and deceptive reward functions. To alleviate these problems, a Population-guided Novelty…

Machine Learning · Computer Science 2021-10-12 Qihao Liu , Yujia Wang , Xiaofeng Liu

Competition between synapses arises in some forms of correlation-based plasticity. Here we propose a game theory-inspired model of synaptic interactions whose dynamics is driven by competition between synapses in their weak and strong…

Disordered Systems and Neural Networks · Physics 2011-10-19 Ajaz Ahmad Bhat , Gaurang Mahajan , Anita Mehta

General results from statistical learning theory suggest to understand not only brain computations, but also brain plasticity as probabilistic inference. But a model for that has been missing. We propose that inherently stochastic features…

Neural and Evolutionary Computing · Computer Science 2016-02-17 David Kappel , Stefan Habenschuss , Robert Legenstein , Wolfgang Maass

Reservoir Computing (RC) is an appealing approach in Machine Learning that combines the high computational capabilities of Recurrent Neural Networks with a fast and easy training method. Likewise, successful implementation of neuro-inspired…

Adaptation and Self-Organizing Systems · Physics 2021-07-13 Guillermo B. Morales , Claudio R. Mirasso , Miguel C. Soriano

In timing-based neural codes, neurons have to emit action potentials at precise moments in time. We use a supervised learning paradigm to derive a synaptic update rule that optimizes via gradient ascent the likelihood of postsynaptic firing…

Neurons and Cognition · Quantitative Biology 2007-05-23 Jean-Pascal Pfister , Taro Toyoizumi , David Barber , Wulfram Gerstner

We formulate the search for phenomenological models of synaptic plasticity as an optimization problem. We employ Cartesian genetic programming to evolve biologically plausible human-interpretable plasticity rules that allow a given network…

Neural and Evolutionary Computing · Computer Science 2021-02-09 Henrik D. Mettler , Maximilian Schmidt , Walter Senn , Mihai A. Petrovici , Jakob Jordan

A fundamental aspect of learning in biological neural networks is the plasticity property which allows them to modify their configurations during their lifetime. Hebbian learning is a biologically plausible mechanism for modeling the…

Neural and Evolutionary Computing · Computer Science 2021-03-16 Anil Yaman , Giovanni Iacca , Decebal Constantin Mocanu , Matt Coler , George Fletcher , Mykola Pechenizkiy