English
Related papers

Related papers: Embodied Synaptic Plasticity with Online Reinforce…

200 papers

Future developments in artificial intelligence will profit from the existence of novel, non-traditional substrates for brain-inspired computing. Neuromorphic computers aim to provide such a substrate that reproduces the brain's capabilities…

Neural and Evolutionary Computing · Computer Science 2019-10-02 Timo C. Wunderlich , Akos F. Kungl , Eric Müller , Johannes Schemmel , Mihai Petrovici

Grounding autonomous behavior in the nervous system is a fundamental challenge for neuroscience. In particular, the self-organized behavioral development provides more questions than answers. Are there special functional units for…

Robotics · Computer Science 2016-06-16 Ralf Der , Georg Martius

Controlling the flow and routing of data is a fundamental problem in many distributed networks, including transportation systems, integrated circuits, and the Internet. In the brain, synaptic plasticity rules have been discovered that…

Neural and Evolutionary Computing · Computer Science 2017-04-18 Jonathan Y. Suen , Saket Navlakha

Policy constraint methods to offline reinforcement learning (RL) typically utilize parameterization or regularization that constrains the policy to perform actions within the support set of the behavior policy. The elaborative designs of…

Machine Learning · Computer Science 2022-10-13 Jialong Wu , Haixu Wu , Zihan Qiu , Jianmin Wang , Mingsheng Long

The loss of plasticity in learning agents, analogous to the solidification of neural pathways in biological brains, significantly impedes learning and adaptation in reinforcement learning due to its non-stationary nature. To address this…

Machine Learning · Computer Science 2025-06-03 Jiashun Liu , Johan Obando-Ceron , Aaron Courville , Ling Pan

The plasticity of the conduction delay between neurons plays a fundamental role in learning. However, the exact underlying mechanisms in the brain for this modulation is still an open problem. Understanding the precise adjustment of…

Neural and Evolutionary Computing · Computer Science 2020-11-19 Alireza Nadafian , Mohammad Ganjtabesh

Neuromorphic hardware strives to emulate brain-like neural networks and thus holds the promise for scalable, low-power information processing on temporal data streams. Yet, to solve real-world problems, these networks need to be trained.…

Neural and Evolutionary Computing · Computer Science 2020-10-23 Friedemann Zenke , Emre O. Neftci

Normative models of synaptic plasticity use a combination of mathematics and computational simulations to arrive at predictions of behavioral and network-level adaptive phenomena. In recent years, there has been an explosion of theoretical…

Neurons and Cognition · Quantitative Biology 2023-08-10 Colin Bredenberg , Cristina Savin

The brain is a nonlinear and highly Recurrent Neural Network (RNN). This RNN is surprisingly plastic and supports our astonishing ability to learn and execute complex tasks. However, learning is incredibly complicated due to the brain's…

Neural and Evolutionary Computing · Computer Science 2023-03-14 Mohammad Modiri

Continual Reinforcement Learning (CRL) is essential for developing agents that can learn, adapt, and accumulate knowledge over time. However, a fundamental challenge persists as agents must strike a delicate balance between plasticity,…

Machine Learning · Computer Science 2025-03-11 Chengqi Zheng , Haiyan Yin , Jianda Chen , Terence Ng , Yew-Soon Ong , Ivor Tsang

Recurrent spiking neural networks (RSNN) in the human brain learn to perform a wide range of perceptual, cognitive and motor tasks very efficiently in terms of energy consumption and requires very few examples. This motivates the search for…

Neurons and Cognition · Quantitative Biology 2021-03-22 Paolo Muratore , Cristiano Capone , Pier Stanislao Paolucci

General results from statistical learning theory suggest to understand not only brain computations, but also brain plasticity as probabilistic inference. But a model for that has been missing. We propose that inherently stochastic features…

Neural and Evolutionary Computing · Computer Science 2016-02-17 David Kappel , Stefan Habenschuss , Robert Legenstein , Wolfgang Maass

Air hockey demands split-second decisions at high puck velocities, a challenge we address with a compact network of spiking neurons running on a mixed-signal analog/digital neuromorphic processor. By co-designing hardware and learning…

Continuous adaptation allows survival in an ever-changing world. Adjustments in the synaptic coupling strength between neurons are essential for this capability, setting us apart from simpler, hard-wired organisms. How these changes can be…

Neurons and Cognition · Quantitative Biology 2021-01-06 Jakob Jordan , Maximilian Schmidt , Walter Senn , Mihai A. Petrovici

The brain modifies its synaptic strengths during learning in order to better adapt to its environment. However, the underlying plasticity rules that govern learning are unknown. Many proposals have been suggested, including Hebbian…

Neurons and Cognition · Quantitative Biology 2020-12-09 Aran Nayebi , Sanjana Srivastava , Surya Ganguli , Daniel L. K. Yamins

Synaptic plasticity, the dynamic tuning of signal transmission strength between neurons, serves as a fundamental basis for memory and learning in biological organisms. This adaptive nature of synapses is considered one of the key features…

Mesoscale and Nanoscale Physics · Physics 2024-11-11 Yechan Noh , Alex Smolyanitsky

Interest in biologically inspired alternatives to backpropagation is driven by the desire to both advance connections between deep learning and neuroscience and address backpropagation's shortcomings on tasks such as online, continual…

Neural and Evolutionary Computing · Computer Science 2020-06-18 Jack Lindsey , Ashok Litwin-Kumar

While reinforcement learning (RL) holds great potential for decision making in the real world, it suffers from a number of unique difficulties which often need specific consideration. In particular: it is highly non-stationary; suffers from…

Machine Learning · Computer Science 2025-04-16 Alexander David Goldie , Chris Lu , Matthew Thomas Jackson , Shimon Whiteson , Jakob Nicolaus Foerster

The majority of research in both training Artificial Neural Networks (ANNs) and modeling learning in biological brains focuses on synaptic plasticity, where learning equates to changing the strength of existing connections. However, in…

Neural and Evolutionary Computing · Computer Science 2026-03-13 James C. Knight , Johanna Senk , Thomas Nowotny

Understanding how long-term stimulation reshapes neural circuits requires uncovering the rules of brain plasticity. While short-term synaptic modifications have been extensively characterized, the principles that drive circuit-level…

Neurons and Cognition · Quantitative Biology 2026-03-03 Zhichao Liang , Jingzhe Lin , Xinyi Li , Guanyi Zhao , Quanying Liu