English
Related papers

Related papers: Embodied Synaptic Plasticity with Online Reinforce…

200 papers

Self-organized criticality has been proposed to be a universal mechanism for the emergence of scale-free dynamics in many complex systems, and possibly in the brain. While such scale-free patterns were identified experimentally in many…

Neurons and Cognition · Quantitative Biology 2021-05-11 Roxana Zeraati , Viola Priesemann , Anna Levina

How can we build agents that keep learning from experience, quickly and efficiently, after their initial training? Here we take inspiration from the main mechanism of learning in biological brains: synaptic plasticity, carefully tuned by…

Neural and Evolutionary Computing · Computer Science 2018-08-01 Thomas Miconi , Jeff Clune , Kenneth O. Stanley

The computational efficiency of the human brain is believed to stem from the parallel information processing capability of neurons with integrated storage in synaptic interconnections programmed by local spike triggered learning rules such…

Emerging Technologies · Computer Science 2020-03-17 S. R. Nandakumar , Bipin Rajendran

Continual learning with deep neural networks presents challenges distinct from both the fixed-dataset and convex continual learning regimes. One such challenge is plasticity loss, wherein a neural network trained in an online fashion…

Machine Learning · Computer Science 2024-11-04 Arthur Juliani , Jordan T. Ash

Synaptic plasticity is the capacity of a preexisting connection between two neurons to change in strength as a function of neural activity. Because synaptic plasticity is the major candidate mechanism for learning and memory, the…

Neurons and Cognition · Quantitative Biology 2015-05-05 Maurizio De Pittà , Nicolas Brunel , Andrea Volterra

Drawing upon the intuition that aligning different modalities to the same semantic embedding space would allow models to understand states and actions more easily, we propose a new perspective to the offline reinforcement learning (RL)…

Artificial Intelligence · Computer Science 2024-02-21 Tianyu Zheng , Ge Zhang , Xingwei Qu , Ming Kuang , Stephen W. Huang , Zhaofeng He

Developments in reinforcement learning (RL) have allowed algorithms to achieve impressive performance in highly complex, but largely static problems. In contrast, biological learning seems to value efficiency of adaptation to a…

Artificial Intelligence · Computer Science 2022-05-20 Eric Chalmers , Artur Luczak

Providing reinforcement learning agents with informationally rich human knowledge can dramatically improve various aspects of learning. Prior work has developed different kinds of shaping methods that enable agents to learn efficiently in…

Human-Computer Interaction · Computer Science 2018-11-13 Chao Yu , Tianpei Yang , Wenxuan Zhu , Dongxu wang , Guangliang Li

Deep brain stimulation (DBS) has shown great promise toward treating motor symptoms caused by Parkinson's disease (PD), by delivering electrical pulses to the Basal Ganglia (BG) region of the brain. However, DBS devices approved by the U.S.…

Continual learning algorithms strive to acquire new knowledge while preserving prior information. Often, these algorithms emphasise stability and restrict network updates upon learning new tasks. In many cases, such restrictions come at a…

Machine Learning · Computer Science 2024-06-21 Daniel Anthes , Sushrut Thorat , Peter König , Tim C. Kietzmann

Contrastive representation learning has emerged as a promising technique for continual learning as it can learn representations that are robust to catastrophic forgetting and generalize well to unseen future tasks. Previous work in…

Computer Vision and Pattern Recognition · Computer Science 2023-11-06 Rouzbeh Meshkinnejad , Jie Mei , Daniel Lizotte , Yalda Mohsenzadeh

In neuroscience, learning and memory are usually associated to long-term changes of neuronal connectivity. In this context, synaptic plasticity refers to the set of mechanisms driving the dynamics of neuronal connections, called {\em…

Probability · Mathematics 2021-06-10 Philippe Robert , Gaetan Vignoud

Artificial neural networks used for reinforcement learning are structurally rigid, meaning that each optimized parameter of the network is tied to its specific placement in the network structure. It also means that a network only works with…

Neural and Evolutionary Computing · Computer Science 2024-05-20 Joachim Winther Pedersen , Erwan Plantec , Eleni Nisioti , Milton Montero , Sebastian Risi

Cortical plasticity is one of the main features that enable our ability to learn and adapt in our environment. Indeed, the cerebral cortex self-organizes itself through structural and synaptic plasticity mechanisms that are very likely at…

Neural and Evolutionary Computing · Computer Science 2020-09-03 Lyes Khacef , Laurent Rodriguez , Benoit Miramond

Muscle-actuated organisms are capable of learning an unparalleled diversity of dexterous movements despite their vast amount of muscles. Reinforcement learning (RL) on large musculoskeletal models, however, has not been able to show similar…

Robotics · Computer Science 2023-04-28 Pierre Schumacher , Daniel Häufle , Dieter Büchler , Syn Schmitt , Georg Martius

We study offline meta-reinforcement learning, a practical reinforcement learning paradigm that learns from offline data to adapt to new tasks. The distribution of offline data is determined jointly by the behavior policy and the task.…

Machine Learning · Computer Science 2022-06-22 Haoqi Yuan , Zongqing Lu

Navigation foundation models trained on massive webscale data enable agents to generalize across diverse environments and embodiments. However, these models trained solely on offline data, often lack the capacity to reason about the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Honglin He , Yukai Ma , Wayne Wu , Bolei Zhou

Understanding and modeling animal behavior is essential for studying collective motion, decision-making, and bio-inspired robotics. Yet, evaluating the accuracy of behavioral models still often relies on offline comparisons to static…

Robotics · Computer Science 2026-05-20 Mathis Hocke , Andreas Gerken , David Bierbach , Jens Krause , Tim Landgraf

Clinical decision support must adapt online under safety constraints. We present an online adaptive tool where reinforcement learning provides the policy, a patient digital twin provides the environment, and treatment effect defines the…

Artificial Intelligence · Computer Science 2025-08-26 Xinyu Qin , Ruiheng Yu , Lu Wang

Despite the numerous advances, reinforcement learning remains away from widespread acceptance for autonomous controller design as compared to classical methods due to lack of ability to effectively tackle the reality gap. The reliance on…

Machine Learning · Computer Science 2024-09-23 Narendra Patwardhan , Zequn Wang