English
Related papers

Related papers: Model-Based Episodic Memory Induces Dynamic Hybrid…

200 papers

One of the key challenges in applying reinforcement learning to complex robotic control tasks is the need to gather large amounts of experience in order to find an effective policy for the task at hand. Model-based reinforcement learning…

Machine Learning · Computer Science 2016-08-12 Justin Fu , Sergey Levine , Pieter Abbeel

In this paper, we present a robotic model-based reinforcement learning method that combines ideas from model identification and model predictive control. We use a feature-based representation of the dynamics that allows the dynamics model…

Machine Learning · Computer Science 2016-03-16 Christopher Xie , Sachin Patil , Teodor Moldovan , Sergey Levine , Pieter Abbeel

Model-based Reinforcement Learning approaches have the promise of being sample efficient. Much of the progress in learning dynamics models in RL has been made by learning models via supervised learning. But traditional model-based…

Machine Learning · Computer Science 2019-06-12 Shagun Sodhani , Anirudh Goyal , Tristan Deleu , Yoshua Bengio , Sergey Levine , Jian Tang

The ability to learn and execute optimal control policies safely is critical to realization of complex autonomy, especially where task restarts are not available and/or the systems are safety-critical. Safety requirements are often…

Systems and Control · Electrical Eng. & Systems 2021-10-06 S M Nahid Mahmud , Moad Abudia , Scott A Nivison , Zachary I. Bell , Rushikesh Kamalapurkar

Typical methods to study cognitive function are to record the electrical activities of animal neurons during the training of animals performing behavioral tasks. A key problem is that they fail to record all the relevant neurons in the…

Neurons and Cognition · Quantitative Biology 2021-03-08 Xiaohan Zhang , Lu Liu , Guodong Long , Jing Jiang , Shenquan Liu

Many tasks require flexibly modifying perception and behavior based on current goals. Humans can retrieve episodic memories from days to years ago, using them to contextualize and generalize behaviors across novel but structurally related…

Neural and Evolutionary Computing · Computer Science 2025-12-22 Yicong Zheng , Nora Wolf , Charan Ranganath , Randall C. O'Reilly , Kevin L. McKee

Reinforcement learning has achieved remarkable success in robot learning. However, under challenging exploration and contact-rich dynamics, early-stage training is frequently dominated by premature terminations such as collisions and falls.…

Robotics · Computer Science 2026-03-10 Chenyang Miao

Experience-driven learning has emerged as a promising paradigm for enabling agents to improve from interaction trajectories by accumulating and reusing past experience. However, existing approaches are predominantly developed in textual…

Artificial Intelligence · Computer Science 2026-05-19 Xingyu Sui , Weixiang Zhao , Yongxin Tang , Yanyan Zhao , Yang Wu , Dandan Tu , Bing Qin

Effective decision-making in partially observable environments demands robust memory management. Despite their success in supervised learning, current deep-learning memory models struggle in reinforcement learning environments that are…

Machine Learning · Computer Science 2024-10-15 Hung Le , Kien Do , Dung Nguyen , Sunil Gupta , Svetha Venkatesh

Humans navigate unfamiliar environments using episodic simulation and episodic memory, which facilitate a deeper understanding of the complex relationships between environments and objects. Developing an imaginative memory system inspired…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Yiyuan Pan , Yunzhe Xu , Zhe Liu , Hesheng Wang

Online reinforcement learning agents are currently able to process an increasing amount of data by converting it into a higher order value functions. This expansion of the information collected from the environment increases the agent's…

Machine Learning · Computer Science 2021-02-04 Mirza Ramicic , Andrea Bonarini

In model-based reinforcement learning, generative and temporal models of environments can be leveraged to boost agent performance, either by tuning the agent's representations during training or via use as part of an explicit planning…

Reinforcement learning (RL) has driven breakthroughs in AI, from game-play to scientific discovery and AI alignment. However, its broader applicability remains limited by challenges such as low data efficiency and poor generalizability.…

Artificial Intelligence · Computer Science 2025-06-03 Xidong Yang , Wenhao Li , Junjie Sheng , Chuyun Shen , Yun Hua , Xiangfeng Wang

It is well-known that inverse dynamics models can improve tracking performance in robot control. These models need to precisely capture the robot dynamics, which consist of well-understood components, e.g., rigid body dynamics, and effects…

Robotics · Computer Science 2022-05-30 Moritz Reuss , Niels van Duijkeren , Robert Krug , Philipp Becker , Vaisakh Shaj , Gerhard Neumann

Accurately predicting the dynamics of robotic systems is crucial for model-based control and reinforcement learning. The most common way to estimate dynamics is by fitting a one-step ahead prediction model and using it to recursively…

Machine Learning · Computer Science 2021-09-02 Nathan O. Lambert , Albert Wilcox , Howard Zhang , Kristofer S. J. Pister , Roberto Calandra

As Large Language Models (LLMs) evolve from text-completion tools into fully fledged agents operating in dynamic environments, they must address the challenge of continually learning and retaining long-term knowledge. Many biological…

Artificial Intelligence · Computer Science 2025-02-12 Mathis Pink , Qinyuan Wu , Vy Ai Vo , Javier Turek , Jianing Mu , Alexander Huth , Mariya Toneva

We introduce a lifelong language learning setup where a model needs to learn from a stream of text examples without any dataset identifier. We propose an episodic memory model that performs sparse experience replay and local adaptation to…

Machine Learning · Computer Science 2019-11-27 Cyprien de Masson d'Autume , Sebastian Ruder , Lingpeng Kong , Dani Yogatama

In this paper, we propose an adaptive event-triggered reinforcement learning control for continuous-time nonlinear systems, subject to bounded uncertainties, characterized by complex interactions. Specifically, the proposed method is…

Machine Learning · Computer Science 2024-10-01 Umer Siddique , Abhinav Sinha , Yongcan Cao

Deep Deterministic Policy Gradient (DDPG) has been proved to be a successful reinforcement learning (RL) algorithm for continuous control tasks. However, DDPG still suffers from data insufficiency and training inefficiency, especially in…

Machine Learning · Computer Science 2019-03-05 Zhizheng Zhang , Jiale Chen , Zhibo Chen , Weiping Li

Model-Based Reinforcement Learning involves learning a \textit{dynamics model} from data, and then using this model to optimise behaviour, most often with an online \textit{planner}. Much of the recent research along these lines presents a…