English
Related papers

Related papers: What model does MuZero learn?

200 papers

Accuracy and generalization of dynamics models is key to the success of model-based reinforcement learning (MBRL). As the complexity of tasks increases, so does the sample inefficiency of learning accurate dynamics models. However, many…

Machine Learning · Computer Science 2021-06-08 Manan Tomar , Amy Zhang , Roberto Calandra , Matthew E. Taylor , Joelle Pineau

In many contemporary applications such as healthcare, finance, robotics, and recommendation systems, continuous deployment of new policies for data collection and online learning is either cost ineffective or impractical. We consider a…

Machine Learning · Computer Science 2021-06-07 DiJia Su , Jason D. Lee , John M. Mulvey , H. Vincent Poor

Reinforcement learning (RL) is experiencing a resurgence in research interest, where Learning Classifier Systems (LCSs) have been applied for many years. However, traditional Michigan approaches tend to evolve large rule bases that are…

Machine Learning · Computer Science 2023-05-18 Jordan T. Bishop , Marcus Gallagher , Will N. Browne

Multi-task representation learning (MTRL) is an approach that learns shared latent representations across related tasks, facilitating collaborative learning that improves the overall learning efficiency. This paper studies MTRL for…

Machine Learning · Computer Science 2026-04-07 Yaoze Guo , Shana Moothedath

In reinforcement learning (RL), an autonomous agent learns to perform complex tasks by maximizing an exogenous reward signal while interacting with its environment. In real-world applications, test conditions may differ substantially from…

Robotics · Computer Science 2019-10-30 Matteo Turchetta , Andreas Krause , Sebastian Trimpe

In offline model-based reinforcement learning (offline MBRL), we learn a dynamic model from historically collected data, and subsequently utilize the learned model and fixed datasets for policy learning, without further interacting with the…

Machine Learning · Computer Science 2022-10-13 Shentao Yang , Shujian Zhang , Yihao Feng , Mingyuan Zhou

Decision-making agents with planning capabilities have achieved huge success in the challenging domain like Chess, Shogi, and Go. In an effort to generalize the planning ability to the more general tasks where the environment dynamics are…

Artificial Intelligence · Computer Science 2020-06-23 Xuxi Yang , Werner Duvaud , Peng Wei

Model-free deep reinforcement learning algorithms have been shown to be capable of learning a wide range of robotic skills, but typically require a very large number of samples to achieve good performance. Model-based algorithms, in…

Machine Learning · Computer Science 2017-12-05 Anusha Nagabandi , Gregory Kahn , Ronald S. Fearing , Sergey Levine

Top-performing Model-Based Reinforcement Learning (MBRL) agents, such as Dreamer, learn the world model by reconstructing the image observations. Hence, they often fail to discard task-irrelevant details and struggle to handle visual…

Machine Learning · Computer Science 2021-10-28 Fei Deng , Ingook Jang , Sungjin Ahn

Curiosity as a means to explore during reinforcement learning problems has recently become very popular. However, very little progress has been made in utilizing curiosity for learning control. In this work, we propose a model-based…

Robotics · Computer Science 2019-10-09 Sarah Bechtle , Yixin Lin , Akshara Rai , Ludovic Righetti , Franziska Meier

Reinforcement learning (RL) has shown great effectiveness in quadrotor control, enabling specialized policies to develop even human-champion-level performance in single-task scenarios. However, these specialized policies often struggle with…

Robotics · Computer Science 2024-12-18 Jiaxu Xing , Ismail Geles , Yunlong Song , Elie Aljalbout , Davide Scaramuzza

Learning in multi-agent systems is highly challenging due to several factors including the non-stationarity introduced by agents' interactions and the combinatorial nature of their state and action spaces. In particular, we consider the…

Machine Learning · Statistics 2023-05-10 Barna Pásztor , Ilija Bogunovic , Andreas Krause

Reinforcement Learning (RL) is an emerging approach to control many dynamical systems for which classical control approaches are not applicable or insufficient. However, the resultant policies may not generalize to variations in the…

Robotics · Computer Science 2023-11-13 Abdel Gafoor Haddad , Mohammed B. Mohiuddin , Igor Boiko , Yahya Zweiri

Offline reinforcement learning (RL) offers a powerful paradigm for data-driven control. Compared to model-free approaches, offline model-based RL (MBRL) explicitly learns a world model from a static dataset and uses it as a surrogate…

Machine Learning · Computer Science 2026-02-02 Jiayu Chen , Le Xu , Aravind Venugopal , Jeff Schneider

In recent years, a growing number of deep model-based reinforcement learning (RL) methods have been introduced. The interest in deep model-based RL is not surprising, given its many potential benefits, such as higher sample efficiency and…

Machine Learning · Computer Science 2022-06-28 Yi Wan , Ali Rahimi-Kalahroudi , Janarthanan Rajendran , Ida Momennejad , Sarath Chandar , Harm van Seijen

Visual Reinforcement Learning (RL) methods often require extensive amounts of data. As opposed to model-free RL, model-based RL (MBRL) offers a potential solution with efficient data utilization through planning. Additionally, RL lacks…

Machine Learning · Computer Science 2025-01-16 Moritz Schneider , Robert Krug , Narunas Vaskevicius , Luigi Palmieri , Joschka Boedecker

Model-based reinforcement learning (MBRL) has gained much attention for its ability to learn complex behaviors in a sample-efficient way: planning actions by generating imaginary trajectories with predicted rewards. Despite its success, we…

Machine Learning · Computer Science 2024-02-20 Vint Lee , Pieter Abbeel , Youngwoon Lee

We apply reinforcement learning (RL) to robotics tasks. One of the drawbacks of traditional RL algorithms has been their poor sample efficiency. One approach to improve the sample efficiency is model-based RL. In our model-based RL…

Machine Learning · Computer Science 2023-05-16 Adithya Ramesh , Balaraman Ravindran

Model-based reinforcement learning (MBRL) has recently gained immense interest due to its potential for sample efficiency and ability to incorporate off-policy data. However, designing stable and efficient MBRL algorithms using rich…

Machine Learning · Computer Science 2021-03-12 Aravind Rajeswaran , Igor Mordatch , Vikash Kumar

The uncertainty of distributed renewable energy brings significant challenges to economic operation of microgrids. Conventional online optimization approaches require a forecast model. However, accurately forecasting the renewable power…

Systems and Control · Electrical Eng. & Systems 2021-05-31 Hang Shuai , Haibo He