English
Related papers

Related papers: Dream to Generalize: Zero-Shot Model-Based Reinfor…

200 papers

In the present paper, we propose a decoder-free extension of Dreamer, a leading model-based reinforcement learning (MBRL) method from pixels. Dreamer is a sample- and cost-efficient solution to robot learning, as it is used to train latent…

Machine Learning · Computer Science 2021-03-15 Masashi Okada , Tadahiro Taniguchi

Model-based reinforcement learning (MBRL) is a crucial approach to enhance the generalization capabilities and improve the sample efficiency of RL algorithms. However, current MBRL methods focus primarily on building world models for single…

Machine Learning · Computer Science 2025-11-11 Xuantang Xiong , Ni Mu , Runpeng Xie , Senhao Yang , Yaqing Wang , Lexiang Wang , Yao Luan , Siyuan Li , Shuang Xu , Yiqin Yang , Bo Xu

Model-based reinforcement learning (MBRL) improves sample efficiency by optimizing policies inside imagined rollouts, but long-horizon planning degrades when model errors compound and imagined trajectories drift off the training manifold.…

Machine Learning · Computer Science 2026-04-10 Prakul Sunil Hiremath

Training vision-based manipulation policies that are robust across diverse visual environments remains an important and unresolved challenge in robot learning. Current approaches often sidestep the problem by relying on invariant…

Robotics · Computer Science 2025-05-20 Sumeet Batra , Gaurav Sukhatme

Recent advancements in Model-Based Reinforcement Learning (MBRL) have made it a powerful tool for visual control tasks. Despite improved data efficiency, it remains challenging to train MBRL agents with generalizable perception. Training in…

Machine Learning · Computer Science 2024-10-15 Kyungmin Kim , JB Lanier , Pierre Baldi , Charless Fowlkes , Roy Fox

While recent model-free Reinforcement Learning (RL) methods have demonstrated human-level effectiveness in gaming environments, their success in everyday tasks like visual navigation has been limited, particularly under significant…

Machine Learning · Computer Science 2024-04-04 Rudra P. K. Poudel , Harit Pandya , Stephan Liwicki , Roberto Cipolla

While Reinforcement Learning (RL) has achieved remarkable success in language modeling, its triumph hasn't yet fully translated to visuomotor agents. A primary challenge in RL models is their tendency to overfit specific tasks or…

Robotics · Computer Science 2025-08-01 Shaofei Cai , Zhancun Mu , Haiwen Xia , Bowei Zhang , Anji Liu , Yitao Liang

Model-based reinforcement learning (RL) has shown great potential in various control tasks in terms of both sample-efficiency and final performance. However, learning a generalizable dynamics model robust to changes in dynamics remains a…

Machine Learning · Computer Science 2020-10-27 Younggyo Seo , Kimin Lee , Ignasi Clavera , Thanard Kurutach , Jinwoo Shin , Pieter Abbeel

Humans leverage rich internal models of the world to reason about the future, imagine counterfactuals, and adapt flexibly to new situations. In Reinforcement Learning (RL), world models aim to capture how the environment evolves in response…

Artificial Intelligence · Computer Science 2025-10-29 Léopold Maytié , Roland Bertin Johannet , Rufin VanRullen

Reinforcement learning (RL) promises a framework for near-universal problem-solving. In practice however, RL algorithms are often tailored to specific benchmarks, relying on carefully tuned hyperparameters and algorithmic choices. Recently,…

Machine Learning · Computer Science 2025-01-28 Scott Fujimoto , Pierluca D'Oro , Amy Zhang , Yuandong Tian , Michael Rabbat

Learning policies that can generalize to unseen environments is a fundamental challenge in visual reinforcement learning (RL). While most current methods focus on acquiring robust visual representations through auxiliary supervision,…

Machine Learning · Computer Science 2023-12-29 Ziyu Wang , Yanjie Ze , Yifei Sun , Zhecheng Yuan , Huazhe Xu

Model-based Reinforcement Learning (MBRL) has emerged as a promising paradigm for autonomous driving, where data efficiency and robustness are critical. Yet, existing solutions often rely on carefully crafted, task specific extrinsic…

Robotics · Computer Science 2025-03-10 Feeza Khan Khanzada , Jaerock Kwon

Learning generalizable policies that can adapt to unseen environments remains challenging in visual Reinforcement Learning (RL). Existing approaches try to acquire a robust representation via diversifying the appearances of in-domain…

Machine Learning · Computer Science 2022-12-20 Zhecheng Yuan , Zhengrong Xue , Bo Yuan , Xueqian Wang , Yi Wu , Yang Gao , Huazhe Xu

A central challenge in image-based Model-Based Reinforcement Learning (MBRL) is to learn representations that distill essential information from irrelevant visual details. While promising, reconstruction-based methods often waste capacity…

Machine Learning · Computer Science 2026-03-23 Naoki Morihira , Amal Nahar , Kartik Bharadwaj , Yasuhiro Kato , Akinobu Hayashi , Tatsuya Harada

Deep reinforcement learning (DRL) has been proven to be a powerful paradigm for learning complex control policy autonomously. Numerous recent applications of DRL in robotic grasping have successfully trained DRL robotic agents end-to-end,…

Robotics · Computer Science 2020-07-03 Zhixin Chen , Mengxiang Lin , Zhixin Jia , Shibo Jian

Model-based reinforcement learning (MBRL) offers an intuitive way to increase the sample efficiency of model-free RL methods by simultaneously training a world model that learns to predict the future. These models constitute the large…

Artificial Intelligence · Computer Science 2025-12-19 Ashish Sundar , Chunbo Luo , Xiaoyang Wang

A critical bottleneck in deep reinforcement learning (DRL) is sample inefficiency, as training high-performance agents often demands extensive environmental interactions. Model-based reinforcement learning (MBRL) mitigates this by building…

Machine Learning · Computer Science 2025-09-30 Boxuan Zhang , Runqing Wang , Wei Xiao , Weipu Zhang , Jian Sun , Gao Huang , Jie Chen , Gang Wang

In this paper, we deal with the reality gap from a novel perspective, targeting transferring Deep Reinforcement Learning (DRL) policies learned in simulated environments to the real-world domain for visual control tasks. Instead of adopting…

Robotics · Computer Science 2019-01-17 Jingwei Zhang , Lei Tai , Peng Yun , Yufeng Xiong , Ming Liu , Joschka Boedecker , Wolfram Burgard

We present a generic and flexible Reinforcement Learning (RL) based meta-learning framework for the problem of few-shot learning. During training, it learns the best optimization algorithm to produce a learner (ranker/classifier, etc) by…

Machine Learning · Computer Science 2020-05-05 Raviteja Anantha , Stephen Pulman , Srinivas Chappidi

Model-based reinforcement learning (MBRL) is recognized with the potential to be significantly more sample-efficient than model-free RL. How an accurate model can be developed automatically and efficiently from raw sensory inputs (such as…

Robotics · Computer Science 2023-05-24 Jun Lv , Yunhai Feng , Cheng Zhang , Shuang Zhao , Lin Shao , Cewu Lu