English
Related papers

Related papers: Bridging Imagination and Reality for Model-Based D…

200 papers

Model-based reinforcement learning (RL) can be effectively supported at scale through the use of world models. However, in practice, scaling such approaches remains fundamentally limited. A commonly recognized challenge is model bias and…

Machine Learning · Computer Science 2026-05-27 Xiaoyuan Cheng , Wenxuan Yuan , Zhancun Mu , Yuanzhao Zhang , Yiming Yang , Hai Wang , Zhuo Sun , Che Liu

Designing effective model-based reinforcement learning algorithms is difficult because the ease of data generation must be weighed against the bias of model-generated data. In this paper, we study the role of model usage in policy…

Machine Learning · Computer Science 2021-11-30 Michael Janner , Justin Fu , Marvin Zhang , Sergey Levine

Existing imitation learning (IL) methods such as inverse reinforcement learning (IRL) usually have a double-loop training process, alternating between learning a reward function and a policy and tend to suffer long training time and high…

Machine Learning · Computer Science 2022-06-13 Siwei Chen , Xiao Ma , Zhongwen Xu

Deep reinforcement learning provides a promising approach for vision-based control of real-world robots. However, the generalization of such models depends critically on the quantity and variety of data available for training. This data can…

Machine Learning · Computer Science 2019-02-12 Katie Kang , Suneel Belkhale , Gregory Kahn , Pieter Abbeel , Sergey Levine

We propose a novel approach to addressing two fundamental challenges in Model-based Reinforcement Learning (MBRL): the computational expense of repeatedly finding a good policy in the learned model, and the objective mismatch between model…

Machine Learning · Computer Science 2023-03-02 Anirudh Vemula , Yuda Song , Aarti Singh , J. Andrew Bagnell , Sanjiban Choudhury

Model-free control strategies such as reinforcement learning have shown the ability to learn control strategies without requiring an accurate model or simulator of the world. While this is appealing due to the lack of modeling requirements,…

Robotics · Computer Science 2024-06-28 Marius Memmel , Andrew Wagenmaker , Chuning Zhu , Patrick Yin , Dieter Fox , Abhishek Gupta

Reinforcement learning (RL) is well known for requiring large amounts of data in order for RL agents to learn to perform complex tasks. Recent progress in model-based RL allows agents to be much more data-efficient, as it enables them to…

Machine Learning · Computer Science 2021-08-17 Remo Sasso , Matthia Sabatelli , Marco A. Wiering

We develop a hybrid control approach for robot learning based on combining learned predictive models with experience-based state-action policy mappings to improve the learning capabilities of robotic systems. Predictive models provide an…

Robotics · Computer Science 2020-06-09 Ian Abraham , Alexander Broad , Allison Pinosky , Brenna Argall , Todd D. Murphey

Bike-sharing systems play a crucial role in easing traffic congestion and promoting healthier lifestyles. However, ensuring their reliability and user acceptance requires effective strategies for rebalancing bikes. This study introduces a…

Machine Learning · Computer Science 2024-06-04 Jiaqi Liang , Defeng Liu , Sanjay Dominik Jena , Andrea Lodi , Thibaut Vidal

Model-free Reinforcement Learning (RL) offers an attractive approach to learn control policies for high-dimensional systems, but its relatively poor sample complexity often forces training in simulated environments. Even in simulation,…

Robotics · Computer Science 2018-09-18 Boris Ivanovic , James Harrison , Apoorva Sharma , Mo Chen , Marco Pavone

Objective: This paper describes the development of hybrid artificial intelligence strategies for drone navigation. Methods: The navigation module combines a deep learning model with a rule-based engine depending on the agent state. The deep…

Artificial Intelligence · Computer Science 2025-01-09 Rubén San-Segundo , Lucía Angulo , Manuel Gil-Martín , David Carramiñana , Ana M. Bernardos

Multimodal recommendation focuses primarily on effectively exploiting both behavioral and multimodal information for the recommendation task. However, most existing models suffer from the following issues when fusing information from two…

Information Retrieval · Computer Science 2024-09-10 Kangning Zhang , Yingjie Qin , Jiarui Jin , Yifan Liu , Ruilong Su , Weinan Zhang , Yong Yu

Reinforcement learning (RL) algorithms can be divided into two classes: model-free algorithms, which are sample-inefficient, and model-based algorithms, which suffer from model bias. Dyna-style algorithms combine these two approaches by…

Machine Learning · Computer Science 2024-10-17 Yansong Li , Zeyu Dong , Ertai Luo , Yu Wu , Shuo Wu , Shuo Han

Although reinforcement learning (RL) can provide reliable solutions in many settings, practitioners are often wary of the discrepancies between the RL solution and their status quo procedures. Therefore, they may be reluctant to adapt to…

Machine Learning · Computer Science 2019-06-03 Mohammadreza Nazari , Majid Jahani , Lawrence V. Snyder , Martin Takáč

Despite the high performance achieved by deep neural networks on various tasks, extensive studies have demonstrated that small tweaks in the input could fail the model predictions. This issue of deep neural networks has led to a number of…

Machine Learning · Computer Science 2022-02-22 Ming-Chang Chiu , Xuezhe Ma

Several researchers have recently investigated the connection between reinforcement learning and classification. We are motivated by proposals of approximate policy iteration schemes without value functions which focus on policy…

Machine Learning · Computer Science 2008-07-06 Christos Dimitrakakis , Michail G. Lagoudakis

Although reinforcement learning methods offer a powerful framework for automatic skill acquisition, for practical learning-based control problems in domains such as robotics, imitation learning often provides a more convenient and…

Artificial Intelligence · Computer Science 2024-03-20 Jianlan Luo , Perry Dong , Yuexiang Zhai , Yi Ma , Sergey Levine

The application of learning-based control methods in robotics presents significant challenges. One is that model-free reinforcement learning algorithms use observation data with low sample efficiency. To address this challenge, a prevalent…

Machine Learning · Computer Science 2024-07-19 Andrey Gorodetskiy , Konstantin Mironov , Aleksandr Panov

Deep reinforcement learning (RL) provides powerful methods for training optimal sequential decision-making agents. As collecting real-world interactions can entail additional costs and safety risks, the common paradigm of sim2real conducts…

Artificial Intelligence · Computer Science 2023-12-11 Minqi Jiang

One major obstacle that precludes the success of reinforcement learning in real-world applications is the lack of robustness, either to model uncertainties or external disturbances, of the trained policies. Robustness is critical when the…

Machine Learning · Computer Science 2020-05-05 Rahul Singh , Qinsheng Zhang , Yongxin Chen