中文
相关论文

相关论文: Model Imitation for Model-Based Reinforcement Lear…

200 篇论文

We study the problem of Reinforcement Learning (RL) using as few real-world samples as possible. A naive application of RL can be inefficient in large and continuous state spaces. We present two versions of Multi-Fidelity Reinforcement…

机器人学 · 计算机科学 2020-03-10 Varun Suryan , Nahush Gondhalekar , Pratap Tokekar

Imitation learning is an effective tool for robotic learning tasks where specifying a reinforcement learning (RL) reward is not feasible or where the exploration problem is particularly difficult. Imitation, typically behavior cloning or…

机器人学 · 计算机科学 2021-03-19 Yuxiang Zhou , Yusuf Aytar , Konstantinos Bousmalis

Reinforcement learning (RL) is a branch of machine learning which is employed to solve various sequential decision making problems without proper supervision. Due to the recent advancement of deep learning, the newly proposed Deep-RL…

人工智能 · 计算机科学 2019-04-17 Dhruv Ramani

Reinforcement learning (RL) methods have been shown to be capable of learning intelligent behavior in rich domains. However, this has largely been done in simulated domains without adequate focus on the process of building the simulator. In…

机器学习 · 计算机科学 2019-10-24 Aditya Modi , Nan Jiang , Ambuj Tewari , Satinder Singh

This work handles the inverse reinforcement learning (IRL) problem where only a small number of demonstrations are available from a demonstrator for each high-dimensional task, insufficient to estimate an accurate reward function. Observing…

人工智能 · 计算机科学 2017-10-16 Kun Li , Joel W. Burdick

Visual model-based reinforcement learning (MBRL) agents can perform well on the training distribution, but often break down once the test environment shifts. In visual MBRL, recognizing that a shift has occurred is often the easier part;…

机器学习 · 计算机科学 2026-05-01 Haiyang Zhao

Imitation learning (IL) is a popular paradigm for training policies in robotic systems when specifying the reward function is difficult. However, despite the success of IL algorithms, they impose the somewhat unrealistic requirement that…

Distribution and sample models are two popular model choices in model-based reinforcement learning (MBRL). However, learning these models can be intractable, particularly when the state and action spaces are large. Expectation models, on…

机器学习 · 计算机科学 2020-07-31 Yi Wan , Zaheer Abbas , Adam White , Martha White , Richard S. Sutton

Model-based reinforcement learning (MBRL) is a crucial approach to enhance the generalization capabilities and improve the sample efficiency of RL algorithms. However, current MBRL methods focus primarily on building world models for single…

机器学习 · 计算机科学 2025-11-11 Xuantang Xiong , Ni Mu , Runpeng Xie , Senhao Yang , Yaqing Wang , Lexiang Wang , Yao Luan , Siyuan Li , Shuang Xu , Yiqin Yang , Bo Xu

Meta-reinforcement learning (meta-RL) acquires meta-policies that show good performance for tasks in a wide task distribution. However, conventional meta-RL, which learns meta-policies by randomly sampling tasks, has been reported to show…

机器学习 · 计算机科学 2022-04-01 Morio Matsumoto , Hiroya Matsuba , Toshihiro Kujirai

Transfer of recent advances in deep reinforcement learning to real-world applications is hindered by high data demands and thus low efficiency and scalability. Through independent improvements of components such as replay buffers or more…

机器学习 · 计算机科学 2022-11-28 André Eberhard , Houssam Metni , Georg Fahland , Alexander Stroh , Pascal Friederich

In Reinforcement Learning (RL), it is commonly assumed that an immediate reward signal is generated for each action taken by the agent, helping the agent maximize cumulative rewards to obtain the optimal policy. However, in many real-world…

机器学习 · 计算机科学 2024-10-29 Yuting Tang , Xin-Qiang Cai , Yao-Xiang Ding , Qiyu Wu , Guoqing Liu , Masashi Sugiyama

We study reinforcement learning (RL) problems in which agents observe the reward or transition realizations at their current state before deciding which action to take. Such observations are available in many applications, including…

机器学习 · 计算机科学 2024-10-22 Nadav Merlis

Current imitation learning techniques are too restrictive because they require the agent and expert to share the same action space. However, oftentimes agents that act differently from the expert can solve the task just as good. For…

机器学习 · 计算机科学 2018-09-18 Nir Baram , Shie Mannor

Model-based reinforcement learning (RL) is anticipated to exhibit higher sample efficiency compared to model-free RL by utilizing a virtual environment model. However, it is challenging to obtain sufficiently accurate representations of the…

人工智能 · 计算机科学 2026-01-19 Zihao Sheng , Zilin Huang , Sikai Chen

The high sample complexity of reinforcement learning challenges its use in practice. A promising approach is to quickly adapt pre-trained policies to new environments. Existing methods for this policy adaptation problem typically rely on…

机器学习 · 计算机科学 2020-06-16 Yuda Song , Aditi Mavalankar , Wen Sun , Sicun Gao

A limitation of model-based reinforcement learning (MBRL) is the exploitation of errors in the learned models. Black-box models can fit complex dynamics with high fidelity, but their behavior is undefined outside of the data…

机器人学 · 计算机科学 2020-11-04 Michael Lutter , Johannes Silberbauer , Joe Watson , Jan Peters

Model-free reinforcement learning (RL) is a powerful, general tool for learning complex behaviors. However, its sample efficiency is often impractically large for solving challenging real-world problems, even with off-policy algorithms such…

机器学习 · 计算机科学 2020-02-25 Vitchyr Pong , Shixiang Gu , Murtaza Dalal , Sergey Levine

Sample efficiency has been one of the major challenges for deep reinforcement learning. Recently, model-based reinforcement learning has been proposed to address this challenge by performing planning on imaginary trajectories with a learned…

机器学习 · 计算机科学 2020-10-26 Guangxiang Zhu , Minghao Zhang , Honglak Lee , Chongjie Zhang

We present an online model-based reinforcement learning algorithm suitable for controlling complex robotic systems directly in the real world. Unlike prevailing sim-to-real pipelines that rely on extensive offline simulation and model-free…

机器人学 · 计算机科学 2026-05-07 Fang Nan , Hao Ma , Qinghua Guan , Josie Hughes , Michael Muehlebach , Marco Hutter