中文
相关论文

相关论文: Model-Based Imitation Learning Using Entropy Regul…

200 篇论文

Model-based reinforcement learning (MBRL) is believed to have much higher sample efficiency compared to model-free algorithms by learning a predictive model of the environment. However, the performance of MBRL highly relies on the quality…

机器学习 · 计算机科学 2022-11-16 Xin-Yang Liu , Jian-Xun Wang

In this paper, we present a Model-Based Reinforcement Learning (MBRL) algorithm named \emph{Monte Carlo Probabilistic Inference for Learning COntrol} (MC-PILCO). The algorithm relies on Gaussian Processes (GPs) to model the system dynamics…

In imitation learning, an agent learns how to behave in an environment with an unknown cost function by mimicking expert demonstrations. Existing imitation learning algorithms typically involve solving a sequence of planning or…

机器学习 · 计算机科学 2016-06-17 Jonathan Ho , Jayesh K. Gupta , Stefano Ermon

We study inverse reinforcement learning (IRL) and imitation learning (IM), the problems of recovering a reward or policy function from expert's demonstrated trajectories. We propose a new way to improve the learning process by adding a…

机器学习 · 计算机科学 2022-08-23 The Viet Bui , Tien Mai , Patrick Jaillet

Reinforcement Learning (RL) requires a large amount of exploration especially in sparse-reward settings. Imitation Learning (IL) can learn from expert demonstrations without exploration, but it never exceeds the expert's performance and is…

机器学习 · 计算机科学 2021-07-27 Ryoya Ogishima , Izumi Karino , Yasuo Kuniyoshi

A crucial design decision for any robot learning pipeline is the choice of policy representation: what type of model should be used to generate the next set of robot actions? Owing to the inherent multi-modal nature of many robotic tasks,…

机器人学 · 计算机科学 2023-09-13 Sumeet Singh , Stephen Tu , Vikas Sindhwani

Model-based reinforcement learning (MBRL) is recognized with the potential to be significantly more sample-efficient than model-free RL. How an accurate model can be developed automatically and efficiently from raw sensory inputs (such as…

机器人学 · 计算机科学 2023-05-24 Jun Lv , Yunhai Feng , Cheng Zhang , Shuang Zhao , Lin Shao , Cewu Lu

Energy-based models (EBMs) are powerful probabilistic models, but suffer from intractable sampling and density evaluation due to the partition function. As a result, inference in EBMs relies on approximate sampling algorithms, leading to a…

机器学习 · 计算机科学 2020-01-10 Dieterich Lawson , George Tucker , Bo Dai , Rajesh Ranganath

Imitation learning (IL) aims to learn a policy from expert demonstrations that minimizes the discrepancy between the learner and expert behaviors. Various imitation learning algorithms have been proposed with different pre-determined…

机器学习 · 计算机科学 2020-11-20 Xin Zhang , Yanhua Li , Ziming Zhang , Zhi-Li Zhang

We apply reinforcement learning (RL) to robotics tasks. One of the drawbacks of traditional RL algorithms has been their poor sample efficiency. One approach to improve the sample efficiency is model-based RL. In our model-based RL…

机器学习 · 计算机科学 2023-05-16 Adithya Ramesh , Balaraman Ravindran

Imitation learning is a widely used approach for training agents to replicate expert behavior in complex decision-making tasks. However, existing methods often struggle with compounding errors and limited generalization, due to the inherent…

机器学习 · 计算机科学 2025-04-21 Haldun Balim , Yang Hu , Yuyang Zhang , Na Li

Model-based reinforcement learning (MBRL) is a promising route to sample-efficient policy optimization. However, a known vulnerability of reconstruction-based MBRL consists of scenarios in which detailed aspects of the world are highly…

机器学习 · 计算机科学 2024-12-10 Miles Hutson , Isaac Kauvar , Nick Haber

Energy-Based Models (EBMs) present a flexible and appealing way to represent uncertainty. Despite recent advances, training EBMs on high-dimensional data remains a challenging problem as the state-of-the-art approaches are costly, unstable,…

机器学习 · 计算机科学 2021-06-08 Will Grathwohl , Jacob Kelly , Milad Hashemi , Mohammad Norouzi , Kevin Swersky , David Duvenaud

Model usage is the central challenge of model-based reinforcement learning. Although dynamics model based on deep neural networks provide good generalization for single step prediction, such ability is over exploited when it is used to…

机器学习 · 计算机科学 2020-06-30 Chi Zhang , Sanmukh Rao Kuppannagari , Viktor K Prasanna

Many real-life scenarios require humans to make difficult trade-offs: do we always follow all the traffic rules or do we violate the speed limit in an emergency? These scenarios force us to evaluate the trade-off between collective rules…

机器学习 · 计算机科学 2022-02-22 Arie Glazier , Andrea Loreggia , Nicholas Mattei , Taher Rahgooy , Francesca Rossi , Brent Venable

We present a new model-based reinforcement learning algorithm, Cooperative Prioritized Sweeping, for efficient learning in multi-agent Markov decision processes. The algorithm allows for sample-efficient learning on large problems by…

机器学习 · 计算机科学 2020-01-22 Eugenio Bargiacchi , Timothy Verstraeten , Diederik M. Roijers , Ann Nowé

Imitation learning demonstrates remarkable performance in various domains. However, imitation learning is also constrained by many prerequisites. The research community has done intensive research to alleviate these constraints, such as…

神经与进化计算 · 计算机科学 2023-01-19 Boyuan Zheng , Jianlong Zhou , Fang Chen

Model-based reinforcement learning methods learn a dynamics model with real data sampled from the environment and leverage it to generate simulated data to derive an agent. However, due to the potential distribution mismatch between…

机器学习 · 计算机科学 2020-10-29 Jian Shen , Han Zhao , Weinan Zhang , Yong Yu

Developing agents that can perform challenging complex tasks is the goal of reinforcement learning. The model-free reinforcement learning has been considered as a feasible solution. However, the state of the art research has been to develop…

机器学习 · 计算机科学 2020-08-24 MyungJae Shin , Joongheon Kim

Imitation learning (IL) and reinforcement learning (RL) each offer distinct advantages for robotics policy learning: IL provides stable learning from demonstrations, and RL promotes generalization through exploration. While existing robot…