中文
相关论文

相关论文: Off-Dynamics Inverse Reinforcement Learning from H…

200 篇论文

Imitation learning (IL) is a framework that learns to imitate expert behavior from demonstrations. Recently, IL shows promising results on high dimensional and control tasks. However, IL typically suffers from sample inefficiency in terms…

机器学习 · 计算机科学 2021-11-24 Lihua Zhang

Driving behavior modeling is of great importance for designing safe, smart, and personalized autonomous driving systems. In this paper, an internal reward function-based driving model that emulates the human's decision-making mechanism is…

机器人学 · 计算机科学 2021-07-21 Zhiyu Huang , Jingda Wu , Chen Lv

Reinforcement learning is a promising framework for solving control problems, but its use in practical situations is hampered by the fact that reward functions are often difficult to engineer. Specifying goals and tasks for autonomous…

机器学习 · 计算机科学 2019-02-22 Justin Fu , Anoop Korattikara , Sergey Levine , Sergio Guadarrama

Autonomous agents optimize the reward function we give them. What they don't know is how hard it is for us to design a reward function that actually captures what we want. When designing the reward, we might think of some specific training…

人工智能 · 计算机科学 2020-10-08 Dylan Hadfield-Menell , Smitha Milli , Pieter Abbeel , Stuart Russell , Anca Dragan

Inverse reinforcement learning (IRL) addresses the problem of recovering a task description given a demonstration of the optimal policy used to solve such a task. The optimal policy is usually provided by an expert or teacher, making IRL…

机器学习 · 计算机科学 2012-02-09 Héctor Ratia , Luis Montesano , Ruben Martinez-Cantin

Inverse reinforcement learning (IRL) aims to explicitly infer an underlying reward function based on collected expert demonstrations. Considering that obtaining expert demonstrations can be costly, the focus of current IRL techniques is on…

机器学习 · 计算机科学 2023-10-16 Lu Li , Yuxin Pan , Ruobing Chen , Jie Liu , Zilin Wang , Yu Liu , Zhiheng Li

How well do reward functions learned with inverse reinforcement learning (IRL) generalize? We illustrate that state-of-the-art IRL algorithms, which maximize a maximum-entropy objective, learn rewards that overfit to the demonstrations.…

机器学习 · 计算机科学 2023-03-29 Andrew Szot , Amy Zhang , Dhruv Batra , Zsolt Kira , Franziska Meier

Imitation learning (IL) enables agents to acquire skills directly from expert demonstrations, providing a compelling alternative to reinforcement learning. However, prior online IL approaches struggle with complex tasks characterized by…

机器学习 · 计算机科学 2025-05-13 Shangzhe Li , Zhiao Huang , Hao Su

While reinforcement learning algorithms provide automated acquisition of optimal policies, practical application of such methods requires a number of design decisions, such as manually designing reward functions that not only define the…

机器学习 · 计算机科学 2022-12-29 Tim G. J. Rudner , Vitchyr H. Pong , Rowan McAllister , Yarin Gal , Sergey Levine

Imitation learning algorithms learn a policy from demonstrations of expert behavior. We show that, for deterministic experts, imitation learning can be done by reduction to reinforcement learning with a stationary reward. Our theoretical…

机器学习 · 统计学 2022-03-16 Kamil Ciosek

Learning from Demonstrations (LfD) and Reinforcement Learning (RL) have enabled robot agents to accomplish complex tasks. Reward Machines (RMs) enhance RL's capability to train policies over extended time horizons by structuring high-level…

机器人学 · 计算机科学 2024-12-16 Mattijs Baert , Sam Leroux , Pieter Simoens

The problem of Learning from Demonstration is targeted at learning to perform tasks based on observed examples. One approach to Learning from Demonstration is Inverse Reinforcement Learning, in which actions are observed to infer rewards.…

神经与进化计算 · 计算机科学 2016-08-11 Karan K. Budhraja , Tim Oates

Inverse reinforcement learning (IRL) is the problem of inferring the reward function of an agent, given its policy or observed behavior. Analogous to RL, IRL is perceived both as a problem and as a class of methods. By categorically…

机器学习 · 计算机科学 2020-11-19 Saurabh Arora , Prashant Doshi

Learning near-optimal behaviour from an expert's demonstrations typically relies on the assumption that the learner knows the features that the true reward function depends on. In this paper, we study the problem of learning from…

机器学习 · 计算机科学 2019-03-28 Luis Haug , Sebastian Tschiatschek , Adish Singla

In complex real-world tasks such as robotic manipulation and autonomous driving, collecting expert demonstrations is often more straightforward than specifying precise learning objectives and task descriptions. Learning from expert data can…

机器人学 · 计算机科学 2025-05-05 Daulet Baimukashev , Gokhan Alcan , Kevin Sebastian Luck , Ville Kyrki

Inverse reinforcement learning (IRL) learns a reward function and a corresponding policy that best fit the demonstration data of an expert. However, in the current IRL setting, the learner is isolated from the expert and can only passively…

机器学习 · 计算机科学 2026-05-12 Yue Mao , Shicheng Liu , Siyuan Xu , Minghui Zhu

Reinforcement Learning (RL) can effectively learn complex policies. However, learning these policies often demands extensive trial-and-error interactions with the environment. In many real-world scenarios, this approach is not practical due…

机器学习 · 计算机科学 2024-02-19 Linh Le Pham Van , Hung The Tran , Sunil Gupta

When a person is not satisfied with how a robot performs a task, they can intervene to correct it. Reward learning methods enable the robot to adapt its reward function online based on such human input, but they rely on handcrafted…

机器人学 · 计算机科学 2021-01-13 Andreea Bobu , Marius Wiggert , Claire Tomlin , Anca D. Dragan

Offline Reinforcement learning is commonly used for sequential decision-making in domains such as healthcare and education, where the rewards are known and the transition dynamics $T$ must be estimated on the basis of batch data. A key…

机器学习 · 计算机科学 2023-08-10 Leo Benac , Sonali Parbhoo , Finale Doshi-Velez

We present an adversarial active exploration for inverse dynamics model learning, a simple yet effective learning scheme that incentivizes exploration in an environment without any human intervention. Our framework consists of a deep…

机器学习 · 计算机科学 2020-03-18 Zhang-Wei Hong , Tsu-Jui Fu , Tzu-Yun Shann , Yi-Hsiang Chang , Chun-Yi Lee