中文
相关论文

相关论文: BC-IRL: Learning Generalizable Reward Functions fr…

200 篇论文

Inverse reinforcement learning (IRL) is the problem of inferring the reward function of an agent, given its policy or observed behavior. Analogous to RL, IRL is perceived both as a problem and as a class of methods. By categorically…

机器学习 · 计算机科学 2020-11-19 Saurabh Arora , Prashant Doshi

We present the problem of inverse constraint learning (ICL), which recovers constraints from demonstrations to autonomously reproduce constrained skills in new scenarios. However, ICL suffers from an ill-posed nature, leading to inaccurate…

机器人学 · 计算机科学 2023-12-11 Jaehwi Jang , Minjae Song , Daehyung Park

An inverse reinforcement learning (IRL) agent learns to act intelligently by observing expert demonstrations and learning the expert's underlying reward function. Although learning the reward functions from demonstrations has achieved great…

人工智能 · 计算机科学 2022-02-28 Wei Gao , David Hsu , Wee Sun Lee

We study inverse reinforcement learning (IRL) and imitation learning (IM), the problems of recovering a reward or policy function from expert's demonstrated trajectories. We propose a new way to improve the learning process by adding a…

机器学习 · 计算机科学 2022-08-23 The Viet Bui , Tien Mai , Patrick Jaillet

Inverse Reinforcement Learning (IRL) describes the problem of learning an unknown reward function of a Markov Decision Process (MDP) from observed behavior of an agent. Since the agent's behavior originates in its policy and MDP policies…

人工智能 · 计算机科学 2016-04-14 Michael Herman , Tobias Gindele , Jörg Wagner , Felix Schmitt , Wolfram Burgard

Imitation learning methods seek to learn from an expert either through behavioral cloning (BC) of the policy or inverse reinforcement learning (IRL) of the reward. Such methods enable agents to learn complex tasks from humans that are…

机器学习 · 计算机科学 2023-12-07 Joe Watson , Sandy H. Huang , Nicolas Heess

Inverse Reinforcement Learning (IRL) is the problem of finding a reward function which describes observed/known expert behavior. The IRL setting is remarkably useful for automated control, in situations where the reward function is…

机器学习 · 计算机科学 2022-09-12 Gregory Dexter , Kevin Bello , Jean Honorio

We study the problem of generalizing an expert agent's behavior, provided through demonstrations, to new environments and/or additional constraints. Inverse Reinforcement Learning (IRL) offers a promising solution by seeking to recover the…

机器学习 · 计算机科学 2025-09-16 Filippo Lazzati , Alberto Maria Metelli

Multi-task Inverse Reinforcement Learning (IRL) is the problem of inferring multiple reward functions from expert demonstrations. Prior work, built on Bayesian IRL, is unable to scale to complex environments due to computational…

机器学习 · 计算机科学 2018-07-17 Adam Gleave , Oliver Habryka

The goal of the Inverse reinforcement learning (IRL) task is to identify the underlying reward function and the corresponding optimal policy from a set of expert demonstrations. While most IRL algorithms' theoretical guarantees rely on a…

机器学习 · 统计学 2025-03-25 Ruijia Zhang , Siliang Zeng , Chenliang Li , Alfredo Garcia , Mingyi Hong

Inverse reinforcement learning (IRL) learns a reward function and a corresponding policy that best fit the demonstration data of an expert. However, in the current IRL setting, the learner is isolated from the expert and can only passively…

机器学习 · 计算机科学 2026-05-12 Yue Mao , Shicheng Liu , Siyuan Xu , Minghui Zhu

Extrapolating beyond-demonstrator (BD) performance through the imitation learning (IL) algorithm aims to learn from and subsequently outperform the demonstrator. To that end, a representative approach is to leverage inverse reinforcement…

机器学习 · 计算机科学 2022-02-28 Mingqi Yuan , Mao-on Pun

In robotic systems, the performance of reinforcement learning depends on the rationality of predefined reward functions. However, manually designed reward functions often lead to policy failures due to inaccuracies. Inverse Reinforcement…

机器人学 · 计算机科学 2025-09-12 Yongkai Tian , Yirong Qi , Xin Yu , Wenjun Wu , Jie Luo

Inverse Reinforcement Learning (IRL) aims to facilitate a learner's ability to imitate expert behavior by acquiring reward functions that explain the expert's decisions. Regularized IRL applies strongly convex regularizers to the learner's…

机器学习 · 计算机科学 2020-12-04 Wonseok Jeon , Chen-Yang Su , Paul Barde , Thang Doan , Derek Nowrouzezahrai , Joelle Pineau

Inverse Reinforcement Learning (IRL) -- the problem of learning reward functions from demonstrations of an \emph{expert policy} -- plays a critical role in developing intelligent systems. While widely used in applications, theoretical…

机器学习 · 统计学 2024-02-13 Lei Zhao , Mengdi Wang , Yu Bai

Reinforcement learning in complex environments is a challenging problem. In particular, the success of reinforcement learning algorithms depends on a well-designed reward function. Inverse reinforcement learning (IRL) solves the problem of…

机器学习 · 计算机科学 2021-01-20 Rakhoon Hwang , Hanjin Lee , Hyung Ju Hwang

Inverse Reinforcement Learning (IRL) techniques deal with the problem of deducing a reward function that explains the behavior of an expert agent who is assumed to act optimally in an underlying unknown task. In several problems of…

机器学习 · 计算机科学 2024-01-09 Riccardo Poiani , Gabriele Curti , Alberto Maria Metelli , Marcello Restelli

Inverse Reinforcement Learning (IRL) is attractive in scenarios where reward engineering can be tedious. However, prior IRL algorithms use on-policy transitions, which require intensive sampling from the current policy for stable and…

机器学习 · 计算机科学 2022-05-24 Hana Hoshino , Kei Ota , Asako Kanezaki , Rio Yokota

Inverse reinforcement learning (IRL) aims to learn a reward function and a corresponding policy that best fit the demonstrated trajectories of an expert. However, current IRL works cannot learn incrementally from an ongoing trajectory…

机器学习 · 计算机科学 2025-07-24 Shicheng Liu , Minghui Zhu

Often times in imitation learning (IL), the environment we collect expert demonstrations in and the environment we want to deploy our learned policy in aren't exactly the same (e.g. demonstrations collected in simulation but deployment in…

神经与进化计算 · 计算机科学 2024-06-19 Silvia Sapora , Gokul Swamy , Chris Lu , Yee Whye Teh , Jakob Nicolaus Foerster