中文
相关论文

相关论文: Inverse Reinforcement Learning via Convex Optimiza…

200 篇论文

Inverse Reinforcement Learning (IRL) aims to reconstruct the reward function from expert demonstrations to facilitate policy learning, and has demonstrated its remarkable success in imitation learning. To promote expert-like behavior,…

机器学习 · 计算机科学 2023-06-16 Shunyu Liu , Yunpeng Qing , Shuqi Xu , Hongyan Wu , Jiangtao Zhang , Jingyuan Cong , Tianhao Chen , Yunfu Liu , Mingli Song

Inverse Reinforcement Learning (IRL) is the task of learning a single reward function given a Markov Decision Process (MDP) without defining the reward function, and a set of demonstrations generated by humans/experts. However, in practice,…

人工智能 · 计算机科学 2017-12-18 Siddharthan Rajasekaran , Jinwei Zhang , Jie Fu

The classic Reinforcement Learning (RL) formulation concerns the maximization of a scalar reward function. More recently, convex RL has been introduced to extend the RL formulation to all the objectives that are convex functions of the…

机器学习 · 计算机科学 2023-01-30 Mirco Mutti , Riccardo De Santi , Piersilvio De Bartolomeis , Marcello Restelli

Learning from expert demonstrations to flexibly program an autonomous system with complex behaviors or to predict an agent's behavior is a powerful tool, especially in collaborative control settings. A common method to solve this problem is…

系统与控制 · 电气工程与系统科学 2024-05-15 Samuel Tesfazgi , Leonhard Sprandl , Armin Lederer , Sandra Hirche

Inverse reinforcement learning (IRL) is the problem of learning the preferences of an agent from the observations of its behavior on a task. While this problem has been well investigated, the related problem of {\em online} IRL---where the…

机器学习 · 计算机科学 2020-11-19 Saurabh Arora , Prashant Doshi , Bikramjit Banerjee

Inverse reinforcement learning (IRL) aims to learn a reward function and a corresponding policy that best fit the demonstrated trajectories of an expert. However, current IRL works cannot learn incrementally from an ongoing trajectory…

机器学习 · 计算机科学 2025-07-24 Shicheng Liu , Minghui Zhu

Given a dataset of expert demonstrations, inverse reinforcement learning (IRL) aims to recover a reward for which the expert is optimal. This work proposes a model-free algorithm to solve entropy-regularized IRL problem. In particular, we…

机器学习 · 计算机科学 2025-03-04 Titouan Renard , Andreas Schlaginhaufen , Tingting Ni , Maryam Kamgarpour

A significant challenge for the practical application of reinforcement learning in the real world is the need to specify an oracle reward function that correctly defines a task. Inverse reinforcement learning (IRL) seeks to avoid this…

机器学习 · 计算机科学 2019-10-16 Kelvin Xu , Ellis Ratner , Anca Dragan , Sergey Levine , Chelsea Finn

We propose a reinforcement learning (RL) framework under a broad class of risk objectives, characterized by convex scoring functions. This class covers many common risk measures, such as variance, Expected Shortfall, entropic Value-at-Risk,…

数理金融 · 定量金融 2025-05-16 Shanyu Han , Yang Liu , Xiang Yu

We introduce inverse reinforcement learning (IRL) as an effective paradigm for training abstractive summarization models, imitating human summarization behaviors. Our IRL model estimates the reward function using a suite of important…

计算与语言 · 计算机科学 2023-12-06 Yu Fu , Deyi Xiong , Yue Dong

The problem of inverse reinforcement learning (IRL) is relevant to a variety of tasks including value alignment and robot learning from demonstration. Despite significant algorithmic contributions in recent years, IRL remains an ill-posed…

机器学习 · 计算机科学 2020-11-18 Sreejith Balakrishnan , Quoc Phong Nguyen , Bryan Kian Hsiang Low , Harold Soh

The aim of Inverse Reinforcement Learning (IRL) is to infer a reward function $R$ from a policy $\pi$. To do this, we need a model of how $\pi$ relates to $R$. In the current literature, the most common models are optimality, Boltzmann…

机器学习 · 计算机科学 2023-03-27 Joar Skalse , Alessandro Abate

Providing a suitable reward function to reinforcement learning can be difficult in many real world applications. While inverse reinforcement learning (IRL) holds promise for automatically learning reward functions from demonstrations,…

机器学习 · 计算机科学 2019-10-29 Lantao Yu , Tianhe Yu , Chelsea Finn , Stefano Ermon

When deploying Reinforcement Learning (RL) agents into a physical system, we must ensure that these agents are well aware of the underlying constraints. In many real-world problems, however, the constraints are often hard to specify…

机器学习 · 计算机科学 2023-03-03 Guiliang Liu , Yudong Luo , Ashish Gaurav , Kasra Rezaee , Pascal Poupart

Inverse Reinforcement Learning (IRL) is a powerful framework for learning complex behaviors from expert demonstrations. However, it traditionally requires repeatedly solving a computationally expensive reinforcement learning (RL) problem in…

机器学习 · 计算机科学 2024-02-09 David Wu , Gokul Swamy , J. Andrew Bagnell , Zhiwei Steven Wu , Sanjiban Choudhury

Inverse Reinforcement Learning (IRL) -- the problem of learning reward functions from demonstrations of an \emph{expert policy} -- plays a critical role in developing intelligent systems. While widely used in applications, theoretical…

机器学习 · 统计学 2024-02-13 Lei Zhao , Mengdi Wang , Yu Bai

As AI systems become increasingly autonomous, aligning their decision-making to human preferences is essential. In domains like autonomous driving or robotics, it is impossible to write down the reward function representing these…

In this paper, we formulate inverse reinforcement learning (IRL) as an expert-learner interaction whereby the optimal performance intent of an expert or target agent is unknown to a learner agent. The learner observes the states and…

机器学习 · 计算机科学 2023-01-06 Wenqian Xue , Bosen Lian , Jialu Fan , Tianyou Chai , Frank L. Lewis

Explicit engineering of reward functions for given environments has been a major hindrance to reinforcement learning methods. While Inverse Reinforcement Learning (IRL) is a solution to recover reward functions from demonstrations only,…

机器学习 · 计算机科学 2020-02-24 David Venuto , Jhelum Chakravorty , Leonard Boussioux , Junhao Wang , Gavin McCracken , Doina Precup

While Reinforcement Learning (RL) aims to train an agent from a reward function in a given environment, Inverse Reinforcement Learning (IRL) seeks to recover the reward function from observing an expert's behavior. It is well known that, in…

机器学习 · 计算机科学 2022-10-14 Paul Rolland , Luca Viano , Norman Schuerhoff , Boris Nikolov , Volkan Cevher