中文
相关论文

相关论文: CoMI-IRL: Contrastive Multi-Intention Inverse Rein…

200 篇论文

Inverse Reinforcement Learning (IRL) has demonstrated effectiveness in a variety of imitation tasks. In this paper, we introduce an IRL framework designed to extract rewarding features from expert trajectories affected by delayed…

机器学习 · 计算机科学 2024-12-05 Simon Sinong Zhan , Qingyuan Wu , Zhian Ruan , Frank Yang , Philip Wang , Yixuan Wang , Ruochen Jiao , Chao Huang , Qi Zhu

Inverse reinforcement learning (IRL) methods infer an agent's reward function using demonstrations of expert behavior. A Bayesian IRL approach models a distribution over candidate reward functions, capturing a degree of uncertainty in the…

机器学习 · 计算机科学 2025-07-04 Aishwarya Mandyam , Didong Li , Jiayu Yao , Diana Cai , Andrew Jones , Barbara E. Engelhardt

This paper proposes an inverse reinforcement learning (IRL) framework to accelerate learning when the learner-teacher \textit{interaction} is \textit{limited} during training. Our setting is motivated by the realistic scenarios where a…

机器学习 · 计算机科学 2020-07-02 Martin Troussard , Emmanuel Pignat , Parameswaran Kamalaruban , Sylvain Calinon , Volkan Cevher

In this work, we study an inverse reinforcement learning (IRL) problem where the experts are planning under a shared reward function but with different, unknown planning horizons. Without the knowledge of discount factors, the reward…

机器学习 · 计算机科学 2024-09-27 Jiayu Yao , Weiwei Pan , Finale Doshi-Velez , Barbara E Engelhardt

Inverse Reinforcement Learning infers a reward function from expert demonstrations, aiming to encode the behavior and intentions of the expert. Current approaches usually do this with generative and uni-modal models, meaning that they…

机器学习 · 计算机科学 2021-11-16 Niklas Freymuth , Philipp Becker , Gerhard Neumann

The goal of the inverse reinforcement learning (IRL) problem is to recover the reward functions from expert demonstrations. However, the IRL problem like any ill-posed inverse problem suffers the congenital defect that the policy may be…

机器学习 · 计算机科学 2022-09-26 Ce Ju

Inverse reinforcement learning (IRL) is the problem of learning the preferences of an agent from the observations of its behavior on a task. While this problem has been well investigated, the related problem of {\em online} IRL---where the…

机器学习 · 计算机科学 2020-11-19 Saurabh Arora , Prashant Doshi , Bikramjit Banerjee

Deep reinforcement learning achieves superhuman performance in a range of video game environments, but requires that a designer manually specify a reward function. It is often easier to provide demonstrations of a target behavior than to…

机器学习 · 计算机科学 2018-10-26 Aaron Tucker , Adam Gleave , Stuart Russell

The problem of inverse reinforcement learning (IRL) is relevant to a variety of tasks including value alignment and robot learning from demonstration. Despite significant algorithmic contributions in recent years, IRL remains an ill-posed…

机器学习 · 计算机科学 2020-11-18 Sreejith Balakrishnan , Quoc Phong Nguyen , Bryan Kian Hsiang Low , Harold Soh

Reinforcement learning (RL) has achieved tremendous success as a general framework for learning how to make decisions. However, this success relies on the interactive hand-tuning of a reward function by RL experts. On the other hand,…

机器学习 · 计算机科学 2020-11-24 Letian Chen , Rohan Paleja , Muyleng Ghuy , Matthew Gombolay

In the era of Industry 4.0 and smart manufacturing, process systems engineering must adapt to digital transformation. While reinforcement learning offers a model-free approach to process control, its applications are limited by the…

系统与控制 · 电气工程与系统科学 2025-05-28 Runze Lin , Junghui Chen , Biao Huang , Lei Xie , Hongye Su

Inverse Reinforcement Learning (IRL) learns an optimal policy, given some expert demonstrations, thus avoiding the need for the tedious process of specifying a suitable reward function. However, current methods are constrained by at least…

机器学习 · 计算机科学 2023-11-16 Pierre Le Pelletier de Woillemont , Rémi Labory , Vincent Corruble

Inverse Reinforcement Learning (IRL) is attractive in scenarios where reward engineering can be tedious. However, prior IRL algorithms use on-policy transitions, which require intensive sampling from the current policy for stable and…

机器学习 · 计算机科学 2022-05-24 Hana Hoshino , Kei Ota , Asako Kanezaki , Rio Yokota

Our goal is for agents to optimize the right reward function, despite how difficult it is for us to specify what that is. Inverse Reinforcement Learning (IRL) enables us to infer reward functions from demonstrations, but it usually assumes…

机器学习 · 计算机科学 2019-06-25 Rohin Shah , Noah Gundotra , Pieter Abbeel , Anca D. Dragan

Inverse reinforcement learning (IRL) aims to learn a reward function and a corresponding policy that best fit the demonstrated trajectories of an expert. However, current IRL works cannot learn incrementally from an ongoing trajectory…

机器学习 · 计算机科学 2025-07-24 Shicheng Liu , Minghui Zhu

In many sequential decision-making problems (e.g., robotics control, game playing, sequential prediction), human or expert data is available containing useful information about the task. However, imitation learning (IL) from a small amount…

机器学习 · 计算机科学 2022-11-04 Divyansh Garg , Shuvam Chakraborty , Chris Cundy , Jiaming Song , Matthieu Geist , Stefano Ermon

In this paper, we focus on the problem of inferring the underlying reward function of an expert given demonstrations, which is often referred to as inverse reinforcement learning (IRL). In particular, we propose a model-free density-based…

机器人学 · 计算机科学 2016-10-03 Sungjoon Choi , Kyungjae Lee , Andy Park , Songhwai Oh

Adversarial Imitation Learning (AIL) is a class of algorithms in Reinforcement learning (RL), which tries to imitate an expert without taking any reward from the environment and does not provide expert behavior directly to the policy…

机器学习 · 计算机科学 2020-05-05 Samin Yeasar Arnob

We consider the inverse reinforcement learning (IRL) problem, where an unknown reward function of some Markov decision process is estimated based on observed expert demonstrations. In most existing approaches, IRL is formulated and solved…

机器学习 · 计算机科学 2025-06-27 Hao Zhu , Yuan Zhang , Joschka Boedecker

Process rewards have been widely used in deep reinforcement learning to improve training efficiency, reduce variance, and prevent reward hacking. In LLM reasoning, existing works also explore various solutions for learning effective process…

机器学习 · 计算机科学 2026-05-21 Xian Wu , Kaijie Zhu , Ying Zhang , Lun Wang , Wenbo Guo