中文
相关论文

相关论文: Malliavin Calculus for Counterfactual Gradient Est…

200 篇论文

We study inverse reinforcement learning (IRL) and imitation learning (IM), the problems of recovering a reward or policy function from expert's demonstrated trajectories. We propose a new way to improve the learning process by adding a…

机器学习 · 计算机科学 2022-08-23 The Viet Bui , Tien Mai , Patrick Jaillet

Inverse reinforcement learning (IRL) seeks to infer a cost function that explains the underlying goals and preferences of expert demonstrations. This paper presents receding horizon inverse reinforcement learning (RHIRL), a new IRL…

机器学习 · 计算机科学 2022-10-18 Yiqing Xu , Wei Gao , David Hsu

Inverse reinforcement learning (IRL) is a powerful paradigm for uncovering the incentive structure that drives agent behavior, by inferring an unknown reward function from observed trajectories within a Markov decision process (MDP).…

The inverse reinforcement learning approach to imitation learning is a double-edged sword. On the one hand, it can enable learning from a smaller number of expert demonstrations with more robustness to error compounding than behavioral…

机器学习 · 计算机科学 2024-06-06 Juntao Ren , Gokul Swamy , Zhiwei Steven Wu , J. Andrew Bagnell , Sanjiban Choudhury

In online Inverse Reinforcement Learning (IRL), the learner can collect samples about the dynamics of the environment to improve its estimate of the reward function. Since IRL suffers from identifiability issues, many theoretical works on…

机器学习 · 计算机科学 2024-10-10 Filippo Lazzati , Mirco Mutti , Alberto Maria Metelli

Sampling algorithms drive probabilistic machine learning, and recent years have seen an explosion in the diversity of tools for this task. However, the increasing sophistication of sampling algorithms is correlated with an increase in the…

统计计算 · 统计学 2025-07-02 Congye Wang , Matthew A. Fisher , Heishiro Kanagawa , Wilson Chen , Chris. J. Oates

Reward functions are difficult to design and often hard to align with human intent. Preference-based Reinforcement Learning (RL) algorithms address these problems by learning reward functions from human feedback. However, the majority of…

机器学习 · 计算机科学 2023-11-28 Joey Hejna , Dorsa Sadigh

Inverse reinforcement learning (IRL) aims to explain observed strategic behavior by fitting reinforcement learning models to behavioral data. However, traditional IRL methods are only applicable when the observations are in the form of…

机器学习 · 计算机科学 2018-06-26 Antti Kangasrääsiö , Samuel Kaski

Contrastive Learning (CL) has been proved to be a powerful self-supervised approach for a wide range of domains, including computer vision and graph representation learning. However, the incremental learning issue of CL has rarely been…

机器学习 · 计算机科学 2023-01-31 Cheng Ji , Jianxin Li , Hao Peng , Jia Wu , Xingcheng Fu , Qingyun Sun , Phillip S. Yu

This paper proposes an active learning (AL) algorithm to solve regression problems based on inverse-distance weighting functions for selecting the feature vectors to query. The algorithm has the following features: (i) supports both…

机器学习 · 计算机科学 2022-12-15 Alberto Bemporad

We introduce inverse reinforcement learning (IRL) as an effective paradigm for training abstractive summarization models, imitating human summarization behaviors. Our IRL model estimates the reward function using a suite of important…

计算与语言 · 计算机科学 2023-12-06 Yu Fu , Deyi Xiong , Yue Dong

Inverse reinforcement learning (IRL) learns a reward function and a corresponding policy that best fit the demonstration data of an expert. However, in the current IRL setting, the learner is isolated from the expert and can only passively…

机器学习 · 计算机科学 2026-05-12 Yue Mao , Shicheng Liu , Siyuan Xu , Minghui Zhu

Inferring the intent of an intelligent agent from demonstrations and subsequently predicting its behavior, is a critical task in many collaborative settings. A common approach to solve this problem is the framework of inverse reinforcement…

机器学习 · 计算机科学 2021-10-05 Samuel Tesfazgi , Armin Lederer , Sandra Hirche

In this paper, we model one-day international cricket games as Markov processes, applying forward and inverse Reinforcement Learning (RL) to develop three novel tools for the game. First, we apply Monte-Carlo learning to fit a nonlinear…

机器学习 · 计算机科学 2021-03-09 Manohar Vohra , George S. D. Gordon

The objective of offline RL is to learn optimal policies when a fixed exploratory demonstrations data-set is available and sampling additional observations is impossible (typically if this operation is either costly or rises ethical…

机器学习 · 计算机科学 2021-06-10 Firas Jarboui , Vianney Perchet

Inverse reinforcement learning (IRL) methods assume that the expert data is generated by an agent optimizing some reward function. However, in many settings, the agent may optimize a reward function subject to some constraints, where the…

机器学习 · 计算机科学 2023-05-01 Ashish Gaurav , Kasra Rezaee , Guiliang Liu , Pascal Poupart

Inverse reinforcement learning (IRL) is the task of finding a reward function that generates a desired optimal policy for a given Markov Decision Process (MDP). This paper develops an information-theoretic lower bound for the sample…

机器学习 · 计算机科学 2021-07-07 Abi Komanduru , Jean Honorio

We study the inverse reinforcement learning (IRL) problem under a transition dynamics mismatch between the expert and the learner. Specifically, we consider the Maximum Causal Entropy (MCE) IRL learner model and provide a tight upper bound…

机器学习 · 计算机科学 2021-12-01 Luca Viano , Yu-Ting Huang , Parameswaran Kamalaruban , Adrian Weller , Volkan Cevher

Imitation learning (IL) is a framework that learns to imitate expert behavior from demonstrations. Recently, IL shows promising results on high dimensional and control tasks. However, IL typically suffers from sample inefficiency in terms…

机器学习 · 计算机科学 2021-11-24 Lihua Zhang

We study the problem of estimating from data, a sparse approximation to the inverse covariance matrix. Estimating a sparsity constrained inverse covariance matrix is a key component in Gaussian graphical model learning, but one that is…

机器学习 · 统计学 2011-06-28 Suvrit Sra , Dongmin Kim