中文
相关论文

相关论文: Distributional Inverse Reinforcement Learning

200 篇论文

Distributional reinforcement learning, which focuses on learning the entire return distribution instead of only its expectation in standard RL, has demonstrated remarkable success in enhancing performance. Despite these advancements, our…

机器学习 · 计算机科学 2024-09-24 Ke Sun , Bei Jiang , Linglong Kong

Inverse Reinforcement Learning (IRL) aims to reconstruct the reward function from expert demonstrations to facilitate policy learning, and has demonstrated its remarkable success in imitation learning. To promote expert-like behavior,…

机器学习 · 计算机科学 2023-06-16 Shunyu Liu , Yunpeng Qing , Shuqi Xu , Hongyan Wu , Jiangtao Zhang , Jingyuan Cong , Tianhao Chen , Yunfu Liu , Mingli Song

Inverse reinforcement learning (IRL) aims to learn a reward function and a corresponding policy that best fit the demonstrated trajectories of an expert. However, current IRL works cannot learn incrementally from an ongoing trajectory…

机器学习 · 计算机科学 2025-07-24 Shicheng Liu , Minghui Zhu

We introduce inverse reinforcement learning (IRL) as an effective paradigm for training abstractive summarization models, imitating human summarization behaviors. Our IRL model estimates the reward function using a suite of important…

计算与语言 · 计算机科学 2023-12-06 Yu Fu , Deyi Xiong , Yue Dong

We introduce Iterative Dual Reinforcement Learning (IDRL), a new method that takes an optimal discriminator-weighted imitation view of solving RL. Our method is motivated by a simple experiment in which we find training a discriminator…

机器学习 · 计算机科学 2025-04-21 Haoran Xu , Shuozhe Li , Harshit Sikchi , Scott Niekum , Amy Zhang

Inverse Reinforcement Learning addresses the problem of inferring an expert's reward function from demonstrations. However, in many applications, we not only have access to the expert's near-optimal behavior, but we also observe part of her…

机器学习 · 计算机科学 2021-09-03 Giorgia Ramponi , Gianluca Drappo , Marcello Restelli

For many reinforcement learning (RL) applications, specifying a reward is difficult. This paper considers an RL setting where the agent obtains information about the reward only by querying an expert that can, for example, evaluate…

机器学习 · 计算机科学 2022-02-01 David Lindner , Matteo Turchetta , Sebastian Tschiatschek , Kamil Ciosek , Andreas Krause

While Distributional Reinforcement Learning (DRL) methods have demonstrated strong performance in online settings, its success in offline scenarios remains limited. We hypothesize that a key limitation of existing offline DRL methods lies…

机器学习 · 计算机科学 2026-01-06 Ryo Iwaki , Takayuki Osogami

Offline reinforcement learning requires reconciling two conflicting aims: learning a policy that improves over the behavior policy that collected the dataset, while at the same time minimizing the deviation from the behavior policy so as to…

机器学习 · 计算机科学 2021-10-13 Ilya Kostrikov , Ashvin Nair , Sergey Levine

We present an algorithm for Inverse Reinforcement Learning (IRL) from expert state observations only. Our approach decouples reward modelling from policy learning, unlike state-of-the-art adversarial methods which require updating the…

机器学习 · 计算机科学 2022-05-20 Wei-Di Chang , Juan Camilo Gamboa Higuera , Scott Fujimoto , David Meger , Gregory Dudek

Inverse reinforcement learning (IRL) has become a useful tool for learning behavioral models from demonstration data. However, IRL remains mostly unexplored for multi-agent systems. In this paper, we show how the principle of IRL can be…

机器学习 · 统计学 2017-03-27 Adrian Šošić , Wasiur R. KhudaBukhsh , Abdelhak M. Zoubir , Heinz Koeppl

In inverse reinforcement learning (IRL), a learning agent infers a reward function encoding the underlying task using demonstrations from experts. However, many existing IRL techniques make the often unrealistic assumption that the agent…

机器学习 · 计算机科学 2023-01-04 Franck Djeumou , Christian Ellis , Murat Cubuktepe , Craig Lennon , Ufuk Topcu

In distributed optimization, the practical problem-solving performance is essentially sensitive to algorithm selection, parameter setting, problem type and data pattern. Thus, it is often laborious to acquire a highly efficient method for a…

最优化与控制 · 数学 2024-01-04 Daokuan Zhu , Tianqi Xu , Jie Lu

Reinforcement learning (RL) has proved to have a promising role in future intelligent wireless networks. Online RL has been adopted for radio resource management (RRM), taking over traditional schemes. However, due to its reliance on online…

机器学习 · 计算机科学 2025-01-24 Eslam Eldeeb , Hirley Alves

This article studies inverse reinforcement learning (IRL) for the stochastic linear-quadratic optimal control problem, where two agents are considered. A learner agent does not know the expert agent's performance cost function, but it…

最优化与控制 · 数学 2024-05-28 Zhongshi Sun , Guangyan Jia

In this work, we propose a novel inverse reinforcement learning (IRL) algorithm for constrained Markov decision process (CMDP) problems. In standard IRL problems, the inverse learner or agent seeks to recover the reward function of the MDP,…

机器学习 · 计算机科学 2024-01-08 Nirjhar Das , Arpan Chattopadhyay

Inverse reinforcement learning (IRL) methods infer an agent's reward function using demonstrations of expert behavior. A Bayesian IRL approach models a distribution over candidate reward functions, capturing a degree of uncertainty in the…

机器学习 · 计算机科学 2025-07-04 Aishwarya Mandyam , Didong Li , Jiayu Yao , Diana Cai , Andrew Jones , Barbara E. Engelhardt

We derive a minimax distributionally robust inverse reinforcement learning (IRL) algorithm to reconstruct the utility functions of a multi-agent sensing system. Specifically, we construct utility estimators which minimize the worst-case…

机器学习 · 计算机科学 2024-09-24 Luke Snow , Vikram Krishnamurthy

Inverse reinforcement learning (IRL) is the problem of inferring the reward function of an agent, given its policy or observed behavior. Analogous to RL, IRL is perceived both as a problem and as a class of methods. By categorically…

机器学习 · 计算机科学 2020-11-19 Saurabh Arora , Prashant Doshi

This paper focuses on the development of an online inverse reinforcement learning (IRL) technique for a class of nonlinear systems. The developed approach utilizes observed state and input trajectories, and determines the unknown cost…

系统与控制 · 计算机科学 2018-11-27 Ryan Self , Michael Harlan , Rushikesh Kamalapurkar