中文
相关论文

相关论文: CWAE-IRL: Formulating a supervised approach to Inv…

200 篇论文

Bayesian inference over the reward presents an ideal solution to the ill-posed nature of the inverse reinforcement learning problem. Unfortunately current methods generally do not scale well beyond the small tabular setting due to the need…

机器学习 · 计算机科学 2021-03-15 Alex J. Chan , Mihaela van der Schaar

Inverse reinforcement learning methods aim to retrieve the reward function of a Markov decision process based on a dataset of expert demonstrations. The commonplace scarcity and heterogeneous sources of such demonstrations can lead to the…

机器学习 · 计算机科学 2024-09-13 Ivan Ovinnikov , Eugene Bykovets , Joachim M. Buhmann

Inverse Reinforcement Learning addresses the problem of inferring an expert's reward function from demonstrations. However, in many applications, we not only have access to the expert's near-optimal behavior, but we also observe part of her…

机器学习 · 计算机科学 2021-09-03 Giorgia Ramponi , Gianluca Drappo , Marcello Restelli

Acquiring complex behaviors is essential for artificially intelligent agents, yet learning these behaviors in high-dimensional settings poses a significant challenge due to the vast search space. Traditional reinforcement learning (RL)…

机器学习 · 计算机科学 2025-04-22 Mert Albaba , Sammy Christen , Thomas Langarek , Christoph Gebhardt , Otmar Hilliges , Michael J. Black

Large language models (LLMs) trained with Reinforcement Learning from Human Feedback (RLHF) have demonstrated remarkable capabilities, but their underlying reward functions and decision-making processes remain opaque. This paper introduces…

计算与语言 · 计算机科学 2025-10-07 Jared Joselowitz , Ritam Majumdar , Arjun Jagota , Matthieu Bou , Nyal Patel , Satyapriya Krishna , Sonali Parbhoo

The Inverse Reinforcement Learning (\textit{IRL}) problem has seen rapid evolution in the past few years, with important applications in domains like robotics, cognition, and health. In this work, we explore the inefficacy of current IRL…

机器学习 · 计算机科学 2022-09-28 Raeid Saqur

This paper addresses the problem of inverse reinforcement learning (IRL) -- inferring the reward function of an agent from observing its behavior. IRL can provide a generalizable and compact representation for apprenticeship learning, and…

机器学习 · 计算机科学 2022-08-10 Marwa Abdulhai , Natasha Jaques , Sergey Levine

In inverse reinforcement learning (IRL), the central objective is to infer underlying reward functions from observed expert behaviors in a way that not only explains the given data but also generalizes to unseen scenarios. This ensures…

机器学习 · 计算机科学 2023-10-19 Ali Baheri

This paper presents a method for learning logical task specifications and cost functions from demonstrations. Constructing specifications by hand is challenging for complex objectives and constraints in autonomous systems. Instead, we…

机器学习 · 计算机科学 2022-09-21 Tianyu Wang , Nikolay Atanasov

We present new algorithms for inverse reinforcement learning (IRL, or inverse optimal control) in convex optimization settings. We argue that finite-space IRL can be posed as a convex quadratic program under a Bayesian inference framework…

机器学习 · 计算机科学 2013-01-22 Qifeng Qiao , Peter A. Beling

Inverse Reinforcement Learning (IRL) aims to reconstruct the reward function from expert demonstrations to facilitate policy learning, and has demonstrated its remarkable success in imitation learning. To promote expert-like behavior,…

机器学习 · 计算机科学 2023-06-16 Shunyu Liu , Yunpeng Qing , Shuqi Xu , Hongyan Wu , Jiangtao Zhang , Jingyuan Cong , Tianhao Chen , Yunfu Liu , Mingli Song

While most approaches to the problem of Inverse Reinforcement Learning (IRL) focus on estimating a reward function that best explains an expert agent's policy or demonstrated behavior on a control task, it is often the case that such…

机器学习 · 计算机科学 2020-05-01 Dexter R. R. Scobee , S. Shankar Sastry

Communication load balancing aims to balance the load between different available resources, and thus improve the quality of service for network systems. After formulating the load balancing (LB) as a Markov decision process problem,…

网络与互联网体系结构 · 计算机科学 2023-03-30 Abhisek Konar , Di Wu , Yi Tian Xu , Seowoo Jang , Steve Liu , Gregory Dudek

As AI systems become increasingly autonomous, reliably aligning their decision-making with human preferences is essential. Inverse reinforcement learning (IRL) offers a promising approach to infer preferences from demonstrations. These…

We present an algorithm for Inverse Reinforcement Learning (IRL) from expert state observations only. Our approach decouples reward modelling from policy learning, unlike state-of-the-art adversarial methods which require updating the…

机器学习 · 计算机科学 2022-05-20 Wei-Di Chang , Juan Camilo Gamboa Higuera , Scott Fujimoto , David Meger , Gregory Dudek

We propose an approach for inverse reinforcement learning from hetero-domain which learns a reward function in the simulator, drawing on the demonstrations from the real world. The intuition behind the method is that the reward function…

机器学习 · 计算机科学 2021-10-25 Yachen Kang , Jinxin Liu , Xin Cao , Donglin Wang

This work aims to tackle a major challenge in offline Inverse Reinforcement Learning (IRL), namely the reward extrapolation error, where the learned reward function may fail to explain the task correctly and misguide the agent in unseen…

机器学习 · 计算机科学 2023-02-22 Sheng Yue , Guanbo Wang , Wei Shao , Zhaofeng Zhang , Sen Lin , Ju Ren , Junshan Zhang

In Imitation Learning (IL), utilizing suboptimal and heterogeneous demonstrations presents a substantial challenge due to the varied nature of real-world data. However, standard IL algorithms consider these datasets as homogeneous, thereby…

机器学习 · 计算机科学 2024-12-16 Mark Beliaev , Ramtin Pedarsani

We introduce inverse reinforcement learning (IRL) as an effective paradigm for training abstractive summarization models, imitating human summarization behaviors. Our IRL model estimates the reward function using a suite of important…

计算与语言 · 计算机科学 2023-12-06 Yu Fu , Deyi Xiong , Yue Dong

Learning from expert demonstrations to flexibly program an autonomous system with complex behaviors or to predict an agent's behavior is a powerful tool, especially in collaborative control settings. A common method to solve this problem is…

系统与控制 · 电气工程与系统科学 2024-05-15 Samuel Tesfazgi , Leonhard Sprandl , Armin Lederer , Sandra Hirche