English
Related papers

Related papers: Learning Robust Rewards with Adversarial Inverse R…

200 papers

Reinforcement learning (RL) provides a powerful framework for decision-making, but its application in practice often requires a carefully designed reward function. Adversarial Imitation Learning (AIL) sheds light on automatic policy…

Machine Learning · Computer Science 2024-02-05 Kaifeng Zhang , Rui Zhao , Ziming Zhang , Yang Gao

Inverse Reinforcement Learning (IRL) is the problem of finding a reward function which describes observed/known expert behavior. The IRL setting is remarkably useful for automated control, in situations where the reward function is…

Machine Learning · Computer Science 2022-09-12 Gregory Dexter , Kevin Bello , Jean Honorio

Adversarial Inverse Reinforcement Learning (AIRL) has shown promise in addressing the sparse reward problem in reinforcement learning (RL) by inferring dense reward functions from expert demonstrations. However, its performance in highly…

Machine Learning · Computer Science 2026-04-23 Bram Silue , Santiago Amaya-Corredor , Patrick Mannion , Lander Willem , Pieter Libin

Inverse reinforcement learning (IRL) is computationally challenging, with common approaches requiring the solution of multiple reinforcement learning (RL) sub-problems. This work motivates the use of potential-based reward shaping to reduce…

Machine Learning · Computer Science 2023-12-19 Lauren H. Cooke , Harvey Klyne , Edwin Zhang , Cassidy Laidlaw , Milind Tambe , Finale Doshi-Velez

The Inverse Reinforcement Learning (\textit{IRL}) problem has seen rapid evolution in the past few years, with important applications in domains like robotics, cognition, and health. In this work, we explore the inefficacy of current IRL…

Machine Learning · Computer Science 2022-09-28 Raeid Saqur

Inverse reinforcement learning (IRL) aims to recover the reward function of an expert agent from demonstrations of behavior. It is well-known that the IRL problem is fundamentally ill-posed, i.e., many reward functions can explain the…

Machine Learning · Computer Science 2024-06-07 Filippo Lazzati , Mirco Mutti , Alberto Maria Metelli

We present the ADaptive Adversarial Imitation Learning (ADAIL) algorithm for learning adaptive policies that can be transferred between environments of varying dynamics, by imitating a small number of demonstrations collected from a single…

Machine Learning · Computer Science 2020-08-31 Yiren Lu , Jonathan Tompson

Inverse reinforcement learning (IRL) is the problem of inferring a reward function from expert behavior. There are several approaches to IRL, but most are designed to learn a Markovian reward. However, a reward function might be…

Machine Learning · Computer Science 2024-06-21 Noah Topper , Alvaro Velasquez , George Atia

Inverse reinforcement learning (IRL) addresses the problem of recovering a task description given a demonstration of the optimal policy used to solve such a task. The optimal policy is usually provided by an expert or teacher, making IRL…

Machine Learning · Computer Science 2012-02-09 Héctor Ratia , Luis Montesano , Ruben Martinez-Cantin

Inverse reinforcement learning (IRL) methods assume that the expert data is generated by an agent optimizing some reward function. However, in many settings, the agent may optimize a reward function subject to some constraints, where the…

Machine Learning · Computer Science 2023-05-01 Ashish Gaurav , Kasra Rezaee , Guiliang Liu , Pascal Poupart

Acquiring complex behaviors is essential for artificially intelligent agents, yet learning these behaviors in high-dimensional settings poses a significant challenge due to the vast search space. Traditional reinforcement learning (RL)…

Machine Learning · Computer Science 2025-04-22 Mert Albaba , Sammy Christen , Thomas Langarek , Christoph Gebhardt , Otmar Hilliges , Michael J. Black

Inverse reinforcement learning (IRL) enables an agent to learn complex behavior by observing demonstrations from a (near-)optimal policy. The typical assumption is that the learner's goal is to match the teacher's demonstrated behavior. In…

Machine Learning · Computer Science 2019-10-30 Sebastian Tschiatschek , Ahana Ghosh , Luis Haug , Rati Devidze , Adish Singla

Deep Reinforcement Learning (DRL) is a subfield of machine learning for training autonomous agents that take sequential actions across complex environments. Despite its significant performance in well-known environments, it remains…

Inverse reinforcement learning (IRL) is used to infer the reward function from the actions of an expert running a Markov Decision Process (MDP). A novel approach using variational inference for learning the reward function is proposed in…

Machine Learning · Computer Science 2019-10-03 Arpan Kusari

Bayesian inference over the reward presents an ideal solution to the ill-posed nature of the inverse reinforcement learning problem. Unfortunately current methods generally do not scale well beyond the small tabular setting due to the need…

Machine Learning · Computer Science 2021-03-15 Alex J. Chan , Mihaela van der Schaar

We consider a setting for Inverse Reinforcement Learning (IRL) where the learner is extended with the ability to actively select multiple environments, observing an agent's behavior on each environment. We first demonstrate that if the…

Artificial Intelligence · Computer Science 2016-01-26 Kareem Amin , Satinder Singh

Inferring an adversary's goals from exhibited behavior is crucial for counterplanning and non-cooperative multi-agent systems in domains like cybersecurity, military, and strategy games. Deep Inverse Reinforcement Learning (IRL) methods…

Machine Learning · Computer Science 2025-10-07 Paul Ghanem , Owen Howell , Michael Potter , Pau Closas , Alireza Ramezani , Deniz Erdogmus , Tales Imbiriba

Text generation is a crucial task in NLP. Recently, several adversarial generative models have been proposed to improve the exposure bias problem in text generation. Though these models gain great success, they still suffer from the…

Computation and Language · Computer Science 2018-06-08 Zhan Shi , Xinchi Chen , Xipeng Qiu , Xuanjing Huang

Reward learning enables robots to learn adaptable behaviors from human input. Traditional methods model the reward as a linear function of hand-crafted features, but that requires specifying all the relevant features a priori, which is…

Robotics · Computer Science 2022-01-19 Andreea Bobu , Marius Wiggert , Claire Tomlin , Anca D. Dragan

An inverse reinforcement learning (IRL) agent learns to act intelligently by observing expert demonstrations and learning the expert's underlying reward function. Although learning the reward functions from demonstrations has achieved great…

Artificial Intelligence · Computer Science 2022-02-28 Wei Gao , David Hsu , Wee Sun Lee