English
Related papers

Related papers: On Reward Transferability in Adversarial Inverse R…

200 papers

Reinforcement learning (RL) agents often struggle to generalize to new tasks and contexts without updating their parameters, mainly because their learned representations and policies are overfit to the specifics of their training…

Machine Learning · Computer Science 2025-08-12 Fernando Martinez-Lopez , Tao Li , Yingdong Lu , Juntao Chen

Reinforcement learning (RL) provides a powerful framework for decision-making, but its application in practice often requires a carefully designed reward function. Adversarial Imitation Learning (AIL) sheds light on automatic policy…

Machine Learning · Computer Science 2024-02-05 Kaifeng Zhang , Rui Zhao , Ziming Zhang , Yang Gao

Multiagent reinforcement learning (MARL) is commonly considered to suffer from non-stationary environments and exponentially increasing policy space. It would be even more challenging when rewards are sparse and delayed over long…

Various methods for solving the inverse reinforcement learning (IRL) problem have been developed independently in machine learning and economics. In particular, the method of Maximum Causal Entropy IRL is based on the perspective of entropy…

Machine Learning · Computer Science 2021-03-05 Navyata Sanghvi , Shinnosuke Usami , Mohit Sharma , Joachim Groeger , Kris Kitani

Deep Reinforcement Learning (DRL) is a subfield of machine learning for training autonomous agents that take sequential actions across complex environments. Despite its significant performance in well-known environments, it remains…

We propose an inverse reinforcement learning (IRL) approach using Deep Q-Networks to extract the rewards in problems with large state spaces. We evaluate the performance of this approach in a simulation-based autonomous driving scenario.…

Artificial Intelligence · Computer Science 2017-09-22 Sahand Sharifzadeh , Ioannis Chiotellis , Rudolph Triebel , Daniel Cremers

Inferring a person's goal from their behavior is an important problem in applications of AI (e.g. automated assistants, recommender systems). The workhorse model for this task is the rational actor model - this amounts to assuming that…

Machine Learning · Computer Science 2019-03-15 Alexander Peysakhovich

Hierarchical Reinforcement Learning (HRL) is a promising approach to solving long-horizon problems with sparse and delayed rewards. Many existing HRL algorithms either use pre-trained low-level skills that are unadaptable, or require…

Machine Learning · Computer Science 2019-10-11 Siyuan Li , Rui Wang , Minxue Tang , Chongjie Zhang

Training a policy in a source domain for deployment in the target domain under a dynamics shift can be challenging, often resulting in performance degradation. Previous work tackles this challenge by training on the source domain with…

Machine Learning · Computer Science 2024-11-18 Yihong Guo , Yixuan Wang , Yuanyuan Shi , Pan Xu , Anqi Liu

For many reinforcement learning (RL) applications, specifying a reward is difficult. This paper considers an RL setting where the agent obtains information about the reward only by querying an expert that can, for example, evaluate…

Machine Learning · Computer Science 2022-02-01 David Lindner , Matteo Turchetta , Sebastian Tschiatschek , Kamil Ciosek , Andreas Krause

Predicting the motion of a mobile agent from a third-person perspective is an important component for many robotics applications, such as autonomous navigation and tracking. With accurate motion prediction of other agents, robots can plan…

Robotics · Computer Science 2018-10-18 Yanfu Zhang , Wenshan Wang , Rogerio Bonatti , Daniel Maturana , Sebastian Scherer

Inverse reinforcement learning (IRL), which infers reward functions from demonstrations, is a valuable tool for modeling and understanding decision-making behavior. Many variants of IRL have been developed to capture complexities of human…

Machine Learning · Computer Science 2026-05-14 Leo Benac , Abhishek Sharma , Alihan Huyuk , Finale Doshi-Velez

Anomaly detection plays a critical role in Autonomous Vehicles (AVs) by identifying unusual behaviors through perception systems that could compromise safety and lead to hazardous situations. Current approaches, which often rely on…

Artificial Intelligence · Computer Science 2025-07-08 Ashish Bastola , Mert D. Pesé , Long Cheng , Jonathon Smereka , Abolfazl Razi

Information theoretic sensor management approaches are an ideal solution to state estimation problems when considering the optimal control of multi-agent systems, however they are too computationally intensive for large state spaces,…

Multiagent Systems · Computer Science 2021-02-02 William A. Dawson , Ruben Glatt , Edward Rusu , Braden C. Soper , Ryan A. Goldhahn

Random exploration is one of the main mechanisms through which reinforcement learning (RL) finds well-performing policies. However, it can lead to undesirable or catastrophic outcomes when learning online in safety-critical environments. In…

Machine Learning · Computer Science 2021-07-15 Djordje Grbic , Sebastian Risi

We present a framework using Relative Entropy Inverse Reinforcement Learning (RE-IRL) to recover investor reward functions from observed investment actions and market conditions. Unlike traditional IRL algorithms, RE-IRL is employed to…

Machine Learning · Computer Science 2026-04-28 Chen Xu

For task-oriented dialog systems, training a Reinforcement Learning (RL) based Dialog Management module suffers from low sample efficiency and slow convergence speed due to the sparse rewards in RL.To solve this problem, many strategies…

Computation and Language · Computer Science 2021-04-13 Zhengxu Hou , Bang Liu , Ruihui Zhao , Zijing Ou , Yafei Liu , Xi Chen , Yefeng Zheng

Deducing the contribution of each agent and assigning the corresponding reward to them is a crucial problem in cooperative Multi-Agent Reinforcement Learning (MARL). Previous studies try to resolve the issue through designing an intrinsic…

Machine Learning · Computer Science 2023-02-21 Wei Li , Weiyan Liu , Shitong Shao , Shiyi Huang

Inverse Reinforcement Learning (IRL) aims to recover a reward function from expert demonstrations. Recently, Optimal Transport (OT) methods have been successfully deployed to align trajectories and infer rewards. While OT-based methods have…

Machine Learning · Computer Science 2025-06-10 Zixuan Dong , Yumi Omori , Keith Ross

Inverse reinforcement learning (IRL) is the problem of learning the preferences of an agent from the observations of its behavior on a task. While this problem has been well investigated, the related problem of {\em online} IRL---where the…

Machine Learning · Computer Science 2020-11-19 Saurabh Arora , Prashant Doshi , Bikramjit Banerjee