English
Related papers

Related papers: No Metrics Are Perfect: Adversarial Reward Learnin…

200 papers

Recent developments in multi-agent imitation learning have shown promising results for modeling the behavior of human drivers. However, it is challenging to capture emergent traffic behaviors that are observed in real-world datasets. Such…

We study the problem of learning optimal behavior from sub-optimal datasets for goal-conditioned offline reinforcement learning under sparse rewards, invertible actions and deterministic transitions. To mitigate the effects of…

Machine Learning · Computer Science 2026-02-12 Alfredo Reichlin , Miguel Vasco , Hang Yin , Danica Kragic

Generating accurate descriptions for online fashion items is important not only for enhancing customers' shopping experiences, but also for the increase of online sales. Besides the need of correctly presenting the attributes of items, the…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Xuewen Yang , Heming Zhang , Di Jin , Yingru Liu , Chi-Hao Wu , Jianchao Tan , Dongliang Xie , Jue Wang , Xin Wang

The alignment between humans and machines is a critical challenge in artificial intelligence today. Reinforcement learning, which aims to maximize a reward function, is particularly vulnerable to the risks associated with poorly designed…

Artificial Intelligence · Computer Science 2025-10-29 Valentin Cuzin-Rambaud , Emilien Komlenovic , Alexandre Faure , Bruno Yun

Reinforcement learning in complex environments is a challenging problem. In particular, the success of reinforcement learning algorithms depends on a well-designed reward function. Inverse reinforcement learning (IRL) solves the problem of…

Machine Learning · Computer Science 2021-01-20 Rakhoon Hwang , Hanjin Lee , Hyung Ju Hwang

Generative Adversarial Imitation Learning (GAIL) is a powerful and practical approach for learning sequential decision-making policies. Different from Reinforcement Learning (RL), GAIL takes advantage of demonstration data by experts (e.g.,…

Machine Learning · Computer Science 2020-01-14 Minshuo Chen , Yizhou Wang , Tianyi Liu , Zhuoran Yang , Xingguo Li , Zhaoran Wang , Tuo Zhao

Automatic video captioning aims for a holistic visual scene understanding. It requires a mechanism for capturing temporal context in video frames and the ability to comprehend the actions and associations of objects in a given timeframe.…

Computer Vision and Pattern Recognition · Computer Science 2022-12-22 Daniel Lukas Rothenpieler , Shahin Amiriparian

Visual imitation learning enables reinforcement learning agents to learn to behave from expert visual demonstrations such as videos or image sequences, without explicit, well-defined rewards. Previous research either adopted supervised…

Artificial Intelligence · Computer Science 2023-02-14 Minghuan Liu , Tairan He , Weinan Zhang , Shuicheng Yan , Zhongwen Xu

Continual learning aims to learn new tasks without forgetting previously learned ones. We hypothesize that representations learned to solve each task in a sequence have a shared structure while containing some task-specific properties. We…

Machine Learning · Computer Science 2020-07-22 Sayna Ebrahimi , Franziska Meier , Roberto Calandra , Trevor Darrell , Marcus Rohrbach

Understanding an agent's goals from its behavior is fundamental to aligning AI systems with human intentions. Existing goal recognition methods typically rely on an optimal goal-oriented policy representation, which may differ from the…

Artificial Intelligence · Computer Science 2026-02-17 Osher Elhadad , Felipe Meneguzzi , Reuth Mirsky

The overarching goal of this work is to efficiently enable end-users to correctly anticipate a robot's behavior in novel situations. Since a robot's behavior is often a direct result of its underlying objective function, our insight is that…

Robotics · Computer Science 2018-10-19 Sandy H. Huang , David Held , Pieter Abbeel , Anca D. Dragan

How can we design good goals for arbitrarily intelligent agents? Reinforcement learning (RL) is a natural approach. Unfortunately, RL does not work well for generally intelligent agents, as RL agents are incentivised to shortcut the reward…

Artificial Intelligence · Computer Science 2016-05-11 Tom Everitt , Marcus Hutter

Contrastive learning is an effective unsupervised method in graph representation learning, and the key component of contrastive learning lies in the construction of positive and negative samples. Previous methods usually utilize the…

Machine Learning · Computer Science 2024-02-07 Shengyu Feng , Baoyu Jing , Yada Zhu , Hanghang Tong

Reward learning enables the application of reinforcement learning (RL) to tasks where reward is defined by human judgment, building a model of reward by asking humans questions. Most work on reward learning has used simulated environments,…

Computation and Language · Computer Science 2020-01-10 Daniel M. Ziegler , Nisan Stiennon , Jeffrey Wu , Tom B. Brown , Alec Radford , Dario Amodei , Paul Christiano , Geoffrey Irving

Offline Reinforcement Learning (ORL) offers a robust solution to training agents in applications where interactions with the environment must be strictly limited due to cost, safety, or lack of accurate simulation environments. Despite its…

Machine Learning · Computer Science 2024-07-16 Carlo Romeo , Andrew D. Bagdanov

There is a surge of interest in using formal languages such as Linear Temporal Logic (LTL) to precisely and succinctly specify complex tasks and derive reward functions for Reinforcement Learning (RL). However, existing methods often assign…

Robotics · Computer Science 2025-05-20 Minjae Kwon , Ingy ElSayed-Aly , Lu Feng

Adversarial representation learning aims to learn data representations for a target task while removing unwanted sensitive information at the same time. Existing methods learn model parameters iteratively through stochastic gradient…

Machine Learning · Computer Science 2021-09-14 Bashir Sadeghi , Lan Wang , Vishnu Naresh Boddeti

Reinforcement learning faces significant challenges when applied to tasks characterized by sparse reward structures. Although imitation learning, within the domain of supervised learning, offers faster convergence, it relies heavily on…

Machine Learning · Computer Science 2025-09-04 Zeqiang Zhang , Fabian Wurzberger , Gerrit Schmid , Sebastian Gottwald , Daniel A. Braun

Reinforcement learning (RL) has shown its strength in challenging sequential decision-making problems. The reward function in RL is crucial to the learning performance, as it serves as a measure of the task completion degree. In real-world…

Machine Learning · Computer Science 2024-02-13 Siyuan Li , Shijie Han , Yingnan Zhao , By Liang , Peng Liu

Inverse reinforcement learning (IRL) aims to learn a reward function and a corresponding policy that best fit the demonstrated trajectories of an expert. However, current IRL works cannot learn incrementally from an ongoing trajectory…

Machine Learning · Computer Science 2025-07-24 Shicheng Liu , Minghui Zhu