English
Related papers

Related papers: DERAIL: Diagnostic Environments for Reward And Imi…

200 papers

Successfully navigating a complex environment to obtain a desired outcome is a difficult task, that up to recently was believed to be capable only by humans. This perception has been broken down over time, especially with the introduction…

Machine Learning · Computer Science 2019-11-12 Joshua Hare

Imitation learning is often used in addition to reinforcement learning in environments where reward design is difficult or where the reward is sparse, but it is difficult to be able to imitate well in unknown states from a small amount of…

Machine Learning · Computer Science 2024-01-31 Ryoma Furuyama , Daiki Kuyoshi , Satoshi Yamane

The difficulty in specifying rewards for many real-world problems has led to an increased focus on learning rewards from human feedback, such as demonstrations. However, there are often many different reward functions that explain the human…

Machine Learning · Computer Science 2021-06-23 Zaynah Javed , Daniel S. Brown , Satvik Sharma , Jerry Zhu , Ashwin Balakrishna , Marek Petrik , Anca D. Dragan , Ken Goldberg

Large Language Models (LLMs) are nowadays expected to generate content aligned with human preferences. Current work focuses on alignment at model training time, through techniques such as Reinforcement Learning with Human Feedback (RLHF).…

Artificial Intelligence · Computer Science 2026-01-21 James Y. Huang , Sailik Sengupta , Daniele Bonadiman , Yi-An Lai , Arshit Gupta , Nikolaos Pappas , Saab Mansour , Katrin Kirchhoff , Dan Roth

Learning a reward function from human preferences is challenging as it typically requires having a high-fidelity simulator or using expensive and potentially unsafe actual physical rollouts in the environment. However, in many tasks the…

Machine Learning · Computer Science 2023-01-05 Daniel Shin , Anca D. Dragan , Daniel S. Brown

We show that a critical vulnerability in adversarial imitation is the tendency of discriminator networks to learn spurious associations between visual features and expert labels. When the discriminator focuses on task-irrelevant features,…

Imitation learning is a class of promising policy learning algorithms that is free from many practical issues with reinforcement learning, such as the reward design issue and the exploration hardness. However, the current imitation…

Machine Learning · Computer Science 2022-10-19 Zhao-Heng Yin , Weirui Ye , Qifeng Chen , Yang Gao

Many imitation learning (IL) algorithms use inverse reinforcement learning (IRL) to infer a reward function that aligns with the demonstration. However, the inferred reward functions often fail to capture the underlying task objectives. In…

Machine Learning · Computer Science 2024-11-01 Weichao Zhou , Wenchao Li

As robots and other intelligent agents move from simple environments and problems to more complex, unstructured settings, manually programming their behavior has become increasingly challenging and expensive. Often, it is easier for a…

Robotics · Computer Science 2018-11-19 Takayuki Osa , Joni Pajarinen , Gerhard Neumann , J. Andrew Bagnell , Pieter Abbeel , Jan Peters

We consider a setting for Inverse Reinforcement Learning (IRL) where the learner is extended with the ability to actively select multiple environments, observing an agent's behavior on each environment. We first demonstrate that if the…

Artificial Intelligence · Computer Science 2016-01-26 Kareem Amin , Satinder Singh

Though impressive results have been achieved in visual captioning, the task of generating abstract stories from photo streams is still a little-tapped problem. Different from captions, stories have more expressive language styles and…

Computation and Language · Computer Science 2018-07-10 Xin Wang , Wenhu Chen , Yuan-Fang Wang , William Yang Wang

Reinforcement Learning (RL) agents often struggle with inefficient exploration, particularly in environments with sparse rewards. Traditional exploration strategies can lead to slow learning and suboptimal performance because agents fail to…

Machine Learning · Computer Science 2026-03-31 Gaurav Chaudhary , Laxmidhar Behera , Washim Uddin Mondal

Generative Adversarial Imitation Learning (GAIL) is a powerful and practical approach for learning sequential decision-making policies. Different from Reinforcement Learning (RL), GAIL takes advantage of demonstration data by experts (e.g.,…

Machine Learning · Computer Science 2020-01-14 Minshuo Chen , Yizhou Wang , Tianyi Liu , Zhuoran Yang , Xingguo Li , Zhaoran Wang , Tuo Zhao

Learning from few demonstrations to develop policies robust to variations in robot initial positions and object poses is a problem of significant practical interest in robotics. Compared to imitation learning, which often struggles to…

Robotics · Computer Science 2025-04-30 Haowen Sun , Han Wang , Chengzhong Ma , Shaolong Zhang , Jiawei Ye , Xingyu Chen , Xuguang Lan

The goal of imitation learning is to mimic expert behavior from demonstrations, without access to an explicit reward signal. A popular class of approach infers the (unknown) reward function via inverse reinforcement learning (IRL) followed…

Machine Learning · Computer Science 2022-04-19 Carl Qi , Pieter Abbeel , Aditya Grover

Visual imitation learning enables reinforcement learning agents to learn to behave from expert visual demonstrations such as videos or image sequences, without explicit, well-defined rewards. Previous research either adopted supervised…

Artificial Intelligence · Computer Science 2023-02-14 Minghuan Liu , Tairan He , Weinan Zhang , Shuicheng Yan , Zhongwen Xu

Reward learning is a fundamental problem in human-robot interaction to have robots that operate in alignment with what their human user wants. Many preference-based learning algorithms and active querying techniques have been proposed as a…

Machine Learning · Computer Science 2022-01-05 Erdem Bıyık , Aditi Talati , Dorsa Sadigh

Imitation learning benchmarks often lack sufficient variation between training and evaluation, limiting meaningful generalisation assessment. We introduce Labyrinth, a benchmarking environment designed to test generalisation with precise…

Machine Learning · Computer Science 2025-09-30 Nathan Gavenski , Odinaldo Rodrigues

Inferring reward functions from demonstrations and pairwise preferences are auspicious approaches for aligning Reinforcement Learning (RL) agents with human intentions. However, state-of-the art methods typically focus on learning a single…

Machine Learning · Computer Science 2022-01-04 Markus Peschl , Arkady Zgonnikov , Frans A. Oliehoek , Luciano C. Siebert

Deep Reinforcement Learning achieves very good results in domains where reward functions can be manually engineered. At the same time, there is growing interest within the community in using games based on Procedurally Content Generation…

Machine Learning · Computer Science 2020-12-07 Alessandro Sestini , Alexander Kuhnle , Andrew D. Bagdanov