English
Related papers

Related papers: Hindsight Generative Adversarial Imitation Learnin…

200 papers

In generative adversarial imitation learning (GAIL), the agent aims to learn a policy from an expert demonstration so that its performance cannot be discriminated from the expert policy on a certain predefined reward set. In this paper, we…

Machine Learning · Computer Science 2021-08-20 Zhihan Liu , Yufeng Zhang , Zuyue Fu , Zhuoran Yang , Zhaoran Wang

This paper explores a simple regularizer for reinforcement learning by proposing Generative Adversarial Self-Imitation Learning (GASIL), which encourages the agent to imitate past good trajectories via generative adversarial imitation…

Machine Learning · Computer Science 2018-12-04 Yijie Guo , Junhyuk Oh , Satinder Singh , Honglak Lee

We present the ADaptive Adversarial Imitation Learning (ADAIL) algorithm for learning adaptive policies that can be transferred between environments of varying dynamics, by imitating a small number of demonstrations collected from a single…

Machine Learning · Computer Science 2020-08-31 Yiren Lu , Jonathan Tompson

Generative adversarial imitation learning (GAIL) has shown promising results by taking advantage of generative adversarial nets, especially in the field of robot learning. However, the requirement of isolated single modal demonstrations…

Machine Learning · Computer Science 2020-05-25 Cong Fei , Bin Wang , Yuzheng Zhuang , Zongzhang Zhang , Jianye Hao , Hongbo Zhang , Xuewu Ji , Wulong Liu

We show that a critical vulnerability in adversarial imitation is the tendency of discriminator networks to learn spurious associations between visual features and expert labels. When the discriminator focuses on task-irrelevant features,…

We study risk-sensitive imitation learning where the agent's goal is to perform at least as well as the expert in terms of a risk profile. We first formulate our risk-sensitive imitation learning setting. We consider the generative…

Machine Learning · Computer Science 2018-12-27 Jonathan Lacotte , Mohammad Ghavamzadeh , Yinlam Chow , Marco Pavone

Imitation learning is a proven method for creating a policy in the absence of rewards, by leveraging expert demonstrations. In this work, we apply imitation learning to conversation. In doing so, we recover a policy capable of talking to a…

Computation and Language · Computer Science 2025-08-19 Noah Kasmanoff , Rahul Zalkikar

Generative Adversarial Imitation Learning (GAIL) trains a generative policy to mimic a demonstrator. It uses on-policy Reinforcement Learning (RL) to optimize a reward signal derived from a GAN-like discriminator. A major drawback of GAIL…

Machine Learning · Computer Science 2024-10-30 Tianjiao Luo , Tim Pearce , Huayu Chen , Jianfei Chen , Jun Zhu

Understanding an agent's goals from its behavior is fundamental to aligning AI systems with human intentions. Existing goal recognition methods typically rely on an optimal goal-oriented policy representation, which may differ from the…

Artificial Intelligence · Computer Science 2026-02-17 Osher Elhadad , Felipe Meneguzzi , Reuth Mirsky

Imitation learning aims to solve the problem of defining reward functions in real-world decision-making tasks. The current popular approach is the Adversarial Imitation Learning (AIL) framework, which matches expert state-action occupancy…

Machine Learning · Computer Science 2023-12-13 Bingzheng Wang , Guoqiang Wu , Teng Pang , Yan Zhang , Yilong Yin

Simulation is an appealing option for validating the safety of autonomous vehicles. Generative Adversarial Imitation Learning (GAIL) has recently been shown to learn representative human driver models. These human driver models were learned…

Artificial Intelligence · Computer Science 2018-03-06 Raunak P. Bhattacharyya , Derek J. Phillips , Blake Wulfe , Jeremy Morton , Alex Kuefler , Mykel J. Kochenderfer

Learning complex policies with Reinforcement Learning (RL) is often hindered by instability and slow convergence, a problem exacerbated by the difficulty of reward engineering. Imitation Learning (IL) from expert demonstrations bypasses…

Machine Learning · Computer Science 2026-05-19 Sayambhu Sen , Shalabh Bhatnagar

Imitation Learning (IL) enables agents to mimic expert behavior by learning from demonstrations. However, traditional IL methods require large amounts of medium-to-high-quality demonstrations as well as actions of expert demonstrations,…

Machine Learning · Computer Science 2026-03-06 Siqi Yang , Kai Yan , Alexander G. Schwing , Yu-Xiong Wang

Adversarial Imitation Learning (AIL) is a dominant framework in imitation learning that infers rewards from expert demonstrations to guide policy optimization. Although providing more expert demonstrations typically leads to improved…

Machine Learning · Computer Science 2026-04-30 Pengcheng Li , Qiang Fang , Tong Zhao , Yixing Lan , Xin Xu

Generative adversarial imitation learning (GAIL) is a model-free algorithm that has been shown to provide strong results in imitating complex behaviors in high-dimensional environments. In this paper, we utilize the GAIL model for text…

Computation and Language · Computer Science 2021-05-28 Pratyush Muthukumar , Karishma Muthukumar , Deepan Muthirayan , Pramod Khargonekar

Reinforcement learning (RL) provides a powerful framework for decision-making, but its application in practice often requires a carefully designed reward function. Adversarial Imitation Learning (AIL) sheds light on automatic policy…

Machine Learning · Computer Science 2024-02-05 Kaifeng Zhang , Rui Zhao , Ziming Zhang , Yang Gao

Human beings are able to understand objectives and learn by simply observing others perform a task. Imitation learning methods aim to replicate such capabilities, however, they generally depend on access to a full set of optimal states and…

Machine Learning · Computer Science 2021-03-10 Edoardo Cetin , Oya Celiktutan

Inverse Reinforcement Learning (IRL) learns an optimal policy, given some expert demonstrations, thus avoiding the need for the tedious process of specifying a suitable reward function. However, current methods are constrained by at least…

Machine Learning · Computer Science 2023-11-16 Pierre Le Pelletier de Woillemont , Rémi Labory , Vincent Corruble

Imitation learning (IL) has proven to be an effective method for learning good policies from expert demonstrations. Adversarial imitation learning (AIL), a subset of IL methods, is particularly promising, but its theoretical foundation in…

Machine Learning · Computer Science 2023-06-14 Tian Xu , Ziniu Li , Yang Yu , Zhi-Quan Luo

Adversarial imitation learning (AIL) has become a popular alternative to supervised imitation learning that reduces the distribution shift suffered by the latter. However, AIL requires effective exploration during an online reinforcement…

Machine Learning · Computer Science 2023-10-16 Trevor Ablett , Bryan Chan , Jonathan Kelly