English
Related papers

Related papers: Generative Adversarial Self-Imitation Learning

200 papers

Generative Adversarial Imitation Learning (GAIL) is a powerful and practical approach for learning sequential decision-making policies. Different from Reinforcement Learning (RL), GAIL takes advantage of demonstration data by experts (e.g.,…

Machine Learning · Computer Science 2020-01-14 Minshuo Chen , Yizhou Wang , Tianyi Liu , Zhuoran Yang , Xingguo Li , Zhaoran Wang , Tuo Zhao

Generative adversarial imitation learning (GAIL) is a popular inverse reinforcement learning approach for jointly optimizing policy and reward from expert trajectories. A primary question about GAIL is whether applying a certain policy…

Machine Learning · Computer Science 2020-06-26 Ziwei Guan , Tengyu Xu , Yingbin Liang

GAIL is a recent successful imitation learning architecture that exploits the adversarial training procedure introduced in GANs. Albeit successful at generating behaviours similar to those demonstrated to the agent, GAIL suffers from a high…

Machine Learning · Computer Science 2019-03-11 Lionel Blondé , Alexandros Kalousis

Compared to reinforcement learning, imitation learning (IL) is a powerful paradigm for training agents to learn control policies efficiently from expert demonstrations. However, in most cases, obtaining demonstration data is costly and…

Machine Learning · Computer Science 2019-03-20 Naijun Liu , Tao Lu , Yinghao Cai , Boyao Li , Shuo Wang

Generative Adversarial Imitation Learning (GAIL) trains a generative policy to mimic a demonstrator. It uses on-policy Reinforcement Learning (RL) to optimize a reward signal derived from a GAN-like discriminator. A major drawback of GAIL…

Machine Learning · Computer Science 2024-10-30 Tianjiao Luo , Tim Pearce , Huayu Chen , Jianfei Chen , Jun Zhu

Imitation learning aims to learn a policy from observing expert demonstrations without access to reward signals from environments. Generative adversarial imitation learning (GAIL) formulates imitation learning as adversarial learning,…

Machine Learning · Computer Science 2024-11-27 Chun-Mao Lai , Hsiang-Chun Wang , Ping-Chun Hsieh , Yu-Chiang Frank Wang , Min-Hung Chen , Shao-Hua Sun

Reinforcement learning for multi-goal robot manipulation tasks poses significant challenges due to the diversity and complexity of the goal space. Techniques such as Hindsight Experience Replay (HER) have been introduced to improve learning…

Robotics · Computer Science 2025-06-17 Yingyi Kuang , Luis J. Manso , George Vogiatzis

The introduction of the generative adversarial imitation learning (GAIL) algorithm has spurred the development of scalable imitation learning approaches using deep neural networks. Many of the algorithms that followed used a similar…

Machine Learning · Computer Science 2023-09-21 Kai Arulkumaran , Dan Ogawa Lillrank

Generative adversarial imitation learning (GAIL) demonstrates tremendous success in practice, especially when combined with neural networks. Different from reinforcement learning, GAIL learns both policy and reward function from expert…

Machine Learning · Computer Science 2020-06-26 Yufeng Zhang , Qi Cai , Zhuoran Yang , Zhaoran Wang

Many tasks in practice require the collaboration of multiple agents through reinforcement learning. In general, cooperative multiagent reinforcement learning algorithms can be classified into two paradigms: Joint Action Learners (JALs) and…

Multiagent Systems · Computer Science 2019-09-26 Xiaotian Hao , Weixun Wang , Jianye Hao , Yaodong Yang

We study risk-sensitive imitation learning where the agent's goal is to perform at least as well as the expert in terms of a risk profile. We first formulate our risk-sensitive imitation learning setting. We consider the generative…

Machine Learning · Computer Science 2018-12-27 Jonathan Lacotte , Mohammad Ghavamzadeh , Yinlam Chow , Marco Pavone

Generative adversarial imitation learning (GAIL) has shown promising results by taking advantage of generative adversarial nets, especially in the field of robot learning. However, the requirement of isolated single modal demonstrations…

Machine Learning · Computer Science 2020-05-25 Cong Fei , Bin Wang , Yuzheng Zhuang , Zongzhang Zhang , Jianye Hao , Hongbo Zhang , Xuewu Ji , Wulong Liu

Generative adversarial imitation learning (GAIL) has attracted increasing attention in the field of robot learning. It enables robots to learn a policy to achieve a task demonstrated by an expert while simultaneously estimating the reward…

Machine Learning · Computer Science 2019-11-04 Kyoichiro Kobayashi , Takato Horii , Ryo Iwaki , Yukie Nagai , Minoru Asada

This paper considers learning robot locomotion and manipulation tasks from expert demonstrations. Generative adversarial imitation learning (GAIL) trains a discriminator that distinguishes expert from agent transitions, and in turn use a…

Machine Learning · Computer Science 2022-06-24 Tianyu Wang , Nikhil Karnwal , Nikolay Atanasov

Learning to imitate expert behavior from demonstrations can be challenging, especially in environments with high-dimensional, continuous observations and unknown dynamics. Supervised learning methods based on behavioral cloning (BC) suffer…

Machine Learning · Computer Science 2019-09-27 Siddharth Reddy , Anca D. Dragan , Sergey Levine

Imitation learning demonstrates remarkable performance in various domains. However, imitation learning is also constrained by many prerequisites. The research community has done intensive research to alleviate these constraints, such as…

Neural and Evolutionary Computing · Computer Science 2023-01-19 Boyuan Zheng , Jianlong Zhou , Fang Chen

We propose Generative Predecessor Models for Imitation Learning (GPRIL), a novel imitation learning algorithm that matches the state-action distribution to the distribution observed in expert demonstrations, using generative models to…

Machine Learning · Computer Science 2019-04-03 Yannick Schroecker , Mel Vecerik , Jonathan Scholz

In generative adversarial imitation learning (GAIL), the agent aims to learn a policy from an expert demonstration so that its performance cannot be discriminated from the expert policy on a certain predefined reward set. In this paper, we…

Machine Learning · Computer Science 2021-08-20 Zhihan Liu , Yufeng Zhang , Zuyue Fu , Zhuoran Yang , Zhaoran Wang

Generative Adversarial Networks (GANs) for text generation have recently received many criticisms, as they perform worse than their MLE counterparts. We suspect previous text GANs' inferior performance is due to the lack of a reliable…

Computation and Language · Computer Science 2021-04-28 Qingyang Wu , Lei Li , Zhou Yu

Generative Adversarial Imitation Learning suffers from the fundamental problem of reward bias stemming from the choice of reward functions used in the algorithm. Different types of biases also affect different types of environments - which…

Machine Learning · Computer Science 2020-09-22 Rohit Jena , Siddharth Agrawal , Katia Sycara
‹ Prev 1 2 3 10 Next ›