中文
相关论文

相关论文: Generative Adversarial Imitation from Observation

200 篇论文

Generative adversarial imitation learning (GAIL) has shown promising results by taking advantage of generative adversarial nets, especially in the field of robot learning. However, the requirement of isolated single modal demonstrations…

机器学习 · 计算机科学 2020-05-25 Cong Fei , Bin Wang , Yuzheng Zhuang , Zongzhang Zhang , Jianye Hao , Hongbo Zhang , Xuewu Ji , Wulong Liu

Generative adversarial imitation learning (GAIL) is a popular inverse reinforcement learning approach for jointly optimizing policy and reward from expert trajectories. A primary question about GAIL is whether applying a certain policy…

机器学习 · 计算机科学 2020-06-26 Ziwei Guan , Tengyu Xu , Yingbin Liang

Imitation learning trains a policy by mimicking expert demonstrations. Various imitation methods were proposed and empirically evaluated, meanwhile, their theoretical understanding needs further studies. In this paper, we firstly analyze…

机器学习 · 计算机科学 2020-10-23 Tian Xu , Ziniu Li , Yang Yu

Imitation learning methods have demonstrated considerable success in teaching autonomous systems complex tasks through expert demonstrations. However, a limitation of these methods is their lack of interpretability, particularly in…

机器学习 · 计算机科学 2025-07-21 Wenliang Liu , Danyang Li , Erfan Aasi , Daniela Rus , Roberto Tron , Calin Belta

Adversarial Imitation Learning is traditionally framed as a two-player zero-sum game between a learner and an adversarially chosen cost function, and can therefore be thought of as the sequential generalization of a Generative Adversarial…

机器学习 · 计算机科学 2025-03-04 Runzhe Wu , Yiding Chen , Gokul Swamy , Kianté Brantley , Wen Sun

Learning complex policies with Reinforcement Learning (RL) is often hindered by instability and slow convergence, a problem exacerbated by the difficulty of reward engineering. Imitation Learning (IL) from expert demonstrations bypasses…

机器学习 · 计算机科学 2026-05-19 Sayambhu Sen , Shalabh Bhatnagar

Consider an imitation learning problem that the imitator and the expert have different dynamics models. Most of the current imitation learning methods fail because they focus on imitating actions. We propose a novel state alignment-based…

机器学习 · 计算机科学 2019-11-26 Fangchen Liu , Zhan Ling , Tongzhou Mu , Hao Su

Learning from demonstration (LfD) has the potential to greatly increase the applicability of robotic manipulators in modern industrial applications. Recent progress in LfD methods have put more emphasis in learning robustness than in…

机器人学 · 计算机科学 2023-02-09 Fouad Sukkar , Victor Hernandez Moreno , Teresa Vidal-Calleja , Jochen Deuse

It is challenging learning from demonstrated observation-only trajectories in a non-time-aligned environment because most imitation learning methods aim to imitate experts by following the demonstration step-by-step. However, aligned…

机器学习 · 计算机科学 2024-10-30 Shanqi Liu , Junjie Cao , Wenzhou Chen , Licheng Wen , Yong Liu

Consider learning an imitation policy on the basis of demonstrated behavior from multiple environments, with an eye towards deployment in an unseen environment. Since the observable features from each setting may be different, directly…

机器学习 · 统计学 2023-11-06 Ioana Bica , Daniel Jarrett , Mihaela van der Schaar

Imitation learning trains policies to map from input observations to the actions that an expert would choose. In this setting, distribution shift frequently exacerbates the effect of misattributing expert actions to nuisance correlates…

机器学习 · 计算机科学 2020-10-29 Chuan Wen , Jierui Lin , Trevor Darrell , Dinesh Jayaraman , Yang Gao

Imitation learning (IL) enables agents to acquire skills by observing and replicating the behavior of one or multiple experts. In recent years, advances in deep learning have significantly expanded the capabilities and scalability of…

机器学习 · 计算机科学 2025-11-06 Iason Chrysomallis , Georgios Chalkiadakis

Adversarial imitation learning (AIL), a prominent approach in imitation learning, has achieved significant practical success powered by neural network approximation. However, existing theoretical analyses of AIL are primarily confined to…

机器学习 · 计算机科学 2026-05-05 Tian Xu , Zhilong Zhang , Zexuan Chen , Ruishuo Chen , Yihao Sun , Yang Yu

We consider the problem of learning from observation (LfO), in which the agent aims to mimic the expert's behavior from the state-only demonstrations by experts. We additionally assume that the agent cannot interact with the environment but…

机器学习 · 计算机科学 2022-10-19 Geon-Hyeong Kim , Jongmin Lee , Youngsoo Jang , Hongseok Yang , Kee-Eung Kim

In learning from demonstrations, many generative models of trajectories make simplifying assumptions of independence. Correctness is sacrificed in the name of tractability and speed of the learning phase. The ignored dependencies, which…

机器人学 · 计算机科学 2020-11-09 Emmanuel Pignat , Hakan Girgin , Sylvain Calinon

Imitation learning trains control policies by mimicking pre-recorded expert demonstrations. In partially observable settings, imitation policies must rely on observation histories, but many seemingly paradoxical results show better…

机器学习 · 计算机科学 2021-06-14 Chuan Wen , Jierui Lin , Jianing Qian , Yang Gao , Dinesh Jayaraman

Imitation Learning (IL) is a widely used framework for learning imitative behavior from demonstrations. It is especially appealing for solving complex real-world tasks where handcrafting reward function is difficult, or when the goal is to…

机器学习 · 计算机科学 2024-01-17 Chenran Li , Chen Tang , Haruki Nishimura , Jean Mercat , Masayoshi Tomizuka , Wei Zhan

The problem of Learning from Demonstration is targeted at learning to perform tasks based on observed examples. One approach to Learning from Demonstration is Inverse Reinforcement Learning, in which actions are observed to infer rewards.…

神经与进化计算 · 计算机科学 2016-08-11 Karan K. Budhraja , Tim Oates

Imitation learning aims to extract knowledge from human experts' demonstrations or artificially created agents in order to replicate their behaviors. Its success has been demonstrated in areas such as video games, autonomous driving,…

机器学习 · 计算机科学 2022-10-24 Boyuan Zheng , Sunny Verma , Jianlong Zhou , Ivor Tsang , Fang Chen

We tackle the problem of policy learning from expert demonstrations without a reward function. A central challenge in this space is that these policies fail upon deployment due to issues of distributional shift, environment stochasticity,…

机器学习 · 计算机科学 2024-08-19 Victor Kolev , Rafael Rafailov , Kyle Hatch , Jiajun Wu , Chelsea Finn