中文
相关论文

相关论文: Augmenting GAIL with BC for sample efficient imita…

200 篇论文

Most existing imitation learning approaches assume the demonstrations are drawn from experts who are optimal, but relaxing this assumption enables us to use a wider range of data. Standard imitation learning may learn a suboptimal policy…

机器学习 · 计算机科学 2022-01-27 Songyuan Zhang , Zhangjie Cao , Dorsa Sadigh , Yanan Sui

Approaches based on generative adversarial networks for imitation learning are promising because they are sample efficient in terms of expert demonstrations. However, training a generator requires many interactions with the actual…

机器学习 · 计算机科学 2022-09-01 Eiji Uchibe

Learning from demonstration is widely used as an efficient way for robots to acquire new skills. However, it typically requires that demonstrations provide full access to the state and action sequences. In contrast, learning from…

机器学习 · 计算机科学 2020-08-05 Zachary W. Robertson , Matthew R. Walter

A major bottleneck in imitation learning is the requirement of a large number of expert demonstrations, which can be expensive or inaccessible. Learning from supplementary demonstrations without strict quality requirements has emerged as a…

机器学习 · 计算机科学 2024-12-31 Jiangdong Fan , Hongcai He , Paul Weng , Hui Xu , Jie Shao

Imitation learning (IL) is a framework that learns to imitate expert behavior from demonstrations. Recently, IL shows promising results on high dimensional and control tasks. However, IL typically suffers from sample inefficiency in terms…

机器学习 · 计算机科学 2021-11-24 Lihua Zhang

Behavior cloning has shown success in many sequential decision-making tasks by learning from expert demonstrations, yet they can be very sample inefficient and fail to generalize to unseen scenarios. One approach to these problems is to…

人工智能 · 计算机科学 2026-02-05 Feiyu Zhu , Jean Oh , Reid Simmons

Imitation learning is often used in addition to reinforcement learning in environments where reward design is difficult or where the reward is sparse, but it is difficult to be able to imitate well in unknown states from a small amount of…

机器学习 · 计算机科学 2024-01-31 Ryoma Furuyama , Daiki Kuyoshi , Satoshi Yamane

Generative Behavior Cloning (GBC) is a simple yet effective framework for robot learning, particularly in multi-task settings. Recent GBC methods often employ diffusion policies with open-loop (OL) control, where actions are generated via a…

机器人学 · 计算机科学 2025-10-15 Junhyuk So , Chiwoong Lee , Shinyoung Lee , Jungseul Ok , Eunhyeok Park

Generative adversarial imitation learning (GAIL) has attracted increasing attention in the field of robot learning. It enables robots to learn a policy to achieve a task demonstrated by an expert while simultaneously estimating the reward…

机器学习 · 计算机科学 2019-11-04 Kyoichiro Kobayashi , Takato Horii , Ryo Iwaki , Yukie Nagai , Minoru Asada

Since the introduction of GAIL, adversarial imitation learning (AIL) methods attract lots of research interests. Among these methods, ValueDice has achieved significant improvements: it beats the classical approach Behavioral Cloning (BC)…

机器学习 · 计算机科学 2022-05-30 Ziniu Li , Tian Xu , Yang Yu , Zhi-Quan Luo

We study offline imitation learning (IL) when part of the decision-relevant state is observed only through noisy measurements and the distribution may change between training and deployment. Such settings induce spurious state-action…

机器学习 · 计算机科学 2026-02-02 Shi Bo , AmirEmad Ghassami

Consider learning an imitation policy on the basis of demonstrated behavior from multiple environments, with an eye towards deployment in an unseen environment. Since the observable features from each setting may be different, directly…

机器学习 · 统计学 2023-11-06 Ioana Bica , Daniel Jarrett , Mihaela van der Schaar

Imitation learning is a widely used approach for training agents to replicate expert behavior in complex decision-making tasks. However, existing methods often struggle with compounding errors and limited generalization, due to the inherent…

机器学习 · 计算机科学 2025-04-21 Haldun Balim , Yang Hu , Yuyang Zhang , Na Li

Adversarial Imitation Learning (AIL) is a broad family of imitation learning methods designed to mimic expert behaviors from demonstrations. While AIL has shown state-of-the-art performance on imitation learning with only small number of…

机器学习 · 计算机科学 2020-02-21 Ruohan Wang , Carlo Ciliberto , Pierluigi Amadori , Yiannis Demiris

Deep generative models have recently shown great promise in imitation learning for motor control. Given enough data, even supervised approaches can do one-shot imitation learning; however, they are vulnerable to cascading failures when the…

机器学习 · 计算机科学 2017-07-17 Ziyu Wang , Josh Merel , Scott Reed , Greg Wayne , Nando de Freitas , Nicolas Heess

Generative adversarial imitation learning (GAIL) has shown promising results by taking advantage of generative adversarial nets, especially in the field of robot learning. However, the requirement of isolated single modal demonstrations…

机器学习 · 计算机科学 2020-05-25 Cong Fei , Bin Wang , Yuzheng Zhuang , Zongzhang Zhang , Jianye Hao , Hongbo Zhang , Xuewu Ji , Wulong Liu

Class incremental learning (CIL) trains a network on sequential tasks with separated categories in each task but suffers from catastrophic forgetting, where models quickly lose previously learned knowledge when acquiring new tasks. The…

机器学习 · 计算机科学 2024-11-05 Huiping Zhuang , Yizhu Chen , Di Fang , Run He , Kai Tong , Hongxin Wei , Ziqian Zeng , Cen Chen

Online imitation learning (IL) is an algorithmic framework that leverages interactions with expert policies for efficient policy optimization. Here policies are optimized by performing online learning on a sequence of loss functions that…

机器学习 · 计算机科学 2021-02-23 Xinyan Yan , Byron Boots , Ching-An Cheng

Offline Imitation Learning (IL) methods such as Behavior Cloning are effective at acquiring complex robotic manipulation skills. However, existing IL-trained policies are confined to executing the task at the same speed as shown in…

In many settings, it is desirable to learn decision-making and control policies through learning or bootstrapping from expert demonstrations. The most common approaches under this Imitation Learning (IL) framework are Behavioural Cloning…

机器学习 · 计算机科学 2019-11-07 Seyed Kamyar Seyed Ghasemipour , Richard Zemel , Shixiang Gu