English
Related papers

Related papers: Imitation Learning for High Precision Peg-in-Hole …

200 papers

Imitation learning (IL) aims to learn an optimal policy from demonstrations. However, such demonstrations are often imperfect since collecting optimal ones is costly. To effectively learn from imperfect demonstrations, we propose a novel…

Machine Learning · Computer Science 2019-01-31 Yueh-Hua Wu , Nontawat Charoenphakdee , Han Bao , Voot Tangkaratt , Masashi Sugiyama

We show that a critical vulnerability in adversarial imitation is the tendency of discriminator networks to learn spurious associations between visual features and expert labels. When the discriminator focuses on task-irrelevant features,…

Even though the peg-hole insertion is one of the well-studied problems in robotics, it still remains a challenge for robots, especially when it comes to flexibility and the ability to generalize. Successful completion of the task requires…

Robotics · Computer Science 2020-06-01 Damian Bogunowicz , Aleksandr Rybnikov , Komal Vendidandi , Fedor Chervinskii

Generative adversarial imitation learning (GAIL) is a popular inverse reinforcement learning approach for jointly optimizing policy and reward from expert trajectories. A primary question about GAIL is whether applying a certain policy…

Machine Learning · Computer Science 2020-06-26 Ziwei Guan , Tengyu Xu , Yingbin Liang

Compared to traditional imitation learning methods such as DAgger and DART, intervention-based imitation offers a more convenient and sample efficient data collection process to users. In this paper, we introduce Reinforced…

Robotics · Computer Science 2022-03-30 Rom Parnichkun , Matthew N. Dailey , Atsushi Yamashita

Learning generalizable insertion skills in a data-efficient manner has long been a challenge in the robot learning community. While the current state-of-the-art methods with reinforcement learning (RL) show promising performance in…

Robotics · Computer Science 2022-12-05 Zheng Wu , Wenzhao Lian , Changhao Wang , Mengxi Li , Stefan Schaal , Masayoshi Tomizuka

Offline Imitation Learning (IL) methods such as Behavior Cloning are effective at acquiring complex robotic manipulation skills. However, existing IL-trained policies are confined to executing the task at the same speed as shown in…

Generative Adversarial Imitation Learning (GAIL) is a powerful and practical approach for learning sequential decision-making policies. Different from Reinforcement Learning (RL), GAIL takes advantage of demonstration data by experts (e.g.,…

Machine Learning · Computer Science 2020-01-14 Minshuo Chen , Yizhou Wang , Tianyi Liu , Zhuoran Yang , Xingguo Li , Zhaoran Wang , Tuo Zhao

Construction robots are challenging the traditional paradigm of labor intensive and repetitive construction tasks. Present concerns regarding construction robots are focused on their abilities in performing complex tasks consisting of…

Robotics · Computer Science 2023-05-25 Kangkang Duan , Zhengbo Zou

Generative adversarial imitation learning (GAIL) has attracted increasing attention in the field of robot learning. It enables robots to learn a policy to achieve a task demonstrated by an expert while simultaneously estimating the reward…

Machine Learning · Computer Science 2019-11-04 Kyoichiro Kobayashi , Takato Horii , Ryo Iwaki , Yukie Nagai , Minoru Asada

Integration of reinforcement learning and imitation learning is an important problem that has been studied for a long time in the field of intelligent robotics. Reinforcement learning optimizes policies to maximize the cumulative reward,…

Machine Learning · Computer Science 2023-01-18 Akira Kinose , Tadahiro Taniguchi

This paper explores a simple regularizer for reinforcement learning by proposing Generative Adversarial Self-Imitation Learning (GASIL), which encourages the agent to imitate past good trajectories via generative adversarial imitation…

Machine Learning · Computer Science 2018-12-04 Yijie Guo , Junhyuk Oh , Satinder Singh , Honglak Lee

In generative adversarial imitation learning (GAIL), the agent aims to learn a policy from an expert demonstration so that its performance cannot be discriminated from the expert policy on a certain predefined reward set. In this paper, we…

Machine Learning · Computer Science 2021-08-20 Zhihan Liu , Yufeng Zhang , Zuyue Fu , Zhuoran Yang , Zhaoran Wang

Fine manipulation tasks, such as threading cable ties or slotting a battery, are notoriously difficult for robots because they require precision, careful coordination of contact forces, and closed-loop visual feedback. Performing these…

Robotics · Computer Science 2023-04-27 Tony Z. Zhao , Vikash Kumar , Sergey Levine , Chelsea Finn

In robotic manipulation, acquiring samples is extremely expensive because it often requires interacting with the real world. Traditional image-level data augmentation has shown the potential to improve sample efficiency in various machine…

Robotics · Computer Science 2022-11-02 Mingxi Jia , Dian Wang , Guanang Su , David Klee , Xupeng Zhu , Robin Walters , Robert Platt

Imitation learning is promising for robotic manipulation, but \emph{precise insertion} in the real world remains difficult due to contact-rich dynamics, tight clearances, and limited demonstrations. Many existing visuomotor policies depend…

Robotics · Computer Science 2026-03-25 Han Sun , Sheng Liu , Yizhao Wang , Zhenning Zhou , Shuai Wang , Haibo Yang , Jingyuan Sun , Qixin Cao

We study risk-sensitive imitation learning where the agent's goal is to perform at least as well as the expert in terms of a risk profile. We first formulate our risk-sensitive imitation learning setting. We consider the generative…

Machine Learning · Computer Science 2018-12-27 Jonathan Lacotte , Mohammad Ghavamzadeh , Yinlam Chow , Marco Pavone

We demonstrate the first large-scale application of model-based generative adversarial imitation learning (MGAIL) to the task of dense urban self-driving. We augment standard MGAIL using a hierarchical model to enable generalization to…

Interactive Imitation Learning (IIL) allows agents to acquire desired behaviors through human interventions, but current methods impose high cognitive demands on human supervisors. We propose the Adaptive Intervention Mechanism (AIM), a…

Artificial Intelligence · Computer Science 2025-06-12 Haoyuan Cai , Zhenghao Peng , Bolei Zhou

Learning to solve complex manipulation tasks from visual observations is a dominant challenge for real-world robot learning. Although deep reinforcement learning algorithms have recently demonstrated impressive results in this context, they…

Robotics · Computer Science 2022-01-20 Eugenio Chisari , Tim Welschehold , Joschka Boedecker , Wolfram Burgard , Abhinav Valada