中文
相关论文

相关论文: Imitation Learning from Imperfect Demonstration

200 篇论文

Imitation learning is a widely used approach for training agents to replicate expert behavior in complex decision-making tasks. However, existing methods often struggle with compounding errors and limited generalization, due to the inherent…

机器学习 · 计算机科学 2025-04-21 Haldun Balim , Yang Hu , Yuyang Zhang , Na Li

A key challenge in Imitation Learning (IL) is that optimal state actions demonstrations are difficult for the teacher to provide. For example in robotics, providing kinesthetic demonstrations on a robotic manipulator requires the teacher to…

机器人学 · 计算机科学 2021-04-05 Matthew Schmittle , Sanjiban Choudhury , Siddhartha S. Srinivasa

While reinforcement learning (RL) has shown promising performance, its sample complexity continues to be a substantial hurdle, restricting its broader application across a variety of domains. Imitation learning (IL) utilizes oracles to…

机器学习 · 计算机科学 2025-08-12 Xuefeng Liu , Takuma Yoneda , Rick L. Stevens , Matthew R. Walter , Yuxin Chen

Sidewalk micromobility is a promising solution for last-mile transportation, but current learning-based control methods struggle in complex urban environments. Imitation learning (IL) learns policies from human demonstrations, yet its…

机器人学 · 计算机科学 2026-03-25 Honglin He , Yukai Ma , Brad Squicciarini , Wayne Wu , Bolei Zhou

Generative Adversarial Imitation Learning (GAIL) is a powerful and practical approach for learning sequential decision-making policies. Different from Reinforcement Learning (RL), GAIL takes advantage of demonstration data by experts (e.g.,…

机器学习 · 计算机科学 2020-01-14 Minshuo Chen , Yizhou Wang , Tianyi Liu , Zhuoran Yang , Xingguo Li , Zhaoran Wang , Tuo Zhao

Imitation Learning from observation describes policy learning in a similar way to human learning. An agent's policy is trained by observing an expert performing a task. While many state-only imitation learning approaches are based on…

机器学习 · 计算机科学 2024-10-02 Damian Boborzi , Christoph-Nikolas Straehle , Jens S. Buchner , Lars Mikelsons

Imitation learning (IL) is a general learning paradigm for tackling sequential decision-making problems. Interactive imitation learning, where learners can interactively query for expert demonstrations, has been shown to achieve provably…

机器学习 · 计算机科学 2022-09-27 Yichen Li , Chicheng Zhang

Learning from Demonstration (LfD) is a popular approach that allows humans to teach robots new skills by showing the correct way(s) of performing the desired skill. Human-provided demonstrations, however, are not always optimal and the…

机器人学 · 计算机科学 2024-07-01 Brendan Hertel , S. Reza Ahmadzadeh

Limited data has become a major bottleneck in scaling up offline imitation learning (IL). In this paper, we propose enhancing IL performance under limited expert data by introducing a pre-training stage that learns dynamics representations,…

机器人学 · 计算机科学 2025-08-21 Haitong Ma , Bo Dai , Zhaolin Ren , Yebin Wang , Na Li

Nowadays, robots become a companion in everyday life. To be well-accepted by humans, robots should efficiently understand meanings of their partners' motions and body language, and respond accordingly. Learning concepts by imitation brings…

人工智能 · 计算机科学 2017-07-25 Mina Alibeigi , Majid Nili Ahmadabadi , Babak Nadjar Araabi

Standard imitation learning can fail when the expert demonstrators have different sensory inputs than the imitating agent. This is because partial observability gives rise to hidden confounders in the causal graph. In previous work, to work…

机器学习 · 计算机科学 2024-08-27 Risto Vuorio , Pim de Haan , Johann Brehmer , Hanno Ackermann , Daniel Dijkman , Taco Cohen

Adversarial Imitation Learning (AIL) is a class of algorithms in Reinforcement learning (RL), which tries to imitate an expert without taking any reward from the environment and does not provide expert behavior directly to the policy…

机器学习 · 计算机科学 2020-05-05 Samin Yeasar Arnob

Human demonstration data is often ambiguous and incomplete, motivating imitation learning approaches that also exhibit reliable planning behavior. A common paradigm to perform planning-from-demonstration involves learning a reward function…

Imitation learning (IL) has proven effective for enabling robots to acquire visuomotor skills through expert demonstrations. However, traditional IL methods are limited by their reliance on high-quality, often scarce, expert data, and…

机器人学 · 计算机科学 2025-09-05 Shuze Wang , Yunpeng Mei , Hongjie Cao , Yetian Yuan , Gang Wang , Jian Sun , Jie Chen

The emergence of in-context learning (ICL) enables large pre-trained language models (PLMs) to make predictions for unseen inputs without updating parameters. Despite its potential, ICL's effectiveness heavily relies on the quality,…

机器学习 · 计算机科学 2024-07-02 Xiaoling Zhou , Wei Ye , Yidong Wang , Chaoya Jiang , Zhemg Lee , Rui Xie , Shikun Zhang

Imitation learning methods seek to learn from an expert either through behavioral cloning (BC) of the policy or inverse reinforcement learning (IRL) of the reward. Such methods enable agents to learn complex tasks from humans that are…

机器学习 · 计算机科学 2023-12-07 Joe Watson , Sandy H. Huang , Nicolas Heess

Learning to imitate expert behavior from demonstrations can be challenging, especially in environments with high-dimensional, continuous observations and unknown dynamics. Supervised learning methods based on behavioral cloning (BC) suffer…

机器学习 · 计算机科学 2019-09-27 Siddharth Reddy , Anca D. Dragan , Sergey Levine

Self-imitation learning is a Reinforcement Learning (RL) method that encourages actions whose returns were higher than expected, which helps in hard exploration and sparse reward problems. It was shown to improve the performance of…

机器学习 · 计算机科学 2020-12-23 Johan Ferret , Olivier Pietquin , Matthieu Geist

For flexible yet safe imitation learning (IL), we propose theory and a modular method, with a safety layer that enables a closed-form probability density/gradient of the safe generative continuous policy, end-to-end generative adversarial…

机器学习 · 计算机科学 2023-07-31 Philipp Geiger , Christoph-Nikolas Straehle

Adversarial imitation learning has become a widely used imitation learning framework. The discriminator is often trained by taking expert demonstrations and policy trajectories as examples respectively from two categories (positive vs.…

机器学习 · 计算机科学 2023-02-14 Yunke Wang , Bo Du , Chang Xu