中文
相关论文

相关论文: Provably Efficient Imitation Learning from Observa…

200 篇论文

Offline imitation from observations aims to solve MDPs where only task-specific expert states and task-agnostic non-expert state-action pairs are available. Offline imitation is useful in real-world scenarios where arbitrary interactions…

机器学习 · 计算机科学 2023-11-03 Kai Yan , Alexander G. Schwing , Yu-Xiong Wang

Learning from demonstrations has made great progress over the past few years. However, it is generally data hungry and task specific. In other words, it requires a large amount of data to train a decent model on a particular task, and the…

机器学习 · 计算机科学 2021-03-29 Pin Wang , Hanhan Li , Ching-Yao Chan

Imitation learning (IL) enables agents to mimic expert behavior without reward signals but faces challenges in cross-domain scenarios with high-dimensional, noisy, and incomplete visual observations. To address this, we propose…

计算机视觉与模式识别 · 计算机科学 2025-02-17 Minung Kim , Kawon Lee , Jungmo Kim , Sungho Choi , Seungyul Han

Imitation Learning (IL) aims to discover a policy by minimizing the discrepancy between the agent's behavior and expert demonstrations. However, IL is susceptible to limitations imposed by noisy demonstrations from non-expert behaviors,…

机器学习 · 计算机科学 2023-10-25 Ye Yuan , Xin Li , Yong Heng , Leiji Zhang , MingZhong Wang

Offline reinforcement learning (RL) tasks require the agent to learn from a pre-collected dataset with no further interactions with the environment. Despite the potential to surpass the behavioral policies, RL-based methods are generally…

机器学习 · 计算机科学 2022-01-13 Minghuan Liu , Hanye Zhao , Zhengyu Yang , Jian Shen , Weinan Zhang , Li Zhao , Tie-Yan Liu

Adversarial Imitation Learning (AIL) is a broad family of imitation learning methods designed to mimic expert behaviors from demonstrations. While AIL has shown state-of-the-art performance on imitation learning with only small number of…

机器学习 · 计算机科学 2020-02-21 Ruohan Wang , Carlo Ciliberto , Pierluigi Amadori , Yiannis Demiris

We present the ADaptive Adversarial Imitation Learning (ADAIL) algorithm for learning adaptive policies that can be transferred between environments of varying dynamics, by imitating a small number of demonstrations collected from a single…

机器学习 · 计算机科学 2020-08-31 Yiren Lu , Jonathan Tompson

Imitation learning (IL) from a state-based reinforcement learning (RL) policy is a common approach to overcome the curse of dimensionality in complex and high-dimensional observation spaces prevalent in robotics. This paper addresses the…

机器学习 · 计算机科学 2026-05-28 Meraj Mammadov , Pedro Zuidberg Dos Martires , Johannes Andreas Stork

One of the main challenges in imitation learning is determining what action an agent should take when outside the state distribution of the demonstrations. Inverse reinforcement learning (IRL) can enable generalization to new states by…

机器学习 · 计算机科学 2024-03-04 Daniel S. Brown , Scott Niekum , Marek Petrik

The imitation learning research community has recently made significant progress towards the goal of enabling artificial agents to imitate behaviors from video demonstrations alone. However, current state-of-the-art approaches developed for…

机器人学 · 计算机科学 2022-07-28 Haresh Karnan , Garrett Warnell , Faraz Torabi , Peter Stone

Humans often learn how to perform tasks via imitation: they observe others perform a task, and then very quickly infer the appropriate actions to take based on their observations. While extending this paradigm to autonomous agents is a…

人工智能 · 计算机科学 2018-05-15 Faraz Torabi , Garrett Warnell , Peter Stone

Recent years have witnessed impressive robotic manipulation systems driven by advances in imitation learning and generative modeling, such as diffusion- and flow-based approaches. As robot policy performance increases, so does the…

Despite the considerable potential of reinforcement learning (RL), robotic control tasks predominantly rely on imitation learning (IL) due to its better sample efficiency. However, it is costly to collect comprehensive expert demonstrations…

机器学习 · 计算机科学 2024-05-22 Hengyuan Hu , Suvir Mirchandani , Dorsa Sadigh

Interactive-Grounded Learning (IGL) [Xie et al., 2021] is a powerful framework in which a learner aims at maximizing unobservable rewards through interacting with an environment and observing reward-dependent feedback on the taken actions.…

机器学习 · 计算机科学 2024-06-03 Mengxiao Zhang , Yuheng Zhang , Haipeng Luo , Paul Mineiro

In many sequential decision-making problems (e.g., robotics control, game playing, sequential prediction), human or expert data is available containing useful information about the task. However, imitation learning (IL) from a small amount…

机器学习 · 计算机科学 2022-11-04 Divyansh Garg , Shuvam Chakraborty , Chris Cundy , Jiaming Song , Matthieu Geist , Stefano Ermon

Imitation Learning (IL) has proven highly effective for robotic and control tasks where manually designing reward functions or explicit controllers is infeasible. However, standard IL methods implicitly assume that the environment dynamics…

机器学习 · 计算机科学 2025-11-12 Rishabh Agrawal , Yusuf Alvi , Rahul Jain , Ashutosh Nayyar

Imitation learning algorithms learn viable policies by imitating an expert's behavior when reward signals are not available. Generative Adversarial Imitation Learning (GAIL) is a state-of-the-art algorithm for learning policies when the…

Model-free learning-based control methods have recently shown significant advantages over traditional control methods in avoiding complex vehicle characteristic estimation and parameter tuning. As a primary policy learning method, imitation…

机器人学 · 计算机科学 2024-04-29 C. Gong , C. Lu , Z. Li , Z. Liu , J. Gong , X. Chen

Sample efficiency is critical in solving real-world reinforcement learning problems, where agent-environment interactions can be costly. Imitation learning from expert advice has proved to be an effective strategy for reducing the number of…

机器学习 · 计算机科学 2018-10-16 Ching-An Cheng , Xinyan Yan , Evangelos A. Theodorou , Byron Boots

We consider the problem of Imitation Learning (IL) by actively querying noisy expert for feedback. While imitation learning has been empirically successful, much of prior work assumes access to noiseless expert feedback which is not…

机器学习 · 计算机科学 2023-07-12 Ayush Sekhari , Karthik Sridharan , Wen Sun , Runzhe Wu