中文
相关论文

相关论文: DEALIO: Data-Efficient Adversarial Learning for Im…

200 篇论文

Imitation Learning (IL) algorithms offer an efficient way to train an agent by mimicking an expert's behavior without requiring a reward function. IL algorithms often necessitate access to state and action information from expert…

机器学习 · 计算机科学 2025-09-25 Returaj Burnwal , Hriday Mehta , Nirav Pravinbhai Bhatt , Balaraman Ravindran

We study Imitation Learning (IL) from Observations alone (ILFO) in large-scale MDPs. While most IL algorithms rely on an expert to directly provide actions to the learner, in this setting the expert only supplies sequences of observations.…

机器学习 · 计算机科学 2019-06-12 Wen Sun , Anirudh Vemula , Byron Boots , J. Andrew Bagnell

Recent research on vulnerabilities of deep reinforcement learning (RL) has shown that adversarial policies adopted by an adversary agent can influence a target RL agent (victim agent) to perform poorly in a multi-agent environment. In…

机器学习 · 计算机科学 2022-11-01 The Viet Bui , Tien Mai , Thanh H. Nguyen

Adversarial Imitation Learning alternates between learning a discriminator -- which tells apart expert's demonstrations from generated ones -- and a generator's policy to produce trajectories that can fool this discriminator. This…

机器学习 · 计算机科学 2021-04-19 Paul Barde , Julien Roy , Wonseok Jeon , Joelle Pineau , Christopher Pal , Derek Nowrouzezahrai

In standard passive imitation learning, the goal is to learn a target policy by passively observing full execution trajectories of it. Unfortunately, generating such trajectories can require substantial expert effort and be impractical in…

机器学习 · 计算机科学 2012-10-19 Kshitij Judah , Alan Fern , Thomas G. Dietterich

This paper studies Learning from Observations (LfO) for imitation learning with access to state-only demonstrations. In contrast to Learning from Demonstration (LfD) that involves both action and state supervision, LfO is more practical in…

机器学习 · 计算机科学 2019-11-19 Chao Yang , Xiaojian Ma , Wenbing Huang , Fuchun Sun , Huaping Liu , Junzhou Huang , Chuang Gan

Learning from demonstrations has made great progress over the past few years. However, it is generally data hungry and task specific. In other words, it requires a large amount of data to train a decent model on a particular task, and the…

机器学习 · 计算机科学 2021-03-29 Pin Wang , Hanhan Li , Ching-Yao Chan

Learning from demonstrations is a useful way to transfer a skill from one agent to another. While most imitation learning methods aim to mimic an expert skill by following the demonstration step-by-step, imitating every step in the…

机器人学 · 计算机科学 2019-12-18 Youngwoon Lee , Edward S. Hu , Zhengyu Yang , Joseph J. Lim

Imitation Learning from observation describes policy learning in a similar way to human learning. An agent's policy is trained by observing an expert performing a task. While many state-only imitation learning approaches are based on…

机器学习 · 计算机科学 2024-10-02 Damian Boborzi , Christoph-Nikolas Straehle , Jens S. Buchner , Lars Mikelsons

Imitation learning is an effective approach for autonomous systems to acquire control policies when an explicit reward function is unavailable, using supervision provided as demonstrations from an expert, typically a human operator.…

机器学习 · 计算机科学 2018-06-20 YuXuan Liu , Abhishek Gupta , Pieter Abbeel , Sergey Levine

The goal of imitation learning is to mimic expert behavior from demonstrations, without access to an explicit reward signal. A popular class of approach infers the (unknown) reward function via inverse reinforcement learning (IRL) followed…

机器学习 · 计算机科学 2022-04-19 Carl Qi , Pieter Abbeel , Aditya Grover

Imitation learning from observation (LfO) is more preferable than imitation learning from demonstration (LfD) due to the nonnecessity of expert actions when reconstructing the expert policy from the expert data. However, previous studies…

机器人学 · 计算机科学 2020-10-19 Zhihao Cheng , Liu Liu , Aishan Liu , Hao Sun , Meng Fang , Dacheng Tao

We tackle the problem of policy learning from expert demonstrations without a reward function. A central challenge in this space is that these policies fail upon deployment due to issues of distributional shift, environment stochasticity,…

机器学习 · 计算机科学 2024-08-19 Victor Kolev , Rafael Rafailov , Kyle Hatch , Jiajun Wu , Chelsea Finn

Adversarial methods for imitation learning have been shown to perform well on various control tasks. However, they require a large number of environment interactions for convergence. In this paper, we propose an end-to-end differentiable…

机器学习 · 计算机科学 2019-03-11 Vaibhav Saxena , Srinivasan Sivanandan , Pulkit Mathur

Human demonstration data is often ambiguous and incomplete, motivating imitation learning approaches that also exhibit reliable planning behavior. A common paradigm to perform planning-from-demonstration involves learning a reward function…

Imitation learning (IL) enables agents to mimic expert behaviors. Most previous IL techniques focus on precisely imitating one policy through mass demonstrations. However, in many applications, what humans require is the ability to perform…

Imitation learning enables robots to learn from demonstrations. Previous imitation learning algorithms usually assume access to optimal expert demonstrations. However, in many real-world applications, this assumption is limiting. Most…

机器学习 · 计算机科学 2021-03-11 Zhangjie Cao , Dorsa Sadigh

Humans often learn how to perform tasks via imitation: they observe others perform a task, and then very quickly infer the appropriate actions to take based on their observations. While extending this paradigm to autonomous agents is a…

人工智能 · 计算机科学 2018-05-15 Faraz Torabi , Garrett Warnell , Peter Stone

Learning complex policies with Reinforcement Learning (RL) is often hindered by instability and slow convergence, a problem exacerbated by the difficulty of reward engineering. Imitation Learning (IL) from expert demonstrations bypasses…

机器学习 · 计算机科学 2026-05-19 Sayambhu Sen , Shalabh Bhatnagar

Imitation learning (IL) is a popular paradigm for training policies in robotic systems when specifying the reward function is difficult. However, despite the success of IL algorithms, they impose the somewhat unrealistic requirement that…