中文
相关论文

相关论文: MILES: Making Imitation Learning Easy with Self-Su…

200 篇论文

Deep reinforcement learning (RL) has shown immense potential for learning to control systems through data alone. However, one challenge deep RL faces is that the full state of the system is often not observable. When this is the case, the…

机器学习 · 计算机科学 2023-10-27 Ian Char , Jeff Schneider

The goal of imitation learning is to mimic expert behavior from demonstrations, without access to an explicit reward signal. A popular class of approach infers the (unknown) reward function via inverse reinforcement learning (IRL) followed…

机器学习 · 计算机科学 2022-04-19 Carl Qi , Pieter Abbeel , Aditya Grover

We study the problem of programmatic reinforcement learning, in which policies are represented as short programs in a symbolic language. Programmatic policies can be more interpretable, generalizable, and amenable to formal verification…

机器学习 · 计算机科学 2021-01-21 Abhinav Verma , Hoang M. Le , Yisong Yue , Swarat Chaudhuri

This paper presents a safe imitation learning approach for autonomous vehicle driving, with attention on real-life human driving data and experimental validation. In order to increase occupant's acceptance and gain drivers' trust, the…

系统与控制 · 电气工程与系统科学 2021-10-11 Flavia Sofia Acerbo , Mohsen Alirezaei , Herman Van der Auweraer , Tong Duy Son

Imitation learning methods seek to learn from an expert either through behavioral cloning (BC) of the policy or inverse reinforcement learning (IRL) of the reward. Such methods enable agents to learn complex tasks from humans that are…

机器学习 · 计算机科学 2023-12-07 Joe Watson , Sandy H. Huang , Nicolas Heess

The long-term goal of machine learning is to learn general visual representations from a small amount of data without supervision, mimicking three advantages of human cognition: i) no need for labels, ii) robustness to data scarcity, and…

机器学习 · 计算机科学 2023-08-29 Jingyao Wang , Zeen Song , Wenwen Qiang , Changwen Zheng

We study the problem of smooth imitation learning for online sequence prediction, where the goal is to train a policy that can smoothly imitate demonstrated behavior in a dynamic and continuous environment in response to online, sequential…

机器学习 · 计算机科学 2016-06-06 Hoang M. Le , Andrew Kang , Yisong Yue , Peter Carr

Transfer learning from large-scale pre-trained models has become essential for many computer vision tasks. Recent studies have shown that datasets like ImageNet are weakly labeled since images with multiple object classes present are…

计算机视觉与模式识别 · 计算机科学 2021-11-25 Sai Rajeswar , Pau Rodriguez , Soumye Singhal , David Vazquez , Aaron Courville

Everything else being equal, simpler models should be preferred over more complex ones. In reinforcement learning (RL), simplicity is typically quantified on an action-by-action basis -- but this timescale ignores temporal regularities,…

机器学习 · 计算机科学 2023-05-29 Tankred Saanum , Noémi Éltető , Peter Dayan , Marcel Binz , Eric Schulz

In this paper, we leverage the rapid advances in imitation learning, a topic of intense recent focus in the Reinforcement Learning (RL) literature, to develop new sample complexity results and performance guarantees for data-driven Model…

最优化与控制 · 数学 2022-10-18 Kwangjun Ahn , Zakaria Mhammedi , Horia Mania , Zhang-Wei Hong , Ali Jadbabaie

Imitation learning aims to extract knowledge from human experts' demonstrations or artificially created agents in order to replicate their behaviors. Its success has been demonstrated in areas such as video games, autonomous driving,…

机器学习 · 计算机科学 2022-10-24 Boyuan Zheng , Sunny Verma , Jianlong Zhou , Ivor Tsang , Fang Chen

Inverse reinforcement learning (IRL) infers a reward function from demonstrations, allowing for policy improvement and generalization. However, despite much recent interest in IRL, little work has been done to understand the minimum set of…

机器学习 · 计算机科学 2019-08-19 Daniel S. Brown , Scott Niekum

Imitation learning (IL) algorithms use expert demonstrations to learn a specific task. Most of the existing approaches assume that all expert demonstrations are reliable and trustworthy, but what if there exist some adversarial…

机器学习 · 计算机科学 2021-01-06 Mostafa Hussein , Brendan Crowe , Marek Petrik , Momotaz Begum

Our goal is for robots to follow natural language instructions like "put the towel next to the microwave." But getting large amounts of labeled data, i.e. data that contains demonstrations of tasks labeled with the language instruction, is…

Humans are capable of learning a new behavior by observing others perform the skill. Robots can also implement this by imitation learning. Furthermore, if with external guidance, humans will master the new behavior more efficiently. So how…

机器人学 · 计算机科学 2019-09-17 Boyi Liu , Lujia Wang , Ming Liu , Cheng-Zhong Xu

In imitation learning, imitators and demonstrators are policies for picking actions given past interactions with the environment. If we run an imitator, we probably want events to unfold similarly to the way they would have if the…

机器学习 · 计算机科学 2022-10-05 Michael K. Cohen , Marcus Hutter , Neel Nanda

One of the key challenges in visual imitation learning is collecting large amounts of expert demonstrations for a given task. While methods for collecting human demonstrations are becoming easier with teleoperation methods and the use of…

机器人学 · 计算机科学 2021-07-20 Sarah Young , Jyothish Pari , Pieter Abbeel , Lerrel Pinto

Imitation learning of robot policies from few demonstrations is crucial in open-ended applications. We propose a new method, Interaction Warping, for learning SE(3) robotic manipulation policies from a single demonstration. We infer the 3D…

Observational learning requires an agent to learn to perform a task by referencing only observations of the performed task. This work investigates the equivalent setting in real-world robot learning where access to hand-designed rewards and…

Class Incremental Learning (CIL) aims to sequentially learn new classes while avoiding catastrophic forgetting of previous knowledge. We propose to use Masked Autoencoders (MAEs) as efficient learners for CIL. MAEs were originally designed…

计算机视觉与模式识别 · 计算机科学 2023-08-25 Jiang-Tian Zhai , Xialei Liu , Andrew D. Bagdanov , Ke Li , Ming-Ming Cheng