中文
相关论文

相关论文: Value from Observations: Towards Large-Scale Imita…

200 篇论文

Reinforcement learning offers the promise of automating the acquisition of complex behavioral skills. However, compared to commonly used and well-understood supervised learning methods, reinforcement learning algorithms can be brittle,…

机器学习 · 计算机科学 2020-01-01 Aviral Kumar , Xue Bin Peng , Sergey Levine

When a person is not satisfied with how a robot performs a task, they can intervene to correct it. Reward learning methods enable the robot to adapt its reward function online based on such human input, but they rely on handcrafted…

机器人学 · 计算机科学 2021-01-13 Andreea Bobu , Marius Wiggert , Claire Tomlin , Anca D. Dragan

A significant challenge for the practical application of reinforcement learning in the real world is the need to specify an oracle reward function that correctly defines a task. Inverse reinforcement learning (IRL) seeks to avoid this…

机器学习 · 计算机科学 2019-10-16 Kelvin Xu , Ellis Ratner , Anca Dragan , Sergey Levine , Chelsea Finn

A critical flaw of existing inverse reinforcement learning (IRL) methods is their inability to significantly outperform the demonstrator. This is because IRL typically seeks a reward function that makes the demonstrator appear near-optimal,…

机器学习 · 计算机科学 2019-07-10 Daniel S. Brown , Wonjoon Goo , Prabhat Nagarajan , Scott Niekum

Sidewalk micromobility is a promising solution for last-mile transportation, but current learning-based control methods struggle in complex urban environments. Imitation learning (IL) learns policies from human demonstrations, yet its…

机器人学 · 计算机科学 2026-03-25 Honglin He , Yukai Ma , Brad Squicciarini , Wayne Wu , Bolei Zhou

We develop a simple framework to learn bio-inspired foraging policies using human data. We conduct an experiment where humans are virtually immersed in an open field foraging environment and are trained to collect the highest amount of…

We introduce VIOLA, an object-centric imitation learning approach to learning closed-loop visuomotor policies for robot manipulation. Our approach constructs object-centric representations based on general object proposals from a…

机器人学 · 计算机科学 2023-03-09 Yifeng Zhu , Abhishek Joshi , Peter Stone , Yuke Zhu

Augmenting reinforcement learning with imitation learning is often hailed as a method by which to improve upon learning from scratch. However, most existing methods for integrating these two techniques are subject to several strong…

机器学习 · 计算机科学 2020-07-23 Brahma S. Pavse , Faraz Torabi , Josiah P. Hanna , Garrett Warnell , Peter Stone

Imitation learning is the task of replicating expert policy from demonstrations, without access to a reward function. This task becomes particularly challenging when the expert exhibits a mixture of behaviors. Prior work has introduced…

机器学习 · 计算机科学 2022-05-10 Arash Vahabpour , Tianyi Wang , Qiujing Lu , Omead Pooladzandi , Vwani Roychowdhury

Scaling model-based inverse reinforcement learning (IRL) to real robotic manipulation tasks with unknown dynamics remains an open problem. The key challenges lie in learning good dynamics models, developing algorithms that scale to…

机器人学 · 计算机科学 2023-03-08 Neha Das , Sarah Bechtle , Todor Davchev , Dinesh Jayaraman , Akshara Rai , Franziska Meier

How to make imitation learning more general when demonstrations are relatively limited has been a persistent problem in reinforcement learning (RL). Poor demonstrations lead to narrow and biased date distribution, non-Markovian human expert…

人工智能 · 计算机科学 2021-11-17 Haofeng Liu , Yiwen Chen , Jiayi Tan , Marcelo H Ang

We propose a self-supervised approach for learning representations and robotic behaviors entirely from unlabeled videos recorded from multiple viewpoints, and study how this representation can be used in two robotic imitation settings:…

计算机视觉与模式识别 · 计算机科学 2018-03-21 Pierre Sermanet , Corey Lynch , Yevgen Chebotar , Jasmine Hsu , Eric Jang , Stefan Schaal , Sergey Levine

Offline imitation learning enables learning a policy solely from a set of expert demonstrations, without any environment interaction. To alleviate the issue of distribution shift arising due to the small amount of expert data, recent works…

机器学习 · 计算机科学 2025-05-23 Udita Ghosh , Dripta S. Raychaudhuri , Jiachen Li , Konstantinos Karydis , Amit K. Roy-Chowdhury

In standard passive imitation learning, the goal is to learn a target policy by passively observing full execution trajectories of it. Unfortunately, generating such trajectories can require substantial expert effort and be impractical in…

机器学习 · 计算机科学 2012-10-19 Kshitij Judah , Alan Fern , Thomas G. Dietterich

This work presents a case study of a learning-based approach for target driven map-less navigation. The underlying navigation model is an end-to-end neural network which is trained using a combination of expert demonstrations, imitation…

机器人学 · 计算机科学 2018-09-03 Mark Pfeiffer , Samarth Shukla , Matteo Turchetta , Cesar Cadena , Andreas Krause , Roland Siegwart , Juan Nieto

Imitation learning (IL) algorithms use expert demonstrations to learn a specific task. Most of the existing approaches assume that all expert demonstrations are reliable and trustworthy, but what if there exist some adversarial…

机器学习 · 计算机科学 2021-01-06 Mostafa Hussein , Brendan Crowe , Marek Petrik , Momotaz Begum

Imitation learning holds tremendous promise in learning policies efficiently for complex decision making problems. Current state-of-the-art algorithms often use inverse reinforcement learning (IRL), where given a set of expert…

机器人学 · 计算机科学 2023-02-22 Siddhant Haldar , Vaibhav Mathur , Denis Yarats , Lerrel Pinto

Imitation learning is an effective alternative approach to learn a policy when the reward function is sparse. In this paper, we consider a challenging setting where an agent and an expert use different actions from each other. We assume…

机器学习 · 计算机科学 2019-08-27 Konrad Zolna , Negar Rostamzadeh , Yoshua Bengio , Sungjin Ahn , Pedro O. Pinheiro

In imitation learning, an agent learns how to behave in an environment with an unknown cost function by mimicking expert demonstrations. Existing imitation learning algorithms typically involve solving a sequence of planning or…

机器学习 · 计算机科学 2016-06-17 Jonathan Ho , Jayesh K. Gupta , Stefano Ermon

Many existing imitation learning datasets are collected from multiple demonstrators, each with different expertise at different parts of the environment. Yet, standard imitation learning algorithms typically treat all demonstrators as…

机器学习 · 计算机科学 2022-06-14 Mark Beliaev , Andy Shih , Stefano Ermon , Dorsa Sadigh , Ramtin Pedarsani