English
Related papers

Related papers: On-Policy Robot Imitation Learning from a Convergi…

200 papers

Although reinforcement learning methods offer a powerful framework for automatic skill acquisition, for practical learning-based control problems in domains such as robotics, imitation learning often provides a more convenient and…

Artificial Intelligence · Computer Science 2024-03-20 Jianlan Luo , Perry Dong , Yuexiang Zhai , Yi Ma , Sergey Levine

On-policy imitation learning algorithms such as DAgger evolve a robot control policy by executing it, measuring performance (loss), obtaining corrective feedback from a supervisor, and generating the next policy. As the loss between…

Robotics · Computer Science 2019-07-10 Jonathan N. Lee , Michael Laskey , Ajay Kumar Tanwani , Anil Aswani , Ken Goldberg

Imitation learning has been widely applied to various autonomous systems thanks to recent development in interactive algorithms that address covariate shift and compounding errors induced by traditional approaches like behavior cloning.…

Machine Learning · Computer Science 2024-05-03 Xiatao Sun , Shuo Yang , Mingyan Zhou , Kunpeng Liu , Rahul Mangharam

Imitation learning has proven to be useful for many real-world problems, but approaches such as behavioral cloning suffer from data mismatch and compounding error issues. One attempt to address these limitations is the DAgger algorithm,…

Robotics · Computer Science 2019-03-12 Michael Kelly , Chelsea Sidrane , Katherine Driggs-Campbell , Mykel J. Kochenderfer

One approach to Imitation Learning is Behavior Cloning, in which a robot observes a supervisor and infers a control policy. A known problem with this "off-policy" approach is that the robot's errors compound when drifting away from the…

Machine Learning · Computer Science 2018-02-01 Michael Laskey , Jonathan Lee , Roy Fox , Anca Dragan , Ken Goldberg

Imitation learning algorithms learn a policy from demonstrations of expert behavior. We show that, for deterministic experts, imitation learning can be done by reduction to reinforcement learning with a stationary reward. Our theoretical…

Machine Learning · Statistics 2022-03-16 Kamil Ciosek

Current reinforcement learning (RL) algorithms can be brittle and difficult to use, especially when learning goal-reaching behaviors from sparse rewards. Although supervised imitation learning provides a simple and stable alternative, it…

Machine Learning · Computer Science 2020-10-06 Dibya Ghosh , Abhishek Gupta , Ashwin Reddy , Justin Fu , Coline Devin , Benjamin Eysenbach , Sergey Levine

In this paper, We Apply Reinforcement learning (RL) techniques to train a realistic biomechanical model to work with different people and on different walking environments. We benchmarking 3 RL algorithms: Deep Deterministic Policy Gradient…

Artificial Intelligence · Computer Science 2019-01-16 Montaser Mohammedalamen , Waleed D. Khamies , Benjamin Rosman

One way to approach end-to-end autonomous driving is to learn a policy function that maps from a sensory input, such as an image frame from a front-facing camera, to a driving action, by imitating an expert driver, or a reference policy.…

Machine Learning · Computer Science 2016-05-23 Jiakai Zhang , Kyunghyun Cho

Learning complex policies with Reinforcement Learning (RL) is often hindered by instability and slow convergence, a problem exacerbated by the difficulty of reward engineering. Imitation Learning (IL) from expert demonstrations bypasses…

Machine Learning · Computer Science 2026-05-19 Sayambhu Sen , Shalabh Bhatnagar

Reinforcement learning (RL) algorithms have demonstrated promising results on complex tasks, yet often require impractical numbers of samples since they learn from scratch. Meta-RL aims to address this challenge by leveraging experience…

Machine Learning · Computer Science 2020-10-28 Russell Mendonca , Abhishek Gupta , Rosen Kralev , Pieter Abbeel , Sergey Levine , Chelsea Finn

Long-horizon LM agents learn from multi-turn interaction, where a single early mistake can alter the subsequent state distribution and derail the whole trajectory. Existing recipes fall short in complementary ways: supervised fine-tuning…

Machine Learning · Computer Science 2026-05-14 Changhao Li , Rushi Qiang , Jiawei Huang , Chenxiao Gao , Chao Zhang , Niao He , Bo Dai

Learning-based approaches for solving large sequential decision making problems have become popular in recent years. The resulting agents perform differently and their characteristics depend on those of the underlying learning approach.…

Machine Learning · Computer Science 2020-08-04 Timo P. Gros , Daniel Höller , Jörg Hoffmann , Verena Wolf

While reinforcement learning (RL) has shown promising performance, its sample complexity continues to be a substantial hurdle, restricting its broader application across a variety of domains. Imitation learning (IL) utilizes oracles to…

Machine Learning · Computer Science 2025-08-12 Xuefeng Liu , Takuma Yoneda , Rick L. Stevens , Matthew R. Walter , Yuxin Chen

Humans are experts at high-fidelity imitation -- closely mimicking a demonstration, often in one attempt. Humans use this ability to quickly solve a task instance, and to bootstrap learning of new tasks. Achieving these abilities in…

Deep learning techniques have been widely applied, achieving state-of-the-art results in various fields of study. This survey focuses on deep learning solutions that target learning control policies for robotics applications. We carry out…

Robotics · Computer Science 2018-04-10 Lei Tai , Jingwei Zhang , Ming Liu , Joschka Boedecker , Wolfram Burgard

Humans can leverage hierarchical structures to split a task into sub-tasks and solve problems efficiently. Both imitation and reinforcement learning or a combination of them with hierarchical structures have been proven to be an efficient…

Robotics · Computer Science 2020-12-15 Yaru Niu , Yijun Gu

Off-policy model-free deep reinforcement learning methods using previously collected data can improve sample efficiency over on-policy policy gradient techniques. On the other hand, on-policy algorithms are often more stable and easier to…

Machine Learning · Computer Science 2017-06-02 Shixiang Gu , Timothy Lillicrap , Zoubin Ghahramani , Richard E. Turner , Bernhard Schölkopf , Sergey Levine

Learning from demonstrations has made great progress over the past few years. However, it is generally data hungry and task specific. In other words, it requires a large amount of data to train a decent model on a particular task, and the…

Machine Learning · Computer Science 2021-03-29 Pin Wang , Hanhan Li , Ching-Yao Chan

Deep neural networks trained on demonstrations of human actions give robot the ability to perform self-driving on the road. However, navigation in a pedestrian-rich environment, such as a campus setup, is still challenging---one needs to…

Computer Vision and Pattern Recognition · Computer Science 2018-11-02 Jing Bi , Tianyou Xiao , Qiuyue Sun , Chenliang Xu
‹ Prev 1 2 3 10 Next ›