English
Related papers

Related papers: Augmented Reality Demonstrations for Scalable Robo…

200 papers

Dexterous manipulation is a crucial yet highly complex challenge in humanoid robotics, demanding precise, adaptable, and sample-efficient learning methods. As humanoid robots are usually designed to operate in human-centric environments and…

Robotics · Computer Science 2026-02-26 Edgar Welte , Rania Rayyes

Learning-based approaches, such as reinforcement learning (RL) and imitation learning (IL), have indicated superiority over rule-based approaches in complex urban autonomous driving environments, showing great potential to make intelligent…

Robotics · Computer Science 2022-05-31 Haochen Liu , Zhiyu Huang , Jingda Wu , Chen Lv

Imitation learning from human-provided demonstrations is a strong approach for learning policies for robot manipulation. While the ideal dataset for imitation learning is homogenous and low-variance -- reflecting a single, optimal method…

Robotics · Computer Science 2022-10-18 Kanishk Gandhi , Siddharth Karamcheti , Madeline Liao , Dorsa Sadigh

Approaches for teaching learning agents via human demonstrations have been widely studied and successfully applied to multiple domains. However, the majority of imitation learning work utilizes only behavioral information from the…

The overarching goal of this work is to efficiently enable end-users to correctly anticipate a robot's behavior in novel situations. Since a robot's behavior is often a direct result of its underlying objective function, our insight is that…

Robotics · Computer Science 2018-10-19 Sandy H. Huang , David Held , Pieter Abbeel , Anca D. Dragan

Legged robots have enormous potential in their range of capabilities, from navigating unstructured terrains to high-speed running. However, designing robust controllers for highly agile dynamic motions remains a substantial challenge for…

Robotics · Computer Science 2023-04-20 Laura Smith , J. Chase Kew , Tianyu Li , Linda Luu , Xue Bin Peng , Sehoon Ha , Jie Tan , Sergey Levine

Imitation learning is one of the methods for reproducing human demonstration adaptively in robots. So far, it has been found that generalization ability of the imitation learning enables the robots to perform tasks adaptably in untrained…

Robotics · Computer Science 2024-07-12 Kento Kawaharazuka , Yoichiro Kawamura , Kei Okada , Masayuki Inaba

We consider the problem of visual imitation learning without human supervision (e.g. kinesthetic teaching or teleoperation), nor access to an interactive reinforcement learning (RL) training environment. We present a geometric perspective…

Robotics · Computer Science 2020-03-06 Jun Jin , Laura Petrich , Masood Dehghan , Martin Jagersand

Imitation learning is a powerful machine learning algorithm for a robot to acquire manipulation skills. Nevertheless, many real-world manipulation tasks involve precise and dexterous robot-object interactions, which make it difficult for…

Robotics · Computer Science 2024-07-23 Zhao-Heng Yin , Pieter Abbeel

In this paper, we study the problem of enabling a vision-based robotic manipulation system to generalize to novel tasks, a long-standing challenge in robot learning. We approach the challenge from an imitation learning perspective, aiming…

Manipulating objects is a hallmark of human intelligence, and an important task in domains such as robotics. In principle, Reinforcement Learning (RL) offers a general approach to learn object manipulation. In practice, however, domains…

Robotics · Computer Science 2024-04-02 Dan Haramati , Tal Daniel , Aviv Tamar

In order for a robot to be a generalist that can perform a wide range of jobs, it must be able to acquire a wide variety of skills quickly and efficiently in complex unstructured environments. High-capacity models such as deep neural…

Machine Learning · Computer Science 2017-09-15 Chelsea Finn , Tianhe Yu , Tianhao Zhang , Pieter Abbeel , Sergey Levine

In contrast to single-skill tasks, long-horizon tasks play a crucial role in our daily life, e.g., a pouring task requires a proper concatenation of reaching, grasping and pouring subtasks. As an efficient solution for transferring human…

Robotics · Computer Science 2024-10-03 Shaokang Wu , Yijin Wang , Yanlong Huang

Imitation learning for acquiring generalizable policies often requires a large volume of demonstration data, making the process significantly costly. One promising strategy to address this challenge is to leverage the cognitive and…

Robotics · Computer Science 2025-06-09 Yutaro Ishida , Takamitsu Matsubara , Takayuki Kanai , Kazuhiro Shintani , Hiroshi Bito

Imitation Learning (IL) algorithms offer an efficient way to train an agent by mimicking an expert's behavior without requiring a reward function. IL algorithms often necessitate access to state and action information from expert…

Machine Learning · Computer Science 2025-09-25 Returaj Burnwal , Hriday Mehta , Nirav Pravinbhai Bhatt , Balaraman Ravindran

Guaranteeing constraint satisfaction is challenging in imitation learning (IL), particularly in tasks that require operating near a system's handling limits. Traditional IL methods, such as Behavior Cloning (BC), often struggle to enforce…

Machine Learning · Computer Science 2025-08-29 Shengfan Cao , Eunhyek Joa , Francesco Borrelli

Imitating human demonstrations is a promising approach to endow robots with various manipulation capabilities. While recent advances have been made in imitation learning and batch (offline) reinforcement learning, a lack of open-source…

Robotic reinforcement learning (RL) holds the promise of enabling robots to learn complex behaviors through experience. However, realizing this promise for long-horizon tasks in the real world requires mechanisms to reduce human burden in…

Robotics · Computer Science 2020-06-23 Laura Smith , Nikita Dhawan , Marvin Zhang , Pieter Abbeel , Sergey Levine

Imitation learning (IL) and reinforcement learning (RL) each offer distinct advantages for robotics policy learning: IL provides stable learning from demonstrations, and RL promotes generalization through exploration. While existing robot…

Hand-crafting generalised decision-making rules for real-world urban autonomous driving is hard. Alternatively, learning behaviour from easy-to-collect human driving demonstrations is appealing. Prior work has studied imitation learning…

Computer Vision and Pattern Recognition · Computer Science 2019-12-06 Jeffrey Hawke , Richard Shen , Corina Gurau , Siddharth Sharma , Daniele Reda , Nikolay Nikolov , Przemyslaw Mazur , Sean Micklethwaite , Nicolas Griffiths , Amar Shah , Alex Kendall