English
Related papers

Related papers: Behavioral Cloning from Observation

200 papers

Humans are adept at learning new tasks by watching a few instructional videos. On the other hand, robots that learn new actions either require a lot of effort through trial and error, or use expert demonstrations that are challenging to…

Robotics · Computer Science 2020-11-16 Vladimír Petrík , Makarand Tapaswi , Ivan Laptev , Josef Sivic

Imitation learning (IL) is a frequently used approach for data-efficient policy learning. Many IL methods, such as Dataset Aggregation (DAgger), combat challenges like distributional shift by interacting with oracular experts.…

Robotics · Computer Science 2021-06-08 Mandy Xie , Anqi Li , Karl Van Wyk , Frank Dellaert , Byron Boots , Nathan Ratliff

This paper describes methods for training autonomous agents to play the game "Doom 2" through Imitation Learning (IL) using only pixel data as input. We also explore how Reinforcement Learning (RL) compares to IL for humanness by comparing…

Machine Learning · Computer Science 2024-01-09 Ryan Spick , Timothy Bradley , Ayush Raina , Pierluigi Vito Amadori , Guy Moss

Generative Behavior Cloning (GBC) is a simple yet effective framework for robot learning, particularly in multi-task settings. Recent GBC methods often employ diffusion policies with open-loop (OL) control, where actions are generated via a…

Robotics · Computer Science 2025-10-15 Junhyuk So , Chiwoong Lee , Shinyoung Lee , Jungseul Ok , Eunhyeok Park

Imitation learning is a promising approach for training autonomous vehicles (AV) to navigate complex traffic environments by mimicking expert driver behaviors. While existing imitation learning frameworks focus on leveraging expert…

Robotics · Computer Science 2025-09-25 Yasin Sonmez , Hanna Krasowski , Murat Arcak

Behavior cloning (BC) is a popular supervised imitation learning method in the societies of robotics, autonomous driving, etc., wherein complex skills can be learned by direct imitation from expert demonstrations. Despite its rapid…

Robotics · Computer Science 2024-08-21 Wensheng Liang , Jun Xie , Zhicheng Wang , Jianwei Tan , Xiaoguang Ma

In sequential decision-making environments, the primary approaches for training agents are Reinforcement Learning (RL) and Imitation Learning (IL). Unlike RL, which relies on modeling a reward function, IL leverages expert demonstrations,…

Artificial Intelligence · Computer Science 2024-12-11 Jonas Nüßlein , Maximilian Zorn , Philipp Altmann , Claudia Linnhoff-Popien

In autonomous driving, end-to-end methods utilizing Imitation Learning (IL) and Reinforcement Learning (RL) are becoming more and more common. However, they do not involve explicit reasoning like classic robotics workflow and planning with…

Robotics · Computer Science 2024-10-23 Mingyan Zhou , Biao Wang , Tian Tan , Xiatao Sun

Imitation learning has traditionally been applied to learn a single task from demonstrations thereof. The requirement of structured and isolated demonstrations limits the scalability of imitation learning approaches as they are difficult to…

Robotics · Computer Science 2017-11-27 Karol Hausman , Yevgen Chebotar , Stefan Schaal , Gaurav Sukhatme , Joseph Lim

Acquiring multiple skills has commonly involved collecting a large number of expert demonstrations per task or engineering custom reward functions. Recently it has been shown that it is possible to acquire a diverse set of skills by…

Robotics · Computer Science 2020-06-15 Rostam Dinyari , Pierre Sermanet , Corey Lynch

Humans and animals are capable of learning a new behavior by observing others perform the skill just once. We consider the problem of allowing a robot to do the same -- learning from a raw video pixels of a human, even when there is…

Machine Learning · Computer Science 2018-02-06 Tianhe Yu , Chelsea Finn , Annie Xie , Sudeep Dasari , Tianhao Zhang , Pieter Abbeel , Sergey Levine

Behavioral cloning (BC) bears a high potential for safe and direct transfer of human skills to robots. However, demonstrations performed by human operators often contain noise or imperfect behaviors that can affect the efficiency of the…

Machine Learning · Computer Science 2021-08-03 Wendyam Eric Lionel Ilboudo , Taisuke Kobayashi , Kenji Sugimoto

Offline imitation from observations aims to solve MDPs where only task-specific expert states and task-agnostic non-expert state-action pairs are available. Offline imitation is useful in real-world scenarios where arbitrary interactions…

Machine Learning · Computer Science 2023-11-03 Kai Yan , Alexander G. Schwing , Yu-Xiong Wang

This paper studies Learning from Observations (LfO) for imitation learning with access to state-only demonstrations. In contrast to Learning from Demonstration (LfD) that involves both action and state supervision, LfO is more practical in…

Machine Learning · Computer Science 2019-11-19 Chao Yang , Xiaojian Ma , Wenbing Huang , Fuchun Sun , Huaping Liu , Junzhou Huang , Chuang Gan

A challenge in robot grasping is to achieve task-grasping which is to select a grasp that is advantageous to the success of tasks before and after grasps. One of the frameworks to address this difficulty is Learning-from-Observation (LfO),…

Robotics · Computer Science 2022-03-03 Daichi Saito , Kazuhiro Sasabuchi , Naoki Wake , Jun Takamatsu , Hideki Koike , Katsushi Ikeuchi

Imitation learning (IL) aims to learn an optimal policy from demonstrations. However, such demonstrations are often imperfect since collecting optimal ones is costly. To effectively learn from imperfect demonstrations, we propose a novel…

Machine Learning · Computer Science 2019-01-31 Yueh-Hua Wu , Nontawat Charoenphakdee , Han Bao , Voot Tangkaratt , Masashi Sugiyama

Unlike most reinforcement learning agents which require an unrealistic amount of environment interactions to learn a new behaviour, humans excel at learning quickly by merely observing and imitating others. This ability highly depends on…

Machine Learning · Computer Science 2023-12-05 Xingyuan Zhang , Philip Becker-Ehmck , Patrick van der Smagt , Maximilian Karl

Imitation learning offers a promising path for robots to learn general-purpose behaviors, but traditionally has exhibited limited scalability due to high data supervision requirements and brittle generalization. Inspired by recent advances…

Machine Learning · Computer Science 2022-11-16 Soroush Nasiriany , Tian Gao , Ajay Mandlekar , Yuke Zhu

Social learning plays an important role in the development of human intelligence. As children, we imitate our parents' speech patterns until we are able to produce sounds; we learn from them praising us and scolding us; and as adults, we…

Machine Learning · Computer Science 2024-08-06 Dylan Hillier , Cheston Tan , Jing Jiang

Autonomous manipulation in robot arms is a complex and evolving field of study in robotics. This paper proposes work stands at the intersection of two innovative approaches in the field of robotics and machine learning. Inspired by the…

Robotics · Computer Science 2024-02-01 Thanpimon Buamanee , Masato Kobayashi , Yuki Uranishi , Haruo Takemura