English
Related papers

Related papers: Injective State-Image Mapping facilitates Visual A…

200 papers

Imitation learning is a control design paradigm that seeks to learn a control policy reproducing demonstrations from expert agents. By substituting expert demonstrations for optimal behaviours, the same paradigm leads to the design of…

Machine Learning · Computer Science 2024-12-20 Dharmesh Tailor , Dario Izzo

We introduce a simple new method for visual imitation learning, which allows a novel robot manipulation task to be learned from a single human demonstration, without requiring any prior knowledge of the object being interacted with. Our…

Robotics · Computer Science 2021-06-11 Edward Johns

The imitation learning research community has recently made significant progress towards the goal of enabling artificial agents to imitate behaviors from video demonstrations alone. However, current state-of-the-art approaches developed for…

Robotics · Computer Science 2022-07-28 Haresh Karnan , Garrett Warnell , Faraz Torabi , Peter Stone

The development of sophisticated models for video-to-video synthesis has been facilitated by recent advances in deep reinforcement learning and generative adversarial networks (GANs). In this paper, we propose RL-V2V-GAN, a new deep neural…

Machine Learning · Computer Science 2024-10-29 Yintai Ma , Diego Klabjan , Jean Utke

Current reinforcement learning (RL) algorithms can be brittle and difficult to use, especially when learning goal-reaching behaviors from sparse rewards. Although supervised imitation learning provides a simple and stable alternative, it…

Machine Learning · Computer Science 2020-10-06 Dibya Ghosh , Abhishek Gupta , Ashwin Reddy , Justin Fu , Coline Devin , Benjamin Eysenbach , Sergey Levine

Imitation learning algorithms learn a policy from demonstrations of expert behavior. We show that, for deterministic experts, imitation learning can be done by reduction to reinforcement learning with a stationary reward. Our theoretical…

Machine Learning · Statistics 2022-03-16 Kamil Ciosek

In imitation learning from observation IfO, a learning agent seeks to imitate a demonstrating agent using only observations of the demonstrated behavior without access to the control signals generated by the demonstrator. Recent methods…

Machine Learning · Computer Science 2021-04-02 Faraz Torabi , Garrett Warnell , Peter Stone

Training a high-dimensional simulated agent with an under-specified reward function often leads the agent to learn physically infeasible strategies that are ineffective when deployed in the real world. To mitigate these unnatural behaviors,…

Artificial Intelligence · Computer Science 2022-03-30 Alejandro Escontrela , Xue Bin Peng , Wenhao Yu , Tingnan Zhang , Atil Iscen , Ken Goldberg , Pieter Abbeel

Agents that can learn to imitate given video observation -- \emph{without direct access to state or action information} are more applicable to learning in the natural world. However, formulating a reinforcement learning (RL) agent that…

Machine Learning · Computer Science 2023-07-14 Glen Berseth , Florian Golemo , Christopher Pal

Observing a human demonstrator manipulate objects provides a rich, scalable and inexpensive source of data for learning robotic policies. However, transferring skills from human videos to a robotic manipulator poses several challenges, not…

Robotics · Computer Science 2023-03-08 Minttu Alakuijala , Gabriel Dulac-Arnold , Julien Mairal , Jean Ponce , Cordelia Schmid

In order to enable high-quality decision making and motion planning of intelligent systems such as robotics and autonomous vehicles, accurate probabilistic predictions for surrounding interactive objects is a crucial prerequisite. Although…

Robotics · Computer Science 2019-04-05 Jiachen Li , Hengbo Ma , Masayoshi Tomizuka

In inverse reinforcement learning (IRL), an agent seeks to replicate expert demonstrations through interactions with the environment. Traditionally, IRL is treated as an adversarial game, where an adversary searches over reward models, and…

Machine Learning · Computer Science 2025-04-23 Arnav Kumar Jain , Harley Wiltzer , Jesse Farebrother , Irina Rish , Glen Berseth , Sanjiban Choudhury

The use of imitation learning to learn a single policy for a complex task that has multiple modes or hierarchical structure can be challenging. In fact, previous work has shown that when the modes are known, learning separate policies for…

Machine Learning · Computer Science 2019-03-13 Arjun Sharma , Mohit Sharma , Nicholas Rhinehart , Kris M. Kitani

Humans are adept at learning new tasks by watching a few instructional videos. On the other hand, robots that learn new actions either require a lot of effort through trial and error, or use expert demonstrations that are challenging to…

Robotics · Computer Science 2020-11-16 Vladimír Petrík , Makarand Tapaswi , Ivan Laptev , Josef Sivic

The field of visual representation learning has seen explosive growth in the past years, but its benefits in robotics have been surprisingly limited so far. Prior work uses generic visual representations as a basis to learn (task-specific)…

Robotics · Computer Science 2023-08-16 Jianren Wang , Sudeep Dasari , Mohan Kumar Srirama , Shubham Tulsiani , Abhinav Gupta

Learning from demonstrations has made great progress over the past few years. However, it is generally data hungry and task specific. In other words, it requires a large amount of data to train a decent model on a particular task, and the…

Machine Learning · Computer Science 2021-03-29 Pin Wang , Hanhan Li , Ching-Yao Chan

In this paper, we introduce MAAD, a novel, sample-efficient on-policy algorithm for Imitation Learning from Observations. MAAD utilizes a surrogate reward signal, which can be derived from various sources such as adversarial games,…

Machine Learning · Computer Science 2025-10-01 João A. Cândido Ramos , Lionel Blondé , Naoya Takeishi , Alexandros Kalousis

Synthesizing graceful and life-like behaviors for physically simulated characters has been a fundamental challenge in computer animation. Data-driven methods that leverage motion tracking are a prominent class of techniques for producing…

Graphics · Computer Science 2022-05-13 Xue Bin Peng , Ze Ma , Pieter Abbeel , Sergey Levine , Angjoo Kanazawa

While adversarial neural networks have been shown successful for static image attacks, very few approaches have been developed for attacking online image streams while taking into account the underlying physical dynamics of autonomous…

Robotics · Computer Science 2021-05-19 Hyung-Jin Yoon , Hamidreza Jafarnejadsani , Petros Voulgaris

The existing Motion Imitation models typically require expert data obtained through MoCap devices, but the vast amount of training data needed is difficult to acquire, necessitating substantial investments of financial resources, manpower,…

Robotics · Computer Science 2024-05-03 Liu Qiyuan