English
Related papers

Related papers: Imitation Learning: Progress, Taxonomies and Chall…

200 papers

The goal of imitation learning is to mimic expert behavior from demonstrations, without access to an explicit reward signal. A popular class of approach infers the (unknown) reward function via inverse reinforcement learning (IRL) followed…

Machine Learning · Computer Science 2022-04-19 Carl Qi , Pieter Abbeel , Aditya Grover

Recent work has demonstrated that problems-- particularly imitation learning and structured prediction-- where a learner's predictions influence the input-distribution it is tested on can be naturally addressed by an interactive approach…

Machine Learning · Computer Science 2014-06-24 Stephane Ross , J. Andrew Bagnell

The goal of imitation learning is to mimic expert behavior without access to an explicit reward signal. Expert demonstrations provided by humans, however, often show significant variability due to latent factors that are typically not…

Machine Learning · Computer Science 2017-11-16 Yunzhu Li , Jiaming Song , Stefano Ermon

Humans can leverage hierarchical structures to split a task into sub-tasks and solve problems efficiently. Both imitation and reinforcement learning or a combination of them with hierarchical structures have been proven to be an efficient…

Robotics · Computer Science 2020-12-15 Yaru Niu , Yijun Gu

Imitation from observation is a computational technique that teaches an agent on how to mimic the behavior of an expert by observing only the sequence of states from the expert demonstrations. Recent approaches learn the inverse dynamics of…

Artificial Intelligence · Computer Science 2020-04-29 Juarez Monteiro , Nathan Gavenski , Roger Granada , Felipe Meneguzzi , Rodrigo Barros

Imitation learning often assumes that demonstrations are close to optimal according to some fixed, but unknown, cost function. However, according to satisficing theory, humans often choose acceptable behavior based on their personal (and…

Machine Learning · Computer Science 2025-05-27 Rushit N. Shah , Nikolaos Agadakos , Synthia Sasulski , Ali Farajzadeh , Sanjiban Choudhury , Brian Ziebart

Imitation learning has emerged as a powerful paradigm in robot manipulation, yet its generalization capability remains constrained by object-specific dependencies in limited expert demonstrations. To address this challenge, we propose…

Robotics · Computer Science 2025-06-27 Zhuochen Miao , Jun Lv , Hongjie Fang , Yang Jin , Cewu Lu

Training agents in multi-agent competitive games presents significant challenges due to their intricate nature. These challenges are exacerbated by dynamics influenced not only by the environment but also by opponents' strategies. Existing…

Machine Learning · Computer Science 2023-08-22 The Viet Bui , Tien Mai , Thanh Hong Nguyen

Robots are required to autonomously respond to changing situations. Imitation learning is a promising candidate for achieving generalization performance, and extensive results have been demonstrated in object manipulation. However,…

Robotics · Computer Science 2021-01-21 Ayumu Sasagawa , Kazuki Fujimoto , Sho Sakaino , Toshiaki Tsuji

Reinforcement learning (RL) makes it possible to train agents capable of achieving sophisticated goals in complex and uncertain environments. A key difficulty in reinforcement learning is specifying a reward function for the agent to…

Machine Learning · Computer Science 2019-09-24 Bradly C. Stadie , Pieter Abbeel , Ilya Sutskever

Imitation learning seeks to circumvent the difficulty in designing proper reward functions for training agents by utilizing expert behavior. With environments modeled as Markov Decision Processes (MDP), most of the existing imitation…

Machine Learning · Computer Science 2021-05-24 Dripta S. Raychaudhuri , Sujoy Paul , Jeroen van Baar , Amit K. Roy-Chowdhury

Imitation can be viewed as a means of enhancing learning in multiagent environments. It augments an agent's ability to learn useful behaviors by making intelligent use of the knowledge implicit in behaviors demonstrated by cooperative…

Machine Learning · Computer Science 2011-06-06 C. Boutilier , B. Price

Imitation learning seeks to learn an expert policy from sampled demonstrations. However, in the real world, it is often difficult to find a perfect expert and avoiding dangerous behaviors becomes relevant for safety reasons. We present the…

Machine Learning · Computer Science 2019-09-26 David Venuto , Leonard Boussioux , Junhao Wang , Rola Dali , Jhelum Chakravorty , Yoshua Bengio , Doina Precup

We study how an autonomous agent learns to perform a task from demonstrations in a different domain, such as a different environment or different agent. Such cross-domain imitation learning is required to, for example, train an artificial…

Artificial Intelligence · Computer Science 2022-09-27 Tim Franzmeyer , Philip H. S. Torr , João F. Henriques

In this work we propose a novel end-to-end imitation learning approach which combines natural language, vision, and motion information to produce an abstract representation of a task, which in turn is used to synthesize specific motion…

Robotics · Computer Science 2019-11-27 Simon Stepputtis , Joseph Campbell , Mariano Phielipp , Chitta Baral , Heni Ben Amor

Imitation learning is a popular approach for teaching motor skills to robots. However, most approaches focus on extracting policy parameters from execution traces alone (i.e., motion trajectories and perceptual data). No adequate…

Robotics · Computer Science 2020-10-26 Simon Stepputtis , Joseph Campbell , Mariano Phielipp , Stefan Lee , Chitta Baral , Heni Ben Amor

The notion that cooperation can aid a group of agents to solve problems more efficiently than if those agents worked in isolation is prevalent, despite the little quantitative groundwork to support it. Here we consider a primordial form of…

Adaptation and Self-Organizing Systems · Physics 2014-10-22 José F. Fontanari

This paper surveys the field of reinforcement learning from a computer-science perspective. It is written to be accessible to researchers familiar with machine learning. Both the historical basis of the field and a broad selection of…

Artificial Intelligence · Computer Science 2014-11-17 L. P. Kaelbling , M. L. Littman , A. W. Moore

Imitation learning trains policies to map from input observations to the actions that an expert would choose. In this setting, distribution shift frequently exacerbates the effect of misattributing expert actions to nuisance correlates…

Machine Learning · Computer Science 2020-10-29 Chuan Wen , Jierui Lin , Trevor Darrell , Dinesh Jayaraman , Yang Gao

We aim to enable robot to learn object manipulation by imitation. Given external observations of demonstrations on object manipulations, we believe that two underlying problems to address in learning by imitation is 1) segment a given…

Robotics · Computer Science 2017-11-21 Zhen Zeng , Benjamin Kuipers