English
Related papers

Related papers: Generative predecessor models for sample-efficient…

200 papers

We study risk-sensitive imitation learning where the agent's goal is to perform at least as well as the expert in terms of a risk profile. We first formulate our risk-sensitive imitation learning setting. We consider the generative…

Machine Learning · Computer Science 2018-12-27 Jonathan Lacotte , Mohammad Ghavamzadeh , Yinlam Chow , Marco Pavone

Imitation learning, in which learning is performed by demonstration, has been studied and advanced for sequential decision-making tasks in which a reward function is not predefined. However, imitation learning methods still require numerous…

Machine Learning · Computer Science 2024-01-24 Dahuin Jung , Hyungyu Lee , Sungroh Yoon

Imitation learning trains a policy by mimicking expert demonstrations. Various imitation methods were proposed and empirically evaluated, meanwhile, their theoretical understanding needs further studies. In this paper, we firstly analyze…

Machine Learning · Computer Science 2020-10-23 Tian Xu , Ziniu Li , Yang Yu

In imitation learning, robots are supposed to learn from demonstrations of the desired behavior. Most of the work in imitation learning for swarm robotics provides the demonstrations as rollouts of an existing policy. In this work, we…

Robotics · Computer Science 2026-03-04 Mattes Kraus , Jonas Kuckling

Researchers have demonstrated state-of-the-art performance in sequential decision making problems (e.g., robotics control, sequential prediction) with deep neural network models. One often has access to near-optimal oracles that achieve…

Machine Learning · Computer Science 2017-03-06 Wen Sun , Arun Venkatraman , Geoffrey J. Gordon , Byron Boots , J. Andrew Bagnell

Simulation is an appealing option for validating the safety of autonomous vehicles. Generative Adversarial Imitation Learning (GAIL) has recently been shown to learn representative human driver models. These human driver models were learned…

Artificial Intelligence · Computer Science 2018-03-06 Raunak P. Bhattacharyya , Derek J. Phillips , Blake Wulfe , Jeremy Morton , Alex Kuefler , Mykel J. Kochenderfer

Imitation learning enables agents to reuse and adapt the hard-won expertise of others, offering a solution to several key challenges in learning behavior. Although it is easy to observe behavior in the real-world, the underlying actions may…

Machine Learning · Computer Science 2021-07-09 Andrew Jaegle , Yury Sulsky , Arun Ahuja , Jake Bruce , Rob Fergus , Greg Wayne

Imitation learning has shown great potential for enabling robots to acquire complex manipulation behaviors. However, these algorithms suffer from high sample complexity in long-horizon tasks, where compounding errors accumulate over the…

Robotics · Computer Science 2024-08-20 Tian Gao , Soroush Nasiriany , Huihan Liu , Quantao Yang , Yuke Zhu

Recently, particle-based variational inference (ParVI) methods have gained interest because they can avoid arbitrary parametric assumptions that are common in variational inference. However, many ParVI approaches do not allow arbitrary…

Machine Learning · Computer Science 2021-08-12 Neale Ratzlaff , Qinxun Bai , Li Fuxin , Wei Xu

Generative control policies have recently unlocked major progress in robotics. These methods produce action sequences via diffusion or flow matching, with training data provided by demonstrations. But existing methods come with two key…

Robotics · Computer Science 2026-03-09 Vince Kurtz , Joel W. Burdick

Imitation learning is often used in addition to reinforcement learning in environments where reward design is difficult or where the reward is sparse, but it is difficult to be able to imitate well in unknown states from a small amount of…

Machine Learning · Computer Science 2024-01-31 Ryoma Furuyama , Daiki Kuyoshi , Satoshi Yamane

Imitation learning is a powerful machine learning algorithm for a robot to acquire manipulation skills. Nevertheless, many real-world manipulation tasks involve precise and dexterous robot-object interactions, which make it difficult for…

Robotics · Computer Science 2024-07-23 Zhao-Heng Yin , Pieter Abbeel

Decision-making in long-tail scenarios is pivotal to autonomous-driving development, and realistic and challenging simulations play a crucial role in testing safety-critical situations. However, existing open-source datasets lack systematic…

Robotics · Computer Science 2025-09-09 Chuancheng Zhang , Zhenhao Wang , Jiangcheng Wang , Kun Su , Qiang Lv , Bin Jiang , Kunkun Hao , Wenyu Wang

Sample-efficient online reinforcement learning often uses replay buffers to store experience for reuse when updating the value function. However, uniform replay is inefficient, since certain classes of transitions can be more relevant to…

Machine Learning · Computer Science 2025-05-12 Renhao Wang , Kevin Frans , Pieter Abbeel , Sergey Levine , Alexei A. Efros

Generative Adversarial Imitation Learning (GAIL) trains a generative policy to mimic a demonstrator. It uses on-policy Reinforcement Learning (RL) to optimize a reward signal derived from a GAN-like discriminator. A major drawback of GAIL…

Machine Learning · Computer Science 2024-10-30 Tianjiao Luo , Tim Pearce , Huayu Chen , Jianfei Chen , Jun Zhu

Recently, an abundant amount of urban vehicle trajectory data has been collected in road networks. Many studies have used machine learning algorithms to analyze patterns in vehicle trajectories to predict location sequences of individual…

Machine Learning · Computer Science 2021-10-01 Seongjin Choi , Jiwon Kim , Hwasoo Yeo

Despite the considerable potential of reinforcement learning (RL), robotic control tasks predominantly rely on imitation learning (IL) due to its better sample efficiency. However, it is costly to collect comprehensive expert demonstrations…

Machine Learning · Computer Science 2024-05-22 Hengyuan Hu , Suvir Mirchandani , Dorsa Sadigh

Policy learning under action constraints plays a central role in ensuring safe behaviors in various robot control and resource allocation applications. In this paper, we study a new problem setting termed Action-Constrained Imitation…

Robotics · Computer Science 2025-08-21 Chia-Han Yeh , Tse-Sheng Nan , Risto Vuorio , Wei Hung , Hung-Yen Wu , Shao-Hua Sun , Ping-Chun Hsieh

Imitation learning, which enables robots to learn behaviors from demonstrations by human, has emerged as a promising solution for generating robot motions in such environments. The imitation learning-based robot motion generation method,…

Robotics · Computer Science 2025-03-17 Hyeonjun Park , Daegyu Lim , Seungyeon Kim , Sumin Park

Cross-domain imitation learning studies how to leverage expert demonstrations of one agent to train an imitation agent with a different embodiment or morphology. Comparing trajectories and stationary distributions between the expert and…

Machine Learning · Computer Science 2026-01-14 Arnaud Fickinger , Samuel Cohen , Stuart Russell , Brandon Amos