English
Related papers

Related papers: Adversarial Imitation Learning from Incomplete Dem…

200 papers

Self-imitation learning is a Reinforcement Learning (RL) method that encourages actions whose returns were higher than expected, which helps in hard exploration and sparse reward problems. It was shown to improve the performance of…

Machine Learning · Computer Science 2020-12-23 Johan Ferret , Olivier Pietquin , Matthieu Geist

Vision-language-action (VLA) models provide a promising paradigm for scalable robotic manipulation, yet their reliance on success-only behavioral cloning leaves them brittle; lacking corrective training signals, minor execution errors…

In imitation learning, robots are supposed to learn from demonstrations of the desired behavior. Most of the work in imitation learning for swarm robotics provides the demonstrations as rollouts of an existing policy. In this work, we…

Robotics · Computer Science 2026-03-04 Mattes Kraus , Jonas Kuckling

Standard imitation learning can fail when the expert demonstrators have different sensory inputs than the imitating agent. This is because partial observability gives rise to hidden confounders in the causal graph. In previous work, to work…

Machine Learning · Computer Science 2024-08-27 Risto Vuorio , Pim de Haan , Johann Brehmer , Hanno Ackermann , Daniel Dijkman , Taco Cohen

Recent research on vulnerabilities of deep reinforcement learning (RL) has shown that adversarial policies adopted by an adversary agent can influence a target RL agent (victim agent) to perform poorly in a multi-agent environment. In…

Machine Learning · Computer Science 2022-11-01 The Viet Bui , Tien Mai , Thanh H. Nguyen

Continual learning (or class incremental learning) is a realistic learning scenario for computer vision systems, where deep neural networks are trained on episodic data, and the data from previous episodes are generally inaccessible to the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Aditya R. Bhattacharya , Debanjan Goswami , Shayok Chakraborty

We study interactive imitation learning, where a learner interactively queries a demonstrating expert for action annotations, aiming to learn a policy that has performance competitive with the expert, using as few annotations as possible.…

Machine Learning · Computer Science 2024-07-18 Yichen Li , Chicheng Zhang

We present an iterative active constraint learning (ACL) algorithm, within the learning from demonstrations (LfD) paradigm, which intelligently solicits informative demonstration trajectories for inferring an unknown constraint in the…

Robotics · Computer Science 2025-12-30 Zheng Qiu , Chih-Yuan Chiu , Glen Chou

Imitation learning (IL) is a framework that learns to imitate expert behavior from demonstrations. Recently, IL shows promising results on high dimensional and control tasks. However, IL typically suffers from sample inefficiency in terms…

Machine Learning · Computer Science 2021-11-24 Lihua Zhang

Imitation learning (IL) is a popular paradigm for training policies in robotic systems when specifying the reward function is difficult. However, despite the success of IL algorithms, they impose the somewhat unrealistic requirement that…

Machine Learning · Computer Science 2022-02-16 Luca Viano , Yu-Ting Huang , Parameswaran Kamalaruban , Craig Innes , Subramanian Ramamoorthy , Adrian Weller

Generative Adversarial Imitation Learning suffers from the fundamental problem of reward bias stemming from the choice of reward functions used in the algorithm. Different types of biases also affect different types of environments - which…

Machine Learning · Computer Science 2020-09-22 Rohit Jena , Siddharth Agrawal , Katia Sycara

We propose a novel one-step supervised imitation learning (IL) framework called Adversarial Density Regression (ADR). This IL framework aims to correct the policy learned on unknown-quality to match the expert distribution by utilizing…

Machine Learning · Computer Science 2025-01-14 Ziqi Zhang , Zifeng Zhuang , Jingzehua Xu , Yiyuan Yang , Yubo Huang , Donglin Wang , Shuai Zhang

Deriving event storylines is an effective summarization method to succinctly organize extensive information, which can significantly alleviate the pain of information overload. The critical challenge is the lack of widely recognized…

Artificial Intelligence · Computer Science 2017-12-06 Zhiqian Chen , Xuchao Zhang , Arnold P. Boedihardjo , Jing Dai , Chang-Tien Lu

Current reinforcement learning (RL) algorithms can be brittle and difficult to use, especially when learning goal-reaching behaviors from sparse rewards. Although supervised imitation learning provides a simple and stable alternative, it…

Machine Learning · Computer Science 2020-10-06 Dibya Ghosh , Abhishek Gupta , Ashwin Reddy , Justin Fu , Coline Devin , Benjamin Eysenbach , Sergey Levine

The study of unsupervised learning can be generally divided into two categories: imitation learning and reinforcement learning. In imitation learning the machine learns by mimicking the behavior of an expert system whereas in reinforcement…

Machine Learning · Computer Science 2020-04-07 Xiao Lei Zhang , Anish Agarwal

Humans can abstract prior knowledge from very little data and use it to boost skill learning. In this paper, we propose routine-augmented policy learning (RAPL), which discovers routines composed of primitive actions from a single…

Machine Learning · Computer Science 2021-05-04 Zelin Zhao , Chuang Gan , Jiajun Wu , Xiaoxiao Guo , Joshua B. Tenenbaum

Reinforcement learning provides a powerful and general framework for decision making and control, but its application in practice is often hindered by the need for extensive feature and reward engineering. Deep reinforcement learning…

Machine Learning · Computer Science 2018-08-15 Justin Fu , Katie Luo , Sergey Levine

Imitation learning seeks to learn an expert policy from sampled demonstrations. However, in the real world, it is often difficult to find a perfect expert and avoiding dangerous behaviors becomes relevant for safety reasons. We present the…

Machine Learning · Computer Science 2019-09-26 David Venuto , Leonard Boussioux , Junhao Wang , Rola Dali , Jhelum Chakravorty , Yoshua Bengio , Doina Precup

A major bottleneck in imitation learning is the requirement of a large number of expert demonstrations, which can be expensive or inaccessible. Learning from supplementary demonstrations without strict quality requirements has emerged as a…

Machine Learning · Computer Science 2024-12-31 Jiangdong Fan , Hongcai He , Paul Weng , Hui Xu , Jie Shao

We propose a new active learning by query synthesis approach using Generative Adversarial Networks (GAN). Different from regular active learning, the resulting algorithm adaptively synthesizes training instances for querying to increase…

Machine Learning · Computer Science 2017-11-17 Jia-Jie Zhu , José Bento