English
Related papers

Related papers: Sample-Efficient Expert Query Control in Active Im…

200 papers

Autonomous urban driving navigation with complex multi-agent dynamics is under-explored due to the difficulty of learning an optimal driving policy. The traditional modular pipeline heavily relies on hand-designed rules and the…

Computer Vision and Pattern Recognition · Computer Science 2018-07-11 Xiaodan Liang , Tairui Wang , Luona Yang , Eric Xing

In this paper, we propose Sparse Imitation Reinforcement Learning (SIRL), a hybrid end-to-end control policy that combines the sparse expert driving knowledge with reinforcement learning (RL) policy for autonomous driving (AD) task in CARLA…

Computer Vision and Pattern Recognition · Computer Science 2022-05-25 Yuci Han , Alper Yilmaz

Contrastive learning is an effective unsupervised method in graph representation learning. Recently, the data augmentation based contrastive learning method has been extended from images to graphs. However, most prior works are directly…

Machine Learning · Computer Science 2023-12-19 Shengyu Feng , Baoyu Jing , Yada Zhu , Hanghang Tong

Predictive models trained on observational data often fail to generalise to the distributions they encounter when deployed, especially when the training data is a product of the system being optimised. Recommender systems are a canonical…

Machine Learning · Statistics 2026-05-27 Yorgos Felekis , Michael O'Riordan , Oriol Corcoll , Ciarán M. Gilligan-Lee

We propose a novel interactive learning framework which we refer to as Interactive Attention Learning (IAL), in which the human supervisors interactively manipulate the allocated attentions, to correct the model's behavior by updating the…

Machine Learning · Computer Science 2020-06-11 Jay Heo , Junhyeon Park , Hyewon Jeong , Kwang Joon Kim , Juho Lee , Eunho Yang , Sung Ju Hwang

Often times in imitation learning (IL), the environment we collect expert demonstrations in and the environment we want to deploy our learned policy in aren't exactly the same (e.g. demonstrations collected in simulation but deployment in…

Neural and Evolutionary Computing · Computer Science 2024-06-19 Silvia Sapora , Gokul Swamy , Chris Lu , Yee Whye Teh , Jakob Nicolaus Foerster

Imitation Learning (IL) is a machine learning approach to learn a policy from a dataset of demonstrations. IL can be useful to kick-start learning before applying reinforcement learning (RL) but it can also be useful on its own, e.g. to…

Demonstrations are commonly used to speed up the learning process of Deep Reinforcement Learning algorithms. To cope with the difficulty of accessing multiple demonstrations, some algorithms have been developed to learn from a single…

Robotics · Computer Science 2024-02-15 Alexandre Chenu , Olivier Serris , Olivier Sigaud , Nicolas Perrin-Gilbert

Class incremental learning (CIL) requires an agent to learn distinct tasks consecutively with knowledge retention against forgetting. Problems impeding the practical applications of CIL methods are twofold: (1) non-i.i.d batch streams and…

Machine Learning · Computer Science 2025-10-27 Junda Wang , Minghui Hu , Ning Li , Abdulaziz Al-Ali , Ponnuthurai Nagaratnam Suganthan

Imitation learning (IL) is a general learning paradigm for tackling sequential decision-making problems. Interactive imitation learning, where learners can interactively query for expert demonstrations, has been shown to achieve provably…

Machine Learning · Computer Science 2022-09-27 Yichen Li , Chicheng Zhang

Class-incremental learning (CIL) learns a classification model with training data of different classes arising progressively. Existing CIL either suffers from serious accuracy loss due to catastrophic forgetting, or invades data privacy by…

Machine Learning · Computer Science 2022-12-13 Huiping Zhuang , Zhenyu Weng , Hongxin Wei , Renchunzi Xie , Kar-Ann Toh , Zhiping Lin

Visual imitation learning provides an effective framework to learn skills from demonstrations. However, the quality of the provided demonstrations usually significantly affects the ability of an agent to acquire desired skills. Therefore,…

Robotics · Computer Science 2023-03-02 Ray Chen Zheng , Kaizhe Hu , Zhecheng Yuan , Boyuan Chen , Huazhe Xu

Imitation learning (IL) aims to mimic the behavior of an expert policy in a sequential decision-making problem given only demonstrations. In this paper, we focus on understanding the minimax statistical limits of IL in episodic Markov…

Machine Learning · Computer Science 2020-09-15 Nived Rajaraman , Lin F. Yang , Jiantao Jiao , Kannan Ramachandran

Animals are able to imitate each others' behavior, despite their difference in biomechanics. In contrast, imitating the other similar robots is a much more challenging task in robotics. This problem is called cross domain imitation…

Robotics · Computer Science 2021-09-14 Zhao-Heng Yin , Lingfeng Sun , Hengbo Ma , Masayoshi Tomizuka , Wu-Jun Li

Generative Adversarial Imitation Learning (GAIL) is a powerful and practical approach for learning sequential decision-making policies. Different from Reinforcement Learning (RL), GAIL takes advantage of demonstration data by experts (e.g.,…

Machine Learning · Computer Science 2020-01-14 Minshuo Chen , Yizhou Wang , Tianyi Liu , Zhuoran Yang , Xingguo Li , Zhaoran Wang , Tuo Zhao

In recent years, the development of robotics and artificial intelligence (AI) systems has been nothing short of remarkable. As these systems continue to evolve, they are being utilized in increasingly complex and unstructured environments,…

Machine Learning · Computer Science 2024-10-28 Maryam Zare , Parham M. Kebria , Abbas Khosravi , Saeid Nahavandi

Imitation from observation (IfO) is a learning paradigm that consists of training autonomous agents in a Markov Decision Process (MDP) by observing expert demonstrations without access to its actions. These demonstrations could be sequences…

Artificial Intelligence · Computer Science 2023-02-14 Medric Sonwa , Johanna Hansen , Eugene Belilovsky

Effective exploration continues to be a significant challenge that prevents the deployment of reinforcement learning for many physical systems. This is particularly true for systems with continuous and high-dimensional state and action…

Machine Learning · Computer Science 2022-07-21 Trevor Ablett , Bryan Chan , Jonathan Kelly

Self-imitation learning is a Reinforcement Learning (RL) method that encourages actions whose returns were higher than expected, which helps in hard exploration and sparse reward problems. It was shown to improve the performance of…

Machine Learning · Computer Science 2020-12-23 Johan Ferret , Olivier Pietquin , Matthieu Geist

Researchers have demonstrated state-of-the-art performance in sequential decision making problems (e.g., robotics control, sequential prediction) with deep neural network models. One often has access to near-optimal oracles that achieve…

Machine Learning · Computer Science 2017-03-06 Wen Sun , Arun Venkatraman , Geoffrey J. Gordon , Byron Boots , J. Andrew Bagnell