English
Related papers

Related papers: GRAIL: Goal Recognition Alignment through Imitatio…

200 papers

Imitation learning (IL) is a framework that learns to imitate expert behavior from demonstrations. Recently, IL shows promising results on high dimensional and control tasks. However, IL typically suffers from sample inefficiency in terms…

Machine Learning · Computer Science 2021-11-24 Lihua Zhang

Integration of reinforcement learning and imitation learning is an important problem that has been studied for a long time in the field of intelligent robotics. Reinforcement learning optimizes policies to maximize the cumulative reward,…

Machine Learning · Computer Science 2023-01-18 Akira Kinose , Tadahiro Taniguchi

Imitation learning, which learns agent policy by mimicking expert demonstration, has shown promising results in many applications such as medical treatment regimes and self-driving vehicles. However, it remains a difficult task to interpret…

Machine Learning · Computer Science 2024-01-31 Tianxiang Zhao , Wenchao Yu , Suhang Wang , Lu Wang , Xiang Zhang , Yuncong Chen , Yanchi Liu , Wei Cheng , Haifeng Chen

Multi-objective reinforcement learning (MORL) algorithms tackle sequential decision problems where agents may have different preferences over (possibly conflicting) reward functions. Such algorithms often learn a set of policies (each…

Machine Learning · Computer Science 2023-08-16 Lucas N. Alegre , Ana L. C. Bazzan , Diederik M. Roijers , Ann Nowé , Bruno C. da Silva

Conditional imitation learning (CIL) trains deep neural networks, in an end-to-end manner, to mimic human driving. This approach has demonstrated suitable vehicle control when following roads, avoiding obstacles, or taking specific turns at…

Robotics · Computer Science 2022-11-22 Hesham M. Eraqi , Mohamed N. Moustafa , Jens Honer

We tackle a common scenario in imitation learning (IL), where agents try to recover the optimal policy from expert demonstrations without further access to the expert or environment reward signals. Except the simple Behavior Cloning (BC)…

Machine Learning · Computer Science 2021-04-16 Minghuan Liu , Tairan He , Minkai Xu , Weinan Zhang

We address the problem of imitation learning with multi-modal demonstrations. Instead of attempting to learn all modes, we argue that in many tasks it is sufficient to imitate any one of them. We show that the state-of-the-art methods such…

Machine Learning · Computer Science 2020-06-02 Liyiming Ke , Sanjiban Choudhury , Matt Barnes , Wen Sun , Gilwoo Lee , Siddhartha Srinivasa

The aim of inverse reinforcement learning (IRL) is to infer an agent's preferences from observing their behaviour. Usually, preferences are modelled as a reward function, $R$, and behaviour is modelled as a policy, $\pi$. One of the central…

Machine Learning · Computer Science 2024-12-17 Joar Skalse , Alessandro Abate

Unsupervised pre-training has recently become the bedrock for computer vision and natural language processing. In reinforcement learning (RL), goal-conditioned RL can potentially provide an analogous self-supervised approach for making use…

Machine Learning · Computer Science 2024-03-12 Seohong Park , Dibya Ghosh , Benjamin Eysenbach , Sergey Levine

Generative Adversarial Imitation Learning (GAIL) stands as a cornerstone approach in imitation learning. This paper investigates the gradient explosion in two types of GAIL: GAIL with deterministic policy (DE-GAIL) and GAIL with stochastic…

Machine Learning · Computer Science 2023-12-19 Wanying Wang , Yichen Zhu , Yirui Zhou , Chaomin Shen , Jian Tang , Zhiyuan Xu , Yaxin Peng , Yangchun Zhang

Class-Incremental Learning (CIL) aims to continuously acquire new categories while preserving previously learned knowledge. Recently, Contrastive Language-Image Pre-trained (CLIP) models have shown strong potential for CIL due to their…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Tianqi Wang , Jingcai Guo

Adversarial Imitation Learning (AIL) allows the agent to reproduce expert behavior with low-dimensional states and actions. However, challenges arise in handling visual states due to their less distinguishable representation compared to…

Machine Learning · Computer Science 2024-01-23 Yunke Wang , Linwei Tao , Bo Du , Yutian Lin , Chang Xu

In many settings, it is desirable to learn decision-making and control policies through learning or bootstrapping from expert demonstrations. The most common approaches under this Imitation Learning (IL) framework are Behavioural Cloning…

Machine Learning · Computer Science 2019-11-07 Seyed Kamyar Seyed Ghasemipour , Richard Zemel , Shixiang Gu

As a pivotal component to attaining generalizable solutions in human intelligence, reasoning provides great potential for reinforcement learning (RL) agents' generalization towards varied goals by summarizing part-to-whole arguments and…

Machine Learning · Computer Science 2023-05-18 Wenhao Ding , Haohong Lin , Bo Li , Ding Zhao

Effective exploration continues to be a significant challenge that prevents the deployment of reinforcement learning for many physical systems. This is particularly true for systems with continuous and high-dimensional state and action…

Machine Learning · Computer Science 2022-07-21 Trevor Ablett , Bryan Chan , Jonathan Kelly

Current approaches to embodied AI tend to learn policies from expert demonstrations. However, without a mechanism to evaluate the quality of demonstrated actions, they are limited to learning from optimal behaviour, or they risk replicating…

Computation and Language · Computer Science 2025-10-14 Sabrina McCallum , Amit Parekh , Alessandro Suglia

Imitation learning methods have demonstrated considerable success in teaching autonomous systems complex tasks through expert demonstrations. However, a limitation of these methods is their lack of interpretability, particularly in…

Machine Learning · Computer Science 2025-07-21 Wenliang Liu , Danyang Li , Erfan Aasi , Daniela Rus , Roberto Tron , Calin Belta

Large language models have achieved remarkable progress on complex reasoning tasks. However, they often implicitly fabricate information when inputs are incomplete, producing confident but unreliable conclusions -- a failure mode we term…

Computation and Language · Computer Science 2026-04-22 Yiwen Qiu , Linjuan Wu , Yizhou Liu , Yuchen Yan , Jin Ma , Xu Tan , Yao Hu , Daoxin Zhang , Wenqi Zhang , Weiming Lu , Jun Xiao , Yongliang Shen

Embodied agents, such as robots and virtual characters, must continuously select actions to execute tasks effectively, solving complex sequential decision-making problems. Given the difficulty of designing such controllers manually,…

Robotics · Computer Science 2026-05-18 Pedro Santana

Model-based reinforcement learning algorithms make decisions by building and utilizing a model of the environment. However, none of the existing algorithms attempts to infer the dynamics of any state-action pair from known state-action…

Machine Learning · Computer Science 2020-02-25 Yanchao Sun , Furong Huang