English
Related papers

Related papers: Robust Maximum Entropy Behavior Cloning

200 papers

Adversarial imitation learning has become a popular framework for imitation in continuous control. Over the years, several variations of its components were proposed to enhance the performance of the learned policies as well as the sample…

Imitation learning techniques have been shown to be highly effective in real-world control scenarios, such as robotics. However, these approaches not only suffer from compounding error issues but also require human experts to provide…

Robotics · Computer Science 2025-02-21 Yigit Korkmaz , Erdem Bıyık

Behavioural cloning is an imitation learning technique that teaches an agent how to behave via expert demonstrations. Recent approaches use self-supervision of fully-observable unlabelled snapshots of the states to decode state pairs into…

Machine Learning · Computer Science 2023-04-24 Juarez Monteiro , Nathan Gavenski , Felipe Meneguzzi , Rodrigo C. Barros

Large Language Models (LLMs) have demonstrated impressive in-context learning (ICL) capabilities from few-shot demonstration exemplars. While recent learning-based demonstration selection methods have proven beneficial to ICL by choosing…

Machine Learning · Computer Science 2024-10-16 Hui Liu , Wenya Wang , Hao Sun , Chris Xing Tian , Chenqi Kong , Xin Dong , Haoliang Li

Imitation learning trains policies to map from input observations to the actions that an expert would choose. In this setting, distribution shift frequently exacerbates the effect of misattributing expert actions to nuisance correlates…

Machine Learning · Computer Science 2020-10-29 Chuan Wen , Jierui Lin , Trevor Darrell , Dinesh Jayaraman , Yang Gao

Model-free Reinforcement Learning (RL) works well when experience can be collected cheaply and model-based RL is effective when system dynamics can be modeled accurately. However, both assumptions can be violated in real world problems such…

Machine Learning · Computer Science 2020-05-07 Mohak Bhardwaj , Ankur Handa , Dieter Fox , Byron Boots

This paper presents a general framework for exploiting the representational capacity of neural networks to approximate complex, nonlinear reward functions in the context of solving the inverse reinforcement learning (IRL) problem. We show…

Machine Learning · Computer Science 2016-03-14 Markus Wulfmeier , Peter Ondruska , Ingmar Posner

Learning customer preferences from an observed behaviour is an important topic in the marketing literature. Structural models typically model forward-looking customers or firms as utility-maximizing agents whose utility is estimated using…

Computational Finance · Quantitative Finance 2017-12-14 Igor Halperin

We aim to enable robot to learn object manipulation by imitation. Given external observations of demonstrations on object manipulations, we believe that two underlying problems to address in learning by imitation is 1) segment a given…

Robotics · Computer Science 2017-11-21 Zhen Zeng , Benjamin Kuipers

Adversarial methods for imitation learning have been shown to perform well on various control tasks. However, they require a large number of environment interactions for convergence. In this paper, we propose an end-to-end differentiable…

Machine Learning · Computer Science 2019-03-11 Vaibhav Saxena , Srinivasan Sivanandan , Pulkit Mathur

Practical Imitation Learning (IL) systems rely on large human demonstration datasets for successful policy learning. However, challenges lie in maintaining the quality of collected data and addressing the suboptimal nature of some…

Robotics · Computer Science 2025-05-07 Sachit Kuhar , Shuo Cheng , Shivang Chopra , Matthew Bronars , Danfei Xu

Sensitivity to adversarial noise hinders deployment of machine learning algorithms in security-critical applications. Although many adversarial defenses have been proposed, robustness to adversarial noise remains an open problem. The most…

Machine Learning · Computer Science 2020-08-13 Alex Serban , Erik Poll , Joost Visser

Providing a suitable reward function to reinforcement learning can be difficult in many real world applications. While inverse reinforcement learning (IRL) holds promise for automatically learning reward functions from demonstrations,…

Machine Learning · Computer Science 2019-10-29 Lantao Yu , Tianhe Yu , Chelsea Finn , Stefano Ermon

In imitation learning from observation IfO, a learning agent seeks to imitate a demonstrating agent using only observations of the demonstrated behavior without access to the control signals generated by the demonstrator. Recent methods…

Machine Learning · Computer Science 2021-04-02 Faraz Torabi , Garrett Warnell , Peter Stone

Machine learning (ML)-based planners have recently gained significant attention. They offer advantages over traditional optimization-based planning algorithms. These advantages include fewer manually selected parameters and faster…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Hui Zhou , Shaoshuai Shi , Hongsheng Li

Imitation Learning from observation describes policy learning in a similar way to human learning. An agent's policy is trained by observing an expert performing a task. While many state-only imitation learning approaches are based on…

Machine Learning · Computer Science 2024-10-02 Damian Boborzi , Christoph-Nikolas Straehle , Jens S. Buchner , Lars Mikelsons

Imitation learning (IL) can generate computationally efficient sensorimotor policies from demonstrations provided by computationally expensive model-based sensing and control algorithms. However, commonly employed IL methods are often…

Robotics · Computer Science 2022-10-20 Andrea Tagliabue , Jonathan P. How

Learning-based approaches, such as reinforcement learning (RL) and imitation learning (IL), have indicated superiority over rule-based approaches in complex urban autonomous driving environments, showing great potential to make intelligent…

Robotics · Computer Science 2022-05-31 Haochen Liu , Zhiyu Huang , Jingda Wu , Chen Lv

Imitation learning is a primary approach to improve the efficiency of reinforcement learning by exploiting the expert demonstrations. However, in many real scenarios, obtaining expert demonstrations could be extremely expensive or even…

Machine Learning · Computer Science 2023-07-25 Kun-Peng Ning , Hu Xu , Kun Zhu , Sheng-Jun Huang

Imitation learning holds tremendous promise in learning policies efficiently for complex decision making problems. Current state-of-the-art algorithms often use inverse reinforcement learning (IRL), where given a set of expert…

Robotics · Computer Science 2023-02-22 Siddhant Haldar , Vaibhav Mathur , Denis Yarats , Lerrel Pinto