English
Related papers

Related papers: SeMAIL: Eliminating Distractors in Visual Imitatio…

200 papers

Robots can use Visual Imitation Learning (VIL) to learn manipulation tasks from video demonstrations. However, translating visual observations into actionable robot policies is challenging due to the high-dimensional nature of video data.…

Robotics · Computer Science 2025-01-22 Ananth Jonnavittula , Sagar Parekh , Dylan P. Losey

Model-based reinforcement learning (MBRL) is a promising route to sample-efficient policy optimization. However, a known vulnerability of reconstruction-based MBRL consists of scenarios in which detailed aspects of the world are highly…

Machine Learning · Computer Science 2024-12-10 Miles Hutson , Isaac Kauvar , Nick Haber

In this paper, we consider the problem of autonomous driving using imitation learning in a semi-supervised manner. In particular, both labeled and unlabeled demonstrations are leveraged during training by estimating the quality of each…

Robotics · Computer Science 2021-09-24 Gunmin Lee , Wooseok Oh , Seungyoun Shin , Dohyeong Kim , Jeongwoo Oh , Jaeyeon Jeong , Sungjoon Choi , Songhwai Oh

Image-based Reinforcement Learning is known to suffer from poor sample efficiency and generalisation to unseen visuals such as distractors (task-independent aspects of the observation space). Visual domain randomisation encourages transfer…

Artificial Intelligence · Computer Science 2021-01-12 Sasha Salter , Dushyant Rao , Markus Wulfmeier , Raia Hadsell , Ingmar Posner

Transfer learning from large-scale pre-trained models has become essential for many computer vision tasks. Recent studies have shown that datasets like ImageNet are weakly labeled since images with multiple object classes present are…

Computer Vision and Pattern Recognition · Computer Science 2021-11-25 Sai Rajeswar , Pau Rodriguez , Soumye Singhal , David Vazquez , Aaron Courville

We consider model-based reinforcement learning (MBRL) in 2-agent, high-fidelity continuous control problems -- an important domain for robots interacting with other agents in the same workspace. For non-trivial dynamical systems, MBRL…

Machine Learning · Computer Science 2019-11-04 Orr Krupnik , Igor Mordatch , Aviv Tamar

State-of-the-art (SOTA) anomaly segmentation approaches on complex urban driving scenes explore pixel-wise classification uncertainty learned from outlier exposure, or external reconstruction models. However, previous uncertainty approaches…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Yu Tian , Yuyuan Liu , Guansong Pang , Fengbei Liu , Yuanhong Chen , Gustavo Carneiro

When faced with accomplishing a task, human experts exhibit intentional behavior. Their unique intents shape their plans and decisions, resulting in experts demonstrating diverse behaviors to accomplish the same task. Due to the…

Machine Learning · Computer Science 2024-04-29 Sangwon Seo , Vaibhav Unhelkar

Recent learning-to-imitation methods have shown promising results in planning via imitating within the observation-action space. However, their ability in open environments remains constrained, particularly in long-horizon tasks. In…

Machine Learning · Computer Science 2024-11-28 Jie-Jing Shao , Hao-Ran Hao , Xiao-Wen Yang , Yu-Feng Li

The performance of multi-agent reinforcement learning (MARL) in partially observable environments depends on effectively aggregating information from observations, communications, and reward signals. While most existing multi-agent systems…

Multiagent Systems · Computer Science 2025-11-04 Qinwei Huang , Stefan Wang , Simon Khan , Garrett Katz , Qinru Qiu

A new multi-attention based method for solving the MIL problem (MAMIL), which takes into account the neighboring patches or instances of each analyzed patch in a bag, is proposed. In the method, one of the attention modules takes into…

Machine Learning · Computer Science 2021-12-14 Andrei V. Konstantinov , Lev V. Utkin

eXplanation Based Learning (XBL) is a form of Interactive Machine Learning (IML) that provides a model refining approach via user feedback collected on model explanations. Although the interactivity of XBL promotes model transparency, XBL…

Machine Learning · Computer Science 2023-07-13 Misgina Tsighe Hagos , Kathleen M. Curran , Brian Mac Namee

Imitation learning (IL) from a state-based reinforcement learning (RL) policy is a common approach to overcome the curse of dimensionality in complex and high-dimensional observation spaces prevalent in robotics. This paper addresses the…

Machine Learning · Computer Science 2026-05-28 Meraj Mammadov , Pedro Zuidberg Dos Martires , Johannes Andreas Stork

Sample efficiency has been a key issue in reinforcement learning (RL). An efficient agent must be able to leverage its prior experiences to quickly adapt to similar, but new tasks and situations. Meta-RL is one attempt at formalizing and…

Machine Learning · Computer Science 2023-01-02 Seyed Roozbeh Razavi Rohani , Saeed Hedayatian , Mahdieh Soleymani Baghshah

In several supervised learning scenarios, auxiliary losses are used in order to introduce additional information or constraints into the supervised learning objective. For instance, knowledge distillation aims to mimic outputs of a powerful…

Machine Learning · Computer Science 2022-12-08 Durga Sivasubramanian , Ayush Maheshwari , Pradeep Shenoy , Prathosh AP , Ganesh Ramakrishnan

In many real-world visual Imitation Learning (IL) scenarios, there is a misalignment between the agent's and the expert's perspectives, which might lead to the failure of imitation. Previous methods have generally solved this problem by…

Robotics · Computer Science 2024-04-05 Kaichen Huang , Minghao Shao , Shenghua Wan , Hai-Hang Sun , Shuai Feng , Le Gan , De-Chuan Zhan

The task of infomin learning aims to learn a representation with high utility while being uninformative about a specified target, with the latter achieved by minimising the mutual information between the representation and the target. It…

Machine Learning · Computer Science 2023-02-22 Yanzhi Chen , Weihao Sun , Yingzhen Li , Adrian Weller

Multi-view learning (MVL) has gained great success in integrating information from multiple perspectives of a dataset to improve downstream task performance. To make MVL methods more practical in an open-ended environment, this paper…

Machine Learning · Computer Science 2023-10-16 Depeng Li , Tianqi Wang , Junwei Chen , Kenji Kawaguchi , Cheng Lian , Zhigang Zeng

The goal of imitation learning is to mimic expert behavior without access to an explicit reward signal. Expert demonstrations provided by humans, however, often show significant variability due to latent factors that are typically not…

Machine Learning · Computer Science 2017-11-16 Yunzhu Li , Jiaming Song , Stefano Ermon

Approaches for teaching learning agents via human demonstrations have been widely studied and successfully applied to multiple domains. However, the majority of imitation learning work utilizes only behavioral information from the…