English
Related papers

Related papers: Out-of-Dynamics Imitation Learning from Multimodal…

200 papers

The goal of imitation learning (IL) is to learn a good policy from high-quality demonstrations. However, the quality of demonstrations in reality can be diverse, since it is easier and cheaper to collect demonstrations from a mix of experts…

Machine Learning · Computer Science 2019-09-17 Voot Tangkaratt , Bo Han , Mohammad Emtiyaz Khan , Masashi Sugiyama

Offline imitation learning (IL) refers to learning expert behavior solely from demonstrations, without any additional interaction with the environment. Despite significant advances in offline IL, existing techniques find it challenging to…

Machine Learning · Computer Science 2023-12-19 Abhinav Jain , Vaibhav Unhelkar

Learning from demonstrations is a useful way to transfer a skill from one agent to another. While most imitation learning methods aim to mimic an expert skill by following the demonstration step-by-step, imitating every step in the…

Robotics · Computer Science 2019-12-18 Youngwoon Lee , Edward S. Hu , Zhengyu Yang , Joseph J. Lim

Imitation learning enables robots to learn from demonstrations. Previous imitation learning algorithms usually assume access to optimal expert demonstrations. However, in many real-world applications, this assumption is limiting. Most…

Machine Learning · Computer Science 2021-03-11 Zhangjie Cao , Dorsa Sadigh

Out-of-distribution (OOD) robustness is a critical challenge for modern machine learning systems, particularly as they increasingly operate in multimodal settings involving inputs like video, audio, and sensor data. Currently, many OOD…

Machine Learning · Computer Science 2026-02-23 Yuehan Qin , Li Li , Defu Cao , Tiankai Yang , Jiate Li , Yue Zhao

Recent years have witnessed significant progress in the development of machine learning models across a wide range of fields, fueled by increased computational resources, large-scale datasets, and the rise of deep learning architectures.…

Imitation learning (IL) is notably effective for robotic tasks where directly programming behaviors or defining optimal control costs is challenging. In this work, we address a scenario where the imitator relies solely on observed behavior…

Machine Learning · Computer Science 2024-08-20 Rishabh Agrawal , Nathan Dahlin , Rahul Jain , Ashutosh Nayyar

Multimodal demonstrations provide robots with an abundance of information to make sense of the world. However, such abundance may not always lead to good performance when it comes to learning sensorimotor control policies from human…

Machine Learning · Computer Science 2023-03-07 Yilun Hao , Ruinan Wang , Zhangjie Cao , Zihan Wang , Yuchen Cui , Dorsa Sadigh

This thesis makes considerable contributions to the realm of machine learning, specifically in the context of open-world scenarios where systems face previously unseen data and contexts. Traditional machine learning models are usually…

Machine Learning · Computer Science 2023-10-11 Yiyou Sun

Imitation learning (IL) seeks to teach agents specific tasks through expert demonstrations. One of the key approaches to IL is to define a distance between agent and expert and to find an agent policy that minimizes that distance. Optimal…

Machine Learning · Computer Science 2023-07-21 Ilana Sebag , Samuel Cohen , Marc Peter Deisenroth

Imitation learning (IL) is a popular paradigm for training policies in robotic systems when specifying the reward function is difficult. However, despite the success of IL algorithms, they impose the somewhat unrealistic requirement that…

Machine Learning · Computer Science 2022-02-16 Luca Viano , Yu-Ting Huang , Parameswaran Kamalaruban , Craig Innes , Subramanian Ramamoorthy , Adrian Weller

Offline imitation learning (IL) promises the ability to learn performant policies from pre-collected demonstrations without interactions with the environment. However, imitating behaviors fully offline typically requires numerous expert…

Machine Learning · Computer Science 2023-03-07 Lantao Yu , Tianhe Yu , Jiaming Song , Willie Neiswanger , Stefano Ermon

Out-of-distribution (OOD) detection aims to detect "unknown" data whose labels have not been seen during the in-distribution (ID) training process. Recent progress in representation learning gives rise to distance-based OOD detection that…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Ji Zhang , Lianli Gao , Bingguang Hao , Hao Huang , Jingkuan Song , Hengtao Shen

Out-of-distribution (OOD) detection aims to identify test examples that do not belong to the training distribution and are thus unlikely to be predicted reliably. Despite a plethora of existing works, most of them focused only on the…

Machine Learning · Computer Science 2023-11-07 Reza Averly , Wei-Lun Chao

Most existing imitation learning approaches assume the demonstrations are drawn from experts who are optimal, but relaxing this assumption enables us to use a wider range of data. Standard imitation learning may learn a suboptimal policy…

Machine Learning · Computer Science 2022-01-27 Songyuan Zhang , Zhangjie Cao , Dorsa Sadigh , Yanan Sui

In the real world, a learning system could receive an input that is unlike anything it has seen during training. Unfortunately, out-of-distribution samples can lead to unpredictable behaviour. We need to know whether any given input belongs…

Machine Learning · Computer Science 2019-08-21 Alireza Shafaei , Mark Schmidt , James J. Little

The goal of learning from demonstrations is to learn a policy for an agent (imitator) by mimicking the behavior in the demonstrations. Prior works on learning from demonstrations assume that the demonstrations are collected by a…

Robotics · Computer Science 2021-10-29 Zhangjie Cao , Yilun Hao , Mengxi Li , Dorsa Sadigh

A fundamental challenge in physics-informed machine learning (PIML) is the design of robust PIML methods for out-of-distribution (OOD) forecasting tasks. These OOD tasks require learning-to-learn from observations of the same (ODE)…

Machine Learning · Computer Science 2023-03-07 S Chandra Mouli , Muhammad Ashraful Alam , Bruno Ribeiro

Traditional machine learning paradigms are based on the assumption that both training and test data follow the same statistical pattern, which is mathematically referred to as Independent and Identically Distributed ($i.i.d.$). However, in…

Machine Learning · Computer Science 2023-07-28 Jiashuo Liu , Zheyan Shen , Yue He , Xingxuan Zhang , Renzhe Xu , Han Yu , Peng Cui

One-shot Imitation Learning~(OSIL) aims to imbue AI agents with the ability to learn a new task from a single demonstration. To supervise the learning, OSIL typically requires a prohibitively large number of paired expert demonstrations --…

Machine Learning · Computer Science 2024-08-13 Philipp Wu , Kourosh Hakhamaneshi , Yuqing Du , Igor Mordatch , Aravind Rajeswaran , Pieter Abbeel