English
Related papers

Related papers: Out-of-Dynamics Imitation Learning from Multimodal…

200 papers

We propose State Matching Offline DIstribution Correction Estimation (SMODICE), a novel and versatile regression-based offline imitation learning (IL) algorithm derived via state-occupancy matching. We show that the SMODICE objective admits…

Machine Learning · Computer Science 2022-06-22 Yecheng Jason Ma , Andrew Shen , Dinesh Jayaraman , Osbert Bastani

Out-of-Distribution (OOD) detection is a critical task that has garnered significant attention. The emergence of CLIP has spurred extensive research into zero-shot OOD detection, often employing a training-free approach. Current methods…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Haoran Xu , Yanlin Liu , Zizhao Tong , Jiaze Li , Kexue Fu , Yuyang Zhang , Longxiang Gao , Shuaiguang Li , Xingyu Li , Yanran Xu , Changwei Wang

Imitating skills from low-quality datasets, such as sub-optimal demonstrations and observations with distractors, is common in real-world applications. In this work, we focus on the problem of Learning from Noisy Demonstrations (LND), where…

Machine Learning · Computer Science 2024-04-05 Kaichen Huang , Hai-Hang Sun , Shenghua Wan , Minghao Shao , Shuai Feng , Le Gan , De-Chuan Zhan

Out-of-distribution (OOD) detection is a critical task to ensure the reliability and security of machine learning models deployed in real-world applications. Conventional methods for OOD detection that rely on single-modal information,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 K Huang , G Song , Hanwen Su , Jiyan Wang

Augmenting reinforcement learning with imitation learning is often hailed as a method by which to improve upon learning from scratch. However, most existing methods for integrating these two techniques are subject to several strong…

Machine Learning · Computer Science 2020-07-23 Brahma S. Pavse , Faraz Torabi , Josiah P. Hanna , Garrett Warnell , Peter Stone

Avoiding out-of-distribution (OOD) data is critical for training supervised machine learning models in the medical imaging domain. Furthermore, obtaining labeled medical data is difficult and expensive since it requires expert annotators…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Suraj Kothawade , Akshit Srivastava , Venkat Iyer , Ganesh Ramakrishnan , Rishabh Iyer

State-of-the-art Object Detection (OD) methods predominantly operate under a closed-world assumption, where test-time categories match those encountered during training. However, detecting and localizing unknown objects is crucial for…

Computer Vision and Pattern Recognition · Computer Science 2025-06-18 Daniel Montoya , Aymen Bouguerra , Alexandra Gomez-Villa , Fabio Arnez

Imitation learning frameworks that learn robot control policies from demonstrators' motions via hand-mounted demonstration interfaces have attracted increasing attention. However, due to differences in physical characteristics between…

Robotics · Computer Science 2026-02-18 Kei Takahashi , Hikaru Sasaki , Takamitsu Matsubara

Recently, there has been gradually more attention paid to Out-of-Distribution (OOD) performance prediction, whose goal is to predict the performance of trained models on unlabeled OOD test datasets, so that we could better leverage and…

Machine Learning · Computer Science 2025-11-03 Han Yu , Kehan Li , Dongbai Li , Yue He , Xingxuan Zhang , Peng Cui

Robust imitation learning using disturbance injections overcomes issues of limited variation in demonstrations. However, these methods assume demonstrations are optimal, and that policy stabilization can be learned via simple augmentations.…

Robotics · Computer Science 2022-05-10 Hirotaka Tahara , Hikaru Sasaki , Hanbit Oh , Brendan Michael , Takamitsu Matsubara

Continual learning in environments with shifting data distributions is a challenging problem with several real-world applications. In this paper we consider settings in which the data distribution(task) shifts abruptly and the timing of…

Machine Learning · Computer Science 2022-01-07 Mengda Xu , Sumitra Ganesh , Pranay Pasula

Despite machine learning models' success in Natural Language Processing (NLP) tasks, predictions from these models frequently fail on out-of-distribution (OOD) samples. Prior works have focused on developing state-of-the-art methods for…

Computation and Language · Computer Science 2021-11-30 Dyah Adila , Dongyeop Kang

Imitation learning, in which learning is performed by demonstration, has been studied and advanced for sequential decision-making tasks in which a reward function is not predefined. However, imitation learning methods still require numerous…

Machine Learning · Computer Science 2024-01-24 Dahuin Jung , Hyungyu Lee , Sungroh Yoon

Out-of-distribution (OOD) detection is indispensable for deploying reliable machine learning systems in real-world scenarios. Recent works, using auxiliary outliers in training, have shown good potential. However, they seldom concern the…

Machine Learning · Computer Science 2024-12-17 Yutian Lei , Luping Ji , Pei Liu

Out-of-distribution (OOD) detection is a well-studied topic in supervised learning. Extending the successes in supervised learning methods to the reinforcement learning (RL) setting, however, is difficult due to the data generating process…

Machine Learning · Computer Science 2021-11-01 Sumedh A Sontakke , Stephen Iota , Zizhao Hu , Arash Mehrjou , Laurent Itti , Bernhard Schölkopf

Continual learning (CL) is an important technique to allow artificial neural networks to work in open environments. CL enables a system to learn new tasks without severe interference to its performance on old tasks, i.e., overcome the…

Machine Learning · Computer Science 2024-07-08 Liangxuan Guo , Yang Chen , Shan Yu

We examine the problem of transferring a policy learned in a source environment to a target environment with different dynamics, particularly in the case where it is critical to reduce the amount of interaction with the target environment…

Artificial Intelligence · Computer Science 2021-01-26 Siddharth Desai , Ishan Durugkar , Haresh Karnan , Garrett Warnell , Josiah Hanna , Peter Stone

Imitation learning (IL) enables autonomous behavior by learning from expert demonstrations. While more sample-efficient than comparative alternatives like reinforcement learning, IL is sensitive to compounding errors induced by distribution…

Systems and Control · Electrical Eng. & Systems 2025-12-22 Aditya Gahlawat , Ahmed Aboudonia , Sandeep Banik , Naira Hovakimyan , Nikolai Matni , Aaron D. Ames , Gioele Zardini , Alberto Speranzon

Learning from Observations (LfO) is a practical reinforcement learning scenario from which many applications can benefit through the reuse of incomplete resources. Compared to conventional imitation learning (IL), LfO is more challenging…

Machine Learning · Computer Science 2021-03-01 Zhuangdi Zhu , Kaixiang Lin , Bo Dai , Jiayu Zhou

Distribution shifts on graphs -- the data distribution discrepancies between training and testing a graph machine learning model, are often ubiquitous and unavoidable in real-world scenarios. Such shifts may severely deteriorate the…

Machine Learning · Computer Science 2024-02-20 Shuhan Liu , Kaize Ding