中文
相关论文

相关论文: Robust Imitation Learning from Corrupted Demonstra…

200 篇论文

Conformal prediction is a flexible framework for calibrating machine learning predictions, providing distribution-free statistical guarantees. In outlier detection, this calibration relies on a reference set of labeled inlier data to…

机器学习 · 统计学 2025-06-17 Meshi Bashari , Matteo Sesia , Yaniv Romano

We consider the problem of learning from noisy data in practical settings where the size of data is too large to store on a single machine. More challenging, the data coming from the wild may contain malicious outliers. To address the…

机器学习 · 计算机科学 2017-01-03 Jiashi Feng , Huan Xu , Shie Mannor

Offline Imitation Learning (IL) with imperfect demonstrations has garnered increasing attention owing to the scarcity of expert data in many real-world domains. A fundamental problem in this scenario is how to extract positive behaviors…

机器学习 · 计算机科学 2024-05-31 Sheng Yue , Jiani Liu , Xingyuan Hua , Ju Ren , Sen Lin , Junshan Zhang , Yaoxue Zhang

Training deep neural models in the presence of corrupted supervision is challenging as the corrupted data points may significantly impact the generalization performance. To alleviate this problem, we present an efficient robust algorithm…

机器学习 · 计算机科学 2021-02-16 Boyang Liu , Mengying Sun , Ding Wang , Pang-Ning Tan , Jiayu Zhou

Offline reinforcement learning (RL) seeks to learn optimal policies from static datasets without interacting with the environment. A common challenge is handling multi-modal action distributions, where multiple behaviours are represented in…

机器学习 · 计算机科学 2025-03-20 Mianchu Wang , Yue Jin , Giovanni Montana

The problem of robust mean estimation in high dimensions is studied, in which a certain fraction (less than half) of the datapoints can be arbitrarily corrupted. Motivated by compressive sensing, the robust mean estimation problem is…

应用统计 · 统计学 2022-12-08 Aditya Deshmukh , Jing Liu , Venugopal V. Veeravalli

Offline imitation learning enables learning a policy solely from a set of expert demonstrations, without any environment interaction. To alleviate the issue of distribution shift arising due to the small amount of expert data, recent works…

机器学习 · 计算机科学 2025-05-23 Udita Ghosh , Dripta S. Raychaudhuri , Jiachen Li , Konstantinos Karydis , Amit K. Roy-Chowdhury

In performative Reinforcement Learning (RL), an agent faces a policy-dependent environment: the reward and transition functions depend on the agent's policy. Prior work on performative RL has studied the convergence of repeated retraining…

机器学习 · 计算机科学 2025-05-12 Vasilis Pollatos , Debmalya Mandal , Goran Radanovic

Imitation learning algorithms learn a policy from demonstrations of expert behavior. We show that, for deterministic experts, imitation learning can be done by reduction to reinforcement learning with a stationary reward. Our theoretical…

机器学习 · 统计学 2022-03-16 Kamil Ciosek

We find that across a wide range of robot policy learning scenarios, treating supervised policy learning with an implicit model generally performs better, on average, than commonly used explicit models. We present extensive experiments on…

Federated learning is the centralized training of statistical models from decentralized data on mobile devices while preserving the privacy of each device. We present a robust aggregation approach to make federated learning robust to…

机器学习 · 统计学 2023-08-04 Krishna Pillutla , Sham M. Kakade , Zaid Harchaoui

Offline reinforcement learning (RL) presents a promising approach for learning reinforced policies from offline datasets without the need for costly or unsafe interactions with the environment. However, datasets collected by humans in…

机器学习 · 计算机科学 2024-03-12 Rui Yang , Han Zhong , Jiawei Xu , Amy Zhang , Chongjie Zhang , Lei Han , Tong Zhang

Data corruption, including missing and noisy data, poses significant challenges in real-world machine learning. This study investigates the effects of data corruption on model performance and explores strategies to mitigate these effects…

机器学习 · 计算机科学 2025-05-22 Qi Liu , Wanjing Ma

Imitation learning is a data-driven approach to learning policies from expert behavior, but it is prone to unreliable outcomes in out-of-sample (OOS) regions. While previous research relying on stable dynamical systems guarantees…

机器学习 · 计算机科学 2025-03-27 Amin Abyaneh , Mahrokh G. Boroujeni , Hsiu-Chin Lin , Giancarlo Ferrari-Trecate

Learning from humans is challenging because people are imperfect teachers. When everyday humans show the robot a new task they want it to perform, humans inevitably make errors (e.g., inputting noisy actions) and provide suboptimal examples…

机器人学 · 计算机科学 2025-05-19 Shahabedin Sagheb , Dylan P. Losey

Offline reinforcement learning (RL) algorithms can acquire effective policies by utilizing previously collected experience, without any online interaction. It is widely understood that offline RL is able to extract good policies even from…

机器学习 · 计算机科学 2022-04-13 Aviral Kumar , Joey Hong , Anikait Singh , Sergey Levine

Distributionally robust offline reinforcement learning (RL) aims to find a policy that performs the best under the worst environment within an uncertainty set using an offline dataset collected from a nominal model. While recent advances in…

机器学习 · 计算机科学 2025-01-07 Ruiquan Huang , Yingbin Liang , Jing Yang

We present an adaptive approach for robust learning from corrupted training sets. We identify corrupted and non-corrupted samples with latent Bernoulli variables and thus formulate the learning problem as maximization of the likelihood…

机器学习 · 统计学 2024-06-17 Aleksandr Karakulev , Dave Zachariah , Prashant Singh

Imitation Learning (IL) has proven highly effective for robotic and control tasks where manually designing reward functions or explicit controllers is infeasible. However, standard IL methods implicitly assume that the environment dynamics…

机器学习 · 计算机科学 2025-11-12 Rishabh Agrawal , Yusuf Alvi , Rahul Jain , Ashutosh Nayyar

Imitation learning can reproduce policies by observing experts, which poses a problem regarding policy privacy. Policies, such as human, or policies on deployed robots, can all be cloned without consent from the owners. How can we protect…

机器学习 · 计算机科学 2020-08-04 Albert Zhan , Stas Tiomkin , Pieter Abbeel