中文
相关论文

相关论文: Unlabeled Imperfect Demonstrations in Adversarial …

200 篇论文

In standard passive imitation learning, the goal is to learn a target policy by passively observing full execution trajectories of it. Unfortunately, generating such trajectories can require substantial expert effort and be impractical in…

机器学习 · 计算机科学 2012-10-19 Kshitij Judah , Alan Fern , Thomas G. Dietterich

Imitation learning has traditionally been applied to learn a single task from demonstrations thereof. The requirement of structured and isolated demonstrations limits the scalability of imitation learning approaches as they are difficult to…

机器人学 · 计算机科学 2017-11-27 Karol Hausman , Yevgen Chebotar , Stefan Schaal , Gaurav Sukhatme , Joseph Lim

Imitation learning is a proven method for creating a policy in the absence of rewards, by leveraging expert demonstrations. In this work, we apply imitation learning to conversation. In doing so, we recover a policy capable of talking to a…

计算与语言 · 计算机科学 2025-08-19 Noah Kasmanoff , Rahul Zalkikar

Limited data has become a major bottleneck in scaling up offline imitation learning (IL). In this paper, we propose enhancing IL performance under limited expert data by introducing a pre-training stage that learns dynamics representations,…

机器人学 · 计算机科学 2025-08-21 Haitong Ma , Bo Dai , Zhaolin Ren , Yebin Wang , Na Li

We consider the problem of learning to perform a task from demonstrations given by teachers or experts, when some of the experts' demonstrations might be adversarial and demonstrate an incorrect way to perform the task. We propose a novel…

机器学习 · 计算机科学 2023-06-13 Prithviraj Dasgupta

Adversarial examples are malicious inputs designed to fool machine learning models. They often transfer from one model to another, allowing attackers to mount black box attacks without knowledge of the target model's parameters. Adversarial…

计算机视觉与模式识别 · 计算机科学 2017-02-14 Alexey Kurakin , Ian Goodfellow , Samy Bengio

We consider a problem of learning the reward and policy from expert examples under unknown dynamics. Our proposed method builds on the framework of generative adversarial networks and introduces the empowerment-regularized maximum-entropy…

机器学习 · 计算机科学 2019-02-26 Ahmed H. Qureshi , Byron Boots , Michael C. Yip

This paper considers learning robot locomotion and manipulation tasks from expert demonstrations. Generative adversarial imitation learning (GAIL) trains a discriminator that distinguishes expert from agent transitions, and in turn use a…

机器学习 · 计算机科学 2022-06-24 Tianyu Wang , Nikhil Karnwal , Nikolay Atanasov

Imitation learning (IL) algorithms use expert demonstrations to learn a specific task. Most of the existing approaches assume that all expert demonstrations are reliable and trustworthy, but what if there exist some adversarial…

机器学习 · 计算机科学 2021-01-06 Mostafa Hussein , Brendan Crowe , Marek Petrik , Momotaz Begum

Developing agents that can perform challenging complex tasks is the goal of reinforcement learning. The model-free reinforcement learning has been considered as a feasible solution. However, the state of the art research has been to develop…

机器学习 · 计算机科学 2020-08-24 MyungJae Shin , Joongheon Kim

We study how an autonomous agent learns to perform a task from demonstrations in a different domain, such as a different environment or different agent. Such cross-domain imitation learning is required to, for example, train an artificial…

人工智能 · 计算机科学 2022-09-27 Tim Franzmeyer , Philip H. S. Torr , João F. Henriques

Inverse Reinforcement Learning (IRL) has demonstrated effectiveness in a variety of imitation tasks. In this paper, we introduce an IRL framework designed to extract rewarding features from expert trajectories affected by delayed…

机器学习 · 计算机科学 2024-12-05 Simon Sinong Zhan , Qingyuan Wu , Zhian Ruan , Frank Yang , Philip Wang , Yixuan Wang , Ruochen Jiao , Chao Huang , Qi Zhu

Learning reward functions from data is a promising path towards achieving scalable Reinforcement Learning (RL) for robotics. However, a major challenge in training agents from learned reward models is that the agent can learn to exploit…

机器学习 · 计算机科学 2019-11-04 Danfei Xu , Misha Denil

Imitation learning, which learns agent policy by mimicking expert demonstration, has shown promising results in many applications such as medical treatment regimes and self-driving vehicles. However, it remains a difficult task to interpret…

机器学习 · 计算机科学 2024-01-31 Tianxiang Zhao , Wenchao Yu , Suhang Wang , Lu Wang , Xiang Zhang , Yuncong Chen , Yanchi Liu , Wei Cheng , Haifeng Chen

Learning control policies offline from pre-recorded datasets is a promising avenue for solving challenging real-world problems. However, available datasets are typically of mixed quality, with a limited number of the trajectories that we…

In imitation learning from observation IfO, a learning agent seeks to imitate a demonstrating agent using only observations of the demonstrated behavior without access to the control signals generated by the demonstrator. Recent methods…

机器学习 · 计算机科学 2021-04-02 Faraz Torabi , Garrett Warnell , Peter Stone

In imitation learning, an agent learns how to behave in an environment with an unknown cost function by mimicking expert demonstrations. Existing imitation learning algorithms typically involve solving a sequence of planning or…

机器学习 · 计算机科学 2016-06-17 Jonathan Ho , Jayesh K. Gupta , Stefano Ermon

We study the problem of imitating an expert demonstrator in a discrete-time, continuous state-and-action control system. We show that, even if the dynamics satisfy a control-theoretic property called exponential stability (i.e. the effects…

机器学习 · 计算机科学 2025-07-29 Max Simchowitz , Daniel Pfrommer , Ali Jadbabaie

Imitation learning (IL) provides a data-driven framework for approximating policies for large-scale combinatorial optimisation problems formulated as sequential decision problems (SDPs), where exact solution methods are computationally…

机器学习 · 计算机科学 2026-04-13 Prakash Gawas , Antoine Legrain , Louis-Martin Rousseau

Adversarial training has emerged as an effective approach to train robust neural network models that are resistant to adversarial attacks, even in low-label regimes where labeled data is scarce. In this paper, we introduce a novel…

机器学习 · 计算机科学 2024-11-28 Tian Ye , Rajgopal Kannan , Viktor Prasanna