中文
相关论文

相关论文: Regularizing Adversarial Imitation Learning Using …

200 篇论文

When applying imitation learning techniques to fit a policy from expert demonstrations, one can take advantage of prior stability/robustness assumptions on the expert's policy and incorporate such control-theoretic prior knowledge…

最优化与控制 · 数学 2021-03-25 Aaron Havens , Bin Hu

Imitation learning is a proven method for creating a policy in the absence of rewards, by leveraging expert demonstrations. In this work, we apply imitation learning to conversation. In doing so, we recover a policy capable of talking to a…

计算与语言 · 计算机科学 2025-08-19 Noah Kasmanoff , Rahul Zalkikar

While recent progress has spawned very powerful machine learning systems, those agents remain extremely specialized and fail to transfer the knowledge they gain to similar yet unseen tasks. In this paper, we study a simple reinforcement…

机器学习 · 计算机科学 2020-12-15 Remi Tachet , Philip Bachman , Harm van Seijen

Providing expert trajectories in the context of Imitation Learning is often expensive and time-consuming. The goal must therefore be to create algorithms which require as little expert data as possible. In this paper we present an algorithm…

机器学习 · 计算机科学 2022-06-14 Jonas Nüßlein , Steffen Illium , Robert Müller , Thomas Gabor , Claudia Linnhoff-Popien

Behavioral cloning has proven to be effective for learning sequential decision-making policies from expert demonstrations. However, behavioral cloning often suffers from the causal confusion problem where a policy relies on the noticeable…

机器学习 · 计算机科学 2021-10-28 Jongjin Park , Younggyo Seo , Chang Liu , Li Zhao , Tao Qin , Jinwoo Shin , Tie-Yan Liu

Imitation learning is a popular approach for teaching motor skills to robots. However, most approaches focus on extracting policy parameters from execution traces alone (i.e., motion trajectories and perceptual data). No adequate…

机器人学 · 计算机科学 2020-10-26 Simon Stepputtis , Joseph Campbell , Mariano Phielipp , Stefan Lee , Chitta Baral , Heni Ben Amor

The goal of imitation learning is to mimic expert behavior from demonstrations, without access to an explicit reward signal. A popular class of approach infers the (unknown) reward function via inverse reinforcement learning (IRL) followed…

机器学习 · 计算机科学 2022-04-19 Carl Qi , Pieter Abbeel , Aditya Grover

Learning complex policies with Reinforcement Learning (RL) is often hindered by instability and slow convergence, a problem exacerbated by the difficulty of reward engineering. Imitation Learning (IL) from expert demonstrations bypasses…

机器学习 · 计算机科学 2026-05-19 Sayambhu Sen , Shalabh Bhatnagar

Imitation learning in robotics faces significant challenges in generalization due to the complexity of robotic environments and the high cost of data collection. We introduce RoCoDA, a novel method that unifies the concepts of invariance,…

机器人学 · 计算机科学 2025-05-21 Ezra Ameperosa , Jeremy A. Collins , Mrinal Jain , Animesh Garg

Recent research on vulnerabilities of deep reinforcement learning (RL) has shown that adversarial policies adopted by an adversary agent can influence a target RL agent (victim agent) to perform poorly in a multi-agent environment. In…

机器学习 · 计算机科学 2022-11-01 The Viet Bui , Tien Mai , Thanh H. Nguyen

This study investigates behavior-targeted attacks on reinforcement learning and their countermeasures. Behavior-targeted attacks aim to manipulate the victim's behavior as desired by the adversary through adversarial interventions in state…

机器学习 · 计算机科学 2026-02-18 Shojiro Yamabe , Kazuto Fukuchi , Jun Sakuma

The goal of imitation learning is to mimic expert behavior without access to an explicit reward signal. Expert demonstrations provided by humans, however, often show significant variability due to latent factors that are typically not…

机器学习 · 计算机科学 2017-11-16 Yunzhu Li , Jiaming Song , Stefano Ermon

Imitation learning (IL) has achieved considerable success in solving complex sequential decision-making problems. However, current IL methods mainly assume that the environment for learning policies is the same as the environment for…

机器学习 · 计算机科学 2023-10-24 Siyuan Li , Xun Wang , Rongchang Zuo , Kewu Sun , Lingfei Cui , Jishiyu Ding , Peng Liu , Zhe Ma

Imitation learning suffers from causal confusion. This phenomenon occurs when learned policies attend to features that do not causally influence the expert actions but are instead spuriously correlated. Causally confused agents produce low…

机器学习 · 计算机科学 2023-08-14 Samuel Pfrommer , Yatong Bai , Hyunin Lee , Somayeh Sojoudi

Inverse reinforcement learning (IRL) infers a reward function from demonstrations, allowing for policy improvement and generalization. However, despite much recent interest in IRL, little work has been done to understand the minimum set of…

机器学习 · 计算机科学 2019-08-19 Daniel S. Brown , Scott Niekum

Imitation learning (IL) algorithms use expert demonstrations to learn a specific task. Most of the existing approaches assume that all expert demonstrations are reliable and trustworthy, but what if there exist some adversarial…

机器学习 · 计算机科学 2021-01-06 Mostafa Hussein , Brendan Crowe , Marek Petrik , Momotaz Begum

Learning representations that capture the underlying data generating process is a key problem for data efficient and robust use of neural networks. One key property for robustness which the learned representation should capture and which…

机器学习 · 计算机科学 2022-06-24 Mathieu Chevalley , Charlotte Bunne , Andreas Krause , Stefan Bauer

Consider an imitation learning problem that the imitator and the expert have different dynamics models. Most of the current imitation learning methods fail because they focus on imitating actions. We propose a novel state alignment-based…

机器学习 · 计算机科学 2019-11-26 Fangchen Liu , Zhan Ling , Tongzhou Mu , Hao Su

It has become increasingly common nowadays to collect observations of feature and response pairs from different environments. As a consequence, one has to apply learned predictors to data with a different distribution due to distribution…

统计方法学 · 统计学 2023-10-31 Kang Du , Yu Xiang

Representations of data that are invariant to changes in specified factors are useful for a wide range of problems: removing potential biases in prediction problems, controlling the effects of covariates, and disentangling meaningful…

机器学习 · 计算机科学 2019-12-03 Daniel Moyer , Shuyang Gao , Rob Brekelmans , Greg Ver Steeg , Aram Galstyan