中文
相关论文

相关论文: Regularizing Adversarial Imitation Learning Using …

200 篇论文

Robust imitation learning using disturbance injections overcomes issues of limited variation in demonstrations. However, these methods assume demonstrations are optimal, and that policy stabilization can be learned via simple augmentations.…

机器人学 · 计算机科学 2022-05-10 Hirotaka Tahara , Hikaru Sasaki , Hanbit Oh , Brendan Michael , Takamitsu Matsubara

This article introduces an imitation learning method for learning maximum entropy policies that comply with constraints demonstrated by expert trajectories executing a task. The formulation of the method takes advantage of results…

机器学习 · 计算机科学 2025-07-10 George Papadopoulos , George A. Vouros

Inverse Reinforcement Learning (IRL) aims to facilitate a learner's ability to imitate expert behavior by acquiring reward functions that explain the expert's decisions. Regularized IRL applies strongly convex regularizers to the learner's…

机器学习 · 计算机科学 2020-12-04 Wonseok Jeon , Chen-Yang Su , Paul Barde , Thang Doan , Derek Nowrouzezahrai , Joelle Pineau

Imitation learning, which learns agent policy by mimicking expert demonstration, has shown promising results in many applications such as medical treatment regimes and self-driving vehicles. However, it remains a difficult task to interpret…

机器学习 · 计算机科学 2024-01-31 Tianxiang Zhao , Wenchao Yu , Suhang Wang , Lu Wang , Xiang Zhang , Yuncong Chen , Yanchi Liu , Wei Cheng , Haifeng Chen

Imitation learning seeks to learn an expert policy from sampled demonstrations. However, in the real world, it is often difficult to find a perfect expert and avoiding dangerous behaviors becomes relevant for safety reasons. We present the…

机器学习 · 计算机科学 2019-09-26 David Venuto , Leonard Boussioux , Junhao Wang , Rola Dali , Jhelum Chakravorty , Yoshua Bengio , Doina Precup

We study the problem of learning causal models from observational data through the lens of interpolation and its counterpart -- regularization. A large volume of recent theoretical, as well as empirical work, suggests that, in highly…

The proliferation of artificial intelligence is increasingly dependent on model understanding. Understanding demands both an interpretation - a human reasoning about a model's behavior - and an explanation - a symbolic representation of the…

机器学习 · 计算机科学 2022-08-30 Charl Maree , Christian W. Omlin

In this paper we propose a novel gradient algorithm to learn a policy from an expert's observed behavior assuming that the expert behaves optimally with respect to some unknown reward function of a Markovian Decision Problem. The…

机器学习 · 计算机科学 2012-06-26 Gergely Neu , Csaba Szepesvari

Autonomous systems are increasingly expected to operate in the presence of adversaries, though adversaries may infer sensitive information simply by observing a system. Therefore, present a deceptive sequential decision-making framework…

We present the ADaptive Adversarial Imitation Learning (ADAIL) algorithm for learning adaptive policies that can be transferred between environments of varying dynamics, by imitating a small number of demonstrations collected from a single…

机器学习 · 计算机科学 2020-08-31 Yiren Lu , Jonathan Tompson

Inverse Reinforcement Learning (IRL) learns an optimal policy, given some expert demonstrations, thus avoiding the need for the tedious process of specifying a suitable reward function. However, current methods are constrained by at least…

机器学习 · 计算机科学 2023-11-16 Pierre Le Pelletier de Woillemont , Rémi Labory , Vincent Corruble

It is evidence that representation learning can improve model's performance over multiple downstream tasks in many real-world scenarios, such as image classification and recommender systems. Existing learning approaches rely on establishing…

机器学习 · 计算机科学 2022-02-18 Mengyue Yang , Xinyu Cai , Furui Liu , Xu Chen , Zhitang Chen , Jianye Hao , Jun Wang

Imitation learning is a powerful approach for learning autonomous driving policy by leveraging data from expert driver demonstrations. However, driving policies trained via imitation learning that neglect the causal structure of expert…

机器人学 · 计算机科学 2021-12-08 Mohammad Reza Samsami , Mohammadhossein Bahari , Saber Salehkaleybar , Alexandre Alahi

Behavioral cloning reduces policy learning to supervised learning by training a discriminative model to predict expert actions given observations. Such discriminative models are non-causal: the training procedure is unaware of the causal…

机器学习 · 计算机科学 2019-11-05 Pim de Haan , Dinesh Jayaraman , Sergey Levine

We propose a method for learning linear models whose predictive performance is robust to causal interventions on unobserved variables, when noisy proxies of those variables are available. Our approach takes the form of a regularization term…

机器学习 · 计算机科学 2021-06-29 Michael Oberst , Nikolaj Thams , Jonas Peters , David Sontag

Many modern methods for imitation learning and inverse reinforcement learning, such as GAIL or AIRL, are based on an adversarial formulation. These methods apply GANs to match the expert's distribution over states and actions with the…

机器学习 · 计算机科学 2020-08-11 Oleg Arenz , Gerhard Neumann

Imitation Learning describes the problem of recovering an expert policy from demonstrations. While inverse reinforcement learning approaches are known to be very sample-efficient in terms of expert demonstrations, they usually require…

机器学习 · 计算机科学 2019-06-20 Huang Xiao , Michael Herman , Joerg Wagner , Sebastian Ziesche , Jalal Etesami , Thai Hong Linh

Recent developments in imitation learning have considerably advanced robotic manipulation. However, current techniques in imitation learning can suffer from poor generalization, limiting performance even under relatively minor domain…

机器人学 · 计算机科学 2025-07-31 Yifei Chen , Yuzhe Zhang , Giovanni D'urso , Nicholas Lawrance , Brendan Tidd

Unlike traditional learning to rank models that depend on hand-crafted features, neural representation learning models learn higher level features for the ranking task by training on large datasets. Their ability to learn new features…

信息检索 · 计算机科学 2018-05-10 Daniel Cohen , Bhaskar Mitra , Katja Hofmann , W. Bruce Croft

The increased complexity of state-of-the-art reinforcement learning (RL) algorithms have resulted in an opacity that inhibits explainability and understanding. This has led to the development of several post-hoc explainability methods that…

机器学习 · 计算机科学 2022-03-25 Charl Maree , Christian Omlin