中文
相关论文

相关论文: Transferable Reward Learning by Dynamics-Agnostic …

200 篇论文

This paper presents a deep Inverse Reinforcement Learning (IRL) framework that can learn an a priori unknown number of nonlinear reward functions from unlabeled experts' demonstrations. For this purpose, we employ the tools from Dirichlet…

机器学习 · 计算机科学 2021-07-15 Ariyan Bighashdel , Panagiotis Meletis , Pavol Jancura , Gijs Dubbelman

Inverse Reinforcement Learning (IRL) is attractive in scenarios where reward engineering can be tedious. However, prior IRL algorithms use on-policy transitions, which require intensive sampling from the current policy for stable and…

机器学习 · 计算机科学 2022-05-24 Hana Hoshino , Kei Ota , Asako Kanezaki , Rio Yokota

Adversarial inverse reinforcement learning (AIRL) stands as a cornerstone approach in imitation learning, yet it faces criticisms from prior studies. In this paper, we rethink AIRL and respond to these criticisms. Criticism 1 lies in…

机器学习 · 计算机科学 2024-10-29 Yangchun Zhang , Qiang Liu , Weiming Li , Yirui Zhou

Many manipulation tasks require robots to interact with unknown environments. In such applications, the ability to adapt the impedance according to different task phases and environment constraints is crucial for safety and performance.…

机器人学 · 计算机科学 2021-02-16 Xiang Zhang , Liting Sun , Zhian Kuang , Masayoshi Tomizuka

Compared to traditional imitation learning methods such as DAgger and DART, intervention-based imitation offers a more convenient and sample efficient data collection process to users. In this paper, we introduce Reinforced…

机器人学 · 计算机科学 2022-03-30 Rom Parnichkun , Matthew N. Dailey , Atsushi Yamashita

We tackle a common scenario in imitation learning (IL), where agents try to recover the optimal policy from expert demonstrations without further access to the expert or environment reward signals. Except the simple Behavior Cloning (BC)…

机器学习 · 计算机科学 2021-04-16 Minghuan Liu , Tairan He , Minkai Xu , Weinan Zhang

Domain incremental learning (DIL) poses a significant challenge in real-world scenarios, as models need to be sequentially trained on diverse domains over time, all the while avoiding catastrophic forgetting. Mitigating representation…

机器学习 · 计算机科学 2024-06-25 Kishaan Jeeveswaran , Elahe Arani , Bahram Zonooz

Inverse reinforcement learning (IRL) denotes a powerful family of algorithms for recovering a reward function justifying the behavior demonstrated by an expert agent. A well-known limitation of IRL is the ambiguity in the choice of the…

机器学习 · 计算机科学 2023-04-26 Alberto Maria Metelli , Filippo Lazzati , Marcello Restelli

Model-free deep reinforcement learning (RL) has demonstrated its superiority on many complex sequential decision-making problems. However, heavy dependence on dense rewards and high sample-complexity impedes the wide adoption of these…

机器学习 · 计算机科学 2020-04-02 Zhuangdi Zhu , Kaixiang Lin , Bo Dai , Jiayu Zhou

Inverse Reinforcement Learning (IRL) has demonstrated effectiveness in a variety of imitation tasks. In this paper, we introduce an IRL framework designed to extract rewarding features from expert trajectories affected by delayed…

机器学习 · 计算机科学 2024-12-05 Simon Sinong Zhan , Qingyuan Wu , Zhian Ruan , Frank Yang , Philip Wang , Yixuan Wang , Ruochen Jiao , Chao Huang , Qi Zhu

We study the use of inverse reinforcement learning (IRL) as a tool for the recognition of agents' behavior on the basis of observation of their sequential decision behavior interacting with the environment. We model the problem faced by the…

机器学习 · 计算机科学 2013-03-22 Qifeng Qiao , Peter A. Beling

Robotic manipulation holds the potential to replace humans in the execution of tedious or dangerous tasks. However, control-based approaches are not suitable due to the difficulty of formally describing open-world manipulation in reality,…

机器人学 · 计算机科学 2023-11-21 Zihao Liu , Xing Liu , Yizhai Zhang , Zhengxiong Liu , Panfeng Huang

In Imitation Learning (IL), utilizing suboptimal and heterogeneous demonstrations presents a substantial challenge due to the varied nature of real-world data. However, standard IL algorithms consider these datasets as homogeneous, thereby…

机器学习 · 计算机科学 2024-12-16 Mark Beliaev , Ramtin Pedarsani

Imitation learning in a high-dimensional environment is challenging. Most inverse reinforcement learning (IRL) methods fail to outperform the demonstrator in such a high-dimensional environment, e.g., Atari domain. To address this…

机器学习 · 计算机科学 2020-09-14 Xingrui Yu , Yueming Lyu , Ivor W. Tsang

This paper considers learning robot locomotion and manipulation tasks from expert demonstrations. Generative adversarial imitation learning (GAIL) trains a discriminator that distinguishes expert from agent transitions, and in turn use a…

机器学习 · 计算机科学 2022-06-24 Tianyu Wang , Nikhil Karnwal , Nikolay Atanasov

Advanced biological intelligence learns efficiently from an information-rich stream of stimulus information, even when feedback on behaviour quality is sparse or absent. Such learning exploits implicit assumptions about task domains. We…

神经与进化计算 · 计算机科学 2024-08-05 Solvi Arnold , Reiji Suzuki , Takaya Arita , Kimitoshi Yamazaki

Adversarial inverse reinforcement learning (IRL) for multi-agent task allocation (MATA) is challenged by non-stationary interactions and high-dimensional coordination. Unconstrained reward inference in these settings often leads to high…

机器学习 · 计算机科学 2026-02-10 Huilin Yin , Zhikun Yang , Linchuan Zhang , Daniel Watzenig

Learning to imitate expert behavior from demonstrations can be challenging, especially in environments with high-dimensional, continuous observations and unknown dynamics. Supervised learning methods based on behavioral cloning (BC) suffer…

机器学习 · 计算机科学 2019-09-27 Siddharth Reddy , Anca D. Dragan , Sergey Levine

Many imitation learning (IL) algorithms employ inverse reinforcement learning (IRL) to infer the intrinsic reward function that an expert is implicitly optimizing for based on their demonstrated behaviors. However, in practice, IRL-based IL…

机器学习 · 计算机科学 2024-02-08 Weichao Zhou , Wenchao Li

Inverse reinforcement learning (IRL) seeks to learn the reward function from expert trajectories, to understand the task for imitation or collaboration thereby removing the need for manual reward engineering. However, IRL in the context of…

机器学习 · 计算机科学 2023-11-13 Yikang Gui , Prashant Doshi