中文
相关论文

相关论文: Inversely Learning Transferable Rewards via Abstra…

200 篇论文

Reinforcement learning agents are prone to undesired behaviors due to reward mis-specification. Finding a set of reward functions to properly guide agent behaviors is particularly challenging in multi-agent scenarios. Inverse reinforcement…

机器学习 · 计算机科学 2019-08-01 Lantao Yu , Jiaming Song , Stefano Ermon

In this paper, we propose a novel method for learning reward functions directly from offline demonstrations. Unlike traditional inverse reinforcement learning (IRL), our approach decouples the reward function from the learner's policy,…

机器学习 · 计算机科学 2025-06-13 Seyed Mahdi B. Azad , Zahra Padar , Gabriel Kalweit , Joschka Boedecker

Inverse Reinforcement Learning infers a reward function from expert demonstrations, aiming to encode the behavior and intentions of the expert. Current approaches usually do this with generative and uni-modal models, meaning that they…

机器学习 · 计算机科学 2021-11-16 Niklas Freymuth , Philipp Becker , Gerhard Neumann

In this paper, we study an inverse reinforcement learning problem that involves learning the reward function of a learning agent using trajectory data collected while this agent is learning its optimal policy. To address this problem, we…

机器学习 · 计算机科学 2024-10-21 Kavinayan P. Sivakumar , Yi Shen , Zachary Bell , Scott Nivison , Boyuan Chen , Michael M. Zavlanos

Reward functions are difficult to design and often hard to align with human intent. Preference-based Reinforcement Learning (RL) algorithms address these problems by learning reward functions from human feedback. However, the majority of…

机器学习 · 计算机科学 2023-11-28 Joey Hejna , Dorsa Sadigh

Inverse reinforcement learning (IRL) aims to explicitly infer an underlying reward function based on collected expert demonstrations. Considering that obtaining expert demonstrations can be costly, the focus of current IRL techniques is on…

机器学习 · 计算机科学 2023-10-16 Lu Li , Yuxin Pan , Ruobing Chen , Jie Liu , Zilin Wang , Yu Liu , Zhiheng Li

Large language models (LLMs) trained with Reinforcement Learning from Human Feedback (RLHF) have demonstrated remarkable capabilities, but their underlying reward functions and decision-making processes remain opaque. This paper introduces…

计算与语言 · 计算机科学 2025-10-07 Jared Joselowitz , Ritam Majumdar , Arjun Jagota , Matthieu Bou , Nyal Patel , Satyapriya Krishna , Sonali Parbhoo

When a person is not satisfied with how a robot performs a task, they can intervene to correct it. Reward learning methods enable the robot to adapt its reward function online based on such human input, but they rely on handcrafted…

机器人学 · 计算机科学 2021-01-13 Andreea Bobu , Marius Wiggert , Claire Tomlin , Anca D. Dragan

While Reinforcement Learning (RL) aims to train an agent from a reward function in a given environment, Inverse Reinforcement Learning (IRL) seeks to recover the reward function from observing an expert's behavior. It is well known that, in…

机器学习 · 计算机科学 2022-10-14 Paul Rolland , Luca Viano , Norman Schuerhoff , Boris Nikolov , Volkan Cevher

When robots enter everyday human environments, they need to understand their tasks and how they should perform those tasks. To encode these, reward functions, which specify the objective of a robot, are employed. However, designing reward…

机器人学 · 计算机科学 2022-10-21 Erdem Bıyık

In this paper, we study the problem of obtaining a control policy that can mimic and then outperform expert demonstrations in Markov decision processes where the reward function is unknown to the learning agent. One main relevant approach…

机器学习 · 计算机科学 2020-09-24 Feng Tao , Yongcan Cao

Advances in the field of inverse reinforcement learning (IRL) have led to sophisticated inference frameworks that relax the original modeling assumption of observing an agent behavior that reflects only a single intention. Instead of…

机器学习 · 计算机科学 2018-12-03 Adrian Šošić , Elmar Rueckert , Jan Peters , Abdelhak M. Zoubir , Heinz Koeppl

Current reinforcement learning (RL) methods can successfully learn single tasks but often generalize poorly to modest perturbations in task domain or training procedure. In this work, we present a decoupled learning strategy for RL that…

机器学习 · 计算机科学 2018-05-10 Amy Zhang , Harsh Satija , Joelle Pineau

In the era of Industry 4.0 and smart manufacturing, process systems engineering must adapt to digital transformation. While reinforcement learning offers a model-free approach to process control, its applications are limited by the…

系统与控制 · 电气工程与系统科学 2025-05-28 Runze Lin , Junghui Chen , Biao Huang , Lei Xie , Hongye Su

Inverse reinforcement learning methods aim to retrieve the reward function of a Markov decision process based on a dataset of expert demonstrations. The commonplace scarcity and heterogeneous sources of such demonstrations can lead to the…

机器学习 · 计算机科学 2024-09-13 Ivan Ovinnikov , Eugene Bykovets , Joachim M. Buhmann

We propose a distributional framework for offline Inverse Reinforcement Learning (IRL) that jointly models uncertainty over reward functions and full distributions of returns. Unlike conventional IRL approaches that recover a deterministic…

机器学习 · 计算机科学 2026-05-29 Feiyang Wu , Ye Zhao , Anqi Wu

An inverse reinforcement learning (IRL) agent learns to act intelligently by observing expert demonstrations and learning the expert's underlying reward function. Although learning the reward functions from demonstrations has achieved great…

人工智能 · 计算机科学 2022-02-28 Wei Gao , David Hsu , Wee Sun Lee

Inverse Reinforcement Learning (IRL) learns an optimal policy, given some expert demonstrations, thus avoiding the need for the tedious process of specifying a suitable reward function. However, current methods are constrained by at least…

机器学习 · 计算机科学 2023-11-16 Pierre Le Pelletier de Woillemont , Rémi Labory , Vincent Corruble

We study the problem of inverse reinforcement learning (IRL), where the learning agent recovers a reward function using expert demonstrations. Most of the existing IRL techniques make the often unrealistic assumption that the agent has…

机器学习 · 计算机科学 2021-12-20 Franck Djeumou , Murat Cubuktepe , Craig Lennon , Ufuk Topcu

Active learning from demonstration allows a robot to query a human for specific types of input to achieve efficient learning. Existing work has explored a variety of active query strategies; however, to our knowledge, none of these…

机器学习 · 计算机科学 2019-06-05 Daniel S. Brown , Yuchen Cui , Scott Niekum