中文
相关论文

相关论文: A Comprehensive Survey on Inverse Constrained Rein…

200 篇论文

Two main challenges in Reinforcement Learning (RL) are designing appropriate reward functions and ensuring the safety of the learned policy. To address these challenges, we present a theoretical framework for Inverse Reinforcement Learning…

机器学习 · 计算机科学 2023-06-02 Andreas Schlaginhaufen , Maryam Kamgarpour

In recent years, Reinforcement Learning (RL) has been applied to real-world problems with increasing success. Such applications often require to put constraints on the agent's behavior. Existing algorithms for constrained RL (CRL) rely on…

机器学习 · 计算机科学 2023-03-07 Ted Moskovitz , Brendan O'Donoghue , Vivek Veeriah , Sebastian Flennerhag , Satinder Singh , Tom Zahavy

Safe reinforcement learning (Safe RL) aims to ensure policy performance while satisfying safety constraints. However, most existing Safe RL methods assume benign environments, making them vulnerable to adversarial perturbations commonly…

机器学习 · 计算机科学 2026-02-19 Jialiang Fan , Shixiong Jiang , Mengyu Liu , Fanxin Kong

Deep reinforcement learning (DRL) has achieved groundbreaking successes in a wide variety of robotic applications. A natural consequence is the adoption of this paradigm for safety-critical tasks, where human safety and expensive hardware…

机器人学 · 计算机科学 2022-06-22 Davide Corsi , Raz Yerushalmi , Guy Amir , Alessandro Farinelli , David Harel , Guy Katz

Embodied agents, such as robots and virtual characters, must continuously select actions to execute tasks effectively, solving complex sequential decision-making problems. Given the difficulty of designing such controllers manually,…

机器人学 · 计算机科学 2026-05-18 Pedro Santana

Inverse reinforcement learning (IRL) aims to explicitly infer an underlying reward function based on collected expert demonstrations. Considering that obtaining expert demonstrations can be costly, the focus of current IRL techniques is on…

机器学习 · 计算机科学 2023-10-16 Lu Li , Yuxin Pan , Ruobing Chen , Jie Liu , Zilin Wang , Yu Liu , Zhiheng Li

The goal of the inverse reinforcement learning (IRL) problem is to recover the reward functions from expert demonstrations. However, the IRL problem like any ill-posed inverse problem suffers the congenital defect that the policy may be…

机器学习 · 计算机科学 2022-09-26 Ce Ju

In-context reinforcement learning (ICRL) is an emerging RL paradigm where an agent, after pretraining, can adapt to out-of-distribution test tasks without any parameter updates, instead relying on an expanding context of interaction…

机器学习 · 计算机科学 2026-05-28 Amir Moeini , Minjae Kwon , Alper Kamil Bozkurt , Yuichi Motai , Rohan Chandra , Lu Feng , Shangtong Zhang

Inverse reinforcement learning (IRL) aims to infer an agent's preferences (represented as a reward function $R$) from their behaviour (represented as a policy $\pi$). To do this, we need a behavioural model of how $\pi$ relates to $R$. In…

机器学习 · 计算机科学 2024-03-12 Joar Skalse , Alessandro Abate

Safe Reinforcement Learning (SafeRL) is the subfield of reinforcement learning that explicitly deals with safety constraints during the learning and deployment of agents. This survey provides a mathematically rigorous overview of SafeRL…

机器学习 · 计算机科学 2026-04-30 Ankita Kushwaha , Kiran Ravish , Preeti Lamba , Pawan Kumar

The goal of the Inverse reinforcement learning (IRL) task is to identify the underlying reward function and the corresponding optimal policy from a set of expert demonstrations. While most IRL algorithms' theoretical guarantees rely on a…

机器学习 · 统计学 2025-03-25 Ruijia Zhang , Siliang Zeng , Chenliang Li , Alfredo Garcia , Mingyi Hong

In standard reinforcement learning (RL), a learning agent seeks to optimize the overall reward. However, many key aspects of a desired behavior are more naturally expressed as constraints. For instance, the designer may want to limit the…

机器学习 · 计算机科学 2021-01-29 Sobhan Miryoosefi , Kianté Brantley , Hal Daumé , Miroslav Dudik , Robert Schapire

Inverse Reinforcement Learning (IRL) is a powerful paradigm for inferring a reward function from expert demonstrations. Many IRL algorithms require a known transition model and sometimes even a known expert policy, or they at least require…

机器学习 · 计算机科学 2023-08-23 David Lindner , Andreas Krause , Giorgia Ramponi

Reinforcement learning (RL) solves sequential decision-making problems via a trial-and-error process interacting with the environment. While RL achieves outstanding success in playing complex video games that allow huge trial-and-error,…

机器学习 · 计算机科学 2022-06-22 Fan-Ming Luo , Tian Xu , Hang Lai , Xiong-Hui Chen , Weinan Zhang , Yang Yu

Inverse reinforcement learning (IRL) aims to learn a reward function and a corresponding policy that best fit the demonstrated trajectories of an expert. However, current IRL works cannot learn incrementally from an ongoing trajectory…

机器学习 · 计算机科学 2025-07-24 Shicheng Liu , Minghui Zhu

Explicit engineering of reward functions for given environments has been a major hindrance to reinforcement learning methods. While Inverse Reinforcement Learning (IRL) is a solution to recover reward functions from demonstrations only,…

机器学习 · 计算机科学 2020-02-24 David Venuto , Jhelum Chakravorty , Leonard Boussioux , Junhao Wang , Gavin McCracken , Doina Precup

In this work, we propose a novel inverse reinforcement learning (IRL) algorithm for constrained Markov decision process (CMDP) problems. In standard IRL problems, the inverse learner or agent seeks to recover the reward function of the MDP,…

机器学习 · 计算机科学 2024-01-08 Nirjhar Das , Arpan Chattopadhyay

With the development of deep representation learning, the domain of reinforcement learning (RL) has become a powerful learning framework now capable of learning complex policies in high dimensional environments. This review summarises deep…

We study constrained reinforcement learning (CRL) from a novel perspective by setting constraints directly on state density functions, rather than the value functions considered by previous works. State density has a clear physical and…

机器学习 · 计算机科学 2021-06-25 Zengyi Qin , Yuxiao Chen , Chuchu Fan

We study a class of constrained reinforcement learning (RL) problems in which multiple constraint specifications are not identified before training. It is challenging to identify appropriate constraint specifications due to the undefined…

最优化与控制 · 数学 2024-01-02 Dongsheng Ding , Zhengyan Huan , Alejandro Ribeiro