中文
相关论文

相关论文: Learning Safety Constraints from Demonstrations wi…

200 篇论文

In the field of safe reinforcement learning (RL), finding a balance between satisfying safety constraints and optimizing reward performance presents a significant challenge. A key obstacle in this endeavor is the estimation of safety…

机器学习 · 计算机科学 2024-06-14 Zhepeng Cen , Yihang Yao , Zuxin Liu , Ding Zhao

Safety in goal directed Reinforcement Learning (RL) settings has typically been handled through constraints over trajectories and have demonstrated good performance in primarily short horizon tasks. In this paper, we are specifically…

人工智能 · 计算机科学 2024-01-10 Yuxiao Lu , Arunesh Sinha , Pradeep Varakantham

Safety in reinforcement learning (RL) is a key property in both training and execution in many domains such as autonomous driving or finance. In this paper, we formalize it with a constrained RL formulation in the distributional RL setting.…

机器学习 · 计算机科学 2021-03-01 Jianyi Zhang , Paul Weng

Learning from Demonstration allows robots to mimic human actions. However, these methods do not model constraints crucial to ensure safety of the learned skill. Moreover, even when explicitly modelling constraints, they rely on the…

机器人学 · 计算机科学 2025-01-09 Shivam Chaubey , Francesco Verdoja , Ville Kyrki

Reinforcement learning (RL) has revolutionized decision-making across a wide range of domains over the past few decades. Yet, deploying RL policies in real-world scenarios presents the crucial challenge of ensuring safety. Traditional safe…

系统与控制 · 电气工程与系统科学 2024-03-26 Lunet Yifru , Ali Baheri

Training-time safety violations have been a major concern when we deploy reinforcement learning algorithms in the real world. This paper explores the possibility of safe RL algorithms with zero training-time safety violations in the…

机器学习 · 计算机科学 2022-03-14 Yuping Luo , Tengyu Ma

Planning for diverse real-world robotic tasks necessitates to know and write all constraints. However, instances exist where these constraints are either unknown or challenging to specify accurately. A possible solution is to infer the…

机器人学 · 计算机科学 2025-01-17 Baiyu Peng , Aude Billard

Goal-Conditioned Reinforcement Learning (GCRL) provides a versatile framework for developing unified controllers capable of handling wide ranges of tasks, exploring environments, and adapting behaviors. However, its reliance on…

机器学习 · 计算机科学 2025-02-20 Charly Pecqueux-Guézénec , Stéphane Doncieux , Nicolas Perrin-Gilbert

Reinforcement learning (RL) excels in various applications but struggles in dynamic environments where the underlying Markov decision process evolves. Continual reinforcement learning (CRL) enables RL agents to continually learn and adapt…

机器学习 · 计算机科学 2025-12-23 Xue Yang , Michael Schukat , Junlin Lu , Patrick Mannion , Karl Mason , Enda Howley

An inverse reinforcement learning (IRL) agent learns to act intelligently by observing expert demonstrations and learning the expert's underlying reward function. Although learning the reward functions from demonstrations has achieved great…

人工智能 · 计算机科学 2022-02-28 Wei Gao , David Hsu , Wee Sun Lee

We consider the inverse reinforcement learning (IRL) problem, where an unknown reward function of some Markov decision process is estimated based on observed expert demonstrations. In most existing approaches, IRL is formulated and solved…

机器学习 · 计算机科学 2025-06-27 Hao Zhu , Yuan Zhang , Joschka Boedecker

Safe reinforcement learning (Safe RL) refers to a class of techniques that aim to prevent RL algorithms from violating constraints in the process of decision-making and exploration during trial and error. In this paper, a novel model-free…

系统与控制 · 电气工程与系统科学 2024-08-14 Homayoun Honari , Mehran Ghafarian Tamizi , Homayoun Najjaran

Safety stands as the primary obstacle preventing the widespread adoption of learning-based robotic systems in our daily lives. While reinforcement learning (RL) shows promise as an effective robot learning paradigm, conventional RL…

机器人学 · 计算机科学 2025-05-27 Maeva Guerrier , Karthik Soma , Hassan Fouad , Giovanni Beltrame

This work provides a state-of-the-art survey of continual safe online reinforcement learning (COSRL) methods. We discuss theoretical aspects, challenges, and open questions in building continual online safe reinforcement learning…

机器学习 · 计算机科学 2026-01-09 Timofey Tomashevskiy

Constrained Markov Decision Processes are a class of stochastic decision problems in which the decision maker must select a policy that satisfies auxiliary cost constraints. This paper extends upper confidence reinforcement learning for…

机器学习 · 计算机科学 2020-01-28 Liyuan Zheng , Lillian J. Ratliff

This work addresses the problem of offline safe imitation learning (IL), where the goal is to learn safe and reward-maximizing policies from demonstrations that do not have per-timestep safety cost or reward information. In many real-world…

机器学习 · 计算机科学 2026-02-12 Returaj Burnwal , Nirav Pravinbhai Bhatt , Balaraman Ravindran

Inverse reinforcement learning (IRL) aims to explicitly infer an underlying reward function based on collected expert demonstrations. Considering that obtaining expert demonstrations can be costly, the focus of current IRL techniques is on…

机器学习 · 计算机科学 2023-10-16 Lu Li , Yuxin Pan , Ruobing Chen , Jie Liu , Zilin Wang , Yu Liu , Zhiheng Li

Two main challenges in Reinforcement Learning (RL) are designing appropriate reward functions and ensuring the safety of the learned policy. To address these challenges, we present a theoretical framework for Inverse Reinforcement Learning…

机器学习 · 计算机科学 2023-06-02 Andreas Schlaginhaufen , Maryam Kamgarpour

Constrained Reinforcement Learning (CRL) aims to optimize decision-making policies under constraint conditions, making it highly applicable to safety-critical domains such as autonomous driving, robotics, and power grid management. However,…

机器学习 · 计算机科学 2026-02-16 Wentao Xu , Zhongming Yao , Weihao Li , Zhenghang Song , Yumeng Song , Tianyi Li , Yushuai Li

Optimizing objective functions subject to constraints is fundamental in many real-world applications. However, these constraints are often not readily defined and must be inferred from expert agent behaviors, a problem known as Inverse…

机器学习 · 计算机科学 2025-05-19 Bo Yue , Jian Li , Guiliang Liu