中文
相关论文

相关论文: Leveraging Analytic Gradients in Provably Safe Rei…

200 篇论文

Reinforcement Learning (RL) has been shown to be effective in many scenarios. However, it typically requires the exploration of a sufficiently large number of state-action pairs, some of which may be unsafe. Consequently, its application to…

系统与控制 · 电气工程与系统科学 2022-06-24 Yousef Emam , Gennaro Notomista , Paul Glotfelter , Zsolt Kira , Magnus Egerstedt

Shielding is a popular technique for achieving safe reinforcement learning (RL). However, classical shielding approaches come with quite restrictive assumptions making them difficult to deploy in complex environments, particularly those…

机器学习 · 计算机科学 2024-02-02 Alexander W. Goodall , Francesco Belardinelli

Safety is an essential component for deploying reinforcement learning (RL) algorithms in real-world scenarios, and is critical during the learning process itself. A natural first approach toward safe RL is to manually specify constraints on…

机器学习 · 计算机科学 2020-10-29 Krishnan Srinivasan , Benjamin Eysenbach , Sehoon Ha , Jie Tan , Chelsea Finn

In this paper we propose a formal, model-agnostic meta-learning framework for safe reinforcement learning. Our framework is inspired by how parents safeguard their children across a progression of increasingly riskier tasks, imparting a…

机器学习 · 计算机科学 2024-11-01 Nabil Omi , Hosein Hasanbeig , Hiteshi Sharma , Sriram K. Rajamani , Siddhartha Sen

Ensuring the safety of Reinforcement Learning (RL) is crucial for its deployment in real-world applications. Nevertheless, managing the trade-off between reward and safety during exploration presents a significant challenge. Improving…

机器学习 · 计算机科学 2025-03-04 Shangding Gu , Bilgehan Sel , Yuhao Ding , Lu Wang , Qingwei Lin , Ming Jin , Alois Knoll

Reinforcement learning is a powerful paradigm for learning optimal policies from experimental data. However, to find optimal policies, most reinforcement learning algorithms explore all possible actions, which may be harmful for real-world…

机器学习 · 统计学 2017-11-15 Felix Berkenkamp , Matteo Turchetta , Angela P. Schoellig , Andreas Krause

Reinforcement learning (RL) has shown great potential for solving complex tasks in a variety of domains. However, applying RL to safety-critical systems in the real-world is not easy as many algorithms are sample-inefficient and maximising…

机器学习 · 计算机科学 2024-02-02 Alexander W. Goodall , Francesco Belardinelli

Recently, safe reinforcement learning (RL) with the actor-critic structure for continuous control tasks has received increasing attention. It is still challenging to learn a near-optimal control policy with safety and convergence…

机器学习 · 计算机科学 2024-02-06 Xinglong Zhang , Yaoqian Peng , Biao Luo , Wei Pan , Xin Xu , Haibin Xie

Deep Reinforcement Learning (RL) has shown promise in addressing complex robotic challenges. In real-world applications, RL is often accompanied by failsafe controllers as a last resort to avoid catastrophic events. While necessary for…

机器人学 · 计算机科学 2023-09-26 Jakob Thumm , Guillaume Pelat , Matthias Althoff

As safety violations can lead to severe consequences in real-world robotic applications, the increasing deployment of Reinforcement Learning (RL) in robotic domains has propelled the study of safe exploration for reinforcement learning…

人工智能 · 计算机科学 2022-09-21 Hanping Zhang , Yuhong Guo

The concept of the value-gradient is introduced and developed in the context of reinforcement learning. It is shown that by learning the value-gradients exploration or stochastic behaviour is no longer needed to find locally optimal…

神经与进化计算 · 计算机科学 2008-03-26 Michael Fairbank

Safe reinforcement learning (Safe RL) seeks to maximize rewards while satisfying safety constraints, typically addressed through Lagrangian-based methods. However, existing approaches, including PID and classical Lagrangian methods, suffer…

机器学习 · 计算机科学 2026-01-27 Mingxu Zhang , Huicheng Zhang , Jiaming Ji , Yaodong Yang , Ying Sun

This paper develops the first policy gradient method with global optimality guarantee and complexity analysis for robust reinforcement learning under model mismatch. Robust reinforcement learning is to learn a policy robust to model…

机器学习 · 计算机科学 2022-05-17 Yue Wang , Shaofeng Zou

Deep reinforcement learning (DRL) has demonstrated remarkable performance in many continuous control tasks. However, a significant obstacle to the real-world application of DRL is the lack of safety guarantees. Although DRL agents can…

机器人学 · 计算机科学 2025-08-15 Weiye Zhao , Feihan Li , Changliu Liu

Vanilla Reinforcement Learning (RL) can efficiently solve complex tasks but does not provide any guarantees on system behavior. To bridge this gap, we propose a three-step safe RL procedure for continuous action spaces that provides…

机器人学 · 计算机科学 2023-09-29 Hanna Krasowski , Prithvi Akella , Aaron D. Ames , Matthias Althoff

The increasing adoption of Reinforcement Learning in safety-critical systems domains such as autonomous vehicles, health, and aviation raises the need for ensuring their safety. Existing safety mechanisms such as adversarial training,…

机器学习 · 计算机科学 2021-11-11 Paulina Stevia Nouwou Mindom , Amin Nikanjam , Foutse Khomh , John Mullins

Safety is a critical component of autonomous systems and remains a challenge for learning-based policies to be utilized in the real world. In particular, policies learned using reinforcement learning often fail to generalize to novel…

机器人学 · 计算机科学 2023-04-04 Kai-Chieh Hsu , Allen Z. Ren , Duy Phuong Nguyen , Anirudha Majumdar , Jaime F. Fisac

Reinforcement learning is a powerful technique for developing new robot behaviors. However, typical lack of safety guarantees constitutes a hurdle for its practical application on real robots. To address this issue, safe reinforcement…

机器学习 · 计算机科学 2024-04-29 Maeva Guerrier , Hassan Fouad , Giovanni Beltrame

Safety-critical robot systems need thorough testing to expose design flaws and software bugs which could endanger humans. Testing in simulation is becoming increasingly popular, as it can be applied early in the development process and does…

机器人学 · 计算机科学 2023-11-07 Tom P. Huck , Martin Kaiser , Constantin Cronrath , Bengt Lennartson , Torsten Kröger , Tamim Asfour

For all its successes, Reinforcement Learning (RL) still struggles to deliver formal guarantees on the closed-loop behavior of the learned policy. Among other things, guaranteeing the safety of RL with respect to safety-critical systems is…

系统与控制 · 电气工程与系统科学 2020-04-03 Sebastien Gros , Mario Zanon , Alberto Bemporad