中文
相关论文

相关论文: Safe Reinforcement Learning using Action Projectio…

200 篇论文

Real-world reinforcement learning (RL) problems often demand that agents behave safely by obeying a set of designed constraints. We address the challenge of safe RL by coupling a safety guide based on model predictive control (MPC) with a…

机器学习 · 计算机科学 2022-03-30 Samuel Pfrommer , Tanmay Gautam , Alec Zhou , Somayeh Sojoudi

Reinforcement Learning (RL) has been shown to be effective in many scenarios. However, it typically requires the exploration of a sufficiently large number of state-action pairs, some of which may be unsafe. Consequently, its application to…

系统与控制 · 电气工程与系统科学 2022-06-24 Yousef Emam , Gennaro Notomista , Paul Glotfelter , Zsolt Kira , Magnus Egerstedt

Deep Reinforcement Learning (RL) has shown promise in addressing complex robotic challenges. In real-world applications, RL is often accompanied by failsafe controllers as a last resort to avoid catastrophic events. While necessary for…

机器人学 · 计算机科学 2023-09-26 Jakob Thumm , Guillaume Pelat , Matthias Althoff

Reinforcement Learning (RL) is essentially a trial-and-error learning procedure which may cause unsafe behavior during the exploration-and-exploitation process. This hinders the application of RL to real-world control problems, especially…

机器学习 · 计算机科学 2021-05-03 Yutong Li , Nan Li , H. Eric Tseng , Anouck Girard , Dimitar Filev , Ilya Kolmanovsky

We consider the safe reinforcement learning (RL) problem of maximizing utility with extremely low constraint violation rates. Assuming no prior knowledge or pre-training of the environment safety model given a task, an agent has to learn,…

机器学习 · 计算机科学 2022-10-12 Haonan Yu , Wei Xu , Haichao Zhang

Reinforcement Learning (RL) offers a promising framework for autonomous driving by enabling agents to learn control policies through interaction with environments. However, large and high-dimensional action spaces often used to support…

机器人学 · 计算机科学 2025-07-08 Elahe Delavari , Feeza Khan Khanzada , Jaerock Kwon

Safe reinforcement learning (RL) with hard constraint guarantees is a promising optimal control direction for multi-energy management systems. It only requires the environment-specific constraint functions itself a priori and not a complete…

系统与控制 · 电气工程与系统科学 2023-11-07 Glenn Ceusters , Muhammad Andy Putratama , Rüdiger Franke , Ann Nowé , Maarten Messagie

Reinforcement Learning (RL) for control has become increasingly popular due to its ability to learn rich feedback policies that take into account uncertainty and complex representations of the environment. When considering safety…

机器学习 · 计算机科学 2024-05-21 Sean Vaskov , Wilko Schwarting , Chris L. Baker

Safety in reinforcement learning (RL) is a key property in both training and execution in many domains such as autonomous driving or finance. In this paper, we formalize it with a constrained RL formulation in the distributional RL setting.…

机器学习 · 计算机科学 2021-03-01 Jianyi Zhang , Paul Weng

Reinforcement learning (RL) agents need to explore their environments in order to learn optimal policies. In many environments and tasks, safety is of critical importance. The widespread use of simulators offers a number of advantages,…

机器人学 · 计算机科学 2024-03-01 Luka Kovač , Igor Farkaš

Reinforcement learning (RL) controllers are flexible and performant but rarely guarantee safety. Safety filters impart hard safety guarantees to RL controllers while maintaining flexibility. However, safety filters can cause undesired…

机器人学 · 计算机科学 2024-12-20 Federico Pizarro Bejarano , Lukas Brunke , Angela P. Schoellig

In many RL applications, ensuring an agent's actions adhere to constraints is crucial for safety. Most previous methods in Action-Constrained Reinforcement Learning (ACRL) employ a projection layer after the policy network to correct the…

机器学习 · 计算机科学 2025-02-18 Janaka Chathuranga Brahmanage , Jiajing Ling , Akshat Kumar

Reinforcement Learning (RL) is a powerful method for controlling dynamic systems, but its learning mechanism can lead to unpredictable actions that undermine the safety of critical systems. Here, we propose RL with Adaptive Regularization…

机器学习 · 计算机科学 2024-11-01 Haozhe Tian , Homayoun Hamedmoghadam , Robert Shorten , Pietro Ferraro

Safe interaction with the environment is one of the most challenging aspects of Reinforcement Learning (RL) when applied to real-world problems. This is particularly important when unsafe actions have a high or irreversible negative impact…

机器学习 · 计算机科学 2021-10-22 Erik Aumayr , Saman Feghhi , Filippo Vannella , Ezeddin Al Hakim , Grigorios Iakovidis

Reinforcement Learning (RL) applications in real-world scenarios must prioritize safety and reliability, which impose strict constraints on agent behavior. Model-based RL leverages predictive world models for action planning and policy…

人工智能 · 计算机科学 2025-06-06 Artem Latyshev , Gregory Gorbov , Aleksandr I. Panov

Many sequential decision problems involve finding a policy that maximizes total reward while obeying safety constraints. Although much recent research has focused on the development of safe reinforcement learning (RL) algorithms that…

机器学习 · 计算机科学 2021-07-20 Nolan Wagener , Byron Boots , Ching-An Cheng

Reinforcement learning~(RL) is a versatile framework for learning to solve complex real-world tasks. However, influences on the learning performance of RL algorithms are often poorly understood in practice. We discuss different analysis…

机器学习 · 计算机科学 2023-09-14 Jan Schneider , Pierre Schumacher , Daniel Häufle , Bernhard Schölkopf , Dieter Büchler

Reinforcement Learning (RL) bears the promise of being a game-changer in many applications. However, since most of the literature in the field is currently focused on opaque models, the use of RL in high-stakes scenarios, where…

机器学习 · 计算机科学 2025-01-22 Leonardo Lucio Custode , Giovanni Iacca

Safe reinforcement learning (RL) studies problems where an intelligent agent has to not only maximize reward but also avoid exploring unsafe areas. In this study, we propose CUP, a novel policy optimization method based on Constrained…

机器学习 · 计算机科学 2022-11-10 Long Yang , Jiaming Ji , Juntao Dai , Linrui Zhang , Binbin Zhou , Pengfei Li , Yaodong Yang , Gang Pan

Function approximation has enabled remarkable advances in applying reinforcement learning (RL) techniques in environments with high-dimensional inputs, such as images, in an end-to-end fashion, mapping such inputs directly to low-level…

机器学习 · 计算机科学 2023-01-02 Junlin Wu , Hussein Sibai , Yevgeniy Vorobeychik