English
Related papers

Related papers: Controlling Underestimation Bias in Constrained Re…

200 papers

Learning from expert demonstrations to flexibly program an autonomous system with complex behaviors or to predict an agent's behavior is a powerful tool, especially in collaborative control settings. A common method to solve this problem is…

Systems and Control · Electrical Eng. & Systems 2024-05-15 Samuel Tesfazgi , Leonhard Sprandl , Armin Lederer , Sandra Hirche

An inherent problem of reinforcement learning is performing exploration of an environment through random actions, of which a large portion can be unproductive. Instead, exploration can be improved by initializing the learning policy with an…

Machine Learning · Computer Science 2023-08-22 Jun Jet Tai , Jordan K. Terry , Mauro S. Innocente , James Brusey , Nadjim Horri

Constrained Reinforcement Learning (CRL) tackles sequential decision-making problems where agents are required to achieve goals by maximizing the expected return while meeting domain-specific constraints, which are often formulated as…

Machine Learning · Computer Science 2024-11-13 Alessandro Montenegro , Marco Mussi , Matteo Papini , Alberto Maria Metelli

As safety is of paramount importance in robotics, reinforcement learning that reflects safety, called safe RL, has been studied extensively. In safe RL, we aim to find a policy which maximizes the desired return while satisfying the defined…

Robotics · Computer Science 2023-12-04 Dohyeong Kim , Songhwai Oh

In safety-critical RL settings, the inclusion of an additional cost function is often favoured over the arduous task of modifying the reward function to ensure the agent's safe behaviour. However, designing or evaluating such a cost…

Artificial Intelligence · Computer Science 2025-01-14 Shashank Reddy Chirra , Pradeep Varakantham , Praveen Paruchuri

Safe reinforcement learning (RL) aims to learn policies that satisfy certain constraints before deploying them to safety-critical applications. Previous primal-dual style approaches suffer from instability issues and lack optimality…

Machine Learning · Computer Science 2022-06-20 Zuxin Liu , Zhepeng Cen , Vladislav Isenbaev , Wei Liu , Zhiwei Steven Wu , Bo Li , Ding Zhao

The deep reinforcement learning (DRL) algorithm works brilliantly on solving various complex control tasks. This phenomenal success can be partly attributed to DRL encouraging intelligent agents to sufficiently explore the environment and…

Machine Learning · Computer Science 2023-01-09 Chao Li , Chen Gong , Qiang He , Xinwen Hou , Yu Liu

Ensuring safety is a critical challenge in applying Reinforcement Learning (RL) to real-world scenarios. Constrained Reinforcement Learning (CRL) addresses this by maximizing returns under predefined constraints, typically formulated as the…

Machine Learning · Computer Science 2026-01-21 Shiqing Gao , Yihang Zhou , Shuai Shao , Haoyu Luo , Yiheng Bing , Jiaxin Ding , Luoyi Fu , Xinbing Wang

Constrained Reinforcement Learning (RL) aims to maximize the return while adhering to predefined constraint limits, which represent domain-specific safety requirements. In continuous control settings, where learning agents govern system…

Machine Learning · Computer Science 2025-09-12 Somnath Hazra , Pallab Dasgupta , Soumyajit Dey

In this work, we propose a novel inverse reinforcement learning (IRL) algorithm for constrained Markov decision process (CMDP) problems. In standard IRL problems, the inverse learner or agent seeks to recover the reward function of the MDP,…

Machine Learning · Computer Science 2024-01-08 Nirjhar Das , Arpan Chattopadhyay

In recent years, Reinforcement Learning (RL) has been applied to real-world problems with increasing success. Such applications often require to put constraints on the agent's behavior. Existing algorithms for constrained RL (CRL) rely on…

Machine Learning · Computer Science 2023-03-07 Ted Moskovitz , Brendan O'Donoghue , Vivek Veeriah , Sebastian Flennerhag , Satinder Singh , Tom Zahavy

This paper studies the constrained/safe reinforcement learning (RL) problem with sparse indicator signals for constraint violations. We propose a model-based approach to enable RL agents to effectively explore the environment with unknown…

Artificial Intelligence · Computer Science 2021-03-09 Zuxin Liu , Hongyi Zhou , Baiming Chen , Sicheng Zhong , Martial Hebert , Ding Zhao

Reinforcement Learning (RL) applied in healthcare can lead to unsafe medical decisions and treatment, such as excessive dosages or abrupt changes, often due to agents overlooking common-sense constraints. Consequently, Constrained…

Machine Learning · Computer Science 2024-10-15 Nan Fang , Guiliang Liu , Wei Gong

In risk-averse reinforcement learning (RL), the goal is to optimize some risk measure of the returns. A risk measure often focuses on the worst returns out of the agent's experience. As a result, standard methods for risk-averse RL often…

Machine Learning · Computer Science 2022-10-13 Ido Greenberg , Yinlam Chow , Mohammad Ghavamzadeh , Shie Mannor

In-context reinforcement learning (ICRL) promises fast adaptation to unseen environments without parameter updates, but current methods either cannot improve beyond the training distribution or require near-optimal data, limiting practical…

Machine Learning · Computer Science 2026-01-07 Anaïs Berkes , Vincent Taboga , Donna Vakalis , David Rolnick , Yoshua Bengio

Simulation-based design space exploration (DSE) aims to efficiently optimize high-dimensional structured designs under complex constraints and expensive evaluation costs. Existing approaches, including heuristic and multi-step reinforcement…

Machine Learning · Computer Science 2025-06-05 Yifeng Xiao , Yurong Xu , Ning Yan , Masood Mortazavi , Pierluigi Nuzzo

When dealing with real-world optimization problems, decision-makers usually face high levels of uncertainty associated with partial information, unknown parameters, or complex relationships between these and the problem decision variables.…

Optimization and Control · Mathematics 2023-05-01 Antonio Alcántara , Carlos Ruiz

Though deep reinforcement learning (DRL) has obtained substantial success, it may encounter catastrophic failures due to the intrinsic uncertainty of both transition and observation. Most of the existing methods for safe reinforcement…

Machine Learning · Computer Science 2025-05-20 Chengyang Ying , Xinning Zhou , Hang Su , Dong Yan , Ning Chen , Jun Zhu

Ensuring safety in Reinforcement Learning (RL), typically framed as a Constrained Markov Decision Process (CMDP), is crucial for real-world exploration applications. Current approaches in handling CMDP struggle to balance optimality and…

Robotics · Computer Science 2024-03-07 Zhaorun Chen , Zhuokai Zhao , Tairan He , Binhao Chen , Xuhao Zhao , Liang Gong , Chengliang Liu

Constrained reinforcement learning is to maximize the expected reward subject to constraints on utilities/costs. However, the training environment may not be the same as the test one, due to, e.g., modeling error, adversarial attack,…

Machine Learning · Computer Science 2022-09-16 Yue Wang , Fei Miao , Shaofeng Zou