中文
相关论文

相关论文: Flipping-based Policy for Chance-Constrained Marko…

200 篇论文

Stochastic and soft optimal policies resulting from entropy-regularized Markov decision processes (ER-MDP) are desirable for exploration and imitation learning applications. Motivated by the fact that such policies are sensitive with…

机器学习 · 计算机科学 2022-01-03 Tien Mai , Patrick Jaillet

In this paper, we study the learning of safe policies in the setting of reinforcement learning problems. This is, we aim to control a Markov Decision Process (MDP) of which we do not know the transition probabilities, but we have access to…

系统与控制 · 电气工程与系统科学 2022-01-14 Santiago Paternain , Miguel Calvo-Fullana , Luiz F. O. Chamon , Alejandro Ribeiro

Safe reinforcement learning has been a promising approach for optimizing the policy of an agent that operates in safety-critical applications. In this paper, we propose an algorithm, SNO-MDP, that explores and optimizes Markov decision…

机器学习 · 计算机科学 2020-08-18 Akifumi Wachi , Yanan Sui

Real-world reinforcement learning (RL) problems often demand that agents behave safely by obeying a set of designed constraints. We address the challenge of safe RL by coupling a safety guide based on model predictive control (MPC) with a…

机器学习 · 计算机科学 2022-03-30 Samuel Pfrommer , Tanmay Gautam , Alec Zhou , Somayeh Sojoudi

Traditional reinforcement learning (RL) aims to maximize the expected total reward, while the risk of uncertain outcomes needs to be controlled to ensure reliable performance in a risk-averse setting. In this paper, we consider the problem…

机器学习 · 计算机科学 2023-01-18 Xian Yu , Siqian Shen

Safe exploration is crucial for the real-world application of reinforcement learning (RL). Previous works consider the safe exploration problem as Constrained Markov Decision Process (CMDP), where the policies are being optimized under…

机器学习 · 计算机科学 2021-07-12 Hao Sun , Ziping Xu , Meng Fang , Zhenghao Peng , Jiadong Guo , Bo Dai , Bolei Zhou

Reinforcement learning (RL) is currently one of the most prominent methods for optimizing dynamical systems, with breakthrough results across various fields. The framework is based on the concept of a Markov decision process (MDP), leading…

最优化与控制 · 数学 2025-11-17 Rene Carmona , Mathieu Lauriere

Constrained Markov Decision Process (CMDP) is a natural framework for reinforcement learning tasks with safety constraints, where agents learn a policy that maximizes the long-term reward while satisfying the constraints on the long-term…

人工智能 · 计算机科学 2018-02-20 Qingkai Liang , Fanyu Que , Eytan Modiano

To overcome the curses of dimensionality and modeling of Dynamic Programming (DP) methods to solve Markov Decision Process (MDP) problems, Reinforcement Learning (RL) methods are adopted in practice. Contrary to traditional RL algorithms…

机器学习 · 计算机科学 2021-08-24 Arghyadip Roy , Vivek Borkar , Abhay Karandikar , Prasanna Chaporkar

Despite the tremendous success of Reinforcement Learning (RL) algorithms in simulation environments, applying RL to real-world applications still faces many challenges. A major concern is safety, in another word, constraint satisfaction.…

机器学习 · 计算机科学 2023-07-04 Weiye Zhao , Tairan He , Rui Chen , Tianhao Wei , Changliu Liu

This paper proposes tackling safety-critical stochastic Reinforcement Learning (RL) tasks with a sample-based, model-based approach. At the core of the method lies a Model Predictive Control (MPC) scheme that acts as function approximation,…

系统与控制 · 电气工程与系统科学 2025-07-30 Filippo Airaldi , Bart De Schutter , Azita Dabiri

A popular perspective in Reinforcement learning (RL) casts the problem as probabilistic inference on a graphical model of the Markov decision process (MDP). The core object of study is the probability of each state-action pair being visited…

机器学习 · 计算机科学 2023-11-23 Jean Tarbouriech , Tor Lattimore , Brendan O'Donoghue

We consider the reinforcement learning problem for the constrained Markov decision process (CMDP), which plays a central role in satisfying safety or resource constraints in sequential learning and decision-making. In this problem, we are…

机器学习 · 计算机科学 2025-11-19 Jiashuo Jiang , Yinyu Ye

In real-life scenarios, a Reinforcement Learning (RL) agent aiming to maximise their reward, must often also behave in a safe manner, including at training time. Thus, much attention in recent years has been given to Safe RL, where an agent…

机器学习 · 统计学 2025-03-26 Edwin Hamel-De le Court , Francesco Belardinelli , Alexander W. Goodall

Reinforcement learning is widely used in applications where one needs to perform sequential decisions while interacting with the environment. The problem becomes more challenging when the decision requirement includes satisfying some safety…

机器学习 · 计算机科学 2022-07-15 Qinbo Bai , Amrit Singh Bedi , Mridul Agarwal , Alec Koppel , Vaneet Aggarwal

Incorporating safety is an essential prerequisite for broadening the practical applications of reinforcement learning in real-world scenarios. To tackle this challenge, Constrained Markov Decision Processes (CMDPs) are leveraged, which…

机器学习 · 计算机科学 2023-11-03 Jaafar Mhamed , Shangding Gu

Constrained Markov decision processes (CMDPs) model scenarios of sequential decision making with multiple objectives that are increasingly important in many applications. However, the model is often unknown and must be learned online while…

机器学习 · 计算机科学 2023-01-30 Krishna C Kalagarla , Rahul Jain , Pierluigi Nuzzo

In this paper, we consider the problem of learning safe policies for probabilistic-constrained reinforcement learning (RL). Specifically, a safe policy or controller is one that, with high probability, maintains the trajectory of the agent…

机器学习 · 计算机科学 2024-03-14 Weiqin Chen , Dharmashankar Subramanian , Santiago Paternain

We propose a general framework for entropy-regularized average-reward reinforcement learning in Markov decision processes (MDPs). Our approach is based on extending the linear-programming formulation of policy optimization in MDPs to…

机器学习 · 计算机科学 2017-05-23 Gergely Neu , Anders Jonsson , Vicenç Gómez

Safe reinforcement learning (RL) aims to learn policies that satisfy certain constraints before deploying them to safety-critical applications. Previous primal-dual style approaches suffer from instability issues and lack optimality…

机器学习 · 计算机科学 2022-06-20 Zuxin Liu , Zhepeng Cen , Vladislav Isenbaev , Wei Liu , Zhiwei Steven Wu , Bo Li , Ding Zhao