中文
相关论文

相关论文: Feasible Actor-Critic: Constrained Reinforcement L…

200 篇论文

Robust Reinforcement Learning aims to derive optimal behavior that accounts for model uncertainty in dynamical systems. However, previous studies have shown that by considering the worst case scenario, robust policies can be overly…

机器学习 · 计算机科学 2018-10-25 Esther Derman , Daniel J. Mankowitz , Timothy A. Mann , Shie Mannor

Reinforcement Learning (RL) has achieved remarkable success in solving complex sequential decision-making problems. However, its application to safety-critical physical systems remains constrained by the lack of stability guarantees.…

系统与控制 · 电气工程与系统科学 2026-03-19 Dhruv S. Kushwaha , Zoleikha A. Biron

Robust reinforcement learning (RL) considers the problem of learning policies that perform well in the worst case among a set of possible environment parameter values. In real-world environments, choosing the set of possible values for…

机器学习 · 计算机科学 2022-10-05 JB Lanier , Stephen McAleer , Pierre Baldi , Roy Fox

Safe reinforcement learning (RL) offers advanced solutions to constrained optimal control problems. Existing studies in safe RL implicitly assume continuity in policy functions, where policies map states to actions in a smooth,…

机器学习 · 计算机科学 2024-03-29 Wenjun Zou , Yao Lyu , Jie Li , Yujie Yang , Shengbo Eben Li , Jingliang Duan , Xianyuan Zhan , Jingjing Liu , Yaqin Zhang , Keqiang Li

Traditional control theory-based methods require tailored engineering for each system and constant fine-tuning. In power plant control, one often needs to obtain a precise representation of the system dynamics and carefully design the…

系统与控制 · 电气工程与系统科学 2024-09-21 Yixuan Sun , Sami Khairy , Richard B. Vilim , Rui Hu , Akshay J. Dave

Reinforcement learning in partially observable domains is challenging due to the lack of observable state information. Thankfully, learning offline in a simulator with such state information is often possible. In particular, we propose a…

机器人学 · 计算机科学 2022-11-11 Hai Nguyen , Andrea Baisero , Dian Wang , Christopher Amato , Robert Platt

The applicability of reinforcement learning (RL) algorithms in real-world domains often requires adherence to safety constraints, a need difficult to address given the asymptotic nature of the classic RL optimization objective. In contrast…

机器学习 · 计算机科学 2021-04-15 Moritz A. Zanger , Karam Daaboul , J. Marius Zöllner

In safety-critical RL settings, the inclusion of an additional cost function is often favoured over the arduous task of modifying the reward function to ensure the agent's safe behaviour. However, designing or evaluating such a cost…

人工智能 · 计算机科学 2025-01-14 Shashank Reddy Chirra , Pradeep Varakantham , Praveen Paruchuri

Model-free deep reinforcement learning (RL) algorithms have been demonstrated on a range of challenging decision making and control tasks. However, these methods typically suffer from two major challenges: very high sample complexity and…

机器学习 · 计算机科学 2018-08-10 Tuomas Haarnoja , Aurick Zhou , Pieter Abbeel , Sergey Levine

Reinforcement Learning (RL) has been shown to be effective in many scenarios. However, it typically requires the exploration of a sufficiently large number of state-action pairs, some of which may be unsafe. Consequently, its application to…

系统与控制 · 电气工程与系统科学 2022-06-24 Yousef Emam , Gennaro Notomista , Paul Glotfelter , Zsolt Kira , Magnus Egerstedt

Safety stands as the primary obstacle preventing the widespread adoption of learning-based robotic systems in our daily lives. While reinforcement learning (RL) shows promise as an effective robot learning paradigm, conventional RL…

机器人学 · 计算机科学 2025-05-27 Maeva Guerrier , Karthik Soma , Hassan Fouad , Giovanni Beltrame

In this paper, we develop a method for learning a control policy guaranteed to satisfy an affine state constraint of high relative degree in closed loop with a black-box system. Previous reinforcement learning (RL) approaches to satisfy…

系统与控制 · 电气工程与系统科学 2024-07-31 Jean-Baptiste Bouvier , Kartik Nagpal , Negar Mehr

In many robotic applications, some aspects of the system dynamics can be modeled accurately while others are difficult to obtain or model. We present a novel reinforcement learning (RL) method for continuous state and action spaces that…

人工智能 · 计算机科学 2017-06-06 Tomoki Nishi , Prashant Doshi , Michael R. James , Danil Prokhorov

It is quite challenging to ensure the safety of reinforcement learning (RL) agents in an unknown and stochastic environment under hard constraints that require the system state not to reach certain specified unsafe regions. Many popular…

系统与控制 · 电气工程与系统科学 2023-06-14 Yixuan Wang , Simon Sinong Zhan , Ruochen Jiao , Zhilu Wang , Wanxin Jin , Zhuoran Yang , Zhaoran Wang , Chao Huang , Qi Zhu

In the context of safe exploration, Reinforcement Learning (RL) has long grappled with the challenges of balancing the tradeoff between maximizing rewards and minimizing safety violations, particularly in complex environments with…

机器学习 · 计算机科学 2023-12-13 Simon Sinong Zhan , Yixuan Wang , Qingyuan Wu , Ruochen Jiao , Chao Huang , Qi Zhu

In this paper, we present an online reinforcement learning algorithm for constrained Markov decision processes with a safety constraint. Despite the necessary attention of the scientific community, considering stochastic stopping time, the…

机器学习 · 计算机科学 2024-03-26 Abhijit Mazumdar , Rafal Wisniewski , Manuela L. Bujorianu

An important facet of reinforcement learning (RL) has to do with how the agent goes about exploring the environment. Traditional exploration strategies typically focus on efficiency and ignore safety. However, for practical applications,…

机器学习 · 计算机科学 2019-04-23 Jiameng Fan , Wenchao Li

The ability to learn and execute optimal control policies safely is critical to realization of complex autonomy, especially where task restarts are not available and/or the systems are safety-critical. Safety requirements are often…

系统与控制 · 电气工程与系统科学 2021-10-06 S M Nahid Mahmud , Moad Abudia , Scott A Nivison , Zachary I. Bell , Rushikesh Kamalapurkar

Multi-agent deep reinforcement learning makes optimal decisions dependent on system states observed by agents, but any uncertainty on the observations may mislead agents to take wrong actions. The Mean-Field Actor-Critic reinforcement…

机器学习 · 计算机科学 2023-06-01 Ziyuan Zhou , Guanjun Liu

Ensuring safety for black-box hybrid dynamical systems presents significant challenges due to their instantaneous state jumps and unknown explicit nonlinear dynamics. Existing solutions for strict safety constraint satisfaction, like…

机器人学 · 计算机科学 2026-04-27 Aayushi Shrivastava , Kartik Nagpal , Sairam Jinkala , Jean-Baptiste Bouvier , Negar Mehr