中文
相关论文

相关论文: Scalable Primal-Dual Actor-Critic Method for Safe …

200 篇论文

The increasing adoption of Reinforcement Learning in safety-critical systems domains such as autonomous vehicles, health, and aviation raises the need for ensuring their safety. Existing safety mechanisms such as adversarial training,…

机器学习 · 计算机科学 2021-11-11 Paulina Stevia Nouwou Mindom , Amin Nikanjam , Foutse Khomh , John Mullins

Reinforcement Learning (RL) has been shown to be effective and convenient for a number of tasks in robotics. However, it requires the exploration of a sufficiently large number of state-action pairs, many of which may be unsafe or…

Primal-dual safe RL methods commonly perform iterations between the primal update of the policy and the dual update of the Lagrange Multiplier. Such a training paradigm is highly susceptible to the error in cumulative cost estimation since…

机器学习 · 计算机科学 2024-04-16 Zifan Wu , Bo Tang , Qian Lin , Chao Yu , Shangqin Mao , Qianlong Xie , Xingxing Wang , Dong Wang

Primal-dual methods have a natural application in Safe Reinforcement Learning (SRL), posed as a constrained policy optimization problem. In practice however, applying primal-dual methods to SRL is challenging, due to the inter-dependency of…

Finding feasible and collision-free paths for multiple nonlinear agents is challenging in the decentralized scenarios due to limited available information of other agents and complex dynamics constraints. In this paper, we propose a fast…

机器人学 · 计算机科学 2020-03-04 Hao Li , Bowen Weng , Abhishek Gupta , Jia Pan , Wei Zhang

In this work, we study the problem of finding Pareto optimal policies in multi-agent reinforcement learning problems with cooperative reward structures. We show that any algorithm where each agent only optimizes their reward is subject to…

机器学习 · 计算机科学 2024-10-28 Bang Giang Le , Viet Cuong Ta

We consider the Reinforcement Learning problem of controlling an unknown dynamical system to maximise the long-term average reward along a single trajectory. Most of the literature considers system interactions that occur in discrete time…

人工智能 · 计算机科学 2023-09-07 Lorenzo Croissant , Marc Abeille , Bruno Bouchard

Grant-free random access (RA) has been recognized as a promising solution to support massive connectivity due to the removal of the uplink grant request procedures. While most endeavours assume perfect synchronization among users and the…

信号处理 · 电气工程与系统科学 2024-02-29 Xinyu Bian , Yuyi Mao , Jun Zhang

Most multi-agent reinforcement learning (MARL) methods are limited in the scale of problems they can handle. With increasing numbers of agents, the number of training iterations required to find the optimal behaviors increases exponentially…

多智能体系统 · 计算机科学 2025-01-03 Baoqian Wang , Junfei Xie , Nikolay Atanasov

The POST-Agents Proposal (PAP) is an idea for ensuring that advanced artificial agents never resist shutdown. A key part of the PAP is using a novel `Discounted Reward for Same-Length Trajectories (DReST)' reward function to train agents to…

人工智能 · 计算机科学 2026-05-13 Elliott Thornley , Alexander Roman , Christos Ziakas , Leyton Ho , Louis Thomson

Reinforcement learning involves agents interacting with an environment to complete tasks. When rewards provided by the environment are sparse, agents may not receive immediate feedback on the quality of actions that they take, thereby…

多智能体系统 · 计算机科学 2022-02-22 Baicen Xiao , Bhaskar Ramasubramanian , Radha Poovendran

Covering skill (a.k.a., option) discovery has been developed to improve the exploration of RL in single-agent scenarios with sparse reward signals, through connecting the most distant states in the embedding space provided by the Fiedler…

机器学习 · 计算机科学 2023-08-22 Jiayu Chen , Jingdi Chen , Tian Lan , Vaneet Aggarwal

This paper proposes the Cooperative Soft Actor Critic (CSAC) method of enabling consecutive reinforcement learning agents to cooperatively solve a long time horizon multi-stage task. This method is achieved by modifying the policy of each…

机器学习 · 计算机科学 2020-07-02 Jordan Erskine , Chris Lehnert

In this paper, we consider the important problem of safe exploration in reinforcement learning. While reinforcement learning is well-suited to domains with complex transition dynamics and high-dimensional state-action spaces, an additional…

机器学习 · 计算机科学 2014-02-05 Javier Garcia , Fernando Fernandez

For groups of autonomous agents to achieve a particular goal, they must engage in coordination and long-horizon reasoning. However, designing reward functions to elicit such behavior is challenging. In this paper, we study how…

机器学习 · 计算机科学 2025-09-16 Chirayu Nimonkar , Shlok Shah , Catherine Ji , Benjamin Eysenbach

Safe exploration is a key requirement for reinforcement learning (RL) agents to learn and adapt online, beyond controlled (e.g. simulated) environments. In this work, we tackle this challenge by utilizing suboptimal yet conservative…

机器学习 · 计算机科学 2026-02-10 Manuel Wendl , Yarden As , Manish Prajapat , Anton Pollak , Stelian Coros , Andreas Krause

Multi-task reinforcement learning (RL) aims to find a single policy that effectively solves multiple tasks at the same time. This paper presents a constrained formulation for multi-task RL where the goal is to maximize the average…

最优化与控制 · 数学 2024-05-07 Sihan Zeng , Thinh T. Doan , Justin Romberg

We study a collaborative multi-agent stochastic linear bandit setting, where $N$ agents that form a network communicate locally to minimize their overall regret. In this setting, each agent has its own linear bandit problem (its own reward…

机器学习 · 计算机科学 2022-05-16 Ahmadreza Moradipari , Mohammad Ghavamzadeh , Mahnoosh Alizadeh

We consider a collection of linear stochastic bandit problems, each modeling the random response of different agents to proposed interventions, coupled together by a global safety constraint. We assume a central coordinator must choose…

最优化与控制 · 数学 2025-04-24 Arghavan Zibaie , Spencer Hutchinson , Ramtin Pedarsani , Mahnoosh Alizadeh

Multi-agent deep reinforcement learning has been applied to address a variety of complex problems with either discrete or continuous action spaces and achieved great success. However, most real-world environments cannot be described by only…

机器学习 · 计算机科学 2022-06-13 Hongzhi Hua , Kaigui Wu , Guixuan Wen