中文
相关论文

相关论文: Provably Learning Nash Policies in Constrained Mar…

200 篇论文

The partial alignment and conflict of autonomous agents lead to mixed-motive scenarios in many real-world applications. However, agents may fail to cooperate in practice even when cooperation yields a better outcome. One well known reason…

人工智能 · 计算机科学 2025-03-20 Shuhui Zhu , Baoxiang Wang , Sriram Ganapathi Subramanian , Pascal Poupart

While multi-agent reinforcement learning (MARL) has produced numerous algorithms that converge to Nash or related equilibria, such equilibria are often non-unique and can exhibit widely varying efficiency. This raises a fundamental…

计算机科学与博弈论 · 计算机科学 2026-01-29 Runyu Zhang , Gioele Zardini , Asuman Ozdaglar , Jeff Shamma , Na Li

Active voltage control presents a promising avenue for relieving power congestion and enhancing voltage quality, taking advantage of the distributed controllable generators in the power network, such as roof-top photovoltaics. While…

机器学习 · 计算机科学 2024-09-04 Yang Qu , Jinming Ma , Feng Wu

Constrained Reinforcement Learning (CRL) tackles sequential decision-making problems where agents are required to achieve goals by maximizing the expected return while meeting domain-specific constraints, which are often formulated as…

机器学习 · 计算机科学 2024-11-13 Alessandro Montenegro , Marco Mussi , Matteo Papini , Alberto Maria Metelli

Multi-agent reinforcement learning (MARL) algorithms often suffer from an exponential sample complexity dependence on the number of agents, a phenomenon known as \emph{the curse of multiagents}. In this paper, we address this challenge by…

机器学习 · 计算机科学 2022-02-01 Weichao Mao , Lin F. Yang , Kaiqing Zhang , Tamer Başar

Multi-agent reinforcement learning (MARL) holds great potential but faces robustness challenges due to environmental uncertainty. To address this, distributionally robust Markov games (RMGs) optimize worst-case performance when the…

机器学习 · 计算机科学 2026-05-08 Jingchu Gai , Laixi Shi

This paper introduces an information-theoretic constraint on learned policy complexity in the Multi-Agent Deep Deterministic Policy Gradient (MADDPG) reinforcement learning algorithm. Previous research with a related approach in continuous…

人工智能 · 计算机科学 2025-05-16 Tailia Malloy , Tim Klinger , Miao Liu , Matthew Riemer , Gerald Tesauro , Chris R. Sims

In practical multi-agent systems, agents often have diverse objectives, which makes the system more complex, as each agent's performance across multiple criteria depends on the joint actions of all agents, creating intricate strategic…

多智能体系统 · 计算机科学 2025-09-30 Yue Wang

Ensuring safety in MARL, particularly when deploying it in real-world applications such as autonomous driving, emerges as a critical challenge. To address this challenge, traditional safe MARL methods extend MARL approaches to incorporate…

机器人学 · 计算机科学 2024-05-29 Zhi Zheng , Shangding Gu

This paper explores multi-scenario optimization on large platforms using multi-agent reinforcement learning (MARL). We address this by treating scenarios like search, recommendation, and advertising as a cooperative, partially observable…

机器学习 · 计算机科学 2024-07-04 Yang Zhao , Chang Zhou , Jin Cao , Yi Zhao , Shaobo Liu , Chiyu Cheng , Xingchen Li

This paper studies multi-agent reinforcement learning in Markov games, with the goal of learning Nash equilibria or coarse correlated equilibria (CCE) sample-optimally. All prior results suffer from at least one of the two obstacles: the…

机器学习 · 计算机科学 2022-10-13 Gen Li , Yuejie Chi , Yuting Wei , Yuxin Chen

Softmax policy gradient is a popular algorithm for policy optimization in single-agent reinforcement learning, particularly since projection is not needed for each gradient update. However, in multi-agent systems, the lack of central…

最优化与控制 · 数学 2022-11-01 Runyu Zhang , Jincheng Mei , Bo Dai , Dale Schuurmans , Na Li

In order for artificial agents to coordinate effectively with people, they must act consistently with existing conventions (e.g. how to navigate in traffic, which language to speak, or how to coordinate with teammates). A group's…

人工智能 · 计算机科学 2019-03-14 Adam Lerer , Alexander Peysakhovich

Although Reinforcement Learning (RL) algorithms have found tremendous success in simulated domains, they often cannot directly be applied to physical systems, especially in cases where there are hard constraints to satisfy (e.g. on safety…

机器学习 · 计算机科学 2020-08-28 Harsh Satija , Philip Amortila , Joelle Pineau

The thriving field of multi-agent reinforcement learning (MARL) studies how a group of interacting agents make decisions autonomously in a shared dynamic environment. Existing theoretical studies in this area suffer from at least two of the…

机器学习 · 计算机科学 2025-12-02 Na Li , Yuchen Jiao , Hangguan Shan , Shefeng Yan

We initiate the study of Preference-Based Multi-Agent Reinforcement Learning (PbMARL), exploring both theoretical foundations and empirical validations. We define the task as identifying the Nash equilibrium from a preference-only offline…

机器学习 · 计算机科学 2025-01-10 Natalia Zhang , Xinqi Wang , Qiwen Cui , Runlong Zhou , Sham M. Kakade , Simon S. Du

Stochastic games are a popular framework for studying multi-agent reinforcement learning (MARL). Recent advances in MARL have focused primarily on games with finitely many states. In this work, we study multi-agent learning in stochastic…

机器学习 · 计算机科学 2024-03-28 Awni Altabaa , Bora Yongacoglu , Serdar Yüksel

Reinforcement Learning (RL) agents can solve diverse tasks but often exhibit unsafe behavior. Constrained Markov Decision Processes (CMDPs) address this by enforcing safety constraints, yet existing methods either sacrifice reward…

机器学习 · 计算机科学 2025-08-18 Nikola Milosevic , Johannes Müller , Nico Scherf

We consider a constrained Markov Decision Problem (CMDP) where the goal of an agent is to maximize the expected discounted sum of rewards over an infinite horizon while ensuring that the expected discounted sum of costs exceeds a certain…

机器学习 · 计算机科学 2024-11-01 Washim Uddin Mondal , Vaneet Aggarwal

This paper introduces a framework of Constrained Mean-Field Games (CMFGs), where each agent solves a constrained Markov decision process (CMDP). This formulation captures scenarios in which agents' strategies are subject to feasibility,…

最优化与控制 · 数学 2025-10-15 Anran Hu , Zijiu Lyu