中文
相关论文

相关论文: Provably Efficient Offline Multi-agent Reinforceme…

200 篇论文

Learning by experience in Multi-Agent Systems (MAS) is a difficult and exciting task, due to the lack of stationarity of the environment, whose dynamics evolves as the population learns. In order to design scalable algorithms for systems…

最优化与控制 · 数学 2020-02-24 Romuald Elie , Julien Pérolat , Mathieu Laurière , Matthieu Geist , Olivier Pietquin

We propose a multi-agent distributed reinforcement learning algorithm that balances between potentially conflicting short-term reward and sparse, delayed long-term reward, and learns with partial information in a dynamic environment. We…

机器学习 · 计算机科学 2022-04-06 Jing Tan , Ramin Khalili , Holger Karl

In this paper, we propose a new mutual information framework for multi-agent reinforcement learning to enable multiple agents to learn coordinated behaviors by regularizing the accumulated return with the simultaneous mutual information…

多智能体系统 · 计算机科学 2023-03-02 Woojun Kim , Whiyoung Jung , Myungsik Cho , Youngchul Sung

In this paper, we settle the sampling complexity of solving discounted two-player turn-based zero-sum stochastic games up to polylogarithmic factors. Given a stochastic game with discount factor $\gamma\in(0,1)$ we provide an algorithm that…

机器学习 · 计算机科学 2019-08-30 Aaron Sidford , Mengdi Wang , Lin F. Yang , Yinyu Ye

What can an agent learn in a stochastic Multi-Armed Bandit (MAB) problem from a dataset that contains just a single sample for each arm? Surprisingly, in this work, we demonstrate that even in such a data-starved setting it may still be…

机器学习 · 计算机科学 2024-02-27 Ruiqi Zhang , Yuexiang Zhai , Andrea Zanette

In tabular multi-agent reinforcement learning with average-cost criterion, a team of agents sequentially interacts with the environment and observes local incentives. We focus on the case that the global reward is a sum of local rewards,…

最优化与控制 · 数学 2021-10-26 Alec Koppel , Amrit Singh Bedi , Bhargav Ganguly , Vaneet Aggarwal

This paper considers the problem of inverse reinforcement learning in zero-sum stochastic games when expert demonstrations are known to be not optimal. Compared to previous works that decouple agents in the game by assuming optimality in…

机器学习 · 统计学 2018-06-07 Xingyu Wang , Diego Klabjan

Model-based reinforcement learning (MBRL) agents typically learn world models by minimizing predictive loss. However, powerful RL optimizers inevitably exploit minor model inaccuracies, leading to simulator exploitation and a reality gap…

机器学习 · 计算机科学 2026-05-29 Christoph Dann , Yishay Mansour , Mehryar Mohri

In the case of the two-person zero-sum stochastic game with a central controller, this paper proposes a best collaborative behavior search and selection algorithm based on reinforcement learning, in response to how to choose the best…

机器人学 · 计算机科学 2019-10-01 Yunkai Wang , Shenhan Jia , Zexi Chen , Zheyuan Huang , Rong Xiong

Multi-agent reinforcement learning involves multiple agents interacting with each other and a shared environment to complete tasks. When rewards provided by the environment are sparse, agents may not receive immediate feedback on the…

机器学习 · 计算机科学 2021-03-31 Baicen Xiao , Bhaskar Ramasubramanian , Radha Poovendran

A major challenge of multiagent reinforcement learning (MARL) is the curse of multiagents, where the size of the joint action space scales exponentially with the number of agents. This remains to be a bottleneck for designing efficient MARL…

机器学习 · 计算机科学 2021-10-28 Chi Jin , Qinghua Liu , Yuanhao Wang , Tiancheng Yu

We develop provably efficient reinforcement learning algorithms for two-player zero-sum finite-horizon Markov games with simultaneous moves. To incorporate function approximation, we consider a family of Markov games where the reward…

机器学习 · 计算机科学 2020-06-25 Qiaomin Xie , Yudong Chen , Zhaoran Wang , Zhuoran Yang

We consider model-based multi-agent reinforcement learning, where the environment transition model is unknown and can only be learned via expensive interactions with the environment. We propose H-MARL (Hallucinated Multi-Agent Reinforcement…

机器学习 · 计算机科学 2022-07-12 Pier Giuseppe Sessa , Maryam Kamgarpour , Andreas Krause

Progress in fields of machine learning and adversarial planning has benefited significantly from benchmark domains, from checkers and the classic UCI data sets to Go and Diplomacy. In sequential decision-making, agent evaluation has largely…

计算机科学与博弈论 · 计算机科学 2023-11-02 Marc Lanctot , John Schultz , Neil Burch , Max Olan Smith , Daniel Hennes , Thomas Anthony , Julien Perolat

Imitation learning is an effective alternative approach to learn a policy when the reward function is sparse. In this paper, we consider a challenging setting where an agent and an expert use different actions from each other. We assume…

机器学习 · 计算机科学 2019-08-27 Konrad Zolna , Negar Rostamzadeh , Yoshua Bengio , Sungjin Ahn , Pedro O. Pinheiro

In this work, we present the first theoretical analysis of multi-agent imitation learning (MAIL) in linear Markov games where both the transition dynamics and each agent's reward function are linear in some given features. We demonstrate…

机器学习 · 计算机科学 2026-02-27 Luca Viano , Till Freihaut , Emanuele Nevali , Volkan Cevher , Matthieu Geist , Giorgia Ramponi

In multi-agent reinforcement learning, the behaviors that agents learn in a single Markov Game (MG) are typically confined to the given agent number. Every single MG induced by varying the population may possess distinct optimal joint…

机器学习 · 计算机科学 2023-06-06 Shenao Zhang , Li Shen , Lei Han , Li Shen

We introduce a class of networked Markov potential games in which agents are associated with nodes in a network. Each agent has its own local potential function, and the reward of each agent depends only on the states and actions of the…

机器学习 · 计算机科学 2023-07-11 Zhaoyi Zhou , Zaiwei Chen , Yiheng Lin , Adam Wierman

This study proposes the use of a social learning method to estimate a global state within a multi-agent off-policy actor-critic algorithm for reinforcement learning (RL) operating in a partially observable environment. We assume that the…

机器学习 · 计算机科学 2024-07-09 Ainur Zhaikhan , Ali H. Sayed

This paper considers the problem of designing optimal algorithms for reinforcement learning in two-player zero-sum games. We focus on self-play algorithms which learn the optimal policy by playing against itself without any direct…

机器学习 · 计算机科学 2020-07-15 Yu Bai , Chi Jin , Tiancheng Yu