English
Related papers

Related papers: Learning Two-Player Mixture Markov Games: Kernel F…

200 papers

Decoding how rational agents should behave in shared systems remains a critical challenge within theoretical computer science, artificial intelligence and economics studies. Central to this challenge is the task of computing the solution…

Computer Science and Game Theory · Computer Science 2025-01-07 Dongge Wang , Xiang Yan , Zehao Dou , Wenhan Huang , Yaodong Yang , Xiaotie Deng

Self-play, where the algorithm learns by playing against itself without requiring any direct supervision, has become the new weapon in modern Reinforcement Learning (RL) for achieving superhuman performance in practice. However, the…

Machine Learning · Computer Science 2020-07-10 Yu Bai , Chi Jin

Learning in games considers how multiple agents maximize their own rewards through repeated games. Memory, an ability that an agent changes his/her action depending on the history of actions in previous games, is often introduced into…

Computer Science and Game Theory · Computer Science 2024-02-19 Yuma Fujimoto , Kaito Ariu , Kenshi Abe

In this paper we consider the problem of finding a Nash equilibrium (NE) via zeroth-order feedback information in games with merely monotone pseudogradient mapping. Based on hybrid system theory, we propose a novel extremum seeking…

Systems and Control · Electrical Eng. & Systems 2021-09-17 Suad Krilašević , Sergio Grammatico

We consider a nonzero-sum N-player Markov game on an abstract measurable state space with compact metric action spaces. The payoff functions are bounded Carath\'eodory functions and the transitions of the system are assumed to have a…

Optimization and Control · Mathematics 2023-05-09 François Dufour , Tomás Prieto-Rumeau

Learning and equilibrium computation in games are fundamental problems across computer science and economics, with applications ranging from politics to machine learning. Much of the work in this area revolves around a simple algorithm…

Computer Science and Game Theory · Computer Science 2022-07-19 Daniel Beaglehole , Max Hopkins , Daniel Kane , Sihan Liu , Shachar Lovett

The overall aim of our research is to develop techniques to reason about the equilibrium properties of multi-agent systems. We model multi-agent systems as concurrent games, in which each player is a process that is assumed to act…

Logic in Computer Science · Computer Science 2020-08-14 Julian Gutierrez , Aniello Murano , Giuseppe Perelli , Sasha Rubin , Thomas Steeples , Michael Wooldridge

In the first-order query model for zero-sum $K\times K$ matrix games, players observe the expected pay-offs for all their possible actions under the randomized action played by their opponent. This classical model has received renewed…

Computer Science and Game Theory · Computer Science 2023-11-03 Hédi Hadiji , Sarah Sachs , Tim van Erven , Wouter M. Koolen

Multi-agent imitation learning (MA-IL) aims to learn optimal policies from expert demonstrations of interactions in multi-agent interactive domains. Despite existing guarantees on the performance of the resulting learned policies,…

Machine Learning · Computer Science 2026-02-25 Antoine Bergerault , Volkan Cevher , Negar Mehr

We study algorithms for online linear optimization in Hilbert spaces, focusing on the case where the player is unconstrained. We develop a novel characterization of a large class of minimax algorithms, recovering, and even improving,…

Machine Learning · Computer Science 2014-05-22 H. Brendan McMahan , Francesco Orabona

Several multiagent reinforcement learning (MARL) algorithms have been proposed to optimize agents decisions. Due to the complexity of the problem, the majority of the previously developed MARL algorithms assumed agents either had some…

Machine Learning · Computer Science 2014-01-16 Sherief Abdallah , Victor Lesser

We propose a deep neural network-based algorithm to identify the Markovian Nash equilibrium of general large $N$-player stochastic differential games. Following the idea of fictitious play, we recast the $N$-player game into $N$ decoupled…

Optimization and Control · Mathematics 2020-06-08 Jiequn Han , Ruimeng Hu

This paper considers two-player zero-sum finite-horizon Markov games with simultaneous moves. The study focuses on the challenging settings where the value function or the model is parameterized by general function classes. Provably…

Computer Science and Game Theory · Computer Science 2021-11-02 Baihe Huang , Jason D. Lee , Zhaoran Wang , Zhuoran Yang

Consider a strongly monotone game where the players' utility functions include a reward function and a linear term for each dimension, with coefficients that are controlled by the manager. Gradient play converges to a unique Nash…

Multiagent Systems · Computer Science 2026-02-25 Siddharth Chandak , Ilai Bistritz , Nicholas Bambos

In this paper we propose a numerical method to obtain an approximation of Nash equilibria for multi-player non-cooperative games with a special structure. We consider the infinite horizon problem in a case which leads to a system of…

Numerical Analysis · Mathematics 2016-02-19 Simone Cacace , Emiliano Cristiani , Maurizio Falcone

We explore the use of policy approximations to reduce the computational cost of learning Nash equilibria in zero-sum stochastic games. We propose a new Q-learning type algorithm that uses a sequence of entropy-regularized soft policies to…

Machine Learning · Computer Science 2021-06-29 Yue Guan , Qifan Zhang , Panagiotis Tsiotras

We study the problem of multi-agent reinforcement learning (MARL) with adaptivity constraints -- a new problem motivated by real-world applications where deployments of new policies are costly and the number of policy updates must be…

Machine Learning · Computer Science 2024-02-05 Dan Qiao , Yu-Xiang Wang

We show that, for any sufficiently small fixed $\epsilon > 0$, when both players in a general-sum two-player (bimatrix) game employ optimistic mirror descent (OMD) with smooth regularization, learning rate $\eta = O(\epsilon^2)$ and $T =…

Computer Science and Game Theory · Computer Science 2022-10-10 Ioannis Anagnostides , Gabriele Farina , Ioannis Panageas , Tuomas Sandholm

Games with incomplete preferences are an important model for studying rational decision-making in scenarios where players face incomplete information about their preferences and must contend with incomparable outcomes. We study the problem…

Computer Science and Game Theory · Computer Science 2024-08-13 Abhishek N. Kulkarni , Jie Fu , Ufuk Topcu

We study the problem of learning a Nash equilibrium (NE) in an imperfect information game (IIG) through self-play. Precisely, we focus on two-player, zero-sum, episodic, tabular IIG under the perfect-recall assumption where the only…

Machine Learning · Statistics 2021-06-14 Tadashi Kozuno , Pierre Ménard , Rémi Munos , Michal Valko