English
Related papers

Related papers: On the Convergence of Min-Max Langevin Dynamics an…

200 papers

Markov games model interactions among multiple players in a stochastic, dynamic environment. Each player in a Markov game maximizes its expected total discounted reward, which depends upon the policies of the other players. We formulate a…

Computer Science and Game Theory · Computer Science 2023-09-11 Shenghui Chen , Yue Yu , David Fridovich-Keil , Ufuk Topcu

We study discrete-time mean-field Markov games with infinite numbers of agents where each agent aims to minimize its ergodic cost. We consider the setting where the agents have identical linear state transitions and quadratic cost…

Optimization and Control · Mathematics 2019-10-17 Zuyue Fu , Zhuoran Yang , Yongxin Chen , Zhaoran Wang

We analyze a recently proposed class of algorithms for the problem of sampling from probability distributions $\mu^\ast$ in $\mathbb{R}^d$ with a Lebesgue density of the form $\mu^\ast(x) \propto \exp(-f(Kx)-g(x))$, where $K$ is a linear…

Optimization and Control · Mathematics 2024-11-06 Martin Burger , Matthias J. Ehrhardt , Lorenz Kuger , Lukas Weigand

We study policy optimization algorithms for computing correlated equilibria in multi-player general-sum Markov Games. Previous results achieve $O(T^{-1/2})$ convergence rate to a correlated equilibrium and an accelerated $O(T^{-3/4})$…

Machine Learning · Computer Science 2024-05-03 Yang Cai , Haipeng Luo , Chen-Yu Wei , Weiqiang Zheng

We study zero-sum stochastic differential games where the state dynamics of the two players is governed by a generalized McKean-Vlasov (or mean-field) stochastic differential equation in which the distribution of both state and controls of…

Probability · Mathematics 2018-03-21 Huyen Pham , Andrea Cosso

This paper investigates probabilistic robustness of nonconvex-nonconcave minimax problems via the scenario approach. Specifically, under convex strategy sets for all players, inspired by recent advances in scenario optimization, we first…

Computer Science and Game Theory · Computer Science 2026-05-14 Huan Peng , Guanpu Chen , Karl Henrik Johansson

We describe and develop a close relationship between two problems that have customarily been regarded as distinct: that of maximizing entropy, and that of minimizing worst-case expected loss. Using a formulation grounded in the equilibrium…

Statistics Theory · Mathematics 2007-06-13 Peter D. Grunwald , A. Philip Dawid

Convergence to a saddle point for convex-concave functions has been studied for decades, while recent years has seen a surge of interest in non-convex (zero-sum) smooth games, motivated by their recent wide applications. It remains an…

Machine Learning · Computer Science 2022-02-04 Guojun Zhang , Pascal Poupart , Yaoliang Yu

Overdamped Langevin dynamics are reversible stochastic differential equations which are commonly used to sample probability measures in high-dimensional spaces, such as the ones appearing in computational statistical physics and Bayesian…

Numerical Analysis · Mathematics 2025-02-10 Tony Lelièvre , Grigorios A. Pavliotis , Geneviève Robin , Régis Santet , Gabriel Stoltz

The works of (Daskalakis et al., 2009, 2022; Jin et al., 2022; Deng et al., 2023) indicate that computing Nash equilibria in multi-player Markov games is a computationally hard task. This fact raises the question of whether or not…

Computer Science and Game Theory · Computer Science 2023-05-30 Fivos Kalogiannis , Ioannis Panageas

The predominant paradigm in evolutionary game theory and more generally online learning in games is based on a clear distinction between a population of dynamic agents that interact given a fixed, static game. In this paper, we move away…

Computer Science and Game Theory · Computer Science 2020-12-16 Stratis Skoulakis , Tanner Fiez , Ryann Sim , Georgios Piliouras , Lillian Ratliff

We consider the problem of two-player zero-sum games. This problem is formulated as a min-max Markov game in the literature. The solution of this game, which is the min-max payoff, starting from a given state is called the min-max value of…

Machine Learning · Computer Science 2022-03-21 Raghuram Bharadwaj Diddigi , Chandramouli Kamanchi , Shalabh Bhatnagar

This paper introduces alignment games, a new class of zero-sum games modeling strategic interventions where effectiveness depends on alignment with an underlying hidden state. Motivated by operational problems in medical diagnostics,…

Optimization and Control · Mathematics 2025-09-08 Pedro Cesar Lopes Gerum , Thomas Lidbetter

Zero-sum games arise in a wide variety of problems, including robust optimization and adversarial learning. However, algorithms deployed for finding a local Nash equilibrium in these games often converge to non-Nash stationary points. This…

Computer Science and Game Theory · Computer Science 2025-09-30 Kushagra Gupta , Xinjie Liu , Ross Allen , Ufuk Topcu , David Fridovich-Keil

In this paper, we consider a mean field game model inspired by crowd motion in which several interacting populations evolving in $\mathbb R^d$ aim at reaching given target sets in minimal time. The movement of each agent is described by a…

Optimization and Control · Mathematics 2022-08-16 Saeed Sadeghi Arjmand , Guilherme Mazanti

We provide an abstract framework for submodular mean field games and identify verifiable sufficient conditions that allow to prove existence and approximation of strong mean field equilibria in models where data may not be continuous with…

Optimization and Control · Mathematics 2022-01-21 Jodi Dianetti , Giorgio Ferrari , Markus Fischer , Max Nendel

We develop a probabilistic approach to continuous-time finite state mean field games. Based on an alternative description of continuous-time Markov chain by means of semimartingale and the weak formulation of stochastic optimal control, our…

Probability · Mathematics 2018-08-24 Rene Carmona , Peiqi Wang

This paper studies the connections between mean-field games and the social welfare optimization problems. We consider a mean field game in functional spaces with a large population of agents, each of which seeks to minimize an individual…

Optimization and Control · Mathematics 2016-09-27 Sen Li , Wei Zhang , Lin Zhao

This paper investigates the problem of computing the equilibrium of competitive games, which is often modeled as a constrained saddle-point optimization problem with probability simplex constraints. Despite recent efforts in understanding…

Optimization and Control · Mathematics 2023-01-23 Shicong Cen , Yuting Wei , Yuejie Chi

We propose a new method called the Metropolis-adjusted Mirror Langevin algorithm for approximate sampling from distributions whose support is a compact and convex set. This algorithm adds an accept-reject filter to the Markov chain induced…

Computation · Statistics 2024-06-24 Vishwak Srinivasan , Andre Wibisono , Ashia Wilson