English
Related papers

Related papers: Convergence of Gradient Methods on Bilinear Zero-S…

200 papers

We design and analyze minimax-optimal algorithms for online linear optimization games where the player's choice is unconstrained. The player strives to minimize regret, the difference between his loss and the loss of a post-hoc benchmark…

Machine Learning · Computer Science 2013-02-12 H. Brendan McMahan

The approximation of mixed Nash equilibria (MNE) for zero-sum games with mean-field interacting players has recently raised much interest in machine learning. In this paper we propose a mean-field gradient descent dynamics for finding the…

Optimization and Control · Mathematics 2025-05-13 Yulong Lu , Pierre Monmarché

Stochastic min-max optimization has gained interest in the machine learning community with the advancements in GANs and adversarial training. Although game optimization is fairly well understood in the deterministic setting, some issues…

Machine Learning · Computer Science 2024-03-27 Juan Ramirez , Rohan Sukumaran , Quentin Bertrand , Gauthier Gidel

In this paper, we consider the dual formulation of minimizing $\sum_{i\in I}f_i(x_i)+\sum_{j\in J} g_j(\mathcal{A}_jx)$ with the index sets $I$ and $J$ being large. To address the difficulties from the high dimension of the variable $x$…

Optimization and Control · Mathematics 2020-09-03 Hui Zhang , Yu-Hong Dai , Lei Guo

The extensive-form game has been studied considerably in recent years. It can represent games with multiple decision points and incomplete information, and hence it is helpful in formulating games with uncertain inputs, such as poker. We…

Computer Science and Game Theory · Computer Science 2023-03-21 Keigo Habara , Ellen Hidemi Fukuda , Nobuo Yamashita

In this paper, we propose a provably convergent and practical framework for multi-objective reinforcement learning with max-min criterion. From a game-theoretic perspective, we reformulate max-min multi-objective reinforcement learning as a…

Machine Learning · Computer Science 2025-10-24 Woohyeon Byeon , Giseung Park , Jongseong Chae , Amir Leshem , Youngchul Sung

Min-max optimization problems arise in several key machine learning setups, including adversarial learning and generative modeling. In their general form, in absence of convexity/concavity assumptions, finding pure equilibria of the…

Machine Learning · Computer Science 2022-02-23 Carles Domingo-Enrich , Joan Bruna

We study the convergence to local Nash equilibria of gradient methods for two-player zero-sum differentiable games. It is well-known that such dynamics converge locally when $S \succ 0$ and may diverge when $S=0$, where $S\succeq 0$ is the…

Optimization and Control · Mathematics 2023-11-08 Guillaume Wang , Lénaïc Chizat

Self-play via online learning is one of the premier ways to solve large-scale two-player zero-sum games, both in theory and practice. Particularly popular algorithms include optimistic multiplicative weights update (OMWU) and optimistic…

Computer Science and Game Theory · Computer Science 2025-01-22 Yang Cai , Gabriele Farina , Julien Grand-Clément , Christian Kroer , Chung-Wei Lee , Haipeng Luo , Weiqiang Zheng

Stackelberg Games are gaining importance in the last years due to the raise of Adversarial Machine Learning (AML). Within this context, a new paradigm must be faced: in classical game theory, intervening agents were humans whose decisions…

Computer Science and Game Theory · Computer Science 2019-10-25 Roi Naveiro , David Ríos Insua

We study online optimization methods for zero-sum games, a fundamental problem in adversarial learning in machine learning, economics, and many other domains. Traditional methods approximate Nash equilibria (NE) using either regret-based…

Computer Science and Game Theory · Computer Science 2025-07-16 Taemin Kim , James P. Bailey

We introduce a new approach for computing optimal equilibria via learning in games. It applies to extensive-form settings with any number of players, including mechanism design, information design, and solution concepts such as correlated,…

We study the problem of convergence to a stationary point in zero-sum games. We propose competitive gradient optimization (CGO ), a gradient-based method that incorporates the interactions between the two players in zero-sum games for…

Optimization and Control · Mathematics 2022-05-31 Abhijeet Vyas , Kamyar Azizzadenesheli

This paper discusses the convergence of the modified predictive method (MPM) proposed by Liang and stokes corresponding to high-resolution differential equations (HRDE) in bilinear games. First, we present the high-resolution differential…

Optimization and Control · Mathematics 2024-05-24 Keke Li , Xinmin Yang

Learning in multi-player games can model a large variety of practical scenarios, where each player seeks to optimize its own local objective function, which at the same time relies on the actions taken by others. Motivated by the frequent…

Optimization and Control · Mathematics 2023-09-08 Yuanhanqing Huang , Jianghai Hu

This paper presents new families of algorithms for the repeated play of two-agent (near) zero-sum games and two-agent zero-sum stochastic games. For example, the family includes fictitious play and its variants as members. Commonly, the…

Computer Science and Game Theory · Computer Science 2023-11-03 Yuksel Arslantas , Ege Yuceel , Yigit Yalin , Muhammed O. Sayin

Min-max optimization problems (i.e., min-max games) have attracted a great deal of attention recently as their applicability to a wide range of machine learning problems has become evident. In this paper, we study min-max games with…

Computer Science and Game Theory · Computer Science 2022-08-23 Denizalp Goktas , Amy Greenwald

This paper addresses the bilinearly coupled minimax optimization problem: $\min_{x \in \mathbb{R}^{d_x}}\max_{y \in \mathbb{R}^{d_y}} \ f_1(x) + f_2(x) + y^{\top} Bx - g_1(y) - g_2(y)$, where $f_1$ and $g_1$ are smooth convex functions,…

Optimization and Control · Mathematics 2025-05-27 Jingwang Li , Xiao Li

Min-max optimization is emerging as a key framework for analyzing problems of robustness to strategically and adversarially generated data. We propose a random reshuffling-based gradient free Optimistic Gradient Descent-Ascent algorithm for…

Optimization and Control · Mathematics 2022-02-22 Chinmay Maheshwari , Chih-Yuan Chiu , Eric Mazumdar , S. Shankar Sastry , Lillian J. Ratliff

This paper introduces alignment games, a new class of zero-sum games modeling strategic interventions where effectiveness depends on alignment with an underlying hidden state. Motivated by operational problems in medical diagnostics,…

Optimization and Control · Mathematics 2025-09-08 Pedro Cesar Lopes Gerum , Thomas Lidbetter