English
Related papers

Related papers: Gradient Descent Ascent in Min-Max Stackelberg Gam…

200 papers

The approximation of mixed Nash equilibria (MNE) for zero-sum games with mean-field interacting players has recently raised much interest in machine learning. In this paper we propose a mean-field gradient descent dynamics for finding the…

Optimization and Control · Mathematics 2025-05-13 Yulong Lu , Pierre Monmarché

A fortification game (FG) is a three-level, two-player Stackelberg game, also known as defender-attacker-defender game, in which at the uppermost level, the defender selects some assets to be protected from potential malicious attacks. At…

Optimization and Control · Mathematics 2023-03-24 Markus Leitner , Ivana Ljubić , Michele Monaci , Markus Sinnl , Kübra Tanınmış

Stochastic min-max optimization has gained interest in the machine learning community with the advancements in GANs and adversarial training. Although game optimization is fairly well understood in the deterministic setting, some issues…

Machine Learning · Computer Science 2024-03-27 Juan Ramirez , Rohan Sukumaran , Quentin Bertrand , Gauthier Gidel

In this work, we use a Stackelberg infinite discrete-time dynamic game model to study the optimal supply schedule and the optimal demand response under a market-driven dynamic price. A two-layer optimization framework is established. At the…

Systems and Control · Electrical Eng. & Systems 2019-11-19 Yunhan Huang

This paper presents a novel distributed formulation of the min-max optimization problem. Such a formulation enables enhanced flexibility among agents when optimizing their maximization variables. To address the problem, we propose two…

Optimization and Control · Mathematics 2025-05-19 Runze You , Kun Huang , Shi Pu

This paper considers dynamic (multi-stage) signaling games involving an encoder and a decoder who have subjective models on the cost functions. We consider both Nash (simultaneous-move) and Stackelberg (leader-follower) equilibria of…

Optimization and Control · Mathematics 2020-03-11 Serkan Sarıtaş , Serdar Yüksel , Sinan Gezici

This contribution deals with a two-level discrete decision problem, a so-called Stackelberg strategic game: A Subset Sum setting is addressed with a set $N$ of items with given integer weights. One distinguished player, the leader, may…

Discrete Mathematics · Computer Science 2018-01-12 Ulrich Pferschy , Gaia Nicosia , Andrea Pacifici

Designing socially optimal policies in multi-agent environments is a fundamental challenge in both economics and artificial intelligence. This paper studies a general framework for learning Stackelberg equilibria in dynamic and uncertain…

Systems and Control · Electrical Eng. & Systems 2025-09-23 Jun He , Andrew L. Liu , Yihsu Chen

Adaptive momentum methods have recently attracted a lot of attention for training of deep neural networks. They use an exponential moving average of past gradients of the objective function to update both search directions and learning…

Optimization and Control · Mathematics 2021-04-27 Babak Barazandeh , Davoud Ataee Tarzanagh , George Michailidis

Stackelberg equilibrium is a solution concept that describes optimal strategies to commit: Player 1 (the leader) first commits to a strategy that is publicly announced, then Player 2 (the follower) plays a best response to the leader's…

Computer Science and Game Theory · Computer Science 2021-11-04 Aditya Aradhye , Branislav Bošanský , Michael Hlaváček

This paper studies a class of dynamic Stackelberg games under open-loop information structure with constrained linear agent dynamics and quadratic utility functions. We show two important properties for this class of dynamic Stackelberg…

Optimization and Control · Mathematics 2016-08-09 Sen Li , Wei Zhang , Jianming Lian , Karanjit Kalsi

We consider a class of dynamic collective choice models with social interactions, whereby a large number of non-uniform agents have to individually settle on one of multiple discrete alternative choices, with the relevance of their would-be…

Systems and Control · Computer Science 2017-08-21 Rabih Salhab , Roland P. Malhamé , Jerome Le Ny

In multi-agent problems requiring a high degree of cooperation, success often depends on the ability of the agents to adapt to each other's behavior. A natural solution concept in such settings is the Stackelberg equilibrium, in which the…

Machine Learning · Computer Science 2024-06-14 Robert Loftin , Mustafa Mert Çelikok , Herke van Hoof , Samuel Kaski , Frans A. Oliehoek

In this paper we consider solving saddle point problems using two variants of Gradient Descent-Ascent algorithms, Extra-gradient (EG) and Optimistic Gradient Descent Ascent (OGDA) methods. We show that both of these algorithms admit a…

Optimization and Control · Mathematics 2019-09-06 Aryan Mokhtari , Asuman Ozdaglar , Sarath Pattathil

Most existing results about \emph{last-iterate convergence} of learning dynamics are limited to two-player zero-sum games, and only apply under rigid assumptions about what dynamics the players follow. In this paper we provide new results…

Computer Science and Game Theory · Computer Science 2022-03-24 Ioannis Anagnostides , Ioannis Panageas , Gabriele Farina , Tuomas Sandholm

Recent advances at the intersection of dense large graph limits and mean field games have begun to enable the scalable analysis of a broad class of dynamical sequential games with large numbers of agents. So far, results have been largely…

Computer Science and Game Theory · Computer Science 2022-02-21 Kai Cui , Heinz Koeppl

Understanding and analyzing markets is crucial, yet analytical equilibrium solutions remain largely infeasible. Recent breakthroughs in equilibrium computation rely on zeroth-order policy gradient estimation. These approaches commonly…

Computer Science and Game Theory · Computer Science 2023-03-17 Nils Kohring , Fabian R. Pieroth , Martin Bichler

Our work focuses on extra gradient learning algorithms for finding Nash equilibria in bilinear zero-sum games. The proposed method, which can be formally considered as a variant of Optimistic Mirror Descent…

Computer Science and Game Theory · Computer Science 2022-03-09 Michail Fasoulakis , Evangelos Markakis , Yannis Pantazis , Constantinos Varsos

In this paper, we consider continuous-time stochastic optimal control problems where the cost is evaluated through a coherent risk measure. We provide an explicit gradient descent-ascent algorithm which applies to problems subject to…

Optimization and Control · Mathematics 2023-06-23 Gabriel Velho , Jean Auriol , Riccardo Bonalli

We study the problem of computing an approximate Nash equilibrium of a game whose strategy space is continuous without access to gradients of the utility function. Such games arise, for example, when players' strategies are represented by…

Computer Science and Game Theory · Computer Science 2025-10-28 Carlos Martin , Tuomas Sandholm