English
Related papers

Related papers: Generalized conditional gradient and learning in p…

200 papers

Fictitious play is an algorithm for computing Nash equilibria of matrix games. Recently, machine learning variants of fictitious play have been successfully applied to complicated real-world games. This paper presents a simple modification…

Computer Science and Game Theory · Computer Science 2022-12-21 Alex Cloud , Albert Wang , Wesley Kerr

We study two-layer neural networks in the mean field limit, where the number of neurons tends to infinity. In this regime, the optimization over the neuron parameters becomes the optimization over the probability measures, and by adding an…

Optimization and Control · Mathematics 2023-08-17 Fan Chen , Zhenjie Ren , Songbo Wang

Conditional Gradient algorithms (aka Frank-Wolfe algorithms) form a classical set of methods for constrained smooth convex minimization due to their simplicity, the absence of projection steps, and competitive numerical performance. While…

Optimization and Control · Mathematics 2021-10-20 Thomas Kerdreux , Alexandre d'Aspremont , Sebastian Pokutta

We propose a new stochastic gradient method for optimizing the sum of a finite set of smooth functions, where the sum is strongly convex. While standard stochastic gradient methods converge at sublinear rates for this problem, the proposed…

Optimization and Control · Mathematics 2013-03-12 Nicolas Le Roux , Mark Schmidt , Francis Bach

In this paper, we study the generalized Douglas-Rachford algorithm and its cyclic variants which include many projection-type methods such as the classical Douglas-Rachford algorithm and the alternating projection algorithm. Specifically,…

Optimization and Control · Mathematics 2020-04-14 Minh N. Dao , Hung M. Phan

We revisit the finite time analysis of policy gradient methods in the one of the simplest settings: finite state and action MDPs with a policy class consisting of all stochastic policies and with exact gradient evaluations. There has been…

Machine Learning · Computer Science 2021-12-14 Jalaj Bhandari , Daniel Russo

We introduce and analyze a new finite-difference scheme, relying on the theta-method, for solving monotone second-order mean field games. These games consist of a coupled system of the Fokker-Planck and the Hamilton-Jacobi-Bellman equation.…

Numerical Analysis · Mathematics 2023-05-23 J. Frédéric Bonnans , Kang Liu , Laurent Pfeiffer

The cornerstone underpinning deep learning is the guarantee that gradient descent on an objective converges to local minima. Unfortunately, this guarantee fails in settings, such as generative adversarial nets, where there are multiple…

Machine Learning · Computer Science 2018-06-07 David Balduzzi , Sebastien Racaniere , James Martens , Jakob Foerster , Karl Tuyls , Thore Graepel

In this paper, we present an extension of Uzawa's algorithm and apply it to build approximating sequences of mean field games systems. We prove that Uzawa's iterations can be used in a more general situation than the one in it is usually…

Analysis of PDEs · Mathematics 2018-10-03 Charles Bertucci

A classic model to study strategic decision making in multi-agent systems is the normal-form game. This model can be generalised to allow for an infinite number of pure strategies leading to continuous games. Multi-objective normal-form…

Computer Science and Game Theory · Computer Science 2023-03-02 Willem Röpke , Carla Groenland , Roxana Rădulescu , Ann Nowé , Diederik M. Roijers

This paper introduces a new method based on Deep Galerkin Methods (DGMs) for solving high-dimensional stochastic Mean Field Games (MFGs). We achieve this by using two neural networks to approximate the unknown solutions of the MFG system…

Machine Learning · Computer Science 2023-08-09 Mouhcine Assouli , Badr Missaoui

In this paper, we consider a finite horizon, non-stationary, mean field games (MFG) with a large population of homogeneous players, sequentially making strategic decisions, where each player is affected by other players through an aggregate…

Systems and Control · Electrical Eng. & Systems 2020-04-07 Rajesh K Mishra , Deepanshu Vasal , Sriram Vishwanath

Minimization of a smooth function on a sphere or, more generally, on a smooth manifold, is the simplest non-convex optimization problem. It has a lot of applications. Our goal is to propose a version of the gradient projection algorithm for…

Optimization and Control · Mathematics 2019-06-28 Maxim Balashov , Boris Polyak , Andrey Tremba

We propose a discrete time graphon game formulation on continuous state and action spaces using a representative player to study stochastic games with heterogeneous interaction among agents. This formulation admits both philosophical and…

Optimization and Control · Mathematics 2024-06-07 Fuzhong Zhou , Chenyu Zhang , Xu Chen , Xuan Di

In this letter, we study a class of linear-quadratic mean-field-type difference games with coupled affine inequality constraints. We show that the mean-field-type equilibrium can be characterized by the existence of a multiplier process…

Optimization and Control · Mathematics 2025-10-06 Partha Sarathi Mohapatra , Puduru Viswanadha Reddy

Finding Nash equilibria in two-player zero-sum continuous games is a central problem in machine learning, e.g. for training both GANs and robust models. The existence of pure Nash equilibria requires strong conditions which are not…

Machine Learning · Computer Science 2021-05-07 Carles Domingo-Enrich , Samy Jelassi , Arthur Mensch , Grant Rotskoff , Joan Bruna

In this paper, we solve the problem of learning a generalized Nash equilibrium (GNE) in merely monotone games. First, we propose a novel continuous semi-decentralized solution algorithm without projections that uses first-order information…

Systems and Control · Electrical Eng. & Systems 2021-10-07 Suad Krilašević , Sergio Grammatico

This paper introduces a framework of Constrained Mean-Field Games (CMFGs), where each agent solves a constrained Markov decision process (CMDP). This formulation captures scenarios in which agents' strategies are subject to feasibility,…

Optimization and Control · Mathematics 2025-10-15 Anran Hu , Zijiu Lyu

We provide a distributed algorithm to learn a Nash equilibrium in a class of non-cooperative games with strongly monotone mappings and unconstrained action sets. Each player has access to her own smooth local cost function and can…

Optimization and Control · Mathematics 2019-07-17 Tatiana Tatarenko , Angelia Nedich

We develop methods to formally describe and compare games, in order to probe questions of game structure and design, and as a stepping stone to predicting player behavior from design patterns. We define a grammar-like formalism to describe…

Logic in Computer Science · Computer Science 2021-01-05 Paul Riggins , David McPherson