English
Related papers

Related papers: Training GANs with Optimism

200 papers

We study the problem of no-regret learning algorithms for general monotone and smooth games and their last-iterate convergence properties. Specifically, we investigate the problem under bandit feedback and strongly uncoupled dynamics, which…

Computer Science and Game Theory · Computer Science 2024-08-19 Jing Dong , Baoxiang Wang , Yaoliang Yu

The wide applications of Generative adversarial networks benefit from the successful training methods, guaranteeing that an object function converges to the local minima. Nevertheless, designing an efficient and competitive training method…

Machine Learning · Computer Science 2021-11-11 Huiqing Qi , Fang Li , Shengli Tan , Xiangyun Zhang

Generative Adversarial Networks (GANs) have been promising in the field of image generation, however, they have been hard to train for language generation. GANs were originally designed to output differentiable values, so discrete language…

Machine Learning · Computer Science 2018-07-04 Mehrad Moradshahi , Utkarsh Contractor

We study the performance of optimistic regret-minimization algorithms for both minimizing regret in, and computing Nash equilibria of, zero-sum extensive-form games. In order to apply these algorithms to extensive-form games, a…

Computer Science and Game Theory · Computer Science 2019-10-29 Gabriele Farina , Christian Kroer , Tuomas Sandholm

Generative adversarial networks (GANs) represent a zero-sum game between two machine players, a generator and a discriminator, designed to learn the distribution of data. While GANs have achieved state-of-the-art performance in several…

Machine Learning · Computer Science 2020-02-24 Farzan Farnia , Asuman Ozdaglar

We address scaling up equilibrium computation in Mean Field Games (MFGs) using Online Mirror Descent (OMD). We show that continuous-time OMD provably converges to a Nash equilibrium under a natural and well-motivated set of monotonicity…

Artificial Intelligence · Computer Science 2021-03-02 Julien Perolat , Sarah Perrin , Romuald Elie , Mathieu Laurière , Georgios Piliouras , Matthieu Geist , Karl Tuyls , Olivier Pietquin

In this paper, we investigate the power of {\it regularization}, a common technique in reinforcement learning and optimization, in solving extensive-form games (EFGs). We propose a series of new algorithms based on regularizing the payoff…

Computer Science and Game Theory · Computer Science 2025-07-10 Mingyang Liu , Asuman Ozdaglar , Tiancheng Yu , Kaiqing Zhang

We consider the problem of training generative models with a Generative Adversarial Network (GAN). Although GANs can accurately model complex distributions, they are known to be difficult to train due to instabilities caused by a difficult…

Machine Learning · Computer Science 2017-06-13 Paulina Grnarova , Kfir Y. Levy , Aurelien Lucchi , Thomas Hofmann , Andreas Krause

No-regret learning has been widely used to compute a Nash equilibrium in two-person zero-sum games. However, there is still a lack of regret analysis for network stochastic zero-sum games, where players competing in two subnetworks only…

Optimization and Control · Mathematics 2022-05-31 Shijie Huang , Jinlong Lei , Yiguang Hong

We relate the minimax game of generative adversarial networks (GANs) to finding the saddle points of the Lagrangian function for a convex optimization problem, where the discriminator outputs and the distribution of generator outputs play…

Machine Learning · Computer Science 2018-02-07 Xu Chen , Jiang Wang , Hao Ge

We study how to learn $\epsilon$-optimal strategies in zero-sum imperfect information games (IIG) with trajectory feedback. In this setting, players update their policies sequentially based on their observations over a fixed number of…

Computer Science and Game Theory · Computer Science 2023-09-06 Côme Fiegel , Pierre Ménard , Tadashi Kozuno , Rémi Munos , Vianney Perchet , Michal Valko

In a recent series of papers it has been established that variants of Gradient Descent/Ascent and Mirror Descent exhibit last iterate convergence in convex-concave zero-sum games. Specifically, \cite{DISZ17, LiangS18} show last iterate…

Machine Learning · Computer Science 2025-09-30 Qi Lei , Sai Ganesh Nagarajan , Ioannis Panageas , Xiao Wang

One of the major breakthroughs in deep learning over the past five years has been the Generative Adversarial Network (GAN), a neural network-based generative model which aims to mimic some underlying distribution given a dataset of samples.…

Machine Learning · Computer Science 2020-06-23 Yeojoon Youn , Neil Thistlethwaite , Sang Keun Choe , Jacob Abernethy

Generative adversarial network (GAN) has gotten wide re-search interest in the field of deep learning. Variations of GAN have achieved competitive results on specific tasks. However, the stability of training and diversity of generated…

Computer Vision and Pattern Recognition · Computer Science 2018-09-07 Haoxuan You , Zhicheng Jiao , Haojun Xu , Jie Li , Ying Wang , Xinbo Gao

The paper presents the formulation, implementation, and evaluation of the ArcGD optimiser. The evaluation is conducted initially on a non-convex benchmark function and subsequently on a real-world ML dataset. The initial comparative study…

Machine Learning · Computer Science 2026-03-25 Nikhil Verma , Joonas Linnosmaa , Leonardo Espinosa-Leal , Napat Vajragupta

In optimization, the negative gradient of a function denotes the direction of steepest descent. Furthermore, traveling in any direction orthogonal to the gradient maintains the value of the function. In this work, we show that these…

Machine Learning · Computer Science 2019-05-21 Ian Gemp , Sridhar Mahadevan

In two-player zero-sum games, the learning dynamic based on optimistic Hedge achieves one of the best-known regret upper bounds among strongly-uncoupled learning dynamics. With an appropriately chosen learning rate, the social and…

Machine Learning · Computer Science 2025-10-14 Taira Tsuchiya

To model complex real-world systems, such as traders in stock markets, or the dissemination of contagious diseases, graphon mean-field games (GMFG) have been proposed to model many agents. Despite the empirical success, our understanding of…

Computer Science and Game Theory · Computer Science 2024-10-14 Jing Dong , Baoxiang Wang , Yaoliang Yu

This paper mainly conducts further research to alleviate the issue of limit cycling behavior in training generative adversarial networks (GANs) through the proposed predictive centripetal acceleration algorithm (PCAA). Specifically, we…

Machine Learning · Statistics 2023-08-14 Li Keke , Yang Xinmin

Generative adversarial networks (GANs) have enjoyed much success in learning high-dimensional distributions. Learning objectives approximately minimize an $f$-divergence ($f$-GANs) or an integral probability metric (Wasserstein GANs)…

Machine Learning · Computer Science 2020-06-19 Jiaming Song , Stefano Ermon