English
Related papers

Related papers: Tight Analysis of Extra-gradient and Optimistic Gr…

200 papers

Smooth minimax optimization problems play a central role in a wide range of applications, including machine learning, game theory, and operations research. However, existing algorithmic frameworks vary significantly depending on the problem…

Optimization and Control · Mathematics 2025-06-10 Taoli Zheng , Anthony Man-Cho So , Jiajin Li

Minimax problems, such as generative adversarial network, adversarial training, and fair training, are widely solved by a multi-step gradient descent ascent (MGDA) method in practice. However, its convergence guarantee is limited. In this…

Optimization and Control · Mathematics 2022-06-10 Sucheol Lee , Donghwan Kim

We consider nonconvex-concave minimax problems, $\min_{\mathbf{x}} \max_{\mathbf{y} \in \mathcal{Y}} f(\mathbf{x}, \mathbf{y})$, where $f$ is nonconvex in $\mathbf{x}$ but concave in $\mathbf{y}$ and $\mathcal{Y}$ is a convex and bounded…

Machine Learning · Computer Science 2024-05-06 Tianyi Lin , Chi Jin , Michael I. Jordan

Gradient Descent Ascent (GDA) methods for min-max optimization problems typically produce oscillatory behavior that can lead to instability, e.g., in bilinear settings. To address this problem, we introduce a dissipation term into the GDA…

Optimization and Control · Mathematics 2024-03-15 Tianqi Zheng , Nicolas Loizou , Pengcheng You , Enrique Mallada

This paper aims at developing novel shuffling gradient-based methods for tackling two classes of minimax problems: nonconvex-linear and nonconvex-strongly concave settings. The first algorithm addresses the nonconvex-linear minimax model…

Optimization and Control · Mathematics 2024-10-30 Quoc Tran-Dinh , Trang H. Tran , Lam M. Nguyen

The Gradient Descent-Ascent (GDA) algorithm, designed to solve minimax optimization problems, takes the descent and ascent steps either simultaneously (Sim-GDA) or alternately (Alt-GDA). While Alt-GDA is commonly observed to converge…

Optimization and Control · Mathematics 2024-07-16 Jaewook Lee , Hanseul Cho , Chulhee Yun

In this paper, we study the minimax optimization problem in the smooth and strongly convex-strongly concave setting when we have access to noisy estimates of gradients. In particular, we first analyze the stochastic Gradient Descent Ascent…

Optimization and Control · Mathematics 2020-02-14 Alireza Fallah , Asuman Ozdaglar , Sarath Pattathil

We develop subgradient- and gradient-based methods for minimizing strongly convex functions under a notion which generalizes the standard Euclidean strong convexity. We propose a unifying framework for subgradient methods which yields two…

Optimization and Control · Mathematics 2016-08-19 Masaru Ito

Adaptive gradient algorithms perform gradient-based updates using the history of gradients and are ubiquitous in training deep neural networks. While adaptive gradient methods theory is well understood for minimization problems, the…

Optimization and Control · Mathematics 2020-12-29 Mingrui Liu , Youssef Mroueh , Jerret Ross , Wei Zhang , Xiaodong Cui , Payel Das , Tianbao Yang

Smooth minimax games often proceed by simultaneous or alternating gradient updates. Although algorithms with alternating updates are commonly used in practice, the majority of existing theoretical analyses focus on simultaneous algorithms…

Machine Learning · Computer Science 2022-02-15 Guodong Zhang , Yuanhao Wang , Laurent Lessard , Roger Grosse

Despite remarkable empirical success, the training dynamics of generative adversarial networks (GAN), which involves solving a minimax game using stochastic gradients, is still poorly understood. In this work, we analyze last-iterate…

Machine Learning · Computer Science 2020-10-13 Ernest K. Ryu , Kun Yuan , Wotao Yin

Gradient descent ascent (GDA), the simplest single-loop algorithm for nonconvex minimax optimization, is widely used in practical applications such as generative adversarial networks (GANs) and adversarial training. Albeit its desirable…

Machine Learning · Computer Science 2021-12-13 Junchi Yang , Antonio Orvieto , Aurelien Lucchi , Niao He

There is a growing interest in using robust control theory to analyze and design optimization and machine learning algorithms. This paper studies a class of nonconvex optimization problems whose cost functions satisfy the so-called…

Optimization and Control · Mathematics 2019-12-11 Huaqing Xiong , Yuejie Chi , Bin Hu , Wei Zhang

We study alternating first-order algorithms with no inner loops for solving nonconvex-strongly-concave min-max problems. We show the convergence of the alternating gradient descent--ascent algorithm method by proposing a substantially…

Optimization and Control · Mathematics 2026-03-31 Guido Tapia-Riera , Camille Castera , Nicolas Papadakis

In this paper, we consider nonconvex minimax optimization, which is gaining prominence in many modern machine learning applications such as GANs. Large-scale edge-based collection of training data in these applications calls for…

Optimization and Control · Mathematics 2022-03-10 Pranay Sharma , Rohan Panda , Gauri Joshi , Pramod K. Varshney

We analyze a fast incremental aggregated gradient method for optimizing nonconvex problems of the form $\min_x \sum_i f_i(x)$. Specifically, we analyze the SAGA algorithm within an Incremental First-order Oracle framework, and show that it…

Optimization and Control · Mathematics 2016-03-22 Sashank J. Reddi , Suvrit Sra , Barnabas Poczos , Alex Smola

We study constrained comonotone min-max optimization, a structured class of nonconvex-nonconcave min-max optimization problems, and their generalization to comonotone inclusion. In our first contribution, we extend the Extra Anchored…

Optimization and Control · Mathematics 2024-12-06 Yang Cai , Argyris Oikonomou , Weiqiang Zheng

In this work we introduce a new optimisation method called SAGA in the spirit of SAG, SDCA, MISO and SVRG, a set of recently proposed incremental gradient algorithms with fast linear convergence rates. SAGA improves on the theory behind SAG…

Machine Learning · Computer Science 2014-12-17 Aaron Defazio , Francis Bach , Simon Lacoste-Julien

Minimax optimization recently is widely applied in many machine learning tasks such as generative adversarial networks, robust learning and reinforcement learning. In the paper, we study a class of nonconvex-nonconcave minimax optimization…

Optimization and Control · Mathematics 2025-04-23 Feihu Huang , Chunyu Xuan , Xinrui Wang , Siqi Zhang , Songcan Chen

Recently, there has been growing interest in developing optimization methods for solving large-scale machine learning problems. Most of these problems boil down to the problem of minimizing an average of a finite set of smooth and strongly…

Optimization and Control · Mathematics 2018-02-09 Aryan Mokhtari , Mert Gürbüzbalaban , Alejandro Ribeiro