English
Related papers

Related papers: Gradient Free Minimax Optimization: Variance Reduc…

200 papers

In recent years, there has been considerable interest in designing stochastic first-order algorithms to tackle finite-sum smooth minimax problems. To obtain the gradient estimates, one typically relies on the uniform…

Optimization and Control · Mathematics 2024-10-08 Xia Jiang , Linglingzhi Zhu , Anthony Man-Cho So , Shisheng Cui , Jian Sun

We present two easy-to-implement gradient-free/zeroth-order methods to optimize a stochastic non-smooth function accessible only via a black-box. The methods are built upon efficient first-order methods in the heavy-tailed case, i.e., when…

Optimization and Control · Mathematics 2023-08-25 Nikita Kornilov , Alexander Gasnikov , Pavel Dvurechensky , Darina Dvinskikh

In this paper, we study zeroth-order algorithms for nonconvex minimax problems with coupled linear constraints under the deterministic and stochastic settings, which have attracted wide attention in machine learning, signal processing and…

Optimization and Control · Mathematics 2026-03-06 Huiling Zhang , Zi Xu , Yuhong Dai

We develop a novel and single-loop variance-reduced algorithm to solve a class of stochastic nonconvex-convex minimax problems involving a nonconvex-linear objective function, which has various applications in different fields such as…

Optimization and Control · Mathematics 2020-10-27 Quoc Tran-Dinh , Deyi Liu , Lam M. Nguyen

Variance reduction techniques are designed to decrease the sampling variance, thereby accelerating convergence rates of first-order (FO) and zeroth-order (ZO) optimization methods. However, in composite optimization problems, ZO methods…

Machine Learning · Computer Science 2024-05-29 Hao Di , Haishan Ye , Yueling Zhang , Xiangyu Chang , Guang Dai , Ivor W. Tsang

In the paper, we study a class of useful minimax problems on Riemanian manifolds and propose a class of effective Riemanian gradient-based methods to solve these minimax problems. Specifically, we propose an effective Riemannian gradient…

Machine Learning · Computer Science 2023-01-04 Feihu Huang , Shangqian Gao

Minimax optimization recently is widely applied in many machine learning tasks such as generative adversarial networks, robust learning and reinforcement learning. In the paper, we study a class of nonconvex-nonconcave minimax optimization…

Optimization and Control · Mathematics 2025-04-23 Feihu Huang , Chunyu Xuan , Xinrui Wang , Siqi Zhang , Songcan Chen

We consider the optimization problem of the form $\min_{x \in \mathbb{R}^d} f(x) \triangleq \mathbb{E}_{\xi} [F(x; \xi)]$, where the component $F(x;\xi)$ is $L$-mean-squared Lipschitz but possibly nonconvex and nonsmooth. The recently…

Optimization and Control · Mathematics 2024-05-15 Lesi Chen , Jing Xu , Luo Luo

Two types of zeroth-order stochastic algorithms have recently been designed for nonconvex optimization respectively based on the first-order techniques SVRG and SARAH/SPIDER. This paper addresses several important issues that are still open…

Machine Learning · Computer Science 2019-10-29 Kaiyi Ji , Zhe Wang , Yi Zhou , Yingbin Liang

In recent years, nonconvex minimax problems have attracted significant attention due to their broad applications in machine learning, including generative adversarial networks, robust optimization and adversarial training. Most existing…

Optimization and Control · Mathematics 2026-03-06 Yan Gao , Yongchao Liu

In machine learning, nonconvex optimization problems with multiple local optimums are often encountered. Graduated Optimization Algorithm (GOA) is a popular heuristic method to obtain global optimums of nonconvex problems through…

Machine Learning · Computer Science 2017-07-11 Li Chen , Shuisheng Zhou , Zhuan Zhang

In this paper we analyze a zeroth-order proximal stochastic gradient method suitable for the minimization of weakly convex stochastic optimization problems. We consider nonsmooth and nonlinear stochastic composite problems, for which…

Optimization and Control · Mathematics 2025-04-21 Spyridon Pougkakiotis , Dionysios S. Kalogerias

In this paper we propose stochastic gradient-free methods and accelerated methods with momentum for solving stochastic optimization problems. All these methods rely on stochastic directions rather than stochastic gradients. We analyze the…

Optimization and Control · Mathematics 2020-01-15 Xiaopeng Luo , Xin Xu

Minimax optimization plays an important role in many machine learning tasks such as generative adversarial networks (GANs) and adversarial training. Although recently a wide variety of optimization methods have been proposed to solve the…

Optimization and Control · Mathematics 2023-04-24 Feihu Huang , Songcan Chen

We propose a novel single-loop decentralized algorithm called DGDA-VR for solving the stochastic nonconvex strongly-concave minimax problem over a connected network of $M$ agents. By using stochastic first-order oracles to estimate the…

Optimization and Control · Mathematics 2024-03-21 Xuan Zhang , Gabriel Mancino-Ball , Necdet Serhat Aybat , Yangyang Xu

In this study, we consider an optimization problem with uncertainty dependent on decision variables, which has recently attracted attention due to its importance in machine learning and pricing applications. In this problem, the gradient of…

Optimization and Control · Mathematics 2024-12-31 Yuya Hikima , Akiko Takeda

In the paper, we propose a class of accelerated zeroth-order and first-order momentum methods for both nonconvex mini-optimization and minimax-optimization. Specifically, we propose a new accelerated zeroth-order momentum (Acc-ZOM) method…

Optimization and Control · Mathematics 2022-01-19 Feihu Huang , Shangqian Gao , Jian Pei , Heng Huang

In this paper, we consider nonconvex minimax optimization, which is gaining prominence in many modern machine learning applications such as GANs. Large-scale edge-based collection of training data in these applications calls for…

Optimization and Control · Mathematics 2022-03-10 Pranay Sharma , Rohan Panda , Gauri Joshi , Pramod K. Varshney

We study a class of zeroth-order distributed optimization problems, where each agent can control a partial vector and observe a local cost that depends on the joint vector of all agents, and the agents can communicate with each other with…

Optimization and Control · Mathematics 2024-01-09 Xinran Zheng , Tara Javidi , Behrouz Touri

We study stochastic decentralized optimization for the problem of training machine learning models with large-scale distributed data. We extend the widely used EXTRA and DIGing methods with variance reduction (VR), and propose two methods:…

Optimization and Control · Mathematics 2022-08-30 Huan Li , Zhouchen Lin , Yongchun Fang