English
Related papers

Related papers: Online Optimization Perspective on First-Order and…

200 papers

We study online convex optimization in the random order model, recently proposed by \citet{garber2020online}, where the loss functions may be chosen by an adversary, but are then presented to the online algorithm in a uniformly random…

Machine Learning · Computer Science 2021-06-30 Uri Sherman , Tomer Koren , Yishay Mansour

In this work, we consider bilevel optimization when the lower-level problem is strongly convex. Recent works show that with a Hessian-vector product (HVP) oracle, one can provably find an $\epsilon$-stationary point within…

Optimization and Control · Mathematics 2026-05-26 Lesi Chen , Yaohua Ma , Jingzhao Zhang

Recently, min-max optimization problems have received increasing attention due to their wide range of applications in machine learning (ML). However, most existing min-max solution techniques are either single-machine or distributed…

Machine Learning · Computer Science 2023-03-07 Zhuqing Liu , Xin Zhang , Songtao Lu , Jia Liu

This text presents an introduction to an emerging paradigm in control of dynamical systems and differentiable reinforcement learning called online nonstochastic control. The new approach applies techniques from online convex optimization…

Machine Learning · Computer Science 2026-04-28 Elad Hazan , Karan Singh

Optimization problems involving the minimization of a finite sum of smooth, possibly non-convex functions arise in numerous applications. To achieve a consensus solution over a network, distributed optimization algorithms, such as…

Optimization and Control · Mathematics 2025-07-09 Lei Qin , Ye Pu

The use of min-max optimization in adversarial training of deep neural network classifiers and training of generative adversarial networks has motivated the study of nonconvex-nonconcave optimization objectives, which frequently arise in…

Optimization and Control · Mathematics 2021-03-02 Jelena Diakonikolas , Constantinos Daskalakis , Michael I. Jordan

This work aims to solve a stochastic nonconvex nonsmooth composite optimization problem. Previous works on composite optimization problem requires the major part to satisfy Lipschitz smoothness or some relaxed smoothness conditions, which…

Optimization and Control · Mathematics 2025-10-07 Ziyi Chen , Peiran Yu , Heng Huang

Consider a network of $N$ decentralized computing agents collaboratively solving a nonconvex stochastic composite problem. In this work, we propose a single-loop algorithm, called DEEPSTORM, that achieves optimal sample complexity for this…

Optimization and Control · Mathematics 2023-04-14 Gabriel Mancino-Ball , Shengnan Miao , Yangyang Xu , Jie Chen

In recent years, nonconvex minimax problems have attracted significant attention due to their broad applications in machine learning, including generative adversarial networks, robust optimization and adversarial training. Most existing…

Optimization and Control · Mathematics 2026-03-06 Yan Gao , Yongchao Liu

Gradient-free/zeroth-order methods for black-box convex optimization have been extensively studied in the last decade with the main focus on oracle calls complexity. In this paper, besides the oracle complexity, we focus also on iteration…

The generalized smooth condition, $(L_{0},L_{1})$-smoothness, has triggered people's interest since it is more realistic in many optimization problems shown by both empirical and theoretical evidence. Two recent works established the…

Machine Learning · Computer Science 2023-10-31 Zijian Liu , Srikanth Jagabathula , Zhengyuan Zhou

We propose stochastic optimization algorithms that can find local minima faster than existing algorithms for nonconvex optimization problems, by exploiting the third-order smoothness to escape non-degenerate saddle points more efficiently.…

Optimization and Control · Mathematics 2017-12-19 Yaodong Yu , Pan Xu , Quanquan Gu

This paper studies a compressed momentum-based single-point zeroth-order algorithm for stochastic distributed nonconvex optimization, aiming to alleviate communication overhead and address the unavailability of explicit gradient…

Optimization and Control · Mathematics 2026-05-12 Linjing Chen , Antai Xie , Xinlei Yi , Xiaoqiang Ren , Xiaofan Wang

Decentralized optimization with time-varying networks is an emerging paradigm in machine learning. It saves remarkable communication overhead in large-scale deep training and is more robust in wireless scenarios especially when nodes are…

Machine Learning · Computer Science 2022-11-02 Xinmeng Huang , Kun Yuan

This paper studies the stochastic nonconvex-strongly-concave minimax optimization over a multi-agent network. We propose an efficient algorithm, called Decentralized Recursive gradient descEnt Ascent Method (DREAM), which achieves the…

Machine Learning · Computer Science 2024-05-15 Lesi Chen , Haishan Ye , Luo Luo

Decentralized optimization is effective to save communication in large-scale machine learning. Although numerous algorithms have been proposed with theoretical guarantees and empirical successes, the performance limits in decentralized…

Machine Learning · Computer Science 2022-10-17 Kun Yuan , Xinmeng Huang , Yiming Chen , Xiaohan Zhang , Yingya Zhang , Pan Pan

We present a new class of decentralized first-order methods for nonsmooth and stochastic optimization problems defined over multiagent networks. Considering that communication is a major bottleneck in decentralized optimization, our main…

Optimization and Control · Mathematics 2017-02-07 Guanghui Lan , Soomin Lee , Yi Zhou

We study differentially private (DP) optimization algorithms for stochastic and empirical objectives which are neither smooth nor convex, and propose methods that return a Goldstein-stationary point with sample complexity bounds that…

Machine Learning · Computer Science 2025-06-10 Guy Kornowski , Daogao Liu , Kunal Talwar

We consider the task of minimizing the sum of convex functions stored in a decentralized manner across the nodes of a communication network. This problem is relatively well-studied in the scenario when the objective functions are smooth, or…

Optimization and Control · Mathematics 2024-05-29 Dmitry Kovalev , Ekaterina Borodich , Alexander Gasnikov , Dmitrii Feoktistov

This paper focuses on a multi-agent zeroth-order online optimization problem in a federated learning setting for target tracking. The agents only sense their current distances to their targets and aim to maintain a minimum safe distance…

Machine Learning · Computer Science 2023-06-12 Ege C. Kaya , M. Berk Sahin , Abolfazl Hashemi