English
Related papers

Related papers: Optimistic mirror descent in saddle-point problems…

200 papers

Feedback delays are inevitable in real-world multi-agent learning. They are known to severely degrade performance, and the convergence rate under delayed feedback is still unclear, even for bilinear games. This paper derives the rate of…

Machine Learning · Computer Science 2026-02-20 Yuma Fujimoto , Kenshi Abe , Kaito Ariu

This paper studies the convergence of the mirror descent algorithm for finite horizon stochastic control problems with measure-valued control processes. The control objective involves a convex regularisation function, denoted as $h$, with…

Optimization and Control · Mathematics 2025-08-22 Bekzhan Kerimkulov , David Šiška , Łukasz Szpruch , Yufei Zhang

This paper revisits the convergence of Stochastic Mirror Descent (SMD) in the contemporary nonconvex optimization setting. Existing results for batch-free nonconvex SMD restrict the choice of the distance generating function (DGF) to be…

Optimization and Control · Mathematics 2024-02-28 Ilyas Fatkhullin , Niao He

The paper studies a distributed gradient descent (DGD) process and considers the problem of showing that in nonconvex optimization problems, DGD typically converges to local minima rather than saddle points. The paper considers…

Optimization and Control · Mathematics 2019-10-24 Brian Swenson , Ryan Murray , H. Vincent Poor , Soummya Kar

Mirror Descent (MD) is a well-known method of solving non-smooth convex optimization problems. This paper analyzes the stochastic variant of MD with adaptive stepsizes. Its convergence on average is shown to be faster than with the fixed…

Optimization and Control · Mathematics 2017-05-08 Anastasia Bayandina

We propose Mirror Descent Optimal Transport (MDOT), a novel method for solving discrete optimal transport (OT) problems with high precision, by unifying temperature annealing in entropic-regularized OT (EOT) with mirror descent techniques.…

Machine Learning · Computer Science 2025-06-04 Mete Kemertas , Allan D. Jepson , Amir-massoud Farahmand

We consider centralized and distributed mirror descent algorithms over a finite-dimensional Hilbert space, and prove that the problem variables converge to an optimizer of a possibly nonsmooth function when the step sizes are square…

Optimization and Control · Mathematics 2018-05-07 Thinh T. Doan , Subhonmesh Bose , D. Hoa Nguyen , Carolyn L. Beck

Stochastic multi-objective optimization (SMOO) has recently emerged as a powerful framework for addressing machine learning problems with multiple objectives. The bias introduced by the nonlinearity of the subproblem solution mapping…

Optimization and Control · Mathematics 2024-10-10 Linxi Yang , Liping Tang , Jiahao Lv , Yuehong He , Xinmin Yang

Smooth minimax optimization problems play a central role in a wide range of applications, including machine learning, game theory, and operations research. However, existing algorithmic frameworks vary significantly depending on the problem…

Optimization and Control · Mathematics 2025-06-10 Taoli Zheng , Anthony Man-Cho So , Jiajin Li

Stochastic descent methods (of the gradient and mirror varieties) have become increasingly popular in optimization. In fact, it is now widely recognized that the success of deep learning is not only due to the special deep architecture of…

Machine Learning · Computer Science 2019-01-21 Navid Azizan , Babak Hassibi

This letter investigates the convergence and concentration properties of the Stochastic Mirror Descent (SMD) algorithm utilizing biased stochastic subgradients. We establish the almost sure convergence of the algorithm's iterates under the…

Optimization and Control · Mathematics 2024-07-09 Anik Kumar Paul , Arun D Mahindrakar , Rachel K Kalaimani

Adam-type methods, the extension of adaptive gradient methods, have shown great performance in the training of both supervised and unsupervised machine learning models. In particular, Adam-type optimizers have been widely used empirically…

Machine Learning · Computer Science 2021-09-30 Zehao Dou , Yuanzhi Li

We show that, for any sufficiently small fixed $\epsilon > 0$, when both players in a general-sum two-player (bimatrix) game employ optimistic mirror descent (OMD) with smooth regularization, learning rate $\eta = O(\epsilon^2)$ and $T =…

Computer Science and Game Theory · Computer Science 2022-10-10 Ioannis Anagnostides , Gabriele Farina , Ioannis Panageas , Tuomas Sandholm

We consider convex-concave saddle-point problems where the objective functions may be split in many components, and extend recent stochastic variance reduction methods (such as SVRG or SAGA) to provide the first large-scale linearly…

Machine Learning · Computer Science 2016-11-04 P Balamurugan , Francis Bach

Non-cooperative games serve as a powerful framework for capturing the interactions among self-interested players and have broad applicability in modeling a wide range of practical scenarios, ranging from power management to drug delivery.…

Optimization and Control · Mathematics 2023-09-08 Yuanhanqing Huang , Jianghai Hu

Constrained competitive optimization involves multiple agents trying to minimize conflicting objectives, subject to constraints. This is a highly expressive modeling language that subsumes most of modern machine learning. In this work we…

Optimization and Control · Mathematics 2020-06-19 Florian Schäfer , Anima Anandkumar , Houman Owhadi

Online mirror descent (OMD) is a fundamental algorithmic paradigm that underlies many algorithms in optimization, machine learning and sequential decision-making. The OMD iterates are defined as solutions to optimization subproblems which,…

Machine Learning · Computer Science 2025-12-01 Ofir Schlisselberg , Uri Sherman , Tomer Koren , Yishay Mansour

We develop a first-order accelerated algorithm for a class of constrained bilinear saddle-point problems with applications to network systems. The algorithm is a modified time-varying primal-dual version of an accelerated mirror-descent…

Optimization and Control · Mathematics 2024-10-04 Weijian Li , Xianlin Zeng , Lacra Pavel

Multi-objective optimization (MOO) is receiving more attention in various fields such as multi-task learning. Recent works provide some effective algorithms with theoretical analysis but they are limited by the standard $L$-smooth or…

Machine Learning · Computer Science 2025-03-11 Qi Zhang , Peiyao Xiao , Shaofeng Zou , Kaiyi Ji

Optimistic Gradient Descent Ascent (OGDA) and Optimistic Multiplicative Weights Update (OMWU) for saddle-point optimization have received growing attention due to their favorable last-iterate convergence. However, their behaviors for simple…

Machine Learning · Computer Science 2021-03-23 Chen-Yu Wei , Chung-Wei Lee , Mengxiao Zhang , Haipeng Luo