English
Related papers

Related papers: Geometry-Aware Universal Mirror-Prox

200 papers

We introduce an inexact oracle model for variational inequalities (VI) with monotone operator, propose a numerical method which solves such VI's and analyze its convergence rate. As a particular case, we consider VI's with…

Optimization and Control · Mathematics 2022-02-18 Fedor Stonyakin , Alexander Gasnikov , Pavel Dvurechensky , Mohammad Alkousa , Alexander Titov

We consider variational inequalities coming from monotone operators, a setting that includes convex minimization and convex-concave saddle-point problems. We assume an access to potentially noisy unbiased values of the monotone operators…

Machine Learning · Computer Science 2019-02-06 Francis Bach , Kfir Y. Levy

We consider the mirror-prox algorithm for solving monotone Variational Inequality (VI) problems. As the mirror-prox algorithm is not practically implementable, except in special instances of VIs (such as affine VIs), we consider its…

Optimization and Control · Mathematics 2024-09-27 Abhishek Chakraborty , Angelia Nedić

This paper establishes the convergence properties of the Popov mirror-prox algorithm for solving stochastic and deterministic variational inequalities (VIs) under a polynomial growth condition on the mapping variation. Unlike existing…

Optimization and Control · Mathematics 2025-10-21 Abhishek Chakraborty , Angelia Nedić

In this paper we propose new algorithms for solving a class of structured monotone variational inequality (VI) problems over compact feasible sets. By identifying the gradient components existing in the operator of VI, we show that it is…

Optimization and Control · Mathematics 2021-11-02 Guanghui Lan , Yuyuan Ouyang

In this paper we consider iterative methods for stochastic variational inequalities (s.v.i.) with monotone operators. Our basic assumption is that the operator possesses both smooth and nonsmooth components. Further, only noisy observations…

Optimization and Control · Mathematics 2011-06-01 Anatoli Juditsky , Arkadii S. Nemirovskii , Claire Tauvel

In this work, we present new simple and optimal algorithms for solving the variational inequality (VI) problem for $p^{th}$-order smooth, monotone operators -- a problem that generalizes convex optimization and saddle-point problems. Recent…

Optimization and Control · Mathematics 2022-06-01 Deeksha Adil , Brian Bullins , Arun Jambulapati , Sushant Sachdeva

We present a \emph{mirror-free} mirror prox (MFMP) algorithm, which extends the classic approach of Nemirovski (2004) to allow for proximal-like updates without the explicit need for a mirror map. We further analyze the convergence of our…

Optimization and Control · Mathematics 2026-03-24 Abhijeet Vyas , Brian Bullins

Basing on some recently proposed methods for solving variational inequalities with non-smooth operators, we propose an analogue of the Mirror Prox method for the corresponding class of problems under the assumption of relative smoothness…

Optimization and Control · Mathematics 2021-06-09 Alexander A. Titov

We develop new adaptive algorithms for variational inequalities with monotone operators, which capture many problems of interest, notably convex optimization and convex-concave saddle point problems. Our algorithms automatically adapt to…

Machine Learning · Computer Science 2021-08-30 Alina Ene , Huy L. Nguyen

We propose a novel method, namely the accelerated mirror-prox (AMP) method, for computing the weak solutions of a class of deterministic and stochastic monotone variational inequalities (VI). The main idea of this algorithm is to…

Optimization and Control · Mathematics 2014-03-18 Yunmei Chen , Guanghui Lan , Yuyuan Ouyang

In the paper, we develop a composite version of Mirror Prox algorithm for solving convex-concave saddle point problems and monotone variational inequalities of special structure, allowing to cover saddle point/variational analogies of what…

Optimization and Control · Mathematics 2014-05-23 Niao He , Anatoli Juditsky , Arkadi Nemirovski

Some adaptive analogue of the Mirror Prox method for variational inequalities is proposed. In this work we consider the adaptation not only to the value of the Lipschitz constant, but also to the magnitude of the oracle error. This…

Optimization and Control · Mathematics 2020-03-27 Fedor Stonyakin , Evgeniya Vorontsova , Mohammad Alkousa

The article is devoted to the development of numerical methods for solving variational inequalities with relatively strongly monotone operators. We consider two classes of variational inequalities related to some analogs of the Lipschitz…

Optimization and Control · Mathematics 2022-05-25 F. S. Stonyakin , A. A. Titov , D. V. Makarenko , M. S. Alkousa

The article is devoted to the development of numerical methods for solving saddle point problems and variational inequalities with simplified requirements for the smoothness conditions of functionals. Recently there were proposed some…

Optimization and Control · Mathematics 2023-11-22 Alexander Titov , Fedor Stonyakin , Mohammad Alkousa , Alexander Gasnikov

Nonconvex-nonconcave saddle-point optimization in machine learning has triggered lots of research for studying non-monotone variational inequalities (VI). In this work, we introduce two mirror frameworks, called mirror extragradient method…

Optimization and Control · Mathematics 2023-01-02 Hui Zhang , Yu-Hong Dai

Motivated by multi-user optimization problems and non-cooperative Nash games in uncertain regimes, we consider stochastic Cartesian variational inequalities (SCVI) where the set is given as the Cartesian product of a collection of component…

Optimization and Control · Mathematics 2018-01-16 Farzad Yousefian , Angelia Nedich , Uday V. Shanbhag

This paper introduces a general framework for iterative optimization algorithms and establishes under general assumptions that their convergence is asymptotically geometric. We also prove that under appropriate assumptions, the rate of…

Machine Learning · Statistics 2023-02-27 Randal Douc , Sylvain Le Corff

We provide improved convergence rates for constrained convex-concave min-max problems and monotone variational inequalities with higher-order smoothness. In min-max settings where the $p^{th}$-order derivatives are Lipschitz continuous, we…

Optimization and Control · Mathematics 2020-07-10 Brian Bullins , Kevin A. Lai

Low-rank and nonsmooth matrix optimization problems capture many fundamental tasks in statistics and machine learning. While significant progress has been made in recent years in developing efficient methods for \textit{smooth} low-rank…

Optimization and Control · Mathematics 2025-04-10 Dan Garber , Atara Kaplan
‹ Prev 1 2 3 10 Next ›