English
Related papers

Related papers: Extragradient Sliding for Composite Non-Monotone V…

200 papers

The main contributions of this paper are the proposition and the convergence analysis of a class of inertial projection-type algorithm for solving variational inequality problems in real Hilbert spaces where the underline operator is…

Optimization and Control · Mathematics 2021-01-25 Yekini Shehu , Olaniyi. S. Iyiola , Xiao-Huan Li , Qiao-Li Dong

Variational inequalities have recently attracted considerable interest in machine learning as a flexible paradigm for models that go beyond ordinary loss function minimization (such as generative adversarial networks and related deep…

Optimization and Control · Mathematics 2020-02-12 Yu-Guan Hsieh , Franck Iutzeler , Jérôme Malick , Panayotis Mertikopoulos

Variational inequalities are a universal optimization paradigm that incorporate classical minimization and saddle point problems. Nowadays more and more tasks require to consider stochastic formulations of optimization problems. In this…

Optimization and Control · Mathematics 2024-09-17 Alexander Pichugin , Maksim Pechin , Aleksandr Beznosikov , Vasilii Novitskii , Alexander Gasnikov

We introduce an inexact oracle model for variational inequalities (VI) with monotone operator, propose a numerical method which solves such VI's and analyze its convergence rate. As a particular case, we consider VI's with…

Optimization and Control · Mathematics 2022-02-18 Fedor Stonyakin , Alexander Gasnikov , Pavel Dvurechensky , Mohammad Alkousa , Alexander Titov

This paper introduces a subgradient extragradient algorithm with a conjugate gradient-type direction to solve pseudomonotone variational inequality problems in Hilbert spaces. The algorithm features a self-adaptive strategy that eliminates…

Optimization and Control · Mathematics 2025-05-07 Ibrahim Arzuka , Parin Chaipunya , Poom Kumam

We consider in this paper a class of composite optimization problems whose objective function is given by the summation of a general smooth and nonsmooth component, together with a relatively simple nonsmooth term. We present a new class of…

Optimization and Control · Mathematics 2015-10-27 Guanghui Lan

The monotone variational inequality is a central problem in mathematical programming that unifies and generalizes many important settings such as smooth convex optimization, two-player zero-sum games, convex-concave saddle point problems,…

Optimization and Control · Mathematics 2022-05-17 Yang Cai , Argyris Oikonomou , Weiqiang Zheng

The optimization problems associated with training generative adversarial neural networks can be largely reduced to certain {\em non-monotone} variational inequality problems (VIPs), whereas existing convergence results are mostly based on…

Optimization and Control · Mathematics 2021-03-09 Chaobing Song , Zhengyuan Zhou , Yichao Zhou , Yong Jiang , Yi Ma

We introduce and study the convergence properties of a projection-type algorithm for solving the variational inequality problem for point-to-set operators. No monotoni\-city assumption is used in our analysis. The operator defining the…

Optimization and Control · Mathematics 2017-11-29 Regina S. Burachik , R. Díaz Millán

While Variational Inequality (VI) is a well-established mathematical framework that subsumes Nash equilibrium and saddle-point problems, less is known about its extension, Quasi-Variational Inequalities (QVI). QVI allows for cases where the…

Optimization and Control · Mathematics 2025-11-25 Zeinab Alizadeh , Afrooz Jalilzadeh

Some adaptive analogue of the Mirror Prox method for variational inequalities is proposed. In this work we consider the adaptation not only to the value of the Lipschitz constant, but also to the magnitude of the oracle error. This…

Optimization and Control · Mathematics 2020-03-27 Fedor Stonyakin , Evgeniya Vorontsova , Mohammad Alkousa

In this paper, we develop a sliding method for the fractional Laplacian. We first obtain the key ingredients needed in the sliding method either in a bounded domain or in the whole space, such as narrow region principles and maximum…

Analysis of PDEs · Mathematics 2019-12-03 Leyun Wu , Wenxiong Chen

We study structured convex optimization problems, with additive objective $r:=p + q$, where $r$ is ($\mu$-strongly) convex, $q$ is $L_q$-smooth and convex, and $p$ is $L_p$-smooth, possibly nonconvex. For such a class of problems, we…

Optimization and Control · Mathematics 2022-05-31 Dmitry Kovalev , Aleksandr Beznosikov , Ekaterina Borodich , Alexander Gasnikov , Gesualdo Scutari

In this paper we propose a variant of the random coordinate descent method for solving linearly constrained convex optimization problems with composite objective functions. If the smooth part of the objective function has Lipschitz…

Optimization and Control · Mathematics 2013-02-14 Ion Necoara , Andrei Patrascu

Nonconvex-nonconcave saddle-point optimization in machine learning has triggered lots of research for studying non-monotone variational inequalities (VI). In this work, we introduce two mirror frameworks, called mirror extragradient method…

Optimization and Control · Mathematics 2023-01-02 Hui Zhang , Yu-Hong Dai

We investigate an inertial viscosity-type Tseng's extragradient algorithm with a new step size to solve pseudomonotone variational inequality problems in real Hilbert spaces. A strong convergence theorem of the algorithm is obtained without…

Optimization and Control · Mathematics 2020-07-24 Bing Tan , Xiaolong Qin

While monotone operator theory is often studied on Hilbert spaces, many interesting problems in machine learning and optimization arise naturally in finite-dimensional vector spaces endowed with non-Euclidean norms, such as…

Optimization and Control · Mathematics 2025-08-26 Alexander Davydov , Saber Jafarpour , Anton V. Proskurnikov , Francesco Bullo

In this article, we study the convergence of algorithms for solving monotone inclusions in the presence of adjoint mismatch. The adjoint mismatch arises when the adjoint of a linear operator is replaced by an approximation, due to…

Optimization and Control · Mathematics 2023-11-10 Emilie Chouzenoux , Jean-Christophe Pesquet , Fernando Roldán

The proximal extrapolated gradient method \cite{Malitsky18a} is an extension of the projected reflected gradient method \cite{Malitsky15}. Both methods were proposed for solving the classic variational inequalities. In this paper, we…

Optimization and Control · Mathematics 2019-08-19 Volkan Cevher , Bang Cong Vu

Variational inequalities are a universal optimization paradigm that is interesting in itself, but also incorporates classical minimization and saddle point problems. Modern realities encourage to consider stochastic formulations of…

Optimization and Control · Mathematics 2024-03-27 Alexander Pichugin , Maksim Pechin , Aleksandr Beznosikov , Alexander Gasnikov