English
Related papers

Related papers: Variance-reduction for Variational Inequality Prob…

200 papers

In this paper, we address variational inequalities (VI) with a finite sum structure by proposing a novel single-loop variance-reduced algorithm that incorporates the Bregman distance. Under the monotone setting, we establish the almost sure…

Optimization and Control · Mathematics 2025-11-21 Wang Zhong-bao , Zhang Zhong-cheng

The main purpose of this paper is to propose a variance-based Bregman extragradient algorithm with line search for solving stochastic variational inequalities, which is robust with respect an unknown Lipschitz constant. We prove the almost…

Optimization and Control · Mathematics 2022-08-31 Xian-Jun Long , Yue-Hong He , Nan-Jing Huang

Variational inequalities are a universal optimization paradigm that incorporate classical minimization and saddle point problems. Nowadays more and more tasks require to consider stochastic formulations of optimization problems. In this…

Optimization and Control · Mathematics 2024-09-17 Alexander Pichugin , Maksim Pechin , Aleksandr Beznosikov , Vasilii Novitskii , Alexander Gasnikov

We develop a novel stochastic primal dual splitting method with Bregman distances for solving a structured composite problems involving infimal convolutions in non-Euclidean spaces. The sublinear convergence in expectation of the…

Optimization and Control · Mathematics 2021-03-17 Nguyen Van Dung , Băng Công Vũ

We are concerned with optimization in a broad sense through the lens of solving variational inequalities (VIs) -- a class of problems that are so general that they cover as particular cases minimization of functions, saddle-point (minimax)…

Optimization and Control · Mathematics 2026-02-17 Pavel Dvurechensky , Andrea Ebner , Johannes Carl Schnebel , Shimrit Shtern , Mathias Staudigl

We propose stochastic variance reduced algorithms for solving convex-concave saddle point problems, monotone variational inequalities, and monotone inclusions. Our framework applies to extragradient, forward-backward-forward, and…

Optimization and Control · Mathematics 2022-06-14 Ahmet Alacaoglu , Yura Malitsky

In this paper, we develop stochastic variance reduced algorithms for solving a class of finite-sum hemivariational inequality (HVI) problem. In this HVI problem, the associated function is assumed to be differentiable, and both the vector…

Optimization and Control · Mathematics 2025-09-12 Kevin Huang , Nuozhou Wang , Shuzhong Zhang

Motivated by multi-user optimization problems and non-cooperative Nash games in stochastic regimes, we consider stochastic variational inequality (SVI) problems on matrix spaces where the variables are positive semidefinite matrices and the…

Optimization and Control · Mathematics 2018-09-26 Nahidsadat Majlesinasab , Farzad Yousefian , Mohammad Javad Feizollahi

In this paper, we discuss variational inequality (VI) problems without monotonicity from the perspective of convergence of projection-type algorithms. In particular, we identify existing conditions as well as present new conditions that are…

Optimization and Control · Mathematics 2023-04-11 Kevin Huang , Shuzhong Zhang

This paper introduces a family of stochastic extragradient-type algorithms for a class of nonconvex-nonconcave problems characterized by the weak Minty variational inequality (MVI). Unlike existing results on extragradient methods in the…

Optimization and Control · Mathematics 2023-02-20 Thomas Pethick , Olivier Fercoq , Puya Latafat , Panagiotis Patrinos , Volkan Cevher

In this paper, we develop a splitting algorithm incorporating Bregman distances to solve a broad class of linearly constrained composite optimization problems, whose objective function is the separable sum of possibly nonconvex nonsmooth…

Optimization and Control · Mathematics 2024-10-01 Tan Nhat Pham , Minh N. Dao , Andrew Eberhard , Nargiz Sultanova

We propose a novel stochastic distributed method for both monotone and strongly monotone variational inequalities with Lipschitz operator and proper convex regularizers arising in various applications from game theory to adversarial…

Optimization and Control · Mathematics 2024-10-07 Aleksandr Beznosikov , Darina Dvinskikh , Dmitry Bylinkin , Andrei Semenov , Alexander Gasnikov

We study monotone variational inequalities that can arise as optimality conditions for constrained convex optimisation or convex-concave minimax problems and propose a novel algorithm that uses only one gradient/operator evaluation and one…

Optimization and Control · Mathematics 2023-07-24 Michael Sedlmayer , Dang-Khoa Nguyen , Radu Ioan Bot

In this work, we propose a novel Bregman ADMM with nonlinear dual update to solve the Bethe variational problem (BVP), a key optimization formulation in graphical models and statistical physics. Our algorithm provides rigorous convergence…

Optimization and Control · Mathematics 2025-11-19 Yuehaw Khoo , Tianyun Tang , Kim-Chuan Toh

Variational inequalities are a universal optimization paradigm that is interesting in itself, but also incorporates classical minimization and saddle point problems. Modern realities encourage to consider stochastic formulations of…

Optimization and Control · Mathematics 2024-03-27 Alexander Pichugin , Maksim Pechin , Aleksandr Beznosikov , Alexander Gasnikov

In this paper, we present a novel stochastic method for solving variational inequalities (VI) in the context of Markovian noise. By leveraging Extragradient technique, we can productively solve VI optimization problems characterized by…

Optimization and Control · Mathematics 2026-05-18 Vladimir Solodkin , Michael Ermoshin , Roman Gavrilenko , Aleksandr Beznosikov

In this paper, we propose a variance-reduced primal-dual algorithm with Bregman distance for solving convex-concave saddle-point problems with finite-sum structure and nonbilinear coupling function. This type of problems typically arises in…

Optimization and Control · Mathematics 2021-06-02 Erfan Yazdandoost Hamedani , Afrooz Jalilzadeh

The constrained gradient method (CGM) has recently been proposed to solve convex optimization and monotone variational inequality (VI) problems with general functional constraints. While existing literature has established convergence…

Optimization and Control · Mathematics 2025-11-24 Danqing Zhou , Hongmei Chen , Shiqian Ma , Junfeng Yang

Minimizing finite sums of functions is a central problem in optimization, arising in numerous practical applications. Such problems are commonly addressed using first-order optimization methods. However, these procedures cannot be used in…

Optimization and Control · Mathematics 2025-07-01 Marco Rando , Cheik Traoré , Cesare Molinari , Lorenzo Rosasco , Silvia Villa

We propose a forward-backward splitting algorithm based on Bregman distances for composite minimization problems in general reflexive Banach spaces. The convergence is established using the notion of variable quasi-Bregman monotone…

Optimization and Control · Mathematics 2016-10-10 Quang Van Nguyen
‹ Prev 1 2 3 10 Next ›