English
Related papers

Related papers: Variance-reduction for Variational Inequality Prob…

200 papers

The Bregman proximal gradient method (BPGM), which uses the Bregman distance as a proximity measure in the iterative scheme, has recently been re-developed for minimizing convex composite problems without the global Lipschitz gradient…

Optimization and Control · Mathematics 2025-04-16 Lei Yang , Kim-Chuan Toh

We introduce a new system of split variational inequality problems which is a natural extension of split variational inequality problem in semi-inner product spaces. We use the retraction technique to propose an iterative algorithm for…

Functional Analysis · Mathematics 2017-01-20 K. R. Kazmi , Mohd Furkan

We introduce a notion of variable quasi-Bregman monotone sequence which unifies the notion of variable metric quasi-Fej\'er monotone sequences and that of Bregman monotone sequences. The results are applied to analyze the asymptotic…

Optimization and Control · Mathematics 2015-05-19 Quang Van Nguyen

Variational inequalities are a broad formalism that encompasses a vast number of applications. Motivated by applications in machine learning and beyond, stochastic methods are of great importance. In this paper we consider the problem of…

Optimization and Control · Mathematics 2023-09-26 Aleksandr Beznosikov , Alexander Gasnikov

In this paper, we study the local linear convergence behavior of proximal-gradient (PG) descent algorithm on a parameterized gap-function reformulation of a smooth but non-monotone variational inequality problem (VIP). The aim is to solve…

Optimization and Control · Mathematics 2025-10-15 Lei Zhao , Daoli Zhu , Shuzhong Zhang

We propose a novel method, namely the accelerated mirror-prox (AMP) method, for computing the weak solutions of a class of deterministic and stochastic monotone variational inequalities (VI). The main idea of this algorithm is to…

Optimization and Control · Mathematics 2014-03-18 Yunmei Chen , Guanghui Lan , Yuyuan Ouyang

The Bregman divergence (Bregman distance, Bregman measure of distance) is a certain useful substitute for a distance, obtained from a well-chosen function (the "Bregman function"). Bregman functions and divergences have been extensively…

Optimization and Control · Mathematics 2019-04-10 Daniel Reem , Simeon Reich , Alvaro De Pierro

Variational inequality problems are recognized for their broad applications across various fields including machine learning and operations research. First-order methods have emerged as the standard approach for solving these problems due…

Optimization and Control · Mathematics 2025-03-24 Liang Zhang , Niao He , Michael Muehlebach

A common goal in observational research is to estimate marginal causal effects in the presence of confounding variables. One solution to this problem is to use the covariate distribution to weight the outcomes such that the data appear…

Methodology · Statistics 2020-08-18 Kevin P. Josey , Elizabeth Juarez-Colunga , Fan Yang , Debashis Ghosh

In this paper we propose new algorithms for solving a class of structured monotone variational inequality (VI) problems over compact feasible sets. By identifying the gradient components existing in the operator of VI, we show that it is…

Optimization and Control · Mathematics 2021-11-02 Guanghui Lan , Yuyuan Ouyang

We propose an extragradient method with stepsizes bounded away from zero for stochastic variational inequalities requiring only pseudo-monotonicity. We provide convergence and complexity analysis, allowing for an unbounded feasible set,…

Optimization and Control · Mathematics 2017-03-02 Alfredo Iusem , Alejandro Jofré , Roberto I. Oliveira , Philip Thompson

In this paper, we focus on deriving some sufficient conditions for the existence of solutions to non-monotone Variational Inequalities (VIs) based on inverse mapping theory. We have obtained several widely applicable sufficient conditions…

Optimization and Control · Mathematics 2024-09-17 Sina Arefizadeh , Angelia Nedich

For many applications in signal processing and machine learning, we are tasked with minimizing a large sum of convex functions subject to a large number of convex constraints. In this paper, we devise a new random projection method (RPM) to…

Optimization and Control · Mathematics 2024-04-08 Zhichun Yang , Fu-quan Xia , Kai Tu , Man-Chung Yue

This paper explores the non-convex composition optimization in the form including inner and outer finite-sum functions with a large number of component functions. This problem arises in some important applications such as nonlinear…

Machine Learning · Statistics 2017-11-15 Liu Liu , Ji Liu , Dacheng Tao

In this paper, we propose two new solution schemes to solve the stochastic strongly monotone variational inequality problems: the stochastic extra-point solution scheme and the stochastic extra-momentum solution scheme. The first one is a…

Optimization and Control · Mathematics 2021-07-20 Kevin Huang , Shuzhong Zhang

Large-scale nonconvex and nonsmooth problems have attracted considerable attention in the fields of compress sensing, big data optimization and machine learning. Exploring effective methods is still the main challenge of today's research.…

Optimization and Control · Mathematics 2019-05-28 Lei Zhao , Daoli Zhu

The focus of this paper is on stochastic variational inequalities (VI) under Markovian noise. A prominent application of our algorithmic developments is the stochastic policy evaluation problem in reinforcement learning. Prior…

Optimization and Control · Mathematics 2021-08-17 Georgios Kotsalis , Guanghui Lan , Tianjiao Li

In recent years, by using Bregman distance, the Lipschitz gradient continuity and strong convexity were lifted and replaced by relative smoothness and relative strong convexity. Under the mild assumptions, it was proved that gradient…

Optimization and Control · Mathematics 2022-06-22 Jian Chen , Liping Tang , Xinmin Yang

The article is devoted to the development of numerical methods for solving variational inequalities with relatively strongly monotone operators. We consider two classes of variational inequalities related to some analogs of the Lipschitz…

Optimization and Control · Mathematics 2022-05-25 F. S. Stonyakin , A. A. Titov , D. V. Makarenko , M. S. Alkousa

This paper is focused on a stochastic quasi-variational inequality (SQVI) problem with a continuous and strongly-monotone mapping over a closed and convex set where the projection onto the constraint set may not be easy to compute. We…

Optimization and Control · Mathematics 2022-09-02 Zeinab Alizadeh , Brianna M. Otero , Afrooz Jalilzadeh