English
Related papers

Related papers: Methods for Solving Variational Inequalities with …

200 papers

The paper concerns with novel first-order methods for monotone variational inequalities. They use a very simple linesearch procedure that takes into account a local information of the operator. Also the methods do not require…

Optimization and Control · Mathematics 2018-03-26 Yura Malitsky

In this paper, we study federated optimization for solving stochastic variational inequalities (VIs), a problem that has attracted growing attention in recent years. Despite substantial progress, a significant gap remains between existing…

Machine Learning · Computer Science 2026-02-11 Guanghui Wang , Satyen Kale

This paper considers variational inequalities (VI) defined by the conditional value-at-risk (CVaR) of uncertain functions and provides three stochastic approximation schemes to solve them. All methods use an empirical estimate of the CVaR…

Optimization and Control · Mathematics 2022-11-16 Jasper Verbree , Ashish Cherukuri

Stochastic approximation methods play a central role in maximum likelihood estimation problems involving intractable likelihood functions, such as marginal likelihoods arising in problems with missing or incomplete data, and in parametric…

Computation · Statistics 2020-06-02 Valentin De Bortoli , Alain Durmus , Marcelo Pereyra , Ana F. Vidal

We improve the understanding of the $\textit{golden ratio algorithm}$, which solves monotone variational inequalities (VI) and convex-concave min-max problems via the distinctive feature of adapting the step sizes to the local Lipschitz…

Optimization and Control · Mathematics 2022-12-29 Ahmet Alacaoglu , Axel Böhm , Yura Malitsky

This paper focuses on optimization problems constrained by Parametric Variational Inequalities (PVI) defined on a moving set. Unlike most existing works on mathematical programs with equilibrium constraints, the equilibrium constraints have…

Optimization and Control · Mathematics 2026-03-06 Xiaojun Chen , Jin Zhang , Yixuan Zhang

Recently, several powerful tools for the reconstruction of stochastic differential equations from measured data sets have been proposed [e.g. Siegert et al., Physics Letters A 243, 275 (1998); Hurn et al., Journal of Time Series Analysis…

Data Analysis, Statistics and Probability · Physics 2009-11-13 David Kleinhans , Rudolf Friedrich , Matthias Waechter , Joachim Peinke

We study a stochastic optimization problem in which the sampling distribution depends on the decision variable, and the available samples are generated through an iterate-dependent Markov chain. Such settings arise naturally in problems…

Optimization and Control · Mathematics 2026-05-18 Anik Kumar Paul , Shalabh Bhatnagar

In this paper, we introduce and study a class of resolvent dynamical systems to investigate some inertial proximal methods for solving mixed variational inequalities. These proposed methods along with their discretizations and derived rates…

Dynamical Systems · Mathematics 2024-06-28 Oday Hazaimah

Single-call stochastic extragradient methods, like stochastic past extragradient (SPEG) and stochastic optimistic gradient (SOG), have gained a lot of interest in recent years and are one of the most efficient algorithms for solving…

Optimization and Control · Mathematics 2023-11-14 Sayantan Choudhury , Eduard Gorbunov , Nicolas Loizou

We consider monotone variational inequality (VI) problems in multi-GPU settings where multiple processors/workers/clients have access to local stochastic dual vectors. This setting includes a broad range of important problems from…

Machine Learning · Computer Science 2023-08-21 Ali Ramezani-Kebrya , Kimon Antonakopoulos , Igor Krawczuk , Justin Deschenaux , Volkan Cevher

We propose a novel method, namely the accelerated mirror-prox (AMP) method, for computing the weak solutions of a class of deterministic and stochastic monotone variational inequalities (VI). The main idea of this algorithm is to…

Optimization and Control · Mathematics 2014-03-18 Yunmei Chen , Guanghui Lan , Yuyuan Ouyang

We study a variation of vanilla stochastic gradient descent where the optimizer only has access to a Markovian sampling scheme. These schemes encompass applications that range from decentralized optimization with a random walker (token…

Optimization and Control · Mathematics 2023-06-26 Mathieu Even

We aim to solve a structured convex optimization problem, where a nonsmooth function is composed with a linear operator. When opting for full splitting schemes, usually, primal-dual type methods are employed as they are effective and also…

Optimization and Control · Mathematics 2019-05-17 Radu Ioan Bot , Axel Böhm

We introduce the Multiscale Experience Replay (MER) algorithm for solving a class of stochastic variational inequalities (VIs) in settings where samples are generated from a Markov chain and we have access to a memory buffer to store them.…

Optimization and Control · Mathematics 2026-01-06 Milind Nakul , Tianjiao Li , Ashwin Pananjady

We study existence and uniqueness of a variational solution in terms of stochastic variational inequalities (SVI) to stochastic nonlinear diffusion equations with a highly singular diffusivity term and multiplicative Stratonovich…

Analysis of PDEs · Mathematics 2016-08-17 Ioana Ciotir , Jonas M. Tölle

Stochastic approximation is a class of algorithms that update a vector iteratively, incrementally, and stochastically, including, e.g., stochastic gradient descent and temporal difference learning. One fundamental challenge in analyzing a…

Machine Learning · Computer Science 2025-11-06 Shuze Daniel Liu , Shuhang Chen , Shangtong Zhang

In this paper, we consider the monotone generalized variational inequality (MGVI) where the monotone operator is Lipschitz continuous. Inspired by the extragradient method and the projection contraction algorithms for monotone variational…

Optimization and Control · Mathematics 2020-09-09 Yu You

This paper considers a variational inequality (VI) problem arising from a game among multiple agents, where each agent aims to minimize its own cost function subject to its constrained set represented as the intersection of a (possibly…

Optimization and Control · Mathematics 2024-09-13 Abhishek Chakraborty , Angelia Nedić

We consider a class of optimization problems with Cartesian variational inequality (CVI) constraints, where the objective function is convex and the CVI is associated with a monotone mapping and a convex Cartesian product set. This…

Optimization and Control · Mathematics 2021-02-16 Harshal D. Kaushik , Farzad Yousefian