English
Related papers

Related papers: Methods for Solving Variational Inequalities with …

200 papers

We consider the problem of fitting variational posterior approximations using stochastic optimization methods. The performance of these approximations depends on (1) how well the variational family matches the true posterior…

Variational inequalities are a universal optimization paradigm that incorporate classical minimization and saddle point problems. Nowadays more and more tasks require to consider stochastic formulations of optimization problems. In this…

Optimization and Control · Mathematics 2024-09-17 Alexander Pichugin , Maksim Pechin , Aleksandr Beznosikov , Vasilii Novitskii , Alexander Gasnikov

The monotone Variational Inequality (VI) is a general model with important applications in various engineering and scientific domains. In numerous instances, the VI problems are accompanied by function constraints that can be data-driven,…

Optimization and Control · Mathematics 2024-05-27 Digvijay Boob , Qi Deng , Mohammad Khalafi

Statistical inference methods are fundamentally important in machine learning. Most state-of-the-art inference algorithms are variants of Markov chain Monte Carlo (MCMC) or variational inference (VI). However, both methods struggle with…

Machine Learning · Computer Science 2019-10-17 Yichuan Zhang , José Miguel Hernández-Lobato

Variational inequalities are a universal optimization paradigm that is interesting in itself, but also incorporates classical minimization and saddle point problems. Modern realities encourage to consider stochastic formulations of…

Optimization and Control · Mathematics 2024-03-27 Alexander Pichugin , Maksim Pechin , Aleksandr Beznosikov , Alexander Gasnikov

In this paper, we study a class of generalized monotone variational inequality (GMVI) problems whose operators are not necessarily monotone (e.g., pseudo-monotone). We present non-Euclidean extragradient (N-EG) methods for computing…

Optimization and Control · Mathematics 2013-11-13 Cong D. Dang , Guanghui Lan

We consider a stochastic Inverse Variational Inequality (IVI) problem defined by a continuous and co-coercive map over a closed and convex set. Motivated by the absence of performance guarantees for stochastic IVI, we present a…

Optimization and Control · Mathematics 2023-12-08 Zeinab Alizadeh , Felipe Parra Polanco , Afrooz Jalilzadeh

Recently, lower-level constrained bilevel optimization has attracted increasing attention. However, existing methods mostly focus on either deterministic cases or problems with linear constraints. The main challenge in stochastic cases with…

Optimization and Control · Mathematics 2025-10-13 Hantao Nie , Jiaxiang Li , Zaiwen Wen

We consider minimizing a sum of agent-specific nondifferentiable merely convex functions over the solution set of a variational inequality (VI) problem in that each agent is associated with a local monotone mapping. This problem finds an…

Optimization and Control · Mathematics 2022-12-13 Harshal D. Kaushik , Sepideh Samadi , Farzad Yousefian

The subgradient extragradient method for solving the variational inequality (VI) problem, which is introduced by Censor et al. \cite{CGR}, replaces the second projection onto the feasible set of the VI, in the extragradient method, with a…

Optimization and Control · Mathematics 2018-01-03 Qiao-Li Dong , Dan Jiang , Aviv Gibali

Cyclic block coordinate methods are a fundamental class of optimization methods widely used in practice and implemented as part of standard software packages for statistical learning. Nevertheless, their convergence is generally not well…

Optimization and Control · Mathematics 2023-06-09 Chaobing Song , Jelena Diakonikolas

Nonconvex-nonconcave saddle-point optimization in machine learning has triggered lots of research for studying non-monotone variational inequalities (VI). In this work, we introduce two mirror frameworks, called mirror extragradient method…

Optimization and Control · Mathematics 2023-01-02 Hui Zhang , Yu-Hong Dai

This work proposes a general framework for capturing noise-driven transitions in spatially extended non-equilibrium systems and explains the emergence of coherent patterns beyond the instability onset. The framework relies on stochastic…

Dynamical Systems · Mathematics 2024-12-16 Mickaël D. Chekroun , Honghu Liu , James C. McWilliams

This paper considers stochastic-constrained stochastic optimization where the stochastic constraint is to satisfy that the expectation of a random function is below a certain threshold. In particular, we study the setting where data samples…

Optimization and Control · Mathematics 2026-01-27 Yeongjong Kim , Dabeen Lee

We analyze algorithms for solving stochastic variational inequalities (VI) without the bounded variance or bounded domain assumptions, where our main focus is min-max optimization with possibly unbounded constraint sets. We focus on two…

Optimization and Control · Mathematics 2026-02-06 Ahmet Alacaoglu , Jun-Hyun Kim

In this paper, we propose a general extra-gradient scheme for solving monotone variational inequalities (VI), referred to here as Approximation-based Regularized Extra-gradient method (ARE). The first step of ARE solves a VI subproblem with…

Optimization and Control · Mathematics 2022-10-11 Kevin Huang , Shuzhong Zhang

Equivalence of convex optimization, saddle-point problems, and variational inequalities is a well-established concept. The variational inequality (VI) is a static problem which is studied under dynamical settings using a framework called…

Optimization and Control · Mathematics 2019-05-14 P. A. Bansode , V. Chinde , S. R. Wagh , R. Pasumarthy , N. M. Singh

In this paper, we propose a stochastic method for solving equality constrained optimization problems that utilizes predictive variance reduction. Specifically, we develop a method based on the sequential quadratic programming paradigm that…

Optimization and Control · Mathematics 2023-03-28 Albert S. Berahas , Jiahao Shi , Zihong Yi , Baoyu Zhou

In this paper we consider a non-monotone (mixed) variational inequality model with (nonlinear) convex conic constraints. Through developing an equivalent Lagrangian function-like primal-dual saddle-point system for the VI model in question,…

Optimization and Control · Mathematics 2023-06-05 Lei Zhao , Daoli Zhu , Shuzhong Zhang

In this paper we discuss backward stochastic differential equations with Markov chain noise, having continuous drivers. We obtain the existence of a solution which is possibly not unique. Moreover, we show there is a minimal solution for…

Probability · Mathematics 2014-12-01 Dimbinirina Ramarimbahoaka , Zhe Yang , Robert J. Elliott