English
Related papers

Related papers: Popov Mirror-Prox for solving Variational Inequali…

200 papers

This paper is concerned with convergence analysis for the mirror descent (MD) method, a well-known algorithm in convex optimization. An analysis framework via integral quadratic constraints (IQCs) is constructed to analyze the convergence…

Optimization and Control · Mathematics 2022-09-12 Mengmou Li , Khaled Laib , Ioannis Lestas

A parallel splitting method is proposed for solving systems of coupled monotone inclusions in Hilbert spaces. Convergence is established for a wide class of coupling schemes. Unlike classical alternating algorithms, which are limited to two…

Optimization and Control · Mathematics 2009-02-26 H. Attouch , L. M. Briceno-Arias , P. L. Combettes

In this paper, we study a class of misspecified variational inequalities (VIs) where both the monotone operator and nonlinear convex constraints depend on an unknown parameter learned via a secondary VI. Existing data-driven VI methods…

Optimization and Control · Mathematics 2026-03-18 Novel Kumar Dey , Mohammad Mahdi Ahmadi , Erfan Yazdandoost Hamedani , Afrooz Jalilzadeh

Reinforcement Learning from Human Feedback (RLHF) has been highly successful in aligning large language models with human preferences. While prevalent methods like DPO have demonstrated strong performance, they frame interactions with the…

Machine Learning · Computer Science 2025-05-27 Yongtao Wu , Luca Viano , Yihang Chen , Zhenyu Zhu , Kimon Antonakopoulos , Quanquan Gu , Volkan Cevher

It is well known that the projection method is not convergent for monotone equilibrium problems. Recently Sosa \textit{et al.} in \cite{SS2011} proposed a projection algorithm ensuring convergence for paramonotone equilibrium problems. In…

Optimization and Control · Mathematics 2018-04-30 Le Dung Muu , Phung Minh Duc , Xuan Thanh Le

In this paper, we consider two variants of the concept of sharp minimum for mathematical programming problems with quasiconvex objective function and inequality constraints. It investigated the problem of describing a variant of a simple…

Optimization and Control · Mathematics 2023-12-29 S. M. Puchinin , E. R. Korolkov , F. S. Stonyakin , M. S. Alkousa , A. A Vyguzov

The forward-backward splitting algorithm is a popular operator-splitting method for solving monotone inclusion of the sum of a maximal monotone operator and a cocoercive operator. In this paper, we present a new convergence analysis of a…

Functional Analysis · Mathematics 2019-08-30 Fuying Cui , Yuchao Tang , Chuanxi Zhu

This paper introduces a family of stochastic extragradient-type algorithms for a class of nonconvex-nonconcave problems characterized by the weak Minty variational inequality (MVI). Unlike existing results on extragradient methods in the…

Optimization and Control · Mathematics 2023-02-20 Thomas Pethick , Olivier Fercoq , Puya Latafat , Panagiotis Patrinos , Volkan Cevher

This study explores an inertial-based contraction-type approach for addressing monotone variational inclusion problems (in short, MVIP) within real Hilbert spaces. Most contraction-type techniques assume Lipschitz continuity and…

Optimization and Control · Mathematics 2026-04-09 Feeroz Babu , Syed Shakaib Irfan , Jen-Chih Yao , Xiaopeng Zhao

We describe inexact proximal Newton-like methods for solving degenerate regularized optimization problems and for the broader problem of finding a zero of a generalized equation that is the sum of a continuous map and a maximal monotone…

Optimization and Control · Mathematics 2026-02-12 Ching-pei Lee , Stephen J. Wright

In this paper, we derive a Fast Reflected Forward-Backward (Fast RFB) algorithm to solve the problem of finding a zero of the sum of a maximally monotone operator and a monotone and Lipschitz continuous operator in a real Hilbert space. Our…

Optimization and Control · Mathematics 2025-10-20 Radu Ioan Bot , Dang-Khoa Nguyen , Chunxiang Zong

This paper considers convex programs with a general (possibly non-differentiable) convex objective function and Lipschitz continuous convex inequality constraint functions. A simple algorithm is developed and achieves an $O(1/t)$…

Optimization and Control · Mathematics 2017-08-01 Hao Yu , Michael J. Neely

We consider a stochastic variational inequality (SVI) problem with a continuous and monotone mapping over a closed and convex set. In strongly monotone regimes, we present a variable sample-size averaging scheme (VS-Ave) that achieves a…

Optimization and Control · Mathematics 2019-10-01 Afrooz Jalilzadeh , Uday V. Shanbhag

We focus on the linear convergence of generalized proximal point algorithms for solving monotone inclusion problems. Under the assumption that the associated monotone operator is metrically subregular or that the inverse of the monotone…

Optimization and Control · Mathematics 2022-03-29 Hui Ouyang

In this paper we provide a convergence analysis of some variational methods alternative to the classical Tikhonov regularization, namely Ivanov regularization (also called method of quasi solutions) with some versions of the discrepancy…

Numerical Analysis · Mathematics 2018-04-18 Barbara Kaltenbacher , Andrej Klassen

We analyze the convergence rate of the monotone accelerated proximal gradient method, which can be used to solve structured convex composite optimization problems. A linear convergence rate is established when the smooth part of the…

Optimization and Control · Mathematics 2026-03-16 Zepeng Wang , Juan Peypouquet

In this paper, we consider a broad class of nonconvex and nonsmooth optimization problems, where one objective component is a nonsmooth weakly convex function composed with a linear operator. By integrating variable smoothing techniques…

Optimization and Control · Mathematics 2025-11-03 Xian-Jun Long , Kang Zeng , Gao-Xi Li , Minh N. Dao , Zai-Yun Peng

The paper concerns with novel first-order methods for monotone variational inequalities. They use a very simple linesearch procedure that takes into account a local information of the operator. Also the methods do not require…

Optimization and Control · Mathematics 2018-03-26 Yura Malitsky

To estimate the conditional probability functions based on the direct problem setting, V-matrix based method was proposed. We construct V-matrix based constrained quadratic programming problems for which the inequality constraints are…

Machine Learning · Statistics 2018-09-07 Niharika Gauraha , Akshay Chaturvedi

We develop new adaptive algorithms for variational inequalities with monotone operators, which capture many problems of interest, notably convex optimization and convex-concave saddle point problems. Our algorithms automatically adapt to…

Machine Learning · Computer Science 2021-08-30 Alina Ene , Huy L. Nguyen