English
Related papers

Related papers: Some Methods for Relatively Strongly Monotone Vari…

200 papers

In this paper, we propose a general algorithmic framework for first-order methods in optimization in a broad sense, including minimization problems, saddle-point problems, and variational inequalities. This framework allows obtaining many…

We examine the linear convergence rates of variants of the proximal point method for finding zeros of maximal monotone operators. We begin by showing how metric subregularity is sufficient for linear convergence to a zero of a maximal…

Optimization and Control · Mathematics 2009-02-25 D. Leventhal

We develop new adaptive algorithms for variational inequalities with monotone operators, which capture many problems of interest, notably convex optimization and convex-concave saddle point problems. Our algorithms automatically adapt to…

Machine Learning · Computer Science 2021-08-30 Alina Ene , Huy L. Nguyen

In this paper, we present a unified analysis of methods for such a wide class of problems as variational inequalities, which includes minimization problems and saddle point problems. We develop our analysis on the modified Extra-Gradient…

Optimization and Control · Mathematics 2023-04-18 Aleksandr Beznosikov , Alexander Gasnikov , Karina Zainulina , Alexander Maslovskiy , Dmitry Pasechnyuk

In this paper, we introduce and study a class of resolvent dynamical systems to investigate some inertial proximal methods for solving mixed variational inequalities. These proposed methods along with their discretizations and derived rates…

Dynamical Systems · Mathematics 2024-06-28 Oday Hazaimah

The (global) Lipschitz smoothness condition is crucial in establishing the convergence theory for most optimization methods. Unfortunately, most machine learning and signal processing problems are not Lipschitz smooth. This motivates us to…

Optimization and Control · Mathematics 2019-04-23 Qiuwei Li , Zhihui Zhu , Gongguo Tang , Michael B. Wakin

Monotone inclusions have a wide range of applications, including minimization, saddle-point, and equilibria problems. We introduce new stochastic algorithms, with or without variance reduction, to estimate a root of the expectation of…

Optimization and Control · Mathematics 2024-05-24 Abdurakhmon Sadiev , Laurent Condat , Peter Richtárik

This article analyses the simple projection method proposed by Izuchukwu et al. [8, Algorithm 3.2] for solving variational inequality problems by incorporating momentum terms. A new step size strategy is also introduced, in which the step…

Optimization and Control · Mathematics 2025-05-12 Gourav Kumar , Santanu Soe , V. Vetrivel

Recently, there were introduced important classes of relatively smooth, relatively continuous, and relatively strongly convex optimization problems. These concepts have significantly expanded the class of problems for which optimal…

Optimization and Control · Mathematics 2023-03-07 Oleg Savchuk , Fedor Stonyakin , Mohammad Alkousa , Rida Zabirova , Alexander Titov , Alexander Gasnikov

We consider the problem of minimization of a convex function on a simple set with convex non-smooth inequality constraint and describe first-order methods to solve such problems in different situations: smooth or non-smooth objective…

Optimization and Control · Mathematics 2018-01-30 Anastasia Bayandina , Pavel Dvurechensky , Alexander Gasnikov , Fedor Stonyakin , Alexander Titov

We consider perturbed nonlinear ill-posed equations in Hilbert spaces, with operators that are monotone on a given closed convex subset. A simple stable approach is Lavrentiev regularization, but existence of solutions of the regularized…

Numerical Analysis · Mathematics 2018-06-05 Robert Plato , Bernd Hofmann

The main contributions of this paper are the proposition and the convergence analysis of a class of inertial projection-type algorithm for solving variational inequality problems in real Hilbert spaces where the underline operator is…

Optimization and Control · Mathematics 2021-01-25 Yekini Shehu , Olaniyi. S. Iyiola , Xiao-Huan Li , Qiao-Li Dong

We propose in this paper a proximal and contraction method for solving a convex mixed variational inequality problem in a real Hilbert space. To accelerate the convergence of our proposed method, we incorporate an inertial extrapolation…

Optimization and Control · Mathematics 2025-11-25 Chidi Elijah Nwakpa , Austine Efut Ofem , Kalu Okam Okorie , Chinedu Izuchukwu , Chibueze Christian Okeke

The paper proposes and justifies a new algorithm of the proximal Newton type to solve a broad class of nonsmooth composite convex optimization problems without strong convexity assumptions. Based on advanced notions and techniques of…

Optimization and Control · Mathematics 2022-03-02 Boris S. Mordukhovich , Xiaoming Yuan , Shangzhi Zeng , Jin Zhang

This paper examines a variety of classical optimization problems, including well-known minimization tasks and more general variational inequalities. We consider a stochastic formulation of these problems, and unlike most previous work, we…

Optimization and Control · Mathematics 2025-11-11 Vladimir Solodkin , Andrew Veprikov , Aleksandr Beznosikov

The paper is devoted to a special Mirror Descent algorithm for problems of convex minimization with functional constraints. The objective function may not satisfy the Lipschitz condition, but it must necessarily have the Lipshitz-continuous…

Optimization and Control · Mathematics 2018-04-17 Fedor S. Stonyakin , Alexander A. Titov

In this paper, we discuss variational inequality (VI) problems without monotonicity from the perspective of convergence of projection-type algorithms. In particular, we identify existing conditions as well as present new conditions that are…

Optimization and Control · Mathematics 2023-04-11 Kevin Huang , Shuzhong Zhang

We propose an inertial variant of the strongly convergent inexact proximal-point (PP) method of Solodov and Svaiter (2000) for monotone inclusions. We prove strong convergence of our main algorithm under less restrictive assumptions on the…

Optimization and Control · Mathematics 2025-09-24 M. Marques Alves , J. E. Navarro Caballero , M. Geremia , R. T. Marcavillaca

We consider hierarchical variational inequality problems, or more generally, variational inequalities defined over the set of zeros of a monotone operator. This framework includes convex optimization over equilibrium constraints and…

Optimization and Control · Mathematics 2026-01-07 Daniel Cortild , Meggie Marschner , Mathias Staudigl

Block coordinate methods have been extensively studied for minimization problems, where they come with significant complexity improvements whenever the considered problems are compatible with block decomposition and, moreover, block…

Optimization and Control · Mathematics 2025-01-31 Jelena Diakonikolas