English
Related papers

Related papers: Algorithms for solving variational inequalities an…

200 papers

Using convex combination and linesearch techniques, we introduce a novel primal-dual algorithm for solving structured convex-concave saddle point problems with a generic smooth nonbilinear coupling term. Our adaptive linesearch strategy…

Optimization and Control · Mathematics 2024-01-17 Xiaokai Chang , Junfeng Yang , Hongchao Zhang

In this paper we propose a general algorithmic framework for first-order methods in optimization in a broad sense, including minimization problems, saddle-point problems and variational inequalities. This framework allows to obtain many…

The first order condition of the constrained minimization problem leads to a saddle point problem. A multigrid method using a multiplicative Schwarz smoother for saddle point problems can thus be interpreted as a successive subspace…

Numerical Analysis · Mathematics 2016-01-19 Long Chen

This is a continuation of our previous work entitled \enquote{Alternating Proximity Mapping Method for Convex-Concave Saddle-Point Problems}, in which we proposed the alternating proximal mapping method and showed convergence results on the…

Optimization and Control · Mathematics 2023-11-01 Hui Ouyang

We consider the problem of minimization of a convex function on a simple set with convex non-smooth inequality constraint and describe first-order methods to solve such problems in different situations: smooth or non-smooth objective…

Optimization and Control · Mathematics 2018-01-30 Anastasia Bayandina , Pavel Dvurechensky , Alexander Gasnikov , Fedor Stonyakin , Alexander Titov

In this paper we propose a variant of the random coordinate descent method for solving linearly constrained convex optimization problems with composite objective functions. If the smooth part of the objective function has Lipschitz…

Optimization and Control · Mathematics 2013-02-14 Ion Necoara , Andrei Patrascu

Inspired by the Optimistic Gradient Ascent-Proximal Point Algorithm (OGAProx) proposed by Bo{\c{t}}, Csetnek, and Sedlmayer for solving a saddle-point problem associated with a convex-concave function with a nonsmooth coupling function and…

Optimization and Control · Mathematics 2023-11-01 Hui Ouyang

In this paper, we propose some accelerated methods for solving optimization problems under the condition of relatively smooth and relatively Lipschitz continuous functions with an inexact oracle. We consider the problem of minimizing the…

Optimization and Control · Mathematics 2024-11-27 O. S. Savchuk , M. S. Alkousa , A. S. Shushko , A. A. Vyguzov , F. S. Stonyakin , D. A. Pasechnyuk , A. V. Gasnikov

Some adaptive analogue of the Mirror Prox method for variational inequalities is proposed. In this work we consider the adaptation not only to the value of the Lipschitz constant, but also to the magnitude of the oracle error. This…

Optimization and Control · Mathematics 2020-03-27 Fedor Stonyakin , Evgeniya Vorontsova , Mohammad Alkousa

We give in this paper a convergence result concerning parallel asynchronous algorithm with bounded delays to solve a nonlinear fixed point problems. This result is applied to calculate the solution of a strongly monotone operator. Special…

Numerical Analysis · Mathematics 2007-05-23 Abdenasser Benahmed

Saddle point problems have been attracting people's attention in recent years. To solve large and sparse saddle point problems, Uzawa type algorithms were proposed. The main contribution of this paper is to present a new Uzawa-exact type…

Optimization and Control · Mathematics 2018-02-20 Zhitao Xu , Ting Jiang , Li Gao

Variational inequalities are a formalism that includes games, minimization, saddle point, and equilibrium problems as special cases. Methods for variational inequalities are therefore universal approaches for many applied tasks, including…

This paper examines a variety of classical optimization problems, including well-known minimization tasks and more general variational inequalities. We consider a stochastic formulation of these problems, and unlike most previous work, we…

Optimization and Control · Mathematics 2025-11-11 Vladimir Solodkin , Andrew Veprikov , Aleksandr Beznosikov

We are concerned with optimization in a broad sense through the lens of solving variational inequalities (VIs) -- a class of problems that are so general that they cover as particular cases minimization of functions, saddle-point (minimax)…

Optimization and Control · Mathematics 2026-02-17 Pavel Dvurechensky , Andrea Ebner , Johannes Carl Schnebel , Shimrit Shtern , Mathias Staudigl

This paper considers the problem of designing accelerated gradient-based algorithms for optimization and saddle-point problems. The class of objective functions is defined by a generalized sector condition. This class of functions contains…

Optimization and Control · Mathematics 2020-11-17 Dennis Gramlich , Christian Ebenbauer , Carsten W. Scherer

We study the convex-concave bilinear saddle-point problem $\min_x \max_y f(x) + y^\top Ax - g(y)$, where both, only one, or none of the functions $f$ and $g$ are strongly convex, and suitable rank conditions on the matrix $A$ hold. The…

Optimization and Control · Mathematics 2025-04-22 Colin Dirren , Mattia Bianchi , Panagiotis D. Grontas , John Lygeros , Florian Dörfler

The article is devoted to some adaptive methods for variational inequalities with relatively smooth and relatively strongly monotone operators. Starting from the recently proposed proximal variant of the extragradient method for this class…

Optimization and Control · Mathematics 2023-08-02 S. S. Ablaev , F. S. Stonyakin , M. S. Alkousa , D. A. Pasechnyuk

In this paper, we consider first-order convergence theory and algorithms for solving a class of non-convex non-concave min-max saddle-point problems, whose objective function is weakly convex in the variables of minimization and weakly…

Optimization and Control · Mathematics 2021-07-08 Mingrui Liu , Hassan Rafique , Qihang Lin , Tianbao Yang

We propose a regularized saddle-point algorithm for convex networked optimization problems with resource allocation constraints. Standard distributed gradient methods suffer from slow convergence and require excessive communication when…

Systems and Control · Computer Science 2012-08-16 Andrea Simonetto , Tamas Keviczky , Mikael Johansson

A new stochastic primal--dual algorithm for solving a composite optimization problem is proposed. It is assumed that all the functions/operators that enter the optimization problem are given as statistical expectations. These expectations…

Optimization and Control · Mathematics 2020-06-23 Pascal Bianchi , Walid Hachem , Adil Salim