English
Related papers

Related papers: Proximal extrapolated gradient methods for variati…

200 papers

In this paper an inexact proximal point method for variational inequalities in Hadamard manifolds is introduced and studied its convergence properties. The main tool used for presenting the method is the concept of enlargement of monotone…

Optimization and Control · Mathematics 2015-11-30 E. E. A. Batista , G. C. Bento , O. P. Ferreira

The standard assumption for proving linear convergence of first order methods for smooth convex optimization is the strong convexity of the objective function, an assumption which does not hold for many practical applications. In this…

Optimization and Control · Mathematics 2016-08-10 I. Necoara , Yu. Nesterov , F. Glineur

In this paper we present a subgradient method with non-monotone line search for the minimization of convex functions with simple convex constraints. Different from the standard subgradient method with prefixed step sizes, the new method…

Optimization and Control · Mathematics 2022-04-22 O. P. Ferreira , G. N. Grapiglia , E. M. Santos , J. C. O. Souza

A subgradient method is presented for solving general convex optimization problems, the main requirement being that a strictly-feasible point is known. A feasible sequence of iterates is generated, which converges to within user-specified…

Optimization and Control · Mathematics 2016-05-30 James Renegar

We study monotone variational inequalities that can arise as optimality conditions for constrained convex optimisation or convex-concave minimax problems and propose a novel algorithm that uses only one gradient/operator evaluation and one…

Optimization and Control · Mathematics 2023-07-24 Michael Sedlmayer , Dang-Khoa Nguyen , Radu Ioan Bot

In this paper, we introduce and study a new extragradient iterative process for finding a common element of the set of fixed points of an infinite family of nonexpansive mappings and the set of solutions of a variational inequality for an…

Functional Analysis · Mathematics 2014-05-22 Ibrahim Karahan , Murat Ozdemir

Many popular first order algorithms for convex optimization, such as forward-backward splitting, Douglas-Rachford splitting, and the alternating direction method of multipliers (ADMM), can be formulated as averaged iteration of a…

Optimization and Control · Mathematics 2016-06-28 Pontus Giselsson , Mattias Fält , Stephen Boyd

Recent works have developed new projection-free first-order methods based on utilizing linesearches and normal vector computations to maintain feasibility. These oracles can be cheaper than orthogonal projection or linear optimization…

Optimization and Control · Mathematics 2024-05-01 Thabo Samakhoana , Benjamin Grimmer

In this paper, we introduce and study a class of resolvent dynamical systems to investigate some inertial proximal methods for solving mixed variational inequalities. These proposed methods along with their discretizations and derived rates…

Dynamical Systems · Mathematics 2024-06-28 Oday Hazaimah

Composite optimization problems, where the sum of a smooth and a merely lower semicontinuous function has to be minimized, are often tackled numerically by means of proximal gradient methods as soon as the lower semicontinuous part of the…

Optimization and Control · Mathematics 2022-07-05 Christian Kanzow , Patrick Mehlitz

This paper studies proximal gradient iterations for solving simple bilevel optimization problems where both the upper and the lower level cost functions are split as the sum of differentiable and (possibly nonsmooth) proximable functions.…

Optimization and Control · Mathematics 2024-03-05 Puya Latafat , Andreas Themelis , Silvia Villa , Panagiotis Patrinos

We study the ergodic problem for fully nonlinear operators which may be singular or degenerate when the gradient of solutions vanishes. We prove the convergence of both explosive solutions and solutions of Dirichlet problems for…

Analysis of PDEs · Mathematics 2017-12-08 Isabeau Birindelli , Francoise Demengel , Fabiana Leoni

Extragradient method (EG) (Korpelevich, 1976) is one of the most popular methods for solving saddle point and variational inequalities problems (VIP). Despite its long history and significant attention in the optimization community, there…

Optimization and Control · Mathematics 2022-02-23 Eduard Gorbunov , Nicolas Loizou , Gauthier Gidel

In this paper we consider stochastic composite convex optimization problems with the objective function satisfying a stochastic bounded gradient condition, with or without a quadratic functional growth property. These models include the…

Optimization and Control · Mathematics 2020-03-10 Ion Necoara

Many recently proposed gradient projection algorithms with inertial extrapolation step for solving quasi-variational inequalities in Hilbert spaces are proven to be strongly convergent with no linear rate given when the cost operator is…

Optimization and Control · Mathematics 2024-04-23 Yonghong Yao , Lateef O. Jolaoso , Yekini Shehu

In this paper, we propose some accelerated methods for solving optimization problems under the condition of relatively smooth and relatively Lipschitz continuous functions with an inexact oracle. We consider the problem of minimizing the…

Optimization and Control · Mathematics 2024-11-27 O. S. Savchuk , M. S. Alkousa , A. S. Shushko , A. A. Vyguzov , F. S. Stonyakin , D. A. Pasechnyuk , A. V. Gasnikov

Variational inequality problems are recognized for their broad applications across various fields including machine learning and operations research. First-order methods have emerged as the standard approach for solving these problems due…

Optimization and Control · Mathematics 2025-03-24 Liang Zhang , Niao He , Michael Muehlebach

First-order operator splitting methods are ubiquitous among many fields through science and engineering, such as inverse problems, signal/image processing, statistics, data science and machine learning, to name a few. In this paper, we…

Optimization and Control · Mathematics 2020-09-10 Clarice Poon , Jingwei Liang

In this paper, we propose two new solution schemes to solve the stochastic strongly monotone variational inequality problems: the stochastic extra-point solution scheme and the stochastic extra-momentum solution scheme. The first one is a…

Optimization and Control · Mathematics 2021-07-20 Kevin Huang , Shuzhong Zhang

In this paper, using sunny generalized nonexpansive retraction, we propose new extragradient and linesearch algorithms for finding a common element of the set of solutions of an equilibrium problem and the set of fixed points of a…

Functional Analysis · Mathematics 2016-06-07 Zeynab Jouymandi , Fridoun Moradlou