English
Related papers

Related papers: Weak and strong convergence of an inertial proxima…

200 papers

Weak convergence of inertial iterative method for solving variational inequalities is the focus of this paper. The cost function is assumed to be non-Lipschitz and monotone. We propose a projection-type method with inertial terms and give…

Optimization and Control · Mathematics 2021-01-21 Yekini Shehu , Olaniyi. S. Iyiola

An efficient proximal-gradient-based method, called proximal extrapolated gradient method, is designed for solving monotone variational inequality in Hilbert space. The proposed method extends the acceptable range of parameters to obtain…

Optimization and Control · Mathematics 2019-12-05 Xiaokai Chang , Sanyang Liu , Jianchao Bai , Jun Yang

We propose a primal-dual backward reflected forward splitting method for solving structured primal-dual monotone inclusion in real Hilbert space. The algorithm allows to use the inexact computations of the Lipschitzian and cocoercive…

Optimization and Control · Mathematics 2024-01-11 Vu Cong Bang , Dimitri Papadimitriou , Vu Xuan Nham

In this manuscript we propose and analyze an implicit two-point type method (or inertial method) for obtaining stable approximate solutions to linear ill-posed operator equations. The method is based on the iterated Tikhonov (iT) scheme. We…

Numerical Analysis · Mathematics 2024-01-30 Joel C. Rabelo , Antonio Leitão , Alexandre L. Madureira

In a Hilbert setting, we introduce a new dynamical system and associated algorithms for solving monotone inclusions by rapid methods. Given a maximal monotone operator $A$, the evolution is governed by the time dependent operator $I -(I +…

Optimization and Control · Mathematics 2015-04-20 Hedy Attouch , Maicon Marques Alves , Benar F. Svaiter

In this paper, based on inertial and Tseng's ideas, we propose two projection-based algorithms to solve a monotone inclusion problem in infinite dimensional Hilbert spaces. Solution theorems of strong convergence are obtained under the…

Optimization and Control · Mathematics 2020-08-31 Bing Tan , Zheng Zhou , Xiaolong Qin

In this paper we study the pseudomonotone equilibrium problem. We consider a new inertial condition for the subgradient extragradient method with self-adaptive step size for approximating a solution of the equilibrium problem in a real…

Optimization and Control · Mathematics 2023-11-01 Chinedu Izuchukwu , Grace Ogwo , Bertin Zinsou

We propose techniques for approximating bilevel optimization problems with non-smooth lower level problems that can have a non-unique solution. To this end, we substitute the expression of a minimizer of the lower level minimization problem…

Optimization and Control · Mathematics 2016-04-27 Peter Ochs , René Ranftl , Thomas Brox , Thomas Pock

This paper deals with speeding up the convergence of a class of two-step iterative methods for solving linear systems of equations. To implement the acceleration technique, the residual norm associated with computed approximations for each…

Numerical Analysis · Mathematics 2024-04-24 Fatemeh P. A. Beik , Michele Benzi , Mehdi Najafi-Kalyani

In this paper, we propose an inertial accelerated primal-dual method for the linear equality constrained convex optimization problem. When the objective function has a ``nonsmooth + smooth'' composite structure, we further propose an…

Optimization and Control · Mathematics 2021-06-30 Xin He , Rong Hu , Ya-Ping Fang

Bilevel optimization problems embed the optimality of a subproblem as a constraint of another optimization problem. We introduce the concept of near-optimality robustness for bilevel optimization, protecting the upper-level solution…

Optimization and Control · Mathematics 2024-07-15 Mathieu Besançon , Miguel F. Anjos , Luce Brotcorne

We propose an inertial variant of the strongly convergent inexact proximal-point (PP) method of Solodov and Svaiter (2000) for monotone inclusions. We prove strong convergence of our main algorithm under less restrictive assumptions on the…

Optimization and Control · Mathematics 2025-09-24 M. Marques Alves , J. E. Navarro Caballero , M. Geremia , R. T. Marcavillaca

This paper presents an improved forward-backward splitting algorithm with two inertial parameters. It aims to find a point in the real Hilbert space at which the sum of a co-coercive operator and a maximal monotone operator vanishes. Under…

Machine Learning · Computer Science 2025-05-08 İrfan Işik , Ibrahim Karahan , Okan Erkaymaz

We consider a stochastic version of the proximal point algorithm for optimization problems posed on a Hilbert space. A typical application of this is supervised learning. While the method is not new, it has not been extensively analyzed in…

Optimization and Control · Mathematics 2021-09-28 Monika Eisenmann , Tony Stillfjord , Måns Williamson

In this paper, we introduce a \textit{Bi-level OPTimization} (BiOPT) framework for minimizing the sum of two convex functions, where both can be nonsmooth. The BiOPT framework involves two levels of methodologies. At the upper level of…

Optimization and Control · Mathematics 2021-07-14 Masoud Ahookhosh , Yurii Nesterov

In this paper, we introduce and study a class of resolvent dynamical systems to investigate some inertial proximal methods for solving mixed variational inequalities. These proposed methods along with their discretizations and derived rates…

Dynamical Systems · Mathematics 2024-06-28 Oday Hazaimah

Incremental methods are widely utilized for solving finite-sum optimization problems in machine learning and signal processing. In this paper, we study a family of incremental methods -- including incremental subgradient, incremental…

Optimization and Control · Mathematics 2022-12-26 Xiao Li , Zhihui Zhu , Anthony Man-Cho So , Jason D Lee

We propose a doubly stochastic primal-dual coordinate optimization algorithm for empirical risk minimization, which can be formulated as a bilinear saddle-point problem. In each iteration, our method randomly samples a block of coordinates…

Machine Learning · Computer Science 2017-04-13 Adams Wei Yu , Qihang Lin , Tianbao Yang

We provide new complexity information for the convergence of the Hybrid Steepest Descent Method for solving the Variational Inequality Problem for a strict contraction on Hilbert space over a closed convex set C given either as the fixed…

Logic · Mathematics 2016-10-04 Daniel Körnlein

This is a continuation of our previous work entitled \enquote{Alternating Proximity Mapping Method for Convex-Concave Saddle-Point Problems}, in which we proposed the alternating proximal mapping method and showed convergence results on the…

Optimization and Control · Mathematics 2023-11-01 Hui Ouyang