English
Related papers

Related papers: Inertial Krasnoselskii-Mann Iterations

200 papers

In this paper, we propose two novel non-stationary first-order primal-dual algorithms to solve nonsmooth composite convex optimization problems. Unlike existing primal-dual schemes where the parameters are often fixed, our methods use…

Optimization and Control · Mathematics 2020-07-13 Quoc Tran-Dinh , Yuzixuan Zhu

We study the problem of solving fixed-point equations for seminorm-contractive operators and establish foundational results on the non-asymptotic behavior of iterative algorithms in both deterministic and stochastic settings. Specifically,…

Machine Learning · Computer Science 2025-02-21 Zaiwei Chen , Sheng Zhang , Zhe Zhang , Shaan Ul Haque , Siva Theja Maguluri

We introduce a new extragradient iterative process, motivated and inspired by [S. H. Khan, A Picard-Mann Hybrid Iterative Process, Fixed Point Theory and Applications, doi:10.1186/1687-1812-2013-69], for finding a common element of the set…

Functional Analysis · Mathematics 2014-03-14 Ibrahim Karahan , Murat Ozdemir

Building up on classical linear formulations, we posit that a broad class of problems in signal synthesis and in signal recovery are reducible to the basic task of finding a point in a closed convex subset of a Hilbert space that satisfies…

Optimization and Control · Mathematics 2021-05-18 Patrick L. Combettes , Zev C. Woodstock

In this paper, we propose a second-order continuous primal-dual dynamical system with time-dependent positive damping terms for a separable convex optimization problem with linear equality constraints. By the Lyapunov function approach, we…

Optimization and Control · Mathematics 2020-07-27 Xin He , Rong Hu , Ya-Ping Fang

We in this paper study the nonexpansive operators equipped with arbitrary metric and investigate the connections between firm nonexpansiveness, cocoerciveness and averagedness. The convergence of the associated fixed-point iterations is…

Optimization and Control · Mathematics 2022-10-11 Feng Xue

We propose a new class of fast Krasnoselkii--Mann methods with variance reduction to solve a finite-sum co-coercive equation $Gx = 0$. Our algorithm is single-loop and leverages a new family of unbiased variance-reduced estimators…

Optimization and Control · Mathematics 2025-06-09 Quoc Tran-Dinh

In this paper, we propose two novel inertial-like algorithms for solving the split common null point problem (SCNPP) with respect to set-valued maximal operators. The features of the presented algorithm are using new inertial structure…

Numerical Analysis · Mathematics 2021-09-21 Yan Tang , Shiqing Zhang

In order to solve the minimization of a nonsmooth convex function, we design an inertial second-order dynamic algorithm, which is obtained by approximating the nonsmooth function by a class of smooth functions. By studying the asymptotic…

Optimization and Control · Mathematics 2021-12-20 Xin Qu , Wei Bian

We propose and study a weakly convergent variant of the forward--backward algorithm for solving structured monotone inclusion problems. Our algorithm features a per-iteration deviation vector which provides additional degrees of freedom.…

Optimization and Control · Mathematics 2022-08-15 Hamed Sadeghi , Sebastian Banert , Pontus Giselsson

We develop a novel unified randomized block-coordinate primal-dual algorithm to solve a class of nonsmooth constrained convex optimization problems, which covers different existing variants and model settings from the literature. We prove…

Optimization and Control · Mathematics 2021-10-29 Quoc Tran-Dinh , Deyi Liu

Nonlinear acceleration algorithms improve the performance of iterative methods, such as gradient descent, using the information contained in past iterates. However, their efficiency is still not entirely understood even in the quadratic…

Optimization and Control · Mathematics 2019-03-22 Damien Scieur

The method of iterated conformal maps is developed for quasi-static fracture of brittle materials, for all modes of fracture. Previous theory, that was relevant for mode III only, is extended here to mode I and II. The latter require…

Statistical Mechanics · Physics 2009-11-07 Felipe Barra , Anders Levermann , Itamar Procaccia

In this paper, we establish sublinear and linear convergence of fixed point iterations generated by averaged operators in a Hilbert space. Our results are achieved under a bounded H\"older regularity assumption which generalizes the…

Optimization and Control · Mathematics 2018-08-16 Jonathan M. Borwein , Guoyin Li , Matthew K. Tam

Compressed sensing is a technique to sample compressible signals below the Nyquist rate, whilst still allowing near optimal reconstruction of the signal. In this paper we present a theoretical analysis of the iterative hard thresholding…

Information Theory · Computer Science 2008-05-06 Thomas Blumensath , Mike E. Davies

A new stochastic primal--dual algorithm for solving a composite optimization problem is proposed. It is assumed that all the functions/operators that enter the optimization problem are given as statistical expectations. These expectations…

Optimization and Control · Mathematics 2020-06-23 Pascal Bianchi , Walid Hachem , Adil Salim

We present a numerical iterative optimization algorithm for the minimization of a cost function consisting of a linear combination of three convex terms, one of which is differentiable, a second one is prox-simple and the third one is the…

Optimization and Control · Mathematics 2024-10-04 Ignace Loris , Simone Rebegoldi

Despite the broad use of fixed-point iterations throughout applied mathematics, the optimal convergence rate of general fixed-point problems with nonexpansive nonlinear operators has not been established. This work presents an acceleration…

Optimization and Control · Mathematics 2022-06-28 Jisun Park , Ernest K. Ryu

Recent advancements in data science have significantly elevated the importance of orthogonally constrained optimization problems. The Riemannian approach has become a popular technique for addressing these problems due to the advantageous…

Optimization and Control · Mathematics 2026-04-07 Linglingzhi Zhu , Wentao Ding , Shangyuan Liu , Anthony Man-Cho So

The primal-dual algorithm recently proposed by Chambolle & Pock (abbreviated as CPA) for structured convex optimization is very efficient and popular. It was shown by Chambolle & Pock in \cite{CP11} and also by Shefi & Teboulle in…

Optimization and Control · Mathematics 2014-09-11 Raymond H. Chan , Shiqian Ma , Junfeng Yang