English
Related papers

Related papers: Accelerated forward-backward and Douglas-Rachford …

200 papers

The Douglas-Rachford algorithm is a classical and powerful splitting method for minimizing the sum of two convex functions and, more generally, finding a zero of the sum of two maximally monotone operators. Although this algorithm is well…

Optimization and Control · Mathematics 2020-04-14 Minh N. Dao , Hung M. Phan

In this paper, based a novel primal-dual dynamical model with adaptive scaling parameters and Bregman divergences, we propose new accelerated primal-dual proximal gradient splitting methods for solving bilinear saddle-point problems with…

Optimization and Control · Mathematics 2024-09-04 Hao Luo

In this article, we propose and study a stochastic and relaxed preconditioned Douglas--Rachford splitting method to solve saddle-point problems that have separable dual variables. We prove the almost sure convergence of the iteration…

Optimization and Control · Mathematics 2024-10-01 Yakun Dong , Kristian Bredies , Hongpeng Sun

We study the cyclic relaxed Douglas-Rachford algorithm for possibly nonconvex, and inconsistent feasibility problems. This algorithm can be viewed as a convex relaxation between the cyclic Douglas-Rachford algorithm first introduced by…

Optimization and Control · Mathematics 2026-05-06 Thi Lan Dinh , G. S. Matthijs Jansen , D. Russell Luke

Although originally designed and analyzed for convex problems, the alternating direction method of multipliers (ADMM) and its close relatives, Douglas-Rachford splitting (DRS) and Peaceman-Rachford splitting (PRS), have been observed to…

Optimization and Control · Mathematics 2020-02-25 Andreas Themelis , Panagiotis Patrinos

A large class of non-smooth practical optimization problems can be written as minimization of a sum of smooth and partly smooth functions. We examine such structured problems which also depend on a parameter vector and study the problem of…

Optimization and Control · Mathematics 2024-10-28 Sheheryar Mehmood , Peter Ochs

We propose an inertial Douglas-Rachford splitting algorithm for finding the set of zeros of the sum of two maximally monotone operators in Hilbert spaces and investigate its convergence properties. To this end we formulate first the…

Optimization and Control · Mathematics 2014-03-31 Radu Ioan Bot , Ernö Robert Csetnek , Christopher Hendrich

We are interested in restoring images having values in a symmetric Hadamard manifold by minimizing a functional with a quadratic data term and a total variation like regularizing term. To solve the convex minimization problem, we extend the…

Numerical Analysis · Mathematics 2018-12-10 Ronny Bergmann , Johannes Persch , Gabriele Steidl

The deviation vectors provide additional degrees of freedom and effectively enhance the flexibility of algorithms. In the literature, the iterative schemes with deviations are constructed and their convergence analyses are performed on an…

Optimization and Control · Mathematics 2025-09-05 Yongyu Fu , Haowen Zheng , Qiao-Li Dong , Xiaolong Qin , Jing Zhao

We shed light on the structure of the "three-operator" version of the forward-Douglas--Rachford splitting algorithm for finding a zero of a sum of maximally monotone operators $A + B + C$, where $B$ is cocoercive, involving only the…

Optimization and Control · Mathematics 2018-05-02 Hugo Raguet

This paper derives new inexact variants of the Douglas-Rachford splitting method for maximal monotone operators and the alternating direction method of multipliers (ADMM) for convex optimization. The analysis is based on a new inexact…

Optimization and Control · Mathematics 2019-04-25 M. Marques Alves , Jonathan Eckstein , Marina Geremia , Jefferson Melo

Our interest lies in developing some efficient methods for minimizing the sum of two geodesically convex functions on Hadamard manifolds, with the aim to enhance the convergence of the Douglas-Rachford algorithm in Hadamard manifolds.…

Optimization and Control · Mathematics 2026-02-17 D. R. Sahu , Shikher Sharma , Pankaj Gautam

We study the convergence of the adaptive Douglas--Rachford (aDR) algorithm for solving a multioperator inclusion problem involving the sum of maximally comonotone operators. To address such problems, we adopt a product space reformulation…

Optimization and Control · Mathematics 2025-07-01 Jan Harold Alcantara , Minh N. Dao , Akiko Takeda

Splitting schemes are a class of powerful algorithms that solve complicated monotone inclusions and convex optimization problems that are built from many simpler pieces. They give rise to algorithms in which the simple pieces of the…

Optimization and Control · Mathematics 2015-05-19 Damek Davis , Wotao Yin

Douglas-Rachford Splitting (DRS) methods based on the proximal point algorithms for the Poisson and Gaussian log-likelihood functions are proposed for ptychography and phase retrieval. Fixed point analysis shows that the DRS iterated…

Numerical Analysis · Mathematics 2020-04-13 A. Fannjiang , Z. Zhang

In this work, we aim to establish the exact worst-case convergence rates of Douglas--Rachford splitting (DRS) and Davis--Yin splitting (DYS) when applied to convex optimization problems. Both DRS and DYS have two variants as swapping the…

Optimization and Control · Mathematics 2025-09-15 Edward Duc Hien Nguyen , Jaewook J. Suh , Xin Jiang , Shiqian Ma

For a class of nonsmooth composite optimization problems with linear equality constraints, we utilize a Lyapunov-based approach to establish the global exponential stability of the primal-dual gradient flow dynamics based on the proximal…

Optimization and Control · Mathematics 2019-10-03 Dongsheng Ding , Mihailo R. Jovanović

We investigate the integration of Nesterov-type acceleration into primal-dual methods for structured convex optimization. While proximal splitting algorithms efficiently handle composite problems of the form $\min_x f(x)+g(x)+h(Kx)$,…

Optimization and Control · Mathematics 2026-04-13 Laurent Condat , Abdurakhmon Sadiev , Peter Richtárik

The forward-backward splitting method (FBS) for minimizing a nonsmooth composite function can be interpreted as a (variable-metric) gradient method over a continuously differentiable function which we call forward-backward envelope (FBE).…

Optimization and Control · Mathematics 2019-11-11 Lorenzo Stella , Andreas Themelis , Panagiotis Patrinos

In this paper, we study the local linear convergence properties of a versatile class of Primal-Dual splitting methods for minimizing composite non-smooth convex optimization problems. Under the assumption that the non-smooth components of…

Optimization and Control · Mathematics 2018-01-10 Jingwei Liang , Jalal Fadili , Gabriel Peyré