English
Related papers

Related papers: Convergence rates of Forward--Douglas--Rachford sp…

200 papers

This paper proposes an algorithm for solving structured optimization problems, which covers both the backward-backward and the Douglas-Rachford algorithms as special cases, and analyzes its convergence. The set of fixed points of the…

Optimization and Control · Mathematics 2017-09-19 Nguyen Hieu Thao

The Peaceman-Rachford splitting method is efficient for minimizing a convex optimization problem with a separable objective function and linear constraints. However, its convergence was not guaranteed without extra requirements. He {\it et…

Optimization and Control · Mathematics 2022-09-27 Yan Gu , Bo Jiang , Deren Han

The Douglas-Rachford algorithm is a classical and powerful splitting method for minimizing the sum of two convex functions and, more generally, finding a zero of the sum of two maximally monotone operators. Although this algorithm is well…

Optimization and Control · Mathematics 2020-04-14 Minh N. Dao , Hung M. Phan

Motivated by nonconvex, inconsistent feasibility problems in imaging, the relaxed alternating averaged reflections algorithm, or relaxed Douglas-Rachford algorithm (DR$\lambda$), was first proposed over a decade ago. Convergence results for…

Optimization and Control · Mathematics 2020-03-26 D. Russell Luke , Anna-Lena Martins

In this paper, we introduce a simple methodology to leverage strong convexity and smoothness in order to obtain an optimal linear convergence rate for the Peaceman--Rachford splitting (PRS) scheme applied to optimization problems involving…

Optimization and Control · Mathematics 2026-01-21 Luis Briceño-Arias , Fernando Roldán

The forward-backward splitting method (FBS) for minimizing a nonsmooth composite function can be interpreted as a (variable-metric) gradient method over a continuously differentiable function which we call forward-backward envelope (FBE).…

Optimization and Control · Mathematics 2019-11-11 Lorenzo Stella , Andreas Themelis , Panagiotis Patrinos

In this paper, we consider a class of structured nonconvex nonsmooth optimization problems whose objective function is the sum of three nonconvex functions, one of which is expressed in a difference-of-convex (DC) form. This problem class…

Optimization and Control · Mathematics 2025-06-10 Minh N. Dao , Tan Nhat Pham , Phan Thanh Tung

We analyze the Douglas-Rachford splitting method for weakly convex optimization problems, by the token of the Douglas-Rachford envelope, a merit function akin to the Moreau envelope. First, we use epi-convergence techniques to show that…

Optimization and Control · Mathematics 2024-12-30 Felipe Atenas

The properties of gradient techniques for the phase retrieval problem have received a considerable attention in recent years. In almost all applications, however, the phase retrieval problem is solved using a family of algorithms that can…

Information Theory · Computer Science 2020-06-05 Eitan Levin , Tamir Bendory

The Douglas-Rachford (DR) method is a widely used method for finding a point in the intersection of two closed convex sets (feasibility problem). However, the method converges weakly and the associated rate of convergence is hard to analyze…

Optimization and Control · Mathematics 2024-01-10 Deren Han , Yansheng Su , Jiaxin Xie

We shed light on the structure of the "three-operator" version of the forward-Douglas--Rachford splitting algorithm for finding a zero of a sum of maximally monotone operators $A + B + C$, where $B$ is cocoercive, involving only the…

Optimization and Control · Mathematics 2018-05-02 Hugo Raguet

This paper considers the distributed optimization problem over a network, where the objective is to optimize a global function formed by a sum of local functions, using only local computation and communication. We develop an Accelerated…

Optimization and Control · Mathematics 2020-06-02 Guannan Qu , Na Li

In this paper, we investigate the Douglas-Rachford method for two closed (possibly nonconvex) sets in Euclidean spaces. We show that under certain regularity conditions, the Douglas-Rachford method converges locally with R-linear rate. In…

Optimization and Control · Mathematics 2015-02-20 Hung M. Phan

This paper provides a theoretical and numerical comparison of classical first-order splitting methods for solving smooth convex optimization problems and cocoercive equations. From a theoretical point of view, we compare convergence rates…

Optimization and Control · Mathematics 2022-07-15 Luis Briceño-Arias , Nelly Pustelnik

We address the problem of finding the zeros of the sum of a maximally monotone operator and a cocoercive operator. Our approach introduces a modification to the forward-backward method by integrating an inertial/momentum term alongside a…

Optimization and Control · Mathematics 2023-12-20 Radu Ioan Bot , Dang-Khoa Nguyen , Chunxiang Zong

Recently, several authors have shown local and global convergence rate results for Douglas-Rachford splitting under strong monotonicity, Lipschitz continuity, and cocoercivity assumptions. Most of these focus on the convex optimization…

Optimization and Control · Mathematics 2017-04-05 Pontus Giselsson

We provide a simple analysis of the Douglas-Rachford splitting algorithm in the context of $\ell^1$ minimization with linear constraints, and quantify the asymptotic linear convergence rate in terms of principal angles between relevant…

Numerical Analysis · Mathematics 2013-05-30 Laurent Demanet , Xiangxiong Zhang

The Douglas-Rachford method is a popular splitting technique for finding a zero of the sum of two subdifferential operators of proper closed convex functions; more generally two maximally monotone operators. Recent results concerned with…

Optimization and Control · Mathematics 2018-05-25 Walaa M. Moursi , Lieven Vandenberghe

Douglas-Rachford splitting and its equivalent dual formulation ADMM are widely used iterative methods in composite optimization problems arising in control and machine learning applications. The performance of these algorithms depends on…

Optimization and Control · Mathematics 2019-06-28 Jacob H. Seidman , Mahyar Fazlyab , Victor M. Preciado , George J. Pappas

In this paper, by using tools of second-order variational analysis, we study the popular forward-backward splitting method with Beck-Teboulle's line-search for solving convex optimization problem where the objective function can be split…

Optimization and Control · Mathematics 2018-06-19 Yunier Bello-Cruz , G. Li , T. T. A. Nghia