English
Related papers

Related papers: Linear Convergence of the Douglas-Rachford Method …

200 papers

The properties of gradient techniques for the phase retrieval problem have received a considerable attention in recent years. In almost all applications, however, the phase retrieval problem is solved using a family of algorithms that can…

Information Theory · Computer Science 2020-06-05 Eitan Levin , Tamir Bendory

Many iterative methods for solving optimization or feasibility problems have been invented, and often convergence of the iterates to some solution is proven. Under favourable conditions, one might have additional bounds on the distance of…

Optimization and Control · Mathematics 2020-04-14 Heinz H. Bauschke , Minh N. Dao , Dominikus Noll , Hung M. Phan

We study the cyclic relaxed Douglas-Rachford algorithm for possibly nonconvex, and inconsistent feasibility problems. This algorithm can be viewed as a convex relaxation between the cyclic Douglas-Rachford algorithm first introduced by…

Optimization and Control · Mathematics 2026-05-06 Thi Lan Dinh , G. S. Matthijs Jansen , D. Russell Luke

The Douglas-Rachford method, a projection algorithm designed to solve continuous optimization problems, forms the basis of a useful heuristic for solving combinatorial optimization problems. In order to successfully use the method, it is…

Optimization and Control · Mathematics 2019-04-22 Francisco J. Aragón Artacho , Rubén Campoy , Matthew K. Tam

The Douglas Rachford algorithm is an algorithm that converges to a minimizer of a sum of two convex functions. The algorithm consists in fixed point iterations involving computations of the proximity operators of the two functions…

Optimization and Control · Mathematics 2018-04-04 Adil Salim , Pascal Bianchi , Walid Hachem

We propose a new approach for analyzing convergence of the Douglas-Rachford splitting method for solving convex composite optimization problems. The approach is based on a continuously differentiable function, the Douglas-Rachford Envelope…

Optimization and Control · Mathematics 2014-09-23 Panagiotis Patrinos , Lorenzo Stella , Alberto Bemporad

In this expository paper, we show how to use the Douglas-Rachford algorithm as a successful heuristic for finding magic squares. The Douglas-Rachford algorithm is an iterative projection method for solving feasibility problems. Although its…

Optimization and Control · Mathematics 2019-02-25 Francisco J. Aragón Artacho , Paula Segura Martínez

The Douglas-Rachford and Peaceman-Rachford algorithms have been successfully employed to solve convex optimization problems, or more generally find zeros of monotone inclusions. Recently, the behaviour of these methods in the inconsistent…

Optimization and Control · Mathematics 2024-05-28 Regina S. Burachik , Bethany I. Caldwell , C. Yalçın Kaya , Walaa M. Moursi , Matthew Saurette

The Douglas-Rachford algorithm is widely used in sparse signal processing for minimizing a sum of two convex functions. In this paper, we consider the case where one of the functions is weakly convex but the other is strongly convex so that…

Optimization and Control · Mathematics 2015-11-13 İlker Bayram , Ivan W. Selesnick

We discuss recent positive experiences applying convex feasibility algorithms of Douglas--Rachford type to highly combinatorial and far from convex problems.

Optimization and Control · Mathematics 2015-07-01 Francisco J. Aragón Artacho , Jonathan M. Borwein , Matthew K. Tam

The Douglas-Rachford algorithm (DRA) is a powerful optimization method for minimizing the sum of two convex (not necessarily smooth) functions. The vast majority of previous research dealt with the case when the sum has at least one…

Optimization and Control · Mathematics 2020-07-10 Heinz H. Bauschke , Walaa M. Moursi

In this paper, we study the local linear convergence properties of a versatile class of Primal-Dual splitting methods for minimizing composite non-smooth convex optimization problems. Under the assumption that the non-smooth components of…

Optimization and Control · Mathematics 2018-01-10 Jingwei Liang , Jalal Fadili , Gabriel Peyré

In recent years, there has been a growing interest in mathematical models leading to the minimization, in a symmetric matrix space, of a Bregman divergence coupled with a regularization term. We address problems of this type within a…

Optimization and Control · Mathematics 2022-06-10 A. Benfenati , E. Chouzenoux , J. -C. Pesquet

The Douglas-Rachford algorithm is one of the most prominent splitting algorithms for solving convex optimization problems. Recently, the method has been successful in finding a generalized solution (provided that one exists) for…

Optimization and Control · Mathematics 2022-06-16 Walaa M. Moursi

Douglas-Rachford method is a splitting algorithm for finding a zero of the sum of two maximal monotone operators. Each of its iterations requires the sequential solution of two proximal subproblems. The aim of this work is to present a…

Optimization and Control · Mathematics 2018-09-10 Benar F. Svaiter

We adapt the Douglas-Rachford (DR) splitting method to solve nonconvex feasibility problems by studying this method for a class of nonconvex optimization problem. While the convergence properties of the method for convex problems have been…

Optimization and Control · Mathematics 2015-11-17 Guoyin Li , Ting Kei Pong

The elementary Euclidean concept of circumcenter has recently been employed to improve two aspects of the classical Douglas--Rachford method for projecting onto the intersection of affine subspaces. The so-called circumcentered-reflection…

Optimization and Control · Mathematics 2021-03-30 Roger Behling , J. -Yunier Bello-Cruz , Luiz-Rafael Santos

In this work, we propose some new Douglas-Rashford splitting algorithms for solving a class of generalized DC (difference of convex functions) in real Hilbert spaces. The proposed methods leverage the proximal properties of the nonsmooth…

Optimization and Control · Mathematics 2024-04-24 Yonghong Yao , Lateef O. Jolaoso , Yekini Shehu , Jen-Chih Yao

We show that Newton's method converges globally at a linear rate for objective functions whose Hessians are stable. This class of problems includes many functions which are not strongly convex, such as logistic regression. Our linear…

Machine Learning · Computer Science 2018-06-04 Sai Praneeth Karimireddy , Sebastian U. Stich , Martin Jaggi

Randomized iterative methods have gained recent interest in machine learning and signal processing for solving large-scale linear systems. One such example is the randomized Douglas-Rachford (RDR) method, which updates the iterate by…

Numerical Analysis · Mathematics 2025-06-13 Liqi Guo , Ruike Xiang , Deren Han , Jiaxin Xie