English
Related papers

Related papers: New Douglas-Rachford algorithmic structures and th…

200 papers

We study acceleration and preconditioning strategies for a class of Douglas-Rachford methods aiming at the solution of convex-concave saddle-point problems associated with Fenchel-Rockafellar duality. While the basic iteration converges…

Optimization and Control · Mathematics 2016-04-22 Kristian Bredies , Hongpeng Sun

Convex optimization has become ubiquitous in most quantitative disciplines of science, including variational image processing. Proximal splitting algorithms are becoming popular to solve such structured convex optimization problems. Within…

Optimization and Control · Mathematics 2015-08-03 Jingwei Liang , Jalal Fadili , Gabriel Peyré , Russell Luke

Douglas-Rachford Splitting (DRS) methods based on the proximal point algorithms for the Poisson and Gaussian log-likelihood functions are proposed for ptychography and phase retrieval. Fixed point analysis shows that the DRS iterated…

Numerical Analysis · Mathematics 2020-04-13 A. Fannjiang , Z. Zhang

In this paper we propose two different primal-dual splitting algorithms for solving inclusions involving mixtures of composite and parallel-sum type monotone operators which rely on an inexact Douglas-Rachford splitting method, however…

Optimization and Control · Mathematics 2012-12-04 Radu Ioan Bot , Christopher Hendrich

The Douglas-Rachford and Peaceman-Rachford algorithms have been successfully employed to solve convex optimization problems, or more generally find zeros of monotone inclusions. Recently, the behaviour of these methods in the inconsistent…

Optimization and Control · Mathematics 2024-05-28 Regina S. Burachik , Bethany I. Caldwell , C. Yalçın Kaya , Walaa M. Moursi , Matthew Saurette

Dynamic Programming (DP) provides standard algorithms to solve Markov Decision Processes. However, these algorithms generally do not optimize a scalar objective function. In this paper, we draw connections between DP and (constrained)…

Machine Learning · Computer Science 2019-10-30 Nino Vieillard , Olivier Pietquin , Matthieu Geist

We examine convergence properties of continuous-time variants of accelerated Forward-Backward (FB) and Douglas-Rachford (DR) splitting algorithms for nonsmooth composite optimization problems. When the objective function is given by the sum…

Optimization and Control · Mathematics 2024-11-26 Ibrahim K. Ozaslan , Mihailo R. Jovanović

Douglas-Rachford splitting and the alternating direction method of multipliers (ADMM) can be used to solve convex optimization problems that consist of a sum of two functions. Convergence rate estimates for these algorithms have received…

Optimization and Control · Mathematics 2015-03-04 Pontus Giselsson

The problem of finding a zero of the sum of two maximally monotone operators is of central importance in optimization. One successful method to find such a zero is the Douglas-Rachford algorithm which iterates a firmly nonexpansive operator…

Optimization and Control · Mathematics 2016-02-19 Heinz H. Bauschke , Jason Schaad , Xianfu Wang

This article surveys the burgeoning area at the intersection of dynamical systems theory and algorithms for NP-hard problems. Traditionally, computational complexity and the analysis of non-deterministic polynomial-time (NP)-hard problems…

Optimization and Control · Mathematics 2020-05-12 Tuhin Sahai

Splitting schemes are a class of powerful algorithms that solve complicated monotone inclusion and convex optimization problems that are built from many simpler pieces. They give rise to algorithms in which the simple pieces of the…

Optimization and Control · Mathematics 2015-05-04 Damek Davis , Wotao Yin

Dynamic programming (DP) solves a variety of structured combinatorial problems by iteratively breaking them down into smaller subproblems. In spite of their versatility, DP algorithms are usually non-differentiable, which hampers their use…

Machine Learning · Statistics 2018-02-21 Arthur Mensch , Mathieu Blondel

We prove that the Douglas--Rachford method applied to two closed convex cones in the Euclidean plane converges in finitely many steps if and only if the set of fixed points of the Douglas--Rachford operator is nontrivial. We analyze this…

Optimization and Control · Mathematics 2023-10-27 Minh N. Dao , Mareike Dressler , Hongzhi Liao , Vera Roshchina

In this paper we provide a generalization of the Douglas-Rachford splitting (DRS) and the primal-dual algorithm (Vu 2013, Condat 2013) for solving monotone inclusions in a real Hilbert space involving a general linear operator. The proposed…

Optimization and Control · Mathematics 2021-09-22 Luis M. Briceño-Arias , Fernando Roldán

In this paper, we consider nonconvex decentralised optimisation and learning over a network of distributed agents. We develop an ADMM algorithm based on the Randomised Block Coordinate Douglas-Rachford splitting method which enables agents…

Optimization and Control · Mathematics 2025-07-31 Behnam Mafakheri , Jonathan H. Manton , Iman Shames

In this work, we develop a convergence framework for iterative algorithms whose updates can be described by a one-parameter family of nonexpansive operators. Within the framework, each step involving one of the main algorithmic operators is…

Optimization and Control · Mathematics 2025-12-01 Felipe Atenas , Heinz H. Bauschke , Minh N. Dao , Matthew K. Tam

The Douglas--Rachford (DR) and alternating direction method of multipliers (ADMM) are two proximal splitting algorithms designed to minimize the sum of two proper lower semi-continuous convex functions whose proximity operators are easy to…

Optimization and Control · Mathematics 2017-03-07 Jingwei Liang , Jalal Fadili , Gabriel Peyré

In this article, we propose and study a stochastic and relaxed preconditioned Douglas--Rachford splitting method to solve saddle-point problems that have separable dual variables. We prove the almost sure convergence of the iteration…

Optimization and Control · Mathematics 2024-10-01 Yakun Dong , Kristian Bredies , Hongpeng Sun

In this work we propose a new splitting technique, namely Asymmetric Forward-Backward-Adjoint splitting, for solving monotone inclusions involving three terms, a maximally monotone, a cocoercive and a bounded linear operator. Classical…

Optimization and Control · Mathematics 2016-10-17 Puya Latafat , Panagiotis Patrinos

The primal-dual Douglas-Rachford method is a well-known algorithm to solve optimization problems written as convex-concave saddle-point problems. Each iteration involves solving a linear system involving a linear operator and its adjoint.…

Optimization and Control · Mathematics 2025-11-11 Emanuele Naldi , Felix Schneppe
‹ Prev 1 3 4 5 6 7 10 Next ›