English
Related papers

Related papers: Douglas-Rachford Splitting: Complexity Estimates a…

200 papers

In this paper we propose two different primal-dual splitting algorithms for solving inclusions involving mixtures of composite and parallel-sum type monotone operators which rely on an inexact Douglas-Rachford splitting method, however…

Optimization and Control · Mathematics 2012-12-04 Radu Ioan Bot , Christopher Hendrich

In this paper, we propose a new optimization algorithm for sparse logistic regression based on a stochastic version of the Douglas-Rachford splitting method. Our algorithm sweeps the training set by randomly selecting a mini-batch of data…

Optimization and Control · Mathematics 2019-04-09 Luis M. Briceno-Arias , Giovanni Chierchia , Emilie Chouzenoux , Jean-Christophe Pesquet

We propose and analyze an adaptive step-size variant of the Davis-Yin three operator splitting. This method can solve optimization problems composed by a sum of a smooth term for which we have access to its gradient and an arbitrary number…

Optimization and Control · Mathematics 2018-08-02 Fabian Pedregosa , Gauthier Gidel

In the context of convex optimization problems in Hilbert spaces, we induce inertial effects into the classical ADMM numerical scheme and obtain in this way so-called inertial ADMM algorithms, the convergence properties of which we…

Optimization and Control · Mathematics 2014-04-18 Radu Ioan Bot , Ernö Robert Csetnek

The Douglas-Rachford reflection method is a general purpose algorithm useful for solving the feasibility problem of finding a point in the intersection of finitely many sets. In this chapter we demonstrate that applied to a specific…

Optimization and Control · Mathematics 2018-08-16 Jonathan M. Borwein , Matthew K. Tam

We consider distributed optimization in the client-server setting. By use of Douglas-Rachford splitting to the dual of the sum problem, we design a BFGS method that requires minimal communication (sending/receiving one vector per round for…

Optimization and Control · Mathematics 2024-10-30 Dingran Yi , Nikolaos M. Freris

In this paper, we present a method for identifying infeasible, unbounded, and pathological conic programs based on Douglas-Rachford splitting, or equivalently ADMM. When an optimization program is infeasible, unbounded, or pathological, the…

Optimization and Control · Mathematics 2017-10-17 Yanli Liu , Ernest K. Ryu , Wotao Yin

We propose and analyze a second-order Strang splitting method for a class of stiff matrix differential equations with Sylvester-type structure. The method splits the dynamics into a stiff linear part, treated exactly via matrix…

Numerical Analysis · Mathematics 2026-02-10 Carmen Scalone , Nicola Guglielmi

The authors in (Banjac et al., 2019) recently showed that the Douglas-Rachford algorithm provides certificates of infeasibility for a class of convex optimization problems. In particular, they showed that the difference between consecutive…

Optimization and Control · Mathematics 2021-02-08 Goran Banjac , John Lygeros

The elementary Euclidean concept of circumcenter has recently been employed to improve two aspects of the classical Douglas--Rachford method for projecting onto the intersection of affine subspaces. The so-called circumcentered-reflection…

Optimization and Control · Mathematics 2021-03-30 Roger Behling , J. -Yunier Bello-Cruz , Luiz-Rafael Santos

Distributionally robust optimization (DRO) is a powerful framework for training robust models against data distribution shifts. This paper focuses on constrained DRO, which has an explicit characterization of the robustness level. Existing…

Machine Learning · Statistics 2024-04-02 Qi Zhang , Yi Zhou , Ashley Prater-Bennette , Lixin Shen , Shaofeng Zou

The circumcentered Douglas--Rachford method (C--DRM), introduced by Behling, Bello Cruz and Santos, is an acceleration of the well-known Douglas-Rachford method (DRM) for finding the best approximation onto the intersection of finitely many…

Optimization and Control · Mathematics 2020-06-16 Heinz H. Bauschke , Hui Ouyang , Xianfu Wang

In order to accelerate the Douglas--Rachford method we recently developed the circumcentered--reflection method, which provides the closest iterate to the solution among all points relying on successive reflections, for the best…

Optimization and Control · Mathematics 2020-08-11 Roger Behling , José Yunier Bello-Cruz , Luiz-Rafael Santos

Alternating projection based methods, such as ePIE and rPIE, have been used widely in ptychography. However, they only work well if there are adequate measurements (diffraction patterns); in the case of sparse data (i.e. fewer measurements)…

Image and Video Processing · Electrical Eng. & Systems 2020-01-08 Minh Pham , Arjun Rana , Jianwei Miao , Stanley Osher

This paper introduces the distributed Halpern Peaceman--Rachford (dHPR) method, an efficient algorithm for solving distributed convex composite optimization problems with non-smooth objectives, which achieves a non-ergodic $O(1/k)$…

Optimization and Control · Mathematics 2025-11-14 Zhangcheng Feng , Defeng Sun , Yancheng Yuan , Guojun Zhang

We consider the problem of minimizing the sum of a smooth function $h$ with a bounded Hessian, and a nonsmooth function. We assume that the latter function is a composition of a proper closed function $P$ and a surjective linear map $\cal…

Optimization and Control · Mathematics 2015-11-17 Guoyin Li , Ting Kei Pong

In this paper, we study the local linear convergence properties of a versatile class of Primal-Dual splitting methods for minimizing composite non-smooth convex optimization problems. Under the assumption that the non-smooth components of…

Optimization and Control · Mathematics 2018-01-10 Jingwei Liang , Jalal Fadili , Gabriel Peyré

This paper studies a class of monotone inclusion problems in a real Hilbert space involving the sum of three operators, where two are maximal monotone and the third is cocoercive. The Davis--Yin three-operator splitting method extends the…

Optimization and Control · Mathematics 2026-05-14 Maoran Wang , Zijun Xia , Xingju Cai

A class of monotone operator equations, which can be decomposed into sum of the gradient of a strongly convex function and a linear and skew-symmetric operator, is considered in this work. Based on discretization of the generalized gradient…

Optimization and Control · Mathematics 2025-01-22 Long Chen , Jingrong Wei

The Douglas-Rachford and Peaceman-Rachford algorithms have been successfully employed to solve convex optimization problems, or more generally find zeros of monotone inclusions. Recently, the behaviour of these methods in the inconsistent…

Optimization and Control · Mathematics 2024-05-28 Regina S. Burachik , Bethany I. Caldwell , C. Yalçın Kaya , Walaa M. Moursi , Matthew Saurette