English
Related papers

Related papers: Extending Douglas-Rachford Splitting for Convex Op…

200 papers

This paper introduces the distributed Halpern Peaceman--Rachford (dHPR) method, an efficient algorithm for solving distributed convex composite optimization problems with non-smooth objectives, which achieves a non-ergodic $O(1/k)$…

Optimization and Control · Mathematics 2025-11-14 Zhangcheng Feng , Defeng Sun , Yancheng Yuan , Guojun Zhang

We propose and analyze the convergence of a novel stochastic forward-backward splitting algorithm for solving monotone inclusions given by the sum of a maximal monotone operator and a single-valued maximal monotone cocoercive operator. This…

Optimization and Control · Mathematics 2015-02-23 Lorenzo Rosasco , Silvia Villa , Bang Công Vũ

Many large-scale and distributed optimization problems can be brought into a composite form in which the objective function is given by the sum of a smooth term and a nonsmooth regularizer. Such problems can be solved via a proximal…

Optimization and Control · Mathematics 2020-06-26 Sepideh Hassan-Moghaddam , Mihailo R. Jovanović

In this paper, we propose and study the iteration complexity of an inexact Douglas-Rachford splitting (DRS) method and a Douglas-Rachford-Tseng's forward-backward (F-B) splitting method for solving two-operator and four-operator monotone…

Optimization and Control · Mathematics 2017-12-01 M. Marques Alves , M. Geremia

In this paper, we consider the problem of distributed optimisation of a separable convex cost function over a graph, where every edge and node in the graph could carry both linear equality and/or inequality constraints. We show how to…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-02-20 Richard Heusdens , Guoqiang Zhang

We consider distributed optimization in the client-server setting. By use of Douglas-Rachford splitting to the dual of the sum problem, we design a BFGS method that requires minimal communication (sending/receiving one vector per round for…

Optimization and Control · Mathematics 2024-10-30 Dingran Yi , Nikolaos M. Freris

Our work considers the optimization of the sum of a non-smooth convex function and a finite family of composite convex functions, each one of which is composed of a convex function and a bounded linear operator. This type of problem is…

Optimization and Control · Mathematics 2019-08-30 Yu-Chao Tang , Chuan-Xi Zhu , Meng Wen , Ji-Gen Peng

In this paper we present two Douglas-Rachford inspired iteration schemes which can be applied directly to N-set convex feasibility problems in Hilbert space. Our main results are weak convergence of the methods to a point whose nearest…

Optimization and Control · Mathematics 2018-05-28 Jonathan M. Borwein , Matthew K. Tam

We consider the problem of minimizing the sum of a smooth function $h$ with a bounded Hessian, and a nonsmooth function. We assume that the latter function is a composition of a proper closed function $P$ and a surjective linear map $\cal…

Optimization and Control · Mathematics 2015-11-17 Guoyin Li , Ting Kei Pong

In recent years, the Douglas-Rachford splitting method has been shown to be effective at solving many non-convex optimization problems. In this paper we present a local convergence analysis for non-convex feasibility problems and show that…

Optimization and Control · Mathematics 2021-01-21 Robert Tovey , Jingwei Liang

Splitting and projection-type algorithms have been applied to many optimization problems due to their simplicity and efficiency, but the application of these algorithms to optimal control is less common. In this paper we utilize the…

Optimization and Control · Mathematics 2024-01-15 Regina S. Burachik , Bethany I. Caldwell , C. Yalçın Kaya

We consider a class of nonsmooth fractional programming problems with fixed-point constraints, where the numerator is convex and the denominator is concave. To solve this problem, we propose splitting algorithms that compute subgradient…

Optimization and Control · Mathematics 2025-09-03 Mootta Prangprakhon , Nimit Nimana

In this paper, we investigate the behavior of the family of graph-based splitting algorithms specialized to the problem of finding a point in the intersection of linear subspaces. The algorithms in this family, which encompasses several…

Optimization and Control · Mathematics 2026-04-07 Francisco J. Aragón-Artacho , César López-Pastor

This paper proposes and analyzes a new operator splitting method for stochastic Maxwell equations driven by additive noise, which not only decomposes the original multi-dimensional system into some local one-dimensional subsystems, but also…

Numerical Analysis · Mathematics 2021-02-23 Chuchu Chen , Jialin Hong , Lihai Ji

For a linear equality constrained convex optimization problem involving two objective functions with a ``nonsmooth" + ``nonsmooth" composite structure, we study two algorithms derived from a mixed-order dynamical system which incorporates…

Optimization and Control · Mathematics 2026-03-25 Geng-Hua Li , Hai-Yi Zhao , Xiangkai Sun

We tackle highly nonconvex, nonsmooth composite optimization problems whose objectives comprise a Moreau-Yosida regularized term. Classical nonconvex proximal splitting algorithms, such as nonconvex ADMM, suffer from lack of convergence for…

Optimization and Control · Mathematics 2018-02-28 Emanuel Laude , Tao Wu , Daniel Cremers

In this work, we introduce the notion of warped Yosida regularization and study the asymptotic behavior of the orbit of dynamical systems generated by warped Yosida regularization, which includes Douglas-Rachford dynamical system. We…

Optimization and Control · Mathematics 2024-01-02 Pankaj Gautam , Vellaichamy Vetrivel

Online and stochastic learning has emerged as powerful tool in large scale optimization. In this work, we generalize the Douglas-Rachford splitting (DRs) method for minimizing composite functions to online and stochastic settings (to our…

Numerical Analysis · Computer Science 2016-12-22 Ziqiang Shi , Rujie Liu

In this article, we study two methods for solving monotone inclusions in real Hilbert spaces involving the sum of a maximally monotone operator, a monotone-Lipschitzian operator, a cocoercive operator, and a normal cone to a vector…

Optimization and Control · Mathematics 2024-05-13 Fernando Roldán

Given the success of Douglas--Rachford splitting (DRS), it is natural to ask whether DRS can be generalized. Are there other 2 operator resolvent-splittings sharing the favorable properties of DRS? Can DRS be generalized to 3 operators?…

Optimization and Control · Mathematics 2025-11-12 Ernest K. Ryu