English
Related papers

Related papers: Douglas-Rachford Splitting: Complexity Estimates a…

200 papers

We develop and analyze DASHA: a new family of methods for nonconvex distributed optimization problems. When the local functions at the nodes have a finite-sum or an expectation form, our new methods, DASHA-PAGE and DASHA-SYNC-MVR, improve…

Machine Learning · Computer Science 2022-05-24 Alexander Tyurin , Peter Richtárik

The goal of this paper is to study approaches to bridge the gap between first-order and second-order type methods for composite convex programs. Our key observations are: i) Many well-known operator splitting methods, such as…

Optimization and Control · Mathematics 2016-09-27 Xiantao Xiao , Yongfeng Li , Zaiwen Wen , Liwei Zhang

We expand upon previous work that examined behavior of the iterated Douglas-Rachford method for a line and a circle by considering two generalizations: that of a line and an ellipse and that of a line together with a $p$-sphere. With…

Functional Analysis · Mathematics 2018-09-18 Jonathan M. Borwein , Scott B. Lindstrom , Brailey Sims , Anna Schneider , Matthew P. Skerritt

We consider smooth stochastic convex optimization problems in the context of algorithms which are based on directional derivatives of the objective function. This context can be considered as an intermediate one between derivative-free…

Optimization and Control · Mathematics 2020-09-22 Pavel Dvurechensky , Eduard Gorbunov , Alexander Gasnikov

In this work, we introduce the notion of warped Yosida regularization and study the asymptotic behavior of the orbit of dynamical systems generated by warped Yosida regularization, which includes Douglas-Rachford dynamical system. We…

Optimization and Control · Mathematics 2024-01-02 Pankaj Gautam , Vellaichamy Vetrivel

We study the applicability of the Peaceman-Rachford (PR) splitting method for solving nonconvex optimization problems. When applied to minimizing the sum of a strongly convex Lipschitz differentiable function and a proper closed function,…

Optimization and Control · Mathematics 2017-01-10 Guoyin Li , Tianxiang Liu , Ting Kei Pong

The ancient concept of circumcenter has recently given birth to the Circumcentered-Reflection method (CRM). CRM was first employed to solve best approximation problems involving affine subspaces. In this setting, it was shown to outperform…

Optimization and Control · Mathematics 2021-03-30 Roger Behling , Yunier Bello-Cruz , Luiz-Rafael Santos

We establish a region of convergence for the proto-typical non-convex Douglas-Rachford iteration which finds a point on the intersection of a line and a circle. Previous work on the non-convex iteration [2] was only able to establish local…

Optimization and Control · Mathematics 2015-07-01 Francisco J. Aragón Artacho , Jonathan M. Borwein

We consider a class of nonsmooth fractional programming problems with fixed-point constraints, where the numerator is convex and the denominator is concave. To solve this problem, we propose splitting algorithms that compute subgradient…

Optimization and Control · Mathematics 2025-09-03 Mootta Prangprakhon , Nimit Nimana

The last two decades witnessed the increasing of the interests on the absolute value equations (AVE) of finding $x\in\mathbb{R}^n$ such that $Ax-|x|-b=0$, where $A\in \mathbb{R}^{n\times n}$ and $b\in \mathbb{R}^n$. In this paper, we pay…

Optimization and Control · Mathematics 2022-02-15 Cairong Chen , Dongmei Yu , Deren Han

Davis-Yin splitting (DYS) has found a wide range of applications in optimization, but its linear rates of convergence have not been studied extensively. The scaled relative graph (SRG) simplifies the convergence analysis of operator…

Optimization and Control · Mathematics 2024-04-23 Jongmin Lee , Soheun Yi , Ernest K. Ryu

Recently, several authors have shown local and global convergence rate results for Douglas-Rachford splitting under strong monotonicity, Lipschitz continuity, and cocoercivity assumptions. Most of these focus on the convex optimization…

Optimization and Control · Mathematics 2017-04-05 Pontus Giselsson

This paper provides a comprehensive discussion of the equivalences between splitting methods. These equivalences have been studied over the past few decades and, in fact, have proven to be very useful. In this paper, we survey known results…

Optimization and Control · Mathematics 2018-06-12 Walaa M. Moursi , Yuriy Zinchenko

In this paper, we prove that the ergodic sequence generated by the Peaceman-Rachford (PR) splitting method with semi-proximal terms converges for convex optimization problems (COPs). Numerical experiments on the linear programming benchmark…

Optimization and Control · Mathematics 2025-01-15 Kaihuang Chen , Defeng Sun , Yancheng Yuan , Guojun Zhang , Xinyuan Zhao

In this paper we describe a systematic procedure to analyze the convergence of degenerate preconditioned proximal point algorithms. We establish weak convergence results under mild assumptions that can be easily employed in the context of…

Optimization and Control · Mathematics 2021-09-24 Kristian Bredies , Enis Chenchene , Dirk A. Lorenz , Emanuele Naldi

We present SuperSCS: a fast and accurate method for solving large-scale convex conic problems. SuperSCS combines the SuperMann algorithmic framework with the Douglas-Rachford splitting which is applied on the homogeneous self-dual embedding…

Optimization and Control · Mathematics 2019-03-18 Pantelis Sopasakis , Krina Menounou , Panagiotis Patrinos

In this paper, we first propose and analyze a novel mixed-type DG method for the coupled Stokes-Darcy problem on simplicial meshes. The proposed formulation is locally conservative. A mixed-type DG method in conjunction with the…

Numerical Analysis · Mathematics 2021-10-01 Lina Zhao

We develop and analyze a new `relax-and-split' (RS) approach for compositions of separable nonconvex nonsmooth functions with linear maps. RS uses a relaxation technique together with partial minimization, and brings classic techniques…

Optimization and Control · Mathematics 2018-09-27 Peng Zheng , Aleksandr Aravkin

We present \texttt{DR-DAQP}, an open-source solver for strongly monotone affine variational inequaliries that combines Douglas-Rachford operator splitting with an active-set acceleration strategy. The key idea is to estimate the active set…

Systems and Control · Electrical Eng. & Systems 2026-04-06 Daniel Arnström , Emilio Benenati , Giuseppe Belgioioso

The alternating direction method of multipliers (ADMM) is a widely used method for solving many convex minimization models arising in signal and image processing. In this paper, we propose an inertial ADMM for solving a two-block separable…

Optimization and Control · Mathematics 2021-04-02 Yang Yang , Yuchao Tang