English
Related papers

Related papers: New Douglas-Rashford Splitting Algorithms for Gene…

200 papers

We examine convergence properties of continuous-time variants of accelerated Forward-Backward (FB) and Douglas-Rachford (DR) splitting algorithms for nonsmooth composite optimization problems. When the objective function is given by the sum…

Optimization and Control · Mathematics 2024-11-26 Ibrahim K. Ozaslan , Mihailo R. Jovanović

We consider a class of nonsmooth fractional programming problems with fixed-point constraints, where the numerator is convex and the denominator is concave. To solve this problem, we propose splitting algorithms that compute subgradient…

Optimization and Control · Mathematics 2025-09-03 Mootta Prangprakhon , Nimit Nimana

This paper derives new inexact variants of the Douglas-Rachford splitting method for maximal monotone operators and the alternating direction method of multipliers (ADMM) for convex optimization. The analysis is based on a new inexact…

Optimization and Control · Mathematics 2019-04-25 M. Marques Alves , Jonathan Eckstein , Marina Geremia , Jefferson Melo

We analyze several generic proximal splitting algorithms well suited for large-scale convex nonsmooth optimization. We derive sublinear and linear convergence results with new rates on the function value suboptimality or distance to the…

Optimization and Control · Mathematics 2022-01-28 Laurent Condat , Grigory Malinovsky , Peter Richtárik

The Douglas-Rachford splitting algorithm is a classical optimization method that has found many applications. When specialized to two normal cone operators, it yields an algorithm for finding a point in the intersection of two convex sets.…

Optimization and Control · Mathematics 2013-12-24 Heinz H. Bauschke , J. Y. Bello Cruz , Tran T. A. Nghia , Hung M. Phan , Xianfu Wang

In recent times the Douglas-Rachford algorithm has been observed empirically to solve a variety of nonconvex feasibility problems including those of a combinatorial nature. For many of these problems current theory is not sufficient to…

Optimization and Control · Mathematics 2017-07-24 Francisco J. Aragón Artacho , Jonathan M. Borwein , Matthew K. Tam

The Douglas-Rachford algorithm (DRA) is a powerful optimization method for minimizing the sum of two convex (not necessarily smooth) functions. The vast majority of previous research dealt with the case when the sum has at least one…

Optimization and Control · Mathematics 2020-07-10 Heinz H. Bauschke , Walaa M. Moursi

In this work, we address a class of nonconvex nonsmooth optimization problems where the objective function is the sum of two smooth functions (one of which is proximable) and two nonsmooth functions (one proper, closed and proximable, and…

Optimization and Control · Mathematics 2025-03-26 Jan Harold Alcantara , Ching-pei Lee , Akiko Takeda

The main challenge of nonconvex optimization is to find a global optimum, or at least to avoid ``bad'' local minima and meaningless stationary points. We study here the extent to which algorithms, as opposed to optimization models and…

Optimization and Control · Mathematics 2025-02-27 Thi Lan Dinh , Wiebke Bennecke , G. S. Matthijs Jansen , D. Russell Luke , Stefan Mathias

In this paper, we study the generalized Douglas-Rachford algorithm and its cyclic variants which include many projection-type methods such as the classical Douglas-Rachford algorithm and the alternating projection algorithm. Specifically,…

Optimization and Control · Mathematics 2020-04-14 Minh N. Dao , Hung M. Phan

We address the problem of computing stationary points for non-smooth, non-convex optimization problems. While this topic is well studied in the smooth setting, fewer algorithmic and theoretical results exist for the non-smooth case. Within…

Optimization and Control · Mathematics 2026-05-18 Hoai An Le Thi , Van Ngai Huynh , Tao Pham Dinh

The Douglas Rachford algorithm is an algorithm that converges to a minimizer of a sum of two convex functions. The algorithm consists in fixed point iterations involving computations of the proximity operators of the two functions…

Optimization and Control · Mathematics 2018-04-04 Adil Salim , Pascal Bianchi , Walid Hachem

Operator splitting schemes are a class of powerful algorithms that solve complicated monotone inclusion and convex optimization problems that are built from many simpler pieces. They give rise to algorithms in which all simple pieces of the…

Optimization and Control · Mathematics 2015-07-09 Damek Davis

We propose a methodology for studying the performance of common splitting methods through semidefinite programming. We prove tightness of the methodology and demonstrate its value by presenting two applications of it. First, we use the…

Optimization and Control · Mathematics 2020-05-01 Ernest K. Ryu , Adrien B. Taylor , Carolina Bergeling , Pontus Giselsson

The Douglas-Rachford algorithm is a simple yet effective method for solving convex feasibility problems. However, if the underlying constraints are inconsistent, then the convergence theory is incomplete. We provide convergence results when…

Optimization and Control · Mathematics 2020-04-14 Heinz H. Bauschke , Minh N. Dao , Walaa M. Moursi

Difference of convex (DC) functions cover a broad family of non-convex and possibly non-smooth and non-differentiable functions, and have wide applications in machine learning and statistics. Although deterministic algorithms for DC…

Optimization and Control · Mathematics 2019-02-05 Yi Xu , Qi Qi , Qihang Lin , Rong Jin , Tianbao Yang

In this paper we provide a generalization of the Douglas-Rachford splitting (DRS) and the primal-dual algorithm (Vu 2013, Condat 2013) for solving monotone inclusions in a real Hilbert space involving a general linear operator. The proposed…

Optimization and Control · Mathematics 2021-09-22 Luis M. Briceño-Arias , Fernando Roldán

Solving feasibility problems is a central task in mathematics and the applied sciences. One particularly successful method is the Douglas-Rachford algorithm. In this paper, we provide many new conditions sufficient for finite convergence.…

Optimization and Control · Mathematics 2020-04-14 Heinz H. Bauschke , Minh N. Dao

The Douglas--Rachford (DR) and alternating direction method of multipliers (ADMM) are two proximal splitting algorithms designed to minimize the sum of two proper lower semi-continuous convex functions whose proximity operators are easy to…

Optimization and Control · Mathematics 2017-03-07 Jingwei Liang , Jalal Fadili , Gabriel Peyré

We investigate a new application of Difference of Convex functions programming and DCA in solving the constrained two-dimensional non-guillotine cutting problem. This problem consists of cutting a number of rectangular pieces from a large…

Computational Engineering, Finance, and Science · Computer Science 2014-04-15 Mahdi Moeini , Hoai An Le Thi