English
Related papers

Related papers: Circumcentering Reflection Methods for Nonconvex F…

200 papers

The main challenge of nonconvex optimization is to find a global optimum, or at least to avoid ``bad'' local minima and meaningless stationary points. We study here the extent to which algorithms, as opposed to optimization models and…

Optimization and Control · Mathematics 2025-02-27 Thi Lan Dinh , Wiebke Bennecke , G. S. Matthijs Jansen , D. Russell Luke , Stefan Mathias

For many problems, some of which are reviewed in the paper, popular algorithms like Douglas--Rachford (DR), ADMM, and FISTA produce approximating sequences that show signs of spiraling toward the solution. We present a meta-algorithm that…

Optimization and Control · Mathematics 2022-09-09 Scott B. Lindstrom

We consider projection algorithms for solving (nonconvex) feasibility problems in Euclidean spaces. Of special interest are the Method of Alternating Projections (MAP) and the Douglas-Rachford or Averaged Alternating Reflection Algorithm…

Optimization and Control · Mathematics 2014-03-17 Robert Hesse , D. Russell Luke

The properties of gradient techniques for the phase retrieval problem have received a considerable attention in recent years. In almost all applications, however, the phase retrieval problem is solved using a family of algorithms that can…

Information Theory · Computer Science 2020-06-05 Eitan Levin , Tamir Bendory

In this paper, we study the generalized Douglas-Rachford algorithm and its cyclic variants which include many projection-type methods such as the classical Douglas-Rachford algorithm and the alternating projection algorithm. Specifically,…

Optimization and Control · Mathematics 2020-04-14 Minh N. Dao , Hung M. Phan

The centralized circumcentered-reflection method (\cCRM) of~\cite{Behling:2024} converges superlinearly to a solution of $\operatorname{find}\;z\in X\cap Y$ when $\inte(X\cap Y)\neq\emptyset$ and the boundaries of $X$ and $Y$ are…

Optimization and Control · Mathematics 2026-04-14 Yunier Bello-Cruz

Many iterative methods for solving optimization or feasibility problems have been invented, and often convergence of the iterates to some solution is proven. Under favourable conditions, one might have additional bounds on the distance of…

Optimization and Control · Mathematics 2020-04-14 Heinz H. Bauschke , Minh N. Dao , Dominikus Noll , Hung M. Phan

The Douglas-Rachford projection algorithm is an iterative method used to find a point in the intersection of closed constraint sets. The algorithm has been experimentally observed to solve various nonconvex feasibility problems which…

Optimization and Control · Mathematics 2020-04-06 Minh N. Dao , Matthew K. Tam

In this paper we present the successive centralization of the circumcenter reflection scheme with several control sequences for solving the convex feasibility problem in Euclidean space. Assuming that a standard error bound holds, we prove…

Optimization and Control · Mathematics 2023-08-22 Roger Behling , Yunier Bello-Cruz , Alfredo Iusem , Di Liu , Luiz-Rafael Santos

The Douglas-Rachford method, a projection algorithm designed to solve continuous optimization problems, forms the basis of a useful heuristic for solving combinatorial optimization problems. In order to successfully use the method, it is…

Optimization and Control · Mathematics 2019-04-22 Francisco J. Aragón Artacho , Rubén Campoy , Matthew K. Tam

In this paper we give general recommendations for successful application of the Douglas-Rachford reflection method to convex and non-convex real matrix-completion problems. These guidelines are demonstrated by various illustrative examples.

Optimization and Control · Mathematics 2014-07-30 Francisco J. Aragón Artacho , Jonathan M. Borwein , Matthew K. Tam

In view of the great performance of circumcentered isometry methods for solving the best approximation problem, in this work we further investigate the locally proper circumcenter mapping and circumcentered method. Various examples of…

Optimization and Control · Mathematics 2021-12-20 Hui Ouyang

The Douglas--Rachford (DR) and alternating direction method of multipliers (ADMM) are two proximal splitting algorithms designed to minimize the sum of two proper lower semi-continuous convex functions whose proximity operators are easy to…

Optimization and Control · Mathematics 2017-03-07 Jingwei Liang , Jalal Fadili , Gabriel Peyré

The Douglas-Rachford reflection method is a general purpose algorithm useful for solving the feasibility problem of finding a point in the intersection of finitely many sets. In this chapter we demonstrate that applied to a specific…

Optimization and Control · Mathematics 2018-08-16 Jonathan M. Borwein , Matthew K. Tam

Over the past years, operator splitting methods have become ubiquitous for non-smooth optimization owing to their simplicity and efficiency. In this paper, we consider the Forward--Douglas--Rachford splitting method (FDR) [10,40], and study…

Optimization and Control · Mathematics 2018-01-04 Cesare Molinari , Jingwei Liang , Jalal Fadili

We propose a new approach for analyzing convergence of the Douglas-Rachford splitting method for solving convex composite optimization problems. The approach is based on a continuously differentiable function, the Douglas-Rachford Envelope…

Optimization and Control · Mathematics 2014-09-23 Panagiotis Patrinos , Lorenzo Stella , Alberto Bemporad

We establish finite convergence of circumcentered-reflection method (CRM) for the case of intersection of two closed convex cones in a real Hilbert space. We apply this result to prove the finite convergence for two polyhedral sets in R^n.

Optimization and Control · Mathematics 2022-11-08 Hongzhi Liao

In recent times the Douglas-Rachford algorithm has been observed empirically to solve a variety of nonconvex feasibility problems including those of a combinatorial nature. For many of these problems current theory is not sufficient to…

Optimization and Control · Mathematics 2017-07-24 Francisco J. Aragón Artacho , Jonathan M. Borwein , Matthew K. Tam

The Douglas-Rachford algorithm is a simple yet effective method for solving convex feasibility problems. However, if the underlying constraints are inconsistent, then the convergence theory is incomplete. We provide convergence results when…

Optimization and Control · Mathematics 2020-04-14 Heinz H. Bauschke , Minh N. Dao , Walaa M. Moursi

In this paper, we propose a new algorithm combining the Douglas-Rachford (DR) algorithm and the Frank-Wolfe algorithm, also known as the conditional gradient (CondG) method, for solving the classic convex feasibility problem. Within the…

Optimization and Control · Mathematics 2021-06-09 R. Díaz Millán , O. P. Ferreira , J. Ugon