English
Related papers

Related papers: A Cyclic Douglas-Rachford Iteration Scheme

200 papers

We study the convergence of the adaptive Douglas--Rachford (aDR) algorithm for solving a multioperator inclusion problem involving the sum of maximally comonotone operators. To address such problems, we adopt a product space reformulation…

Optimization and Control · Mathematics 2025-07-01 Jan Harold Alcantara , Minh N. Dao , Akiko Takeda

In this paper, we study the iteration complexity of cubic regularization of Newton method for solving composite minimization problems with uniformly convex objective. We introduce the notion of second-order condition number of a certain…

Optimization and Control · Mathematics 2021-05-21 Nikita Doikov , Yurii Nesterov

We provide formulas for projectors onto a polyhedral set, i.e. the intersection of a finite number of halfspaces. To this aim we formulate the problem of finding the projection as a convex optimization problem and we solve explicitly…

Optimization and Control · Mathematics 2017-04-20 Krzysztof E. Rutkowski

The Euclidean projection onto a convex set is an important problem that arises in numerous constrained optimization tasks. Unfortunately, in many cases, computing projections is computationally demanding. In this work, we focus on…

Optimization and Control · Mathematics 2021-09-22 Ilnura Usmanova , Maryam Kamgarpour , Andreas Krause , Kfir Yehuda Levy

In this paper, we propose several graph-based extensions of the Douglas-Rachford splitting (DRS) method to solve monotone inclusion problems involving the sum of $N$ maximal monotone operators. Our construction is based on a two-layer…

Optimization and Control · Mathematics 2022-11-10 Kristian Bredies , Enis Chenchene , Emanuele Naldi

In this paper, we consider convex feasibility problems where the underlying sets are loosely coupled, and we propose several algorithms to solve such problems in a distributed manner. These algorithms are obtained by applying proximal…

Optimization and Control · Mathematics 2013-07-01 Sina Khoshfetrat Pakazad , Martin S. Andersen , Anders Hansson

Douglas-Rachford method is a splitting algorithm for finding a zero of the sum of two maximal monotone operators. Weak convergence in this method to a solution of the underlying monotone inclusion problem in the general case remained an…

Optimization and Control · Mathematics 2018-09-10 Benar F. Svaiter

After re-casting the $n$-dimensional wavelet construction problem as a feasibility problem with constraints arising from the requirements of compact support, smoothness and orthogonality, the Douglas--Rachford algorithm is employed in the…

Classical Analysis and ODEs · Mathematics 2020-06-08 David Franklin , Jeffrey A. Hogan , Matthew K. Tam

In this paper the degenerate preconditioned proximal point algorithm will be combined with the idea of varying preconditioners leading to the degenerate variable metric proximal point algorithm. The weak convergence of the resulting…

Optimization and Control · Mathematics 2023-02-28 Dirk A. Lorenz , Jannis Marquardt , Emanuele Naldi

For solving large-scale non-convex problems, we propose inexact variants of trust region and adaptive cubic regularization methods, which, to increase efficiency, incorporate various approximations. In particular, in addition to approximate…

Optimization and Control · Mathematics 2018-02-21 Zhewei Yao , Peng Xu , Farbod Roosta-Khorasani , Michael W. Mahoney

The Douglas-Rachford and Peaceman-Rachford algorithms have been successfully employed to solve convex optimization problems, or more generally find zeros of monotone inclusions. Recently, the behaviour of these methods in the inconsistent…

Optimization and Control · Mathematics 2024-05-28 Regina S. Burachik , Bethany I. Caldwell , C. Yalçın Kaya , Walaa M. Moursi , Matthew Saurette

Although originally designed and analyzed for convex problems, the alternating direction method of multipliers (ADMM) and its close relatives, Douglas-Rachford splitting (DRS) and Peaceman-Rachford splitting (PRS), have been observed to…

Optimization and Control · Mathematics 2020-02-25 Andreas Themelis , Panagiotis Patrinos

In this paper we consider the computation of approximate solutions for inverse problems in Hilbert spaces. In order to capture the special feature of solutions, non-smooth convex functions are introduced as penalty terms. By exploiting the…

Numerical Analysis · Mathematics 2015-06-18 Qinian Jin , Xiliang Lu

Demiclosedness principles are powerful tools in the study of convergence of iterative methods. For instance, a multi-operator demiclosedness principle for firmly nonexpansive mappings is useful in obtaining simple and transparent arguments…

Optimization and Control · Mathematics 2020-08-25 Sedi Bartz , Rubén Campoy , Hung M. Phan

In this paper we analyse convergence of projected fixed-point iteration on a Riemannian manifold of matrices with fixed rank. As a retraction method we use `projector splitting scheme'. We prove that the projector splitting scheme converges…

Numerical Analysis · Mathematics 2016-04-08 Denis Kolesnikov , Ivan Oseledets

We consider variants of trust-region and cubic regularization methods for non-convex optimization, in which the Hessian matrix is approximated. Under mild conditions on the inexact Hessian, and using approximate solution of the…

Optimization and Control · Mathematics 2019-05-15 Peng Xu , Fred Roosta , Michael W. Mahoney

In this paper we present a new algorithmic realization of a projection-based scheme for general convex constrained optimization problem. The general idea is to transform the original optimization problem to a sequence of feasibility…

Optimization and Control · Mathematics 2019-11-12 Aviv Gibali , Karl-Heinz Küfer , Daniel Reem , Philipp Süss

We consider the problem of non-smooth convex optimization with linear equality constraints, where the objective function is only accessible through its proximal operator. This problem arises in many different fields such as statistical…

Optimization and Control · Mathematics 2020-11-18 Anqi Fu , Junzi Zhang , Stephen Boyd

This paper studies a class of monotone inclusion problems in a real Hilbert space involving the sum of three operators, where two are maximal monotone and the third is cocoercive. The Davis--Yin three-operator splitting method extends the…

Optimization and Control · Mathematics 2026-05-14 Maoran Wang , Zijun Xia , Xingju Cai

In Hilbert space, we propose a family of primal-dual dynamical system for affine constrained convex optimization problem. Several damping coefficients, time scaling coefficients, and perturbation terms are thus considered. By constructing…

Optimization and Control · Mathematics 2021-06-28 Xin He , Rong Hu , Ya-Ping Fang