English
Related papers

Related papers: A stochastic preconditioned Douglas-Rachford split…

200 papers

In this paper, we design an inertial accelerated primal-dual algorithm to address the convex-concave saddle point problem, which is formulated as $\min_{x}\max_{y} f(x) + \langle Kx, y \rangle - g(y)$. Remarkably, both functions $f$ and $g$…

Optimization and Control · Mathematics 2024-04-17 X. He , N. J. Huang , Y. P. Fang

Our interest lies in developing some efficient methods for minimizing the sum of two geodesically convex functions on Hadamard manifolds, with the aim to enhance the convergence of the Douglas-Rachford algorithm in Hadamard manifolds.…

Optimization and Control · Mathematics 2026-02-17 D. R. Sahu , Shikher Sharma , Pankaj Gautam

Recently, saddle point problems have received much attention due to their powerful modeling capability for a lot of problems from diverse domains. Applications of these problems occur in many applied areas, such as robust optimization,…

Optimization and Control · Mathematics 2022-02-15 Mohammad Alkousa , Alexander Gasnikov , Pavel Dvurechensky , Abdurakhmon Sadiev , Lama Razouk

The Douglas-Rachford projection algorithm is an iterative method used to find a point in the intersection of closed constraint sets. The algorithm has been experimentally observed to solve various nonconvex feasibility problems which…

Optimization and Control · Mathematics 2020-04-06 Minh N. Dao , Matthew K. Tam

We propose a Nested BDDC for a class of saddle-point problems. The method solves for both flux and pressure variables. The fluxes are resolved in three-steps: the coarse solve is followed by subdomain solves, and last we look for a…

Numerical Analysis · Mathematics 2014-07-17 Bedřich Sousedík

We propose and analyze the convergence of a novel stochastic forward-backward splitting algorithm for solving monotone inclusions given by the sum of a maximal monotone operator and a single-valued maximal monotone cocoercive operator. This…

Optimization and Control · Mathematics 2015-02-23 Lorenzo Rosasco , Silvia Villa , Bang Công Vũ

In this paper, we propose a primal-dual algorithm with a novel momentum term using the partial gradients of the coupling function that can be viewed as a generalization of the method proposed by Chambolle and Pock in 2016 to solve saddle…

Optimization and Control · Mathematics 2020-10-22 Erfan Yazdandoost Hamedani , Necdet Serhat Aybat

The first order condition of the constrained minimization problem leads to a saddle point problem. A multigrid method using a multiplicative Schwarz smoother for saddle point problems can thus be interpreted as a successive subspace…

Numerical Analysis · Mathematics 2016-01-19 Long Chen

For nonsymmetric block three-by-three singular saddle point problems arising from the Picard iteration method for a class of mixed finite element scheme, recently Salkuyeh et al. in (D.K. Salkuyeh, H. Aslani, Z.Z. Liang, An alternating…

Numerical Analysis · Mathematics 2022-08-02 Hamed Aslani , Davod Khojasteh Salkuyeh

The authors in (Banjac et al., 2019) recently showed that the Douglas-Rachford algorithm provides certificates of infeasibility for a class of convex optimization problems. In particular, they showed that the difference between consecutive…

Optimization and Control · Mathematics 2021-02-08 Goran Banjac , John Lygeros

In this paper, we study the generalized Douglas-Rachford algorithm and its cyclic variants which include many projection-type methods such as the classical Douglas-Rachford algorithm and the alternating projection algorithm. Specifically,…

Optimization and Control · Mathematics 2020-04-14 Minh N. Dao , Hung M. Phan

We investigate a primal-dual (PD) method for the saddle point problem (SPP) that uses a linear approximation of the primal function instead of the standard proximal step, resulting in a linearized PD (LPD) method. For convex-strongly…

Optimization and Control · Mathematics 2023-05-19 Mohammad Khalafi , Digvijay Boob

Using convex combination and linesearch techniques, we introduce a novel primal-dual algorithm for solving structured convex-concave saddle point problems with a generic smooth nonbilinear coupling term. Our adaptive linesearch strategy…

Optimization and Control · Mathematics 2024-01-17 Xiaokai Chang , Junfeng Yang , Hongchao Zhang

The Douglas-Rachford algorithm is a simple yet effective method for solving convex feasibility problems. However, if the underlying constraints are inconsistent, then the convergence theory is incomplete. We provide convergence results when…

Optimization and Control · Mathematics 2020-04-14 Heinz H. Bauschke , Minh N. Dao , Walaa M. Moursi

In this paper, we propose a new algorithm combining the Douglas-Rachford (DR) algorithm and the Frank-Wolfe algorithm, also known as the conditional gradient (CondG) method, for solving the classic convex feasibility problem. Within the…

Optimization and Control · Mathematics 2021-06-09 R. Díaz Millán , O. P. Ferreira , J. Ugon

The Douglas-Rachford method, a projection algorithm designed to solve continuous optimization problems, forms the basis of a useful heuristic for solving combinatorial optimization problems. In order to successfully use the method, it is…

Optimization and Control · Mathematics 2019-04-22 Francisco J. Aragón Artacho , Rubén Campoy , Matthew K. Tam

In this paper we propose a class of randomized primal-dual methods to contend with large-scale saddle point problems defined by a convex-concave function $\mathcal{L}(\mathbf{x},y)\triangleq\sum_{i=1}^m f_i(x_i)+\Phi(\mathbf{x},y)-h(y)$. We…

Optimization and Control · Mathematics 2023-03-17 E. Yazdandoost Hamedani , A. Jalilzadeh , N. S. Aybat

We consider the solution of saddle-point systems with a tree-based block structure, introducing a parallelizable direct method for their solution. As our key contribution, we then propose several structure-exploiting preconditioners to be…

Numerical Analysis · Mathematics 2024-11-01 Christoph Hansknecht , Bernhard Heinzelreiter , John W. Pearson , Andreas Potschka

Solving feasibility problems is a central task in mathematics and the applied sciences. One particularly successful method is the Douglas-Rachford algorithm. In this paper, we provide many new conditions sufficient for finite convergence.…

Optimization and Control · Mathematics 2020-04-14 Heinz H. Bauschke , Minh N. Dao

Policy evaluation is a crucial step in many reinforcement-learning procedures, which estimates a value function that predicts states' long-term value under a given policy. In this paper, we focus on policy evaluation with linear function…

Machine Learning · Computer Science 2017-06-12 Simon S. Du , Jianshu Chen , Lihong Li , Lin Xiao , Dengyong Zhou