English
Related papers

Related papers: Augmentation-Based Preconditioners for Saddle-Poin…

200 papers

We study preconditioned proximal point methods for a class of saddle point problems, where the preconditioner decouples the overall proximal point method into an alternating primal--dual method. This is akin to the Chambolle--Pock method or…

Optimization and Control · Mathematics 2020-02-13 Tuomo Valkonen

We propose an unconditionally robust and highly effective preconditioner for general symmetric positive definite (SPD) matrices based on structured incomplete factorization (SIF), called enhanced SIF (eSIF) preconditioner. The original SIF…

Numerical Analysis · Mathematics 2020-07-09 Jianlin Xia

Circulant preconditioners are commonly used to accelerate the rate of convergence of iterative methods when solving linear systems of equations with a Toeplitz matrix. Block extensions that can be applied when the system has a block…

Numerical Analysis · Mathematics 2016-09-06 L. Dykes , S. Noschese , L. Reichel

We establish necessary and sufficient conditions for invertibility of symmetric three-by-three block matrices having a double saddle-point structure \fb{that guarantee the unique solvability of double saddle-point systems}. We consider…

Numerical Analysis · Mathematics 2024-07-04 Fatemeh P. A. Beik , Chen Greif , Manfred Trummer

We propose and analyze a general framework called nonlinear preconditioned primal-dual with projection for solving nonconvex-nonconcave and non-smooth saddle-point problems. The framework consists of two steps. The first is a nonlinear…

Optimization and Control · Mathematics 2024-01-11 Lu Zhang , Hongxia Wang , Hui Zhang

In this paper, we present novel randomized algorithms for solving saddle point problems whose dual feasible region is given by the direct product of many convex sets. Our algorithms can achieve an ${\cal O}(1/N)$ and ${\cal O}(1/N^2)$ rate…

Optimization and Control · Mathematics 2015-11-16 Cong Dang , Guanghui Lan

In this paper, a fast solver is studied for saddle point system arising from a second-order Crank-Nicolson discretization of an initial-valued parabolic PDE constrained optimal control problem, which is indefinite and ill-conditioned.…

Numerical Analysis · Mathematics 2023-12-21 Xue-Lei Lin , Shu-Lin Wu

Employing the ideas of non-linear preconditioning and testing of the classical proximal point method, we formalise common arguments in convergence rate and convergence proofs of optimisation methods to the verification of a simple…

Optimization and Control · Mathematics 2020-10-06 Tuomo Valkonen

The solution of matrices with $2\times 2$ block structure arises in numerous areas of computational mathematics, such as PDE discretizations based on mixed-finite element methods, constrained optimization problems, or the implicit or steady…

Numerical Analysis · Mathematics 2023-07-07 Ben S. Southworth , Abdullah A. Sivas , Sander Rhebergen

We study convex-concave saddle point problems with bilinear coupling, covering linearly constrained convex optimization and more general nonsmooth or constrained models via a proximable term in the dual objective. In linearly convergent…

Optimization and Control · Mathematics 2026-03-02 Meng Li , Paul Grigas

The theory of mixed finite element methods for solving different types of elliptic partial differential equations in saddle point formulation is well established since many decades. This topic was mostly studied for variational formulations…

Numerical Analysis · Mathematics 2024-03-04 Vitoriano Ruas

Model predictive control (MPC) for linear dynamical systems requires solving an optimal control structured quadratic program (QP) at each sampling instant. This paper proposes a primal active-set strategy (PRESAS) for the efficient solution…

Optimization and Control · Mathematics 2020-07-14 Rien Quirynen , Stefano Di Cairano

For the singular saddle-point problems with nonsymmetric positive definite $(1,1)$ block, we present a general constraint preconditioning (GCP) iteration method based on a singular constraint preconditioner. Using the properties of the…

Numerical Analysis · Mathematics 2013-12-30 Ai-Li Yang , Guo-Feng Zhang , Yu-Jiang Wu

We develop robust solvers for a class of perturbed saddle-point problems arising in the study of a second-order elliptic equation in mixed form (in terms of flux and potential), and of the four-field formulation of Biot's consolidation…

Numerical Analysis · Mathematics 2020-11-11 Wietse M. Boon , Miroslav Kuchta , Kent-Andre Mardal , Ricardo Ruiz-Baier

This study explores the integration of the hyper-power sequence, a method commonly employed for approximating the Moore-Penrose inverse, to enhance the effectiveness of an existing preconditioner. The approach is closely related to…

Computational Engineering, Finance, and Science · Computer Science 2023-11-14 Michał Łukasz Mika , Marco ten Eikelder , Dominik Schillinger , René Rinke Hiemstra

We propose a doubly stochastic primal-dual coordinate optimization algorithm for empirical risk minimization, which can be formulated as a bilinear saddle-point problem. In each iteration, our method randomly samples a block of coordinates…

Machine Learning · Computer Science 2017-04-13 Adams Wei Yu , Qihang Lin , Tianbao Yang

For 2x2 block matrices, it is well-known that block-triangular or block-LDU preconditioners with an exact Schur complement (inverse) converge in at most two iterations for fixed-point or minimal-residual methods. Similarly, for saddle-point…

Numerical Analysis · Mathematics 2020-01-06 Ben S. Southworth , Samuel A. Olivier

We present a modified version of the PRESB preconditioner for two-by-two block system of linear equations with the coefficient matrix $$\textbf{A}=\left(\begin{array}{cc} F & -G^* G & F \end{array}\right),$$ where $F\in\mathbb{C}^{n\times…

Numerical Analysis · Mathematics 2024-05-15 Owe Axelsson , Dovod Khojasteh Slakuyeh

High-order implicit shock tracking (fitting) is a class of high-order numerical methods that use numerical optimization to simultaneously compute a high-order approximation to a conservation law solution and align elements of the…

Numerical Analysis · Mathematics 2024-06-28 Jakob Vandergrift , Matthew J. Zahr

In this paper we address the numerical solution of the quadratic optimal transport problem in its dynamical form, the so-called Benamou-Brenier formulation. When solved using interior point methods, the main computational bottleneck is the…

Numerical Analysis · Mathematics 2024-01-22 Enrico Facca , Gabriele Todeschi , Andrea Natale , Michele Benzi