English
Related papers

Related papers: Ideal Preconditioners for Saddle Point Systems wit…

200 papers

In this paper, we investigate delayed linear difference systems and establish several fundamental results. We first provide a Kalman-type rank condition tailored for delayed linear difference systems. Furthermore, we construct the discrete…

Optimization and Control · Mathematics 2025-08-20 Javad A. Asadzade , Nazim I. Mahmudov

A central challenge to using first-order methods for optimizing nonconvex problems is the presence of saddle points. First-order methods often get stuck at saddle points, greatly deteriorating their performance. Typically, to escape from…

Machine Learning · Computer Science 2017-09-06 Sashank J Reddi , Manzil Zaheer , Suvrit Sra , Barnabas Poczos , Francis Bach , Ruslan Salakhutdinov , Alexander J Smola

Solving linear systems is often the computational bottleneck in real-life problems. Iterative solvers are the only option due to the complexity of direct algorithms or because the system matrix is not explicitly known. Here, we develop a…

Numerical Analysis · Computer Science 2020-10-08 Joris Tavernier , Jaak Simm , Karl Meerbergen , Yves Moreau

In this paper, several projection method based preconditioners for various incompressible flow models are studied. In particular, we are interested in the theoretical analysis of a pressure-correction projection method based preconditioner…

Numerical Analysis · Mathematics 2013-12-12 Mingchao Cai

This paper shows that a perturbed form of gradient descent converges to a second-order stationary point in a number iterations which depends only poly-logarithmically on dimension (i.e., it is almost "dimension-free"). The convergence rate…

Machine Learning · Computer Science 2017-03-03 Chi Jin , Rong Ge , Praneeth Netrapalli , Sham M. Kakade , Michael I. Jordan

The generalized Golub-Kahan bidiagonalization has been used to solve saddle-point systems where the leading block is symmetric and positive definite. We extend this iterative method for the case where the symmetry condition no longer holds.…

Numerical Analysis · Mathematics 2023-10-12 Andrei Dumitrasc , Carola Kruse , Ulrich Ruede

We study a preconditioner for a Hermitian positive definite linear system, which is obtained as the solution of a matrix nearness problem based on the Bregman log determinant divergence. The preconditioner is of the form of a Hermitian…

Numerical Analysis · Mathematics 2023-12-15 Andreas Bock , Martin S. Andersen

We show that a combination of two simple preprocessing steps would generally improve the conditioning of a homogeneous system of linear inequalities. Our approach is based on a comparison among three different but related notions of…

Optimization and Control · Mathematics 2013-06-25 Javier Pena , Vera Roshchina , Negar Soheili

We propose an inexact Uzawa algorithm with two variable relaxation parameters for solving the generalized saddle-point system. The saddle-point problems can be found in a wide class of applications, such as the augmented Lagrangian…

Numerical Analysis · Mathematics 2014-08-26 Kazufumi Ito , Hua Xiang , Jun Zou

We introduce a novel strategy for constructing symmetric positive definite (SPD) preconditioners for linear systems with symmetric indefinite matrices. The strategy, called absolute value preconditioning, is motivated by the observation…

Numerical Analysis · Mathematics 2016-10-20 Eugene Vecharynski , Andrew V. Knyazev

We consider the problem of identifying the sparse principal component of a rank-deficient matrix. We introduce auxiliary spherical variables and prove that there exists a set of candidate index-sets (that is, sets of indices to the nonzero…

Information Theory · Computer Science 2011-06-10 Megasthenis Asteris , Dimitris S. Papailiopoulos , George N. Karystinos

In this note we present a parameterized class of lower triangular matrices. The components of the eigenvectors grow rapidly and will exceed the representational range of any finite number system. The eigenvalues and the eigenvectors are…

Numerical Analysis · Mathematics 2020-05-13 Carl Christian Kjelgaard Mikkelsen

In this paper, we propose an algorithm for the construction of low-rank approximations of the inverse of an operator given in low-rank tensor format. The construction relies on an updated greedy algorithm for the minimization of a suitable…

Numerical Analysis · Mathematics 2017-05-11 Loic Giraldi , Anthony Nouy , Gregory Legrain

In this paper, we further investigate and refine the subspace-constrained preconditioning technique to enhance the theoretical and numerical convergence properties of randomized iterative methods for solving linear systems. In particular,…

Numerical Analysis · Mathematics 2026-05-29 Yonghan Sun , Hou-Duo Qi , Deren Han , Jiaxin Xie

We develop a simple algorithmic framework to solve large-scale symmetric positive definite linear systems. At its core, the framework relies on two components: (1) a norm-convergent iterative method (i.e. smoother) and (2) a preconditioner.…

Numerical Analysis · Mathematics 2013-02-18 Xiaozhe Hu , Shuhong Wu , Xiao-Hui Wu , Jinchao Xu , Chen-Song Zhang , Shiquan Zhang , Ludmil Zikatanov

This article considers the iterative solution of a finite element discretisation of the magma dynamics equations. In simplified form, the magma dynamics equations share some features of the Stokes equations. We therefore formulate, analyse…

Numerical Analysis · Mathematics 2016-07-08 Sander Rhebergen , Garth N. Wells , Richard F. Katz , Andrew J. Wathen

A class of preconditioners is introduced to enhance geometry optimisation and transition state search of molecular systems. We start from the Hessian of molecular mechanical terms, decompose it and retain only its positive definite part to…

Chemical Physics · Physics 2018-04-06 Letif Mones , Gabor Csanyi , Christoph Ortner

In this paper, we investigate the preconditioned AOR method for solving linear systems. We study two general preconditioners and propose some lower triangular, upper triangular and combination preconditioners. For $A$ being an L-matrix, a…

Numerical Analysis · Mathematics 2020-02-04 Yongzhong Song

In dynamical systems governed by differential equations, a guarantee that trajectories emanating from a given set of initial conditions do not enter another given set can be obtained by constructing a barrier function that satisfies certain…

Chaotic Dynamics · Physics 2022-05-26 Jeremy P Parker , David Goluskin , Geoffrey M Vasil

The problem of finding a rank-one solution to a system of linear matrix equations arises from many practical applications. Given a system of linear matrix equations, however, such a low-rank solution does not always exist. In this paper, we…

Optimization and Control · Mathematics 2012-11-12 Yunbin Zhao , Masao Fukushima