English
Related papers

Related papers: Toward Efficient Polynomial Preconditioning for GM…

200 papers

We present a novel preconditioning technique for proximal optimization methods that relies on graph algorithms to construct effective preconditioners. Such combinatorial preconditioners arise from partitioning the graph into forests. We…

Optimization and Control · Mathematics 2018-02-22 Thomas Möllenhoff , Zhenzhang Ye , Tao Wu , Daniel Cremers

This paper is concerned with the design, analysis and implementation of preconditioning concepts for spectral Discontinuous Galerkin discretizations of elliptic boundary value problems. While presently known techniques realize a growth of…

Numerical Analysis · Mathematics 2014-05-14 Kolja Brix , Martin Campos Pinto , Claudio Canuto , Wolfgang Dahmen

We consider an efficient preconditioner for boundary integral equation (BIE) formulations of the two-dimensional Stokes equations in porous media. While BIEs are well-suited for resolving the complex porous geometry, they lead to a dense…

Numerical Analysis · Mathematics 2016-09-16 Pieter Coulier , Bryan Quaife , Eric Darve

We present families of space-time finite element methods (STFEMs) for a coupled hyperbolic-parabolic system of poro- or thermoelasticity. Well-posedness of the discrete problems is proved. Higher order approximations inheriting most of the…

Numerical Analysis · Mathematics 2023-03-14 Mathias Anselmann , Markus Bause , Nils Margenberg , Pavel Shamko

A linearly implicit conservative difference scheme is applied to discretize the attractive coupled nonlinear Schr\"odinger equations with fractional Laplacian. Complex symmetric linear systems can be obtained, and the system matrices are…

Numerical Analysis · Mathematics 2023-10-19 Yan Cheng , Xi Yang

Incomplete LU factorizations of sparse matrices are widely used as preconditioners in Krylov subspace methods to speed up solving linear systems. Unfortunately, computing the preconditioner itself can be time-consuming and sensitive to…

Machine Learning · Computer Science 2024-12-12 Paul Häusner , Aleix Nieto Juscafresa , Jens Sjölund

In this note we exploit polynomial preconditioners for the Conjugate Gradient method to solve large symmetric positive definite linear systems in a parallel environment. We put in connection a specialized Newton method to solve the matrix…

Numerical Analysis · Mathematics 2020-11-30 Luca Bergamaschi , Angeles Martinez

In this paper, we address the efficient numerical solution of linear and quadratic programming problems, often of large scale. With this aim, we devise an infeasible interior point method, blended with the proximal method of multipliers,…

Numerical Analysis · Mathematics 2021-01-18 Luca Bergamaschi , Jacek Gondzio , Ángeles Martínez , John W. Pearson , Spyridon Pougkakiotis

This paper studies the solution of nonsymmetric linear systems by preconditioned Krylov methods based on the normal equations, LSQR in particular. On some examples, preconditioned LSQR is seen to produce errors many orders of magnitude…

Numerical Analysis · Mathematics 2025-03-06 Ethan N. Epperly , Anne Greenbaum , Yuji Nakatsukasa

We study the solution of block-structured linear algebra systems arising in optimization by using iterative solution techniques. These systems are the core computational bottleneck of many problems of interest such as parameter estimation,…

Optimization and Control · Mathematics 2019-09-10 Jose S. Rodriguez , Carl D. Laird , Victor M. Zavala

We study the performance of a new block preconditioner for a class of $3\times3$ block saddle point problems which arise from finite element methods for solving time-dependent Maxwell equations and some other practical problems. We also…

Numerical Analysis · Mathematics 2021-09-24 Maryam Abdolmaleki , Saeed Karimi , Davod Khojasteh Salkuyeh

Adaptive regularization methods pre-multiply a descent direction by a preconditioning matrix. Due to the large number of parameters of machine learning problems, full-matrix preconditioning methods are prohibitively expensive. We show how…

Machine Learning · Computer Science 2020-11-19 Naman Agarwal , Brian Bullins , Xinyi Chen , Elad Hazan , Karan Singh , Cyril Zhang , Yi Zhang

This paper provides the first provable $\mathcal{O}(N \log N)$ algorithms for the linear system arising from the direct finite element discretization of the fourth-order equation with different boundary conditions on unstructured grids of…

Numerical Analysis · Mathematics 2012-03-06 Shuo Zhang , Jinchao Xu

We present and analyze a class of nonsymmetric preconditioners within a normal (weighted least-squares) matrix form for use in GMRES to solve nonsymmetric matrix problems that typically arise in finite element discretizations. An example of…

Numerical Analysis · Mathematics 2014-09-02 Blanca Ayuso de Dios , Andrew T. Barker , Panayot S. Vassilevski

Stationary iterative methods with a symmetric splitting matrix are performed as inner-iteration preconditioning for Krylov subspace methods. We give conditions such that the inner-iteration preconditioning matrix is definite, and show that…

Numerical Analysis · Mathematics 2019-05-20 Keiichi Morikuni

When solving linear systems with nonsymmetric Toeplitz or multilevel Toeplitz matrices using Krylov subspace methods, the coefficient matrix may be symmetrized. The preconditioned MINRES method can then be applied to this symmetrized…

Numerical Analysis · Mathematics 2019-04-15 Jennifer Pestana

We develop a parallel-in-time multigrid preconditioner for augmented systems. These saddle-point systems are foundational to numerical optimization. Our preconditioner, when paired with a suitable optimization method, accelerates the…

Optimization and Control · Mathematics 2025-12-08 Radoslav Vuchkov , Eric C. Cyr , Aurya Javeed , Denis Ridzal

This paper presents a method for building a preconditioner for a kernel ridge regression problem, where the preconditioner is not only effective in its ability to reduce the condition number substantially, but also efficient in its…

Numerical Analysis · Mathematics 2021-04-07 Gil Shabat , Era Choshen , Dvir Ben Or , Nadav Carmel

Most finite element methods for solving time-harmonic wave-propagation problems lead to a linear system with a non-normal coefficient matrix. The non-normality is due to boundary conditions and losses. One way to solve these systems is to…

Numerical Analysis · Mathematics 2015-06-01 Antti Hannukainen

As integrated circuits become increasingly complex, the demand for efficient and accurate simulation solvers continues to rise. Traditional solvers often struggle with large-scale sparse systems, leading to prolonged simulation times and…

Numerical Analysis · Mathematics 2025-09-12 Zijian Zhang , Rui Hong , Xuesong Chen , Shuting Cai