English
Related papers

Related papers: Preconditioned Krylov solvers for kernel regressio…

200 papers

This work is on a user-friendly reduced basis method for solving a family of parametric PDEs by preconditioned Krylov subspace methods including the conjugate gradient method, generalized minimum residual method, and bi-conjugate gradient…

Numerical Analysis · Mathematics 2026-02-24 Yuwen Li , Ludmil T. Zikatanov , Cheng Zuo

The computation of sparse solutions of large-scale linear discrete ill-posed problems remains a computationally demanding task. A powerful framework in this context is the use of iteratively reweighted schemes, which are based on…

Numerical Analysis · Mathematics 2025-10-14 Malena Sabaté Landman , Yuji Nakatsukasa

Most efficient linear solvers use composable algorithmic components, with the most common model being the combination of a Krylov accelerator and one or more preconditioners. A similar set of concepts may be used for nonlinear algebraic…

Numerical Analysis · Mathematics 2016-07-15 Peter R. Brune , Matthew G. Knepley , Barry F. Smith , Xuemin Tu

We propose an alternative implementation of preconditioning techniques for the solution of non-linear problems. Within the framework of Newton-Krylov methods, preconditioning techniques are needed to improve the performance of the solvers.…

Computational Physics · Physics 2008-04-02 G. Lapenta , S. Ju

Gaussian process hyperparameter optimization requires linear solves with, and log-determinants of, large kernel matrices. Iterative numerical techniques are becoming popular to scale to larger datasets, relying on the conjugate gradient…

Machine Learning · Computer Science 2022-06-22 Jonathan Wenger , Geoff Pleiss , Philipp Hennig , John P. Cunningham , Jacob R. Gardner

In this thesis, the numerical solution of three different classes of problems have been studied. Specifically, new techniques have been proposed and their theoretical analysis has been performed, accompanied by a wide set of numerical…

Numerical Analysis · Mathematics 2022-05-03 Nikos Barakitis

Preconditioning of a linear system obtained from spectral discretization of time-dependent PDEs often results in a full matrix which is expensive to compute and store specially when the problem size increases. A matrix-free implementation…

Statistics Theory · Mathematics 2016-06-09 A. Ghasemi , L. K. Taylor

The discretization of the double-layer potential integral equation for the interior Dirichlet Laplace problem in a domain with smooth boundary results in a linear system that has a bounded condition number. Thus, the number of iterations…

Numerical Analysis · Mathematics 2014-02-27 Bryan Quaife , George Biros

Iterative solvers for large-scale linear systems such as Krylov subspace methods can diverge when the linear system is ill-conditioned, thus significantly reducing the applicability of these iterative methods in practice for…

Numerical Analysis · Mathematics 2025-07-24 Vasileios Kalantzis , Mark S. Squillante , Chai Wah Wu

We present variants of the Conjugate Gradient (CG), Conjugate Residual (CR), and Generalized Minimal Residual (GMRES) methods which are both pipelined and flexible. These allow computation of inner products and norms to be overlapped with…

Numerical Analysis · Mathematics 2016-09-16 Patrick Sanan , Sascha M. Schnepp , Dave. A. May

We introduce the Neural Preconditioning Operator (NPO), a novel approach designed to accelerate Krylov solvers in solving large, sparse linear systems derived from partial differential equations (PDEs). Unlike classical preconditioners that…

Computational Engineering, Finance, and Science · Computer Science 2025-02-10 Zhihao Li , Di Xiao , Zhilu Lai , Wei Wang

For several classes of mathematical models that yield linear systems, the splitting of the matrix into its Hermitian and skew Hermitian parts is naturally related to properties of the underlying model. This is particularly so for…

Numerical Analysis · Mathematics 2023-01-02 Malak Diab , Andreas Frommer , Karsten Kahl

We develop a simple algorithmic framework to solve large-scale symmetric positive definite linear systems. At its core, the framework relies on two components: (1) a norm-convergent iterative method (i.e. smoother) and (2) a preconditioner.…

Numerical Analysis · Mathematics 2013-02-18 Xiaozhe Hu , Shuhong Wu , Xiao-Hui Wu , Jinchao Xu , Chen-Song Zhang , Shiquan Zhang , Ludmil Zikatanov

This paper studies the solution of nonsymmetric linear systems by preconditioned Krylov methods based on the normal equations, LSQR in particular. On some examples, preconditioned LSQR is seen to produce errors many orders of magnitude…

Numerical Analysis · Mathematics 2025-03-06 Ethan N. Epperly , Anne Greenbaum , Yuji Nakatsukasa

In classical frameworks as the Euclidean space, positive definite kernels as well as their analytic properties are explicitly available and can be incorporated directly in kernel-based learning algorithms. This is different if the…

Numerical Analysis · Mathematics 2023-01-18 Wolfgang Erb

Classical iterative methods for tomographic reconstruction include the class of Algebraic Reconstruction Techniques (ART). Convergence of these stationary linear iterative methods is however notably slow. In this paper we propose the use of…

Numerical Analysis · Mathematics 2015-01-22 Siegfried Cools , Pieter Ghysels , Wim van Aarle , J. Sijbers , Wim Vanroose

It is well-known that the convergence of Krylov subspace methods to solve linear system depends on the spectrum of the coefficient matrix, moreover, it is widely accepted that for both symmetric and unsymmetric systems Krylov subspace…

Numerical Analysis · Mathematics 2013-04-09 Tao Zhao

This paper studies and analyzes a preconditioned Krylov solver for Helmholtz problems that are formulated with absorbing boundary layers based on complex coordinate stretching. The preconditioner problem is a Helmholtz problem where not…

Numerical Analysis · Computer Science 2010-08-19 Bram Reps , Wim Vanroose , Hisham bin Zubair

This paper introduces new solvers for the computation of low-rank approximate solutions to large-scale linear problems, with a particular focus on the regularization of linear inverse problems. Although Krylov methods incorporating explicit…

Numerical Analysis · Mathematics 2019-11-05 Silvia Gazzola , Chang Meng , James Nagy

In this paper, we consider an efficient iterative approach to the solution of the discrete Helmholtz equation with Dirichlet, Neumann and Sommerfeld-like boundary conditions based on a compact sixth order approximation scheme and…

Numerical Analysis · Mathematics 2012-12-07 Yury Gryazin