English
Related papers

Related papers: A survey of subspace recycling iterative methods

200 papers

The use of block Krylov subspace methods for computing the solution to a sequence of shifted linear systems using subspace recycling was first proposed in [Soodhalter, SISC 2016], where a recycled shifted block GMRES algorithm (rsbGMRES)…

Numerical Analysis · Mathematics 2022-09-16 Liam Burke

Rational Krylov subspaces have become a reference tool in dimension reduction procedures for several application problems. When data matrices are symmetric, a short-term recurrence can be used to generate an associated orthonormal basis. In…

Numerical Analysis · Mathematics 2021-12-21 Davide Palitta , Stefano Pozza , Valeria Simoncini

We focus on robust and efficient iterative solvers for the pressure Poisson equation in incompressible Navier-Stokes problems. Preconditioned Krylov subspace methods are popular for these problems, with BiCGStab and GMRES(m) most frequently…

Numerical Analysis · Computer Science 2015-09-29 Amit Amritkar , Eric de Sturler , Katarzyna Świrydowicz , Danesh Tafti , Kapil Ahuja

Many problems in science and engineering fields require the solution of shifted linear systems. To solve such systems efficiently, the recycling BiCG (RBiCG) algorithm in [SIAM J. SCI. COMPUT, 34 (2012) 1925-1949] is extended in this paper.…

Numerical Analysis · Mathematics 2014-06-26 Jing Meng , Pei-yong Zhu , Hou-Biao Li

Augmented Krylov subspace methods aid in accelerating the convergence of a standard Krylov subspace method by including additional vectors in the search space. A residual projection framework based on residual (Petrov-) Galerkin constraints…

Numerical Analysis · Mathematics 2023-05-19 Liam Burke , Kirk M. Soodhalter

Many Krylov subspace methods for shifted linear systems take advantage of the invariance of the Krylov subspace under a shift of the matrix. However, exploiting this fact in the non-Hermitian case introduces restrictions; e.g., initial…

Numerical Analysis · Mathematics 2016-02-05 Kirk M. Soodhalter

We present a new Krylov subspace recycling method for solving a linear system of equations, or a sequence of slowly changing linear systems. Our approach is to reduce the computational overhead of recycling techniques while still benefiting…

Numerical Analysis · Mathematics 2024-09-30 Liam Burke , Stefan Güttel , Kirk M. Soodhalter

Many scientific applications require the evaluation of the action of the matrix function over a vector and the most common methods for this task are those based on the Krylov subspace. Since the orthogonalization cost and memory requirement…

Numerical Analysis · Mathematics 2026-03-24 Nicolas L. Guidotti , Per-Gunnar Martinsson , Juan A. Acebrón , José Monteiro

Mixed-effects models are widely used to model data with hierarchical grouping structures and high-cardinality categorical predictor variables. However, for high-dimensional crossed random effects, current standard computations relying on…

Methodology · Statistics 2026-05-15 Pascal Kündig , Fabio Sigrist

This paper surveys an important class of methods that combine iterative projection methods and variational regularization methods for large-scale inverse problems. Iterative methods such as Krylov subspace methods are invaluable in the…

Numerical Analysis · Mathematics 2021-08-23 Julianne Chung , Silvia Gazzola

A standard approach to model reduction of large-scale higher-order linear dynamical systems is to rewrite the system as an equivalent first-order system and then employ Krylov-subspace techniques for model reduction of first-order systems.…

Numerical Analysis · Mathematics 2007-05-23 Roland W. Freund

Reconstructing high-quality images with sharp edges requires the use of edge-preserving constraints in the regularized form of the inverse problem. The use of the $\ell_q$-norm on the gradient of the image is a common such constraint. For…

Numerical Analysis · Mathematics 2023-09-28 Mirjeta Pasha , Eric de Sturler , Misha E. Kilmer

Krylov subspace methods are a powerful family of iterative solvers for linear systems of equations, which are commonly used for inverse problems due to their intrinsic regularization properties. Moreover, these methods are naturally suited…

The discretization of convection-diffusion equations by implicit or semi-implicit methods leads to a sequence of linear systems usually solved by iterative linear solvers such as GMRES. Many techniques bearing the name of \emph{recycling…

Numerical Analysis · Mathematics 2018-07-26 Giuseppe Pitton , Luca Heltai

Iterative hybrid projection methods have proven to be very effective for solving large linear inverse problems due to their inherent regularizing properties as well as the added flexibility to select regularization parameters adaptively. In…

Numerical Analysis · Mathematics 2020-07-02 Julianne Chung , Eric de Sturler , Jiahua Jiang

It is shown in this paper that, almost all current prevalent iterative \mbox{methods} for solving linear system of equations can be classified as what we called extended Krylov subspace methods. In this paper a new type of iterative methods…

Numerical Analysis · Mathematics 2016-03-18 Wujian Peng , Shuhua Zhang

Block Krylov subspace methods (KSMs) comprise building blocks in many state-of-the-art solvers for large-scale matrix equations as they arise, e.g., from the discretization of partial differential equations. While extended and rational…

Numerical Analysis · Mathematics 2020-02-06 Daniel Kressner , Kathryn Lund , Stefano Massei , Davide Palitta

One of the limitations of recycled GCRO methods is the large amount of computation required to orthogonalize the basis vectors of the newly generated Krylov subspace for the approximate solution when combined with those of the recycle…

Numerical Analysis · Mathematics 2023-06-12 Stephen Thomas , Alison Baker , Stephane Gaudreault

Several problems in machine learning, statistics, and other fields rely on computing eigenvectors. For large scale problems, the computation of these eigenvectors is typically performed via iterative schemes such as subspace iteration or…

Numerical Analysis · Mathematics 2020-11-03 Vasileios Charisopoulos , Austin R. Benson , Anil Damle

Learning neural operators for solving partial differential equations (PDEs) has attracted great attention due to its high inference efficiency. However, training such operators requires generating a substantial amount of labeled data, i.e.,…

Machine Learning · Computer Science 2024-03-20 Hong Wang , Zhongkai Hao , Jie Wang , Zijie Geng , Zhen Wang , Bin Li , Feng Wu