English
Related papers

Related papers: Factorized Krylov subspace methods for solving lar…

200 papers

Randomized iterative methods, such as the randomized Kaczmarz method, have gained significant attention for solving large-scale linear systems due to their simplicity and efficiency. Meanwhile, Krylov subspace methods have emerged as a…

Numerical Analysis · Mathematics 2025-05-28 Yonghan Sun , Deren Han , Jiaxin Xie

This paper introduces new solvers for the computation of low-rank approximate solutions to large-scale linear problems, with a particular focus on the regularization of linear inverse problems. Although Krylov methods incorporating explicit…

Numerical Analysis · Mathematics 2019-11-05 Silvia Gazzola , Chang Meng , James Nagy

An efficient Krylov subspace algorithm for computing actions of the $\varphi$ matrix function for large matrices is proposed. This matrix function is widely used in exponential time integration, Markov chains and network analysis and many…

Numerical Analysis · Mathematics 2020-10-20 Mike A. Botchev , Leonid A. Knizhnerman , Eugene E. Tyrtyshnikov

PDE-constrained optimization problems arise in a broad number of applications such as hyperthermia cancer treatment or blood flow simulation. Discretization of the optimization problem and using a Lagrangian approach result in a large-scale…

Numerical Analysis · Mathematics 2020-06-01 Alexandra Bünger , Valeria Simoncini , Martin Stoll

Many optimization problems require hyperparameters, i.e., parameters that must be pre-specified in advance, such as regularization parameters and parametric regularizers in variational regularization methods for inverse problems, and…

Optimization and Control · Mathematics 2025-10-09 Matthias J. Ehrhardt , Silvia Gazzola , Sebastian J. Scott

Bilevel optimization, with broad applications in machine learning, has an intricate hierarchical structure. Gradient-based methods have emerged as a common approach to large-scale bilevel problems. However, the computation of the…

Optimization and Control · Mathematics 2025-02-27 Yan Yang , Bin Gao , Ya-xiang Yuan

Krylov subspace methods are widely known as efficient algebraic methods for solving large scale linear systems. However, on massively parallel hardware the performance of these methods is typically limited by communication latency rather…

Numerical Analysis · Computer Science 2018-08-22 Siegfried Cools

The use of block Krylov subspace methods for computing the solution to a sequence of shifted linear systems using subspace recycling was first proposed in [Soodhalter, SISC 2016], where a recycled shifted block GMRES algorithm (rsbGMRES)…

Numerical Analysis · Mathematics 2022-09-16 Liam Burke

Performing Bayesian inference on large spatio-temporal models requires extracting inverse elements of large sparse precision matrices for marginal variances, as well as estimating model hyperparameters. Although direct matrix factorizations…

Computation · Statistics 2026-03-17 Abylay Zhumekenov , Elias T. Krainski , Håvard Rue

This paper deals with the definition and optimization of augmentation spaces for faster convergence of the conjugate gradient method in the resolution of sequences of linear systems. Using advanced convergence results from the literature,…

Numerical Analysis · Mathematics 2013-02-01 Pierre Gosselet , Christian Rey , Julien Pebrel

A Krylov subspace recycling method for the efficient evaluation of a sequence of matrix functions acting on a set of vectors is developed. The method improves over the recycling methods presented in [Burke et al., arXiv:2209.14163, 2022] in…

Numerical Analysis · Mathematics 2023-08-23 Liam Burke , Stefan Güttel

This work develops novel rational Krylov methods for updating a large-scale matrix function f(A) when A is subject to low-rank modifications. It extends our previous work in this context on polynomial Krylov methods, for which we present a…

Numerical Analysis · Mathematics 2020-08-27 Bernhard Beckermann , Alice Cortinovis , Daniel Kressner , Marcel Schweitzer

We consider the solution of the Sylvester equation $AX+XB=C$ in mixed precision. We derive a new iterative refinement scheme to solve perturbed quasi-triangular Sylvester equations; our rounding error analysis provides sufficient conditions…

Numerical Analysis · Mathematics 2026-03-27 Andrii Dmytryshyn , Massimiliano Fasi , Nicholas J. Higham , Xiaobo Liu

In this work, we propose a reduced basis method for efficient solution of parametric linear systems. The coefficient matrix is assumed to be a linear matrix-valued function that is symmetric and positive definite for admissible values of…

Numerical Analysis · Mathematics 2021-09-28 Antti Autio , Antti Hannukainen

We introduce a low-rank algorithm inspired by the Basis-Update and Galerkin (BUG) integrator to efficiently approximate solutions to Sylvester-type equations. The algorithm can exploit both the low-rank structure of the solution as well as…

Numerical Analysis · Mathematics 2025-11-04 Georgios Vretinaris

With the emergence of mixed precision capabilities in hardware, iterative refinement schemes for solving linear systems $Ax=b$ have recently been revisited and reanalyzed in the context of three or more precisions. These new analyses show…

Numerical Analysis · Mathematics 2022-02-17 Eda Oktay , Erin Carson

Low-rank Krylov methods are one of the few options available in the literature to address the numerical solution of large-scale general linear matrix equations. These routines amount to well-known Krylov schemes that have been equipped with…

Numerical Analysis · Mathematics 2020-01-28 Davide Palitta , Patrick Kürschner

We present a circulant and skew-circulant splitting (CSCS) iterative method for solving large sparse continuous Sylvester equations $AX + XB = C$, where the coefficient matrices $A$ and $B$ are Toeplitz matrices. A theoretical study shows…

Numerical Analysis · Mathematics 2021-08-10 Zhongyun Liu , Fang Zhang , Carla Ferreira , Yulin Zhang

In this paper we develop randomized Krylov subspace methods for efficiently computing regularized solutions to large-scale linear inverse problems. Building on the recently developed randomized Gram-Schmidt process, where sketched inner…

Numerical Analysis · Mathematics 2025-08-29 Julianne Chung , Silvia Gazzola

We propose a symmetric low-rank representation (SLRR) method for subspace clustering, which assumes that a data set is approximately drawn from the union of multiple subspaces. The proposed technique can reveal the membership of multiple…

Computer Vision and Pattern Recognition · Computer Science 2015-11-24 Jie Chen , Haixian Zhang , Hua Mao , Yongsheng Sang , Zhang Yi