English
Related papers

Related papers: Connecting randomized iterative methods with Krylo…

200 papers

We present an iterative generalisation of the quantum subspace expansion algorithm used with a Krylov basis. The iterative construction connects a sequence of subspaces via their lowest energy states. Diagonalising a Hamiltonian in a given…

Quantum Physics · Physics 2025-05-07 Tom O'Leary , Lewis W. Anderson , Dieter Jaksch , Martin Kiffner

This paper deals with the definition and optimization of augmentation spaces for faster convergence of the conjugate gradient method in the resolution of sequences of linear systems. Using advanced convergence results from the literature,…

Numerical Analysis · Mathematics 2013-02-01 Pierre Gosselet , Christian Rey , Julien Pebrel

We propose a new method for preconditioning Kaczmarz method by sketching. Kaczmarz method is a stochastic method for solving overdetermined linear systems based on a sampling of matrix rows. The standard approach to speed up convergence of…

Numerical Analysis · Computer Science 2019-03-06 Alexandr Katrutsa , Ivan Oseledets

Krylov subspace recycling is a powerful tool for solving long series of large, sparse linear systems that change slowly. In PDE constrained shape optimization, these appear naturally, as hundreds or more optimization steps are needed with…

Numerical Analysis · Mathematics 2020-10-23 Matthias Bolten , Eric de Sturler , Camilla Hahn

In this paper, we propose a novel reduced-rank adaptive filtering algorithm by blending the idea of the Krylov subspace methods with the set-theoretic adaptive filtering framework. Unlike the existing Krylov-subspace-based reduced-rank…

Information Theory · Computer Science 2013-06-28 R. C. de Lamare , M. Yukawa , I. Yamada

Solving linear systems of equations is a fundamental problem in mathematics. When the linear system is so large that it cannot be loaded into memory at once, iterative methods such as the randomized Kaczmarz method excel. Here, we extend…

Numerical Analysis · Mathematics 2020-06-03 Anna Ma , Denali Molitor

Among recent developments centered around Randomized Kaczmarz (RK), a row-sampling iterative projection method for large-scale linear systems, several adaptions to the method have inspired faster convergence. Focusing solely on…

Numerical Analysis · Mathematics 2026-03-03 James Nguyen , Oleg Presnyakov , Adityakrishnan Radhakhrishnan

The Rosenbrock-Krylov family of time integration schemes is an extension of Rosenbrock-W methods that employs a specific Krylov based approximation of the linear system solutions arising within each stage of the integrator. This work…

Numerical Analysis · Mathematics 2019-10-08 Paul Tranquilli , Ross Glandon , Adrian Sandu

The Kaczmarz algorithm is a popular solver for overdetermined linear systems due to its simplicity and speed. In this paper, we propose a modification that speeds up the convergence of the randomized Kaczmarz algorithm for systems of linear…

Numerical Analysis · Computer Science 2013-05-17 Hassan Mansour , Ozgur Yilmaz

Krylov subspace methods, such as the Conjugate Gradient (CG) and BiCGSTAB methods, are widely used in scientific computing for solving linear systems. In this study, we propose a new framework for solving large Sylvester equations in a…

Numerical Analysis · Mathematics 2026-05-28 Yuki Satake , Takeshi Fukaya , Tomohiro Sogabe , Shao-Liang Zhang

The Randomized Kaczmarz method (RK) is a stochastic iterative method for solving linear systems that has recently grown in popularity due to its speed and low memory requirement. Selectable Set Randomized Kaczmarz (SSRK) is an variant of RK…

Numerical Analysis · Mathematics 2022-02-04 Yotam Yaniv , Jacob D. Moorman , William Swartworth , Thomas Tu , Daji Landis , Deanna Needell

The block Kaczmarz method is an iterative scheme for solving overdetermined least-squares problems. At each step, the algorithm projects the current iterate onto the solution space of a subset of the constraints. This paper describes a…

Numerical Analysis · Mathematics 2015-03-20 Deanna Needell , Joel A. Tropp

In this paper, we propose a federated algorithm for solving large linear systems that is inspired by the classic randomized Kaczmarz algorithm. We provide convergence guarantees of the proposed method, and as a corollary of our analysis, we…

Numerical Analysis · Mathematics 2025-05-15 Halyun Jeong , Deanna Needell , Chi-Hao Wu

We consider the solution of large stiff systems of ordinary differential equations with explicit exponential Runge--Kutta integrators. These problems arise from semi-discretized semi-linear parabolic partial differential equations on…

Numerical Analysis · Mathematics 2023-08-24 Kai Bergermann , Martin Stoll

Randomized iterative algorithms for solving a factorized linear system, $\mathbf A\mathbf B\mathbf x=\mathbf b$ with $\mathbf A\in{\mathbb{R}}^{m\times \ell}$, $\mathbf B\in{\mathbb{R}}^{\ell\times n}$, and $\mathbf b\in{\mathbb{R}}^m$,…

Numerical Analysis · Mathematics 2023-07-25 Kui Du

We use a unified framework to summarize sixteen randomized iterative methods including Kaczmarz method, coordinate descent method, etc. Some new iterative schemes are given as well. Some relationships with \textsc{mg} and \textsc{ddm} are…

Numerical Analysis · Mathematics 2017-09-01 Hua Xiang , Lin Zhang

Bivariate matrix functions provide a unified framework for various tasks in numerical linear algebra, including the solution of linear matrix equations and the application of the Fr\'echet derivative. In this work, we propose a novel…

Numerical Analysis · Mathematics 2018-02-22 Daniel Kressner

Randomized orthogonal projection methods (ROPMs) can be used to speed up the computation of Krylov subspace methods in various contexts. Through a theoretical and numerical investigation, we establish that these methods produce…

Numerical Analysis · Mathematics 2023-03-14 Edouard Timsit , Laura Grigori , Oleg Balabanov

The sketch-and-project, as a general archetypal algorithm for solving linear systems, unifies a variety of randomized iterative methods such as the randomized Kaczmarz and randomized coordinate descent. However, since it aims to find a…

Numerical Analysis · Mathematics 2022-05-04 Ziyang Yuan , Lu Zhang , Hongxia Wang , Hui Zhang

Krylov subspace methods are an essential building block in numerical simulation software. The efficient utilization of modern hardware is a challenging problem in the development of these methods. In this work, we develop Krylov subspace…

Numerical Analysis · Mathematics 2021-04-07 Nils-Arne Dreier