English
Related papers

Related papers: A numerically stable communication-avoiding s-step…

200 papers

The Krylov subspace projection approach is a well-established tool for the reduced order modeling of dynamical systems in the time domain. In this paper, we address the main issues obstructing the application of this powerful approach to…

Mathematical Physics · Physics 2012-04-16 Vladimir Druskin , Rob Remis

Multistep matrix splitting iterations serve as preconditioning for Krylov subspace methods for solving singular linear systems. The preconditioner is applied to the generalized minimal residual (GMRES) method and the flexible GMRES (FGMRES)…

Numerical Analysis · Mathematics 2021-11-09 Keiichi Morikuni

This paper presents a single-life reinforcement learning (SLRL) approach to adaptively select the dimension of the Krylov subspace during the generalized minimal residual (GMRES) iteration. GMRES is an iterative algorithm for solving large…

Computational Engineering, Finance, and Science · Computer Science 2025-02-04 Hadi Keramati , Feridun Hamdullahpur

We present variants of the Conjugate Gradient (CG), Conjugate Residual (CR), and Generalized Minimal Residual (GMRES) methods which are both pipelined and flexible. These allow computation of inner products and norms to be overlapped with…

Numerical Analysis · Mathematics 2016-09-16 Patrick Sanan , Sascha M. Schnepp , Dave. A. May

The use of block Krylov subspace methods for computing the solution to a sequence of shifted linear systems using subspace recycling was first proposed in [Soodhalter, SISC 2016], where a recycled shifted block GMRES algorithm (rsbGMRES)…

Numerical Analysis · Mathematics 2022-09-16 Liam Burke

A High Performance Computing alternative to traditional Krylov subspace methods, pipelined Krylov subspace solvers offer better scalability in the strong scaling limit compared to standard Krylov subspace methods for large and sparse linear…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-04-25 Siegfried Cools , Wim Vanroose

Block Gram-Schmidt algorithms serve as essential kernels in many scientific computing applications, but for many commonly used variants, a rigorous treatment of their stability properties remains open. This work provides a comprehensive…

Numerical Analysis · Mathematics 2023-02-21 Erin Carson , Kathryn Lund , Miroslav Rozložník , Stephen Thomas

Strong stability preserving (SSP) methods are designed primarily for time integration of nonlinear hyperbolic PDEs, for which the permissible SSP step size varies from one step to the next. We develop the first SSP linear multistep methods…

Numerical Analysis · Mathematics 2022-04-05 Yiannis Hadjimichael , David Ketcheson , Lajos Lóczi , Adrián Németh

Linear solvers are key components in any software platform for scientific and engineering computing. The solution of large and sparse linear systems lies at the core of physics-driven numerical simulations relying on partial differential…

Numerical Analysis · Mathematics 2026-04-16 Massimo Bernaschi , Mauro G. Carrozzo , Alessandro Celestini , Giacomo Piperno , Pasqua D'Ambra

Preconditioned Krylov subspace (KSP) methods are widely used for solving large-scale sparse linear systems arising from numerical solutions of partial differential equations (PDEs). These linear systems are often nonsymmetric due to the…

Numerical Analysis · Mathematics 2018-09-05 Aditi Ghai , Cao Lu , Xiangmin Jiao

Context. Numerical solutions to transfer problems of polarized radiation in solar and stellar atmospheres commonly rely on stationary iterative methods, which often perform poorly when applied to large problems. In recent times, stationary…

Numerical Analysis · Mathematics 2021-12-08 Pietro Benedusi , Gioele Janett , Luca Belluzzi , Rolf Krause

This paper studies the solution of nonsymmetric linear systems by preconditioned Krylov methods based on the normal equations, LSQR in particular. On some examples, preconditioned LSQR is seen to produce errors many orders of magnitude…

Numerical Analysis · Mathematics 2025-03-06 Ethan N. Epperly , Anne Greenbaum , Yuji Nakatsukasa

We propose a novel algorithm based on inexact GMRES methods for linear response calculations in density functional theory. Such calculations require iteratively solving a nested linear problem $\mathcal{E} \delta\rho = b$ to obtain the…

Numerical Analysis · Mathematics 2025-10-30 Michael F. Herbst , Bonan Sun

Inverse problems arise in various scientific and engineering applications, necessitating robust numerical methods for their solution. In this work, we consider the effectiveness of Krylov subspace iterative methods, including GMRES, QMR,…

Numerical Analysis · Mathematics 2025-08-11 Moshen Hu , Lucas Onisk

We propose a block Krylov subspace version of the GCRO-DR method proposed in [Parks et al.; SISC 2005], which is an iterative method allowing for the efficient minimization of the the residual over an augmented Krylov subspace. We offer a…

Numerical Analysis · Mathematics 2026-05-14 Michael L. Parks , Kirk M. Soodhalter , Daniel B. Szyld

Graph Neural Networks (GNNs) are a computationally efficient method to learn embeddings and classifications on graph data. However, GNN training has low computational intensity, making communication costs the bottleneck for scalability.…

Machine Learning · Computer Science 2025-04-08 Ujjaini Mukhodopadhyay , Alok Tripathy , Oguz Selvitopi , Katherine Yelick , Aydin Buluc

In this thesis we propose a novel implementation of IDRstab that avoids several unlucky breakdowns of current IDRstab implementations and is further capable of benefiting from a particular lucky breakdown scenario. IDRstab is a very…

Numerical Analysis · Mathematics 2017-08-08 Martin P. Neuenhofen

Compressed Stochastic Gradient Descent (SGD) algorithms have been recently proposed to address the communication bottleneck in distributed and decentralized optimization problems, such as those that arise in federated machine learning.…

Machine Learning · Statistics 2022-07-21 Adarsh M. Subramaniam , Akshayaa Magesh , Venugopal V. Veeravalli

Nowadays, many fields of study are have to deal with large and sparse data matrixes, but the most important issue is finding the inverse of these matrixes. Thankfully, Krylov subspace methods can be used in solving these types of problem.…

Optimization and Control · Mathematics 2018-11-26 Shitao Fan

We study how the Newton-GMRES iteration can enable dynamic simulators (time-steppers) to perform fixed-point and path-following computations.For a class of dissipative problems, whose dynamics are characterized by a slow manifold, the…

Dynamical Systems · Mathematics 2007-05-23 C. T. Kelley , I. G. Kevrekidis , L. Qiao