English
Related papers

Related papers: Hardware-Oriented Krylov Methods for High-Performa…

200 papers

We compare two approaches to compute a portion of the spectrum of dense symmetric definite generalized eigenproblems: one is based on the reduction to tridiagonal form, and the other on the Krylov-subspace iteration. Two large-scale…

Randomized iterative methods, such as the randomized Kaczmarz method, have gained significant attention for solving large-scale linear systems due to their simplicity and efficiency. Meanwhile, Krylov subspace methods have emerged as a…

Numerical Analysis · Mathematics 2025-05-28 Yonghan Sun , Deren Han , Jiaxin Xie

We study the use of Krylov subspace recycling for the solution of a sequence of slowly-changing families of linear systems, where each family consists of shifted linear systems that differ in the coefficient matrix only by multiples of the…

Numerical Analysis · Mathematics 2014-10-01 Kirk M. Soodhalter , Daniel B. Szyld , Fei Xue

The Krylov subspace projection approach is a well-established tool for the reduced order modeling of dynamical systems in the time domain. In this paper, we address the main issues obstructing the application of this powerful approach to…

Mathematical Physics · Physics 2012-04-16 Vladimir Druskin , Rob Remis

Primal and dual block coordinate descent methods are iterative methods for solving regularized and unregularized optimization problems. Distributed-memory parallel implementations of these methods have become popular in analyzing large…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-05-03 Aditya Devarakonda , Kimon Fountoulakis , James Demmel , Michael W. Mahoney

We propose an adaptive randomized truncation estimator for Krylov subspace methods that optimizes the trade-off between the solution variance and the computational cost, while remaining unbiased. The estimator solves a constrained…

Numerical Analysis · Mathematics 2025-04-08 Qi Luo , Florian Schäfer

This article introduces randomized block Gram-Schmidt process (RBGS) for QR decomposition. RBGS extends the single-vector randomized Gram-Schmidt (RGS) algorithm and inherits its key characteristics such as being more efficient and having…

Numerical Analysis · Mathematics 2025-02-25 Oleg Balabanov , Laura Grigori

In this paper, we propose a second order optimization method to learn models where both the dimensionality of the parameter space and the number of training samples is high. In our method, we construct on each iteration a Krylov subspace…

Machine Learning · Statistics 2011-11-21 Oriol Vinyals , Daniel Povey

Quantum Krylov algorithms have emerged as a promising approach for ground-state energy estimation in the near-term quantum computing era. A major challenge, however, lies in their inherently substantial sampling cost, primarily due to the…

This paper introduces new solvers for the computation of low-rank approximate solutions to large-scale linear problems, with a particular focus on the regularization of linear inverse problems. Although Krylov methods incorporating explicit…

Numerical Analysis · Mathematics 2019-11-05 Silvia Gazzola , Chang Meng , James Nagy

Augmented Krylov subspace methods aid in accelerating the convergence of a standard Krylov subspace method by including additional vectors in the search space. A residual projection framework based on residual (Petrov-) Galerkin constraints…

Numerical Analysis · Mathematics 2023-05-19 Liam Burke , Kirk M. Soodhalter

As computational machines become larger and more complex, the probability of hardware failure rises. ``Silent errors'', or bit flips, may not be immediately apparent but can cause detrimental effects to algorithm behavior. In this work, we…

Numerical Analysis · Mathematics 2025-03-31 Erin Claire Carson , Jakub Hercík

Hierarchical matrices provide a highly memory-efficient way of storing dense linear operators arising, for example, from boundary element methods, particularly when stored in the H^2 format. In such data-sparse representations, iterative…

Numerical Analysis · Mathematics 2025-09-23 Sven Christophersen

This paper introduces new solvers for efficiently computing solutions to large-scale inverse problems with group sparsity regularization, including both non-overlapping and overlapping groups. Group sparsity regularization refers to a type…

Numerical Analysis · Mathematics 2023-06-16 Julianne Chung , Malena Sabaté Landman

The Rosenbrock-Krylov family of time integration schemes is an extension of Rosenbrock-W methods that employs a specific Krylov based approximation of the linear system solutions arising within each stage of the integrator. This work…

Numerical Analysis · Mathematics 2019-10-08 Paul Tranquilli , Ross Glandon , Adrian Sandu

Model-based reconstruction plays a key role in compressed sensing (CS) MRI, as it incorporates effective image regularizers to improve the quality of reconstruction. The Plug-and-Play and Regularization-by-Denoising frameworks leverage…

Image and Video Processing · Electrical Eng. & Systems 2026-01-13 Tao Hong , Umberto Villa , Jeffrey A. Fessler

Flexible Krylov methods are a common standpoint for inverse problems. In particular, they are used to address the challenges associated with explicit variational regularization when it goes beyond the two-norm, for example involving an…

Numerical Analysis · Mathematics 2025-10-22 Malena Sabaté Landman

In the last decade, tensors have shown their potential as valuable tools for various tasks in numerical linear algebra. While most of the research has been focusing on how to compress a given tensor in order to maintain information as well…

Numerical Analysis · Mathematics 2024-09-17 Alberto Bucci , Davide Palitta , Leonardo Robol

Deflation techniques are typically used to shift isolated clusters of small eigenvalues in order to obtain a tighter distribution and a smaller condition number. Such changes induce a positive effect in the convergence behavior of Krylov…

Numerical Analysis · Mathematics 2024-05-15 Andrei Dumitrasc , Carola Kruse , Ulrich Ruede

This survey concerns subspace recycling methods, a popular class of iterative methods that enable effective reuse of subspace information in order to speed up convergence and find good initial guesses over a sequence of linear systems with…

Numerical Analysis · Mathematics 2020-07-30 Kirk M. Soodhalter , Eric de Sturler , Misha Kilmer