English
Related papers

Related papers: Low-Synch Gram-Schmidt with Delayed Reorthogonaliz…

200 papers

High order exponential integrators require computing linear combination of exponential like $\varphi$-functions of large matrices $A$ times a vector $v$. Krylov projection methods are the most general and remain an efficient choice for…

Numerical Analysis · Mathematics 2024-10-22 Tanya Tafolla , Stéphane Gaudreault , Mayya Tokman

One of the limitations of recycled GCRO methods is the large amount of computation required to orthogonalize the basis vectors of the newly generated Krylov subspace for the approximate solution when combined with those of the recycle…

Numerical Analysis · Mathematics 2023-06-12 Stephen Thomas , Alison Baker , Stephane Gaudreault

We present an overview of randomized orthogonalization techniques that construct a well-conditioned basis whose sketch is orthonormal. Randomized orthogonalization has recently emerged as a powerful paradigm for reducing the computational…

Numerical Analysis · Mathematics 2025-12-18 Jean-Guillaume de Damas , Laura Grigori , Igor Simunec , Edouard Timsit

Communication-avoiding and pipelined variants of Krylov solvers are critical for the scalability of linear system solvers on future exascale architectures. We present low synchronization variants of iterated classical (CGS) and modified…

Numerical Analysis · Computer Science 2018-09-18 Kasia Swirydowicz , Julien Langou , Shreyas Ananthan , Ulrike Yang , Stephen Thomas

With the recent realization of exascale performace by Oak Ridge National Laboratory's Frontier supercomputer, reducing communication in kernels like QR factorization has become even more imperative. Low-synchronization Gram-Schmidt methods,…

Numerical Analysis · Mathematics 2023-02-21 Kathryn Lund

This article introduces randomized block Gram-Schmidt process (RBGS) for QR decomposition. RBGS extends the single-vector randomized Gram-Schmidt (RGS) algorithm and inherits its key characteristics such as being more efficient and having…

Numerical Analysis · Mathematics 2025-02-25 Oleg Balabanov , Laura Grigori

The randomized Arnoldi process has been used in large-scale scientific computing because it produces a well-conditioned basis for the Krylov subspace more quickly than the standard Arnoldi process. However, the resulting Hessenberg matrix…

Numerical Analysis · Mathematics 2026-01-16 Laura Grigori , Daniel Kressner , Nian Shao , Igor Simunec

The GMRES algorithm of Saad and Schultz (1986) is an iterative method for approximately solving linear systems $A{\bf x}={\bf b}$, with initial guess ${\bf x}_0$ and residual ${\bf r}_0 = {\bf b} - A{\bf x}_0$. The algorithm employs the…

Numerical Analysis · Mathematics 2023-03-22 Stephen Thomas , Erin Carson , Miro Rozložník , Arielle Carr , Kasia Świrydowicz

This work introduces a novel algorithm to solve large-scale eigenvalue problems and seek a small set of eigenpairs. The method, called randomized Krylov-Schur (rKS), has a simple implementation and benefits from fast and efficient…

Numerical Analysis · Mathematics 2025-08-08 Jean-Guillaume de Damas , Laura Grigori

In this paper we develop randomized Krylov subspace methods for efficiently computing regularized solutions to large-scale linear inverse problems. Building on the recently developed randomized Gram-Schmidt process, where sketched inner…

Numerical Analysis · Mathematics 2025-08-29 Julianne Chung , Silvia Gazzola

Randomized Krylov subspace methods that employ the sketch-and-solve paradigm to substantially reduce orthogonalization cost have recently shown great promise in speeding up computations for many core linear algebra tasks (e.g., solving…

Numerical Analysis · Mathematics 2026-03-13 Emil Krieger , Marcel Schweitzer

The paper is concerned with methods for computing the best low multilinear rank approximation of large and sparse tensors. Krylov-type methods have been used for this problem; here block versions are introduced. For the computation of…

Numerical Analysis · Mathematics 2020-12-17 L. Eldén , M. Dehghan

A randomized Gram-Schmidt algorithm is developed for orthonormalization of high-dimensional vectors or QR factorization. The proposed process can be less computationally expensive than the classical Gram-Schmidt process while being at least…

Numerical Analysis · Mathematics 2022-01-20 Oleg Balabanov , Laura Grigori

In this paper, we develop algorithms for computing the recurrence coefficients corresponding to multiple orthogonal polynomials on the step-line. We reformulate the problem as an inverse eigenvalue problem, which can be solved using…

Numerical Analysis · Mathematics 2026-03-05 Amin Faghih , Michele Rinelli , Marc Van Barel , Raf Vandebril , Robbe Vermeiren

Two-stage orthogonalization is essential in numerical algorithms such as Krylov subspace methods. For this task we need to orthogonalize a matrix $A$ against another matrix $V$ with orthonormal columns. A common approach is to employ the…

Numerical Analysis · Mathematics 2026-03-24 Zhuang-Ao He , Meiyue Shao

The need for large-scale electronic structure calculations arises recently in the field of material physics and efficient and accurate algebraic methods for large simultaneous linear equations become greatly important. We investigate the…

Mesoscale and Nanoscale Physics · Physics 2015-05-27 H. Teng , T. Fujiwara , T. Hoshi , T. Sogabe , S. -L. Zhang , S. Yamamoto

Block classical Gram-Schmidt (BCGS) is commonly used for orthogonalizing a set of vectors $X$ in distributed computing environments due to its favorable communication properties relative to other orthogonalization approaches, such as…

Numerical Analysis · Mathematics 2025-10-28 Erin Carson , Kathryn Lund , Yuxin Ma , Eda Oktay

The orthogonalization process is an essential building block in Krylov space methods, which takes up a large portion of the computational time. Commonly used methods, like the Gram-Schmidt method, consider the projection and normalization…

Numerical Analysis · Mathematics 2022-04-29 Nils-Arne Dreier , Christian Engwer

Many scientific applications require the evaluation of the action of the matrix function over a vector and the most common methods for this task are those based on the Krylov subspace. Since the orthogonalization cost and memory requirement…

Numerical Analysis · Mathematics 2026-03-24 Nicolas L. Guidotti , Per-Gunnar Martinsson , Juan A. Acebrón , José Monteiro

Krylov subspace methods are an essential building block in numerical simulation software. The efficient utilization of modern hardware is a challenging problem in the development of these methods. In this work, we develop Krylov subspace…

Numerical Analysis · Mathematics 2021-04-07 Nils-Arne Dreier
‹ Prev 1 2 3 10 Next ›