English
Related papers

Related papers: Sketched and Truncated Polynomial Krylov Subspace …

200 papers

Low-rank approximation of tensors has been widely used in high-dimensional data analysis. It usually involves singular value decomposition (SVD) of large-scale matrices with high computational complexity. Sketching is an effective data…

Numerical Analysis · Mathematics 2023-01-30 Wandi Dong , Gaohang Yu , Liqun Qi , Xiaohao Cai

We study two inexact methods for solutions of random eigenvalue problems in the context of spectral stochastic finite elements. In particular, given a parameter-dependent, symmetric matrix operator, the methods solve for eigenvalues and…

Numerical Analysis · Mathematics 2018-12-27 Kookjin Lee , Bedřich Sousedík

For large scale electronic structure calculation, the Krylov subspace method is introduced to calculate the one-body density matrix instead of the eigenstates of given Hamiltonian. This method provides an efficient way to extract the…

Materials Science · Physics 2009-11-10 Ryu Takayama , Takeo Hoshi , Takeo Fujiwara

Enlarged Krylov subspace methods and their s-step versions were introduced [7] in the aim of reducing communication when solving systems of linear equations Ax = b. These enlarged CG methods consist of enlarging the Krylov subspace by a…

Numerical Analysis · Mathematics 2024-09-18 Sophie M. Moufawad

In second-order optimization, a potential bottleneck can be computing the Hessian matrix of the optimized function at every iteration. Randomized sketching has emerged as a powerful technique for constructing estimates of the Hessian which…

Optimization and Control · Mathematics 2021-07-16 Michał Dereziński , Jonathan Lacotte , Mert Pilanci , Michael W. Mahoney

This work is on a user-friendly reduced basis method for solving a family of parametric PDEs by preconditioned Krylov subspace methods including the conjugate gradient method, generalized minimum residual method, and bi-conjugate gradient…

Numerical Analysis · Mathematics 2026-02-24 Yuwen Li , Ludmil T. Zikatanov , Cheng Zuo

The Krylov subspace methods, being one category of the most important classical numerical methods for linear algebra problems, can be much more powerful when generalised to quantum computing. However, quantum Krylov subspace algorithms are…

Quantum Physics · Physics 2024-08-14 Zongkang Zhang , Anbang Wang , Xiaosi Xu , Ying Li

We present a novel distributed computing framework that is robust to slow compute nodes, and is capable of both approximate and exact computation of linear operations. The proposed mechanism integrates the concepts of randomized sketching…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-09-06 Burak Bartan , Mert Pilanci

The singular value decomposition (SVD) of large-scale matrices is a key tool in data analytics and scientific computing. The rapid growth in the size of matrices further increases the need for developing efficient large-scale SVD…

Numerical Analysis · Mathematics 2016-08-31 Ting-Li Chen , Dawei D. Chang , Su-Yun Huang , Hung Chen , Chienyao Lin , Weichung Wang

Randomization has emerged as a powerful set of tools for large-scale matrix and tensor decompositions. Randomized algorithms involve computing sketches with random matrices. A prevalent approach is to take the random matrix as a standard…

Numerical Analysis · Mathematics 2026-04-02 Arvind K. Saibaba , Bhisham Dev Verma , Grey Ballard

We consider the problem of recovering an $n_1 \times n_2$ low-rank matrix with $k$-sparse singular vectors from a small number of linear measurements (sketch). We propose a sketching scheme and an algorithm that can recover the singular…

Information Theory · Computer Science 2024-07-02 Xiaoqi Liu , Ramji Venkataramanan

This work introduces a novel algorithm to solve large-scale eigenvalue problems and seek a small set of eigenpairs. The method, called randomized Krylov-Schur (rKS), has a simple implementation and benefits from fast and efficient…

Numerical Analysis · Mathematics 2025-08-08 Jean-Guillaume de Damas , Laura Grigori

Preventing catastrophic forgetting while continually learning new tasks is an essential problem in lifelong learning. Structural regularization (SR) refers to a family of algorithms that mitigate catastrophic forgetting by penalizing the…

Machine Learning · Computer Science 2021-04-20 Haoran Li , Aditya Krishnan , Jingfeng Wu , Soheil Kolouri , Praveen K. Pilly , Vladimir Braverman

Kernel methods are learning algorithms that enjoy solid theoretical foundations while suffering from important computational limitations. Sketching, which consists in looking for solutions among a subspace of reduced dimension, is a well…

Machine Learning · Statistics 2023-11-07 Tamim El Ahmad , Pierre Laforgue , Florence d'Alché-Buc

While there is no lack of efficient Krylov subspace solvers for Hermitian systems, there are few for complex symmetric, skew symmetric, or skew Hermitian systems, which are increasingly important in modern applications including quantum…

Mathematical Software · Computer Science 2014-01-14 Sou-Cheng , Choi

In many applications it is important to understand the sensitivity of eigenvalues of a matrix polynomial to perturbations of the polynomial. The sensitivity commonly is described by condition numbers or pseudospectra. However, the…

Numerical Analysis · Mathematics 2017-04-06 Silvia Noschese , Lothar Reichel

Despite the successful enhancement to the Harrow-Hassidim-Lloyd algorithm by Childs et al., who introduced the Fourier approach leveraging linear combinations of unitary operators, our research has identified non-trivial redundancies within…

Quantum Physics · Physics 2024-05-13 Rui-Bin Xu , Zhu-Jun Zheng , Zheng Zheng

We first propose the regular sketch-and-project method for solving tensor equations with respect to the popular t-product. Then, three adaptive sampling strategies and three corresponding adaptive sketch-and-project methods are derived. We…

Numerical Analysis · Mathematics 2022-10-18 Ling Tang , Yanjun Zhang , Hanyu Li

Sketching algorithms have recently proven to be a powerful approach both for designing low-space streaming algorithms as well as fast polynomial time approximation schemes (PTAS). In this work, we develop new techniques to extend the…

Data Structures and Algorithms · Computer Science 2023-10-31 Gregory Dexter , Petros Drineas , David P. Woodruff , Taisuke Yasuda

We present a novel method to compute the overlap Dirac operator at zero and nonzero quark chemical potential. To approximate the sign function of large, sparse matrices, standard methods project the operator on a much smaller Krylov…

High Energy Physics - Lattice · Physics 2010-05-19 Jacques C. R. Bloch , Simon Heybrock