English
Related papers

Related papers: An efficient method for block low-rank approximati…

200 papers

Kernel matrices are ubiquitous in computational mathematics, often arising from applications in machine learning and scientific computing. In two or three spatial or feature dimensions, such problems can be approximated efficiently by a…

Numerical Analysis · Mathematics 2025-11-07 Abraham Khan , Chao Chen , Vishwas Rao , Arvind K. Saibaba

Hierarchical matrices provide a powerful representation for significantly reducing the computational complexity associated with dense kernel matrices. For general kernel functions, interpolation-based methods are widely used for the…

Numerical Analysis · Mathematics 2022-06-07 Difeng Cai , Hua Huang , Edmond Chow , Yuanzhe Xi

A new fast algebraic method for obtaining an $\mathcal{H}^2$-approximation of a matrix from its entries is presented. The main idea behind the method is based on the nested representation and the maximum-volume principle to select…

Numerical Analysis · Mathematics 2015-11-17 A. Yu Mikhalev , I. V. Oseledets

Hierarchical matrices approximate a given matrix by a decomposition into low-rank submatrices that can be handled efficiently in factorized form. $\mathcal{H}^2$-matrices refine this representation following the ideas of fast multipole…

Numerical Analysis · Mathematics 2024-04-24 Steffen Börm

A classical problem in matrix computations is the efficient and reliable approximation of a given matrix by a matrix of lower rank. The truncated singular value decomposition (SVD) is known to provide the best such approximation for any…

Numerical Analysis · Mathematics 2014-08-12 Ming Gu

Traditional low-rank approximation is a powerful tool to compress the huge data matrices that arise in simulations of partial differential equations (PDE), but suffers from high computational cost and requires several passes over the PDE…

Numerical Analysis · Mathematics 2024-08-01 Angran Li , Stephen Becker , Alireza Doostan

In this paper we examine the use of low-rank approximations for the handling of radiation boundary conditions in a transient heat equation given a cavity radiation setting. The finite element discretization that arises from cavity radiation…

Numerical Analysis · Mathematics 2023-05-12 Ivan Baburin , Jonas Ballani , John W. Peterson , David Knezevic

We are interested in solving linear systems arising from three applications: (1) kernel methods in machine learning, (2) discretization of boundary integral equations from mathematical physics, and (3) Schur complements formed in the…

Numerical Analysis · Mathematics 2022-08-15 Chao Chen , Per-Gunnar Martinsson

Low-rank matrix approximation plays an increasingly important role in signal and image processing applications. This paper presents a new rank-revealing decomposition method called randomized rank-revealing UZV decomposition (RRR-UZVD).…

Numerical Analysis · Computer Science 2018-11-22 Maboud F. Kaloorazi , Rodrigo C. de Lamare

Solving symmetric positive definite linear problems is a fundamental computational task in machine learning. The exact solution, famously, is cubicly expensive in the size of the matrix. To alleviate this problem, several linear-time…

Machine Learning · Computer Science 2017-06-02 Filip de Roos , Philipp Hennig

The computation of accurate low-rank matrix approximations is central to improving the scalability of various techniques in machine learning, uncertainty quantification, and control. Traditionally, low-rank approximations are constructed…

Numerical Analysis · Mathematics 2025-09-29 Nathaniel Pritchard , Taejun Park , Yuji Nakatsukasa , Per-Gunnar Martinsson

Low rank approximation is an important tool used in many applications of signal processing and machine learning. Recently, randomized sketching algorithms were proposed to effectively construct low rank approximations and obtain approximate…

Information Theory · Computer Science 2018-09-11 Shashanka Ubaru , Arya Mazumdar , Yousef Saad

The Nystr\"om method is a convenient heuristic method to obtain low-rank approximations to kernel matrices in nearly linear complexity. Existing studies typically use the method to approximate positive semidefinite matrices with low or…

Numerical Analysis · Mathematics 2023-07-13 Jianlin Xia

In many applications, it is of interest to approximate data, given by mxn matrix A, by a matrix B of at most rank k, which is much smaller than m and n. The best approximation is given by singular value decomposition, which is too time…

Numerical Analysis · Mathematics 2007-05-23 Shmuel Friedland , Mostafa Kaveh , Amir Niknejad , Hossein Zare

This paper presents a new fast iterative solver for large systems involving kernel matrices. Advantageous aspects of H2 matrix approximations and the multigrid method are hybridized to create the H2-MG algorithm. This combination provides…

Numerical Analysis · Mathematics 2025-09-12 Daria Sushnikova , George Turkiyyah , Edmond Chow , David Keyes

While quantum algorithms for solving large scale systems of linear equations offer potentially exponential speedups, their application has largely been confined to sparse matrices. This work extends the scope of these algorithms to a broad…

Quantum Physics · Physics 2026-02-27 Kun Tang , Jun Lai

Matrix decompositions are fundamental tools in the area of applied mathematics, statistical computing, and machine learning. In particular, low-rank matrix decompositions are vital, and widely used for data analysis, dimensionality…

Computation · Statistics 2019-11-28 N. Benjamin Erichson , Sergey Voronin , Steven L. Brunton , J. Nathan Kutz

We present a distributed-memory library for computations with dense structured matrices. A matrix is considered structured if its off-diagonal blocks can be approximated by a rank-deficient matrix with low numerical rank. Here, we use…

Mathematical Software · Computer Science 2015-06-29 François-Henry Rouet , Xiaoye S. Li , Pieter Ghysels , Artem Napov

The Nystr\"om method is a popular low-rank approximation technique for large matrices that arise in kernel methods and convex optimization. Yet, when the data exhibits heavy-tailed spectral decay, the effective dimension of the problem…

Data Structures and Algorithms · Computer Science 2025-07-22 Sachin Garg , Michał Dereziński

CUR matrix decomposition is a randomized algorithm that can efficiently compute the low rank approximation for a given rectangle matrix. One limitation with the existing CUR algorithms is that they require an access to the full matrix A for…

Machine Learning · Computer Science 2014-03-25 Rong Jin , Shenghuo Zhu