English
Related papers

Related papers: Randomized algorithms for low-rank matrix approxim…

200 papers

Rank deficient Hankel matrices are at the core of several applications. However, in practice, the coefficients of these matrices are noisy due to e.g. measurements errors and computational errors, so generically the involved matrices are…

Numerical Analysis · Mathematics 2020-12-15 Antonio Fazzi , Nicola Guglielmi , Ivan Markovsky

We comment on two randomized algorithms for constructing low-rank matrix decompositions. Both algorithms employ the Subsampled Randomized Hadamard Transform [14]. The first algorithm appeared recently in [9]; here, we provide a novel…

Data Structures and Algorithms · Computer Science 2012-04-04 Christos Boutsidis

This work presents a comprehensive understanding of the estimation of a planted low-rank signal from a general spiked tensor model near the computational threshold. Relying on standard tools from the theory of large random matrices, we…

Machine Learning · Statistics 2025-01-15 Hugo Lebeau , Florent Chatelain , Romain Couillet

Historically, analysis for multiscale PDEs is largely unified while numerical schemes tend to be equation-specific. In this paper, we propose a unified framework for computing multiscale problems through random sampling. This is achieved by…

Numerical Analysis · Mathematics 2022-03-09 Ke Chen , Shi Chen , Qin Li , Jianfeng Lu , Stephen J. Wright

Memristor crossbars enable vector-matrix multiplication (VMM), and are promising for low-power applications. However, it can be difficult to write the memristor conductance values exactly. To improve the accuracy of VMM, we propose a scheme…

Signal Processing · Electrical Eng. & Systems 2025-10-07 Binyu Lu , Matthias Frey , Stark Draper , Jingge Zhu

This paper presents novel adaptive space-time reduced-rank interference suppression least squares algorithms based on joint iterative optimization of parameter vectors. The proposed space-time reduced-rank scheme consists of a joint…

Information Theory · Computer Science 2013-01-15 Rodrigo C. de Lamare , Raimundo Sampaio-Neto

This paper expands the analysis of randomized low-rank approximation beyond the Gaussian distribution to four classes of random matrices: (1) independent sub-Gaussian entries, (2) independent sub-Gaussian columns, (3) independent bounded…

Numerical Analysis · Mathematics 2023-08-14 Arvind K. Saibaba , Agnieszka Międlar

We present an overview of randomized orthogonalization techniques that construct a well-conditioned basis whose sketch is orthonormal. Randomized orthogonalization has recently emerged as a powerful paradigm for reducing the computational…

Numerical Analysis · Mathematics 2025-12-18 Jean-Guillaume de Damas , Laura Grigori , Igor Simunec , Edouard Timsit

The singular value decomposition (SVD) of large-scale matrices is a key tool in data analytics and scientific computing. The rapid growth in the size of matrices further increases the need for developing efficient large-scale SVD…

Numerical Analysis · Mathematics 2016-08-31 Ting-Li Chen , Dawei D. Chang , Su-Yun Huang , Hung Chen , Chienyao Lin , Weichung Wang

Low-rank matrix approximations, such as the truncated singular value decomposition and the rank-revealing QR decomposition, play a central role in data analysis and scientific computing. This work surveys and extends recent research which…

Numerical Analysis · Mathematics 2014-04-29 Nathan Halko , Per-Gunnar Martinsson , Joel A. Tropp

The randomized singular value decomposition proposed in [27] has certainly become one of the most well-established randomization-based algorithms in numerical linear algebra. The key ingredient of the entire procedure is the computation of…

Numerical Analysis · Mathematics 2025-08-01 Davide Palitta , Sascha Portaro

In this paper, we focus on the fixed TT-rank and precision problems of finding an approximation of the tensor train (TT) decomposition of a tensor. Note that the TT-SVD and TT-cross are two well-known algorithms for these two problems.…

Numerical Analysis · Mathematics 2025-02-11 Maolin Che , Yimin Wei , Hong Yan

This work is concerned with approximating matrix functions for banded matrices, hierarchically semiseparable matrices, and related structures. We develop a new divide-and-conquer method based on (rational) Krylov subspace methods for…

Numerical Analysis · Mathematics 2021-07-12 Alice Cortinovis , Daniel Kressner , Stefano Massei

Krylov subspace methods are a powerful tool for efficiently solving high-dimensional linear algebra problems. In this work, we study the approximation quality that a Krylov subspace provides for estimating the numerical range of a matrix.…

Numerical Analysis · Mathematics 2024-12-02 Cecilia Chen , John Urschel

Low-rank modeling has a lot of important applications in machine learning, computer vision and social network analysis. While the matrix rank is often approximated by the convex nuclear norm, the use of nonconvex low-rank regularizers has…

Numerical Analysis · Computer Science 2016-05-02 Quanming Yao , James T. Kwok , Wenliang Zhong

In this paper, we present a Rank Revealing Randomized Singular Value Decomposition (R3SVD) algorithm to incrementally construct a low-rank approximation of a potentially large matrix while adaptively estimating the appropriate rank that can…

Numerical Analysis · Computer Science 2016-05-27 Hao Ji , Wenjian Yu , Yaohang Li

Krylov subspace methods, such as the Conjugate Gradient (CG) and BiCGSTAB methods, are widely used in scientific computing for solving linear systems. In this study, we propose a new framework for solving large Sylvester equations in a…

Numerical Analysis · Mathematics 2026-05-28 Yuki Satake , Takeshi Fukaya , Tomohiro Sogabe , Shao-Liang Zhang

Generalized singular values (GSVs) play an essential role in the comparative analysis. In the real world data for comparative analysis, both data matrices are usually numerically low-rank. This paper proposes a randomized algorithm to first…

Numerical Analysis · Mathematics 2024-04-16 Weiwei Xu , Weijie Shen , Wen Li , Weiguo Gao , Yingzhou Li

This paper introduces new solvers for the computation of low-rank approximate solutions to large-scale linear problems, with a particular focus on the regularization of linear inverse problems. Although Krylov methods incorporating explicit…

Numerical Analysis · Mathematics 2019-11-05 Silvia Gazzola , Chang Meng , James Nagy

Randomized sampling has recently been proven a highly efficient technique for computing approximate factorizations of matrices that have low numerical rank. This paper describes an extension of such techniques to a wider class of matrices…

Numerical Analysis · Mathematics 2015-03-25 Per-Gunnar Martinsson