English
Related papers

Related papers: Perturbation expansions and error bounds for the t…

200 papers

In this paper, we derive entrywise error bounds for low-rank approximations of kernel matrices obtained using the truncated eigen-decomposition (or singular value decomposition). While this approximation is well-known to be optimal with…

Statistics Theory · Mathematics 2024-10-31 Alexander Modell

This paper introduces two methods for verifying the singular values of the structured matrix denoted by $R^{-H}AR^{-1}$, where $R$ is a nonsingular matrix and $A$ is a general nonsingular square matrix. The first of the two methods uses the…

Numerical Analysis · Mathematics 2025-02-17 Takeshi Terao , Yoshitaka Watanabe , Katsuhisa Ozaki

An efficient Singular Value Decomposition (SVD) algorithm is an important tool for distributed and streaming computation in big data problems. It is observed that update of singular vectors of a rank-1 perturbed matrix is similar to a…

Machine Learning · Computer Science 2017-07-27 Ratnik Gandhi , Amoli Rajgor

We present a cost-reduced approach for the distinguishable cluster approximation to coupled cluster with singles, doubles and iterative triples (DC-CCSDT) based on a tensor decomposition of the triples amplitudes. The triples amplitudes and…

Chemical Physics · Physics 2025-03-07 Charlotte Rickert , Denis Usvyat , Daniel Kats

We present a method for computing reduced-order models of parameterized partial differential equation solutions. The key analytical tool is the singular value expansion of the parameterized solution, which we approximate with a singular…

Numerical Analysis · Mathematics 2014-11-03 Paul G. Constantine , David F. Gleich , Yangyang Hou , Jeremy Templeton

Given (orthonormal) approximations $\tilde{U}$ and $\tilde{V}$ to the left and right subspaces spanned by the leading singular vectors of a matrix $A$, we discuss methods to approximate the leading singular values of $A$ and study their…

Numerical Analysis · Mathematics 2026-01-21 Lorenzo Lazzarino , Hussam Al Daas , Yuji Nakatsukasa

In signal processing and identification, generalized singular value decomposition (GSVD), related to a sequence of matrices in product/quotient form are essential numerical linear algebra tools. On behalf of the growing demand for efficient…

Numerical Analysis · Mathematics 2025-11-13 Sitao Ling , Wenxuan Ma , Musheng Wei

The tensor decomposition addressed in this paper may be seen as a generalisation of Singular Value Decomposition of matrices. We consider general multilinear and multihomogeneous tensors. We show how to reduce the problem to a truncated…

Algebraic Geometry · Mathematics 2012-10-17 Alessandra Bernardi , Jerome Brachat , Pierre Comon , Bernard Mourrain

A low rank matrix X has been contaminated by uniformly distributed noise, missing values, outliers and corrupt entries. Reconstruction of X from the singular values and singular vectors of the contaminated matrix Y is a key problem in…

Information Theory · Computer Science 2017-11-21 Danny Barash , Matan Gavish

We prove an estimate on the smallest singular value of a multiplicatively and additively deformed random rectangular matrix. Suppose $n\le N \le M \le \Lambda N$ for some constant $\Lambda \ge 1$. Let $X$ be an $M\times n$ random matrix…

Probability · Mathematics 2018-10-17 Fan Yang

Singular Spectrum Analysis and many other subspace-based methods of signal processing are implicitly relying on the assumption of close proximity of unperturbed and perturbed signal subspaces extracted by the Singular Value Decomposition of…

Numerical Analysis · Mathematics 2010-06-16 Vladimir Nekrutkin

Singular Value Decomposition (SVD) is a technique based on linear projection theory, which has been frequently used for data analysis. It constitutes an optimal (in the sense of least squares) decomposition of a matrix in the most relevant…

Data Analysis, Statistics and Probability · Physics 2015-03-17 Pau Erola , Javier Borge-Holthoefer , Sergio Gomez , Alex Arenas

We study policy evaluation problems in multi-task reinforcement learning (RL) under a low-rank representation setting. In this setting, we are given $N$ learning tasks where the corresponding value function of these tasks lie in an…

Machine Learning · Computer Science 2025-03-05 Yitao Bai , Sihan Zeng , Justin Romberg , Thinh T. Doan

We present a simple yet novel parameterized form of linear mapping to achieves remarkable network compression performance: a pseudo SVD called Ternary SVD (TSVD). Unlike vanilla SVD, TSVD limits the $U$ and $V$ matrices in SVD to ternary…

Machine Learning · Computer Science 2023-08-16 Boyu Chen , Hanxuan Chen , Jiao He , Fengyu Sun , Shangling Jui

We develop new techniques for proving lower bounds on the least singular value of random matrices with limited randomness. The matrices we consider have entries that are given by polynomials of a few underlying base random variables. This…

Data Structures and Algorithms · Computer Science 2025-09-29 Aditya Bhaskara , Eric Evert , Vaidehi Srinivas , Aravindan Vijayaraghavan

We prove that the squared singular values of a fixed matrix multiplied with a truncation of a Haar distributed unitary matrix are distributed by a polynomial ensemble. This result is applied to a multiplication of a truncated unitary matrix…

Probability · Mathematics 2018-07-31 Mario Kieburg , Arno B. J. Kuijlaars , Dries Stivigny

The oriented singular value decomposition (O-SVD) proposed by Zeng and Ng provides a hybrid approach to the t-product based third-order tensor singular value decomposition with the transform matrix being a factor matrix of the higher order…

Numerical Analysis · Mathematics 2023-02-28 Minghui Ding , Yimin Wei , Pengpeng Xie

We propose an efficient, distributed, out-of-memory implementation of the truncated singular value decomposition (t-SVD) for heterogeneous (CPU+GPU) high performance computing (HPC) systems. Various implementations of SVD have been…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-08-18 Ismael Boureima , Manish Bhattarai , Maksim E. Eren , Nick Solovyev , Hristo Djidjev , Boian S. Alexandrov

This paper considers a way of generalizing the t-SVD of third-order tensors (regarded as tubal matrices) to tensors of arbitrary order N (which can be similarly regarded as tubal tensors of order (N-1)). \color{black}Such a generalization…

Numerical Analysis · Mathematics 2022-04-22 Ying Wang , Yuning Yang

We extend the randomized singular value decomposition (SVD) algorithm \citep{Halko2011finding} to estimate the SVD of a shifted data matrix without explicitly constructing the matrix in the memory. With no loss in the accuracy of the…

Machine Learning · Statistics 2019-12-02 Ali Basirat