English
Related papers

Related papers: Singular value decomposition of large random matri…

200 papers

Singular Value Decomposition (SVD) is one of the most useful techniques for analyzing data in linear algebra. SVD decomposes a rectangular real or complex matrix into two orthogonal matrices and one diagonal matrix. In this work we…

Quantum Physics · Physics 2012-07-31 Laszlo Gyongyosi , Sandor Imre

SVD (singular value decomposition) is one of the basic tools of machine learning, allowing to optimize basis for a given matrix. However, sometimes we have a set of matrices $\{A_k\}_k$ instead, and would like to optimize a single common…

Machine Learning · Computer Science 2022-04-19 Jarek Duda

This paper aims to develop a simple procedure to reduce and control the condition number of random matrices, and investigate the effect on the persistent homology (PH) of point clouds of well- and ill-conditioned matrices. For a square…

Algebraic Topology · Mathematics 2023-02-23 Jehan Ghafuri , Sabah Jassim

A matrix of analytic functions A(z), such as the matrix of transfer functions in a multiple-input multiple-output (MIMO) system, generally admits an analytic singular value decomposition (SVD), where the singular values themselves are…

Signal Processing · Electrical Eng. & Systems 2024-10-01 Mohammed Bakhit , Faizan A. Khattak , Ian K. Proudler , Stephan Weiss

We study the problem of estimating a large, low-rank matrix corrupted by additive noise of unknown covariance, assuming one has access to additional side information in the form of noise-only measurements. We study the Whiten-Shrink-reColor…

Statistics Theory · Mathematics 2023-07-18 Matan Gavish , William Leeb , Elad Romanov

Given two positive integers $n$ and $k$ and a parameter $t\in (0,1)$, we choose at random a vector subspace $V_{n}\subset \mathbb{C}^{k}\otimes\mathbb{C}^{n}$ of dimension $N\sim tnk$. We show that the set of $k$-tuples of singular values…

Probability · Mathematics 2015-05-19 S. Belinschi , B. Collins , I. Nechita

In high-dimensional data processing and data analysis related to dual quaternion statistics, generalized singular value decomposition (GSVD) of a dual quaternion matrix pair is an essential numerical linear algebra tool for an elegant…

Numerical Analysis · Mathematics 2025-11-05 Sitao Ling , Wenxuan Ma , Musheng Wei

In this paper, we consider the singular values and singular vectors of finite, low rank perturbations of large rectangular random matrices. Specifically, we prove almost sure convergence of the extreme singular values and appropriate…

Probability · Mathematics 2012-01-27 Florent Benaych-Georges , Raj Rao Nadakuditi

Let $A_n$ be a random symmetric matrix with Bernoulli $\{\pm 1\}$ entries. For any $\kappa>0$ and two real numbers $\lambda_1,\lambda_2$ with a separation $|\lambda_1-\lambda_2|\geq \kappa n^{1/2}$ and both lying in the bulk…

Probability · Mathematics 2025-04-23 Yi Han

Singular value decomposition (SVD) is the mathematical basis of principal component analysis (PCA). Together, SVD and PCA are one of the most widely used mathematical formalism/decomposition in machine learning, data mining, pattern…

Machine Learning · Computer Science 2018-04-17 Shuai Zheng , Chris Ding , Feiping Nie

The structured singular value (SSV), or mu, is used to assess the robust stability and performance of an uncertain linear time-invariant system. Existing algorithms compute upper and lower bounds on the SSV for structured uncertainties that…

Systems and Control · Electrical Eng. & Systems 2024-01-09 Talha Mushtaq , Diganta Bhattacharjee , Peter Seiler , Maziar S. Hemati

This paper explores signal and image analysis by using the Singular Value Decomposition (SVD) and its extension, the Generalized Singular Value Decomposition (GSVD). A key strength of SVD lies in its ability to separate information into…

Signal Processing · Electrical Eng. & Systems 2025-12-10 Oscar Romero , Néstor Thome

We will use the factors obtained by correspondence analysis to find biclustering of a contingency table such that the row-column cluster pairs are regular, i.e., they have small discrepancy. In our main theorem, the constant of the…

Statistics Theory · Mathematics 2013-01-23 Marianna Bolla

Modern data analysis increasingly requires identifying shared latent structure across multiple high-dimensional datasets. A commonly used model assumes that the data matrices are noisy observations of low-rank matrices with a shared…

Machine Learning · Statistics 2025-07-31 Tavor Z. Baharav , Phillip B. Nicol , Rafael A. Irizarry , Rong Ma

Spectral clustering and Singular Value Decomposition (SVD) are both widely used technique for analyzing graph data. In this note, I will present their connections using simple linear algebra, aiming to provide some in-depth understanding…

Social and Information Networks · Computer Science 2018-10-01 Ziwei Zhang

Let $A$ be an $n\times n$ random matrix with independent, identically distributed mean 0, variance 1 subgaussian entries. We prove that $$ \mathbb{P}(A\text{ has distinct singular values})\geq 1-e^{-cn} $$ for some $c>0$, confirming a…

Probability · Mathematics 2025-03-04 Yi Han

We propose an efficient, distributed, out-of-memory implementation of the truncated singular value decomposition (t-SVD) for heterogeneous (CPU+GPU) high performance computing (HPC) systems. Various implementations of SVD have been…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-08-18 Ismael Boureima , Manish Bhattarai , Maksim E. Eren , Nick Solovyev , Hristo Djidjev , Boian S. Alexandrov

In this article, we consider the sparse tensor singular value decomposition, which aims for dimension reduction on high-dimensional high-order data with certain sparsity structure. A method named Sparse Tensor Alternating Thresholding for…

Statistics Theory · Mathematics 2024-07-09 Anru Zhang , Rungang Han

We present a new approach to solve the exponential retrieval problem. We derive a stable technique, based on the singular value decomposition (SVD) of lag-covariance and crosscovariance matrices consisting of covariance coefficients…

Signal Processing · Electrical Eng. & Systems 2020-08-11 D. J Nicolsky , G. S. Tipenko

Relying on random matrix theory (RMT), this paper studies asymmetric order-$d$ spiked tensor models with Gaussian noise. Using the variational definition of the singular vectors and values of (Lim, 2005), we show that the analysis of the…

Probability · Mathematics 2022-11-22 Mohamed El Amine Seddik , Maxime Guillaud , Romain Couillet