English
Related papers

Related papers: Singular vectors under random perturbation

200 papers

Given a matrix $A \in \mathbb{R}^{m\times d}$ with singular values $\sigma_1\geq \cdots \geq \sigma_d$, and a random matrix $G \in \mathbb{R}^{m\times d}$ with iid $N(0,T)$ entries for some $T>0$, we derive new bounds on the Frobenius…

Statistics Theory · Mathematics 2024-06-05 Peiyao Lai , Oren Mangoubi

Tensor models play an increasingly prominent role in many fields, notably in machine learning. In several applications, such as community detection, topic modeling and Gaussian mixture learning, one must estimate a low-rank signal from a…

Machine Learning · Statistics 2022-06-16 José Henrique de Morais Goulart , Romain Couillet , Pierre Comon

A matrix method is formulated in a Lagrangian representation for the solution of the characteristic value problem governing modes of oscillation and instability in a collisionless stellar system. The underlying perturbation equations govern…

Astrophysics · Physics 2009-11-07 Peter O. Vandervoort

Let $A$ be an $m \times n$ matrix with rank $r$ and spectral decomposition $A = \sum_{i=1}^r \sigma_i u_i v_i^\top,$ where $\sigma_i$ are its singular values, ordered decreasingly, and $u_i, v_i$ are the corresponding left and right…

Numerical Analysis · Mathematics 2026-03-17 Phuc Tran , Van Vu

In many situations, the statistical properties of wave systems with chaotic classical limits are well-described by random matrix theory. However, applications of random matrix theory to scattering problems require introduction of system…

Statistical Mechanics · Physics 2013-05-29 James A. Hart , Thomas M. Antonsen , Edward Ott

An unknown $m$ by $n$ matrix $X_0$ is to be estimated from noisy measurements $Y=X_0+Z$, where the noise matrix $Z$ has i.i.d. Gaussian entries. A popular matrix denoising scheme solves the nuclear norm penalization problem $\operatorname…

Statistics Theory · Mathematics 2014-11-05 David Donoho , Matan Gavish

We extend probability estimates on the smallest singular value of random matrices with independent entries to a class of sparse random matrices. We show that one can relax a previously used condition of uniform boundedness of the variances…

Probability · Mathematics 2012-12-21 Alexander Litvak , Omar Rivasplata

It is known that if one perturbs a large iid random matrix by a bounded rank error, then the majority of the eigenvalues will remain distributed according to the circular law. However, the bounded rank perturbation may also create one or…

Probability · Mathematics 2015-03-17 Terence Tao

According to recent findings [1,2], empirical covariance matrices deduced from financial return series contain such a high amount of noise that, apart from a few large eigenvalues and the corresponding eigenvectors, their structure can…

Statistical Mechanics · Physics 2009-11-07 Szilard Pafka , Imre Kondor

This paper considers the problem of estimating a change point in the covariance matrix in a sequence of high-dimensional vectors, where the dimension is substantially larger than the sample size. A two-stage approach is proposed to…

Methodology · Statistics 2018-07-31 H. Dette , G. M. Pan , Q. Yang

We consider the eigenvalues and eigenvectors of finite, low rank perturbations of random matrices. Specifically, we prove almost sure convergence of the extreme eigenvalues and appropriate projections of the corresponding eigenvectors of…

Probability · Mathematics 2012-03-19 Florent Benaych-Georges , Raj Rao Nadakuditi

Many important problems are characterized by the eigenvalues of a large matrix. For example, the difficulty of many optimization problems, such as those arising from the fitting of large models in statistics and machine learning, can be…

We investigate a problem of the necessary and sufficient conditions for appearance of the 1/f fluctuations in the simple systems affected by the external random perturbations, i.e. the power spectral density of the flux of particles moving…

adap-org · Physics 2007-05-23 B. Kaulakys , T. Meskauskas

We consider differentially private approximate singular vector computation. Known worst-case lower bounds show that the error of any differentially private algorithm must scale polynomially with the dimension of the singular vector. We are…

Data Structures and Algorithms · Computer Science 2012-11-06 Moritz Hardt , Aaron Roth

A large i.i.d. random matrix with deterministic low-rank perturbation has been extensively studied, particularly in the aspects of the ESD (Empirical Spectral Distribution) and the outliers of eigenvalues. In this work, we investigate the…

Information Theory · Computer Science 2025-06-24 Kun Chen , Zhihua Zhang

We consider the problem of noisy matrix completion, in which the goal is to reconstruct a structured matrix whose entries are partially observed in noise. Standard approaches to this underdetermined inverse problem are based on assuming…

Machine Learning · Statistics 2017-09-04 Nihar B. Shah , Sivaraman Balakrishnan , Martin J. Wainwright

In this paper we study how perturbing a matrix changes its non-negative rank. We prove that the non-negative rank is upper-semicontinuos and we describe some special families of perturbations. We show how our results relate to Statistics in…

Combinatorics · Mathematics 2011-07-21 Cristiano Bocci , Enrico Carlini , Fabio Rapallo

Matrices with low-rank structure are ubiquitous in scientific computing. Choosing an appropriate rank is a key step in many computational algorithms that exploit low-rank structure. However, estimating the rank has been done largely in an…

Numerical Analysis · Mathematics 2024-01-08 Maike Meier , Yuji Nakatsukasa

In nonlinear systems analysis, minor fractions of higher-order dynamics are often neglected for simplicity. Here, we show that machine epsilon levels of parasitic higher-order dynamics due to computer roundoff alone can cause divergence of…

Computational Physics · Physics 2010-06-03 Cheng Li , Guo-Qiang Wu , Chi-Sang Poon

The CUR decomposition is a factorization of a low-rank matrix obtained by selecting certain column and row submatrices of it. We perform a thorough investigation of what happens to such decompositions in the presence of noise. Since CUR…

Numerical Analysis · Mathematics 2020-07-29 Keaton Hamm , Longxiu Huang