English
Related papers

Related papers: An $\ell_{\infty}$ Eigenvector Perturbation Bound …

200 papers

The extended Davis-Kahan theorem makes use of polynomial matrix transformations to produce bounds at least as tight as the standard Davis-Kahan theorem. The optimization problem of finding transformation parameters resulting in optimal…

Statistics Theory · Mathematics 2019-08-12 J. F. Lutzeyer , A. T. Walden

Several problems in machine learning, statistics, and other fields rely on computing eigenvectors. For large scale problems, the computation of these eigenvectors is typically performed via iterative schemes such as subspace iteration or…

Numerical Analysis · Mathematics 2020-11-03 Vasileios Charisopoulos , Austin R. Benson , Anil Damle

Systems with an effectively non-Hermitian Hamiltonian display an enhanced sensitivity to parametric and dynamic perturbations, which arises from the nonorthogonality of their eigenstates. This enhanced sensitivity can be quantified by the…

Quantum Physics · Physics 2023-12-15 Henning Schomerus

This paper is concerned with the interplay between statistical asymmetry and spectral methods. Suppose we are interested in estimating a rank-1 and symmetric matrix $\mathbf{M}^{\star}\in \mathbb{R}^{n\times n}$, yet only a randomly…

Statistics Theory · Mathematics 2023-01-10 Yuxin Chen , Chen Cheng , Jianqing Fan

We perturb a real matrix $A$ of full column rank, and derive lower bounds for the smallest singular values of the perturbed matrix, in terms of normwise absolute perturbations. Our bounds, which extend existing lower-order expressions,…

Numerical Analysis · Mathematics 2024-02-22 Christos Boutsikas , Petros Drineas , Ilse C. F. Ipsen

We study the sensitivity of the eigenvectors of random matrices, showing that even small perturbations make the eigenvectors almost orthogonal. More precisely, we consider two deformed Wigner matrices $W+D_1$, $W+D_2$ and show that their…

Probability · Mathematics 2026-03-03 Giorgio Cipolloni , László Erdős , Joscha Henheik , Oleksii Kolupaiev

Eigenvector perturbation analysis plays a vital role in various data science applications. A large body of prior works, however, focused on establishing $\ell_{2}$ eigenvector perturbation bounds, which are often highly inadequate in…

Statistics Theory · Mathematics 2022-07-06 Gen Li , Changxiao Cai , H. Vincent Poor , Yuxin Chen

We consider the eigenvalues and eigenvectors of finite, low rank perturbations of random matrices. Specifically, we prove almost sure convergence of the extreme eigenvalues and appropriate projections of the corresponding eigenvectors of…

Probability · Mathematics 2012-03-19 Florent Benaych-Georges , Raj Rao Nadakuditi

In this text, based on elementary computations, we provide a perturbative expansion of the coordinates of the eigenvectors of a Hermitian matrix of large size perturbed by a random matrix with small operator norm whose entries in the…

Probability · Mathematics 2020-03-19 Florent Benaych-Georges , Nathanaël Enriquez , Alkéos Michaïl

We study the problem of Differentially Private Stochastic Convex Optimization (DP-SCO) with heavy-tailed data. Specifically, we focus on the $\ell_1$-norm linear regression in the $\epsilon$-DP model. While most of the previous work focuses…

Machine Learning · Computer Science 2022-01-11 Di Wang , Jinhui Xu

We derive new perturbation bounds for eigenvalues of Hermitian matrices with block structures. The structures we consider range from a standard 2-by-2 block form to block tridiagonal and tridigaonal forms. The main idea is the observation…

Numerical Analysis · Mathematics 2010-09-01 Yuji Nakatsukasa

In this paper, we consider the singular values and singular vectors of finite, low rank perturbations of large rectangular random matrices. Specifically, we prove almost sure convergence of the extreme singular values and appropriate…

Probability · Mathematics 2012-01-27 Florent Benaych-Georges , Raj Rao Nadakuditi

Preconditioned iterative methods for numerical solution of large matrix eigenvalue problems are increasingly gaining importance in various application areas, ranging from material sciences to data mining. Some of them, e.g., those using…

Numerical Analysis · Mathematics 2017-05-12 Merico E. Argentati , Andrew V. Knyazev , Klaus Neymeyr , Evgueni E. Ovtchinnikov , Ming Zhou

The Davis--Kahan theorem is used in the analysis of many statistical procedures to bound the distance between subspaces spanned by population eigenvectors and their sample versions. It relies on an eigenvalue separation condition between…

Statistics Theory · Mathematics 2014-05-06 Yi Yu , Tengyao Wang , Richard J. Samworth

We present first-order perturbation analysis of a simple eigenvalue and the corresponding right and left eigenvectors of a general square matrix, not assumed to be Hermitian or normal. The eigenvalue result is well known to a broad…

Numerical Analysis · Mathematics 2019-06-04 Anne Greenbaum , Ren-cang Li , Michael L. Overton

A standard perturbation result states that perturbed eigenvalues and eigenprojections admit a perturbation series provided that the operator norm of the perturbation is smaller than a constant times the corresponding eigenvalue isolation…

Functional Analysis · Mathematics 2019-10-21 Martin Wahl

The classical Davis-Kahan theorem provides an efficient bound on the perturbation of eigenspaces of a matrix under a large (eigenvalue) gap condition. In this paper, we consider the case when the gap is moderate. Using a bootstrapping…

Numerical Analysis · Mathematics 2025-10-28 Phuc Tran , Van Vu

Let the dimension $N$ of data and the sample size $T$ tend to $\infty$ with $N/T \to c > 0$. The spectral properties of a sample correlation matrix $\mathbf{C}$ and a sample covariance matrix $\mathbf{S}$ are asymptotically equal whenever…

Statistics Theory · Mathematics 2024-07-11 Yohji Akama , Peng Tian

Spectral methods are widely used to estimate eigenvectors of a low-rank signal matrix subject to noise. These methods use the leading eigenspace of an observed matrix to estimate this low-rank signal. Typically, the entrywise estimation…

Statistics Theory · Mathematics 2024-11-01 Hao Yan , Keith Levin

We study ill-conditioned positive definite matrices that are disturbed by the sum of $m$ rank-one matrices of a specific form. We provide estimates for the eigenvalues and eigenvectors. When the condition number of the initial matrix tends…

Numerical Analysis · Mathematics 2024-03-13 Armand Gissler , Anne Auger , Nikolaus Hansen