English
Related papers

Related papers: Spectral Estimation with Free Decompression

200 papers

In this paper we present an efficient algorithm to compute the eigen decomposition of a matrix that is a weighted sum of the self outer products of vectors such as a covariance matrix of data. A well known algorithm to compute the eigen…

Numerical Analysis · Computer Science 2017-06-08 Youhei Akimoto

Via the process of isospectral graph reduction the adjacency matrix of a graph can be reduced to a smaller matrix while its spectrum is preserved up to some known set. It is then possible to estimate the spectrum of the original matrix by…

Spectral Theory · Mathematics 2015-03-13 L. A. Bunimovich , B. Z. Webb

Sample correlation matrices are employed ubiquitously in statistics. However, quite surprisingly, little is known about their asymptotic spectral properties for high-dimensional data, particularly beyond the case of "null models" for which…

Statistics Theory · Mathematics 2019-03-13 David Morales-Jimenez , Iain M. Johnstone , Matthew R. McKay , Jeha Yang

We study an "inner-product kernel" random matrix model, whose empirical spectral distribution was shown by Xiuyuan Cheng and Amit Singer to converge to a deterministic measure in the large $n$ and $p$ limit. We provide an interpretation of…

Probability · Mathematics 2017-02-03 Zhou Fan , Andrea Montanari

Given a large real symmetric, positive semidefinite m-by-m matrix, the goal of this paper is to show how a numerical approximation of the entropy, given by the sum of the entropies of the individual eigenvalues, can be computed in an…

Numerical Analysis · Mathematics 2014-06-13 Thomas P. Wihler , Bänz Bessire , André Stefanov

In statistics, assuming samples are independent is reasonable. However, this property can fail to hold for the features, a distinction that has led to several lines of work aiming to remove the latter assumption of independence present in…

Probability · Mathematics 2026-02-03 Simona Diaconu

The aim of this paper is to show how free probability theory sheds light on spectral properties of deformed matricial models and provides a unified understanding of various asymptotic phenomena such as spectral measure description,…

Probability · Mathematics 2016-07-20 M Capitaine , C Donati-Martin

We describe a method to determine the eigenvalue density of empirical covariance matrix in the presence of correlations between samples. This is a straightforward generalization of the method developed earlier by the authors for…

Statistical Mechanics · Physics 2008-12-02 Z. Burda , J. Jurkiewicz , B. Waclaw

Random matrix theory allows one to deduce the eigenvalue spectrum of a large matrix given only statistical information about its elements. Such results provide insight into what factors contribute to the stability of complex dynamical…

Disordered Systems and Neural Networks · Physics 2025-01-30 Joseph W. Baron , Thomas Jun Jewell , Christopher Ryder , Tobias Galla

Unsupervised estimation of the dimensionality of hyperspectral microspectroscopy datasets containing pure and mixed spectral features, and extraction of their representative endmember spectra, remains a challenge in biochemical data mining.…

This paper is concerned with the interplay between statistical asymmetry and spectral methods. Suppose we are interested in estimating a rank-1 and symmetric matrix $\mathbf{M}^{\star}\in \mathbb{R}^{n\times n}$, yet only a randomly…

Statistics Theory · Mathematics 2023-01-10 Yuxin Chen , Chen Cheng , Jianqing Fan

We show the effectiveness of automatic differentiation in efficiently and correctly computing and controlling the spectrum of implicitly linear operators, a rich family of layer types including all standard convolutional and dense layers.…

Machine Learning · Computer Science 2024-10-08 Ali Ebrahimpour Boroojeny , Matus Telgarsky , Hari Sundaram

Positive definite kernels and their associated Reproducing Kernel Hilbert Spaces provide a mathematically compelling and practically competitive framework for learning from data. In this paper we take the approximation theory point of view…

Machine Learning · Computer Science 2018-08-06 Mikhail Belkin

With the emergence of Artificial Intelligence, numerical algorithms are moving towards more approximate approaches. For methods such as PCA or diffusion maps, it is necessary to compute eigenvalues of a large matrix, which may also be dense…

Numerical Analysis · Mathematics 2023-11-17 Keerthi Gaddameedi , Severin Reiz , Tobias Neckel , Hans-Joachim Bungartz

We describe some numerical experiments which determine the degree of spectral instability of medium size randomly generated matrices which are far from self-adjoint. The conclusion is that the eigenvalues are likely to be intrinsically…

Spectral Theory · Mathematics 2007-05-23 E B Davies

The estimation of a density profile from experimental data points is a challenging problem, usually tackled by plotting a histogram. Prior assumptions on the nature of the density, from its smoothness to the specification of its form, allow…

Methodology · Statistics 2015-03-13 Alberto Bernacchia , Simone Pigolotti

We consider the minimization or maximization of the $J$th largest eigenvalue of an analytic and Hermitian matrix-valued function, and build on Mengi et al. (2014, SIAM J. Matrix Anal. Appl., 35, 699-724). This work addresses the setting…

Numerical Analysis · Mathematics 2017-06-19 Fatih Kangal , Karl Meerbergen , Emre Mengi , Wim Michiels

This paper uses an incremental matrix expansion approach to derive asymptotic eigenvalue distributions (a.e.d.'s) of sums and products of large random matrices. We show that the result can be derived directly as a consequence of two common…

Information Theory · Computer Science 2007-07-13 Matthew J. M. Peacock , Iain B. Collings , Michael L. Honig

Covariance matrix estimates are an essential part of many signal processing algorithms, and are often used to determine a low-dimensional principal subspace via their spectral decomposition. However, exact eigenanalysis is computationally…

Applications · Statistics 2011-12-01 Nicholas Arcolano , Patrick J. Wolfe

In this work, we present a method to exponentiate non-sparse indefinite low-rank matrices on a quantum computer. Given an operation for accessing the elements of the matrix, our method allows singular values and associated singular vectors…

Quantum Physics · Physics 2018-01-31 Patrick Rebentrost , Adrian Steffens , Seth Lloyd