English
Related papers

Related papers: Estimating the Spectral Density of Large Implicit …

200 papers

We study a dynamic version of the implicit trace estimation problem. Given access to an oracle for computing matrix-vector multiplications with a dynamically changing matrix A, our goal is to maintain an accurate approximation to A's trace…

Data Structures and Algorithms · Computer Science 2021-10-27 Prathamesh Dharangutte , Christopher Musco

We compute spectra of large stochastic matrices $W$, defined on sparse random graphs, where edges $(i,j)$ of the graph are given positive random weights $W_{ij}>0$ in such a fashion that column sums are normalized to one. We compute spectra…

Disordered Systems and Neural Networks · Physics 2015-06-23 Reimer Kuehn

High-dimensional inference refers to problems of statistical estimation in which the ambient dimension of the data may be comparable to or possibly even larger than the sample size. We study an instance of high-dimensional inference in…

Statistics Theory · Mathematics 2009-12-31 Sahand Negahban , Martin J. Wainwright

In dealing with high-dimensional data sets, factor models are often useful for dimension reduction. The estimation of factor models has been actively studied in various fields. In the first part of this paper, we present a new approach to…

Statistical Finance · Quantitative Finance 2017-11-27 Joongyeub Yeo , George Papanicolaou

Estimation of a high dimensional precision matrix is a critical problem to many areas of statistics including Gaussian graphical models and inference on high dimensional data. Working under the structural assumption of sparsity, we propose…

Methodology · Statistics 2020-12-17 Adam B Kashlak

Undirected graphical models are widely used in statistics, physics and machine vision. However Bayesian parameter estimation for undirected models is extremely challenging, since evaluation of the posterior typically involves the…

Computation · Statistics 2012-03-19 Richard G. Everitt

The original contributions of this paper are twofold: a new understanding of the influence of noise on the eigenvectors of the graph Laplacian of a set of image patches, and an algorithm to estimate a denoised set of patches from a noisy…

Data Analysis, Statistics and Probability · Physics 2012-03-01 Francois G. Meyer , Xilin Shen

Inspired by the quantum computing algorithms for Linear Algebra problems [HHL,TaShma] we study how the simulation on a classical computer of this type of "Phase Estimation algorithms" performs when we apply it to solve the Eigen-Problem of…

Data Structures and Algorithms · Computer Science 2017-04-07 Michael Ben-Or , Lior Eldar

We propose to quantify the complexity of non-equilibrium steady state density operators, as well as of long-lived Liouvillian decay modes, in terms of level spacing distribution of their spectra. Based on extensive numerical studies in a…

Quantum Physics · Physics 2013-10-01 Tomaz Prosen , Marko Znidaric

Estimating the eigenvalues of non-normal matrices is a foundational problem with far-reaching implications, from modeling non-Hermitian quantum systems to analyzing complex fluid dynamics. Yet, this task remains beyond the reach of standard…

Quantum Physics · Physics 2025-10-23 Yukun Zhang , Yusen Wu , Xiao Yuan

We investigate the problem of estimating a given real symmetric signal matrix $\textbf{C}$ from a noisy observation matrix $\textbf{M}$ in the limit of large dimension. We consider the case where the noisy measurement $\textbf{M}$ comes…

Statistical Mechanics · Physics 2016-10-28 Joël Bun , Romain Allez , Jean-Philippe Bouchaud , Marc Potters

Graph is a highly generic and diverse representation, suitable for almost any data processing problem. Spectral graph theory has been shown to provide powerful algorithms, backed by solid linear algebra theory. It thus can be extremely…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Or Streicher , Ido Cohen , Guy Gilboa

Estimating the eigenvalues of a population covariance matrix from a sample covariance matrix is a problem of fundamental importance in multivariate statistics; the eigenvalues of covariance matrices play a key role in many widely…

Statistics Theory · Mathematics 2007-06-13 Noureddine El Karoui

According to recent findings [1,2], empirical covariance matrices deduced from financial return series contain such a high amount of noise that, apart from a few large eigenvalues and the corresponding eigenvectors, their structure can…

Statistical Mechanics · Physics 2009-11-07 Szilard Pafka , Imre Kondor

This paper is concerned with the interplay between statistical asymmetry and spectral methods. Suppose we are interested in estimating a rank-1 and symmetric matrix $\mathbf{M}^{\star}\in \mathbb{R}^{n\times n}$, yet only a randomly…

Statistics Theory · Mathematics 2023-01-10 Yuxin Chen , Chen Cheng , Jianqing Fan

Consider the empirical autocovariance matrix at a given non-zero time lag based on observations from a multivariate complex Gaussian stationary time series. The spectral analysis of these autocovariance matrices can be useful in certain…

Statistics Theory · Mathematics 2022-06-01 Arup Bose , Walid Hachem

We introduce a method for describing eigenvalue distributions of correlation matrices from multidimensional time series. Using our newly developed matrix H theory, we improve the description of eigenvalue spectra for empirical correlation…

Statistical Finance · Quantitative Finance 2025-12-01 Luan M. T. de Moraes , Antônio M. S. Macêdo , Giovani L. Vasconcelos , Raydonal Ospina

We consider the problem of estimating a rank-one matrix in Gaussian noise under a probabilistic model for the left and right factors of the matrix. The probabilistic model can impose constraints on the factors including sparsity and…

Information Theory · Computer Science 2015-09-16 Alyson K. Fletcher , Sundeep Rangan

Sparse non-Hermitian random matrices arise in the study of disordered physical systems with asymmetric local interactions, and have applications ranging from neural networks to ecosystem dynamics. The spectral characteristics of these…

Statistical Mechanics · Physics 2024-02-21 Fernando Lucas Metz , Izaak Neri , Tim Rogers

We study the matrix denoising problem of estimating the singular vectors of a rank-$1$ signal corrupted by noise with both column and row correlations. Existing works are either unable to pinpoint the exact asymptotic estimation error or,…

Statistics Theory · Mathematics 2024-10-29 Yihan Zhang , Marco Mondelli