English
Related papers

Related papers: Top eigenpair statistics of diluted Wishart matric…

200 papers

The problem of infering the top component of a noisy sample covariance matrix with prior information about the distribution of its entries is considered, in the framework of the spiked covariance model. Using the replica method of…

Statistical Mechanics · Physics 2016-12-20 Rémi Monasson

It has been proposed that complex populations, such as those that arise in genomics studies, may exhibit dependencies among observations as well as among variables. This gives rise to the challenging problem of analyzing unreplicated…

Machine Learning · Statistics 2018-06-08 Michael Hornstein , Roger Fan , Kerby Shedden , Shuheng Zhou

We consider sample covariance matrices $S_N=\frac{1}{p}\Sigma_N^{1/2}X_NX_N^* \Sigma_N^{1/2}$ where $X_N$ is a $N \times p$ real or complex matrix with i.i.d. entries with finite $12^{\rm th}$ moment and $\Sigma_N$ is a $N \times N$…

Probability · Mathematics 2009-11-17 Olivier Ledoit , Sandrine Péché

We revisit the task of computing the span of the top $r$ singular vectors $u_1, \ldots, u_r$ of a matrix under differential privacy. We show that a simple and efficient algorithm -- based on singular value decomposition and standard…

Machine Learning · Computer Science 2025-10-31 Tommaso d'Orsi , Gleb Novikov

This paper presents a new discretization error quantification method for the numerical integration of ordinary differential equations. The error is modelled by using the Wishart distribution, which enables us to capture the correlation…

Methodology · Statistics 2023-08-15 Naoki Marumo , Takeru Matsuda , Yuto Miyatake

We develop a new statistical model for photographic images, in which the local responses of a bank of linear filters are described as jointly Gaussian, with zero mean and a covariance that varies slowly over spatial position. We optimize…

Computer Vision and Pattern Recognition · Computer Science 2015-03-25 Olivier J. Hénaff , Johannes Ballé , Neil C. Rabinowitz , Eero P. Simoncelli

In this work, we give efficient algorithms for privately estimating a Gaussian distribution in both pure and approximate differential privacy (DP) models with optimal dependence on the dimension in the sample complexity. In the pure DP…

Data Structures and Algorithms · Computer Science 2023-06-02 Daniel Alabi , Pravesh K. Kothari , Pranay Tankala , Prayaag Venkat , Fred Zhang

We study efficient algorithms for linear regression and covariance estimation in the absence of Gaussian assumptions on the underlying distributions of samples, making assumptions instead about only finitely-many moments. We focus on how…

Many developments in Mathematics involve the computation of higher order derivatives of Gaussian density functions. The analysis of univariate Gaussian random variables is a well-established field whereas the analysis of their multivariate…

Computation · Statistics 2022-03-04 José E. Chacón , Tarn Duong

We establish a quantitative version of the Tracy--Widom law for the largest eigenvalue of high dimensional sample covariance matrices. To be precise, we show that the fluctuations of the largest eigenvalue of a sample covariance matrix…

Probability · Mathematics 2021-08-21 Kevin Schnelli , Yuanyuan Xu

We study the allocation of synthetic portfolios under hierarchical nested, one-factor, and diagonal structures of the population covariance matrix in a high-dimensional scenario. The noise reduction approaches for the sample realizations…

Computational Finance · Quantitative Finance 2025-03-10 Andrés García-Medina

This article provides a central limit theorem for a consistent estimator of population eigenvalues with large multiplicities based on sample covariance matrices. The focus is on limited sample size situations, whereby the number of…

Probability · Mathematics 2011-08-31 Jianfeng Yao , Romain Couillet , Jamal Najim , Merouane Debbah

Calculating the log-determinant of a matrix is useful for statistical computations used in machine learning, such as generative learning which uses the log-determinant of the covariance matrix to calculate the log-likelihood of model…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-11-21 Xiaomeng Dong , EN Barnett , Sudarshan K. Dhall

The accurate computation of the covariance matrix of fitted model parameters is a somewhat neglected task in Statistics. Algorithms are given for computing accurate covariance matrices derived from computing the Hessian matrix by numerical…

Computation · Statistics 2021-05-12 Rose Baker

This paper introduces some efficient initials for a well-known algorithm (an inverse iteration) for computing the maximal eigenpair of a class of real matrices. The initials not only avoid the collapse of the algorithm but are also…

Probability · Mathematics 2016-11-23 Mu-Fa Chen

We use available measurements to estimate the unknown parameters (variance, smoothness parameter, and covariance length) of a covariance function by maximizing the joint Gaussian log-likelihood function. To overcome cubic complexity in the…

Computation · Statistics 2018-09-13 Alexander Litvinenko , Ying Sun , Marc G. Genton , David Keyes

We study the properties of the eigenvalues of real random matrices and their products. It is known that when the matrix elements are Gaussian-distributed independent random variables, the fraction of real eigenvalues tends to unity as the…

Mathematical Physics · Physics 2016-01-13 Sajna Hameed , Kavita Jain , Arul Lakshminarayan

In this article, the joint fluctuations of the extreme eigenvalues and eigenvectors of a large dimensional sample covariance matrix are analyzed when the associated population covariance matrix is a finite-rank perturbation of the identity…

Information Theory · Computer Science 2012-06-20 Romain Couillet , Walid Hachem

Analytical understanding of how low-dimensional latent features reveal themselves in large-dimensional data is still lacking. We study this by defining a linear latent feature model with additive noise constructed from probabilistic…

Disordered Systems and Neural Networks · Physics 2022-07-20 Philipp Fleig , Ilya Nemenman

We study the eigenvalue behaviour of large complex correlated Wishart matrices near an interior point of the limiting spectrum where the density vanishes (cusp point), and refine the existing results at the hard edge as well. More…

Probability · Mathematics 2016-03-08 Walid Hachem , Adrien Hardy , Jamal Najim