English
Related papers

Related papers: Limiting spectral distribution of sample autocovar…

200 papers

We study an "inner-product kernel" random matrix model, whose empirical spectral distribution was shown by Xiuyuan Cheng and Amit Singer to converge to a deterministic measure in the large $n$ and $p$ limit. We provide an interpretation of…

Probability · Mathematics 2017-02-03 Zhou Fan , Andrea Montanari

This paper studies the theoretical underpinnings of machine learning of ergodic It\^o diffusions. The objective is to understand the convergence properties of the invariant statistics when the underlying system of stochastic differential…

Machine Learning · Computer Science 2021-10-04 He Zhang , John Harlim , Xiantao Li

In this paper we consider ensemble of random matrices $\X_n$ with independent identically distributed vectors $(X_{ij}, X_{ji})_{i \neq j}$ of entries. Under assumption of finite fourth moment of matrix entries it is proved that empirical…

Probability · Mathematics 2012-08-07 Alexey Naumov

In supervised learning, training and test datasets are often sampled from distinct distributions. Domain adaptation techniques are thus required. Covariate shift adaptation yields good generalization performance when domains differ only by…

Machine Learning · Statistics 2022-01-11 Felipe Maia Polo , Renato Vicente

Accelerated stochastic gradient descent (ASGD) is a workhorse in deep learning and often achieves better generalization performance than SGD. However, existing optimization theory can only explain the faster convergence of ASGD, but cannot…

Machine Learning · Computer Science 2023-11-27 Xuheng Li , Yihe Deng , Jingfeng Wu , Dongruo Zhou , Quanquan Gu

We simulate the transition from amplified spontaneous emission (ASE) to lasing in random systems with varying degrees of mode overlap. This is accomplished by solving the stochastic Maxwell-Bloch equations with the finite-difference…

Optics · Physics 2010-12-30 Jonathan Andreasen , Hui Cao

We study the limiting behavior of smooth linear statistics of the spectrum of random permutation matrices in the mesoscopic regime, when the permutation follows one of the Ewens measures on the symmetric group. If we apply a smooth enough…

Probability · Mathematics 2019-10-10 Valentin Bahier , Joseph Najnudel

Exponential moving average (EMA) has recently gained significant popularity in training modern deep learning models, especially diffusion-based generative models. However, there have been few theoretical results explaining the effectiveness…

Machine Learning · Computer Science 2025-02-21 Xuheng Li , Quanquan Gu

Results on the spectral behavior of random matrices as the dimension increases are applied to the problem of detecting the number of sources impinging on an array of sensors. A common strategy to solve this problem is to estimate the…

Statistics Theory · Mathematics 2022-12-09 J. W. Silverstein , P. L. Combettes

Random Schroedinger operators with imaginary vector potentials are studied in dimension one. These operators are non-Hermitian and their spectra lie in the complex plane. We consider the eigenvalue problem on finite intervals of length n…

Mathematical Physics · Physics 2007-05-23 I. Ya. Goldsheid , B. A. Khoruzhenko

This article provides a central limit theorem for a consistent estimator of population eigenvalues with large multiplicities based on sample covariance matrices. The focus is on limited sample size situations, whereby the number of…

Probability · Mathematics 2011-08-31 Jianfeng Yao , Romain Couillet , Jamal Najim , Merouane Debbah

Ensemble Conditional Variance Estimation (ECVE) is a novel sufficient dimension reduction (SDR) method in regressions with continuous response and predictors. ECVE applies to general non-additive error regression models. It operates under…

Methodology · Statistics 2021-03-01 Lukas Fertl , Efstathia Bura

Extreme value (EV) statistics of correlated systems are widely investigated in many fields, spanning the spectrum from weather forecasting to earthquake prediction. Does the unavoidable discrete sampling of a continuous correlated…

Statistical Mechanics · Physics 2022-08-29 Lior Zarfaty , Eli Barkai , David A. Kessler

We consider large complex random sample covariance matrices obtained from "spiked populations", that is when the true covariance matrix is diagonal with all but finitely many eigenvalues equal to one. We investigate the limiting behavior of…

Mathematical Physics · Physics 2015-05-13 Delphine Féral , Sandrine Péché

We consider an $N \times N$ random symmetric Toeplitz matrix with an i.i.d. input sequence drawn from a distribution that lies in the domain of attraction of an $\alpha$-stable law for $0 < \alpha < 2$. We show that under an appropriate…

Probability · Mathematics 2023-04-26 Ratul Biswas , Arnab Sen

Correlated random fields are a common way to model dependence struc- tures in high-dimensional data, especially for data collected in imaging. One important parameter characterizing the degree of dependence is the asymp- totic variance…

Statistics Theory · Mathematics 2018-03-20 Annabel Prause , Ansgar Steland

This paper uses an incremental matrix expansion approach to derive asymptotic eigenvalue distributions (a.e.d.'s) of sums and products of large random matrices. We show that the result can be derived directly as a consequence of two common…

Information Theory · Computer Science 2007-07-13 Matthew J. M. Peacock , Iain B. Collings , Michael L. Honig

This paper is concerned with regular approximations of spectra of singular discrete linear Hamiltonian systems with one singular endpoint. For any given self-adjoint subspace extension (SSE) of the corresponding minimal subspace, its…

Spectral Theory · Mathematics 2017-01-25 Yan Liu , Yuming Shi

Consider the product of $m$ independent $n\times n$ random matrices from the spherical ensemble for $m\ge 1$. The empirical distribution based on the $n$ eigenvalues of the product is called the empirical spectral distribution. Two recent…

Statistics Theory · Mathematics 2017-04-06 Shuhua Chang , Yongcheng Qi

The scaled standard Wigner matrix (symmetric with mean zero, variance one i.i.d. entries), and its limiting eigenvalue distribution, namely the semi-circular distribution, has attracted much attention. The $2k$th moment of the limit equals…

Probability · Mathematics 2021-03-18 Arup Bose , Koushik Saha , Arusharka Sen , Priyanka Sen