English
Related papers

Related papers: Extreme eigenvalues of large-dimensional spiked Fi…

200 papers

We study the high-dimensional inference of a rank-one signal corrupted by sparse noise. The noise is modelled as the adjacency matrix of a weighted undirected graph with finite average connectivity in the large size limit. Using the replica…

Machine Learning · Statistics 2025-11-18 Urte Adomaityte , Gabriele Sicuro , Pierpaolo Vivo

Sample correlation matrices are employed ubiquitously in statistics. However, quite surprisingly, little is known about their asymptotic spectral properties for high-dimensional data, particularly beyond the case of "null models" for which…

Statistics Theory · Mathematics 2019-03-13 David Morales-Jimenez , Iain M. Johnstone , Matthew R. McKay , Jeha Yang

Let $X$ be a centered random vector taking values in $\mathbb{R}^d$ and let $\Sigma= \mathbb{E}(X\otimes X)$ be its covariance matrix. We show that if $X$ satisfies an $L_4-L_2$ norm equivalence, there is a covariance estimator…

Statistics Theory · Mathematics 2019-03-28 Shahar Mendelson , Nikita Zhivotovskiy

The effective Fisher matrix method recently introduced by Cho et al. is a semi-analytic approach to the Fisher matrix, in which a local overlap surface is fitted by using a quadratic fitting function. Mathematically, the effective Fisher…

General Relativity and Quantum Cosmology · Physics 2013-10-14 Hee-Suk Cho , Chang-Hwan Lee

A deep neural network is a hierarchical nonlinear model transforming input signals to output signals. Its input-output relation is considered to be stochastic, being described for a given input by a parameterized conditional probability…

Machine Learning · Computer Science 2018-08-23 Shun-ichi Amari , Ryo Karakida , Masafumi Oizumi

The magnetic phase transition in a Heisenberg fluid is studied by means of the finite size scaling (FSS) technique. We find that even for larger systems, considered in an ensemble with fixed density, the critical exponents show deviations…

Statistical Mechanics · Physics 2009-10-31 I. M. Mryglod , I. P. Omelyan , R. Folk

Combining p-values to integrate multiple effects is of long-standing interest in social science and biomedical research. In this paper, we focus on revisiting a classical scenario closely related to meta-analysis, which combines a…

Methodology · Statistics 2022-04-15 Yusi Fang , Chung Chang , George Tseng

We study the scaling limits of stochastic gradient descent (SGD) with constant step-size in the high-dimensional regime. We prove limit theorems for the trajectories of summary statistics (i.e., finite-dimensional functions) of SGD as the…

Machine Learning · Statistics 2023-08-21 Gerard Ben Arous , Reza Gheissari , Aukosh Jagannath

Motivated by recent studies of population coding in theoretical neuroscience, we examine the optimality of a recently described form of stochastic resonance known as suprathreshold stochastic resonance, which occurs in populations of noisy…

Statistical Mechanics · Physics 2007-07-02 Mark D. McDonnell , Nigel G. Stocks , Charles E. M. Pearce , Derek Abbott

For sample covariance matrices with iid entries with sub-Gaussian tails, when both the number of samples and the number of variables become large and the ratio approaches to one, it is a well-known result of A. Soshnikov that the limiting…

Probability · Mathematics 2007-06-21 Sandrine Peche

Mimicking the maximum likelihood estimator, we construct first order Cramer-Rao efficient and explicitly computable estimators for the scale parameter $\sigma^2$ in the model $Z_{i,n}=\sigma n^{-\beta}X_i+Y_i,i=1,\ldots,n,\beta>0$ with…

Statistics Theory · Mathematics 2015-03-20 Till Sabel , Johannes Schmidt-Hieber

This paper investigates the signal detection problem in colored Gaussian noise with an unknown covariance matrix. To be specific, we consider a sample deficient scenario in which the number of signal bearing samples ($n$) is strictly…

Signal Processing · Electrical Eng. & Systems 2024-04-26 Prathapasinghe Dharmawansa , Saman Atapattu , Jamie Evans , Kandeepan Sithamparanathan

The Fisher information matrix (FIM) plays an important role in the analysis of parameter inference and system design problems. In a number of cases, however, the statistical data distribution and its associated information matrix are either…

Statistics Theory · Mathematics 2016-11-24 Dave Zachariah , Petre Stoica

Let the dimension $N$ of data and the sample size $T$ tend to $\infty$ with $N/T \to c > 0$. The spectral properties of a sample correlation matrix $\mathbf{C}$ and a sample covariance matrix $\mathbf{S}$ are asymptotically equal whenever…

Statistics Theory · Mathematics 2024-07-11 Yohji Akama , Peng Tian

Many complex systems can be reduced to their key components through spectrally decomposing matrices that capture their dynamics. These matrices can in turn be constructed from data, often by least-squares fitting: examples of algorithms to…

Numerical Analysis · Mathematics 2026-05-18 Caroline Wormell

Recently new approaches for sensing the frequency of time dependent Hamiltonians have been presented, and it was shown that the optimal Fisher information scales as $T^{4}.$ We present here our interpretation of this new scaling, where the…

Quantum Physics · Physics 2017-09-13 Tuvia Gefen , Fedor Jelezko , Alex Retzker

This paper is devoted to the estimation of the minimal dimension P of the state-space realizations of a high-dimensional time series y, defined as a noisy version (the noise is white and Gaussian) of a useful signal with low rank rational…

Information Theory · Computer Science 2021-10-25 Daria Tieplova , Philippe Loubaton

This paper discusses fluctuations of linear spectral statistics of high-dimensional sample covariance matrices when the underlying population follows an elliptical distribution. Such population often possesses high order correlations among…

Statistics Theory · Mathematics 2018-03-22 Jiang Hu , Weiming Li , Zhi Liu , Wang Zhou

We study sample covariance matrices of the form $W=\frac 1n C C^T$, where $C$ is a $k\times n$ matrix with i.i.d. mean zero entries. This is a generalization of so-called Wishart matrices, where the entries of $C$ are independent and…

Probability · Mathematics 2009-01-29 Anne Fey , Remco van der Hofstad , Marten Klok

The top eigenvalues of rank $r$ spiked real Wishart matrices and additively perturbed Gaussian orthogonal ensembles are known to exhibit a phase transition in the large size limit. We show that they have limiting distributions for…

Probability · Mathematics 2016-09-28 Alex Bloemendal , Bálint Virág