English
Related papers

Related papers: Energy Landscape for large average submatrix detec…

200 papers

We consider the problem of estimating the factors of a low-rank $n \times d$ matrix, when this is corrupted by additive Gaussian noise. A special example of our setting corresponds to clustering mixtures of Gaussians with equal (known)…

Statistics Theory · Mathematics 2022-11-02 Andrea Montanari , Yuchen Wu

Under certain conditions, the largest eigenvalue of a sample covariance matrix undergoes a well-known phase transition when the sample size $n$ and data dimension $p$ diverge proportionally. In the subcritical regime, this eigenvalue has…

Statistics Theory · Mathematics 2025-04-01 Nina Dörnemann , Miles E. Lopes

We propose a new randomized optimization method for high-dimensional problems which can be seen as a generalization of coordinate descent to random subspaces. We show that an adaptive sampling strategy for the random subspace significantly…

Optimization and Control · Mathematics 2019-12-19 Jonathan Lacotte , Mert Pilanci , Marco Pavone

It is shown that the correlation functions of the random variables $\det(\lambda - X)$, in which $X$ is a real symmetric $ N\times N$ random matrix, exhibit universal local statistics in the large $N$ limit. The derivation relies on an…

Mathematical Physics · Physics 2009-11-07 E. Brezin , S. Hikami

A subspace method is introduced to solve large-scale trace ratio problems. This approach is matrix-free, requiring only the action of the two matrices involved in the trace ratio. At each iteration, a smaller trace ratio problem is…

Numerical Analysis · Mathematics 2024-12-04 G. Ferrandi , M. E. Hochstenbach , M. R. Oliveira

In this paper, we first propose a Bayesian neighborhood selection method to estimate Gaussian Graphical Models (GGMs). We show the graph selection consistency of this method in the sense that the posterior probability of the true model…

Applications · Statistics 2015-07-08 Zhixiang Lin , Tao Wang , Can Yang , Hongyu Zhao

We address the construction of stable random matrix ensembles as the generalization of the stable random variables (Levy distributions). With a simple method we derive the Cauchy case, which is known to have remarkable properties. These…

Statistical Mechanics · Physics 2007-05-23 M. Tierz

The matrix $A:\mathbb{R}^n \to \mathbb{R}^m$ is $(\delta,k)$-regular if for any $k$-sparse vector $x$, $$ \left| \|Ax\|_2^2-\|x\|_2^2\right| \leq \delta \sqrt{k} \|x\|_2^2. $$ We show that if $A$ is $(\delta,k)$-regular for $1 \leq k \leq…

Statistics Theory · Mathematics 2021-03-10 Shahar Mendelson

Large deviation behavior of the largest eigenvalue $\lambda_1$ of Gaussian networks (Erd\H{o}s-R\'enyi random graphs $\mathcal{G}_{n,p}$ with i.i.d. Gaussian weights on the edges) has been the topic of considerable interest. Recently in…

Probability · Mathematics 2021-02-17 Shirshendu Ganguly , Kyeongsik Nam

We study the reduced energy spectrum $\{E_{i}^{(n)}\}$, which is constructed by picking one level from every $n$ levels of the original spectrum $\{E_{i}\}$, in a Gaussian ensemble of random matrix with Dyson index $\beta\in \left( 0,\infty…

Disordered Systems and Neural Networks · Physics 2021-01-19 Wen-Jia Rao , M. N. Chen

We consider $N\times N$ Hermitian random matrices with independent identical distributed entries. The matrix is normalized so that the average spacing between consecutive eigenvalues is of order 1/N. Under suitable assumptions on the…

Mathematical Physics · Physics 2009-11-13 Laszlo Erdos , Benjamin Schlein , Horng-Tzer Yau

Recently, Chernozhukov, Chetverikov, and Kato [Ann. Statist. 42 (2014) 1564--1597] developed a new Gaussian comparison inequality for approximating the suprema of empirical processes. This paper exploits this technique to devise sharp…

Statistics Theory · Mathematics 2017-05-30 Fang Han , Sheng Xu , Wen-Xin Zhou

In an earlier work we had considered a Gaussian ensemble of random matrices in the presence of a given external matrix source. The measure is no longer unitary invariant and the usual techniques based on orthogonal polynomials, or on the…

Statistical Mechanics · Physics 2009-10-31 E. Brezin , S. Hikami

We derive a Gaussian approximation result for the maximum of a sum of high-dimensional random vectors. Specifically, we establish conditions under which the distribution of the maximum is approximated by that of the maximum of a sum of the…

Statistics Theory · Mathematics 2018-01-24 Victor Chernozhukov , Denis Chetverikov , Kengo Kato

This paper expands the analysis of randomized low-rank approximation beyond the Gaussian distribution to four classes of random matrices: (1) independent sub-Gaussian entries, (2) independent sub-Gaussian columns, (3) independent bounded…

Numerical Analysis · Mathematics 2023-08-14 Arvind K. Saibaba , Agnieszka Międlar

We present a new subspace-based method to construct probabilistic models for high-dimensional data and highlight its use in anomaly detection. The approach is based on a statistical estimation of probability density using densities of…

Machine Learning · Computer Science 2021-08-16 Cetin Savkli , Catherine Schwartz

We consider the singular vectors of any $m \times n$ submatrix of a rectangular $M \times N$ Gaussian matrix and study their asymptotic overlaps with those of the full matrix, in the macroscopic regime where $N \,/\, M\,$, $m \,/\, M$ as…

Probability · Mathematics 2025-01-16 Elie Attal , Romain Allez

We consider $N\times N$ symmetric random matrices where the probability distribution for each matrix element is given by a measure $\nu$ with a subexponential decay. We prove that the eigenvalue spacing statistics in the bulk of the…

Mathematical Physics · Physics 2010-11-25 Laszlo Erdos , Benjamin Schlein , Horng-Tzer Yau

Random Hermitian matrices with a source term arise, for instance, in the study of non-intersecting Brownian walkers \cite{Adler:2009a, Daems:2007} and sample covariance matrices \cite{Baik:2005}. We consider the case when the $n\times n$…

Mathematical Physics · Physics 2010-09-21 Marco Bertola , Robert Buckingham , Seung-Yeop Lee , Virgil U. Pierce

A new algorithm is developed to tackle the issue of sampling non-Gaussian model parameter posterior probability distributions that arise from solutions to Bayesian inverse problems. The algorithm aims to mitigate some of the hurdles faced…

Machine Learning · Statistics 2019-11-19 Leen Alawieh , Jonathan Goodman , John B. Bell