English
Related papers

Related papers: Sampling without replacement from a high-dimension…

200 papers

This article attempts to offer some perspectives on Bayesian inference for finite population quantities when the units in the population are assumed to exhibit complex dependencies. Beginning with an overview of Bayesian hierarchical…

Methodology · Statistics 2025-09-15 Sudipto Banerjee

We prove deviation inequalities for sums of high-dimensional random matrices and operators with dependence and {\rc heavy tails}. Estimation of high-dimensional matrices is a concern for numerous modern applications. However, most results…

Statistics Theory · Mathematics 2025-06-26 Shogo Nakakita , Pierre Alquier , Masaaki Imaizumi

This paper uses an incremental matrix expansion approach to derive asymptotic eigenvalue distributions (a.e.d.'s) of sums and products of large random matrices. We show that the result can be derived directly as a consequence of two common…

Information Theory · Computer Science 2007-07-13 Matthew J. M. Peacock , Iain B. Collings , Michael L. Honig

In this paper, we use a new approach to prove that the largest eigenvalue of the sample covariance matrix of a normally distributed vector is bigger than the true largest eigenvalue with probability 1 when the dimension is infinite. We…

Probability · Mathematics 2017-08-14 Soufiane Hayou

For two large matrices ${\mathbf X}$ and ${\mathbf Y}$ with Gaussian i.i.d.\ entries and dimensions $T\times N_X$ and $T\times N_Y$, respectively, we derive the probability distribution of the singular values of $\mathbf{X}^T \mathbf{Y}$ in…

Statistics Theory · Mathematics 2025-08-29 Arabind Swain , Sean Alexander Ridout , Ilya Nemenman

We show that the operatorial framework developed by Voiculescu for free random variables can be extended to arrays of random variables whose multiplication imitates matricial multiplication. The associated notion of independence, called…

Operator Algebras · Mathematics 2010-05-28 Romuald Lenczewski

Solving the generalized eigenvalue problem is a useful method for finding energy eigenstates of large quantum systems. It uses projection onto a set of basis states which are typically not orthogonal. One needs to invert a matrix whose…

Nuclear Theory · Physics 2023-04-05 Caleb Hicks , Dean Lee

In this paper, we study inference for high-dimensional data characterized by small sample sizes relative to the dimension of the data. In particular, we provide an infinite-dimensional framework to study statistical models that involve…

Statistics Theory · Mathematics 2010-02-25 Jim Kuelbs , Anand N. Vidyashankar

This paper examines the distribution of order statistics taken from simple-random-sampling without replacement (SRSWOR) from a finite population with values 1,...,N. This distribution is a shifted version of the beta-binomial distribution,…

Statistics Theory · Mathematics 2023-09-01 Ben O'Neill

Given a linear dynamical system, we consider the problem of constructing an approximate system using only a subset of the sensors out of the total set such that the observability Gramian of the new system is approximately equal to that of…

Systems and Control · Computer Science 2018-11-08 Shaunak D. Bopardikar

We propose a two-sample test for large-dimensional covariance matrices in generalized elliptical models. The test statistic is based on a U-statistic estimator of the squared Frobenius norm of the difference between the two population…

Statistics Theory · Mathematics 2025-07-04 Nina Dörnemann

The estimation of large covariance matrices has a high dimensional bias. Correcting for this bias can be reformulated via the tool of Free Probability Theory as a free deconvolution. The goal of this work is a computational and statistical…

Probability · Mathematics 2023-05-10 Reda Chhaibi , Fabrice Gamboa , Slim Kammoun , Mauricio Velasco

Many complex systems can be reduced to their key components through spectrally decomposing matrices that capture their dynamics. These matrices can in turn be constructed from data, often by least-squares fitting: examples of algorithms to…

Numerical Analysis · Mathematics 2026-05-18 Caroline Wormell

We consider fluctuations of the largest eigenvalues of the random matrix model $A+UBU^{*}$ where $A$ and $B$ are $N \times N$ deterministic Hermitian (or symmetric) matrices and $U$ is a Haar-distributed unitary (or orthogonal) matrix. We…

Probability · Mathematics 2023-03-08 Hong Chang Ji , Jaewhi Park

The classical methods of multivariate analysis are based on the eigenvalues of one or two sample covariance matrices. In many applications of these methods, for example to high dimensional data, it is natural to consider alternative…

Statistics Theory · Mathematics 2014-06-17 Prathapasinghe Dharmawansa , Iain M. Johnstone

We introduce a new ``$(m,mp/n)$ out of $(n,p)$'' sampling-with-replace\-ment bootstrap for eigenvalue statistics of high-dimensional sample covariance matrices based on $n$ independent $p$-dimensional random vectors. As it only uses…

Statistics Theory · Mathematics 2026-03-24 Holger Dette , Angelika Rohde

Missing data occur frequently in a wide range of applications. In this paper, we consider estimation of high-dimensional covariance matrices in the presence of missing observations under a general missing completely at random model in the…

Methodology · Statistics 2016-05-17 T. Tony Cai , Anru Zhang

We provide bounds on the tail probabilities for simple procedures that generate random samples _without replacement_, when the probabilities of being selected need not be equal.

Probability · Mathematics 2024-11-07 Dean P. Foster , Sergiu Hart

This paper examines the foundational concept of random variables in probability theory and statistical inference, demonstrating that their mathematical definition requires no reference to randomization or hypothetical repeated sampling. We…

Other Statistics · Statistics 2025-02-11 Paul W. Vos

Free probability and random matrix theory has shown to be a fruitful combination in many fields of research, such as digital communications, nuclear physics and mathematical finance. The link between free probability and eigenvalue…

Probability · Mathematics 2007-05-23 Øyvind Ryan , Mérouane Debbah