English
Related papers

Related papers: Dimension-free Structured Covariance Estimation

200 papers

Covariate shift arises when covariate distributions differ between source and target populations while the conditional distribution of the response remains invariant, and it underlies problems in missing data and causal inference. We…

Methodology · Statistics 2026-01-13 Junjun Lang , Qiong Zhang , Yukun Liu

The study of third-order statistics in large-scale structure analyses has been hampered by the increased complexity of bispectrum estimators (compared to power spectra), the large dimensionality of the data vector, and the difficulty in…

Cosmology and Nongalactic Astrophysics · Physics 2025-01-20 Lea Harscouet , Jessica A. Cowell , Julia Ereza , David Alonso , Hugo Camacho , Andrina Nicola , Anže Slosar

We consider estimation of a sparse parameter vector that determines the covariance matrix of a Gaussian random vector via a sparse expansion into known "basis matrices". Using the theory of reproducing kernel Hilbert spaces, we derive lower…

Information Theory · Computer Science 2011-01-21 Alexander Jung , Sebastian Schmutzhard , Franz Hlawatsch , Alfred O. Hero

We derive an upper bound for the efficiency of estimating entries in the inverse covariance matrix of a high dimensional distribution. We show that in order to approximate an off-diagonal entry of the density matrix of a $d$-dimensional…

Statistics Theory · Mathematics 2015-05-06 Ronen Eldan

This paper aims to examine the characteristics of the posterior distribution of covariance/precision matrices in a "large $p$, large $n$" scenario, where $p$ represents the number of variables and $n$ is the sample size. Our analysis…

Statistics Theory · Mathematics 2026-02-02 Partha Sarkar , Kshitij Khare , Malay Ghosh , Matt P. Wand

A concrete lower-bound for the Hochschild cohomological dimension of a commutative $k$-algebra, in terms of three other homological invariants is obtained. This result is then used to show that most $k$-algebras fail to be quasi-free, even…

Rings and Algebras · Mathematics 2021-01-28 Anastasis Kratsios

Let $Y$ be a $d$-dimensional random vector with unknown mean $\mu$ and covariance matrix $\Sigma$. This paper is motivated by the problem of designing an estimator of $\Sigma$ that admits tight deviation bounds in the operator norm under…

Statistics Theory · Mathematics 2018-03-09 Stanislav Minsker , Xiaohan Wei

We study the fundamental problem of estimating the mean of a $d$-dimensional distribution with covariance $\Sigma \preccurlyeq \sigma^2 I_d$ given $n$ samples. When $d = 1$, \cite{catoni} showed an estimator with error $(1+o(1)) \cdot…

Statistics Theory · Mathematics 2024-02-20 Shivam Gupta , Samuel B. Hopkins , Eric Price

We study weighted sums of free identically distributed self-adjoint random variables with weights chosen randomly from the unit sphere and show that the Kolmogorov distance between the distribution of such a weighted sum and Wigner's…

Probability · Mathematics 2024-08-26 Leonie Neufeld

The constrained minimization (respectively maximization) of directed distances and of related generalized entropies is a fundamental task in information theory as well as in the adjacent fields of statistics, machine learning, artificial…

Information Theory · Computer Science 2024-10-28 Michel Broniatowski , Wolfgang Stummer

We study sample covariance matrices arising from rectangular random matrices with i.i.d. columns. It was previously known that the resolvent of these matrices admits a deterministic equivalent when the spectral parameter stays bounded away…

Probability · Mathematics 2022-11-24 Clément Chouard

Due to the complexity of order statistics, the finite sample behaviour of robust statistics is generally not analytically solvable. While the Monte Carlo method can provide approximate solutions, its convergence rate is typically very slow,…

Methodology · Statistics 2024-09-12 Li Tuobang

Inferring causal relationships or related associations from observational data can be invalidated by the existence of hidden confounding. We focus on a high-dimensional linear regression setting, where the measured covariates are affected…

Methodology · Statistics 2021-07-22 Zijian Guo , Domagoj Ćevid , Peter Bühlmann

Given N data points drawn from a chi-square distribution, we use Bayesian inference to determine most likely values and N-dependent confidence intervals for the width sigma and the number k of degrees of freedom of that distribution. Using…

Nuclear Theory · Physics 2021-06-14 H. -L. Harney , H. A. Weidenmüller

We consider covariance estimation of any subgaussian distribution from finitely many i.i.d. samples that are quantized to one bit of information per entry. Recent work has shown that a reliable estimator can be constructed if uniformly…

Statistics Theory · Mathematics 2024-01-15 Sjoerd Dirksen , Johannes Maly

This paper introduces a subspace method for the estimation of an array covariance matrix. It is shown that when the received signals are uncorrelated, the true array covariance matrices lie in a specific subspace whose dimension is…

Numerical Analysis · Computer Science 2014-11-04 Mostafa Rahmani , George Atia

The association between two random variables is often of primary interest in statistical research. In this paper semiparametric models for the association between random vectors X and Y are considered which leave the marginal distributions…

Statistics Theory · Mathematics 2012-04-16 Angelika Franke , Gerhard Osius

The purpose of this paper is to construct confidence intervals for the regression coefficients in the Fine-Gray model for competing risks data with random censoring, where the number of covariates can be larger than the sample size. Despite…

Methodology · Statistics 2019-04-10 Jue Hou , Jelena Bradic , Ronghui Xu

We give the first polynomial time algorithm for \emph{list-decodable covariance estimation}. For any $\alpha > 0$, our algorithm takes input a sample $Y \subseteq \mathbb{R}^d$ of size $n\geq d^{\mathsf{poly}(1/\alpha)}$ obtained by…

Data Structures and Algorithms · Computer Science 2022-06-23 Misha Ivkov , Pravesh K. Kothari

This paper investigates limiting properties of eigenvalues of multivariate sample spatial-sign covariance matrices when both the number of variables and the sample size grow to infinity. The underlying p-variate populations are general…

Statistics Theory · Mathematics 2021-01-25 Weiming Li , Qinwen Wang , Jianfeng Yao , Wang Zhou