English
Related papers

Related papers: Covariance estimation for distributions with $2+\v…

200 papers

Estimating covariance matrices is a problem of fundamental importance in multivariate statistics. In practice it is increasingly frequent to work with data matrices $X$ of dimension $n\times p$, where $p$ and $n$ are both large. Results…

Statistics Theory · Mathematics 2009-01-22 Noureddine El Karoui

We study a standard distributed optimization framework where $N$ networked nodes collaboratively minimize the sum of their local convex costs. The main body of existing work considers the described problem when the underling network is…

Optimization and Control · Mathematics 2018-03-22 Anit Kumar Sahu , Dusan Jakovetic , Dragana Bajovic , Soummya Kar

We consider the problem of estimating the mean of a random vector based on $N$ independent, identically distributed observations. We prove the existence of an estimator that has a near-optimal error in all directions in which the variance…

Statistics Theory · Mathematics 2020-10-23 Gabor Lugosi , Shahar Mendelson

We consider the problem of estimating the support size of a discrete distribution whose minimum non-zero mass is at least $ \frac{1}{k}$. Under the independent sampling model, we show that the sample complexity, i.e., the minimal sample…

Statistics Theory · Mathematics 2016-12-13 Yihong Wu , Pengkun Yang

We establish local laws for sample covariance matrices $K = N^{-1}\sum_{i=1}^N \g_i\g_i^*$ where the random vectors $\g_1, \ldots, \g_N \in \R^n$ are independent with common covariance $\Sigma$. Previous work has largely focused on the…

Probability · Mathematics 2026-02-24 Zhou Fan , Renyuan Ma , Elliot Paquette , Zhichao Wang

Pocock and Simon's minimization method is a popular approach for covariate-adaptive randomization in clinical trials. Valid statistical inference with data collected under the minimization method requires the knowledge of the limiting…

Methodology · Statistics 2023-12-29 Zixuan Zhao , Yanglei Song , Wenyu Jiang , Dongsheng Tu

We consider an $n$ agents distributed optimization problem with imperfect information characterized in a parametric sense, where the unknown parameter can be solved by a distinct distributed parameter learning problem. Though each agent…

Optimization and Control · Mathematics 2024-04-23 Yaqun Yang , Jinlong Lei

This paper considers estimation of sparse covariance matrices and establishes the optimal rate of convergence under a range of matrix operator norm and Bregman divergence losses. A major focus is on the derivation of a rate sharp minimax…

Statistics Theory · Mathematics 2013-02-14 T. Tony Cai , Harrison H. Zhou

Given i.i.d. observations of a random vector $X \in \mathbb{R}^p$, we study the problem of estimating both its covariance matrix $\Sigma^*$, and its inverse covariance or concentration matrix {$\Theta^* = (\Sigma^*)^{-1}$.} We estimate…

Machine Learning · Statistics 2008-11-24 Pradeep Ravikumar , Martin J. Wainwright , Garvesh Raskutti , Bin Yu

We show that the spectral radius of an $N\times N$ random symmetric matrix with i.i.d. bounded centered but non-symmetrically distributed entries is bounded from below by $ 2 \*\sigma - o(N^{-6/11+\epsilon}), $ where $\sigma^2 $ is the…

Probability · Mathematics 2008-05-14 Sandrine Peche , Alexander Soshnikov

We propose nonparametric estimators for the second-order central moments of possibly anisotropic spherical random fields, within a functional data analysis context. We consider a measurement framework where each random field among an…

Statistics Theory · Mathematics 2022-06-28 Alessia Caponera , Julien Fageot , Matthieu Simeoni , Victor M. Panaretos

In covariance matrix estimation, one of the challenges lies in finding a suitable model and an efficient estimation method. Two commonly used modelling approaches in the literature involve imposing linear restrictions on the covariance…

Statistics Theory · Mathematics 2024-05-09 Piotr Zwiernik

Let $K$ be an isotropic convex body in $\R^n$. Given $\eps>0$, how many independent points $X_i$ uniformly distributed on $K$ are needed for the empirical covariance matrix to approximate the identity up to $\eps$ with overwhelming…

Probability · Mathematics 2015-05-13 Radosław Adamczak , Alexander E. Litvak , Alain Pajor , Nicole Tomczak-Jaegermann

We introduce a distributionally robust maximum likelihood estimation model with a Wasserstein ambiguity set to infer the inverse covariance matrix of a $p$-dimensional Gaussian random vector from $n$ independent samples. The proposed model…

Optimization and Control · Mathematics 2018-05-21 Viet Anh Nguyen , Daniel Kuhn , Peyman Mohajerin Esfahani

Logarithmic Sobolev inequalities are a powerful way to estimate the rate of convergence of Markov chains and to derive concentration inequalities on distributions. We prove that the log-Sobolev constant of any isotropic logconcave density…

Probability · Mathematics 2017-12-06 Yin Tat Lee , Santosh S. Vempala

We obtain minimax-optimal convergence rates in the supremum norm, including information-theoretic lower bounds, for estimating the covariance kernel of a stochastic process which is repeatedly observed at discrete, synchronous design…

Statistics Theory · Mathematics 2025-09-03 Max Berger , Hajo Holzmann

We consider linear random coefficient regression models, where the regressors are allowed to have a finite support. First, we investigate identifiability, and show that the means and the variances and covariances of the random coefficients…

Statistics Theory · Mathematics 2023-06-16 Philipp Hermann , Hajo Holzmann

Consider the random matrix $\Sigma = D^{1/2} X \widetilde D^{1/2}$ where $D$ and $\widetilde D$ are deterministic Hermitian nonnegative matrices with respective dimensions $N \times N$ and $n \times n$, and where $X$ is a random matrix with…

Probability · Mathematics 2015-02-05 Romain Couillet , Walid Hachem

We investigate the bias and error in estimates of the cosmological parameter covariance matrix, due to sampling or modelling the data covariance matrix, for likelihood width and peak scatter estimators. We show that these estimators do not…

Cosmology and Nongalactic Astrophysics · Physics 2015-06-18 Andy Taylor , Benjamin Joachimi

We show that the spectral radius of an $N\times N$ random symmetric matrix with i.i.d. bounded centered but non-symmetrically distributed entries is bounded from above by $ 2 \*\sigma + o(N^{-6/11+\epsilon}), $ where $\sigma^2 $ is the…

Probability · Mathematics 2007-05-23 Sandrine Peche , Alexander Soshnikov