English
Related papers

Related papers: Sharp minimax tests for large covariance matrices …

200 papers

Robust covariance estimation is the following, well-studied problem in high dimensional statistics: given $N$ samples from a $d$-dimensional Gaussian $\mathcal{N}(\boldsymbol{0}, \Sigma)$, but where an $\varepsilon$-fraction of the samples…

Data Structures and Algorithms · Computer Science 2020-06-25 Jerry Li , Guanghao Ye

Maximizing the likelihood has been widely used for estimating the unknown covariance parameters of spatial Gaussian processes. However, evaluating and optimizing the likelihood function can be computationally intractable, particularly for…

Statistics Theory · Mathematics 2019-07-16 Hossein Keshavarz , XuanLong Nguyen , Clayton Scott

We investigate the problem of center estimation in the high dimensional binary sub-Gaussian Mixture Model with Hidden Markov structure on the labels. We first study the limitations of existing results in the high dimensional setting and…

Statistics Theory · Mathematics 2024-06-19 Vahe Karagulyan , Mohamed Ndaoud

In this paper we study the asymptotic normality in high-dimensional linear regression. We focus on the case where the covariance matrix of the regression variables has a KMS structure, in asymptotic settings where the number of predictors,…

Statistics Theory · Mathematics 2022-05-17 Saulius Jokubaitis , Remigijus Leipus

Sparse linear regression is one of the classical and extensively studied problems in high-dimensional statistics and compressed sensing. Despite the substantial body of literature dedicated to this problem, the precise determination of its…

Statistics Theory · Mathematics 2024-05-10 Yilin Guo , Shubhangi Ghosh , Haolei Weng , Arian Maleki

Motivated by differential co-expression analysis in genomics, we consider in this paper estimation and testing of high-dimensional differential correlation matrices. An adaptive thresholding procedure is introduced and theoretical…

Methodology · Statistics 2015-10-22 T. Tony Cai , Anru Zhang

We study the following fundamental hypothesis testing problem, which we term Gaussian mean testing. Given i.i.d. samples from a distribution $p$ on $\mathbb{R}^d$, the task is to distinguish, with high probability, between the following…

Statistics Theory · Mathematics 2022-10-26 Ilias Diakonikolas , Daniel M. Kane , Ankit Pensia

In Gaussian graphical models, the likelihood equations must typically be solved iteratively. We investigate two algorithms: A version of iterative proportional scaling which avoids inversion of large matrices, and an algorithm based on…

Computation · Statistics 2023-12-12 Søren Højsgaard , Steffen Lauritzen

Given a random sample of size $n$ from a $p$ dimensional random vector, where both $n$ and $p$ are large, we are interested in testing whether the $p$ components of the random vector are mutually independent. This is the so-called complete…

Statistics Theory · Mathematics 2022-01-24 Yongcheng Qi , Yingchao Zhou

We consider covariance estimation in the multivariate generalized Gaussian distribution (MGGD) and elliptically symmetric (ES) distribution. The maximum likelihood optimization associated with this problem is non-convex, yet it has been…

Methodology · Statistics 2015-06-15 Teng Zhang , Ami Wiesel , Maria Sabrina Grec

The study of networks leads to a wide range of high dimensional inference problems. In many practical applications, one needs to draw inference from one or few large sparse networks. The present paper studies hypothesis testing of graphs in…

We derive an upper bound for the efficiency of estimating entries in the inverse covariance matrix of a high dimensional distribution. We show that in order to approximate an off-diagonal entry of the density matrix of a $d$-dimensional…

Statistics Theory · Mathematics 2015-05-06 Ronen Eldan

We consider asymptotic distributions of maximum deviations of sample covariance matrices, a fundamental problem in high-dimensional inference of covariances. Under mild dependence conditions on the entries of the data matrices, we establish…

Statistics Theory · Mathematics 2011-09-05 Han Xiao , Wei Biao Wu

The covariance matrix of a $p$-dimensional random variable is a fundamental quantity in data analysis. Given $n$ i.i.d. observations, it is typically estimated by the sample covariance matrix, at a computational cost of $O(np^{2})$…

Computation · Statistics 2018-11-13 Ofer Shwartz , Boaz Nadler

We provide an algorithm for properly learning mixtures of two single-dimensional Gaussians without any separability assumptions. Given $\tilde{O}(1/\varepsilon^2)$ samples from an unknown mixture, our algorithm outputs a mixture that is…

Data Structures and Algorithms · Computer Science 2014-05-20 Constantinos Daskalakis , Gautam Kamath

A common pursuit in modern statistical learning is to attain satisfactory generalization out of the source data distribution (OOD). In theory, the challenge remains unsolved even under the canonical setting of covariate shift for the linear…

Machine Learning · Statistics 2025-02-14 Yuanshi Liu , Haihan Zhang , Qian Chen , Cong Fang

We consider tests of significance in the setting of the graphical lasso for inverse covariance matrix estimation. We propose a simple test statistic based on a subsequence of the knots in the graphical lasso path. We show that this…

Statistics Theory · Mathematics 2013-07-24 Max Grazier G'Sell , Jonathan Taylor , Robert Tibshirani

Heteroskedasticity testing in nonparametric regression is a classic statistical problem with important practical applications, yet fundamental limits are unknown. Adopting a minimax perspective, this article considers the testing problem in…

Statistics Theory · Mathematics 2024-12-11 Subhodh Kotekal , Soumyabrata Kundu

Supervised learning is often affected by a covariate shift in which the marginal distributions of instances (covariates $x$) of training and testing samples $\mathrm{p}_\text{tr}(x)$ and $\mathrm{p}_\text{te}(x)$ are different but the label…

Machine Learning · Statistics 2023-06-12 José I. Segovia-Martín , Santiago Mazuelas , Anqi Liu

High-dimensional changepoint inference that adapts to various change patterns has received much attention recently. We propose a simple, fast yet effective approach for adaptive changepoint testing. The key observation is that two…

Methodology · Statistics 2022-05-03 Guanghui Wang , Long Feng