中文
相关论文

相关论文: Improved covariance estimation: optimal robustness…

200 篇论文

Let $X_1,..., X_n \in \mathbb{R}^d$ be independent Gaussian random vectors with independent entries and variance profile $(b_{ij})_{i \in [d],j \in [n]}$. A major question in the study of covariance estimation is to give precise control on…

统计理论 · 数学 2023-07-19 Patrick Oliveira Santos

We consider the classical problem of estimating the covariance matrix of a subgaussian distribution from i.i.d. samples in the novel context of coarse quantization, i.e., instead of having full knowledge of the samples, they are quantized…

信息论 · 计算机科学 2022-04-25 Sjoerd Dirksen , Johannes Maly , Holger Rauhut

We construct an estimator $\widehat{\Sigma}$ for covariance matrices of unknown, centred random vectors X, with the given data consisting of N independent measurements $X_1,...,X_N$ of X and the wanted confidence level. We show under…

统计理论 · 数学 2024-02-14 Pedro Abdalla , Shahar Mendelson

A continuous-time regression model with a jointly strictly sub-Gaussian random noise is considered in the paper. Upper exponential bounds for probabilities of large deviations of the least squares estimator for the regression parameter are…

概率论 · 数学 2018-06-12 Alexander V. Ivanov , Igor V. Orlovskyi

We consider a robust estimation of linear regression coefficients. In this note, we focus on the case where the covariates are sampled from an $L$-subGaussian distribution with unknown covariance, the noises are sampled from a distribution…

统计理论 · 数学 2024-05-27 Takeyuki Sasai , Hironori Fujisawa

We study polynomial time algorithms for estimating the mean of a heavy-tailed multivariate random vector. We assume only that the random vector $X$ has finite mean and covariance. In this setting, the radius of confidence intervals achieved…

统计理论 · 数学 2019-06-05 Samuel B. Hopkins

We study the estimation of high-dimensional covariance matrices under elliptical factor models with 2 + {\epsilon}th moment. For such heavy-tailed data, robust estimators like the Huber-type estimator in Fan, Liu and Wang (2018) can not…

统计理论 · 数学 2024-06-27 Yi Ding , Xinghua Zheng

We derive an upper bound for the efficiency of estimating entries in the inverse covariance matrix of a high dimensional distribution. We show that in order to approximate an off-diagonal entry of the density matrix of a $d$-dimensional…

统计理论 · 数学 2015-05-06 Ronen Eldan

Estimation of the mean vector and covariance matrix is of central importance in the analysis of multivariate data. In the framework of generalized linear models, usually the variances are certain functions of the means with the normal…

统计方法学 · 统计学 2023-01-25 Anupam Kundu , Mohsen Pourahmadi

We address high dimensional covariance estimation for elliptical distributed samples, which are also known as spherically invariant random vectors (SIRV) or compound-Gaussian processes. Specifically we consider shrinkage methods that are…

统计方法学 · 统计学 2015-05-20 Yilun Chen , Ami Wiesel , Alfred O. Hero

Given an implicit $n\times n$ matrix $A$ with oracle access $x^TA x$ for any $x\in \mathbb{R}^n$, we study the query complexity of randomized algorithms for estimating the trace of the matrix. This problem has many applications in quantum…

计算复杂性 · 计算机科学 2014-05-29 Karl Wimmer , Yi Wu , Peng Zhang

We study parameter estimation in linear Gaussian covariance models, which are $p$-dimensional Gaussian models with linear constraints on the covariance matrix. Maximum likelihood estimation for this class of models leads to a non-convex…

统计理论 · 数学 2016-04-19 Piotr Zwiernik , Caroline Uhler , Donald Richards

We study the problem of high-dimensional robust linear regression where a learner is given access to $n$ samples from the generative model $Y = \langle X,w^* \rangle + \epsilon$ (with $X \in \mathbb{R}^d$ and $\epsilon$ independent), in…

We give the first polynomial-time, polynomial-sample, differentially private estimator for the mean and covariance of an arbitrary Gaussian distribution $\mathcal{N}(\mu,\Sigma)$ in $\mathbb{R}^d$. All previous estimators are either…

机器学习 · 统计学 2022-02-15 Gautam Kamath , Argyris Mouzakis , Vikrant Singhal , Thomas Steinke , Jonathan Ullman

This article studies the \emph{robust covariance matrix estimation} of a data collection $X = (x_1,\ldots,x_n)$ with $x_i = \sqrt \tau_i z_i + m$, where $z_i \in \mathbb R^p$ is a \textit{concentrated vector} (e.g., an elliptical random…

概率论 · 数学 2022-04-12 Cosme Louart , Romain Couillet

We revisit the problem of robust linear regression under Gaussian covariates with an unknown covariance matrix of condition number $\kappa$. For this fundamental problem, significant gaps remain in our understanding of the trade-offs among…

数据结构与算法 · 计算机科学 2026-05-19 Deeksha Adil , Jarosław Błasiok , Hongjie Chen , Deepak Narayanan Sridharan

In this work, we give efficient algorithms for privately estimating a Gaussian distribution in both pure and approximate differential privacy (DP) models with optimal dependence on the dimension in the sample complexity. In the pure DP…

数据结构与算法 · 计算机科学 2023-06-02 Daniel Alabi , Pravesh K. Kothari , Pranay Tankala , Prayaag Venkat , Fred Zhang

Relying on recent advances in statistical estimation of covariance distances based on random matrix theory, this article proposes an improved covariance and precision matrix estimation for a wide family of metrics. The method is shown to…

机器学习 · 统计学 2021-02-03 Malik Tiomoko , Florent Bouchard , Guillaume Ginholac , Romain Couillet

Fan et al. [$\mathit{Annals}$ $\mathit{of}$ $\mathit{Statistics}$ $\textbf{47}$(6) (2019) 3009-3031] constructed a distributed principal component analysis (PCA) algorithm to reduce the communication cost between multiple servers…

统计理论 · 数学 2021-10-07 Kangqiang Li , Han Bao , Lixin Zhang

We investigate the complexity of covariance matrix estimation for Gibbs distributions based on dependent samples from a Markov chain. We show that when $\pi$ satisfies a Poincar\'e inequality and the chain possesses a spectral gap, we can…

统计理论 · 数学 2024-10-23 Yunbum Kook , Matthew S. Zhang