中文
相关论文

相关论文: Improved covariance estimation: optimal robustness…

200 篇论文

Performing statistical inference in high-dimension is an outstanding challenge. A major source of difficulty is the absence of precise information on the distribution of high-dimensional estimators. Here, we consider linear regression in…

统计理论 · 数学 2016-06-15 Adel Javanmard , Andrea Montanari

We derive a Gaussian approximation result for the maximum of a sum of high-dimensional random vectors. Specifically, we establish conditions under which the distribution of the maximum is approximated by that of the maximum of a sum of the…

统计理论 · 数学 2018-01-24 Victor Chernozhukov , Denis Chetverikov , Kengo Kato

We consider estimation of the covariance matrix of a multivariate random vector under the constraint that certain covariances are zero. We first present an algorithm, which we call Iterative Conditional Fitting, for computing the maximum…

统计理论 · 数学 2010-03-04 Sanjay Chaudhuri , Mathias Drton , Thomas S. Richardson

We study the problem of outlier robust high-dimensional mean estimation under a finite covariance assumption, and more broadly under finite low-degree moment assumptions. We consider a standard stability condition from the recent robust…

统计理论 · 数学 2021-03-17 Ilias Diakonikolas , Daniel M. Kane , Ankit Pensia

We introduce a distributionally robust maximum likelihood estimation model with a Wasserstein ambiguity set to infer the inverse covariance matrix of a $p$-dimensional Gaussian random vector from $n$ independent samples. The proposed model…

最优化与控制 · 数学 2018-05-21 Viet Anh Nguyen , Daniel Kuhn , Peyman Mohajerin Esfahani

We consider the problem of learning a graph modeling the statistical relations of the $d$ variables from a dataset with $n$ samples $X \in \mathbb{R}^{n \times d}$. Standard approaches amount to searching for a precision matrix $\Theta$…

机器学习 · 统计学 2023-12-13 Titouan Vayer , Etienne Lasalle , Rémi Gribonval , Paulo Gonçalves

Let $X$ be a symmetric, isotropic random vector in $\mathbb{R}^m$ and let $X_1...,X_n$ be independent copies of $X$. We show that under mild assumptions on $\|X\|_2$ (a suitable thin-shell bound) and on the tail-decay of the marginals…

泛函分析 · 数学 2022-07-13 Daniel Bartl , Shahar Mendelson

In this paper, we study robust covariance estimation under the approximate factor model with observed factors. We propose a novel framework to first estimate the initial joint covariance matrix of the observed data and the factors, and then…

统计方法学 · 统计学 2016-02-03 Jianqing Fan , Weichen Wang , Yiqiao Zhong

We study the problem of robust estimation of the mean vector of a sub-Gaussian distribution. We introduce an estimator based on spectral dimension reduction (SDR) and establish a finite sample upper bound on its error that is…

统计理论 · 数学 2022-04-06 Amir-Hossein Bateni , Arshak Minasyan , Arnak S. Dalalyan

Determining the number of factors in high-dimensional factor modeling is essential but challenging, especially when the data are heavy-tailed. In this paper, we introduce a new estimator based on the spectral properties of Spearman sample…

统计方法学 · 统计学 2024-08-29 Jiaxin Qiu , Zeng Li , Jianfeng Yao

In this work we construct an optimal linear shrinkage estimator for the covariance matrix in high dimensions. The recent results from the random matrix theory allow us to find the asymptotic deterministic equivalents of the optimal…

统计理论 · 数学 2014-10-28 Taras Bodnar , Arjun K. Gupta , Nestor Parolya

We revisit heavy-tailed corrupted least-squares linear regression assuming to have a corrupted $n$-sized label-feature sample of at most $\epsilon n$ arbitrary outliers. We wish to estimate a $p$-dimensional parameter $b^*$ given such…

统计理论 · 数学 2022-09-08 Roberto I. Oliveira , Zoraida F. Rico , Philip Thompson

In this paper, we present several estimators of the diagonal elements of the inverse of the covariance matrix, called precision matrix, of a sample of iid random vectors. The focus is on high dimensional vectors having a sparse precision…

统计理论 · 数学 2017-07-31 Samuel Balmand , Arnak S. Dalalyan

We study the Gaussian and robust covariance estimation, assuming the true covariance matrix to be a Kronecker product of two lower dimensional square matrices. In both settings we define the estimators as solutions to the constrained…

应用统计 · 统计学 2016-03-28 Ilya Soloveychik , Dmitry Trushin

In this paper we consider Tyler's robust covariance M-estimator under group symmetry constraints. We assume that the covariance matrix is invariant to the conjugation action of a unitary matrix group, referred to as group symmetry. Examples…

应用统计 · 统计学 2015-09-30 Ilya Soloveychik , Dmitry Trushin , Ami Wiesel

We construct and analyze an estimator of association between random variables based on their similarity in both direction and magnitude. Under special conditions, the proposed measure becomes a robust and consistent estimator of the linear…

计量经济学 · 经济学 2026-01-21 Ilya Archakov

We study the problem of estimating E(g(X)), where g is a real-valued function of d variables and X is a d-dimensional Gaussian vector with a given covariance matrix. We present a new unbiased estimator for E(g(X)) that combines the…

统计理论 · 数学 2023-04-18 Nabil Kahale

This paper establishes sharp dimension-free concentration and expectation bounds for the deviation of a sample cross-covariance matrix from its mean. For sub-Gaussian random vectors, we prove a high-probability operator-norm bound governed…

概率论 · 数学 2026-05-19 Jiaheng Chen , Daniel Sanz-Alonso

We address structured covariance estimation in elliptical distributions by assuming that the covariance is a priori known to belong to a given convex set, e.g., the set of Toeplitz or banded matrices. We consider the General Method of…

机器学习 · 统计学 2023-07-19 Ilya Soloveychik , Ami Wiesel

In this work, we revisit the problem of estimating the mean and covariance of an unknown $d$-dimensional Gaussian distribution in the presence of an $\varepsilon$-fraction of adversarial outliers. The pioneering work of [DKK+16] gave a…

数据结构与算法 · 计算机科学 2021-10-25 Pravesh K. Kothari , Peter Manohar , Brian Hu Zhang