English
Related papers

Related papers: Affine Invariant Covariance Estimation for Heavy-T…

200 papers

We study the problem of high-dimensional linear regression in a robust model where an $\epsilon$-fraction of the samples can be adversarially corrupted. We focus on the fundamental setting where the covariates of the uncorrupted samples are…

Machine Learning · Computer Science 2018-06-04 Ilias Diakonikolas , Weihao Kong , Alistair Stewart

We study the fundamental problem of estimating the mean of a $d$-dimensional distribution with covariance $\Sigma \preccurlyeq \sigma^2 I_d$ given $n$ samples. When $d = 1$, \cite{catoni} showed an estimator with error $(1+o(1)) \cdot…

Statistics Theory · Mathematics 2024-02-20 Shivam Gupta , Samuel B. Hopkins , Eric Price

The problem of estimating the covariance matrix $\Sigma$ of a $p$-variate distribution based on its $n$ observations arises in many data analysis contexts. While for $n>p$, the classical sample covariance matrix $\hat{\Sigma}_n$ is a good…

Information Theory · Computer Science 2017-09-28 Maryia Kabanava , Holger Rauhut

We survey some of the recent advances in mean estimation and regression function estimation. In particular, we describe sub-Gaussian mean estimators for possibly heavy-tailed data both in the univariate and multivariate settings. We focus…

Statistics Theory · Mathematics 2019-06-12 Gabor Lugosi , Shahar Mendelson

In this paper, we develop a multiply robust inference procedure of the average treatment effect (ATE) for data with high-dimensional covariates. We consider the case where it is difficult to correctly specify a single parametric model for…

Methodology · Statistics 2025-09-03 Xintao Xia , Yumou Qiu

Heavy-tailed error distributions and predictors with anomalous values are ubiquitous in high-dimensional regression problems and can seriously jeopardize the validity of statistical analyses if not properly addressed. For more reliable…

Methodology · Statistics 2024-09-20 David Kepplinger

Estimation of tail quantities, such as expected shortfall or Value at Risk, is a difficult problem. We show how the theory of nonlinear expectations, in particular the Data-robust expectation introduced in [5], can assist in the…

Statistics Theory · Mathematics 2018-02-15 Samuel N. Cohen

We present a fast, differentially private algorithm for high-dimensional covariance-aware mean estimation with nearly optimal sample complexity. Only exponential-time estimators were previously known to achieve this guarantee. Given $n$…

Machine Learning · Computer Science 2025-11-26 Gavin Brown , Samuel B. Hopkins , Adam Smith

By introducing a weight function into the density power divergence, we develop a new class of robust and smooth estimators for the tail index of Pareto-type distributions, offering improved efficiency in the presence of outliers. These…

Statistics Theory · Mathematics 2025-07-25 Saida Mancer , Abdelhakim Necir , Djamel Meraghni

This paper introduces the partial Gini covariance, a novel dependence measure that addresses the challenges of high-dimensional inference with heavy-tailed errors, often encountered in fields like finance, insurance, climate, and biology.…

Methodology · Statistics 2024-11-21 Yilin Zhang , Songshan Yang , Yunan Wu , Lan Wang

Modeling heterogeneity on heavy-tailed distributions under a regression framework is challenging, and classical statistical methodologies usually place conditions on the distribution models to facilitate the learning procedure. However,…

Methodology · Statistics 2024-10-29 Jiaxi Wang , Yanxi Hou , Xingchi Li , Tiandong Wang

Heavy-tailed distributions have been studied in statistics, random matrix theory, physics, and econometrics as models of correlated systems, among other domains. Further, heavy-tail distributed eigenvalues of the covariance matrix of the…

Machine Learning · Computer Science 2021-05-25 John Y. Shin

A tail empirical process for heavy-tailed and right-censored data is introduced and its Gaussian approximation is established. In this context, a (weighted) new Hill-type estimator for positive extreme value index is proposed and its…

Statistics Theory · Mathematics 2018-02-06 Brahim Brahimi , Djamel Meraghni , Abdelhakim Necir , Louiza Soltane

We study high-probability convergence guarantees of learning on streaming data in the presence of heavy-tailed noise. In the proposed scenario, the model is updated in an online fashion, as new information is observed, without storing any…

Machine Learning · Computer Science 2024-05-02 Aleksandar Armacki , Pranay Sharma , Gauri Joshi , Dragana Bajovic , Dusan Jakovetic , Soummya Kar

Estimation of the covariance matrix has attracted a lot of attention of the statistical research community over the years, partially due to important applications such as Principal Component Analysis. However, frequently used empirical…

Statistics Theory · Mathematics 2018-06-19 Stanislav Minsker

One-rank perturbations of Wigner matrices have been closely studied: let $P=\frac{1}{\sqrt{n}}A+\theta vv^T$ with $A=(a_{ij})_{1 \leq i,j \leq n} \in \mathbb{R}^{n \times n}$ symmetric, $(a_{ij})_{1 \leq i \leq j \leq n}$ i.i.d. with…

Probability · Mathematics 2022-08-05 Simona Diaconu

Finite sample properties of random covariance-type matrices have been the subject of much research. In this paper we focus on the "lower tail" of such a matrix, and prove that it is subgaussian under a simple fourth moment assumption on the…

Probability · Mathematics 2013-12-11 Roberto Imbuzeiro Oliveira

In this paper we propose an estimator of spot covariance matrix which ensure symmetric positive semi-definite estimations. The proposed estimator relies on a suitable modification of the Fourier covariance estimator in Malliavin and Mancino…

Methodology · Statistics 2023-04-11 Jirô Akahori , Nien-Lin Liu , Maria Elvira Mancino , Tommaso Mariotti , Yukie Yasuda

We introduce a trimmed version of the Hill estimator for the index of a heavy-tailed distribution, which is robust to perturbations in the extreme order statistics. In the ideal Pareto setting, the estimator is essentially finite-sample…

Methodology · Statistics 2017-11-15 Shrijita Bhattacharya , Michael Kallitsis , Stilian Stoev

This paper introduces a flexible framework for the estimation of the conditional tail index of heavy tailed distributions. In this framework, the tail index is computed from an auxiliary linear regression model that facilitates estimation…

Econometrics · Economics 2024-09-23 João Nicolau , Paulo M. M. Rodrigues