中文
相关论文

相关论文: Do we need to estimate the variance in robust mean…

200 篇论文

We benchmark the robustness of maximum likelihood based uncertainty estimation methods to outliers in training data for regression tasks. Outliers or noisy labels in training data results in degraded performances as well as incorrect…

机器学习 · 计算机科学 2022-02-09 Deebul S. Nair , Nico Hochgeschwender , Miguel A. Olivares-Mendez

Datasets with extreme observations and/or heavy-tailed error distributions are commonly encountered and should be analyzed with careful consideration of these features from a statistical perspective. Small deviations from an assumed model,…

统计方法学 · 统计学 2023-01-12 Meadhbh O'Neill , Kevin Burke

In this paper, we consider the problem of linear regression with heavy-tailed distributions. Different from previous studies that use the squared loss to measure the performance, we choose the absolute loss, which is capable of estimating…

机器学习 · 计算机科学 2018-10-26 Lijun Zhang , Zhi-Hua Zhou

The paper proposes some robust estimators of the finite population mean. Such estimators are particularly suitable in the presence of some outlying observations. Included as special cases of our general result are robust versions of the…

统计理论 · 数学 2008-12-18 Malay Ghosh

We study the problem of robustly estimating the mean of a $d$-dimensional distribution given $N$ examples, where most coordinates of every example may be missing and $\varepsilon N$ examples may be arbitrarily corrupted. Assuming each…

数据结构与算法 · 计算机科学 2021-05-04 Lunjia Hu , Omer Reingold

By introducing a weight function into the density power divergence, we develop a new class of robust and smooth estimators for the tail index of Pareto-type distributions, offering improved efficiency in the presence of outliers. These…

统计理论 · 数学 2025-07-25 Saida Mancer , Abdelhakim Necir , Djamel Meraghni

In this paper, we investigate the extreme-value methodology, to propose an improved estimator of the conditional tail expectation ($CTE$) for a loss distribution with a finite mean but infinite variance. The present work introduces a new…

统计理论 · 数学 2020-02-11 Mohamed Laidi , Abdelaziz Rassoul , Hamid Ould Rouis

We consider the problem of estimating the mean of a random vector based on i.i.d. observations and adversarial contamination. We introduce a multivariate extension of the trimmed-mean estimator and show its optimal performance under minimal…

统计理论 · 数学 2020-02-25 Gabor Lugosi , Shahar Mendelson

This paper examines robust functional data analysis for discretely observed data, where the underlying process encompasses various distributions, such as heavy tail, skewness, or contaminations. We propose a unified robust concept of…

统计方法学 · 统计学 2023-05-26 Lingxuan Shao , Fang Yao

A powerful robust mean estimator introduced by Catoni (2012) allows for mean estimation of heavy-tailed data while achieving the performance characteristics of classical mean estimator for sub-Gaussian data. While Catoni's framework has…

统计理论 · 数学 2026-02-16 Zhijun Cai , Xiang Li , Lihu Xu

Low-rank tensor models are widely used in statistics. However, most existing methods rely heavily on the assumption that data follows a sub-Gaussian distribution. To address the challenges associated with heavy-tailed distributions…

统计方法学 · 统计学 2025-09-16 Xiaoyu Zhang , Di Wang , Guodong Li , Defeng Sun

Robust and sparse estimation of linear regression coefficients is investigated. The situation addressed by the present paper is that covariates and noises are sampled from heavy-tailed distributions, and the covariates and noises are…

机器学习 · 统计学 2022-10-11 Takeyuki Sasai

This article proposes a new method of truncated estimation to estimate the tail index $\alpha$ of the extremely heavy-tailed distribution with infinite mean or variance. We not only present two truncated estimators $\hat{\alpha}$ and…

统计理论 · 数学 2022-09-13 F. Q. Tang , D. Han

We study the problem of heavy-tailed mean estimation in settings where the variance of the data-generating distribution does not exist. Concretely, given a sample $\mathbf{X} = \{X_i\}_{i = 1}^n$ from a distribution $\mathcal{D}$ over…

Sparse linear regression methods such as Lasso require a tuning parameter that depends on the noise variance, which is typically unknown and difficult to estimate in practice. In the presence of heavy-tailed noise or adversarial outliers,…

统计理论 · 数学 2025-06-17 Takeyuki Sasai , Hironori Fujisawa

High-dimensional covariance estimation is notoriously sensitive to outliers. While statistically optimal estimators exist for general heavy-tailed distributions, they often rely on computationally expensive techniques like semidefinite…

机器学习 · 统计学 2026-01-06 Even He

Randomized experiments are the gold standard for investigating causal relationships, with comparisons of potential outcomes under different treatment groups used to estimate treatment effects. However, outcomes with heavy-tailed…

统计方法学 · 统计学 2024-07-09 Hongzi Li , Wei Ma , Yingying Ma , Hanzhong Liu

We introduce a trimmed version of the Hill estimator for the index of a heavy-tailed distribution, which is robust to perturbations in the extreme order statistics. In the ideal Pareto setting, the estimator is essentially finite-sample…

统计方法学 · 统计学 2018-08-24 Shrijita Bhattacharya , Michael Kallitsis , Stilian Stoev

We use bias-reduced estimators of high quantiles, of heavy-tailed distributions, to introduce a new estimator of the mean in the case of infinite second moment. The asymptotic normality of the proposed estimator is established and checked,…

统计方法学 · 统计学 2014-05-09 Brahim Brahimi , Djamel Meraghni , Abdelhakim Necir , Djabrane Yahia

Different questions related with analysis of extreme values and outliers arise frequently in practice. To exclude extremal observations and outliers is not a good decision because they contain important information about the observed…

统计方法学 · 统计学 2018-01-17 Pavlina K. Jordanova , Monika P. Petkova