English
Related papers

Related papers: Outlier-Robust Sparse Mean Estimation for Heavy-Ta…

200 papers

We study mean change point testing problems for high-dimensional data, with exponentially- or polynomially-decaying tails. In each case, depending on the $\ell_0$-norm of the mean change vector, we separately consider dense and sparse…

Statistics Theory · Mathematics 2025-10-14 Mengchu Li , Yudong Chen , Tengyao Wang , Yi Yu

The central limit theorem introduced by Stute [The central limit theorem under random censorship. Ann. Statist. 1995; 23: 422-439] does not hold for some class of heavy-tailed distributions. In this paper, we make use of the extreme value…

Statistics Theory · Mathematics 2015-07-19 Louiza Soltane , Djamel Meraghni , Abdelhakim Necir

The theory of Bayesian learning incorporates the use of Student-t Processes to model heavy-tailed distributions and datasets with outliers. However, despite Student-t Processes having a similar computational complexity as Gaussian…

Machine Learning · Computer Science 2025-08-12 Jian Xu , Delu Zeng

A significant hurdle for analyzing large sample data is the lack of effective statistical computing and inference methods. An emerging powerful approach for analyzing large sample data is subsampling, by which one takes a random subsample…

Methodology · Statistics 2015-11-24 Rong Zhu , Ping Ma , Michael W. Mahoney , Bin Yu

Despite the successes of probabilistic models based on passing noise through neural networks, recent work has identified that such methods often fail to capture tail behavior accurately, unless the tails of the base distribution are…

Machine Learning · Statistics 2023-06-16 Feynman Liang , Liam Hodgkinson , Michael W. Mahoney

Standard statistical analysis is unable to provide reliable confidence intervals on expectation values of probability distributions that do not satisfy the conditions of the central limit theorem. We present a regression-based estimator of…

Data Analysis, Statistics and Probability · Physics 2019-06-24 Pablo Lopez Rios , Gareth J. Conduit

We consider the problem of robust compressed sensing whose objective is to recover a high-dimensional sparse signal from compressed measurements corrupted by outliers. A new sparse Bayesian learning method is developed for robust compressed…

Machine Learning · Statistics 2016-10-24 Qian Wan , Huiping Duan , Jun Fang , Hongbin Li

High-dimensional datasets are frequently subject to contamination by outliers and heavy-tailed noise, which can severely bias standard regularized estimators like the Lasso. While Maximum Mean Discrepancy (MMD) has recently been introduced…

Methodology · Statistics 2026-02-25 Xiaoning Kang , Lulu Kang

Heavy-tailed noise is pervasive in modern machine learning applications, arising from data heterogeneity, outliers, and non-stationary stochastic environments. While second-order methods can significantly accelerate convergence in…

Optimization and Control · Mathematics 2025-10-14 Abdurakhmon Sadiev , Peter Richtárik , Ilyas Fatkhullin

In this paper, we propose a sparse signal estimation algorithm that is suitable for many wireless communication systems, especially for the future millimeter wave and underwater communication systems. This algorithm is not only…

Information Theory · Computer Science 2018-07-20 Chongwen Huang , Lei Liu , Chau Yuen

We revisit the problem of estimating the mean of a real-valued distribution, presenting a novel estimator with sub-Gaussian convergence: intuitively, "our estimator, on any distribution, is as accurate as the sample mean is for the Gaussian…

Statistics Theory · Mathematics 2020-11-18 Jasper C. H. Lee , Paul Valiant

We consider distributed recursive estimation of consensus+innovations type in the presence of heavy-tailed sensing and communication noises. We allow that the sensing and communication noises are mutually correlated while independent…

Optimization and Control · Mathematics 2023-11-13 Manojlo Vukovic , Dusan Jakovetic , Dragana Bajovic , Soummya Kar

The best subset selection (or "best subsets") estimator is a classic tool for sparse regression, and developments in mathematical optimization over the past decade have made it more computationally tractable than ever. Notwithstanding its…

Methodology · Statistics 2022-01-11 Ryan Thompson

In this paper we develop a novel inferential approach based on geometric records for estimating the tail index of heavy-tailed distributions. We construct a maximum likelihood estimator for the Pareto model and establish its strong…

Statistics Theory · Mathematics 2026-04-30 Martín Alcalde , Raúl Gouet , Miguel Lafuente , F. Javier López , Gerardo Sanz

We study high-dimensional least-squares regression within a subgaussian statistical learning framework with heterogeneous noise. It includes $s$-sparse and $r$-low-rank least-squares regression when a fraction $\epsilon$ of the labels are…

Statistics Theory · Mathematics 2023-11-01 Philip Thompson

Big data is ubiquitous in practices, and it has also led to heavy computation burden. To reduce the calculation cost and ensure the effectiveness of parameter estimators, an optimal subset sampling method is proposed to estimate the…

Methodology · Statistics 2023-11-16 Haohui Han , Liya Fu

As an effective nonparametric method, empirical likelihood (EL) is appealing in combining estimating equations flexibly and adaptively for incorporating data information. To select important variables and estimating equations in the sparse…

Methodology · Statistics 2021-07-02 Jiaqi Li , Liya Fu

We study statistical inference and distributionally robust solution methods for stochastic optimization problems, focusing on confidence intervals for optimal values and solutions that achieve exact coverage asymptotically. We develop a…

Machine Learning · Statistics 2018-07-03 John Duchi , Peter Glynn , Hongseok Namkoong

We study linear models under heavy-tailed priors from a probabilistic viewpoint. Instead of computing a single sparse most probable (MAP) solution as in standard deterministic approaches, the focus in the Bayesian compressed sensing…

Computer Vision and Pattern Recognition · Computer Science 2014-03-05 George Papandreou , Alan Yuille

This paper introduces new empirical process tools for analyzing a broad class of statistical learning models under heavy-tailed noise and complex function classes. Our primary contribution is the derivation of two Dudley-type maximal…

Statistics Theory · Mathematics 2025-11-24 Yizhe Ding , Runze Li , Lingzhou Xue