English
Related papers

Related papers: Outlier-Robust Sparse Mean Estimation for Heavy-Ta…

200 papers

Linear regression with the classical normality assumption for the error distribution may lead to an undesirable posterior inference of regression coefficients due to the potential outliers. This paper considers the finite mixture of two…

Methodology · Statistics 2021-01-12 Yasuyuki Hamura , Kaoru Irie , Shonosuke Sugasawa

This paper studies sparse linear regression analysis with outliers in the responses. A parameter vector for modeling outliers is added to the standard linear regression model and then the sparse estimation problem for both coefficients and…

Statistics Theory · Mathematics 2015-05-21 Shota Katayama , Hironori Fujisawa

We consider high dimensional sparse regression, and develop strategies able to deal with arbitrary -- possibly, severe or coordinated -- errors in the covariance matrix $X$. These may come from corrupted data, persistent experimental…

Machine Learning · Statistics 2013-01-15 Yudong Chen , Constantine Caramanis , Shie Mannor

We study robust high-dimensional sparse regression under finite-variance heavy-tailed noise, epsilon-contamination, and alpha-mixing dependence via two subsampling estimators: Adaptive Importance Sampling (AIS) and Stratified Sub-sampling…

Statistics Theory · Mathematics 2026-03-11 Prateek Mittal , Joohi Chauhan

Aggregating data from multiple sources can be formalized as an Optimal Transport (OT) barycenter problem, which seeks to compute the average of probability distributions with respect to OT discrepancies. However, in real-world scenarios,…

Machine Learning · Statistics 2025-04-15 Milena Gazdieva , Jaemoo Choi , Alexander Kolesov , Jaewoong Choi , Petr Mokrov , Alexander Korotin

We present new estimators of the mean of a real valued random variable, based on PAC-Bayesian iterative truncation. We analyze the non-asymptotic minimax properties of the deviations of estimators for distributions having either a bounded…

Statistics Theory · Mathematics 2009-09-30 Olivier Catoni

In this paper we present a novel methodology to perform Bayesian model selection in linear models with heavy-tailed distributions. We consider a finite mixture of distributions to model a latent variable where each component of the mixture…

Methodology · Statistics 2017-08-21 Flávio B Gonçalves , Marcos O. Prates , Victor H. Lachos

In this paper, we propose a new accelerated stochastic first-order method called clipped-SSTM for smooth convex stochastic optimization with heavy-tailed distributed noise in stochastic gradients and derive the first high-probability…

Optimization and Control · Mathematics 2020-10-26 Eduard Gorbunov , Marina Danilova , Alexander Gasnikov

We propose methodology for estimation of sparse precision matrices and statistical inference for their low-dimensional parameters in a high-dimensional setting where the number of parameters $p$ can be much larger than the sample size. We…

Statistics Theory · Mathematics 2016-07-21 Jana Janková , Sara van de Geer

We consider the problem of sparsity-constrained $M$-estimation when both explanatory and response variables have heavy tails (bounded 4-th moments), or a fraction of arbitrary corruptions. We focus on the $k$-sparse, high-dimensional regime…

Machine Learning · Computer Science 2019-05-31 Liu Liu , Tianyang Li , Constantine Caramanis

This paper studies distributed estimation and support recovery for high-dimensional linear regression model with heavy-tailed noise. To deal with heavy-tailed noise whose variance can be infinite, we adopt the quantile regression loss…

Methodology · Statistics 2020-09-21 Xi Chen , Weidong Liu , Xiaojun Mao , Zhuoyi Yang

This paper proposes a robust Bayesian accelerated failure time model for censored survival data. We develop a new family of life-time distributions using a scale mixture of the generalized gamma distributions, where we propose a novel super…

Methodology · Statistics 2025-04-16 Yasuyuki Hamura , Takahiro Onizuka , Shintaro Hashimoto , Shonosuke Sugasawa

Adaptive importance sampling (AIS) algorithms are widely used to approximate expectations with respect to complicated target probability distributions. When the target has heavy tails, existing AIS algorithms can provide inconsistent…

Computation · Statistics 2023-10-26 Thomas Guilmeau , Nicola Branchini , Emilie Chouzenoux , Víctor Elvira

We consider the problem of hypothesis testing for discrete distributions. In the standard model, where we have sample access to an underlying distribution $p$, extensive research has established optimal bounds for uniformity testing,…

Machine Learning · Computer Science 2024-12-03 Maryam Aliakbarpour , Piotr Indyk , Ronitt Rubinfeld , Sandeep Silwal

We propose a robust estimator for the tail index of Pareto-type distributions under random right-censoring, constructed within the minimum density power divergence (MDPD) framework and based on the Nelson--Aalen estimator of the cumulative…

Statistics Theory · Mathematics 2026-01-27 Nour Elhouda Guesmia , Abdelhakim Necir , Djamel Meraghni

In this paper, we address the problem of conducting statistical inference in settings involving large-scale data that may be high-dimensional and contaminated by outliers. The high volume and dimensionality of the data require distributed…

Machine Learning · Statistics 2022-11-30 Emadaldin Mozafari-Majd , Visa Koivunen

In this paper, we investigate the extreme-value methodology, to propose an improved estimator of the conditional tail expectation ($CTE$) for a loss distribution with a finite mean but infinite variance. The present work introduces a new…

Statistics Theory · Mathematics 2020-02-11 Mohamed Laidi , Abdelaziz Rassoul , Hamid Ould Rouis

Sparse recovery is one of the most fundamental and well-studied inverse problems. Standard statistical formulations of the problem are provably solved by general convex programming techniques and more practical, fast (nearly-linear time)…

Data Structures and Algorithms · Computer Science 2022-03-09 Jonathan A. Kelner , Jerry Li , Allen Liu , Aaron Sidford , Kevin Tian

Several novel statistical methods have been developed to estimate large integrated volatility matrices based on high-frequency financial data. To investigate their asymptotic behaviors, they require a sub-Gaussian or finite high-order…

Statistics Theory · Mathematics 2023-08-15 Minseok Shin , Donggyu Kim , Jianqing Fan

We consider the fitting of heavy tailed data and distribution with a special attention to distributions with a non--standard shape in the "body" of the distribution. To this end we consider a dense class of heavy tailed distributions…

Statistics Theory · Mathematics 2017-05-15 Mogens Bladt , Leonardo Rojas-Nandayapa