中文
相关论文

相关论文: Robust regression with covariate filtering: Heavy …

200 篇论文

Robust and sparse estimation of linear regression coefficients is investigated. The situation addressed by the present paper is that covariates and noises are sampled from heavy-tailed distributions, and the covariates and noises are…

机器学习 · 统计学 2022-10-11 Takeyuki Sasai

We study robust regression under a contamination model in which covariates are clean while the responses may be corrupted in an adaptive manner. Unlike the classical Huber's contamination model, where both covariates and responses may be…

统计理论 · 数学 2026-04-07 Ilias Diakonikolas , Chao Gao , Daniel M. Kane , Ankit Pensia , Dong Xie

Big data can easily be contaminated by outliers or contain variables with heavy-tailed distributions, which makes many conventional methods inadequate. To address this challenge, we propose the adaptive Huber regression for robust…

统计理论 · 数学 2018-10-11 Qiang Sun , Wenxin Zhou , Jianqing Fan

We consider a robust estimation of linear regression coefficients. In this note, we focus on the case where the covariates are sampled from an $L$-subGaussian distribution with unknown covariance, the noises are sampled from a distribution…

统计理论 · 数学 2024-05-27 Takeyuki Sasai , Hironori Fujisawa

A large body of work in the statistics and computer science communities dating back to Huber (Huber, 1960) has led to statistically and computationally efficient outlier-robust estimators. Two particular outlier models have received…

统计理论 · 数学 2024-11-26 Yeshwanth Cherapanamjeri , Daniel Lee

We tackle estimating sparse coefficients in a linear regression when the covariates are sampled from an $L$-subexponential random vector. This vector belongs to a class of distributions that exhibit heavier tails than Gaussian random…

统计理论 · 数学 2024-02-07 Takeyuki Sasai

In this paper, we develop connections between two seemingly disparate, but central, models in robust statistics: Huber's epsilon-contamination model and the heavy-tailed noise model. We provide conditions under which this connection…

机器学习 · 统计学 2019-07-03 Adarsh Prasad , Sivaraman Balakrishnan , Pradeep Ravikumar

Consider the problem of simultaneous estimation of location and variance matrix under Huber's contaminated Gaussian model. First, we study minimum $f$-divergence estimation at the population level, corresponding to a generative adversarial…

统计理论 · 数学 2022-08-09 Ziyue Wang , Zhiqiang Tan

We study the fundamental problems of Gaussian mean estimation and linear regression with Gaussian covariates in the presence of Huber contamination. Our main contribution is the design of the first sample near-optimal and almost linear-time…

数据结构与算法 · 计算机科学 2023-12-05 Ilias Diakonikolas , Daniel M. Kane , Ankit Pensia , Thanasis Pittas

Many modern datasets are collected automatically and are thus easily contaminated by outliers. This led to a regain of interest in robust estimation, including new notions of robustness such as robustness to adversarial contamination of the…

统计理论 · 数学 2023-05-05 Pierre Alquier , Mathieu Gerber

We investigate a problem estimating coefficients of linear regression under sparsity assumption when covariates and noises are sampled from heavy tailed distributions. Additionally, we consider the situation where not only covariates and…

机器学习 · 统计学 2024-08-05 Takeyuki Sasai , Hironori Fujisawa

Heavy-tailed metrics are common and often critical to product evaluation in the online world. While we may have samples large enough for Central Limit Theorem to kick in, experimentation is challenging due to the wide confidence interval of…

应用统计 · 统计学 2019-05-23 Jason , Wang , Pauline Burke

We study high-dimensional least-squares regression within a subgaussian statistical learning framework with heterogeneous noise. It includes $s$-sparse and $r$-low-rank least-squares regression when a fraction $\epsilon$ of the labels are…

统计理论 · 数学 2023-11-01 Philip Thompson

We investigate the high-dimensional properties of robust regression estimators in the presence of heavy-tailed contamination of both the covariates and response functions. In particular, we provide a sharp asymptotic characterisation of…

统计理论 · 数学 2024-06-03 Urte Adomaityte , Leonardo Defilippis , Bruno Loureiro , Gabriele Sicuro

Large outliers break down linear and nonlinear regression models. Robust regression methods allow one to filter out the outliers when building a model. By replacing the traditional least squares criterion with the least trimmed squares…

最优化与控制 · 数学 2012-06-07 Gleb Beliakov , Andrei Kelarev , John Yearwood

It is well-known that trimmed sample means are robust against heavy tails and data contamination. This paper analyzes the performance of trimmed means and related methods in two novel contexts. The first one consists of estimating…

统计理论 · 数学 2025-12-03 Roberto I. Oliveira , Lucas Resende

High-dimensional linear regression under heavy-tailed noise or outlier corruption is challenging, both computationally and statistically. Convex approaches have been proven statistically optimal but suffer from high computational costs,…

统计理论 · 数学 2023-05-11 Yinan Shen , Jingyang Li , Jian-Feng Cai , Dong Xia

We consider outlier-robust and sparse estimation of linear regression coefficients, when the covariates and the noises are contaminated by adversarial outliers and noises are sampled from a heavy-tailed distribution. Our results present…

统计理论 · 数学 2024-05-27 Takeyuki Sasai , Hironori Fujisawa

Cellwise outliers are likely to occur together with casewise outliers in modern data sets with relatively large dimension. Recent work has shown that traditional robust regression methods may fail for data sets in this paradigm. The…

统计理论 · 数学 2016-12-28 Andy Leung , Hongyang Zhang , Ruben H. Zamar

We study the problem of high-dimensional linear regression in a robust model where an $\epsilon$-fraction of the samples can be adversarially corrupted. We focus on the fundamental setting where the covariates of the uncorrupted samples are…

机器学习 · 计算机科学 2018-06-04 Ilias Diakonikolas , Weihao Kong , Alistair Stewart
‹ 上一页 1 2 3 10 下一页 ›