中文
相关论文

相关论文: Consistent regression when oblivious outliers over…

200 篇论文

A current strand of research in high-dimensional statistics deals with robustifying the available methodology with respect to deviations from the pervasive light-tail assumptions. In this paper we consider a linear mean regression model…

统计理论 · 数学 2025-02-06 Philipp Hermann , Hajo Holzmann

We revisit the problem of estimating the mean of a real-valued distribution, presenting a novel estimator with sub-Gaussian convergence: intuitively, "our estimator, on any distribution, is as accurate as the sample mean is for the Gaussian…

统计理论 · 数学 2020-11-18 Jasper C. H. Lee , Paul Valiant

Robust estimation under Huber's $\epsilon$-contamination model has become an important topic in statistics and theoretical computer science. Statistically optimal procedures such as Tukey's median and other estimators based on depth…

机器学习 · 统计学 2019-02-27 Chao Gao , Jiyi Liu , Yuan Yao , Weizhi Zhu

Phase retrieval (PR) is a popular research topic in signal processing and machine learning. However, its performance degrades significantly when the measurements are corrupted by noise or outliers. To address this limitation, we propose a…

最优化与控制 · 数学 2025-05-30 Jun Fan , Ailing Yan , Xianchao Xiu , Wanquan Liu

We study the fundamental task of outlier-robust mean estimation for heavy-tailed distributions in the presence of sparsity. Specifically, given a small number of corrupted samples from a high-dimensional heavy-tailed distribution whose mean…

数据结构与算法 · 计算机科学 2022-11-30 Ilias Diakonikolas , Daniel M. Kane , Jasper C. H. Lee , Ankit Pensia

We consider the statistical inverse problem of recovering a parameter $\theta\in H^\alpha$ from data arising from the Gaussian regression problem \begin{equation*} Y = \mathscr{G}(\theta)(Z)+\varepsilon \end{equation*} with nonlinear…

统计理论 · 数学 2025-09-30 Maximilian Siebel

We present a new Bayesian approach to model-robust linear regression that leads to uncertainty estimates with the same robustness properties as the Huber--White sandwich estimator. The sandwich estimator is known to provide asymptotically…

应用统计 · 统计学 2011-01-10 Adam A. Szpiro , Kenneth M. Rice , Thomas Lumley

We propose a new estimator for the high-dimensional linear regression model with observation error in the design where the number of coefficients is potentially larger than the sample size. The main novelty of our procedure is that the…

统计方法学 · 统计学 2019-09-09 Alexandre Belloni , Abhishek Kaul , Mathieu Rosenbaum

We focus on the high-dimensional linear regression problem, where the algorithmic goal is to efficiently infer an unknown feature vector $\beta^*\in\mathbb{R}^p$ from its linear measurements, using a small number $n$ of samples. Unlike most…

统计理论 · 数学 2023-09-19 David Gamarnik , Eren C. Kızıldağ , Ilias Zadik

We study the problem of robustly estimating the mean of a $d$-dimensional distribution given $N$ examples, where most coordinates of every example may be missing and $\varepsilon N$ examples may be arbitrarily corrupted. Assuming each…

数据结构与算法 · 计算机科学 2021-05-04 Lunjia Hu , Omer Reingold

We consider new formulations and methods for sparse quantile regression in the high-dimensional setting. Quantile regression plays an important role in many applications, including outlier-robust exploratory analysis in gene selection. In…

机器学习 · 统计学 2014-02-20 Aleksandr Y. Aravkin , Anju Kambadur , Aurelie C. Lozano , Ronny Luss

The focus of the paper is functional output regression (FOR) with convoluted losses. While most existing work consider the square loss setting, we leverage extensions of the Huber and the $\epsilon$-insensitive loss (induced by infimal…

机器学习 · 统计学 2022-06-17 Alex Lambert , Dimitri Bouche , Zoltan Szabo , Florence d'Alché-Buc

This paper studies the learning of linear operators between infinite-dimensional Hilbert spaces. The training data comprises pairs of random input vectors in a Hilbert space and their noisy images under an unknown self-adjoint linear…

We study the problem of computationally efficient robust estimation of the covariance/scatter matrix of elliptical distributions -- that is, affine transformations of spherically symmetric distributions -- under the strong contamination…

数据结构与算法 · 计算机科学 2025-04-15 Gleb Novikov

Additive regression models are actively researched in the statistical field because of their usefulness in the analysis of responses determined by non-linear relationships with multivariate predictors. In this kind of statistical models,…

应用统计 · 统计学 2018-03-14 German A. Schnaidt Grez , Brani Vidakovic

In practice, network applications have to deal with failing nodes, malicious attacks, or, somehow, nodes facing highly corrupted data --- generally classified as outliers. This calls for robust, uncomplicated, and efficient methods. We…

最优化与控制 · 数学 2014-10-10 Cláudia Soares , João Gomes

We re-investigate the asymptotic properties of the traditional OLS (pooled) estimator, $\hat{\beta} _P$, in the context of cluster dependence. The present study considers various scenarios under various restrictions on the cluster sizes and…

统计方法学 · 统计学 2025-01-31 Subhodeep Dey , Gopal K. Basak , Samarjit Das

Robust estimation of a mean vector, a topic regarded as obsolete in the traditional robust statistics community, has recently surged in machine learning literature in the last decade. The latest focus is on the sub-Gaussian performance and…

机器学习 · 统计学 2022-02-22 Yijun Zuo

For some special data in reality, such as the genetic data, adjacent genes may have the similar function. Thus ensuring the smoothness between adjacent genes is highly necessary. But, in this case, the standard lasso penalty just doesn't…

统计方法学 · 统计学 2022-09-29 Xin Xin , Boyi Xie , Yunhai Xiao

We consider the problem of performing linear regression over a stream of $d$-dimensional examples, and show that any algorithm that uses a subquadratic amount of memory exhibits a slower rate of convergence than can be achieved without…

机器学习 · 计算机科学 2020-10-13 Vatsal Sharan , Aaron Sidford , Gregory Valiant