中文
相关论文

相关论文: Consistent regression when oblivious outliers over…

200 篇论文

Sparse linear regression is one of the most basic questions in machine learning and statistics. Here, we are given as input a design matrix $X \in \mathbb{R}^{N \times d}$ and measurements or labels ${y} \in \mathbb{R}^N$ where ${y} = {X}…

机器学习 · 计算机科学 2025-11-11 Gautam Chandrasekaran , Raghu Meka , Konstantinos Stavropoulos

We consider the least-squares regression problem with unknown noise variance, where the observed data points are allowed to be corrupted by outliers. Building on the median-of-means (MOM) method introduced by Lecue and Lerasle…

统计理论 · 数学 2021-03-19 G. Finocchio , A. Derumigny , K. Proksch

We consider computationally-efficient estimation of population parameters when observations are subject to missing data. In particular, we consider estimation under the realizable contamination model of missing data in which an $\epsilon$…

统计理论 · 数学 2026-03-18 Kabir Aladin Verchand , Ankit Pensia , Saminul Haque , Rohith Kuditipudi

Model averaging is an alternative to model selection for dealing with model uncertainty, which is widely used and very valuable. However, most of the existing model averaging methods are proposed based on the least squares loss function,…

统计方法学 · 统计学 2019-10-29 Miaomiao Wang , Guohua Zou

This paper studies the computational and statistical aspects of quantile and pseudo-Huber tensor decomposition. The integrated investigation of computational and statistical issues of robust tensor decomposition poses challenges due to the…

统计理论 · 数学 2023-09-07 Yinan Shen , Dong Xia

We study inference on a low-dimensional functional $\beta$ in the presence of infinite-dimensional nuisance parameters. Classical inferential methods are typically based on Wald intervals, whose large-sample validity rests on asymptotic…

统计方法学 · 统计学 2026-02-24 Mengchu Zheng , Matteo Bonvini , Zijian Guo

We consider the problem of fitting the parameters of a high-dimensional linear regression model. In the regime where the number of parameters $p$ is comparable to or exceeds the sample size $n$, a successful approach uses an…

统计理论 · 数学 2013-11-04 Adel Javanmard , Andrea Montanari

Large-scale regression problems where both the number of variables, $p$, and the number of observations, $n$, may be large and in the order of millions or more, are becoming increasingly more common. Typically the data are sparse: only a…

统计理论 · 数学 2018-02-27 Rajen D. Shah , Nicolai Meinshausen

Sparse linear regression with ill-conditioned Gaussian random designs is widely believed to exhibit a statistical/computational gap, but there is surprisingly little formal evidence for this belief, even in the form of examples that are…

数据结构与算法 · 计算机科学 2022-03-08 Jonathan A. Kelner , Frederic Koehler , Raghu Meka , Dhruv Rohatgi

Blockwise missing data occurs frequently when we integrate multisource or multimodality data where different sources or modalities contain complementary information. In this paper, we consider a high-dimensional linear regression model with…

统计方法学 · 统计学 2023-06-30 Fei Xue , Rong Ma , Hongzhe Li

Data-driven computing in applied mechanics utilizes the material data set directly, and hence is free from errors and uncertainties stemming from the conventional material modeling. This paper presents a data-driven approach that is robust…

数值分析 · 数学 2019-01-25 Yoshihiro Kanno

A large dimensional characterization of robust M-estimators of covariance (or scatter) is provided under the assumption that the dataset comprises independent (essentially Gaussian) legitimate samples as well as arbitrary deterministic…

统计理论 · 数学 2015-10-28 David Morales-Jimenez , Romain Couillet , Matthew R. McKay

We present a detailed study of estimation errors in terms of surrogate loss estimation errors. We refer to such guarantees as $\mathscr{H}$-consistency estimation error bounds, since they account for the hypothesis set $\mathscr{H}$…

机器学习 · 计算机科学 2022-05-18 Pranjal Awasthi , Anqi Mao , Mehryar Mohri , Yutao Zhong

We study efficient algorithms for linear regression and covariance estimation in the absence of Gaussian assumptions on the underlying distributions of samples, making assumptions instead about only finitely-many moments. We focus on how…

We consider the problem of robustly testing the norm of a high-dimensional sparse signal vector under two different observation models. In the first model, we are given $n$ i.i.d. samples from the distribution…

信息论 · 计算机科学 2022-11-08 Anand Jerry George , Clément L. Canonne

In regression analysis of multivariate data, it is tacitly assumed that response and predictor variables in each observed response-predictor pair correspond to the same entity or unit. In this paper, we consider the situation of "permuted…

统计理论 · 数学 2017-11-17 Martin Slawski , Emanuel Ben-David

This paper studies low-rank matrix completion in the presence of heavy-tailed and possibly asymmetric noise, where we aim to estimate an underlying low-rank matrix given a set of highly incomplete noisy entries. Though the matrix completion…

统计理论 · 数学 2022-06-10 Bingyan Wang , Jianqing Fan

Although a majority of the theoretical literature in high-dimensional statistics has focused on settings which involve fully-observed data, settings with missing values and corruptions are common in practice. We consider the problems of…

机器学习 · 统计学 2017-11-06 Yining Wang , Jialei Wang , Sivaraman Balakrishnan , Aarti Singh

This paper investigates the stability of deep ReLU neural networks for nonparametric regression under the assumption that the noise has only a finite p-th moment. We unveil how the optimal rate of convergence depends on p, the degree of…

统计理论 · 数学 2023-01-02 Jianqing Fan , Yihong Gu , Wen-Xin Zhou

Suppose that $\mathbf{y}=\lvert A\mathbf{x_0}\rvert+\eta$ where $\mathbf{x_0} \in \mathbb{R}^d$ is the target signal and $\eta\in \mathbb{R}^m$ is a noise vector. The aim of phase retrieval is to estimate $\mathbf{x_0}$ from $\mathbf{y}$. A…

信息论 · 计算机科学 2019-04-23 Meng Huang , Zhiqiang Xu