English
Related papers

Related papers: The noise level in linear regression with dependen…

200 papers

We establish the asymptotic normality of the regression estimator in a fixed-design setting when the errors are given by a field of dependent random variables. The result applies to martingale-difference or strongly mixing random fields. On…

Statistics Theory · Mathematics 2009-07-10 Mohamed El Machkouri , Radu Stoica

The problem of differentiating a function with bounded second derivative in the presence of bounded measurement noise is considered in both continuous-time and sampled-data settings. Fundamental performance limitations of causal…

Systems and Control · Electrical Eng. & Systems 2023-03-28 Richard Seeber , Hernan Haimovich

We consider the frequency estimation of periodic signals using noisy time-of-arrival (TOA) information with missing (sparse) data contaminated with outliers. We tackle the problem from a mathematical optimization standpoint, formulating it…

Optimization and Control · Mathematics 2024-09-04 Romain Puech , Vincent Gouldieff

In this paper, we derive a central limit theorem for collections of weakly correlated random variables indexed by discrete metric spaces, where the correlation decays in the distance of the indices. The correlation structure we study…

Probability · Mathematics 2022-02-11 Michael Fleermann , Werner Kirsch

We prove a non-asymptotic distribution-independent lower bound for the expected mean squared generalization error caused by label noise in ridgeless linear regression. Our lower bound generalizes a similar known result to the…

Machine Learning · Statistics 2023-08-02 David Holzmüller

This paper considers statistical inference for the explained variance $\beta^{\intercal}\Sigma \beta$ under the high-dimensional linear model $Y=X\beta+\epsilon$ in the semi-supervised setting, where $\beta$ is the regression vector and…

Methodology · Statistics 2020-12-01 T. Tony Cai , Zijian Guo

In this paper we propose a novel methodology to construct Optimal Classification Trees that takes into account that noisy labels may occur in the training sample. Our approach rests on two main elements: (1) the splitting rules for the…

Machine Learning · Computer Science 2020-12-17 Víctor Blanco , Alberto Japón , Justo Puerto

Weighted empirical risk minimization is a common approach to prediction under distribution drift. This article studies its out-of-sample prediction error under nonstationarity. We provide a general decomposition of the excess risk into a…

Machine Learning · Statistics 2026-05-19 Tobias Brock , Thomas Nagler

We consider the problem of estimating how well a model class is capable of fitting a distribution of labeled data. We show that it is often possible to accurately estimate this "learnability" even when given an amount of data that is too…

Machine Learning · Computer Science 2019-03-26 Weihao Kong , Gregory Valiant

We study central limit theorems for linear statistics in high-dimensional Bayesian linear regression with product priors. Unlike the existing literature where the focus is on posterior contraction, we work under a non-contracting regime…

Statistics Theory · Mathematics 2025-08-01 Seunghyun Lee , Nabarun Deb , Sumit Mukherjee

The multivariate linear regression model with shuffled data and additive Gaussian noise arises in various correspondence estimation and matching problems. Focusing on the denoising aspect of this problem, we provide a characterization the…

Machine Learning · Statistics 2017-04-26 Ashwin Pananjady , Martin J. Wainwright , Thomas A. Courtade

(This is the third version of a working paper.) We develop a family of self-normalized concentration inequalities for marginal mean under martingale-difference structure and $\phi/\tilde{\phi}$-mixing conditions, where the latter includes…

Statistics Theory · Mathematics 2025-12-17 Zihao Yuan

We prove an elementary yet useful inequality bounding the maximal value of certain linear programs. This leads directly to a bound on the martingale difference for arbitrarily dependent random variables, providing a generalization of some…

Functional Analysis · Mathematics 2007-05-23 Leonid Kontorovich

We study the robustness of conformal prediction, a powerful tool for uncertainty quantification, to label noise. Our analysis tackles both regression and classification problems, characterizing when and how it is possible to construct…

Machine Learning · Computer Science 2024-11-27 Bat-Sheva Einbinder , Shai Feldman , Stephen Bates , Anastasios N. Angelopoulos , Asaf Gendler , Yaniv Romano

Although the standard formulations of prediction problems involve fully-observed and noiseless data drawn in an i.i.d. manner, many applications involve noisy and/or missing data, possibly involving dependence, as well. We study these…

Statistics Theory · Mathematics 2015-03-19 Po-Ling Loh , Martin J. Wainwright

The effect of measurement errors in discriminant analysis is investigated. Given observations $Z=X+\epsilon$, where $\epsilon$ denotes a random noise, the goal is to predict the density of $X$ among two possible candidates $f$ and $g$. We…

Statistics Theory · Mathematics 2015-05-13 Sébastien Loustau , Clément Marteau

Label noise widely exists in large-scale datasets and significantly degenerates the performances of deep learning algorithms. Due to the non-identifiability of the instance-dependent noise transition matrix, most existing algorithms address…

Machine Learning · Computer Science 2023-05-16 Hanwen Deng , Weijia Zhang , Min-Ling Zhang

This paper provides theoretical insights into high-dimensional binary classification with class-conditional noisy labels. Specifically, we study the behavior of a linear classifier with a label noisiness aware loss function, when both the…

Machine Learning · Computer Science 2024-05-24 Aymane El Firdoussi , Mohamed El Amine Seddik

How do statistical dependencies in measurement noise influence high-dimensional inference? To answer this, we study the paradigmatic spiked matrix model of principal components analysis (PCA), where a rank-one matrix is corrupted by…

Information Theory · Computer Science 2023-06-05 Jean Barbier , Francesco Camilli , Marco Mondelli , Manuel Saenz

A robust estimator for a wide family of mixtures of linear regression is presented. Robustness is based on the joint adoption of the Cluster Weighted Model and of an estimator based on trimming and restrictions. The selected model provides…

Methodology · Statistics 2015-02-05 L. A. Garcia-Escudero , A. Gordaliza , F. Greselin , S. Ingrassia , A. Mayo-Iscar