English
Related papers

Related papers: Confidence Intervals for Linear Models with Arbitr…

200 papers

Constructing valid prediction intervals rather than point estimates is a well-established approach for uncertainty quantification in the regression setting. Models equipped with this capacity output an interval of values in which the ground…

Machine Learning · Statistics 2025-02-07 Thomas Pouplin , Alan Jeffares , Nabeel Seedat , Mihaela van der Schaar

In this paper, we study robust covariance estimation under the approximate factor model with observed factors. We propose a novel framework to first estimate the initial joint covariance matrix of the observed data and the factors, and then…

Methodology · Statistics 2016-02-03 Jianqing Fan , Weichen Wang , Yiqiao Zhong

We propose methodology for statistical inference for low-dimensional parameters of sparse precision matrices in a high-dimensional setting. Our method leads to a non-sparse estimator of the precision matrix whose entries have a Gaussian…

Statistics Theory · Mathematics 2015-08-13 Jana Jankova , Sara van de Geer

We study the problem of robustly estimating the mean or location parameter without moment assumptions. We show that for a large class of symmetric distributions, the same error as in the Gaussian setting can be achieved efficiently. The…

Data Structures and Algorithms · Computer Science 2023-11-09 Gleb Novikov , David Steurer , Stefan Tiegel

We study mean estimation for a Gaussian distribution with identity covariance in $\mathbb{R}^d$ under a missing data scheme termed realizable $\epsilon$-contamination model. In this model an adversary can choose a function $r(x)$ between 0…

Machine Learning · Computer Science 2026-03-18 Ilias Diakonikolas , Daniel M. Kane , Thanasis Pittas

This paper addresses the problems of conditional variance estimation and confidence interval construction in nonparametric regression using dense networks with the Rectified Linear Unit (ReLU) activation function. We present a…

The multivariate linear regression model with shuffled data and additive Gaussian noise arises in various correspondence estimation and matching problems. Focusing on the denoising aspect of this problem, we provide a characterization the…

Machine Learning · Statistics 2017-04-26 Ashwin Pananjady , Martin J. Wainwright , Thomas A. Courtade

When studying the causal effect of $x$ on $y$, researchers may conduct regression and report a confidence interval for the slope coefficient $\beta_{x}$. This common confidence interval provides an assessment of uncertainty from sampling…

Methodology · Statistics 2019-08-26 Brian Knaeble , Braxton Osting , Mark Abramson

In observational causal inference, domain knowledge often leaves multiple covariate adjustments plausible, yet which sets satisfy ignorability is untestable. Different adjustment sets can yield conflicting estimates of the average treatment…

Methodology · Statistics 2026-03-23 Aditya Ghosh , Dominik Rothenhäusler

We consider statistical models where functional data are artificially contaminated by independent Wiener processes in order to satisfy privacy constraints. We show that the corrupted observations have a Wiener density which determines the…

Statistics Theory · Mathematics 2019-12-18 Aurore Delaigle , Alexander Meister

For a regression problem with a binary label response, we examine the problem of constructing confidence intervals for the label probability conditional on the features. In a setting where we do not have any information about the underlying…

Statistics Theory · Mathematics 2020-10-09 Rina Foygel Barber

We consider in this paper the problem of estimating a parameter matrix from observations which are affected by two types of noise components: (i) a sparse noise sequence which, whenever nonzero can have arbitrarily large amplitude (ii) and…

Systems and Control · Computer Science 2017-11-07 Laurent Bako

It is in general challenging to provide confidence intervals for individual variables in high-dimensional regression without making strict or unverifiable assumptions on the design matrix. We show here that a "group-bound" confidence…

Methodology · Statistics 2014-06-12 Nicolai Meinshausen

The covariance for clean data given a noisy observation is an important quantity in many training-free guided generation methods for diffusion models. Current methods require heavy test-time computation, altering the standard diffusion…

Machine Learning · Computer Science 2025-03-25 Severi Rissanen , Markus Heinonen , Arno Solin

We present a simple and effective algorithm for the problem of \emph{sparse robust linear regression}. In this problem, one would like to estimate a sparse vector $w^* \in \mathbb{R}^n$ from linear measurements corrupted by sparse noise…

Data Structures and Algorithms · Computer Science 2019-01-08 Sushrut Karmalkar , Eric Price

The paper considers the problem of robust estimating a periodic function in a continuous time regression model with dependent disturbances given by a general square integrable semimartingale with unknown distribution. An example of such a…

Statistics Theory · Mathematics 2010-10-20 Victor Konev , Serguei Pergamenchtchikov

We consider the problem of estimating a signal corrupted by independent interference with the assistance of a cost-constrained helper who knows the interference causally or noncausally. When the interference is known causally, we…

Information Theory · Computer Science 2012-03-21 Yeow-Khiang Chia , Rajiv Soundararajan , Tsachy Weissman

We consider a general regression model, without a scale parameter. Our aim is to construct a confidence interval for a scalar parameter of interest $\theta$ that utilizes the uncertain prior information that a distinct scalar parameter…

Methodology · Statistics 2020-09-17 Paul Kabaila , Nishika Ranathunga

This paper concerns robust inference on average treatment effects following model selection. In the selection on observables framework, we show how to construct confidence intervals based on a doubly-robust estimator that are robust to…

Statistics Theory · Mathematics 2018-04-13 Max H. Farrell

Standard uncertainty estimation techniques, such as dropout, often struggle to clearly distinguish reliable predictions from unreliable ones. We attribute this limitation to noisy classifier weights, which, while not impairing overall…

Machine Learning · Computer Science 2025-06-09 Haripriya Harikumar , Santu Rana