English
Related papers

Related papers: Confidence Intervals for Linear Models with Arbitr…

200 papers

We consider the problem of recovering the unknown noise variance in the linear regression model. To estimate the nuisance (a vector of regression coefficients) we use a family of spectral regularisers of the maximum likelihood estimator.…

Statistics Theory · Mathematics 2017-11-28 Yuri Golubev , Ekaterina Krymova

I propose a new type of confidence interval for correct asymptotic inference after using data to select a model of interest without assuming any model is correctly specified. This hybrid confidence interval is constructed by combining…

Methodology · Statistics 2021-11-25 Adam McCloskey

A rich set of frequentist model averaging methods has been developed, but their applications have largely been limited to point prediction, as measuring prediction uncertainty in general settings remains an open problem. In this paper we…

Econometrics · Economics 2025-10-21 Zhongjun Qu , Wendun Wang , Xiaomeng Zhang

Evaluating treatment effect heterogeneity widely informs treatment decision making. At the moment, much emphasis is placed on the estimation of the conditional average treatment effect via flexible machine learning algorithms. While these…

Methodology · Statistics 2021-05-07 Lihua Lei , Emmanuel J. Candès

Change point detection is becoming increasingly popular in many application areas. On one hand, most of the theoretically-justified methods are investigated in an ideal setting without model violations, or merely robust against identical…

Methodology · Statistics 2021-10-26 Mengchu Li , Yi Yu

In this paper, we study the problem of sparse mean estimation under adversarial corruptions, where the goal is to estimate the $k$-sparse mean of a heavy-tailed distribution from samples contaminated by adversarial noise. Existing methods…

Machine Learning · Computer Science 2025-08-26 Jianhao Ma , Rui Ray Chen , Yinghui He , Salar Fattahi , Wei Hu

Conformal prediction methodologies have significantly advanced the quantification of uncertainties in predictive models. Yet, the construction of confidence regions for model parameters presents a notable challenge, often necessitating…

Machine Learning · Statistics 2024-05-30 Charles Guille-Escuret , Eugene Ndiaye

In a standard classification framework a set of trustworthy learning data are employed to build a decision rule, with the final aim of classifying unlabelled units belonging to the test set. Therefore, unreliable labelled observations,…

Applications · Statistics 2019-11-20 Andrea Cappozzo , Francesca Greselin , Thomas Brendan Murphy

We study the multiplicative hazards model with intermittently observed longitudinal covariates and time-varying coefficients. For such models, the existing ad hoc approach, such as the last value carried forward, is biased. We propose a…

Methodology · Statistics 2025-03-13 Zhuowei Sun , Hongyuan Cao

Well-recommended methods of forming `confidence intervals' for a binomial proportion give interval estimates that do not actually meet the definition of a confidence interval, in that their coverages are sometimes lower than the nominal…

Statistics Theory · Mathematics 2021-06-30 Paul H. Garthwaite , Maha W. Moustafa , Fadlalla G. Elfadaly

We develop joint confidence regions for linear regression coefficients when the regressors and errors are jointly stationary and ergodic with unspecified serial dependence. The method applies random smoothing, using an independent auxiliary…

Methodology · Statistics 2026-05-21 Mous-Abou Hamadou , Martial Longla , Mathias Nthiani Muia , Mahmud Hasan

We tackle the problem of building a prediction interval in heteroscedastic Gaussian regression. We focus on prediction intervals with constrained expected length in order to guarantee interpretability of the output. In this framework, we…

Statistics Theory · Mathematics 2022-09-09 Christophe Denis , Mohamed Hebiri , Ahmed Zaoui

We study least-squares trace regression when the parameter is the sum of a $r$-low-rank matrix and a $s$-sparse matrix and a fraction $\epsilon$ of the labels is corrupted. For subgaussian distributions and feature-dependent noise, we…

Statistics Theory · Mathematics 2024-01-08 Philip Thompson

In this work, we propose a non-parametric and robust change detection algorithm to detect multiple change points in time series data under contamination. The contamination model is sufficiently general, in that, the most common model used…

Methodology · Statistics 2022-06-24 Sujay Bhatt , Guanhua Fang , Ping Li

Whereas confidence intervals are used to assess uncertainty due to unmeasured individuals, confounding intervals can be used to assess uncertainty due to unmeasured attributes. Previously, we have introduced a methodology for computing…

Methodology · Statistics 2025-08-13 Brian Knaeble , R Mitchell Hughes

We study the task of noiseless linear regression under Gaussian covariates in the presence of additive oblivious contamination. Specifically, we are given i.i.d.\ samples from a distribution $(x, y)$ on $\mathbb{R}^d \times \mathbb{R}$ with…

Data Structures and Algorithms · Computer Science 2025-10-14 Ilias Diakonikolas , Chao Gao , Daniel M. Kane , John Lafferty , Ankit Pensia

We propose a robust Bayesian formulation of random feature (RF) regression that accounts explicitly for prior and likelihood misspecification via Huber-style contamination sets. Starting from the classical equivalence between…

Machine Learning · Computer Science 2026-02-24 Michele Caprio , Katerina Papagiannouli , Siu Lun Chau , Sayan Mukherjee

In this work we consider the task of constructing prediction intervals in an inductive batch setting. We present a discriminative learning framework which optimizes the expected error rate under a budget constraint on the interval sizes.…

Machine Learning · Computer Science 2018-02-28 Nir Rosenfeld , Yishay Mansour , Elad Yom-Tov

High-dimensional regression models with regularized sparse estimation are widely applied. For statistical inferences, debiased methods are available about single coefficients or predictions with sparse new covariate vectors (also called…

Statistics Theory · Mathematics 2025-07-16 Libin Liang , Zhiqiang Tan

Classical semiparametric inference with missing outcome data is not robust to contamination of the observed data and a single observation can have arbitrarily large influence on estimation of a parameter of interest. This sensitivity is…

Methodology · Statistics 2021-03-02 Eva Cantoni , Xavier de Luna