English
Related papers

Related papers: Confidence Intervals for High-Dimensional Linear R…

200 papers

Conformal predictors, introduced by Vovk et al. (2005), serve to build prediction intervals by exploiting a notion of conformity of the new data point with previously observed data. In the present paper, we propose a novel method for…

Statistics Theory · Mathematics 2009-02-12 Mohamed Hebiri

In this work, we consider causal inference in various high-dimensional treatment settings, including for single multi-valued treatments and vector treatments with binary or continuous components, when the number of treatments can be…

Statistics Theory · Mathematics 2026-02-26 Patrick Kramer , Edward H. Kennedy , Isaac M. Opper

We consider the problem of constructing honest confidence intervals (CIs) for a scalar parameter of interest, such as the regression discontinuity parameter, in nonparametric regression based on kernel or local polynomial estimators. To…

Applications · Statistics 2020-04-08 Timothy B. Armstrong , Michal Kolesár

In the setting of high-dimensional linear models with Gaussian noise, we investigate the possibility of confidence statements connected to model selection. Although there exist numerous procedures for adaptive point estimation, the…

Statistics Theory · Mathematics 2009-10-07 Angelika Rohde , Lutz Duembgen

Confidence interval procedures used in low dimensional settings are often inappropriate for high dimensional applications. When a large number of parameters are estimated, marginal confidence intervals associated with the most significant…

Methodology · Statistics 2017-02-24 Jean Morrison , Noah Simon

The age of big data has produced data sets that are computationally expensive to analyze and store. Algorithmic leveraging proposes that we sample observations from the original data set to generate a representative data set and then…

Applications · Statistics 2018-03-13 Katelyn Gao

This paper revisits the classical problem of interval estimation of a binomial proportion under Huber contamination. Our main result derives the rate of optimal interval length when the contamination proportion is unknown under a local…

Statistics Theory · Mathematics 2026-01-13 Minjun Cho , Yuetian Luo , Chao Gao

This paper studies the construction of adaptive confidence intervals under Huber's contamination model when the contamination proportion is unknown. For the robust confidence interval of a Gaussian mean, we show that the optimal length of…

Statistics Theory · Mathematics 2025-06-05 Yuetian Luo , Chao Gao

Bayesian predictive inference provides a coherent description of entire predictive uncertainty through predictive distributions. We examine several widely used sparsity priors from the predictive (as opposed to estimation) inference…

Statistics Theory · Mathematics 2024-06-03 Veronika Rockova

Predictive models make mistakes. Hence, there is a need to quantify the uncertainty associated with their predictions. Conformal inference has emerged as a powerful tool to create statistically valid prediction regions around point…

Machine Learning · Statistics 2024-02-14 Luben M. C. Cabezas , Mateus P. Otto , Rafael Izbicki , Rafael B. Stern

In this paper we consider the problem of constructing confidence intervals for coefficients of martingale regression models (in particular, time series models) after variable selection. Although constructing confidence intervals are common…

Statistics Theory · Mathematics 2020-05-19 Ka Wai Tsang , Wei Dai

Statistical inference in high dimensional settings has recently attracted enormous attention within the literature. However, most published work focuses on the parametric linear regression problem. This paper considers an important…

Methodology · Statistics 2019-11-14 Qi Gao , Randy C. S. Lai , Thomas C. M. Lee , Yao Li

The behaviors of various confidence/credible interval constructions are explored, particularly in the region of low statistics where methods diverge most. We highlight a number of challenges, such as the treatment of nuisance parameters,…

Data Analysis, Statistics and Probability · Physics 2015-02-04 Steven D. Biller , Scott M. Oser

In this paper, we study a new notion of scaled minimaxity for sparse estimation in high-dimensional linear regression model. We present more optimistic lower bounds than the one given by the classical minimax theory and hence improve on…

Statistics Theory · Mathematics 2018-10-15 Mohamed Ndaoud

The question of fast convergence in the classical problem of high dimensional linear regression has been extensively studied. Arguably, one of the fastest procedures in practice is Iterative Hard Thresholding (IHT). Still, IHT relies…

Statistics Theory · Mathematics 2020-08-28 Mohamed Ndaoud

In this paper, we provide a general methodology to draw statistical inferences on individual signal coordinates or linear combinations of them in sparse phase retrieval. Given an initial estimator for the targeting parameter (some simple…

Methodology · Statistics 2020-09-29 Yisha Yao

Certifiable, adaptive uncertainty estimates for unknown quantities are an essential ingredient of sequential decision-making algorithms. Standard approaches rely on problem-dependent concentration results and are limited to a specific…

Machine Learning · Computer Science 2023-11-09 Nicolas Emmenegger , Mojmír Mutný , Andreas Krause

We explore a novel methodology for constructing confidence regions for parameters of linear models, using predictions from any arbitrary predictor. Our framework requires minimal assumptions on the noise and can be extended to functions…

Machine Learning · Statistics 2024-01-30 Charles Guille-Escuret , Eugene Ndiaye

Forward regression is a statistical model selection and estimation procedure which inductively selects covariates that add predictive power into a working statistical regression model. Once a model is selected, unknown regression parameters…

Machine Learning · Statistics 2018-04-12 Damian Kozbur

This manuscript studies a general approach to construct confidence sets for the solution of stochastic optimization, rendering empirical risk minimization as special cases. Statistical inference for stochastic optimization poses significant…

Statistics Theory · Mathematics 2026-05-22 Kenta Takatsu , Arun Kumar Kuchibhotla