English
Related papers

Related papers: Valid confidence intervals for post-model-selectio…

200 papers

Statistical inference after model selection requires an inference framework that takes the selection into account in order to be valid. Following recent work on selective inference, we derive analytical expressions for inference after…

Methodology · Statistics 2017-09-26 David Rügamer , Sonja Greven

In machine learning, the selection of a promising model from a potentially large number of competing models and the assessment of its generalization performance are critical tasks that need careful consideration. Typically, model selection…

Machine Learning · Statistics 2023-02-06 Pascal Rink , Werner Brannath

Two-step estimators often called upon to fit censored regression models in many areas of science and engineering. Since censoring incurs a bias in the naive least-squares fit, a two-step estimator first estimates the bias and then fits a…

Methodology · Statistics 2014-03-17 Yuekai Sun , Jonathan E. Taylor

Machine learning models are increasingly used to produce predictions that serve as input data in subsequent statistical analyses. For example, computer vision predictions of economic and environmental indicators based on satellite imagery…

Methodology · Statistics 2025-11-18 Dan M. Kluger , Kerri Lu , Tijana Zrnic , Sherrie Wang , Stephen Bates

Three-dimensional panel models are widely used in empirical analysis. Researchers use various combinations of fixed effects for three-dimensional panels. When one imposes a parsimonious model and the true model is rich, then it incurs…

Econometrics · Economics 2019-05-02 Harold D. Chiang , Joel Rodrigue , Yuya Sasaki

We develop tools for selective inference in the setting of group sparsity, including the construction of confidence intervals and p-values for testing selected groups of variables. Our main technical result gives the precise distribution of…

Methodology · Statistics 2016-07-28 Fan Yang , Rina Foygel Barber , Prateek Jain , John Lafferty

This paper introduces two methods for estimating reliable prediction intervals for local linear least-squares regressions, named Bounded Oscillation Prediction Intervals (BOPI). It also proposes a new measure for comparing interval…

Methodology · Statistics 2016-07-13 Mohammad Ghasemi Hamed , Masoud Ebadi Kivaj

In this paper, we provide a general methodology to draw statistical inferences on individual signal coordinates or linear combinations of them in sparse phase retrieval. Given an initial estimator for the targeting parameter (some simple…

Methodology · Statistics 2020-09-29 Yisha Yao

The proposed approach extends the confidence posterior distribution to the semi-parametric empirical Bayes setting. Whereas the Bayesian posterior is defined in terms of a prior distribution conditional on the observed data, the confidence…

Methodology · Statistics 2012-05-02 David R. Bickel

We congratulate the authors on their exciting paper, which introduces a novel idea for assessing the estimation bias in causal estimates. Doubly robust estimators are now part of the standard set of tools in causal inference, but a typical…

Methodology · Statistics 2020-06-18 Edward H. Kennedy , Sivaraman Balakrishnan , Larry A. Wasserman

This paper describes how to specify probability models for data analysis via a backward induction procedure. The new approach yields coherent, prior-free uncertainty assessment. After presenting some intuition-building examples, the new…

Methodology · Statistics 2015-02-24 P. Richard Hahn

We consider the problem of estimating the conditional distribution of a post-model-selection estimator where the conditioning is on the selected model. The notion of a post-model-selection estimator here refers to the combined procedure…

Statistics Theory · Mathematics 2007-11-06 Hannes Leeb , Benedikt M. Pötscher

We consider inference for M-estimators after model selection using a sparsity-inducing penalty. While existing methods for this task require bespoke inference procedures, we propose a simpler approach, which relies on two insights: (i)…

Methodology · Statistics 2026-01-21 Ronan Perry , Snigdha Panigrahi , Daniela Witten

Artificial intelligence (AI) and machine learning (ML) are increasingly used to generate data for downstream analyses, yet naively treating these predictions as true observations can lead to biased results and incorrect inference. Wang et…

We investigate the issue of post-selection inference for a fixed and a mixed parameter in a linear mixed model using a conditional Akaike information criterion as a model selection procedure. Within the framework of linear mixed models we…

Methodology · Statistics 2021-09-24 Gerda Claeskens , Katarzyna Reluga , Stefan Sperlich

We evaluate the model averaged profile likelihood confidence intervals proposed by Fletcher and Turek (2011) in a simple situation in which there are two linear regression models over which we average. We obtain exact expressions for the…

Methodology · Statistics 2017-10-18 Paul Kabaila , A. H. Welsh , Waruni Abeysekera

This work proposes new inference methods for a regression coefficient of interest in a (heterogeneous) quantile regression model. We consider a high-dimensional model where the number of regressors potentially exceeds the sample size but a…

Statistics Theory · Mathematics 2017-10-05 Alexandre Belloni , Victor Chernozhukov , Kengo Kato

A reasonable confidence interval should have a confidence coefficient no less than the given nominal level and a small expected length to reliably and accurately estimate the parameter of interest, and the bootstrap interval is considered…

Statistics Theory · Mathematics 2024-02-15 Weizhen Wang , Chongxiu Yu , Zhongzhan Zhang

Interval identification of parameters such as average treatment effects, average partial effects and welfare is particularly common when using observational data and experimental data with imperfect compliance due to the endogeneity of…

Econometrics · Economics 2025-04-09 Sukjin Han , Adam McCloskey

Applying standard statistical methods after model selection may yield inefficient estimators and hypothesis tests that fail to achieve nominal type-I error rates. The main issue is the fact that the post-selection distribution of the data…

Methodology · Statistics 2019-05-23 Amit Meir , Mathias Drton