English
Related papers

Related papers: Exact post-selection inference, with application t…

200 papers

Although a few methods have been developed recently for building confidence intervals after model selection, how to construct confidence sets for joint post-selection inference is still an open question. In this paper, we develop a new…

Methodology · Statistics 2021-03-19 Seunghyun Min , Qing Zhou

We develop a framework for post model selection inference, via marginal screening, in linear regression. At the core of this framework is a result that characterizes the exact distribution of linear functions of the response $y$,…

Methodology · Statistics 2014-03-03 Jason D Lee , Jonathan E Taylor

We propose a unified framework to draw inferences for regression coefficients in a generalized linear model (GLM) following Lasso-based variable selection. We adapt to non-Gaussian GLMs a recently developed parametric programming strategy…

Methodology · Statistics 2026-03-27 Qinyan Shen , Karl Gregory , Xianzheng Huang

We develop tools for selective inference in the setting of group sparsity, including the construction of confidence intervals and p-values for testing selected groups of variables. Our main technical result gives the precise distribution of…

Methodology · Statistics 2016-07-28 Fan Yang , Rina Foygel Barber , Prateek Jain , John Lafferty

Selective inference (post-selection inference) is a methodology that has attracted much attention in recent years in the fields of statistics and machine learning. Naive inference based on data that are also used for model selection tends…

Methodology · Statistics 2021-11-25 Yoshiyuki Ninomiya , Yuta Umezu , Ichiro Takeuchi

Construction of valid statistical inference for estimators based on data-driven selection has received a lot of attention in the recent times. Berk et al. (2013) is possibly the first work to provide valid inference for Gaussian…

The Tweedie exponential dispersion family is a popular choice among many to model insurance losses that consist of zero-inflated semicontinuous data. In such data, it is often important to obtain credibility (inference) of the most…

Methodology · Statistics 2025-07-17 Alokesh Manna , Zijian Huang , Dipak K. Dey , Yuwen Gu , Robin He

Among the most popular variable selection procedures in high-dimensional regression, Lasso provides a solution path to rank the variables and determines a cut-off position on the path to select variables and estimate coefficients. In this…

Methodology · Statistics 2018-06-19 X. Jessie Jeng , Huimin Peng , Wenbin Lu

We suggest general methods to construct asymptotically uniformly valid confidence intervals post-model-selection. The constructions are based on principles recently proposed by Berk et al. (2013). In particular the candidate models used can…

Statistics Theory · Mathematics 2017-11-15 François Bachoc , David Preinerstorfer , Lukas Steinberger

This thesis studies two problems in modern statistics. First, we study selective inference, or inference for hypothesis that are chosen after looking at the data. The motiving application is inference for regression coefficients selected by…

Machine Learning · Statistics 2015-07-02 Jason D. Lee

We derive expressions for the finite-sample distribution of the Lasso estimator in the context of a linear regression model in low as well as in high dimensions by exploiting the structure of the optimization problem defining the estimator.…

Statistics Theory · Mathematics 2020-02-25 Karl Ewald , Ulrike Schneider

The graphical lasso is a widely used algorithm for fitting undirected Gaussian graphical models. However, for inference on functionals of edge values in the learned graph, standard tools lack formal statistical guarantees, such as control…

Methodology · Statistics 2025-04-01 Sofia Guglielmini , Gerda Claeskens , Snigdha Panigrahi

Post-selection inference consists in providing statistical guarantees, based on a data set, that are robust to a prior model selection step on the same data set. In this paper, we address an instance of the post-selection-inference problem,…

Statistics Theory · Mathematics 2025-06-16 Dominique Bontemps , François Bachoc , Pierre Neuvial

Post-selection inference is a statistical technique for determining salient variables after model or variable selection. Recently, selective inference, a kind of post-selection inference framework, has garnered the attention in the…

Methodology · Statistics 2019-06-28 Yuta Umezu , Ichiro Takeuchi

Valid inference after model selection is currently a very active area of research. The polyhedral method, pioneered by Lee, et al. (2016), allows for valid inference after model selection if the model selection event can be described by…

Statistics Theory · Mathematics 2019-07-08 Danijel Kivaranovic , Hannes Leeb

Conditional selective inference requires an exact characterization of the selection event, which is often unavailable except for a few examples like the lasso. This work addresses this challenge by introducing a generic approach to estimate…

Methodology · Statistics 2023-08-22 Sifan Liu , Jelena Markovic-Voronov , Jonathan Taylor

We consider the problem of estimating the unconditional distribution of a post-model-selection estimator. The notion of a post-model-selection estimator here refers to the combined procedure resulting from first selecting a model (e.g., by…

Statistics Theory · Mathematics 2007-11-08 Hannes Leeb , Benedikt M. Poetscher

Linear mixed models (LMMs) are suitable for clustered data and are common in biometrics, medicine, survey statistics and many other fields. In those applications, it is essential to carry out valid inference after selecting a subset of the…

Methodology · Statistics 2023-09-14 Peter Kramlinger , Ulrike Schneider , Tatyana Krivobokova

We propose robust methods for inference on the effect of a treatment variable on a scalar outcome in the presence of very many controls. Our setting is a partially linear model with possibly non-Gaussian and heteroscedastic disturbances.…

Methodology · Statistics 2017-10-05 Alexandre Belloni , Victor Chernozhukov , Christian Hansen

Large-scale empirical data, the sample size and the dimension are high, often exhibit various characteristics. For example, the noise term follows unknown distributions or the model is very sparse that the number of critical variables is…

Statistics Theory · Mathematics 2018-06-18 Yuehan Yang , Hu Yang