English
Related papers

Related papers: On Various Confidence Intervals Post-Model-Selecti…

200 papers

To perform inference after model selection, we propose controlling the selective type I error; i.e., the error rate of a test given that it was performed. By doing so, we recover long-run frequency properties among selected hypotheses…

Statistics Theory · Mathematics 2017-04-19 William Fithian , Dennis Sun , Jonathan Taylor

We provide adaptive confidence intervals on a parameter of interest in the presence of nuisance parameters when some of the nuisance parameters have known signs. The confidence intervals are adaptive in the sense that they tend to be short…

Econometrics · Economics 2021-09-20 Philipp Ketz , Adam McCloskey

Bayesian model comparison is often based on the posterior distribution over the set of compared models. This distribution is often observed to concentrate on a single model even when other measures of model fit or forecasting ability…

Statistics Theory · Mathematics 2020-03-10 Oscar Oelrich , Shutong Ding , Måns Magnusson , Aki Vehtari , Mattias Villani

In this article, we introduce the concept of model confidence bounds (MCB) for variable selection in the context of nested models. Similarly to the endpoints in the familiar confidence interval for parameter estimation, the MCB identifies…

Methodology · Statistics 2018-07-27 Yang Li , Yuetian Luo , Davide Ferrari , Xiaonan Hu , Yichen Qin

Turing's estimator allows one to estimate the probabilities of outcomes that either do not appear or only rarely appear in a given random sample. We perform a simulation study to understand the finite sample performance of several related…

Statistics Theory · Mathematics 2025-03-19 Jie Chang , Michael Grabchak , Jialin Zhang

Consider a statistical problem where a set of parameters are of interest to a researcher. Then multiple confidence intervals can be constructed to infer the set of parameters simultaneously. The constructed multiple confidence intervals are…

Methodology · Statistics 2019-12-10 Taeho Kim , Edsel A. Pena

Standard random-effects meta-analysis methods perform poorly when applied to few studies only. Such settings however are commonly encountered in practice. It is unclear, whether or to what extent small-sample-size behaviour can be improved…

Methodology · Statistics 2019-01-15 Svenja E. Seide , Christian Röver , Tim Friede

We investigate the performance of model based bootstrap methods for constructing point-wise confidence intervals around the survival function with interval censored data. We show that bootstrapping from the nonparametric maximum likelihood…

Methodology · Statistics 2013-12-24 Bodhisattva Sen , Gongjun Xu

We develop methodology for valid inference after variable selection in logistic regression when the responses are partially observed, that is, when one observes a set of error-prone testing outcomes instead of the true values of the…

Methodology · Statistics 2025-04-17 Qinyan Shen , Karl Gregory , Xianzheng Huang

Measurements are generally collected as unilateral or bilateral data in clinical trials or observational studies. For example, in ophthalmology studies, the primary outcome is often obtained from one eye or both eyes of an individual. In…

Methodology · Statistics 2021-11-01 Kejia Wang , Chang-Xing Ma

Two-step estimators often called upon to fit censored regression models in many areas of science and engineering. Since censoring incurs a bias in the naive least-squares fit, a two-step estimator first estimates the bias and then fits a…

Methodology · Statistics 2014-03-17 Yuekai Sun , Jonathan E. Taylor

Often the goal of model selection is to choose a model for future prediction, and it is natural to measure the accuracy of a future prediction by squared error loss. Under the Bayesian approach, it is commonly perceived that the optimal…

Statistics Theory · Mathematics 2007-06-13 Maria Maddalena Barbieri , James O. Berger

Applying standard statistical methods after model selection may yield inefficient estimators and hypothesis tests that fail to achieve nominal type-I error rates. The main issue is the fact that the post-selection distribution of the data…

Methodology · Statistics 2019-05-23 Amit Meir , Mathias Drton

The traditional activity of model selection aims at discovering a single model superior to other candidate models. In the presence of pronounced noise, however, multiple models are often found to explain the same data equally well. To…

Methodology · Statistics 2017-09-14 Chao Zheng , Davide Ferrari , Yuhong Yang

Confidence intervals are central to statistical inference as a tool to evaluate the type I error risk at a given significance level. We devise a method to construct confidence intervals using a single run of a permutation test. This…

Methodology · Statistics 2022-06-22 Niels Lundtorp Olsen

Evaluating treatment effect heterogeneity widely informs treatment decision making. At the moment, much emphasis is placed on the estimation of the conditional average treatment effect via flexible machine learning algorithms. While these…

Methodology · Statistics 2021-05-07 Lihua Lei , Emmanuel J. Candès

While conformal predictors reap the benefits of rigorous statistical guarantees on their error frequency, the size of their corresponding prediction sets is critical to their practical utility. Unfortunately, there is currently a lack of…

Machine Learning · Statistics 2024-03-12 Guneet S. Dhillon , George Deligiannidis , Tom Rainforth

This essay looks at decision-making with interval-valued probability measures. Existing decision methods have either supplemented expected utility methods with additional criteria of optimality, or have attempted to supplement the…

Artificial Intelligence · Computer Science 2013-04-15 Ronald P. Loui

We show that two popular selective inference procedures, namely data carving (Fithian et al., 2017) and selection with a randomized response (Tian et al., 2018b), when combined with the polyhedral method (Lee et al., 2016), result in…

Methodology · Statistics 2024-02-22 Danijel Kivaranovic , Hannes Leeb

We derive confidence intervals and confidence sequences for causal effects in situations where the back-door or front-door criteria are applicable. Our tightest confidence intervals hold in the standard setting where the training data…

Statistics Theory · Mathematics 2026-05-26 Vladimir Vovk , Ruodu Wang