English
Related papers

Related papers: Optimal Inference After Model Selection

200 papers

Selective inference is considered for testing trees and edges in phylogenetic tree selection from molecular sequences. This improves the previously proposed approximately unbiased test by adjusting the selection bias when testing many trees…

Applications · Statistics 2019-05-27 Hidetoshi Shimodaira , Yoshikazu Terada

The paper describes a generalized iterative proportional fitting procedure which can be used for maximum likelihood estimation in a special class of the general log-linear model. The models in this class, called relational, apply to…

Computation · Statistics 2014-04-01 Anna Klimova , Tamas Rudas

This paper describes how to specify probability models for data analysis via a backward induction procedure. The new approach yields coherent, prior-free uncertainty assessment. After presenting some intuition-building examples, the new…

Methodology · Statistics 2015-02-24 P. Richard Hahn

Test-time compute has emerged as a powerful paradigm for improving the performance of large language models (LLMs), where generating multiple outputs or refining individual chains can significantly boost answer accuracy. However, existing…

Machine Learning · Computer Science 2025-09-26 Sheng Liu , Tianlang Chen , Pan Lu , Haotian Ye , Yizheng Chen , Lei Xing , James Zou

The use of machine learning methods for predictive purposes has increased dramatically over the past two decades, but uncertainty quantification for predictive comparisons remains elusive. This paper addresses this gap by extending the…

Econometrics · Economics 2025-05-09 Juan Carlos Escanciano , Ricardo Parra

This paper aims to develop an effective model-free inference procedure for high-dimensional data. We first reformulate the hypothesis testing problem via sufficient dimension reduction framework. With the aid of new reformulation, we…

Methodology · Statistics 2022-05-17 Xu Guo , Runze Li , Zhe Zhang , Changliang Zou

In recent years, there has been substantial interest in the task of selective inference: inference on a parameter that is selected from the data. Many of the existing proposals fall into what we refer to as the \emph{infer-and-widen}…

Methodology · Statistics 2026-02-26 Ronan Perry , Zichun Xu , Olivia McGough , Daniela Witten

In this paper, we focus on regression estimation in both the inductive and the transductive case. We assume that we are given a set of features (which can be a base of functions, but not necessarily). We begin by giving a deviation…

Statistics Theory · Mathematics 2015-06-26 Pierre Alquier

Selection bias arises when the probability that an observation enters a dataset depends on variables related to the quantities of interest, leading to systematic distortions in estimation and uncertainty quantification. For example, in…

We propose a frequentist testing procedure that maintains a defined coverage and is optimal in the sense that it gives maximal power to detect deviations from a null hypothesis when the alternative to the null hypothesis is sampled from a…

Applications · Statistics 2020-07-07 Christian Bartels , Johanna Mielke , Ekkehard Glimm

We describe inferactive data analysis, so-named to denote an interactive approach to data analysis with an emphasis on inference after data analysis. Our approach is a compromise between Tukey's exploratory (roughly speaking "model free")…

Statistics Theory · Mathematics 2017-07-24 Nan Bi , Jelena Markovic , Lucy Xia , Jonathan Taylor

In the era of big data, analysts usually explore various statistical models or machine learning methods for observed data in order to facilitate scientific discoveries or gain predictive power. Whatever data and fitting procedures are…

Machine Learning · Statistics 2018-10-24 Jie Ding , Vahid Tarokh , Yuhong Yang

Bayes' rule describes how to infer posterior beliefs about latent variables given observations, and inference is a critical step in learning algorithms for latent variable models (LVMs). Although there are exact algorithms for inference and…

Machine Learning · Computer Science 2025-09-22 Sacha Sokoloski

Many model selection algorithms produce a path of fits specifying a sequence of increasingly complex models. Given such a sequence and the data used to produce them, we consider the problem of choosing the least complex model that is not…

Methodology · Statistics 2015-12-09 William Fithian , Jonathan Taylor , Robert Tibshirani , Ryan Tibshirani

In this paper we consider the problem of constructing confidence intervals for coefficients of martingale regression models (in particular, time series models) after variable selection. Although constructing confidence intervals are common…

Statistics Theory · Mathematics 2020-05-19 Ka Wai Tsang , Wei Dai

Conventional deep models predict a test sample with a single forward propagation, which, however, may not be sufficient for predicting hard-classified samples. On the contrary, we human beings may need to carefully check the sample many…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Shuaicheng Niu , Jiaxiang Wu , Yifan Zhang , Guanghui Xu , Haokun Li , Peilin Zhao , Junzhou Huang , Yaowei Wang , Mingkui Tan

Linear mixed-effects models have increasingly replaced mixed-model analyses of variance for statistical inference in factorial psycholinguistic experiments. Although LMMs have many advantages over ANOVA, like ANOVAs, setting them up for…

Applications · Statistics 2017-02-14 Hannes Matuschek , Reinhold Kliegl , Shravan Vasishth , Harald Baayen , Douglas Bates

We review approaches to statistical inference based on randomization. Permutation tests are treated as an important special case. Under a certain group invariance property, referred to as the ``randomization hypothesis,'' randomization…

Econometrics · Economics 2025-02-05 David M. Ritzwoller , Joseph P. Romano , Azeem M. Shaikh

We consider testing whether a set of Gaussian variables, selected from the data, is independent of the remaining variables. We assume that this set is selected via a very simple approach that is commonly used across scientific disciplines:…

Methodology · Statistics 2022-11-04 Arkajyoti Saha , Daniela Witten , Jacob Bien

The model-X conditional randomization test is a generic framework for conditional independence testing, unlocking new possibilities to discover features that are conditionally associated with a response of interest while controlling type-I…

Machine Learning · Computer Science 2023-02-21 Shalev Shaer , Yaniv Romano