English
Related papers

Related papers: Valid confidence intervals for regression with bes…

200 papers

Instrumental variable methods are among the most commonly used causal inference approaches to deal with unmeasured confounders in observational studies. The presence of invalid instruments is the primary concern for practical applications,…

Methodology · Statistics 2023-04-18 Zijian Guo

Valid uncertainty quantification after model selection remains challenging in high-dimensional linear regression, especially within the possibilistic inferential model (PIM) framework. We develop possibilistic inferential models for…

Methodology · Statistics 2025-12-23 Yaohui Lin

In adaptive clinical trials, the conventional confidence interval (CI) for a treatment effect is prone to undesirable properties such as undercoverage and potential inconsistency with the final hypothesis testing decision. Accordingly, as…

Post-selection inference consists in providing statistical guarantees, based on a data set, that are robust to a prior model selection step on the same data set. In this paper, we address an instance of the post-selection-inference problem,…

Statistics Theory · Mathematics 2025-06-16 Dominique Bontemps , François Bachoc , Pierre Neuvial

Model selection and order selection problems frequently arise in statistical practice. A popular approach to addressing these problems in the frequentist setting involves information criteria based on penalised maxima of log-likelihoods for…

Statistics Theory · Mathematics 2025-10-29 Hien Duy Nguyen , Mayetri Gupta , Jacob Westerhout , TrungTin Nguyen

In many conventional scientific investigations with high or ultra-high dimensional feature spaces, the relevant features, though sparse, are large in number compared with classical statistical problems, and the magnitude of their effects…

Statistics Theory · Mathematics 2011-07-14 Shan Luo , Zehua Chen

We present an efficient method of calculating exact confidence intervals for the hypergeometric parameter representing the number of "successes," or "special items," in the population. The method inverts minimum-width acceptance intervals…

Methodology · Statistics 2022-04-29 Jay Bartroff , Gary Lorden , Lijia Wang

Information criteria are an appropriate and widely used tool for solving model selection problems. However, different ways to use them exist, each leading to a more or less precise approximation of the sought model. In this paper, we mainly…

Statistics Theory · Mathematics 2007-06-13 Guilhem Coq , Olivier Alata , Marc Arnaudon , Christian Olivier

Information theoretic criteria (ITC) have been widely adopted in engineering and statistics for selecting, among an ordered set of candidate models, the one that better fits the observed sample data. The selected model minimizes a penalized…

Machine Learning · Statistics 2019-10-10 Andrea Mariani , Andrea Giorgetti , Marco Chiani

The age of big data has produced data sets that are computationally expensive to analyze and store. Algorithmic leveraging proposes that we sample observations from the original data set to generate a representative data set and then…

Applications · Statistics 2018-03-13 Katelyn Gao

We develop a method to generate prediction sets with a guaranteed coverage rate that is robust to corruptions in the training data, such as missing or noisy variables. Our approach builds on conformal prediction, a powerful framework to…

Machine Learning · Computer Science 2025-01-10 Shai Feldman , Yaniv Romano

We present a novel and easy-to-use method for calibrating error-rate based confidence intervals to evidence-based support intervals. Support intervals are obtained from inverting Bayes factors based on a parameter estimate and its standard…

Methodology · Statistics 2023-06-28 Samuel Pawel , Alexander Ly , Eric-Jan Wagenmakers

We consider the problem of constructing distribution-free prediction sets with finite-sample conditional guarantees. Prior work has shown that it is impossible to provide exact conditional coverage universally in finite samples. Thus, most…

Methodology · Statistics 2024-09-18 Isaac Gibbs , John J. Cherian , Emmanuel J. Candès

We test three common information criteria (IC) for selecting the order of a Hawkes process with an intensity kernel that can be expressed as a mixture of exponential terms. These processes find application in high-frequency financial data…

Statistical Finance · Quantitative Finance 2017-04-05 J. M. Chen , A. G. Hawkes , E. Scalas , M. Trinh

The semiparametric estimation approach, which includes inverse-probability-weighted and doubly robust estimation using propensity scores, is a standard tool in causal inference, and it is rapidly being extended in various directions. On the…

Methodology · Statistics 2022-12-29 Takamichi Baba , Yoshiyuki Ninomiya

In many analyses the object reported at the end is not fixed in advance, but is chosen after a preliminary search over variables, subgroups, transformations, models or contrasts. Classical selective-inference methods are most effective when…

Statistics Theory · Mathematics 2026-04-30 Sayantan Banerjee

This article illustrates how indirect or prior information can be optimally used to construct a prediction region that maintains a target frequentist coverage rate. If the indirect information is accurate, the volume of the prediction…

Statistics Theory · Mathematics 2021-06-01 Peter Hoff

For linear models with a diverging number of parameters, it has recently been shown that modified versions of Bayesian information criterion (BIC) can identify the true model consistently. However, in many cases there is little…

Methodology · Statistics 2011-07-26 Heng Lian

This paper introduces a conformal inference method to evaluate uncertainty in classification by generating prediction sets with valid coverage conditional on adaptively chosen features. These features are carefully selected to reflect…

Machine Learning · Statistics 2024-10-31 Yanfei Zhou , Matteo Sesia

The maximum likelihood estimator is used to determine fit parameters for various parametric models of the Fourier periodogram followed by the selection of the best fit model amongst competing models using the Akaike information criteria.…

Astrophysics of Galaxies · Physics 2015-06-19 P. Mohan , A. Mangalam , S. Chattopadhyay