English
Related papers

Related papers: Exact adaptive confidence intervals for linear reg…

200 papers

A reliable representation of uncertainty is essential for the application of modern machine learning methods in safety-critical settings. In this regard, the use of credal sets (i.e., convex sets of probability distributions) has recently…

Machine Learning · Computer Science 2026-03-10 Paul Hofman , Timo Löhr , Maximilian Muschalik , Yusuf Sale , Eyke Hüllermeier

We consider inference on a scalar regression coefficient under a constraint on the magnitude of the control coefficients. A class of estimators based on a regularized propensity score regression is shown to exactly solve a tradeoff between…

Econometrics · Economics 2023-08-11 Timothy B. Armstrong , Michal Kolesár , Soonwoo Kwon

By generating prediction intervals (PIs) to quantify the uncertainty of each prediction in deep learning regression, the risk of wrong predictions can be effectively controlled. High-quality PIs need to be as narrow as possible, whilst…

Machine Learning · Computer Science 2023-02-03 Haocheng Lei , Anthony Bellotti

We consider the problem of adaptive inference on a regression function at a point under a multivariate nonparametric regression setting. The regression function belongs to a H\"older class and is assumed to be monotone with respect to some…

Statistics Theory · Mathematics 2020-12-01 Koohyun Kwon , Soonwoo Kwon

We study the problem of conditional predictive inference on multiple outcomes missing at random (MAR) -- or equivalently, under covariate shift. While the weighted conformal prediction offers a tool for inference under covariate shift with…

Methodology · Statistics 2025-08-01 Yonghoon Lee , Edgar Dobriban , Eric Tchetgen Tchetgen

Bayes linear analysis and approximate Bayesian computation (ABC) are techniques commonly used in the Bayesian analysis of complex models. In this article we connect these ideas by demonstrating that regression-adjustment ABC algorithms…

Methodology · Statistics 2012-12-10 D. J. Nott , Y. Fan , L. Marshall , S. A. Sisson

It is generally appreciated that a frequentist analysis of a group sequential trial must in order to avoid inflating type I error account for the fact that one or more interim analyses were performed. It is also to a lesser extent realised…

Methodology · Statistics 2025-12-12 Simon Bang Kristensen , Erik Thorlund Parner

Forecasting armed conflicts is a critical area of research with the potential to save lives and mitigate suffering. While existing forecasting models offer valuable point predictions, they often lack individual-level uncertainty estimates,…

Methodology · Statistics 2026-01-14 David Randahl , Jonathan P. Williams , Håvard Hegre

The PAC-Bayesian approach is a powerful set of techniques to derive non- asymptotic risk bounds for random estimators. The corresponding optimal distribution of estimators, usually called the Gibbs posterior, is unfortunately intractable.…

Machine Learning · Statistics 2015-06-16 Pierre Alquier , James Ridgway , Nicolas Chopin

Conformal prediction (CP) is a wrapper around traditional machine learning models, giving coverage guarantees under the sole assumption of exchangeability; in classification problems, for a chosen significance level $\varepsilon$, CP…

Machine Learning · Computer Science 2023-02-23 Javier Abad , Umang Bhatt , Adrian Weller , Giovanni Cherubin

A fundamental problem in modern supervised learning is computing reliable conditional prediction intervals in high-dimensional settings: existing methods often rely on restrictive modelling assumptions, do not scale as predictor dimension…

Machine Learning · Statistics 2026-02-24 Daniel Salnikov , Dan Leonte , Kevin Michalewicz

We develop a general framework for constructing distribution-free prediction intervals for time series. Theoretically, we establish explicit bounds on conditional and marginal coverage gaps of estimated prediction intervals, which…

Methodology · Statistics 2023-02-20 Chen Xu , Yao Xie

PAC-Bayesian analysis is a frequentist framework for incorporating prior knowledge into learning. It was inspired by Bayesian learning, which allows sequential data processing and naturally turns posteriors from one processing step into…

Machine Learning · Computer Science 2025-04-10 Yi-Shan Wu , Yijie Zhang , Badr-Eddine Chérief-Abdellatif , Yevgeny Seldin

Inductive Conformal Prediction (ICP) is a set of distribution-free and model agnostic algorithms devised to predict with a user-defined confidence with coverage guarantee. Instead of having point predictions, i.e., a real number in the case…

Machine Learning · Statistics 2022-07-05 Martim Sousa

A numerical method is developed to solve linear semi-infinite programming problem (LSIP) in which the iterates produced by the algorithm are feasible for the original problem. This is achieved by constructing a sequence of standard linear…

Optimization and Control · Mathematics 2021-01-26 Shuxiong Wang

We address functional uncertainty quantification for ill-posed inverse problems where it is possible to evaluate a possibly rank-deficient forward model, the observation noise distribution is known, and there are known parameter…

Methodology · Statistics 2025-02-06 Michael Stanley , Pau Batlle , Pratik Patil , Houman Owhadi , Mikael Kuusela

The ability to perform offline A/B-testing and off-policy learning using logged contextual bandit feedback is highly desirable in a broad range of applications, including recommender systems, search engines, ad placement, and personalized…

Machine Learning · Computer Science 2019-08-30 Yi Su , Lequn Wang , Michele Santacatterina , Thorsten Joachims

We develop a new method for generating prediction sets that combines the flexibility of conformal methods with an estimate of the conditional distribution $P_{Y \mid X}$. Existing methods, such as conformalized quantile regression and…

Machine Learning · Statistics 2024-10-10 Vincent Plassier , Alexander Fishkov , Mohsen Guizani , Maxim Panov , Eric Moulines

Confidence intervals for a binomial parameter or for the ratio of Poisson means are commonly desired in high energy physics (HEP) applications such as measuring a detection efficiency or branching ratio. Due to the discreteness of the data,…

Data Analysis, Statistics and Probability · Physics 2009-12-23 Robert D. Cousins , Kathryn E. Hymes , Jordan Tucker

This paper studies the construction of adaptive confidence intervals under Huber's contamination model when the contamination proportion is unknown. For the robust confidence interval of a Gaussian mean, we show that the optimal length of…

Statistics Theory · Mathematics 2025-06-05 Yuetian Luo , Chao Gao