English
Related papers

Related papers: On the Binomial Confidence Interval and Probabilis…

200 papers

Tolerance intervals provide bounds that contain a specified proportion of a population with a given confidence level, yet their construction remains challenging when parametric assumptions fail or sample sizes are small. Traditional…

Methodology · Statistics 2026-03-12 Tony Pourmohamad , Robert Richardson , Bruno Sansó

We introduce $\textit{Backward Conformal Prediction}$, a method that guarantees conformal coverage while providing flexible control over the size of prediction sets. Unlike standard conformal prediction, which fixes the coverage level and…

Machine Learning · Statistics 2026-02-13 Etienne Gauthier , Francis Bach , Michael I. Jordan

The construction of the Bayesian credible (confidence) interval for a Poisson observable including both the signal and background with and without systematic uncertainties is presented. Introducing the conditional probability satisfying the…

Data Analysis, Statistics and Probability · Physics 2015-05-13 Yong-Sheng Zhu

The evaluation of the error to be attributed to cut efficiencies is a common question in the practice of experimental particle physics. Specifically, the need to evaluate the efficiency of the cuts for background removal, when they are…

Data Analysis, Statistics and Probability · Physics 2009-02-02 Gioacchino Ranucci

Should prediction models always deliver a prediction? In the pursuit of maximum predictive performance, critical considerations of reliability and fairness are often overshadowed, particularly when it comes to the role of uncertainty.…

Machine Learning · Computer Science 2024-10-29 Anna Sokol , Nuno Moniz , Nitesh Chawla

Conservative inference is a major concern in simulation-based inference. It has been shown that commonly used algorithms can produce overconfident posterior approximations. Balancing has empirically proven to be an effective way to mitigate…

Machine Learning · Statistics 2023-04-24 Arnaud Delaunoy , Benjamin Kurt Miller , Patrick Forré , Christoph Weniger , Gilles Louppe

Conformal prediction is a popular, modern technique for providing valid predictive inference for arbitrary machine learning models. Its validity relies on the assumptions of exchangeability of the data, and symmetry of the given model…

Methodology · Statistics 2023-03-20 Rina Foygel Barber , Emmanuel J. Candes , Aaditya Ramdas , Ryan J. Tibshirani

We provide a detailed study of the estimation of probability distributions---discrete and continuous---in a stringent setting in which data is kept private even from the statistician. We give sharp minimax rates of convergence for…

Statistics Theory · Mathematics 2013-05-28 John C. Duchi , Michael I. Jordan , Martin J. Wainwright

Fitting high-dimensional statistical models often requires the use of non-linear parameter estimation procedures. As a consequence, it is generally impossible to obtain an exact characterization of the probability distribution of the…

Methodology · Statistics 2014-04-03 Adel Javanmard , Andrea Montanari

Score-based generative modeling, informally referred to as diffusion models, continue to grow in popularity across several important domains and tasks. While they provide high-quality and diverse samples from empirical distributions,…

Machine Learning · Statistics 2023-12-29 Jacopo Teneggi , Matthew Tivnan , J. Webster Stayman , Jeremias Sulam

Adaptive experiment designs can dramatically improve statistical efficiency in randomized trials, but they also complicate statistical inference. For example, it is now well known that the sample mean is biased in adaptive trials.…

Machine Learning · Statistics 2021-02-16 Vitor Hadad , David A. Hirshberg , Ruohan Zhan , Stefan Wager , Susan Athey

Conformal prediction delivers prediction intervals with distribution-free coverage, but its intervals can look overconfident in regions where the model is extrapolating, because standard conformal scores do not explicitly represent…

Machine Learning · Statistics 2026-03-10 Luben M. C. Cabezas , Sabina J. Sloman , Bruno M. Resende , Fanyi Wu , Michele Caprio , Rafael Izbicki

Probability predictions from binary regressions or machine learning methods ought to be calibrated: If an event is predicted to occur with probability $x$, it should materialize with approximately that frequency, which means that the…

Statistics Theory · Mathematics 2023-01-11 Timo Dimitriadis , Lutz Duembgen , Alexander Henzi , Marius Puke , Johanna Ziegel

An approach is presented for robustness analysis and quantum (unitary) control synthesis based on the classic method of averaging. The result is a multicriterion optimization competing the nominal (uncertainty-free) fidelity with a well…

Quantum Physics · Physics 2022-08-31 Robert L. Kosut , Gaurav Bhole , Herschel Rabitz

We develop and apply two calibration procedures for checking the coverage of approximate Bayesian credible sets including intervals estimated using Monte Carlo methods. The user has an ideal prior and likelihood, but generates a credible…

Computation · Statistics 2026-05-19 Jeong Eun Lee , Geoff K. Nicholls , Robin J. Ryder

This paper presents a conformal prediction procedure to generate two-sided or one-sided prediction intervals for survival times in the presence of right censoring. Specifically, the method provides two-sided predictive bounds for…

Methodology · Statistics 2025-06-23 Chris Holmes , Ariane Marandon

Posterior predictive p-values are a common approach to Bayesian model-checking. This article analyses their frequency behaviour, that is, their distribution when the parameters and the data are drawn from the prior and the model…

Statistics Theory · Mathematics 2015-03-31 Patrick Rubin-Delanchy , Daniel John Lawson

In Basili and Pratelli (2024), a novel and coherent concept of interval probability measures has been introduced, providing a method for representing imprecise probabilities and uncertainty. Within the framework of set algebra, we…

Statistics Theory · Mathematics 2024-04-25 Marcello Basili , Luca Pratelli

Currently, there is renewed interest in the problem, raised by Shafer in 1985, of updating probabilities when observations are incomplete. This is a fundamental problem in general, and of particular interest for Bayesian networks. Recently,…

Artificial Intelligence · Computer Science 2007-05-23 Gert de Cooman , Marco Zaffalon

We study nonasymptotic (finite-sample) confidence intervals for treatment effects in randomized experiments. In the existing literature, the effective sample sizes of nonasymptotic confidence intervals tend to be looser than the…