English
Related papers

Related papers: A rigorous lower confidence bound for the expectat…

200 papers

The popular criteria of optimality for quickest change detection procedures are the Lorden criterion, the Shiryaev-Roberts-Pollak criterion, and the Bayesian criterion. In this paper a robust version of these quickest change detection…

Information Theory · Computer Science 2016-11-15 Jayakrishnan Unnikrishnan , Venugopal V. Veeravalli , Sean Meyn

The focus of this paper is on the quantification of sampling variation in frequentist probabilistic forecasts. We propose a method of constructing confidence sets that respects the functional nature of the forecast distribution, and use…

Methodology · Statistics 2017-08-09 David Harris , Gael M. Martin , Indeewara Perera , D. S. Poskitt

For any class of one-sided $1-\alpha$ confidence intervals with a certain monotonicity ordering on the random confidence limit, the smallest interval, in the sense of the set inclusion for the difference of two proportions of two…

Statistics Theory · Mathematics 2012-11-19 Weizhen Wang

We propose a general method for constructing confidence intervals and statistical tests for single or low-dimensional components of a large parameter vector in a high-dimensional model. It can be easily adjusted for multiplicity taking…

Statistics Theory · Mathematics 2014-06-24 Sara van de Geer , Peter Bühlmann , Ya'acov Ritov , Ruben Dezeure

We investigate generically applicable and intuitively appealing prediction intervals based on $k$-fold cross validation. We focus on the conditional coverage probability of the proposed intervals, given the observations in the training…

Statistics Theory · Mathematics 2022-05-13 Lukas Steinberger , Hannes Leeb

This paper considers a non-standard problem of generating samples from a low-temperature Gibbs distribution with \emph{constrained} support, when some of the coordinates of the mode lie on the boundary. These coordinates are referred to as…

Statistics Theory · Mathematics 2026-02-27 Ruixiao Wang , Xiaohong Chen , Sinho Chewi

Upper Confidence Bound (UCB) is arguably the most commonly used method for linear multi-arm bandit problems. While conceptually and computationally simple, this method highly relies on the confidence bounds, failing to strike the optimal…

Machine Learning · Computer Science 2020-06-05 Kaige Yang , Laura Toni

We revisit the problem of constructing predictive confidence sets for which we wish to obtain some type of conditional validity. We provide new arguments showing how ``split conformal'' methods achieve near desired coverage levels with high…

Statistics Theory · Mathematics 2025-03-04 John C. Duchi

As LLM-based judges become integral to industry applications, obtaining well-calibrated uncertainty estimates efficiently has become critical for production deployment. However, existing techniques, such as verbalized confidence and…

Machine Learning · Computer Science 2025-12-30 Bhaktipriya Radharapu , Eshika Saxena , Kenneth Li , Chenxi Whitehouse , Adina Williams , Nicola Cancedda

We propose a framework for analyzing the sensitivity of counterfactuals to parametric assumptions about the distribution of latent variables in structural models. In particular, we derive bounds on counterfactuals as the distribution of…

Econometrics · Economics 2024-03-26 Timothy Christensen , Benjamin Connault

This paper revisits a fundamental problem in statistical inference from a non-asymptotic theoretical viewpoint $\unicode{x2013}$ the construction of confidence sets. We establish a finite-sample bound for the estimator, characterizing its…

Statistics Theory · Mathematics 2023-01-03 Lang Liu , Zaid Harchaoui

We present a novel approach to estimating discrete distributions with (potentially) infinite support in the total variation metric. In a departure from the established paradigm, we make no structural assumptions whatsoever on the sampling…

Statistics Theory · Mathematics 2020-10-16 Doron Cohen , Aryeh Kontorovich , Geoffrey Wolfer

We study three notions of uncertainty quantification -- calibration, confidence intervals and prediction sets -- for binary classification in the distribution-free setting, that is without making any distributional assumptions on the data.…

Machine Learning · Statistics 2022-02-17 Chirag Gupta , Aleksandr Podkopaev , Aaditya Ramdas

Monte Carlo methods are used to approximate the means, $\mu$, of random variables $Y$, whose distributions are not known explicitly. The key idea is that the average of a random sample, $Y_1, ..., Y_n$, tends to $\mu$ as $n$ tends to…

Statistics Theory · Mathematics 2015-01-16 Fred J. Hickernell , Lan Jiang , Yuewei Liu , Art Owen

The characteristic function of the folded normal distribution and its moment function are derived. The entropy of the folded normal distribution and the Kullback--Leibler from the normal and half normal distributions are approximated using…

Methodology · Statistics 2014-02-17 Michail Tsagris , Christina Beneki , Hossein Hassani

Calibrated probability outputs of trained classifiers are increasingly used as inputs to downstream regression estimands such as effects, prevalences, or disparities for a latent group observed only on a small labelled subset. A standard…

Methodology · Statistics 2026-05-14 Marcell T. Kurbucz

We identify the critical deviation scale governing Bayesian evidence accumulation in regular parametric testing. Under integrated Bayes risk with zero-one loss, the risk-optimal rejection boundary lies in a moderate deviation regime, with a…

Statistics Theory · Mathematics 2026-03-23 Jyotishka Datta , Nicholas G. Polson , Vadim Sokolov , Daniel Zantedeschi

A trustworthy real-world prediction system should produce well-calibrated confidence scores; that is, its confidence in an answer should be indicative of the likelihood that the answer is correct, enabling deferral to an expert in cases of…

Computation and Language · Computer Science 2023-10-25 Katherine Tian , Eric Mitchell , Allan Zhou , Archit Sharma , Rafael Rafailov , Huaxiu Yao , Chelsea Finn , Christopher D. Manning

Conformal prediction delivers prediction intervals with distribution-free coverage, but its intervals can look overconfident in regions where the model is extrapolating, because standard conformal scores do not explicitly represent…

Machine Learning · Statistics 2026-03-10 Luben M. C. Cabezas , Sabina J. Sloman , Bruno M. Resende , Fanyi Wu , Michele Caprio , Rafael Izbicki

Variational inference methods for latent variable statistical models have gained popularity because they are relatively fast, can handle large data sets, and have deterministic convergence guarantees. However, in practice it is unclear…

Methodology · Statistics 2017-03-22 Hachem Saddiki , Andrew C. Trapp , Patrick Flaherty