English
Related papers

Related papers: Simple Confidence Intervals for MCMC Without CLTs

200 papers

One of the most commonly used methods for forming confidence intervals for statistical inference is the empirical bootstrap, which is especially expedient when the limiting distribution of the estimator is unknown. However, despite its…

Statistics Theory · Mathematics 2020-11-24 Morgane Austern , Vasilis Syrgkanis

Methods that bypass analytical evaluations of the likelihood function have become an indispensable tool for statistical inference in many fields of science. These so-called likelihood-free methods rely on accepting and rejecting simulations…

This work develops central limit theorems for cross-validation and consistent estimators of its asymptotic variance under weak stability conditions on the learning algorithm. Together, these results provide practical, asymptotically-exact…

Machine Learning · Statistics 2020-11-03 Pierre Bayle , Alexandre Bayle , Lucas Janson , Lester Mackey

Transformers have become a standard architecture in machine learning, demonstrating strong in-context learning (ICL) abilities that allow them to learn from the prompt at inference time. However, uncertainty quantification for ICL remains…

Machine Learning · Statistics 2025-04-23 Zhe Huang , Simone Rossi , Rui Yuan , Thomas Hannagan

Introductory texts on statistics typically only cover the classical "two sigma" confidence interval for the mean value and do not describe methods to obtain confidence intervals for other estimators. The present technical report fills this…

Methodology · Statistics 2018-07-11 Christoph Dalitz

In the analysis of survey data it is of interest to estimate and quantify uncertainty about means or totals for each of several non-overlapping subpopulations, or areas. When the sample size for a given area is small, standard confidence…

Methodology · Statistics 2018-09-26 Kyle Burris , Peter Hoff

We assume a drift condition towards a small set and bound the mean square error of estimators obtained by taking averages along a single trajectory of a Markov chain Monte Carlo algorithm. We use these bounds to construct fixed-width…

Methodology · Statistics 2011-02-01 Krzysztof Latuszynski , Wojciech Niemiro

This study aims to evaluate the performance of power in the likelihood ratio test for changepoint detection by bootstrap sampling, and proposes a hypothesis test based on bootstrapped confidence interval lengths. Assuming i.i.d normally…

Methodology · Statistics 2020-11-10 Ryan Chen , Javier Cabrera

Simultaneous confidence bands (SCBs) for percentiles in linear regression are valuable tools with many applications. In this paper, we propose a novel criterion for comparing SCBs for percentiles, termed the Minimum Area Confidence Set…

Methodology · Statistics 2023-09-15 Lingjiao Wang , Yang Han , Wei Liu , Frank Bretz

Confidence ellipsoids for linear regression coefficients are constructed by observations from a mixture with varying concentrations. Two approaches are discussed. The first one is the nonparametric approach based on the weighted least…

Methodology · Statistics 2018-06-12 Vitalii Miroshnichenko , Rostyslav Maiboroda

We develop a Monte Carlo-free approach to inference post output from randomized algorithms with a convex loss and a convex penalty. The pivotal statistic based on a truncated law, called the selective pivot, usually lacks closed form…

Methodology · Statistics 2017-05-19 Snigdha Panigrahi , Jelena Markovic , Jonathan Taylor

Uncertainty quantification for estimation through stochastic optimization solutions in an online setting has gained popularity recently. This paper introduces a novel inference method focused on constructing confidence intervals with…

Machine Learning · Statistics 2026-03-24 Wanrong Zhu , Zhipeng Lou , Ziyang Wei , Wei Biao Wu

We propose a new method to construct confidence intervals for quantities that are associated with a stationary time series, which avoids direct estimation of the asymptotic variances. Unlike the existing tuning-parameter-dependent…

Methodology · Statistics 2010-05-13 Xiaofeng Shao

We consider interval estimation of the difference between two binomial proportions. Several methods of constructing such an interval are known. Unfortunately those confidence intervals have poor coverage probability: it is significantly…

Methodology · Statistics 2019-03-11 Wojciech Zieliński

We have investigated how uncertainties in the estimation of the detection efficiency affect the 90% confidence intervals in the unified approach for constructing confidence intervals. The study has been conducted for experiments where the…

Nuclear Experiment · Physics 2009-06-10 E. S. Smith

Conformal prediction methodologies have significantly advanced the quantification of uncertainties in predictive models. Yet, the construction of confidence regions for model parameters presents a notable challenge, often necessitating…

Machine Learning · Statistics 2024-05-30 Charles Guille-Escuret , Eugene Ndiaye

In this article, we derive an explicit formula for computing confidence interval for the mean of a bounded random variable. Moreover, we have developed multistage point estimation methods for estimating the mean value with prescribed…

Statistics Theory · Mathematics 2010-11-29 Xinjia Chen

We consider the problem of estimating confidence intervals for the mean of a random variable, where the goal is to produce the smallest possible interval for a given number of samples. While minimax optimal algorithms are known for this…

Machine Learning · Statistics 2020-06-19 Shengjia Zhao , Christopher Yeh , Stefano Ermon

We consider independent random variables (r.v.'s) with a common mean $\mu$ that either satisfy Lindeberg's condition, or are symmetric around $\mu$. Present forms of existing functional central limit theorems (FCLT's) for Studentized…

Statistics Theory · Mathematics 2009-01-30 Yuliya V. Martsynyuk

Confidence interval (CI) methods for stratified bilateral studies use intraclass correlation to avoid misleading results. In this article, we propose four CI methods (sample-size weighted global MLE-based Wald-type CI, complete MLE-based…

Methodology · Statistics 2023-03-27 Wanqing Tian , Chang-Xing Ma