English
Related papers

Related papers: Higher-order approximate confidence intervals

200 papers

We study the empirical likelihood approach to construct confidence intervals for the optimal value and the optimality gap of a given solution, henceforth quantify the statistical uncertainty of sample average approximation, for optimization…

Methodology · Statistics 2016-10-25 Henry Lam , Enlu Zhou

We present a second-order estimator of the mean of a variable subject to missingness, under the missing at random assumption. The estimator improves upon existing methods by using an approximate second-order expansion of the parameter…

Statistics Theory · Mathematics 2015-11-30 Iván Díaz , Marco Carone , Mark J. van der Laan

Monte Carlo methods are used to approximate the means, $\mu$, of random variables $Y$, whose distributions are not known explicitly. The key idea is that the average of a random sample, $Y_1, ..., Y_n$, tends to $\mu$ as $n$ tends to…

Statistics Theory · Mathematics 2015-01-16 Fred J. Hickernell , Lan Jiang , Yuewei Liu , Art Owen

We provide an asymptotic expansion of the maximal mean squared error (MSE) of the sample median to be attained on shrinking gross error neighborhoods about an ideal central distribution. More specifically, this expansion comes in powers of…

Statistics Theory · Mathematics 2010-06-02 Peter Ruckdeschel

As large language models (LLMs) are increasingly deployed in critical decision-making systems, the lack of reliable methods to measure their uncertainty presents a fundamental trustworthiness risk. We introduce a normalized confidence score…

Machine Learning · Computer Science 2026-03-10 Xie Xiaohu , Liu Xiaohu , Yao Benjamin

We introduce a new adjusted residual maximum likelihood method (REML) in the context of producing an empirical Bayes (EB) confidence interval for a normal mean, a problem of great interest in different small area applications. Like other…

Statistics Theory · Mathematics 2014-08-29 Masayo Yoshimori , Partha Lahiri

Monte Carlo methods to evaluate and maximize the likelihood function enable the construction of confidence intervals and hypothesis tests, facilitating scientific investigation using models for which the likelihood function is intractable.…

Methodology · Statistics 2017-02-13 Edward L. Ionides , Carles Breto , Joonha Park , Richard A. Smith , Aaron A. King

We consider quantile estimation using Markov chain Monte Carlo and establish conditions under which the sampling distribution of the Monte Carlo error is approximately Normal. Further, we investigate techniques to estimate the associated…

Statistics Theory · Mathematics 2018-04-20 Charles Doss , James M. Flegal , Galin L. Jones , Ronald C. Neath

After performing a randomized experiment, researchers often use ordinary-least squares (OLS) regression to adjust for baseline covariates when estimating the average treatment effect. It is widely known that the resulting confidence…

Statistics Theory · Mathematics 2020-04-27 Kevin Guo , Guillaume Basse

We describe Monte Carlo approximation to the maximum likelihood estimator in models with intractable norming constants and explanatory variables. We consider both sources of randomness (due to the initial sample and to Monte Carlo…

Methodology · Statistics 2016-12-08 Blazej Miasojedow , Wojciech Niemiro , Jan Palczewski , Wojciech Rejchel

Recent advances in machine learning have significantly improved prediction accuracy in various applications. However, ensuring the calibration of probabilistic predictions remains a significant challenge. Despite efforts to enhance model…

Machine Learning · Statistics 2025-08-05 Yan Sun , Pratik Chaudhari , Ian J. Barnett , Edgar Dobriban

We consider penalized extremum estimation of a high-dimensional, possibly nonlinear model that is sparse in the sense that most of its parameters are zero but some are not. We use the SCAD penalty function, which provides model selection…

Econometrics · Economics 2024-02-23 Joel L. Horowitz , Ahnaf Rafi

Nonparametric two-stage procedures to construct fixed-width confidence intervals are studied to quantify uncertainty. It is shown that the validity of the random central limit theorem (RCLT) accompanied by a consistent and asymptotically…

Statistics Theory · Mathematics 2019-10-08 Yuan-Tsung Chang , Ansgar Steland

We derive inferential procedures for large sample sizes that remain valid under data-dependent significance levels (so-called "post-hoc valid inference"). Classical statistical tools require that the significance level -- the "type-I error"…

Statistics Theory · Mathematics 2026-03-10 Ben Chugg , Etienne Gauthier , Michael I. Jordan , Aaditya Ramdas , Ian Waudby-Smith

Importance sampling is a common technique for Monte Carlo approximation, including Monte Carlo approximation of p-values. Here it is shown that a simple correction of the usual importance sampling p-values creates valid p-values, meaning…

Computation · Statistics 2011-04-12 Matthew T. Harrison

In this article, we derive an explicit formula for computing confidence interval for the mean of a bounded random variable. Moreover, we have developed multistage point estimation methods for estimating the mean value with prescribed…

Statistics Theory · Mathematics 2010-11-29 Xinjia Chen

Empirical relationships are derived for the expected sampling error of quantile estimations using Monte Carlo experiments for two frequency distributions frequently encountered in climate sciences. The relationships found are expressed as a…

Methodology · Statistics 2016-10-12 Philippe Roy , René Laprise , Philippe Gachon

We contribute to bridging the gap between large- and finite-sample inference by studying confidence sets (CSs) that are both non-asymptotically valid and asymptotically exact uniformly (NAVAE) over semi-parametric statistical models. NAVAE…

Statistics Theory · Mathematics 2025-07-24 Alexis Derumigny , Lucas Girard , Yannick Guyonvarch

We describe a Monte Carlo method to approximate the maximum likelihood estimate (MLE), when there are missing data and the observed data likelihood is not available in closed form. This method uses simulated missing data that are…

Statistics Theory · Mathematics 2007-08-22 Yun Ju Sung , Charles J. Geyer

Importance sampling with data-driven proposal distributions is widely used in practice. A common workflow first generates an auxiliary sample of size $N$ from an approximation of the target distribution, constructs a density estimate $\hat…

Statistics Theory · Mathematics 2026-05-20 Cathrine Aeckerle-Willems , Ilja Klebanov , Simon Weissmann