English
Related papers

Related papers: Bias, variance, and confidence intervals for effic…

200 papers

In an empirical Bayes analysis, we use data from repeated sampling to imitate inferences made by an oracle Bayesian with extensive knowledge of the data-generating distribution. Existing results provide a comprehensive characterization of…

Methodology · Statistics 2021-09-09 Nikolaos Ignatiadis , Stefan Wager

An important challenge in statistical analysis concerns the control of the finite sample bias of estimators. For example, the maximum likelihood estimator has a bias that can result in a significant inferential loss. This problem is…

Statistics Theory · Mathematics 2019-11-04 Stéphane Guerrier , Mucyo Karemera , Samuel Orso , Maria-Pia Victoria-Feser

The variance of the concentration in a sample can be estimated using knowledge of the particle masses, concentrations and the parameter for the dependent selection of particles. A number of variance estimators are constructed including a…

Applications · Statistics 2010-05-18 B. Geelhoed

We consider universal inference in variance components models, focusing on settings where the parameter is near or at the boundary of the parameter set. Two cases, which are not handled by existing state-of-the-art methods, are of…

Methodology · Statistics 2025-09-03 Yiqiao Zhang , Karl Oskar Ekvall , Aaron J. Molstad

The machine learning literature contains several constructions for prediction intervals that are intuitively reasonable but ultimately ad-hoc in that they do not come with provable performance guarantees. We present methods from the…

Machine Learning · Statistics 2020-02-25 Danijel Kivaranovic , Kory D. Johnson , Hannes Leeb

Adaptive experiment designs can dramatically improve statistical efficiency in randomized trials, but they also complicate statistical inference. For example, it is now well known that the sample mean is biased in adaptive trials.…

Machine Learning · Statistics 2021-02-16 Vitor Hadad , David A. Hirshberg , Ruohan Zhan , Stefan Wager , Susan Athey

Intensity estimation for Poisson processes is a classical problem and has been extensively studied over the past few decades. Practical observations, however, often contain compositional noise, i.e. a nonlinear shift along the time axis,…

Methodology · Statistics 2019-09-25 Glenna Schluck , Wei Wu , Anuj Srivastava

Estimating the probability of failure for expensive simulations is a central task in reliability analysis for structural design, power grid design, and safety certification, among other areas. This work derives credible intervals on the…

Methodology · Statistics 2026-03-16 Aleksei G. Sorokin , Vishwas Rao

In this report we discuss the treatment of statistical errors in cut efficiencies. The two commonly used methods for the calculation of the errors, Poissonian and Binomial, are shown to be defective. We derive the form of the underlying…

Data Analysis, Statistics and Probability · Physics 2012-05-15 T. Ullrich , Z. Xu

Efficient methods for characterizing the performance of quantum measurements are important in the experimental quantum sciences. Ideally, one requires both a physically relevant distinguishability measure between measurement operations and…

Quantum Physics · Physics 2015-06-12 Easwar Magesan , Paola Cappellaro

When releasing binary proportions computed using sensitive data, several government agencies and other data stewards protect confidentiality of the underlying values by ensuring the released statistics satisfy differential privacy.…

Methodology · Statistics 2025-11-06 Hsuan-Chen Kao , Jerome P. Reiter

The declining response rates in probability surveys along with the widespread availability of unstructured data has led to growing research into non-probability samples. Existing robust approaches are not well-developed for non-Gaussian…

Methodology · Statistics 2022-03-29 Ali Rafei , Michael R. Elliott , Carol A. C. Flannagan

In the linear random effects model, when distributional assumptions such as normality of the error variables cannot be justified, moments may serve as alternatives to describe relevant distributions in neighborhoods of their means.…

Statistics Theory · Mathematics 2012-03-05 Ping Wu , Winfried Stute , Li-Xing Zhu

Prediction for very large data sets is typically carried out in two stages, variable selection and pattern recognition. Ordinarily variable selection involves seeing how well individual explanatory variables are correlated with the…

Methodology · Statistics 2017-09-12 Herman Chernoff , Shaw-Hwa Lo , Tian Zheng , Adeline Lo

Given a randomized experiment with binary outcomes, exact confidence intervals for the average causal effect of the treatment can be computed through a series of permutation tests. This approach requires minimal assumptions and is valid for…

Methodology · Statistics 2025-06-19 P. M. Aronow , Haoge Chang , Patrick Lopatto

The purpose of this paper is to estimate the intensity of some random measure by a piecewise constant function on a finite partition of the underlying measurable space. Given a (possibly large) family of candidate partitions, we build a…

Statistics Theory · Mathematics 2007-06-13 Yannick Baraud , Lucien Birgé

Varying coefficient models are widely used to characterize dynamic associations between longitudinal outcomes and covariates. Existing work on varying coefficient models, however, all assumes that observation times are independent of the…

Methodology · Statistics 2026-01-27 Yu Gu , Yangjianchen Xu , Peijun Sang

The purpose of this paper is to propose methodologies for statistical inference of low-dimensional parameters with high-dimensional data. We focus on constructing confidence intervals for individual coefficients and linear combinations of…

Methodology · Statistics 2012-11-05 Cun-Hui Zhang , Stephanie S. Zhang

We consider the Roe-Woodroofe construction of confidence intervals for the case of a Poisson distributed variate where the mean is the sum of a known background and an unknown non-negative signal. We point out that the intervals do not have…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Mark Mandelkern , Jonas Schultz

This paper develops a multifidelity method that enables estimation of failure probabilities for expensive-to-evaluate models via information fusion and importance sampling. The presented general fusion method combines multiple probability…