English
Related papers

Related papers: Under-coverage in high-statistics counting experim…

200 papers

We study the problem of estimating finite sample confidence intervals of the mean of a normal population under the constraint of differential privacy. We consider both the known and unknown variance cases and construct differentially…

Cryptography and Security · Computer Science 2017-11-13 Vishesh Karwa , Salil Vadhan

Cosmological fine-tuning has traditionally been associated with the narrowness of the intervals in which the parameters of the physical models must be located to make life possible. A more thorough approach focuses on the probability of the…

History and Philosophy of Physics · Physics 2022-04-26 Daniel Andrés Díaz-Pachón , Ola Hössjer , Robert J. Marks

We provide finite-sample distribution approximations, that are uniform in the parameter, for inference in linear mixed models. Focus is on variances and covariances of random effects in cases where existing theory fails because their…

Statistics Theory · Mathematics 2025-07-29 Karl Oskar Ekvall , Matteo Bottai

We consider the estimation of rare-event probabilities using sample proportions output by naive Monte Carlo or collected data. Unlike using variance reduction techniques, this naive estimator does not have a priori relative efficiency…

Methodology · Statistics 2025-02-19 Yuanlu Bai , Henry Lam

Consider the observation of n iid realizations of an experiment with d>1 possible outcomes, which corresponds to a single observation of a multinomial distribution M(n,p) where p is an unknown discrete distribution on {1,...,d}. In many…

Computation · Statistics 2010-06-15 Djalil Chafai , Didier Concordet

We present a universal method to include residual un-modeled background shape uncertainties in likelihood based statistical tests for high energy physics and astroparticle physics. This approach provides a simple and natural protection…

Data Analysis, Statistics and Probability · Physics 2017-05-10 Nadav Priel , Ludwig Rauch , Hagar Landsman , Alessandro Manfredini , Ranny Budnik

Confidence interval procedures used in low dimensional settings are often inappropriate for high dimensional applications. When a large number of parameters are estimated, marginal confidence intervals associated with the most significant…

Methodology · Statistics 2017-02-24 Jean Morrison , Noah Simon

The purpose of this paper is to propose methodologies for statistical inference of low-dimensional parameters with high-dimensional data. We focus on constructing confidence intervals for individual coefficients and linear combinations of…

Methodology · Statistics 2012-11-05 Cun-Hui Zhang , Stephanie S. Zhang

Uncertainty quantification for complex deep learning models is increasingly important as these techniques see growing use in high-stakes, real-world settings. Currently, the quality of a model's uncertainty is evaluated using…

Machine Learning · Computer Science 2021-12-15 Benjamin Kompa , Jasper Snoek , Andrew Beam

Survival models incorporating random effects to account for unmeasured heterogeneity are being increasingly used in biostatistical and applied research. Specifically, unmeasured covariates whose lack of inclusion in the model would lead to…

Methodology · Statistics 2020-05-06 Alessandro Gasparini , Mark S. Clements , Keith R. Abrams , Michael J. Crowther

To conduct Bayesian inference with large data sets, it is often convenient or necessary to distribute the data across multiple machines. We consider a likelihood function expressed as a product of terms, each associated with a subset of the…

Computation · Statistics 2020-04-09 Lewis J. Rendell , Adam M. Johansen , Anthony Lee , Nick Whiteley

In this article, we introduce the concept of model confidence bounds (MCB) for variable selection in the context of nested models. Similarly to the endpoints in the familiar confidence interval for parameter estimation, the MCB identifies…

Methodology · Statistics 2018-07-27 Yang Li , Yuetian Luo , Davide Ferrari , Xiaonan Hu , Yichen Qin

Conformal inference has played a pivotal role in providing uncertainty quantification for black-box ML prediction algorithms with finite sample guarantees. Traditionally, conformal prediction inference requires a data-independent…

Methodology · Statistics 2023-07-04 Siddhaarth Sarkar , Arun Kumar Kuchibhotla

The analysis of results from HEP experiments often involves the estimates of the composition of the binned data samples, based on Monte Carlo simulations of various sources. Due to a finite statistic of MC samples they have statistical…

Data Analysis, Statistics and Probability · Physics 2017-11-22 Petr Mandrik

I propose a new type of confidence interval for correct asymptotic inference after using data to select a model of interest without assuming any model is correctly specified. This hybrid confidence interval is constructed by combining…

Methodology · Statistics 2021-11-25 Adam McCloskey

Whilst an abundance of techniques have recently been proposed to generate counterfactual explanations for the predictions of opaque black-box systems, markedly less attention has been paid to exploring the uncertainty of these generated…

Machine Learning · Computer Science 2021-07-22 Eoin Delaney , Derek Greene , Mark T. Keane

Robust inference for stochastic dynamical systems is often hampered by sparse sampling and the absence of closed-form likelihoods. We introduce a Monte Carlo path-inference framework that leverages full-path statistics and bridge processes…

Statistical Mechanics · Physics 2025-10-07 Javier Aguilar , Miguel A. Muñoz , Sandro Azaele

Mathematical models are essential for understanding and making predictions about systems arising in nature and engineering. Yet, mathematical models are a simplification of true phenomena, thus making predictions subject to uncertainty.…

Numerical Analysis · Mathematics 2023-03-03 Mark Hobbs , Hussein Rappel , Tim Dodwell

Statistical inference of the fundamental parameters of supersymmetric theories is a challenging and active endeavor. Several sophisticated algorithms have been employed to this end. While Markov-Chain Monte Carlo (MCMC) and nested sampling…

High Energy Physics - Phenomenology · Physics 2015-03-17 F. Feroz , K. Cranmer , M. Hobson , R. Ruiz de Austri , R. Trotta

Two of the most significant challenges in uncertainty quantification pertain to the high computational cost for simulating complex physical models and the high dimension of the random inputs. In applications of practical interest, both of…

Computational Engineering, Finance, and Science · Computer Science 2022-09-02 Jonas Nitzler , Jonas Biehler , Niklas Fehn , Phaedon-Stelios Koutsourelakis , Wolfgang A. Wall