English
Related papers

Related papers: Simultaneous adjustment of bias and coverage proba…

200 papers

We address functional uncertainty quantification for ill-posed inverse problems where it is possible to evaluate a possibly rank-deficient forward model, the observation noise distribution is known, and there are known parameter…

Methodology · Statistics 2025-02-06 Michael Stanley , Pau Batlle , Pratik Patil , Houman Owhadi , Mikael Kuusela

Constructing valid inferential methods for constrained parameters in normal and Poisson distributions represents two fundamental and important problems in applied statistics, for which there is currently no unified framework for statistical…

Methodology · Statistics 2026-04-13 Hezhi Lu , Qijun Wu

AB-testing is a very popular technique in web companies since it makes it possible to accurately predict the impact of a modification with the simplicity of a random split across users. One of the critical aspects of an AB-test is its…

Machine Learning · Statistics 2015-02-02 Cyrille Dubarry

Many scientific analyses require simultaneous comparison of multiple functionals of an unknown signal at once, calling for multidimensional confidence regions with guaranteed simultaneous frequentist under structural constraints (e.g.,…

Statistics Theory · Mathematics 2025-10-14 Pau Batlle , Pratik Patil , Michael Stanley , Javier Ruiz Lupon , Houman Owhadi , Mikael Kuusela

In this note we present studies of coverage and power for confidence intervals for a Poisson process with known background calculated using the Likelihood ratio (aka Feldman & Cousins) ordering with Bayesian treatment of uncertainties in…

Data Analysis, Statistics and Probability · Physics 2017-08-23 Jan Conrad , Fredrik Tegenfeldt

We study the frequentist properties of confidence intervals computed by the method known to statisticians as the Profile Likelihood. It is seen that the coverage of these intervals is surprisingly good over a wide range of possible…

Data Analysis, Statistics and Probability · Physics 2009-11-10 Wolfgang A. Rolke , Angel M. Lopez , Jan Conrad

Many modern estimators require bootstrapping to calculate confidence intervals because either no analytic standard error is available or the distribution of the parameter of interest is non-symmetric. It remains however unclear how to…

Methodology · Statistics 2018-09-13 Michael Schomaker , Christian Heumann

Randomized clinical trials are considered the gold standard for estimating causal effects. Nevertheless, in studies that are aimed at examining adverse effects of interventions, such trials are often impractical because of ethical and…

Methodology · Statistics 2020-01-20 Anthony D. Scotina , Andrew R. Zullo , Robert J. Smith , Roee Gutman

Conformal prediction builds marginally valid prediction intervals that cover the unknown outcome of a randomly drawn test point with a prescribed probability. However, in practice, data-driven methods are often used to identify specific…

Methodology · Statistics 2025-04-21 Ying Jin , Zhimei Ren

In this note we consider coverage of confidence intervals calculated with and without systematic uncertainties. These calculations follow the prescription originally proposed by Cousins & Highland but here extended to account for different…

High Energy Physics - Experiment · Physics 2007-05-23 J. Conrad , O. Botner , A. Hallgren , C. P. de los Heros

Bayesian analyses are often performed using so-called noninformative priors, with a view to achieving objective inference about unknown parameters on which available data depends. Noninformative priors depend on the relationship of the data…

Methodology · Statistics 2013-08-14 Nicholas Lewis

Bayesian inference requires specification of a single, precise prior distribution, whereas frequentist inference only accommodates a vacuous prior. Since virtually every real-world application falls somewhere in between these two extremes,…

Methodology · Statistics 2023-09-26 Ryan Martin

We compare several confidence intervals after model selection in the setting recently studied by Berk et al. [Ann. Statist. 41 (2013) 802-837], where the goal is to cover not the true parameter but a certain nonstandard quantity of interest…

Statistics Theory · Mathematics 2015-07-30 Hannes Leeb , Benedikt M. Pötscher , Karl Ewald

Expected coverage and expected length of 90% upper and lower limit and 68.27% central intervals are plotted as functions of the true signal for various values of expected background. Results for several objective priors are shown, and…

High Energy Physics - Experiment · Physics 2007-05-23 Ilya Narsky

Conformal Prediction methods have finite-sample distribution-free marginal coverage guarantees. However, they generally do not offer conditional coverage guarantees, which can be important for high-stakes decisions. In this paper, we…

Machine Learning · Statistics 2024-09-27 Ruijiang Gao , Mingzhang Yin , James McInerney , Nathan Kallus

When combining apparently inconsistent experimental results, one often implements errors on errors. The Particle Data Group's phenomenological prescription offers a practical solution but lacks a firm theoretical foundation. To address…

High Energy Physics - Phenomenology · Physics 2025-08-22 Satoshi Mishima , Kin-ya Oda

This paper develops a variance estimation framework for matching estimators that enables valid population inference for treatment effects. We provide theoretical analysis of a variance estimator that addresses key limitations in the…

Methodology · Statistics 2025-06-16 Xiang Meng , Aaron Smith , Luke Miratrix

The current standard Bayesian approach to model calibration, which assigns a Gaussian process prior to the discrepancy term, often suffers from issues of unidentifiability and computational complexity and instability. When the goal is to…

Methodology · Statistics 2019-09-13 Spencer Woody , Novin Ghaffari , Lauren Hund

Non-probability sampling, for example in the form of online panels, has become a fast and cheap method to collect data. While reliable inference tools are available for classical probability samples, non-probability samples can yield…

Methodology · Statistics 2022-04-05 Gerhard Tutz

In this article the issues are discussed with the Bayesian approach, least-square fits, and most-likely fits. Trying to counter these issues, a method, based on weighted confidence, is proposed for estimating probabilities and other…

Statistics Theory · Mathematics 2017-01-26 Fetze Pijlman