English
Related papers

Related papers: Uncertainty Quantification and Confidence Interval…

200 papers

We present a model-agnostic algorithm for generating post-hoc explanations and uncertainty intervals for a machine learning model when only a static sample of inputs and outputs from the model is available, rather than direct access to the…

Machine Learning · Computer Science 2023-06-27 Surin Ahn , Justin Grana , Yafet Tamene , Kristian Holsheimer

We show that confidence intervals in a variance component model, with asymptotically correct uniform coverage probability, can be obtained by inverting certain test-statistics based on the score for the restricted likelihood. The results…

Methodology · Statistics 2024-11-05 Yiqiao Zhang , Karl Oskar Ekvall , Aaron J. Molstad

This article provides a critical review of the main methods used to produce conservative estimators of probabilities of rare events, or critical failures, for reliability and certification studies in the broadest sense. These probabilities…

Statistics Theory · Mathematics 2024-03-27 Nicolas Bousquet

Improving Importance Sampling estimators for rare event probabilities requires sharp approximations of conditional densities. This is achieved for events E_{n}:=(f(X_{1})+...+f(X_{n}))\inA_{n} where the summands are i.i.d. and E_{n} is a…

Probability · Mathematics 2012-02-08 Michel Broniatowski , Virgile Caron

Nonprobability (convenience) samples are increasingly sought to stabilize estimations for one or more population variables of interest that are performed using a randomized survey (reference) sample by increasing the effective sample size.…

For many important problems the quantity of interest is an unknown function of the parameters, which is a random vector with known statistics. Since the dependence of the output on this random vector is unknown, the challenge is to identify…

Machine Learning · Statistics 2021-04-28 Themistoklis P. Sapsis

Fidelity estimation for entangled states constitutes an essential building block for quality control and error detection in quantum networks. Nonetheless, quantum networks often encounter heterogeneous and correlated noise, leading to…

Quantum Physics · Physics 2024-11-18 Liangzhong Ruan , Bas Dirkse

Practical or scientific considerations often lead to selecting a subset of parameters as ``important.'' Inferences about those parameters often are based on the same data used to select them in the first place. That can make the reported…

Methodology · Statistics 2019-06-04 Yoav Benjamini , Yotam Hechtlinger , Philip B. Stark

Bayesian methods provide a natural means for uncertainty quantification, that is, credible sets can be easily obtained from the posterior distribution. But is this uncertainty quantification valid in the sense that the posterior credible…

Statistics Theory · Mathematics 2020-10-02 Ryan Martin , Bo Ning

Nonprobability (convenience) samples are increasingly sought to reduce the estimation variance for one or more population variables of interest that are estimated using a randomized survey (reference) sample by increasing the effective…

In this paper, we develop efficient randomized algorithms for estimating probabilistic robustness margin and constructing robustness degradation curve for uncertain dynamic systems. One remarkable feature of these algorithms is their…

Optimization and Control · Mathematics 2008-05-13 Xinjia Chen , Kemin Zhou , Jorge L. Aravena

For complex latent variable models, the likelihood function is not available in closed form. In this context, a popular method to perform parameter estimation is Importance Weighted Variational Inference. It essentially maximizes the…

Statistics Theory · Mathematics 2025-01-16 Badr-Eddine Cherief-Abdellatif , Randal Douc , Arnaud Doucet , Hugo Marival

While Deep Neural Networks (DNNs) achieve state-of-the-art accuracy in various applications, they often fall short in accurately estimating their predictive uncertainty and, in turn, fail to recognize when these predictions may be wrong.…

Machine Learning · Computer Science 2020-07-22 Ankur Mallick , Chaitanya Dwivedi , Bhavya Kailkhura , Gauri Joshi , T. Yong-Jin Han

Some classical uncertainty quantification problems require the estimation of multiple expectations. Estimating all of them accurately is crucial and can have a major impact on the analysis to perform, and standard existing Monte Carlo…

Methodology · Statistics 2022-12-02 Julien Demange-Chryst , François Bachoc , Jérôme Morio

In this paper, we propose a novel robust stochastic optimization approach with a distinctive consideration for rare events, in which divergence measures are used to bound the event-wise ambiguity sets. This is done by using the Poisson…

Optimization and Control · Mathematics 2021-09-14 Aakil M. Caunhye , Douglas Alem

Uncertainty quantification for estimation through stochastic optimization solutions in an online setting has gained popularity recently. This paper introduces a novel inference method focused on constructing confidence intervals with…

Machine Learning · Statistics 2026-03-24 Wanrong Zhu , Zhipeng Lou , Ziyang Wei , Wei Biao Wu

Data analysis in HEP experiments often uses binned likelihood from data and finite Monte Carlo sample. Statistical uncertainty of Monte Carlo sample has been introduced in Frequentist Inference in some literatures, but they are not suitable…

High Energy Physics - Experiment · Physics 2023-09-28 Shilin Liu , Clark McGrew

The recent growth in multi-fidelity uncertainty quantification has given rise to a large set of variance reduction techniques that leverage information from model ensembles to provide variance reduction for estimates of the statistics of a…

Methodology · Statistics 2021-01-11 Trung Pham , Alex A. Gorodetsky

Uncertainty quantification for complex deep learning models is increasingly important as these techniques see growing use in high-stakes, real-world settings. Currently, the quality of a model's uncertainty is evaluated using…

Machine Learning · Computer Science 2021-12-15 Benjamin Kompa , Jasper Snoek , Andrew Beam

Large Language Models have emerged as prime candidates to tackle misinformation mitigation. However, existing approaches struggle with hallucinations and overconfident predictions. We propose an uncertainty quantification framework that…

Computation and Language · Computer Science 2024-02-01 Mauricio Rivera , Jean-François Godbout , Reihaneh Rabbany , Kellin Pelrine