English
Related papers

Related papers: Error analysis for probabilities of rare events wi…

200 papers

Evaluating rare-event forecasts is challenging because standard metrics collapse as event prevalence declines. Measures such as F1-score, AUPRC, MCC, and accuracy induce degenerate thresholds -- converging to zero or one -- and their values…

Methodology · Statistics 2025-12-02 Sotirios D. Nikolopoulos

We derive globally reliable a posteriori error estimators for a PDE-constrained optimization problem involving linear models in fluid dynamics as state equation; control constraints are also considered. The corresponding local error…

Numerical Analysis · Mathematics 2017-08-03 Alejandro Allendes , Enrique Otarola , Richard Rankin

We present a novel sampling-based method for estimating probabilities of rare or failure events. Our approach is founded on the Ensemble Kalman filter (EnKF) for inverse problems. Therefore, we reformulate the rare event problem as an…

Numerical Analysis · Mathematics 2021-12-15 Fabian Wagner , Iason Papaioannou , Elisabeth Ullmann

This paper considers the classical problem of sampling with Monte Carlo methods a target rare event distribution defined by a score function that is very expensive to compute. We assume we can build using evaluations of the true score, an…

Computation · Statistics 2024-10-25 Frédéric Cérou , Patrick Héas , Mathias Rousset

For rare events described in terms of Markov processes, truly unbiased estimation of the rare event probability generally requires the avoidance of numerical approximations of the Markov process. Recent work in the exact and…

Statistics Theory · Mathematics 2021-11-08 James Hodgson , Adam M. Johansen , Murray Pollock

We present a detailed study of roundoff errors in probabilistic floating-point computations. We derive closed-form expressions for the distribution of roundoff errors associated with a random variable, and we prove that roundoff errors are…

Logic in Computer Science · Computer Science 2021-05-28 George Constantinides , Fredrik Dahlqvist , Zvonimir Rakamaric , Rocco Salvia

Computing the probability of evidence even with known error bounds is NP-hard. In this paper we address this hard problem by settling on an easier problem. We propose an approximation which provides high confidence lower bounds on…

Artificial Intelligence · Computer Science 2012-06-26 Vibhav Gogate , Bozhena Bidyuk , Rina Dechter

Estimating the probability of extreme events involving multiple risk factors is a critical challenge in fields such as finance and climate science. This paper proposes a semi-parametric approach to estimate the probability that a…

Methodology · Statistics 2024-12-31 Anna Kiriliouk , Chen Zhou

This article focuses, in the context of epidemic models, on rare events that may possibly correspond to crisis situations from the perspective of Public Health. In general, no close analytic form for their occurrence probabilities is…

Applications · Statistics 2013-08-28 Stéphan Clémençon , Anthony Cousien , Miraine Dávila Felipe , Viet Chi Tran

Partial differential equation (PDE) models are widely used in engineering and natural sciences to describe spatio-temporal processes. The parameters of the considered processes are often unknown and have to be estimated from experimental…

Numerical Analysis · Mathematics 2016-12-21 Romana Boiger , Jan Hasenauer , Sabrina Hross , Barbara Kaltenbacher

Improving Importance Sampling estimators for rare event probabilities requires sharp approx- imations of the optimal density leading to a nearly zero-variance estimator. This paper presents a new way to handle the estimation of the…

Statistics Theory · Mathematics 2014-01-15 Virgile Caron

Confidence interval performance is typically assessed in terms of two criteria: coverage probability and interval width (or margin of error). In this paper, we assess the performance of four common proportion interval estimators: the Wald,…

Applications · Statistics 2024-01-17 Owen McGrath , Kevin Burke

We often rely on probabilistic measures -- e.g. event probability or expected time -- to characterize systems' safety. However, determining these quantities for extremely low-probability events is generally challenging, as standard safety…

Optimization and Control · Mathematics 2026-02-04 Aitor R. Gomez , Manuela L. Bujorianu , Rafal Wisniewski

Reliability sensitivity analysis is concerned with measuring the influence of a system's uncertain input parameters on its probability of failure. Statistically dependent inputs present a challenge in both computing and interpreting these…

Applications · Statistics 2023-06-21 Max Ehre , Iason Papaioannou , Daniel Straub

By their very nature, rare event probabilities are expensive to compute; they are also delicate to estimate as their value strongly depends on distributional assumptions on the model parameters. Hence, understanding the sensitivity of the…

Numerical Analysis · Mathematics 2021-10-28 Michael Merritt , Alen Alexanderian , Pierre Gremaud

Having reliable estimates of the occurrence rates of extreme events is highly important for insurance companies, government agencies and the general public. The rarity of an extreme event is typically expressed through its return period,…

Methodology · Statistics 2019-10-08 Ross Towe , Jonathan Tawn , Emma Eastoe , Rob Lamb

Computational approaches to PDE-constrained optimization under uncertainty may involve finite-dimensional approximations of control and state spaces, sample average approximations of measures of risk and reliability, smooth approximations…

Optimization and Control · Mathematics 2022-09-01 Peng Chen , Johannes O. Royset

Rare event simulation and rare event probability estimation are important tasks within the analysis of systems subject to uncertainty and randomness. Simultaneously, accurately estimating rare event probabilities is an inherently difficult…

Methodology · Statistics 2024-07-18 Max Ehre , Iason Papaioannou , Daniel Straub

A rare event is defined by a low probability of occurrence. Accurate estimation of such small probabilities is of utmost importance across diverse domains. Conventional Monte Carlo methods are inefficient, demanding an exorbitant number of…

Machine Learning · Computer Science 2023-10-31 Zhenggqi Gao , Dinghuai Zhang , Luca Daniel , Duane S. Boning

A central problem in uncertainty quantification is how to characterize the impact that our incomplete knowledge about models has on the predictions we make from them. This question naturally lends itself to a probabilistic formulation, by…

Statistical Mechanics · Physics 2018-09-03 Giovanni Dematteis , Tobias Grafke , Eric Vanden-Eijnden