English
Related papers

Related papers: Sensitivity Analysis for Rare Events based on R\'e…

200 papers

This study examines sharp bounds on Arimoto's conditional R\'enyi entropy of order $\beta$ with a fixed another one of distinct order $\alpha \neq \beta$. Arimoto inspired the relation between the R\'enyi entropy and the $\ell_{r}$-norm of…

Information Theory · Computer Science 2020-08-24 Yuta Sakai , Ken-ichi Iwata

Outliers are ubiquitous in modern data sets. Distance-based techniques are a popular non-parametric approach to outlier detection as they require no prior assumptions on the data generating distribution and are simple to implement. Scaling…

Machine Learning · Statistics 2016-05-04 Mario Lucic , Olivier Bachem , Andreas Krause

Neural Processes (NPs) are deep probabilistic models that represent stochastic processes by conditioning their prior distributions on a set of context points. Despite their advantages in uncertainty estimation for complex distributions, NPs…

Machine Learning · Computer Science 2025-06-04 Xuesong Wang , He Zhao , Edwin V. Bonilla

One of the main goal of extreme value analysis is to estimate the probability of rare events given a sample from an unknown distribution. The upper tail behavior of this distribution is described by the extreme value index. We present a new…

Probability · Mathematics 2007-05-23 Laurent Gardes , Stephane Girard

This article provides a critical review of the main methods used to produce conservative estimators of probabilities of rare events, or critical failures, for reliability and certification studies in the broadest sense. These probabilities…

Statistics Theory · Mathematics 2024-03-27 Nicolas Bousquet

Chance constraints provide a principled framework to mitigate the risk of high-impact extreme events by modifying the controllable properties of a system. The low probability and rare occurrence of such events, however, impose severe…

Optimization and Control · Mathematics 2022-01-11 Shanyin Tong , Anirudh Subramanyam , Vishwas Rao

Rare events in the first-passage distributions of jump processes are capable of triggering anomalous reactions or series of events. Estimating their probability is particularly important when the jump probabilities have broad-tailed…

Statistical Mechanics · Physics 2024-05-06 Alessandro Vezzani , Raffaella Burioni

Automated event detection in the sequences is an important aspect of temporal data analytics. The events can be in the form of peaks, changes in data distribution, changes of spectral characteristics etc. In this work, we propose a…

Signal Processing · Electrical Eng. & Systems 2020-11-05 Mandar Kulkarni , Aria Abubakar

Many high-stakes AI applications target low-prevalence events, where apparent accuracy can conceal limited real-world value. Relevant AI models range from expert-defined rules and traditional machine learning to generative LLMs constrained…

Machine Learning · Computer Science 2025-10-07 G. Niklas Noren , Eva-Lisa Meldau , Johan Ellenius

In rare-event simulation, an importance sampling (IS) estimator is regarded as efficient if its relative error, namely the ratio between its standard deviation and mean, is sufficiently controlled. It is widely known that when a rare-event…

Statistics Theory · Mathematics 2022-10-31 Yuanlu Bai , Zhiyuan Huang , Henry Lam , Ding Zhao

Solving decision problems in complex, stochastic environments is often achieved by estimating the expected outcome of decisions via Monte Carlo sampling. However, sampling may overlook rare, but important events, which can severely impact…

Machine Learning · Statistics 2023-05-16 Lachlan Gibson , Marcus Hoerger , Dirk Kroese

Diffusion models are a class of probabilistic generative models that have been widely used as a prior for image processing tasks like text conditional generation and inpainting. We demonstrate that these models can be adapted to make…

Machine Learning · Computer Science 2023-06-14 Marc Finzi , Anudhyan Boral , Andrew Gordon Wilson , Fei Sha , Leonardo Zepeda-Núñez

Anomaly detection systems need to consider a lot of information when scanning for anomalies. One example is the context of the process in which an anomaly might occur, because anomalies for one process might not be anomalies for a different…

Machine Learning · Computer Science 2021-01-18 Sebastian Eresheim , Lukas Daniel Klausner , Patrick Kochberger

Transition path sampling is a method for estimating the rates of rare events in molecular systems based on the gradual transformation of a path distribution containing a small fraction of reactive trajectories into a biased distribution in…

Statistical Mechanics · Physics 2015-10-28 Pierre Terrier , Mihai-Cosmin Marinica , Manuel Athènes

Given a statistical model, we propose a novel estimation method that yields randomised estimators for the unknown distribution of an observed random variable. We establish non-asymptotic bounds for the performance of these estimators and…

Statistics Theory · Mathematics 2026-05-06 Yannick Baraud

Chance-constrained optimization is a suitable modeling framework for safety-critical applications where violating constraints is nearly unacceptable. The scenario approach is a popular solution method for these problems, due to its…

Optimization and Control · Mathematics 2026-03-19 Jaeseok Choi , Anand Deo , Constantino Lagoa , Anirudh Subramanyam

We are interested in bounding probabilities of rare events in the context of computer experiments. These rare events depend on the output of a physical model with random input variables. Since the model is only known through an expensive…

Computation · Statistics 2012-03-21 Yves Auffray , Pierre Barbillon , Jean-Michel Marin

Limited overlap between treated and control groups is a key challenge in observational analysis. Standard approaches like trimming importance weights can reduce variance but introduce a fundamental bias. We propose a sensitivity framework…

Machine Learning · Statistics 2026-04-21 Yuanzhe Ma , Yian Huang , Hongseok Namkoong

Training classifiers is difficult with severe class imbalance, but many rare events are the culmination of a sequence with much more common intermediate outcomes. For example, in online marketing a user first sees an ad, then may click on…

Methodology · Statistics 2023-05-31 Gregory Faletto , Jacob Bien

For statistics of rare events in systems obeying a large-deviation principle, the rate function is a key quantity. When numerically estimating the rate function one is always restricted to finite system sizes. Thus, if the interest is in…

Data Analysis, Statistics and Probability · Physics 2024-12-06 Peter Werner , Alexander K. Hartmann